DATA CENTRES, SERVER

FARMS, AND AI:

The Backbone of the Internet

Presented By:
Carlos Mundim, M.Sc. Eng.
University of Technology Sarawak (UTS)

www.ucts.edu.my
Disclaimer

This course is offered by the University of Technology Sarawak (UTS) as an extracurricular programme to
enhance student knowledge and career readiness.

• The course material is intended for educational purposes only.

• The views expressed in this document are those of the lecturer, Ing. Carlos Mundim, and do not
necessarily represent the official stance of UTS.

• While every effort has been made to ensure accuracy, the content should not be considered a
substitute for professional training or certification.
Introductory Note by The Honourable Deputy Chief Minister Datuk Amar Haji
Awang Tengah bin Ali Hasan

It is my great honour and privilege to introduce my personal friend and a truly exceptional
individual, Carlos Mundim, as the lecturer for this enlightening course on Data Centres, Server
Farms, and AI: The Backbone of the Internet.

Carlos is a visionary whose expertise and relentless passion have left a profound impact on
Sarawak’s development, particularly in the areas of energy, infrastructure, and technology. He
played an instrumental role in shaping the Tanjung Manis initiative and the Sarawak Corridor of
Renewable Energy (SCORE) Project, both of which are pivotal to Sarawak’s growth as a modern,
competitive state. Carlos was invaluable in attracting international partners and investors to these
projects, bridging global expertise with local ambition.

On the technology front, Carlos has been nothing short of a mastermind. It was his visionary
proposal that laid the foundation for creating the hyperscale green data centre in Sarawak. This
project, aimed at leveraging Sarawak’s abundant renewable energy resources, is poised to make
our state a leader in sustainable IT infrastructure and a global hub for data centre operations.

Carlos’s remarkable achievements are driven not just by his deep knowledge of engineering and IT
but by his unwavering commitment to advancing Sarawak and empowering its people. As an avid
communicator, traveller, and advocate for education, he embodies the values of curiosity,
innovation, and gratitude.

I have no doubt that this course will benefit immensely from Carlos’s wealth of experience, his
global perspective, and his unique ability to inspire others. To the students of the University of
Technology Sarawak, you are in excellent hands. This course is not just an academic opportunity
but a chance to learn from a leader who has shaped Sarawak’s journey into the digital future.

Datuk Amar Haji Awang Tengah bin Ali Hasan

Deputy Chief Minister of Sarawak
Minister of International Trade, Industry and Investment
Sarawak State Government
Table of Contents
1. Introduction to Data Centres

• What is a Data Centre?

• Importance of Data Centres in the Digital Age

• Types of Data Centres (Enterprise, Colocation, Cloud, Edge)

• Case Study: Google’s Data Centres

• Challenges and Trends

• Class Activity and Homework

2. Data Centre Architecture and Components

• Overview of Data Centre Architecture

• Compute Resources (Servers and Virtualisation)

• Storage Systems (DAS, NAS, SAN, Object Storage)

• Networking Infrastructure (Switches, Routers, Firewalls, Load Balancers)

• Power and Cooling Systems

• Security in Data Centre Architecture

• Class Activity and Homework

3. AI and Automation in Data Centres

• The Role of AI in Data Centre Operations

• Predictive Maintenance and Downtime Reduction

• Dynamic Resource Allocation

• AI-Driven Energy Management

• Tools and Technologies

• Case Study: Google DeepMind

• Class Activity and Homework

4. Sustainability in Data Centres

• Environmental Impact of Data Centres

• Strategies for Energy Efficiency

• Cooling Innovations (Free Cooling, Liquid Cooling)

• Renewable Energy Integration

 • Case Study: Facebook’s Arctic Data Centre

• Class Activity and Homework

5. Careers in Data Centres and Related Fields

• Key Roles in Data Centres

• Skills and Certifications Required (AWS, VMware, CCNA)

• Career Growth Pathways (Entry-Level to Senior Roles)

• Emerging Opportunities (Sustainability Specialists, Edge Computing Experts)

• Class Activity and Homework

6. Ethical and Legal Considerations in Data Centres

• Data Privacy and Security

• Legal Frameworks (GDPR, HIPAA, PCI DSS)

• Compliance Standards (ISO 27001, SOC 2)

• Balancing Ethics with Business Goals

• Trends in Ethical Operations (AI Ethics, Green Compliance)

• Class Activity and Homework

7. Final Project and Course Recap

• Final Project Guidelines

• Recap of Key Learnings

• Career Guidance and Next Steps

Preface
Welcome to Data Centres, Server Farms, and AI: The Backbone of the Internet.

This course has been designed as an extracurricular offering for students who:

1. Aspire to pursue a career in data centres, cloud computing, or AI.

2. Are curious about the unseen infrastructure powering the modern internet.

Data centres form the backbone of the digital economy, enabling everything from social media to
online shopping, cloud storage, and artificial intelligence. Yet, these essential facilities often
remain invisible to the everyday user.

Through this course, we aim to:

• Demystify the architecture, operations, and innovations in data centres.

• Provide practical insights into sustainability and the AI-driven future of these facilities.

• Offer guidance for students considering careers in this exciting and rapidly evolving
industry.

Whether you’re here to expand your professional horizons or simply explore the world of
technology, this course will equip you with the foundational knowledge needed to thrive in the age
of digital transformation.

Who This Course is For

This course is designed for:

• Undergraduate students interested in IT infrastructure, cloud computing, or AI.

• Individuals curious about the architecture and operations of data centres.

• Students considering careers in IT, sustainability, or data management fields.

No prior technical knowledge is required, though familiarity with basic IT concepts will be helpful.

How to Use This Guide

This guide is structured to provide both theoretical knowledge and practical applications:

• Each chapter corresponds to a class session, with detailed explanations, diagrams, and
case studies.

• Glossaries at the end of each chapter define key technical terms for easy reference.

• Class activities encourage hands-on learning, while homework assignments reinforce key
concepts.

• The final project integrates all topics, offering a holistic understanding of data centres.

"The future is digital, and data centres are its beating heart."
— Anonymous
Chapter 1 - Introduction to Data Centres
1.1 What is a Data Centre?
• Definition:
A data centre is a facility that houses critical IT infrastructure such as servers, storage
systems, networking equipment, and power systems. Its primary purpose is to manage
and process data, ensuring seamless operations for various applications, from social
media to financial systems.

• Analogy:
Think of a data centre as the digital brain of the modern world. Just as the brain
controls the body, data centres control and manage digital services.

• Core Functions:

1. Data Storage and Management: Safeguarding data for applications,

businesses, and users.

2. Application Hosting: Running cloud services, websites, and enterprise

software.

3. Data Processing: Powering big data analytics, AI training, and IoT ecosystems.

1.2 Why Are Data Centres Important?

• Enabling the Digital Economy:
Data centres are the backbone of modern life, supporting industries like e-commerce,
banking, healthcare, and entertainment.

• Key Contributions:
 1. Cloud Computing: Hosting platforms like AWS and Google Cloud, enabling
businesses to scale without physical infrastructure.

2. AI and Big Data: Providing the computational power needed for machine
learning and analytics.

3. IoT (Internet of Things): Connecting billions of devices worldwide, from smart

homes to autonomous vehicles.

• Everyday Impact:

• Streaming: Netflix and YouTube rely on data centres to deliver content globally.

• Banking: Every online transaction passes through secure data centres.

• Gaming: Cloud gaming platforms like Xbox Cloud Gaming use data centres for
processing and streaming.

1.3 Types of Data Centres

1. Enterprise Data Centres:

• Description: Owned and operated by individual organisations for internal IT

needs.

• Example: A bank’s data centre for processing secure transactions.

2. Colocation Data Centres:

• Description: Facilities where multiple businesses rent space, sharing

infrastructure and costs.

• Example: Startups hosting their servers at Equinix colocation facilities.

 3. Cloud Data Centres:

• Description: Operated by cloud providers like AWS, Microsoft Azure, and

Google Cloud.

• Key Feature: Scalability and accessibility via the internet.

4. Edge Data Centres:

• Description: Small facilities closer to end-users to reduce latency.

• Example: Supporting real-time analytics in smart cities or autonomous

vehicles.

Data Centre
Ownership Purpose Use Cases
Type
Enterprise Owned and operated by a Supports internal IT Corporate IT, finance,
Data Centre single organisation infrastructure and internal
applications

Colocation Shared space rented by Provides space and SMBs needing space
Data Centre multiple organisations facilities for businesses without building own
centres

Cloud Data Owned by cloud service Offers scalable cloud Public cloud, SaaS, and
Centre providers (e.g., AWS, computing and storage PaaS services
Azure)

Edge Data Small-scale, often close Delivers low-latency IoT, autonomous

Centre to end-users data processing vehicles, and smart
devices

Hyperscale Owned by large Handles large-scale Social media, e-

Data Centre organisations for massive data processing and commerce, and big
scale storage data analytics

1.4 Case Study: Google’s Data Centres

• Overview:
Google operates some of the most advanced and sustainable data centres globally,
supporting services like Gmail, Google Search, and YouTube.

• Key Features:

• Sustainability: Powered by 100% renewable energy since 2017.

• AI-Driven Efficiency: Uses AI to optimise cooling, reducing energy consumption

by up to 40%.

• Global Reach: Houses thousands of servers delivering services to billions of

users.

• Example Facility:
 • Location: Lenoir, North Carolina.

• Innovation: Uses water-based cooling systems for energy efficiency.

1.5 Challenges and Trends in Data Centres

• Challenges:

1. Energy Consumption: Data centres consume approximately 1% of global

electricity.

2. Cooling: High-density servers require efficient cooling to prevent overheating.

3. Cybersecurity: Protecting sensitive data from breaches is critical.

• Emerging Trends:

1. AI Integration: Automating operations and optimising resource usage.

2. Edge Computing: Supporting latency-sensitive applications like autonomous

cars.

3. Green Data Centres: Incorporating renewable energy and sustainable

practices.
1.6 Class Activity: Mapping the Role of Data Centres
• Objective:
Understand how data centres impact everyday digital activities.

• Instructions:

1. List five digital activities you do daily (e.g., browsing social media, streaming
music, online shopping).

2. Discuss in small groups how data centres support these activities (e.g., hosting
platforms, processing requests).

3. Share one example with the class.

1.7 Homework: Exploring a Data Centre

• Task:
Research a major data centre (e.g., AWS, Microsoft Azure, Alibaba Cloud) and write a
summary answering:

1. What services does the data centre support?

2. What technologies are used to ensure efficiency and sustainability?

3. What challenges does it address (e.g., energy use, security)?

• Submission Format:
One-paragraph summary (typed or handwritten).

1.8 Key Terms Glossary

• Data Centre: A facility housing IT infrastructure for data storage and processing.

• Server: A computer that provides resources, data, or services to other systems.

• Redundancy: Backup systems designed to ensure continuous operation.

• Colocation: A facility where multiple businesses share data centre space.

• Edge Computing: Processing data closer to its source to reduce latency.

Chapter 2 - Data Centre Architecture and Components
2.1 Overview of Data Centre Architecture
• Definition:
Data centre architecture refers to the logical and physical design of a facility,
encompassing hardware, networking, and operational systems. It is designed to
ensure reliability, scalability, and efficiency, enabling seamless data processing,
storage, and delivery.

• Key Design Principles:

1. Redundancy: Backup systems to prevent downtime during failures.

2. Scalability: Capability to expand infrastructure as demand grows.

3. Efficiency: Optimised energy and resource usage for cost-effectiveness.

• Core Components:

• Compute resources: Servers and processing units.

• Storage systems: Handling data retention and retrieval.

• Networking infrastructure: Connectivity within and outside the facility.

• Power and cooling systems: Ensuring operational integrity.

(Diagram: A labelled schematic showing the flow of operations in a data centre—servers,

storage, networking, power, and cooling.)

2.2 Compute: The Core of Data Centres

• Servers:

• Role: Perform data processing, storage, and management for applications and
services.

• Types:

1. Rack Servers: Modular servers mounted in racks for scalability.

2. Blade Servers: High-density servers saving space and power.

3. Tower Servers: Standalone servers for smaller-scale needs.

(Visual Comparison: Diagram showing the form factors of rack, blade, and tower servers.)

• Virtualisation:

• Definition: Running multiple virtual environments on a single physical server to

maximise resource utilisation.

• Benefits:
 • Reduces physical hardware requirements.

• Simplifies management and deployment.

(Infographic: How virtualisation optimises server usage.)

• Example in Action:

• A user uploads a file to a cloud service. Virtualised servers process the request
efficiently, allocate storage, and ensure redundancy.

2.3 Storage Systems

• Purpose:
Data centres rely on robust storage systems to manage large volumes of information.

• Types of Storage Systems:

1. Direct Attached Storage (DAS): Directly connected to a server, suitable for

limited, standalone use.

2. Network Attached Storage (NAS): Centralised storage accessible over a

network, ideal for shared environments.

3. Storage Area Network (SAN): High-performance networks connecting storage

devices to servers for enterprise-scale needs.

4. Object Storage: Efficient for unstructured data like videos or backups,

commonly used in cloud environments.

(Table: Comparing DAS, NAS, SAN, and Object Storage based on scalability, performance, and
cost.)

2.4 Networking Infrastructure

• Overview:
Networking is the backbone of data centre operations, enabling data flow within the
facility and to external networks.

• Key Components:

1. Switches: Direct internal traffic between devices.

2. Routers: Connect data centres to external networks.

3. Firewalls: Provide security by filtering incoming and outgoing traffic.

4. Load Balancers: Distribute workloads across multiple servers to prevent

overload.
(Diagram: Network topology showing connections between switches, routers, and servers.)

• Emerging Trends:
 • Software-Defined Networking (SDN): A flexible approach to configuring and
managing networks through software.

• High-Speed Networking: Technologies like 100G Ethernet to meet increasing

data demands.

2.5 Power Systems

• Critical Role:
Reliable power systems ensure uninterrupted operation of IT infrastructure.

• Core Components:

1. Uninterruptible Power Supply (UPS): Backup power for short outages.

2. Diesel Generators: Long-term backup for extended power failures.

3. Power Distribution Units (PDUs): Distribute power to individual servers and

racks.

4. Battery Storage: Emerging as a sustainable alternative.

(Diagram: Power flowchart showing grid power, UPS, and generators supplying energy to
racks.)

2.6 Cooling Systems

• Importance:
Prevents overheating, ensuring optimal performance and longevity of equipment.

• Cooling Methods:

1. Air Cooling: Circulates chilled air through racks to maintain temperatures.

2. Liquid Cooling: Transfers heat using liquid coolants.

3. Immersion Cooling: Submerges servers in non-conductive liquid for maximum

efficiency.

• Innovations in Cooling:

• Free Cooling: Utilises natural air or water sources for cost and energy efficiency.

• AI-Driven Cooling: Adaptive systems that optimise cooling based on real-time

workload and weather conditions.

(Cross-section diagram of a server rack with airflow pathways.)

2.7 Security in Data Centre Architecture

• Physical Security:
 • Biometric access controls and CCTV surveillance.

• Secure perimeters with barriers and guards.

• Cybersecurity:

• Firewalls and intrusion detection systems.

• Encryption for sensitive data in transit and at rest.

(Optional: Case study of a security breach and how it was mitigated.)

2.8 Class Activity: Design a Mini Data Centre

• Objective:
Create a conceptual layout of a small-scale data centre.

• Tips for Designing Your Data Centre:

• Use DAS or NAS for simple storage needs.

• Plan for redundancy with backup power.

• Incorporate cooling systems based on server density.

(Provide a template or example layout for students.)

2.9 Homework: Analysing Data Centre Components

• Task:
Research a real-world data centre and:

1. Identify the types of servers and storage systems used.

2. Sketch a simple layout or flow diagram.

3. Suggest one improvement to its design.

2.10 Key Terms Glossary

• Rack Server: Modular server designed for mounting in racks.

• Virtualisation: Running multiple virtual systems on a single physical server.

• NAS: Centralised storage accessible over a network.

• SDN: A software-based approach to managing networks.

• Free Cooling: Cooling technique that uses natural air or water sources.
Chapter 3 - AI and Automation in Data Centres

3.1 The Role of AI in Data Centres

• Definition of AI in Data Centres:
Artificial Intelligence (AI) refers to systems capable of performing tasks that typically
require human intelligence, such as decision-making, learning, and optimisation. In
data centres, AI automates complex processes, improving efficiency and reliability.

• Why AI Matters in Data Centres:

1. Scale: Modern data centres host thousands of servers, making manual

management infeasible.

2. Complexity: Workloads, energy demands, and security threats require adaptive

solutions.

3. Efficiency Gains: AI minimises costs and energy use while maximising uptime.

(Insert an infographic showing how AI fits into data centre operations—monitoring,

automation, and optimisation.)

3.2 Applications of AI in Data Centres

1. Predictive Maintenance:

• How It Works: AI analyses data from sensors and logs to predict hardware
failures before they happen.

• Benefits:

• Minimises downtime.

• Reduces costs associated with emergency repairs.

• Example: Google uses AI to predict disk failures and schedule proactive

maintenance.

2. Dynamic Resource Allocation:

• How It Works: AI allocates compute and storage resources dynamically based

on workload demands.

• Benefits:

• Optimises server utilisation.

• Prevents bottlenecks during peak usage.

3. Energy Management:
 • How It Works: AI monitors power usage and adjusts cooling and power delivery
systems.

• Benefits:

• Reduces energy waste.

• Adapts cooling systems based on workload and environmental

conditions.

• Case Study: Google’s DeepMind AI reduced energy consumption for cooling by

40%.

4. Security Automation:

• How It Works: AI detects unusual patterns in network traffic and raises alerts for
potential breaches.

• Benefits:

• Protects against cyber threats.

• Automates routine security checks.

• Example: AI-based intrusion detection systems.

(Table: Comparing traditional vs. AI-driven methods for maintenance, resource allocation,
energy management, and security.)

3.3 Tools and Technologies for AI in Data Centres

• Common AI Tools:

1. Google DeepMind: Specialises in energy optimisation.

2. IBM Watson AIOps: Focuses on predictive analytics and operational

automation.

3. Microsoft Project Turing: Enhances server efficiency and natural language

processing.

• Emerging Technologies:

• Digital Twins: Virtual replicas of data centres for simulation and optimisation.

• Machine Learning Frameworks: TensorFlow and PyTorch for developing custom

AI models.

• Edge AI: Deploying AI capabilities closer to the source of data for real-time
decision-making.

(Optional: Include diagrams of AI tools in action, such as a workflow for energy management.)
3.4 Challenges of Implementing AI
• High Initial Costs:
Deploying AI requires investment in specialised hardware and software.

• Complexity of Integration:
Integrating AI systems with existing infrastructure can be time-consuming and
resource-intensive.

• Data Privacy Concerns:

AI systems require access to significant amounts of operational data, raising privacy
and compliance issues.

• Skills Gap:
A shortage of skilled professionals capable of developing and managing AI solutions.

3.5 Case Study: Google’s AI-Driven Efficiency

• Overview:
Google implemented AI developed by DeepMind to optimise cooling in its data centres.

• Key Outcomes:

• 40% reduction in cooling energy consumption.

• Significant decrease in operational costs.

• How It Works:

• AI monitors temperature, power, and server load.

• Adjusts cooling systems dynamically based on predictions and real-time

conditions.

(Insert a flowchart of how DeepMind AI optimises cooling.)

3.6 Class Activity: Brainstorming AI Solutions

• Objective:
Develop AI-driven solutions for common challenges in data centres.

• Instructions:

1. Split into small groups.

2. Choose a problem (e.g., energy waste, server downtime, or cybersecurity).

3. Brainstorm how AI could address the problem.

4. Present your solution, including:

• The AI tools or methods you would use.

 • Expected outcomes and benefits.

(Provide a worksheet or template for brainstorming.)

3.7 Homework: Researching AI Applications in Data Centres

• Task:
Research an AI application used in a real-world data centre. Answer the following:

1. What challenge does the AI address?

2. What tools or technologies are used?

3. What are the outcomes or benefits of using AI?

• Submission Format:
A one-page summary with optional diagrams or visuals.

3.8 Key Terms Glossary

• Artificial Intelligence (AI): Technology enabling machines to perform tasks that require
human intelligence.

• Predictive Maintenance: The use of AI to predict and prevent hardware failures.

• Digital Twin: A virtual replica of a physical system for simulation and optimisation.

• Edge AI: AI deployed closer to data sources for real-time processing.

• Energy Management System (EMS): AI-driven systems to optimise energy use in data
centres.