One
One
and Communications
Objectives:
This course will provide students with practical and theoretical knowledge
Parallel and Distributed Computing. On completion of this course, students
should be able to:
Students should gain an understanding of the principles, concepts, and
challenges of distributed computing.
Students should learn about parallel processing architectures, parallel
algorithms, and techniques for exploiting parallelism in computation.
Students should learn techniques for optimizing the performance of
distributed and parallel applications.
Students should understand the challenges of fault tolerance in
distributed and parallel systems.
Students should understand the concepts of scalability and resource
management in distributed and parallel computing.
Students should stay updated with the latest trends and technologies in
distributed and parallel computing, such as cloud computing, edge
computing, and big data processing frameworks.
Learning Outcome:
At the end of the course, the students will be able to do following:
Topic Content
Introduction to Parallel and Overview of parallel and distributed computing
Distributed Computing concepts
Parallel and distributed computing strategies
Benefits of parallel and distributed computing
Fundamental differences between parallel and
distributed computing
Examples of real-world applications
Parallel Computing Architectures Flynn's taxonomy: SISD, SIMD, MISD, MIMD
Shared memory architectures (e.g., multicore
processors)
Distributed memory architectures (e.g.,
computer clusters)
Hybrid architectures (e.g., GPUs)
Hardware considerations in parallel computing.
Scalability and performance considerations
Models of Computation Overview of parallel computation models
(PRAM, BSP).
Distributed system models (client-server, peer-
to-peer).
Characteristics of parallelism: data, task, and
pipeline.
Fault Tolerance and Reliability Techniques for fault detection and recovery.
Replication and consistency models in
distributed systems.
Case studies on fault tolerance strategies.
Assessment Methods
Coursework
Theory Assignments
Presentations
In-class tests