Scribd
Upload
62 views

Why Choose A Multiprocessor?

There are several reasons to use a multiprocessor system: to improve performance beyond what a single CPU can provide, to support multiple users and applications simultaneously, and to share hardware resources between CPUs. Multiprocessor systems can be symmetric, with equal CPUs, or asymmetric with specialized CPUs. They can execute instructions and operate on data in different ways, including uniprocessor (SISD), multiple instructions multiple data (MIMD), single instruction multiple data (SIMD), or multiple instruction single data (MISD). Communication between CPUs can occur through message passing or shared memory architectures.

Uploaded by

M Ijaz Chohan
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
62 views

Why Choose A Multiprocessor?

There are several reasons to use a multiprocessor system: to improve performance beyond what a single CPU can provide, to support multiple users and applications simultaneously, and to share hardware resources between CPUs. Multiprocessor systems can be symmetric, with equal CPUs, or asymmetric with specialized CPUs. They can execute instructions and operate on data in different ways, including uniprocessor (SISD), multiple instructions multiple data (MIMD), single instruction multiple data (SIMD), or multiple instruction single data (MISD). Communication between CPUs can occur through message passing or shared memory architectures.

Uploaded by

M Ijaz Chohan
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 17

Why Choose a Multiprocessor?

• A single CPU can only go so fast, use more


than one CPU to improve performance

• Multiple users

• Multiple applications

• Share hardware between CPUs


Multiprocessor Symmetry
• In a multiprocessing system, all CPUs may be equal, or
some may be reserved for special purposes.
• Systems that treat all CPUs equally are called symmetric
multiprocessing (SMP) systems.
• If all CPUs are not equal, system resources may be
divided in a number of ways, including asymmetric
multiprocessing (ASMP), non-uniform memory access
(NUMA) multiprocessing.
Instruction and Data Streams
Multiprocessors can be used in different ways:
• Uniprossesors (single-instruction, single-data
or SISD)
• In computing, SISD is a computer architecture
in which executes a single instruction stream,
to operate on data stored in a single memory.
This corresponds to the von Neumann
architecture.
Instruction and Data Streams
Instruction and Data Streams
• Within a single system to execute multiple instructions in
multiple contexts (multiple-instruction, multiple-data or
MIMD);
• In computing, MIMD is a technique to achieve
parallelism. Machines using MIMD have a number
of processors that function asynchronously and
independently. At any time, different processors may be
executing different instructions on different pieces of
data.
Instruction and Data Streams
• These classifications are based on how MIMD
processors access memory. Shared memory machines
may be of the bus-based.
Instruction and Data Streams
• A single sequence of instructions in multiple contexts
(single-instruction, multiple-data or SIMD, often used in
vector processing);
• SIMD is a class of parallel computers. It describes
computers with multiple processing elements that
perform the same operation on multiple data points
simultaneously. Such machines exploit data level
parallelism, but not concurrency: there are simultaneous
(parallel) computations, but only a single process
(instruction) at a given moment.
Instruction and Data Streams
Instruction and Data Streams
• Multiple sequences of instructions in a single context
(multiple-instruction, single-data or MISD, used for
redundancy in fail-safe systems and sometimes applied
to describe pipelined processors or hyper threading).
Multiprocessor Communication
Architectures
Message Passing
• Separate address space for each processor
• Processors communicate via message passing
• Processors have private memories

Shared Memory
• Processors communicate with shared address space
• Processors communicate by memory read/write
• Easy on small-scale machines
• UMA or NUMA
Shared-Memory Processors
Single copy of the OS (although some parts might be parallel)
relatively easy to program and port sequential code to
difficult to scale to large numbers of processors

processor
1
processor
2
... processor
N

cache cache cache

interconnection network

memory
1
memory
2
... memory
M

UMA machine block diagram


Types of Shared-Memory Architectures
UMA
• Uniform Memory Access
• Access to all memory occurred at the same speed for
all processors.

NUMA
• Non-Uniform Memory Access
• Access to some parts of memory is faster for some
processors than other parts of memory.
• Harder to program, but scales to more processors
Bus Based UMA
(a) Simplest MP:
More than one processor on a single bus
connect to memory, bus bandwidth becomes
a bottleneck.
(b) Each processor has a cache to reduce the need
to access to memory.
(c) To further scale the number of processors, each
processor is given private local memory.
NUMA
• All memories can be addressed by all
processors, but access to a processor’s
own local memory is faster than access to
another processor’s remote memory.
• Looks like a distributed machine, but the
interconnection network is usually
custom-designed switches and/or buses.
NUMA
OS Option 1
Each CPU has its own OS
• Statically allocate physical memory to each CPU
• Each CPU runs its own independents OS
• Share peripherals
• Each CPU handles its processes system calls
• Used in early multiprocessor systems
• Simple to implement
• Issues: 1. Each processor has its own scheduling queue.
2. Each processor has its own memory partition.
3. Consistency is an issue with independent disk buffer caches and
potentially shared files.
OS Option 2
Master-Slave Multiprocessors
• OS mostly runs on a single fixed CPU.
• User-level applications run on the other CPUs.
• All system calls are passed to the Master CPU for processing
• Memory can be allocated as needed to all CPUs.
• Issues: Master CPU becomes the bottleneck.

You might also like