Ad
More Related Content
What's hot (20)
Similar to parallel processing (20)
Ad
Recently uploaded (20)
Ad
parallel processing
- 2. What is Serial Computing? Traditionally, software has been written for serial computation: • A problem is broken into a discrete series of instructions • Instructions are executed sequentially one after another • Executed on a single processor • Only one instruction may execute at any moment in time
- 3. Example of Serial Computing
- 4. What is Parallel Computing? In the simplest sense, parallel computing is the simultaneous us e of multiple compute resources to solve a computational proble m:
- 5. A problem is broken into discrete parts that can be solved con currently Each part is further broken down to a series of instructions Instructions from each part execute simultaneously on differe nt processors An overall control/coordination mechanism is employed Parallel Computing
- 6. Parallel Computing • The computational problem should be able to: –Be broken apart into discrete pieces of work that can be solve d simultaneously; –Execute multiple program instructions at any moment in time; –Be solved in less time with multiple compute resources than with a single compute resource. • The compute resources are typically: –A single computer with multiple processors/cores –An arbitrary number of such computers connected by a netwo rk
- 7. Parallel Computers: Virtually all stand-alone computers today are parallel from a hard ware perspective: • Multiple functional units (L1 cache, L2 cache, branch, decode, f loating-point, graphics processing (GPU), etc.) • Multiple execution units/cores • Multiple hardware threads Fig: Networks connect multiple stand-alone computers (nodes) to make larger parallel co mputer clusters
- 8. A typical LLNL parallel computer cluster • Each compute node is a multi-processor parallel computer in itself • Multiple compute nodes are networked together with an InfiniBand (IB) network • Special purpose nodes, also multi-processor, are used for other purp oses
- 9. Why Use Parallel Computing? SAVE TIME AND/OR MONEY : • In theory, throwing more resources at a task will shorten its tim e to completion, with potential cost savings. • Parallel computers can be built from cheap, commodity compon ents.
- 10. SOLVE LARGER / MORE COMPLEX PROBLEMS: • Many problems are so large and/or complex that it is impractical or impossible to solve them on a single computer, especially give n limited computer memory. • Example: Web search engines/databases processing millions of tr ansactions every second
- 11. Why Use Parallel Computing? PROVIDE CONCURRENCY: A single compute resource can only do one thing at a time. Mult iple compute resources can do many things simultaneously. Example: Collaborative Networks provide a global venue where people from around the world can meet and conduct work "virtu ally".
- 12. TAKE ADVANTAGE OF NON-LOCAL RESOURCES: Using compute resources on a wide area network, or even the Int ernet when local compute resources are scarce or insufficient.
- 13. MAKE BETTER USE OF UNDERLYING PARALLEL HA RDWARE: • Modern computers, even laptops, are parallel in architecture wit h multiple processors/cores. • Parallel software is specifically intended for parallel hardware with multiple cores, threads, etc. • In most cases, serial programs run on modern computers "waste " potential computing power.
- 14. Who is Using Parallel Computing? Historically, parallel computing has been considered to be "the hi gh end of computing", and has been used to model difficult probl ems in many areas of science and engineering:
- 15. Who is Using Parallel Computing? Science and Engineering: • Atmosphere, Earth, Environment • Physics - applied, nuclear, particle, condensed matter, high pressure, fusion, photonics • Bioscience, Biotechnology, Genetics • Chemistry, Molecular Sciences • Defense, Geology • Mechanical Engineering - from prosthetics to spacecra ft • Electrical Engineering, Circuit Design, Microelectroni cs • Computer Science, Mathematics
- 16. Who is Using Parallel Computing? Industrial and Commercial: Today, commercial applications provide an equal or greater driving force in the development of faster computers. These applications require the pro cessing of large amounts of data in sophisticated ways. For example:
- 17. Who is Using Parallel Computing? Industrial and Commercial: • "Big Data", databases, data mining • Oil exploration • Web search engines, web based business services • Medical imaging and diagnosis • Pharmaceutical design • Financial and economic modeling • Management of national and multi-national corporations • Advanced graphics and virtual reality, particularly in the entertainment indus try • Networked video and multi-media technologies • Collaborative work environments
- 19. THANK YOU