11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

CUDA Zone
CUDA® is a parallel computing platform and programming model developed by NVIDIA for general computing on graphical processing units (GPUs). With
CUDA, developers are able to dramatically speed up computing applications by harnessing the power of GPUs.

In GPU-accelerated applications, the sequential part of the workload runs on the CPU – which is optimized for single-threaded performance – while the
compute intensive portion of the application runs on thousands of GPU cores in parallel. When using CUDA, developers program in popular languages
such as C, C++, Fortran, Python and MATLAB and express parallelism through extensions in the form of a few basic keywords.

The CUDA Toolkit from NVIDIA provides everything you need to develop GPU-accelerated applications. The CUDA Toolkit includes GPU-accelerated
libraries, a compiler, development tools and the CUDA runtime.

Download Now

Applications Developed with CUDA

Thousands of applications developed with CUDA have been deployed to GPUs in embedded systems, workstations, datacenters and in the cloud.

See More Applications

CUDA for all NVIDIA GPU Families

CUDA serves as a common platform across all NVIDIA GPU families so you can deploy and scale your application across GPU configurations.

https://developer.nvidia.com/cuda-zone 1/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

Desktop Developer Data Center Solutions

Embedded Applications GPU-Accelerate Cloud

The first GPUs were designed as graphics accelerators, becoming more programmable over the 90s, culminating in NVIDIA's first GPU in 1999.
Researchers and scientists rapidly began to apply the excellent floating point performance of this GPU for general purpose computing. In 2003, a team
of researchers led by Ian Buck unveiled Brook, the first widely adopted programming model to extend C with data-parallel constructs. Ian Buck later
joined NVIDIA and led the launch of CUDA in 2006, the world's first solution for general-computing on GPUs.

Since its inception, the CUDA ecosystem has grown rapidly to include software development tools, services and partner-based solutions. The CUDA
Toolkit includes libraries, debugging and optimization tools, a compiler and a runtime library to deploy your application. You'll also find code samples,
programming guides, user manuals, API references and other documentation to help you get started.

Libraries

https://developer.nvidia.com/cuda-zone 2/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

cuRAND NPP

cuFFT
Math Library

nvGRAPH NCCL

See More Libraries

Tools and Integrations

Nsight Visual Profiler

CUDA GDB CUDA MemCheck

https://developer.nvidia.com/cuda-zone 3/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

OpenACC
CUDA Profiling Tools Interface

See More Tools

Domains with CUDA-Accelerated Applications

CUDA accelerates applications across a wide range of domains from image processing, to deep learning, numerical analytics and computational science.

More Applications

Get Started with CUDA

Get started with CUDA by downloading the CUDA Toolkit and exploring introductory resources including videos, code samples, hands-on labs and
webinars.

Get Started with CUDA Download Now

https://developer.nvidia.com/cuda-zone 4/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

Tutorials

November 14, 2024 November 14, 2024

Exploring the Case of Super Protocol with Self- Deep Learning Model Boosts Accuracy in Long-
Sovereign AI and NVIDIA Confidential Range Weather and Climate Forecasting
Computing
Dale Durran, a professor in the Atmospheric Sciences
Confidential and self-sovereign AI is a new approach to AI Department at the University of Washington, introduces a
development, training, and inference where the user’s data is breakthrough deep learning model that combines atmospheric
decentralized, private, and controlled by the users themselves. and oceanic data to set new climate and weather prediction
This post explores how the capabilities of Confidential accuracy standards. In this NVIDIA GTC 2024 session, Durran
Computing (CC) are expanded through decentralization using presents techniques that reduce reliance on traditional
blockchain technology. The problem being solved is most clearly parameterizations, enabling the model to bypass … Continued
shown through the use … Continued

Read More Read More

November 14, 2024 November 14, 2024

Faster Causal Inference on Large Datasets with Just Released: NVIDIA HPC SDK v24.11
NVIDIA RAPIDS
The new release includes several enhancements to the Math
As consumer applications generate more data than ever before, Libraries and improvements for C++ programming.
enterprises are turning to causal inference methods for
observational data to help shed light on how changes to
individual components of their app impact key business metrics.
Over the last decade, econometricians have developed a
technique called double machine learning that brings the power
of machine … Continued

Read More Read More

See More

https://developer.nvidia.com/cuda-zone 5/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

News

October 28, 2024 October 25, 2024

Upcoming Webinar: Enhance Generative AI NVIDIA Showcases the Future of Intelligent

Model Accuracy Through High-Quality Data Robots at CoRL 2024
Processing
From humanoids to policy, explore the work NVIDIA is bringing
Learn how to build scalable data processing pipelines to create to the robotics community.
high-quality datasets.

Read More Read More

October 24, 2024 October 21, 2024

Powering the Next Wave of AI Robotics with IBM’s New Granite 3.0 Generative AI Models Are
Three Computers Small, Yet Highly Accurate and Efficient
NVIDIA has built three computers and accelerated development Today, IBM released the third generation of IBM Granite, a
platforms to enable developers to create physical AI. collection of open language models and complementary tools.
Prior generations of Granite focused on domain-specific use
cases; the latest IBM Granite models meet or exceed the
performance of leading similarly sized open models across both
academic and enterprise benchmarks. The developer-friendly
Granite 3.0 generative AI … Continued

Read More Read More

See More

https://developer.nvidia.com/cuda-zone 6/7
11/18/24, 1:56 PM CUDA Zone - Library of Resources | NVIDIA Developer

Follow NVIDIA Developer

Sign up for NVIDIA News Subscribe
Find more news and tutorials on NVIDIA Technical Blog

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Use | Cookie Policy | Contact

Copyright © 2024 NVIDIA Corporation

https://developer.nvidia.com/cuda-zone 7/7