Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $12.99 CAD/month.

881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

FromSuper Data Science: ML & AI Podcast with Jon Krohn


881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

FromSuper Data Science: ML & AI Podcast with Jon Krohn

ratings:
Length:
77 minutes
Released:
Apr 22, 2025
Format:
Podcast episode

Description

Emily Webber speaks to Jon Krohn about her work at Amazon Web Services, from its Annapurna Labs-developed Nitro System, a foundational technology that can enhance securities and performance in the cloud and how Trainium2 became AWS’ most powerful AI chip with four times the compute of Trainium. Hear the specs of AWS’s chips and when to use them.

Additional materials: www.superdatascience.com/881

This episode is brought to you by ODSC, the Open Data Science Conference.

Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.

In this episode you will learn:

(08:36) Emily’s work on AWS’ SageMaker and Trainium 

(23:54) How AWS Neuron lets builders tailor their approach to using frameworks 

(29:07) Why using an accelerator is better than using a GPU 

(35:29) The key differences between AWS Trainium and AWS Trainium2 

(52:45) How to select between AWS Trainium and AWS Trainium2
Released:
Apr 22, 2025
Format:
Podcast episode

Titles in the series (100)

The Super Data Science podcast with Jon Krohn brings you the latest and most important machine learning, artificial intelligence, and broader data-world topics from across both academia and industry. As the quantity of data on our planet doubles every couple of years and this trend is set to continue for decades to come, there's an unprecedented opportunity for you to make an enormous impact in your lifetime. Whether you're curious about getting started in a data career or you're a deep technical expert, whether you'd like to understand what A.I. is or you'd like to integrate more data-driven processes into your business, we have inspiring guests and lighthearted conversation for you to enjoy. We cover tools, techniques, and implementation tricks across data collection, databases, analytics, predictive modeling, visualization, software engineering, real-world applications, and commercialization − everything you need to crush it with data science.