SRECon Lightning Talk

Mar 29, 20180 likes387 views

Slides for SRECon 2018 talk on https://medium.com/@awspyker/why-as-a-netflix-infrastructure-manager-am-i-on-call-bdc551ac01fe

Why, as a Netflix
infrastructure
manager, am I
on call?
@aspyker - bit.ly/TitusLinks
FINAL

Chris Dag - https://www.flickr.com/photos/chrisdag/3105123976/

Titus is Born
Service
Job and Fleet Management
Resource Management & Optimization
Container Execution
Integration
Batch
Batch and Service Container Management Platform

Product Growth
Usage
1000’s applications
16K VM’s
Millions of
Containers

Team
3 to 4 IC’s
IC to Product Manager
Product Manager
to Manager
Personal Growth

Engineering
Challenge
John Mcsporran- https://www.flickr.com/photos/127130111@N06/15843976929

Sharon Sinclair- https://www.flickr.com/photos/128745475@N07/19402974878

Stability
Michal Osmenda r- https://commons.wikimedia.org/wiki/File:Dangerous_Cliff_Edge_(2258425643).jpg

Manager (me)
Off Hours - On-call
Office Hours
On-call
Team supports users
Team deploys
Manager Things
The Team
Off Hours - On-call
Office Hours
On-call
User support
Deployments
Developer Things

This document discusses various topics related to artificial intelligence including deep learning, IoT, GPUs, autonomous vehicles, robotics, and augmented/virtual reality. It provides an overview of the current state of AI and predictions that AI will continue advancing and having an increasing impact on society through applications such as personal assistants, smart cities, healthcare, and more. The document also examines the relationship between AI, IoT, and new technologies like VR/AR/MR and suggests that combining AI with IoT and other areas has huge potential.

Whats New in Serverless - Serverless Meetup AKLElijah Astley

This document highlights several new developments in serverless computing from April 2018, including the Serverless Application Model becoming open source, GraphQL and serverless becoming areas of focus for cloud computing, IBM releasing Cloud Functions, AWS Lambda adding support for Node.js 8.10, and Azure cloud certification training being offered on A Cloud Guru. It also advertises an upcoming Serverless Meetup in Auckland and provides contact information.

Update on the URISA GIS Management Institute GIS Assessment ServiceGreg Babinski

Lap around ASP.NET 5 - Dayton UGSam Basu

Cutting-Edge Continuous Delivery: Automated Canary Analysis Through Spring-Ba...VMware Tanzu

This document discusses automated canary analysis through Spinnaker for continuous delivery. Spinnaker is an open source tool that allows deploying software changes automatically without fear by using techniques like canary analysis. It supports multiple cloud providers and services. The presentation covers Spinnaker concepts like deployment strategies, canary deployments, chaos engineering, and best practices for canary analysis using Spinnaker like applying fine-grained traffic splits and including business metrics. It demonstrates Spinnaker capabilities using a Rick and Morty example and provides contact details for learning more.

Using Jupyter Notebooks - Developers Forum - AC18Esri UK

The document discusses the ArcGIS API for Python and Jupyter notebooks. It provides an overview of the Python API and how it functions similarly to ArcPy in ArcMap and ArcGIS Pro but works with portal and server functionality. It also introduces Jupyter notebooks as a browser-based development environment for working with the Python API and cautions against using notebooks for production level solutions or recurrent tasks.

[WSO2 Integration Summit San Francisco 2019] Emerging Architecture Patterns- ...WSO2

This document discusses a new cell-based architecture pattern for building applications. It begins by outlining the objectives and motivation for developing this pattern. It then provides background on existing architecture styles like layered and microservices approaches. The document goes on to define key concepts of the cell-based pattern such as cells, components, and connected cells. It also covers how this pattern addresses concerns like API-centric design, automated governance, developer experience, and more. Examples of reference implementations are presented at different levels of abstraction. Metrics for measuring the success of this approach are suggested. The presentation concludes by inviting consumption and contribution to open source projects implementing the cell-based architecture.

Emerging architecture patterns: API-centric cell-based | Yenlo - WSO2 Integra...Yenlo

[WSO2 Integration Summit London 2019] Emerging Architecture Patterns: API-cen...WSO2

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this keynote, Asanka will introduce the "cell-based" reference architecture, which is API-centric, cloud-native, and microservices-friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach.

Real-World Objects Interaction with Unconstrained Spoken Language InstructionsKuniyuki Takahashi

Beautiful and Fast Images Doug Sillars

This document discusses optimizing images and video for fast delivery on mobile devices. It begins by outlining how delays in loading content can negatively impact users and business metrics. It then provides recommendations for optimizing four aspects of images: quality, format, sizing, and lazy loading. Specific techniques are presented for each along with data showing their real-world impact. Video delivery optimization is also covered, including strategies to improve startup times. The document concludes by stating that images and video can be both beautiful and fast with the right optimizations.

Waterford fast imagesDoug Sillars

The document discusses optimizing images and video for fast delivery on websites. It provides tips for improving image quality, format, sizing and lazy loading. For video, it discusses optimizing startup time by preloading strategically and balancing network usage. Testing tools mentioned include WebPageTest, HttpArchive, ImageMagick and SSIM. The goal is to make images and video both beautiful and fast loading.

[WSO2 Integration Summit New York 2019] Emerging Architecture Patterns: API-c...WSO2

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this deck, Asanka introduces the "cell-based" reference architecture, which is API-centric, cloud-native, and microservices-friendly. He explains the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka explores the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach.

[WSO2 Summit APAC 2020] A Decentralized Reference Architecture for Cloud-nati...WSO2

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this deck, Asanka will introduce the "cell-based" architecture, which is decentralized, API-centric, cloud-native and microservices friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach. Watch the session on-demand here: https://wso2.com/library/summit-2020/apac/a-decentralized-reference-architecture-for-cloud-native-applications/

Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"Ibrahim Muhammadi

APIs: The Glue of Microservices - Introduction to the Cell-based ArchitectureWSO2

KubeCon 2020 EU Virtual: How we migrated our monolith to K8sMauricio (Salaboy) Salatino

Tracy Miranda and Mauricio Salatino presented on how they migrated a monolithic application to Kubernetes and improved their team performance. They discussed principles for the migration, examples of challenges they faced, and how tools like Jenkins X helped address those challenges. Some of the key challenges they discussed migrating to a microservices architecture and Kubernetes included splitting the monolith into independent services, deciding between hosted or managed application infrastructure, and ensuring business visibility into the new system.

Cell-based Architecture: An Emerging Architecture Pattern for Agile Integrati...Asanka Abeysinghe

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this talk, Asanka will introduce the “cell-based” reference architecture, which is API-centric, cloud-native and microservices friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach.

An Emerging Architecture Pattern for Agile Integration: Cell-based ArchitectureAll Things Open

The document introduces the concept of cell-based architecture, a new pattern for building agile, modular applications. It describes cells as independently deployable groups of components that can be combined to build applications. Cells communicate using APIs and have control, data, and management planes. The document outlines the motivation for the pattern and provides examples of how it can improve areas like developer experience, security, and automation. It also introduces related tools and frameworks like Cellery and Ballerina that have been developed to support the cell-based approach.

Parisjs fastvideoandimagesDoug Sillars

Doug Sillars discusses optimizing images and video delivery for fast loading on mobile. He provides 4 simple optimizations for images: adjusting quality, format, sizing through responsive images, and lazy loading. For video, he examines startup delays and how to balance network load through adaptive bitrate streaming. Proper preloading and avoiding 3rd party interference can improve video start. Tools like WebPageTest and ImageMagick help optimize and measure performance.

BIM-onomics slidedeckCeilidh Higgins

“BIM-onomics: how will BIM change the business of design?” We all know that BIM takes design to the next level, but how does it change your business? We will look at how by embracing BIM not just as a design tool, but as a completely new way of working will change the way we operate as a business. In this presentation, we will look at potential business challenges, analyse project data, and suggest strategies to prepare your organisation for changes to your underlying business model in the face of a new BIM-driven industry. This presentation will use business examples and discuss the challenges from the perspective of different practices and project scales.

Open shift onlineGayan Kalanamith Mannapperuma

Dublin Tech TalksDoug Sillars

Doug Sillars presented on mobile and web performance optimization at the Dublin Tech Talks on July 10, 2018. He discussed how slow loading times negatively impact user experience and engagement. Sillars recommended tools like Video Optimizer and WebPageTest to audit performance, and emphasized optimizing delivery speed through content delivery networks and image/text compression. He also provided tips for optimizing images, videos, and animations to reduce payload sizes and startup delays. The goal is to create fast, rich mobile experiences for users.

Breaking through the Walls of the Classroom 1.0Clif Mims

Microservices - Code Voyagers SofiaDimitar Danailov

"The term "Microservice Architecture" has sprung up over the last few years to describe a particular way of designing software applications as suites of independently deployable services. While there is no precise definition of this architectural style, there are certain common characteristics around organization around business capability, automated deployment, intelligence in the endpoints, and decentralized control of languages and data." Martin Fowler

[WSO2 Summit New York 2018] Building an Agile EnterpriseWSO2

[WSO2 Summit Sydney 2019] Emerging Architecture Patterns: API-centric and Cel...WSO2

In this deck, Asanka will introduce the "cell-based" reference architecture, which is API-centric, cloud-native, and microservices-friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach. This year we’re touring the world! Join us at a city near you to learn how to achieve API-driven integration agility. - https://wso2.com/integration-summits-2019/

Andy Kirk's talk at the ACEhp 2015 ConferenceAndy Kirk

This document discusses the importance of data visualization and provides guidance on effective approaches. It makes the following key points: 1. Data visualization is the visual communication of data to help understand patterns and insights. It is a relevant skill for sharing information visually. 2. Effective data visualization adds value by making information accessible and enabling exploration. Examples should be curated to guide analysis and understanding. 3. Creating impactful data visualizations requires considering context, embracing journalistic curiosity to find stories, and using imagination to empathize with audiences.

Herding Kats - Netflix’s Journey to Kubernetes Publicaspyker

Season 7 Episode 1 - Tools for Data Scientistsaspyker

Metaflow (Ville Tuulos) Data scientists at Netflix are expected to develop and operate large machine learning workflows autonomously. However, we do not expect that all our scientists are deeply experienced with distributed systems and data engineering. Metaflow was created to make it delightfully easy to build and operate ML workflows in the cloud using idiomatic Python and off-the-shelf ML libraries, covering the whole lifecycle of an ML project from prototype to production. Polynote (Jeremy Smith) Polynote is a new notebook tool we created from scratch to address some of the pain points we've run into while using Scala in machine-learning notebooks at Netflix. It provides essential code editing features other tools lack like interactive auto-completes, support for mixing multiple languages and sharing data between them within a single notebook, and encourages reproducible notebooks with its immutable data model. Papermill (Matthew Seal) Nteract is an open source organization under which there are several libraries and applications that Netflix and many other companies and individuals contribute to. One of these libraries is Papermill, a library used to programmatically parameterize and execute Jupyter Notebooks. Papermill provides a CLI and Python interface that we'll explore during the session to see how it can be used and what value it adds. Using this pattern we'll also briefly talk about how we've integrated papermill at Netflix and how it interfaces with other Jupyter and nteract services.

More Related Content

Similar to SRECon Lightning Talk (20)

[WSO2 Integration Summit London 2019] Emerging Architecture Patterns: API-cen...WSO2

Real-World Objects Interaction with Unconstrained Spoken Language InstructionsKuniyuki Takahashi

Beautiful and Fast Images Doug Sillars

Waterford fast imagesDoug Sillars

[WSO2 Integration Summit New York 2019] Emerging Architecture Patterns: API-c...WSO2

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this deck, Asanka introduces the "cell-based" reference architecture, which is API-centric, cloud-native, and microservices-friendly. He explains the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka explores the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach.

[WSO2 Summit APAC 2020] A Decentralized Reference Architecture for Cloud-nati...WSO2

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this deck, Asanka will introduce the "cell-based" architecture, which is decentralized, API-centric, cloud-native and microservices friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach. Watch the session on-demand here: https://wso2.com/library/summit-2020/apac/a-decentralized-reference-architecture-for-cloud-native-applications/

Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"Ibrahim Muhammadi

APIs: The Glue of Microservices - Introduction to the Cell-based ArchitectureWSO2

KubeCon 2020 EU Virtual: How we migrated our monolith to K8sMauricio (Salaboy) Salatino

Cell-based Architecture: An Emerging Architecture Pattern for Agile Integrati...Asanka Abeysinghe

The number of microservices running in enterprises increases daily. As a result, service composition, governance, security, and observability are becoming a challenge to implement and incorporate. A “cell-based” architecture is an approach that can be applied to current or desired development and technologies to address these issues. This technology-neutral approach helps cloud-native dev teams become more efficient, act in a more self-organized manner, and speed overall release times. In this talk, Asanka will introduce the “cell-based” reference architecture, which is API-centric, cloud-native and microservices friendly. He will explain the role of APIs in the cell-based approach, as well as examine how real applications are built as cells. Asanka will explore the metrics and approaches that can be used to measure the effectiveness of the architecture and explore how organizations can implement the cell approach.

An Emerging Architecture Pattern for Agile Integration: Cell-based ArchitectureAll Things Open

Parisjs fastvideoandimagesDoug Sillars

BIM-onomics slidedeckCeilidh Higgins

Open shift onlineGayan Kalanamith Mannapperuma

Dublin Tech TalksDoug Sillars

Breaking through the Walls of the Classroom 1.0Clif Mims

Microservices - Code Voyagers SofiaDimitar Danailov

[WSO2 Summit New York 2018] Building an Agile EnterpriseWSO2

[WSO2 Summit Sydney 2019] Emerging Architecture Patterns: API-centric and Cel...WSO2

Andy Kirk's talk at the ACEhp 2015 ConferenceAndy Kirk

[WSO2 Integration Summit London 2019] Emerging Architecture Patterns: API-cen...WSO2

Real-World Objects Interaction with Unconstrained Spoken Language InstructionsKuniyuki Takahashi

Beautiful and Fast Images Doug Sillars

Waterford fast imagesDoug Sillars

[WSO2 Integration Summit New York 2019] Emerging Architecture Patterns: API-c...WSO2

[WSO2 Summit APAC 2020] A Decentralized Reference Architecture for Cloud-nati...WSO2

Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"Ibrahim Muhammadi

APIs: The Glue of Microservices - Introduction to the Cell-based ArchitectureWSO2

KubeCon 2020 EU Virtual: How we migrated our monolith to K8sMauricio (Salaboy) Salatino

Cell-based Architecture: An Emerging Architecture Pattern for Agile Integrati...Asanka Abeysinghe

An Emerging Architecture Pattern for Agile Integration: Cell-based ArchitectureAll Things Open

Parisjs fastvideoandimagesDoug Sillars

BIM-onomics slidedeckCeilidh Higgins

Open shift onlineGayan Kalanamith Mannapperuma

Dublin Tech TalksDoug Sillars

Breaking through the Walls of the Classroom 1.0Clif Mims

Microservices - Code Voyagers SofiaDimitar Danailov

[WSO2 Summit New York 2018] Building an Agile EnterpriseWSO2

[WSO2 Summit Sydney 2019] Emerging Architecture Patterns: API-centric and Cel...WSO2

Andy Kirk's talk at the ACEhp 2015 ConferenceAndy Kirk

More from aspyker (20)

Herding Kats - Netflix’s Journey to Kubernetes Publicaspyker

Season 7 Episode 1 - Tools for Data Scientistsaspyker

CMP376 - Another Week, Another Million Containers on Amazon EC2aspyker

Netflix’s container management platform, Titus, powers critical aspects of the Netflix business, including video streaming, recommendations, machine learning, big data, content encoding, studio technology, internal engineering tools, and other Netflix workloads. Titus offers a convenient model for managing compute resources, enables developers to maintain just their application artifacts, and provides a consistent developer experience from a developer’s laptop to production by leveraging Netflix container-focused engineering tools.

QConSF18 - Disenchantment: Netflix Titus, its Feisty Team, and Daemonsaspyker

Disenchantment is a Netflix show following the medieval misadventures of a hard-drinking princess, her feisty elf, and her personal demon. In this talk, we will follow the story of Netflix’s container management platform, Titus, which powers critical aspects of the Netflix business (video encoding & streaming, big data, recommendations & machine learning, and other workloads). We’ll cover the challenges growing Titus from 10’s to 1000’s of workloads. We’ll talk about our feisty team’s work across container runtimes, scheduling & control plane, and cloud infrastructure integration. We’ll talk about the demons we’ve found on this journey covering operability, security, reliability and performance.

NetflixOSS Meetup S6E2 - Spinnaker, Kayentaaspyker

In this episode, we will focus on continuous delivery and how Netflix uses Spinnaker and Kayenta to safely deliver changes to the cloud and beyond. Kayenta is a platform for Automated Canary Analysis (ACA). It is used by Spinnaker to enable automated canary deployments. We will also discuss how Spinnaker is used at Netflix to deploy targets beyond cloud VMs and containers --- batch jobs, CDNs, fast properties and Open Connect appliances.

NetflixOSS Meetup S6E1 - Titus & Containersaspyker

Come hear about our container management platform, Titus. Titus launches over 2 millions containers per week for service and batch workloads. Come to learn what applications are powered by Titus and what values the developers are getting from containers. Also, we will cover some of the Titus unique aspects of reliability, control plane, scheduling, and container runtime technologies. We will also cover our integrations with Netflix systems such as Spinnaker as well as Amazon concepts such as VPC and IAM. https://www.meetup.com/Netflix-Open-Source-Platform/events/247776324/

Container World 2018aspyker

Netflix Cloud Architecture and Open Sourceaspyker

Netflix has over 109 million members and uses over 500 microservices running on 100,000 virtual machines across 3 regions to stream over 100 million hours of content per day. Netflix open sources many of its cloud projects to improve engineering, recruit talent, and align with industry standards. Some of Netflix's notable open source projects include Chaos Monkey for testing high availability, Spinnaker for continuous delivery, and Security Monkey for monitoring security policies. While Netflix's cloud architecture and security practices were discussed, areas like big data, data persistence, UI engineering, personalization algorithms, and studio applications were not covered.

Netflix OSS Meetup Season 5 Episode 1aspyker

Topics: • RepoKid Netflix’s Open-source Strategy to Rightsizing Cloud Permissions at Scale • BetterTLS A test suite for HTTPS clients implementing verification of the Name Constraints certificate extension • Authorization at Netflix Netflix’s architecture for implementing Authorization at scale • Open Policy Agent An open source, general-purpose policy engine that enables unified, context-aware policy enforcement across the entire stack. (www.openpolicyagent.org) • Introducing PADME (Policy Access Decision Management Engine) A modern policy management for distributed heterogenous systems. (www.padme.io) Demo Stations: • Stethoscope Personalized, user-focused recommendations for employee information security. • HubCommander Slack bot for GitHub organization management -- and other things too! • Open Policy Agent An open source, general-purpose policy engine that enables unified, context-aware policy enforcement across the entire stack.

Series of Unfortunate Netflix Container Events - QConNYC17aspyker

Project Titus is Netflix's container runtime on top of Amazon EC2. Titus powers algorithm research through massively parallel model training, media encoding, data research notebooks, ad hoc reporting, NodeJS UI services, stream processing and general micro-services. As an update from last year's talk, we will focus on the lessons learned operating one of the largest container runtimes on a public cloud. We'll cover the migration we've seen of applications and frameworks from VM's to containers. We will cover the operational issues with containers that only showed after we reached the large scale (1000's of container hosts, 100's of thousands of containers launched weekly) we are currently supporting. We'll touch base on the unique features we have added to help both batch and microservices run across a variety of runtimes (Java, R, NodeJS, Python, etc) and how higher level frameworks have taken advantage of Titus's scheduling capabilities.

Netflix OSS Meetup Season 4 Episode 4aspyker

In this episode, we will focus on open sourcing how we run Netflix's open source program. Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.

Re:invent 2016 Container Scheduling, Execution and AWS Integrationaspyker

This document summarizes a presentation about Netflix's use of containers and the Titus container management platform. It discusses: 1. Why Netflix uses containers to increase innovation velocity for tasks like media encoding and software development. Containers allow for faster iteration and simpler deployment. 2. How Titus was developed to manage containers at Netflix's scale of over 100,000 VMs and 500+ microservices, since existing solutions were not suitable. Titus integrates with AWS for resources like VPC networking and EC2 instances. 3. How Titus supports both batch jobs and long-running services, with challenges like networking, autoscaling, and upgrades that services introduce beyond batch. Collaboration with Amazon on ECS

Netflix and Containers: Not A Stranger Thingaspyker

Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. The Netflix streaming service had been powered by the Amazon cloud with virtual machines for over five years, blazing a trail for similar architectures. In the last year, it invested in containers for batch-style jobs and service-style applications. Andrew Spyker will explain the potential containers have to help Netflix create a more productive development experience while simultaneously deepening its control over resource management. Join Andrew to see why Netflix is moving forward with containers, how it can leverage its existing operational machinery, and how it’s running containers with a similar guarantee of high availability as current Netflix infrastructure provides.

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.

Velocity NYC 2016 - Containers @ Netflixaspyker

Netflix uses containers to run both batch jobs and services. For batch jobs, containers simplify resource management and allow jobs like model training and media encoding to easily share resources. Services are more complex to run in containers due to challenges like constant resizing, statefulness, and networking. Netflix addresses these challenges through solutions like a VPC networking driver and reusing existing infrastructure services for containers. Looking ahead, Netflix aims to run more containers at larger scale for areas like developer experience, continuous integration, and internal resource optimization.

Netflix Open Source Meetup Season 4 Episode 3aspyker

In this episode, we will focus on security in the cloud at scale. We’ll have Netflix speakers discussing existing and upcoming security-related OSS releases, and we’ll also have external speakers from organizations that are using and contributing to Netflix security OSS. First, Patrick Kelley from Netflix’s Security Operations team will speak about RepoMan, an upcoming OSS release designed to right-size AWS permissions. Then, Wes Miaw from Netflix’s Security Engineering team will discuss MSL (Message Security Layer). We have two external speakers for this event - Chris Dorros from OpenDNS/Cisco will talk about his use of and contributions to Lemur, and Ryan Lane from Lyft will talk about their use of BLESS. After the talks, we’ll have OSS authors at demo stations to answer questions and provide demos of Netflix security OSS, including Lemur, MSL, and Security Monkey.

Netflix Container Scheduling and Execution - QCon New York 2016aspyker

Scheduling a Fuller House: Container Management At Netflix Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. Various Netflix batch jobs and an increasing number of service applications use containers for their processing. In this talk Netflix will present a deep dive on the motivations and the technology powering container deployment on top of the AWS EC2 service. The talk will cover our approach to cloud resource management and scheduling with the open source Fenzo library, along with details on docker execution engine as a part of project Titus. As well, the talk will share some of the results so far, lessons learned, and end with a brief look at the developer experience for containers.

Netflix Open Source Meetup Season 4 Episode 2aspyker

In this episode, we will take a close look at 2 different approaches to high-throughput/low-latency data stores, developed by Netflix. The first, EVCache, is a battle-tested distributed memcached-backed data store, optimized for the cloud. You will also hear about the road ahead for EVCache it evolves into an L1/L2 cache over RAM and SSDs. The second, Dynomite, is a framework to make any non-distributed data-store, distributed. Netflix's first implementation of Dynomite is based on Redis. Come learn about the products' features and hear from Thomson and Reuters, Diego Pacheco from Ilegra and other third party speakers, internal and external to Netflix, on how these products fit in their stack and roadmap.

Netflix Container Runtime - Titus - for Container Camp 2016aspyker

This document summarizes Netflix's Titus container cloud platform. It discusses Titus' high-level architecture including job management, elastic resource management and optimization, container execution, and integration capabilities. It also provides details on the Titus user interface, underlying technologies like Docker and Mesos, and current metrics like autoscaling hundreds of large EC2 instances and supporting thousands of containers per day across tens of terabytes of memory.

Netflix Open Source Meetup Season 4 Episode 1aspyker

This document summarizes Netflix's efforts to evolve their open source projects. It discusses establishing clear ownership and lifecycles for projects (active, retired, experimental). It also describes a new dashboard called the Netflix OSS Tracker to monitor project health metrics. The rest of the document demonstrates this Spinnaker continuous delivery platform that Netflix has open sourced and discusses Google's involvement in contributing to and adopting Spinnaker.

Herding Kats - Netflix’s Journey to Kubernetes Publicaspyker

Season 7 Episode 1 - Tools for Data Scientistsaspyker

CMP376 - Another Week, Another Million Containers on Amazon EC2aspyker

QConSF18 - Disenchantment: Netflix Titus, its Feisty Team, and Daemonsaspyker

NetflixOSS Meetup S6E2 - Spinnaker, Kayentaaspyker

NetflixOSS Meetup S6E1 - Titus & Containersaspyker

Container World 2018aspyker

Netflix Cloud Architecture and Open Sourceaspyker

Netflix OSS Meetup Season 5 Episode 1aspyker

Series of Unfortunate Netflix Container Events - QConNYC17aspyker

Netflix OSS Meetup Season 4 Episode 4aspyker

Re:invent 2016 Container Scheduling, Execution and AWS Integrationaspyker

Netflix and Containers: Not A Stranger Thingaspyker

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Velocity NYC 2016 - Containers @ Netflixaspyker

Netflix Open Source Meetup Season 4 Episode 3aspyker

Netflix Container Scheduling and Execution - QCon New York 2016aspyker

Netflix Open Source Meetup Season 4 Episode 2aspyker

Netflix Container Runtime - Titus - for Container Camp 2016aspyker

Netflix Open Source Meetup Season 4 Episode 1aspyker

Recently uploaded (20)

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Splunk Security Update | Public Sector Summit Germany 2025Splunk

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ