Edge Engineering Women in Tech Dinner (2018.03.22)
5 likes2,045 views
The document discusses a women in tech dinner event at Netflix HQ that featured several women engineers who work on Netflix's edge architecture. The edge architecture powers core product experiences and includes components like Zuul cloud gateway, NodeQuark edge device services, API service layer, playback licensing, and edge developer experience. Each featured speaker discussed their role and challenges they help address like reliability, availability, traffic management, and developer productivity.
Edge Engineering Women in Tech Dinner (2018.03.22)
- 1. Women Living On The Edge Women in Tech Dinner March 22, 2018 Netflix HQ, Los Gatos
- 2. 190+ Countries 117+ Million Members
- 4. 140+ Million Hours Streamed DAILY
- 6. Edge powers core product experiences
- 7. Edge powers core product experiences
- 8. Edge powers core product experiences
- 9. Edge powers core product experiences
- 10. Compelling product Reliable experience
- 11. Compelling product Reliable experience
- 12. Zuul Cloud Gateway Mid-Tier Services Netflix Edge Architecture API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services
- 13. Gaya Varadarajan Senior Software Engineer Cloud Gateway Kim Trott Engineering Director Edge Device Services Karen Casella Engineering Leader Edge & Playback Access Haripriya Murthy Senior Software Engineer Playback Licensing Sangeeta Narayanan Engineering Director Edge Dev Experience Daniela Enyedi Senior Software Engineer DNA API Meet the Women Living on the Edge
- 15. Zuul Cloud Gateway Mid-Tier Services API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services Cloud Gateway
- 16. Persistence Tier Business services Tier Presentation Tier Website API DB Traffic steering, routing, and insights
- 17. Resiliency Persistence Tier Business services Tier Presentation Tier Website API DB
- 18. Resiliency Persistence Tier Business services Tier Presentation Tier Website API DB
- 19. Resiliency Persistence Tier Business services Tier Presentation Tier Website API DB Persistence Tier Business services Tier Presentation Tier Website API DB Persistence Tier Business services Tier Presentation Tier Website API DB
- 20. Zuul to Backend Debugging Throttling Contextual Alerting Sticky Canary Zuul to Device DDOS Mitigation Anomaly detection Security Protocols Canarying Cross Region Resiliency Smart Load BalancingFlexibility Alerts Load Shedding Resiliency Self Service Routing Custom CanaryPush Messages
- 21. Debugging Throttling Contextual Alerting Sticky Canary Zuul to Device DDOS Mitigation Anomaly detection Security Protocols Canarying Smart Load BalancingFlexibility Alerts Load Shedding Resiliency Self Service Routing Custom Canary Cross Region Resiliency Zuul to Backend Push Messages
- 25. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 26. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 28. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 30. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 32. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 34. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 36. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 37. Reject Spam Configure timeouts Sticky Canary Custom Canary Primary Routing Ramp new Backend Route Overrides Squeeze testing Self Service Routing
- 41. Talk to Me About... ● Self Service Routing ● Traffic Shaping ● DDOS Mitigation ● Availability & Reliability ● Insights
- 42. Edge Device Services Kim Trott
- 43. Zuul Cloud Gateway Mid-Tier Services API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services NodeQuark
- 46. What’s similar? What’s different?
- 47. I MY BFF
- 52. Platform as a Service Allows engineers “...to develop, run, and manage applications without the complexity of building and maintaining infrastructure…” - wikipedia
- 53. Isolation
- 55. Isolation ● Isolate failures ● Independent root cause
- 56. Isolation ● Isolate failures ● Independent root cause ● Fine-grained capacity management
- 57. Isolation ● Isolate failures ● Independent root cause ● Fine-grained capacity management ● Better regression / performance testing
- 59. Talk to Me About... ● Node.js ● Observability ● Availability and Reliability ● gRPC ● Diagnostics Tools
- 60. API Service Layer Karen Casella
- 61. Zuul Cloud Gateway Mid-Tier Services API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services API Service Layer
- 63. Sign-Up Discovery API Service Layer
- 64. Sign-Up Discovery Playback API Service Layer
- 65. Sign-Up Discovery Playback API Service Layer ● Orchestration
- 66. Sign-Up Discovery Playback API Service Layer ● Orchestration ● Availability Protection
- 67. Sign-Up Discovery Playback API Service Layer ● Orchestration ● Availability Protection ● Abstraction
- 69. Challenges & Opportunities Time to ResolveObservability
- 70. Challenges & Opportunities Time to Resolve Blast RadiusObservability
- 71. Breaking Sharding the Monolith “The price of reliability is the pursuit of the utmost simplicity” - C.A.R. Hoare, Turing Award Lecture, 1980
- 72. Sharding Strategies CRITICAL NON CRITICAL Traffic Criticality Traffic Volume (Function or Source)
- 73. Mid-Tier Services Example API Sharding Mobile API Shard Ratings Smart TV API Shard Bookmarks Account
- 74. Results ↓Time to Detect & Debug
- 75. Results ↓Time to Resolve↓Time to Detect & Debug
- 76. Results ↓Time to Resolve ↓ Blast Radius ↑ Reliability ↓Time to Detect & Debug
- 77. Trade-Offs ● ↑ Configuration Overhead ● ↑ Operational Complexity Operational Overhead Availability
- 78. Talk to Me About... ● Playback Licensing / DRM Tech ● Authentication Services ● Availability & Reliability ● Inclusion & Diversity ● Operations @ Scale ● Availability & Reliability ● Service Orchestration
- 81. Zuul Cloud Gateway Mid-Tier Services API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services Playback Licensing
- 83. Chunking & Encryption CDN Key Store Fetch Playlist Playback API 1
- 84. Chunking & Encryption CDN Key Store Playback Licensing Fetch Playlist Playback API 1 2 Fetch License
- 86. Mid-Tier Services Playback Licensing API Service Layer Playback Licensing License Server License Server License Server
- 87. Mid-Tier Services Playback Licensing API Service Layer Playback Licensing License Server Offline License Server License Server Offline Key Server Key Server Netflix Micro- services
- 88. Mid-Tier Services Playback Licensing API Service Layer Playback Licensing License Server Offline License Server License Server Offline Key Server Key Server Netflix Micro- services
- 92. Mid-Tier Services Playback Licensing API Service Layer Playback Licensing License Server Offline License Server License Server Offline Key Server Key Server Netflix Micro- services
- 93. Talk to Me About... ● Playback Licensing / DRM Tech ● New Engineer @ Netflix ● Chaos Engineering ● Service Reliability
- 94. Edge Developer Experience Sangeeta Narayanan
- 95. Zuul Cloud Gateway Mid-Tier Services API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services Productivity & Insights
- 96. High rate of change
- 99. Example: Rapid local iterations
- 102. Detect Recover Root cause
- 104. Example: Domain specific insights
- 105. Build in observability BE SAFE
- 108. MOVE FAST, BE SAFE, STAY CALM Compelling product Reliable experience
- 109. Learn more The Netflix Tech Blog https://netflix.github.io/
- 110. Talk to Me About... ● Developer Experience ● Observability ● PaaS, Containers, Serverless ● Engineering Leadership
- 111. Thank you!
- 112. Join Us for Dinner! #SheRules
- 113. Zuul Cloud Gateway Mid-Tier Services Netflix Edge Architecture API Service Layer NodeQuark Edge Device Services AuthN Services DEVELOPER PRODUCTIVITY OPERATIONAL INSIGHTS Playback Licensing Netflix Micro- services Data Source Data Gathering Data Transforma tion Data Delivery Data Presen tation