Next Generation Big Data Platform at Netflix 2014
Download as PPTX, PDF•8 likes•3,845 views
The document appears to be notes from an event at Netflix discussing cloud applications and storage. It includes details on work with S3 storage, tools like Tez and MR compilers, a distributed SQL query engine, and upcoming releases of S3 version 2.0. The notes also list a number of JIRA tickets and committed/pending pull requests related to various projects. The bottom section lists talks at the event related to cloud computing topics.
Next Generation Big Data Platform at Netflix 2014
- 1. Eva Tse, Netflix November 12, 2014 | Las Vegas, LV
- 9. Cloud apps Event Data Suro Ursula Cassandra Aegisthus 15 min Dimension Data Daily S3 SS Tables
- 10. Storage Compute Service Tools S3
- 11. Storage Compute Service Tools S3 v2.0
- 14. • Works well on S3
- 19. YARN-1864 YARN-2026 YARN-2012 YARN-2214 YARN-2360 YARN-2540
- 20. S3
- 21. S3
- 24. TezCompiler MRCompiler Tez Plan Logical Plan Physical Plan Tez Execution Engine MR Plan MR Execution Engine d
- 27. A Distributed SQL Query Engine for Big Data
- 31. 21 committed PRs and 14 PRs in review
- 32. S3
- 33. v2.0
- 44. Storage Compute Service Tools d S3 v2.0
- 49. YARN-1864 YARN-2026 YARN-2012 YARN-2214 YARN-2360 YARN-2540 HIVE-6783 HIVE-6785 HIVE-6938 HIVE-7800 PARQUET-100 PARQUET-106 PARQUET-2 PARQUET-22 PARQUET-70 PARQUET-75 PARQUET-92 PARQUET-99 PIG-3986
- 59. Talk Time Title PFC-305 Wednesday, 1:15pm Embracing Failure: Fault Injection and Service Reliability BDT-403 Wednesday, 2:15pm Next Generation Big Data Platform at Netflix PFC-306 Wednesday, 3:30pm Performance Tuning EC2 DEV-309 Wednesday, 3:30pm From Asgard to Zuul, How Netflix’s proven Open Source Tools can accelerate and scale your services ARC-317 Wednesday, 4:30pm Maintaining a Resilient Front-Door at Massive Scale PFC-304 Wednesday, 4:30pm Effective Inter-process Communications in the Cloud: The Pros and Cons of Micro Services Architectures ENT-209 Wednesday, 4:30pm Cloud Migration, Dev-Ops and Distributed Systems APP-310 Friday, 9:00am Scheduling using Apache Mesos in the Cloud