Real time data processing and model inferncing platform with Kafka streams (Navinder Singh - Walmart)
2 likes278 views
Speaker: Navinder Pal Singh Brar (https://www.linkedin.com/in/navinderpalsinghbrar/) Talk presented during Bangalore Kafka group's stream processing meetup at Walmart https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/266777028/
Ad
More Related Content
What's hot (20)
Similar to Real time data processing and model inferncing platform with Kafka streams (Navinder Singh - Walmart) (20)
Ad
More from KafkaZone (7)
Ad
Recently uploaded (20)
Real time data processing and model inferncing platform with Kafka streams (Navinder Singh - Walmart)
- 1. 1 Building real-time data processing and model inferencing platform with Kafka Streams Navinder Pal Singh Brar
- 2. Confidential and Proprietary Personalization Fraud detection Display advertisement Email advertisement Omnichannel reorder Autosuggest for out of stock products Delivery Optimization Smart pricing Inventory Forecasting Voice Commerce ML @ Walmart
- 3. Confidential and Proprietary Business understanding Data Collection Data Preparation Exploratory Data Analysis Modelling Model Evaluation Model Deployment Data ScienceModel Life cycle Remaining 30-40% to make it production ready with help of developers 50% + time spending in data collection and cleaning activity Courtesy: http://www.oogazone.com, https://www.vectorstock.com
- 4. Confidential and Proprietary Build a platform to process events, derive inferences and serve knowledge Reliable, highly available and scalable and scalable High throughput and low latency latency Universal feature store across models across models Pluggable design to onboard new onboard new models Reduce dev to prod time Mission Statement
- 5. Confidential and Proprietary Customer Backbone - CBB Distributed streams processing platform built on Kafka Streams Data scientists can bring their trained models and host them on top of CBB, which takes care of • Data Ingestion • Data Transformation • Feature Extraction • Model Inferencing/Scoring • Post Processing Motto: Depth, Freshness & Reach
- 6. Confidential and Proprietary 6 CBB Platform Kafka Streams Recommendation Personalization Fraud Detection …. CBB Internal Kafka Partition: 0 Kafka Streams Partition: 1 CBB Data Pipeline
- 7. Confidential and Proprietary Why Streams? Simple Library, not a framework Embedded DB Interactive Queries Highly scalable DSL/Low Level APIs At least/Exactly once guarantees Apache Samza Apache Spark Apache Flink Dynomite Other alternatives
- 8. Confidential and Proprietary Multitenancy: the challenges Sequential execution of tenant models 1 Any corrupt model can bring down the JVM 2 Any model upgrade requires JVM restart 3 Client Isolation 4
- 9. Confidential and Proprietary 9 CBB Data Pipeline CBB Platform Kafka Streams Recommendation Personalization Fraud Detection …. CBB Internal Kafka
- 10. Confidential and Proprietary CBB Processor CBB Store KIP-408: Add Asynchronous Processing To Kafka Streams CBB Internals C storeB storeA store Model A Model B Model C Before Model A Model B Model C A store B store C store After
- 11. Confidential and Proprietary Process events and update CBB stores Different clients can pull events at own pace Appropriate sharing and isolation Multitenancy: the solution
- 12. Confidential and Proprietary 12 Data Model Tenant Stores Hop-On Store Platform Store LEAF Store 1. Linkages –customer graph 2. Events – customer interactions 3. Address – Addressable entities 4. Facets – customer features Platform Store Sequence Store
- 13. Confidential and Proprietary Sequence Store 0 1 2 3 4 5 6 7 8 … … … …9 10 11 CBB Processorwrites here Model A (offset=3) Model B (offset=8) Sequence Store
- 14. Confidential and Proprietary Model Inferencing Problem Data scientists use various machine learning libraries and need to support them in production e.g. Spark ML, Scikit- learn, Tensorflow Solution Mleap Runtime Provides production level scoring infrastructure independent on the core libraries Execute Spark ML Pipelines without the dependency on the spark context Execute Scikit-learn pipelines without the dependency on numpy, pandas
- 15. Confidential and Proprietary VM 1 VM 2 VM 3 VM 4 Global Topic Global Datastores App Cluster
- 16. Confidential and Proprietary Global Datastores Problem Global data e.g. product catalog One copy of global store per jvm Processing global topics doesn't work with huge data Global data is required before an active task moves to a VM Solution Create global stores in a different Kafka streams app and bootstrap each jvm on update
- 17. Confidential and Proprietary 11000 stores in 27 countries 100 million weekly customers instores 100 million uniquemonthly visitors @Walmart.com 55 bannersincluding includingJet.com, Hayneedle Source: https://corprate.walmart.com/our-story/our-business Walmart Scale
- 18. Confidential and Proprietary Problem: Link different id’s data together when they are identified to be same person Identity Graph Processing Solution: Real time Identity Graph Conflation. Aims to provide a coherent view of a customer by building an identity graph uniting all customer identities across channels and across Walmart subsidiaries
- 19. Confidential and Proprietary Graph processing co-locates the data of two or more customer identities linked to each other on the same physical node. id3 id1 id4 id2 id5 id6 id1id6 id5 id4 id3 id2 = Node A Node B Node A Customer Identity Graph
- 20. Confidential and Proprietary Benchmarks Kafka Cluster : 400 cores Kafka Streams : 800 cores
- 21. Confidential and Proprietary Benefits Money Time Effort Minimal duplication Low Latency Reduces maintenance overhead Courtsey: https://www.vectorstock.com