SlideShare a Scribd company logo
TensorFlow Serving, Deep
Learning on Mobile, and
Deeplearning4j on the JVM
Sam Putnam
6/8/2017
Want to learn live in New York?
I am teaching the Deploying Deep
Learning Track at Deep Learning Conf®
Tickets are available now:
www.DeepLearningConf.com
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deep Learning on Mobile
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deeplearning4j on the JVM
Part 1 of 3
TensorFlow Serving
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Exporting Your Model
http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Question Answering at Zendesk
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Training to Production
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception V1 (GoogLeNet) ‘14
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
https://www.quora.com/What-is-the-vanishing-gradient-problem
think
Oxford’s VGG 16
https://arxiv.org/pdf/1409.4842.pdf
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://research.googleblog.com/2016/08/improving-inception-and-image.html
6/8/2017
Inception V3 ’15 (2x deep, ~2x memory)
Softmax
https://www.youtube.com/watch?v=gNhogKJ_q7U
Part 2 of 3
Deep Learning on Mobile
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deploying TensorFlow to Android (presumably works - I
don’t know because I have an iOS device)
Deep Learning on Mobile
https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
https://youtu.be/XxDbKlIomhc
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
YOLO
https://youtu.be/OUdN4srAtRA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MobileNets
https://youtu.be/0vBsU__JTlA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MNIST (of course)
https://youtu.be/EL78-Rgoyfw
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
.dat or .bin files
https://github.com/LunarFlash/convolutional-neural-network-image-recognition
https://www.youtube.com/watch?v=EYP7099z6kk
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Speech Recognition and API call
https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Live Video Captioning
https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ
6/8/2017
Part 3 of 3
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j is a Deep Learning
Framework that runs on the JVM
https://deeplearning4j.org/
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Today in the DL4j Gitter
https://gitter.im/deeplearning4j/deeplearning4j
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j Integrates with Spark for Distributed Deep Learning
https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
From S3 to DL4j to Spark
https://dzone.com/articles/deep-learning-on-the-jvm
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Python Java for Training, Java for Deploy
https://youtu.be/R3lzuXPbybY?t=5m41s
6/8/2017
Thank you
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Sam@EDeepLearning.com
Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others
who have published diagrams and photos. Slides are for today only.
Always looking for new members & new locations in Cambridge, US or
NYC & new speakers to present on Deep Learning in Production topics
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
6/8/2017

More Related Content

What's hot (11)

A Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & SeleniumA Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & Selenium
James Eisenhauer
 
Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06
Carl Brown
 
Write Better JavaScript
Write Better JavaScriptWrite Better JavaScript
Write Better JavaScript
Kevin Whinnery
 
12 tricks to avoid hackers breaks your CI / CD
12 tricks to avoid hackers breaks your  CI / CD12 tricks to avoid hackers breaks your  CI / CD
12 tricks to avoid hackers breaks your CI / CD
Daniel Garcia (a.k.a cr0hn)
 
Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#
James Montemagno
 
Desenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos androidDesenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos android
Diego Figueredo
 
Rooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CDRooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CD
Daniel Garcia (a.k.a cr0hn)
 
Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015
Aleksey Razbakov
 
Provisioning environments. A simplistic approach
Provisioning  environments. A simplistic approachProvisioning  environments. A simplistic approach
Provisioning environments. A simplistic approach
Eder Roger Souza
 
Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020
Daniel Garcia (a.k.a cr0hn)
 
Prototype 151 Api
Prototype 151 ApiPrototype 151 Api
Prototype 151 Api
guestc360a2
 
A Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & SeleniumA Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & Selenium
James Eisenhauer
 
Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06
Carl Brown
 
Write Better JavaScript
Write Better JavaScriptWrite Better JavaScript
Write Better JavaScript
Kevin Whinnery
 
Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#
James Montemagno
 
Desenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos androidDesenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos android
Diego Figueredo
 
Rooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CDRooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CD
Daniel Garcia (a.k.a cr0hn)
 
Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015
Aleksey Razbakov
 
Provisioning environments. A simplistic approach
Provisioning  environments. A simplistic approachProvisioning  environments. A simplistic approach
Provisioning environments. A simplistic approach
Eder Roger Souza
 
Prototype 151 Api
Prototype 151 ApiPrototype 151 Api
Prototype 151 Api
guestc360a2
 

Viewers also liked (7)

Machine Intelligence at Google Scale: TensorFlow
Machine Intelligence at Google Scale: TensorFlowMachine Intelligence at Google Scale: TensorFlow
Machine Intelligence at Google Scale: TensorFlow
DataWorks Summit/Hadoop Summit
 
Neural Networks with Google TensorFlow
Neural Networks with Google TensorFlowNeural Networks with Google TensorFlow
Neural Networks with Google TensorFlow
Darshan Patel
 
On-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on AndroidOn-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on Android
Yufeng Guo
 
Introducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applicationsIntroducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applications
Rokesh Jankie
 
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Andrew Gardner
 
Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow
Jen Aman
 
Google TensorFlow Tutorial
Google TensorFlow TutorialGoogle TensorFlow Tutorial
Google TensorFlow Tutorial
台灣資料科學年會
 
Neural Networks with Google TensorFlow
Neural Networks with Google TensorFlowNeural Networks with Google TensorFlow
Neural Networks with Google TensorFlow
Darshan Patel
 
On-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on AndroidOn-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on Android
Yufeng Guo
 
Introducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applicationsIntroducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applications
Rokesh Jankie
 
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Andrew Gardner
 
Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow
Jen Aman
 

Similar to TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf (20)

Deep Learning and Recurrent Neural Networks in the Enterprise
Deep Learning and Recurrent Neural Networks in the EnterpriseDeep Learning and Recurrent Neural Networks in the Enterprise
Deep Learning and Recurrent Neural Networks in the Enterprise
Josh Patterson
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
sparktc
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
Steve Moore
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
sparktc
 
Deep learning on a mixed cluster with deeplearning4j and spark
Deep learning on a mixed cluster with deeplearning4j and sparkDeep learning on a mixed cluster with deeplearning4j and spark
Deep learning on a mixed cluster with deeplearning4j and spark
François Garillot
 
open source nn frameworks on cellphones
open source nn frameworks on cellphonesopen source nn frameworks on cellphones
open source nn frameworks on cellphones
Koan-Sin Tan
 
Future of ai on the jvm
Future of ai on the jvmFuture of ai on the jvm
Future of ai on the jvm
Adam Gibson
 
DL4J at Workday Meetup
DL4J at Workday MeetupDL4J at Workday Meetup
DL4J at Workday Meetup
David Kale
 
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn..."Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
Edge AI and Vision Alliance
 
Deep Learning in a nutshell
Deep Learning in a nutshellDeep Learning in a nutshell
Deep Learning in a nutshell
HopeBay Technologies, Inc.
 
Guglielmo iozzia - Google I/O extended dublin 2018
Guglielmo iozzia - Google  I/O extended dublin 2018Guglielmo iozzia - Google  I/O extended dublin 2018
Guglielmo iozzia - Google I/O extended dublin 2018
Guglielmo Iozzia
 
Deep Learning: DL4J and DataVec
Deep Learning: DL4J and DataVecDeep Learning: DL4J and DataVec
Deep Learning: DL4J and DataVec
Josh Patterson
 
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
MLconf
 
Deep Learning for Artificial Intelligence (AI)
Deep Learning for Artificial Intelligence (AI)Deep Learning for Artificial Intelligence (AI)
Deep Learning for Artificial Intelligence (AI)
Er. Shiva K. Shrestha
 
Sjug #26 ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Sjug #26   ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23Sjug #26   ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Sjug #26 ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Tomasz Sikora
 
How to Build Deep Learning Models
How to Build Deep Learning ModelsHow to Build Deep Learning Models
How to Build Deep Learning Models
Josh Patterson
 
Deep learning and Apache Spark
Deep learning and Apache SparkDeep learning and Apache Spark
Deep learning and Apache Spark
QuantUniversity
 
Running deep neural nets in your Java application with Deeplearning4j
Running deep neural nets in your Java application with Deeplearning4jRunning deep neural nets in your Java application with Deeplearning4j
Running deep neural nets in your Java application with Deeplearning4j
Alexander Fedintsev
 
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
Georgia Tech cse6242 - Intro to Deep Learning and DL4JGeorgia Tech cse6242 - Intro to Deep Learning and DL4J
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
Josh Patterson
 
Enhance your java applications with deep learning using deep netts
Enhance your java applications with deep learning using deep nettsEnhance your java applications with deep learning using deep netts
Enhance your java applications with deep learning using deep netts
Zoran Sevarac, PhD
 
Deep Learning and Recurrent Neural Networks in the Enterprise
Deep Learning and Recurrent Neural Networks in the EnterpriseDeep Learning and Recurrent Neural Networks in the Enterprise
Deep Learning and Recurrent Neural Networks in the Enterprise
Josh Patterson
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
sparktc
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
Steve Moore
 
DeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François GarillotDeepLearning4J and Spark: Successes and Challenges - François Garillot
DeepLearning4J and Spark: Successes and Challenges - François Garillot
sparktc
 
Deep learning on a mixed cluster with deeplearning4j and spark
Deep learning on a mixed cluster with deeplearning4j and sparkDeep learning on a mixed cluster with deeplearning4j and spark
Deep learning on a mixed cluster with deeplearning4j and spark
François Garillot
 
open source nn frameworks on cellphones
open source nn frameworks on cellphonesopen source nn frameworks on cellphones
open source nn frameworks on cellphones
Koan-Sin Tan
 
Future of ai on the jvm
Future of ai on the jvmFuture of ai on the jvm
Future of ai on the jvm
Adam Gibson
 
DL4J at Workday Meetup
DL4J at Workday MeetupDL4J at Workday Meetup
DL4J at Workday Meetup
David Kale
 
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn..."Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
"Large-Scale Deep Learning for Building Intelligent Computer Systems," a Keyn...
Edge AI and Vision Alliance
 
Guglielmo iozzia - Google I/O extended dublin 2018
Guglielmo iozzia - Google  I/O extended dublin 2018Guglielmo iozzia - Google  I/O extended dublin 2018
Guglielmo iozzia - Google I/O extended dublin 2018
Guglielmo Iozzia
 
Deep Learning: DL4J and DataVec
Deep Learning: DL4J and DataVecDeep Learning: DL4J and DataVec
Deep Learning: DL4J and DataVec
Josh Patterson
 
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
Josh Patterson, Advisor, Skymind – Deep learning for Industry at MLconf ATL 2016
MLconf
 
Deep Learning for Artificial Intelligence (AI)
Deep Learning for Artificial Intelligence (AI)Deep Learning for Artificial Intelligence (AI)
Deep Learning for Artificial Intelligence (AI)
Er. Shiva K. Shrestha
 
Sjug #26 ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Sjug #26   ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23Sjug #26   ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Sjug #26 ml is in java but is dl too - ver1.04 - tomasz sikora 2018-03-23
Tomasz Sikora
 
How to Build Deep Learning Models
How to Build Deep Learning ModelsHow to Build Deep Learning Models
How to Build Deep Learning Models
Josh Patterson
 
Deep learning and Apache Spark
Deep learning and Apache SparkDeep learning and Apache Spark
Deep learning and Apache Spark
QuantUniversity
 
Running deep neural nets in your Java application with Deeplearning4j
Running deep neural nets in your Java application with Deeplearning4jRunning deep neural nets in your Java application with Deeplearning4j
Running deep neural nets in your Java application with Deeplearning4j
Alexander Fedintsev
 
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
Georgia Tech cse6242 - Intro to Deep Learning and DL4JGeorgia Tech cse6242 - Intro to Deep Learning and DL4J
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
Josh Patterson
 
Enhance your java applications with deep learning using deep netts
Enhance your java applications with deep learning using deep nettsEnhance your java applications with deep learning using deep netts
Enhance your java applications with deep learning using deep netts
Zoran Sevarac, PhD
 

More from Sam Putnam [Deep Learning] (6)

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Sam Putnam [Deep Learning]
 
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Sam Putnam [Deep Learning]
 
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Sam Putnam [Deep Learning]
 
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Sam Putnam [Deep Learning]
 
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Sam Putnam [Deep Learning]
 
Quality and Testing of AI Algorithms - Enterprise Deep Learning
Quality and Testing of AI Algorithms - Enterprise Deep LearningQuality and Testing of AI Algorithms - Enterprise Deep Learning
Quality and Testing of AI Algorithms - Enterprise Deep Learning
Sam Putnam [Deep Learning]
 
Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Lear...
Sam Putnam [Deep Learning]
 
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Sam Putnam [Deep Learning]
 
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Sam Putnam [Deep Learning]
 
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Introduction to Machine Learning for Healthcare, Finance, Energy, and Commerc...
Sam Putnam [Deep Learning]
 
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Transforming Healthcare, Finance, Energy, and Commerce with Machine Learning,...
Sam Putnam [Deep Learning]
 
Quality and Testing of AI Algorithms - Enterprise Deep Learning
Quality and Testing of AI Algorithms - Enterprise Deep LearningQuality and Testing of AI Algorithms - Enterprise Deep Learning
Quality and Testing of AI Algorithms - Enterprise Deep Learning
Sam Putnam [Deep Learning]
 

Recently uploaded (20)

Scalefusion Remote Access for Apple Devices
Scalefusion Remote Access for Apple DevicesScalefusion Remote Access for Apple Devices
Scalefusion Remote Access for Apple Devices
Scalefusion
 
Top 5 Odoo Modules for the EPC Industry.pdf
Top 5 Odoo Modules for the EPC Industry.pdfTop 5 Odoo Modules for the EPC Industry.pdf
Top 5 Odoo Modules for the EPC Industry.pdf
SatishKumar2651
 
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
officeiqai
 
Marketing And Sales Software Services.pptx
Marketing And Sales Software Services.pptxMarketing And Sales Software Services.pptx
Marketing And Sales Software Services.pptx
julia smits
 
German Marketo User Group - May 2025 survey results
German Marketo User Group - May 2025 survey resultsGerman Marketo User Group - May 2025 survey results
German Marketo User Group - May 2025 survey results
BradBedford3
 
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROIAutoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Udit Goenka
 
Key Characteristics of High-Performing Insurance Broker Software
Key Characteristics of High-Performing Insurance Broker SoftwareKey Characteristics of High-Performing Insurance Broker Software
Key Characteristics of High-Performing Insurance Broker Software
Insurance Tech Services
 
Offensive Security Penetration Testing
Offensive Security Penetration Testing        Offensive Security Penetration Testing
Offensive Security Penetration Testing
Purple Box
 
AI Alternative - Discover the best AI tools and their alternatives
AI Alternative - Discover the best AI tools and their alternativesAI Alternative - Discover the best AI tools and their alternatives
AI Alternative - Discover the best AI tools and their alternatives
AI Alternative
 
Why-Choose-an-Authorised-Microsoft-Reseller.pptx
Why-Choose-an-Authorised-Microsoft-Reseller.pptxWhy-Choose-an-Authorised-Microsoft-Reseller.pptx
Why-Choose-an-Authorised-Microsoft-Reseller.pptx
Michael cole
 
Software Risk and Quality management.pptx
Software Risk and Quality management.pptxSoftware Risk and Quality management.pptx
Software Risk and Quality management.pptx
HassanBangash9
 
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdfSecure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Northwind Technologies
 
Shortcomings of EHS Software – And How to Overcome Them
Shortcomings of EHS Software – And How to Overcome ThemShortcomings of EHS Software – And How to Overcome Them
Shortcomings of EHS Software – And How to Overcome Them
TECH EHS Solution
 
Facility Management Solution - TeroTAM CMMS Software
Facility Management Solution - TeroTAM CMMS SoftwareFacility Management Solution - TeroTAM CMMS Software
Facility Management Solution - TeroTAM CMMS Software
TeroTAM
 
Delivering More with Less: AI Driven Resource Management with OnePlan
Delivering More with Less: AI Driven Resource Management with OnePlan Delivering More with Less: AI Driven Resource Management with OnePlan
Delivering More with Less: AI Driven Resource Management with OnePlan
OnePlan Solutions
 
Software Quality Assurance (Models).pptx
Software Quality Assurance (Models).pptxSoftware Quality Assurance (Models).pptx
Software Quality Assurance (Models).pptx
HibbaTabeer
 
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdfBoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
Ortus Solutions, Corp
 
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
MOSIUOA WESI
 
What's-New-with-BoxLang-Brad Wood.pptx.pdf
What's-New-with-BoxLang-Brad Wood.pptx.pdfWhat's-New-with-BoxLang-Brad Wood.pptx.pdf
What's-New-with-BoxLang-Brad Wood.pptx.pdf
Ortus Solutions, Corp
 
Improving Engagement with CRM Software for Instance Agents
Improving Engagement with CRM Software for Instance AgentsImproving Engagement with CRM Software for Instance Agents
Improving Engagement with CRM Software for Instance Agents
Insurance Tech Services
 
Scalefusion Remote Access for Apple Devices
Scalefusion Remote Access for Apple DevicesScalefusion Remote Access for Apple Devices
Scalefusion Remote Access for Apple Devices
Scalefusion
 
Top 5 Odoo Modules for the EPC Industry.pdf
Top 5 Odoo Modules for the EPC Industry.pdfTop 5 Odoo Modules for the EPC Industry.pdf
Top 5 Odoo Modules for the EPC Industry.pdf
SatishKumar2651
 
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
Feeling Lost in the Blue? Exploring a New Path: AI Mental Health Counselling ...
officeiqai
 
Marketing And Sales Software Services.pptx
Marketing And Sales Software Services.pptxMarketing And Sales Software Services.pptx
Marketing And Sales Software Services.pptx
julia smits
 
German Marketo User Group - May 2025 survey results
German Marketo User Group - May 2025 survey resultsGerman Marketo User Group - May 2025 survey results
German Marketo User Group - May 2025 survey results
BradBedford3
 
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROIAutoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Autoposting.ai Sales Deck - Skyrocket your LinkedIn's ROI
Udit Goenka
 
Key Characteristics of High-Performing Insurance Broker Software
Key Characteristics of High-Performing Insurance Broker SoftwareKey Characteristics of High-Performing Insurance Broker Software
Key Characteristics of High-Performing Insurance Broker Software
Insurance Tech Services
 
Offensive Security Penetration Testing
Offensive Security Penetration Testing        Offensive Security Penetration Testing
Offensive Security Penetration Testing
Purple Box
 
AI Alternative - Discover the best AI tools and their alternatives
AI Alternative - Discover the best AI tools and their alternativesAI Alternative - Discover the best AI tools and their alternatives
AI Alternative - Discover the best AI tools and their alternatives
AI Alternative
 
Why-Choose-an-Authorised-Microsoft-Reseller.pptx
Why-Choose-an-Authorised-Microsoft-Reseller.pptxWhy-Choose-an-Authorised-Microsoft-Reseller.pptx
Why-Choose-an-Authorised-Microsoft-Reseller.pptx
Michael cole
 
Software Risk and Quality management.pptx
Software Risk and Quality management.pptxSoftware Risk and Quality management.pptx
Software Risk and Quality management.pptx
HassanBangash9
 
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdfSecure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Secure and Simplify IT Management with ManageEngine Endpoint Central.pdf
Northwind Technologies
 
Shortcomings of EHS Software – And How to Overcome Them
Shortcomings of EHS Software – And How to Overcome ThemShortcomings of EHS Software – And How to Overcome Them
Shortcomings of EHS Software – And How to Overcome Them
TECH EHS Solution
 
Facility Management Solution - TeroTAM CMMS Software
Facility Management Solution - TeroTAM CMMS SoftwareFacility Management Solution - TeroTAM CMMS Software
Facility Management Solution - TeroTAM CMMS Software
TeroTAM
 
Delivering More with Less: AI Driven Resource Management with OnePlan
Delivering More with Less: AI Driven Resource Management with OnePlan Delivering More with Less: AI Driven Resource Management with OnePlan
Delivering More with Less: AI Driven Resource Management with OnePlan
OnePlan Solutions
 
Software Quality Assurance (Models).pptx
Software Quality Assurance (Models).pptxSoftware Quality Assurance (Models).pptx
Software Quality Assurance (Models).pptx
HibbaTabeer
 
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdfBoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
Ortus Solutions, Corp
 
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
🤖🤖🤖Charasteristic of Agentic AI 🤖🤖🤖
MOSIUOA WESI
 
What's-New-with-BoxLang-Brad Wood.pptx.pdf
What's-New-with-BoxLang-Brad Wood.pptx.pdfWhat's-New-with-BoxLang-Brad Wood.pptx.pdf
What's-New-with-BoxLang-Brad Wood.pptx.pdf
Ortus Solutions, Corp
 
Improving Engagement with CRM Software for Instance Agents
Improving Engagement with CRM Software for Instance AgentsImproving Engagement with CRM Software for Instance Agents
Improving Engagement with CRM Software for Instance Agents
Insurance Tech Services
 

TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf

  • 1. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Want to learn live in New York? I am teaching the Deploying Deep Learning Track at Deep Learning Conf® Tickets are available now: www.DeepLearningConf.com
  • 2. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 TensorFlow Serving
  • 3. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Deep Learning on Mobile
  • 4. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Deeplearning4j on the JVM
  • 5. Part 1 of 3 TensorFlow Serving TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 6. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Exporting Your Model http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/ 6/8/2017
  • 7. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Question Answering at Zendesk https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017
  • 8. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Training to Production https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017
  • 9. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Inception V1 (GoogLeNet) ‘14 https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017 https://www.quora.com/What-is-the-vanishing-gradient-problem think Oxford’s VGG 16 https://arxiv.org/pdf/1409.4842.pdf
  • 10. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://research.googleblog.com/2016/08/improving-inception-and-image.html 6/8/2017 Inception V3 ’15 (2x deep, ~2x memory) Softmax https://www.youtube.com/watch?v=gNhogKJ_q7U
  • 11. Part 2 of 3 Deep Learning on Mobile Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 12. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Deploying TensorFlow to Android (presumably works - I don’t know because I have an iOS device) Deep Learning on Mobile https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba 6/8/2017
  • 13. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Inception https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ https://youtu.be/XxDbKlIomhc
  • 14. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ YOLO https://youtu.be/OUdN4srAtRA
  • 15. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ MobileNets https://youtu.be/0vBsU__JTlA
  • 16. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ MNIST (of course) https://youtu.be/EL78-Rgoyfw
  • 17. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam .dat or .bin files https://github.com/LunarFlash/convolutional-neural-network-image-recognition https://www.youtube.com/watch?v=EYP7099z6kk 6/8/2017
  • 18. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Speech Recognition and API call https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be 6/8/2017
  • 19. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Live Video Captioning https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ 6/8/2017
  • 20. Part 3 of 3 Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 21. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Deeplearning4j is a Deep Learning Framework that runs on the JVM https://deeplearning4j.org/ 6/8/2017
  • 22. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Today in the DL4j Gitter https://gitter.im/deeplearning4j/deeplearning4j 6/8/2017
  • 23. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam DL4j Integrates with Spark for Distributed Deep Learning https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17 6/8/2017
  • 24. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam From S3 to DL4j to Spark https://dzone.com/articles/deep-learning-on-the-jvm 6/8/2017
  • 25. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Python Java for Training, Java for Deploy https://youtu.be/R3lzuXPbybY?t=5m41s 6/8/2017
  • 26. Thank you TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam [email protected] Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others who have published diagrams and photos. Slides are for today only. Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77 6/8/2017