When to Use MongoDB...and When You Should Not...
Download as PPTX, PDF16 likes6,695 views
MongoDB is well-suited for applications that require: - A flexible data model to handle diverse and changing data sets - Strong performance on mixed workloads involving reads, writes, and updates - Horizontal scalability to grow with increasing user needs and data volume Some common use cases that leverage MongoDB's strengths include mobile apps, real-time analytics, content management, and IoT applications involving sensor data. However, MongoDB is less suited for tasks requiring full collection scans under load, high write availability, or joins across collections.
![MongoDB Strategic Advantages
Horizontally Scalable
-Sharding
Agile
Flexible
High Performance &
Strong Consistency
Application
Highly
Available
-Replica Sets
{ author: “eliot”,
date: new Date(),
text: “MongoDB”,
tags: [“database”, “flexible”,
“JSON”]}](https://image.slidesharecdn.com/atleveningwithmongodb20150924-150925130224-lva1-app6892/85/When-to-Use-MongoDB-and-When-You-Should-Not-19-320.jpg)
![Document Data Model
Relational MongoDB
{
first_name: ‘Paul’,
surname: ‘Miller’,
city: ‘London’,
location:
[45.123,47.232],
cars: [
{ model: ‘Bentley’,
year: 1973,
value: 100000, … },
{ model: ‘Rolls Royce’,
year: 1965,
value: 330000, … }
]
}](https://image.slidesharecdn.com/atleveningwithmongodb20150924-150925130224-lva1-app6892/85/When-to-Use-MongoDB-and-When-You-Should-Not-20-320.jpg)
![Do More With Your Data
MongoDB
{
first_name: ‘Paul’,
surname: ‘Miller’,
city: ‘London’,
location:
[45.123,47.232],
cars: [
{ model: ‘Bentley’,
year: 1973,
value: 100000, … },
{ model: ‘Rolls Royce’,
year: 1965,
value: 330000, … }
}
}
Rich Queries
Find Paul’s cars
Find everybody in London with a car
built between 1970 and 1980
Geospatial
Find all of the car owners within 5km
of Trafalgar Sq.
Text Search
Find all the cars described as having
leather seats
Aggregation
Calculate the average value of Paul’s
car collection
Map Reduce
What is the ownership pattern of
colors by geography over time?
(is purple trending up in China?)](https://image.slidesharecdn.com/atleveningwithmongodb20150924-150925130224-lva1-app6892/85/When-to-Use-MongoDB-and-When-You-Should-Not-21-320.jpg)
![Molecular Similarity Database
• Store Chemical Compound Fingerprints
• Find compounds which are “close” to a given
compound
• Tanimoto association coefficient compares two
compounds based on their common
fingerprints
• Aggregation framework $setIntersection
Source: Chemical Similarity Search in MongoDB by Matt Swain
01001011 [2, 5, 7, 8, …]](https://image.slidesharecdn.com/atleveningwithmongodb20150924-150925130224-lva1-app6892/85/When-to-Use-MongoDB-and-When-You-Should-Not-36-320.jpg)
![Seismic Modeling
• 2000 x 2000 x 2000 cubic data set
• 8 billion floats
• Relational model can take several
minutes for some calculations
• MongoDB query performs in ~1 second
{
"_id": ObjectId("55e7358e1a317d0fb177b31e"),
"x": 100,
"y": 25,
"z": [0.8506244646719524,
0.18891124618195854,
0.14090160846138955, ...
]
}](https://image.slidesharecdn.com/atleveningwithmongodb20150924-150925130224-lva1-app6892/85/When-to-Use-MongoDB-and-When-You-Should-Not-38-320.jpg)
Ad
More Related Content
What's hot (20)
Similar to When to Use MongoDB...and When You Should Not... (20)
Ad
More from MongoDB (20)
![MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]](https://cdn.slidesharecdn.com/ss_thumbnails/315pminfosysfinalsfoversionvocalpart1-200120221508-thumbnail.jpg?width=560&fit=bounds)
Ad
Recently uploaded (20)
When to Use MongoDB...and When You Should Not...
- 2. When should you use MongoDB ….And when you should not…. Jake Angerman Sr. Solutions Architect MongoDB
- 3. Agenda • What is MongoDB? • What is MongoDB for? • What does MongoDB do very well…. and less well • What do customers do very well with MongoDB, and what they do not do • Some unusual use cases • When you should use MongoDB
- 4. CREATE APPLICATIONS NEVER BEFORE POSSIBLE AGILE SCALABLE
- 5. Factors Driving Modern Applications Data • 90% data created in last 2 years • 80% enterprise data is unstructured • Unstructured data growing 2X rate of structured data Mobile • 2 Billion smartphones in 2015 • Mobile now >50% internet use • 26 Billion devices on IoT by 2020 Social • 72% of internet use is social media • 2 Billion active users monthly • 93% of businesses use social media Cloud • Compute costs declining 33% YOY • Storage costs declining 38% YOY • Network costs declining 27% YOY
- 6. Who is Generating Data? 1.7B Internet users in 2015
- 7. What is Generating Data? 2B smart phones in 2015
- 10. Systems of Engagement • Fueled by mobile devices and sensors • Focus on Communication, Collaboration, Contextual • "The planet is wiring itself a new nervous system." • Enterprise IT must embrace consumer technology, not the other way around • Systems of record are no longer adequate 1991 2011 IBM 3370 hard disk (571MB), 1979Edgar Codd, 1971 Lotus 1-2-3, 1983
- 11. What is MongoDB for? • The data store for all systems of engagement – Demanding, real-time SLAs – Diverse, mixed data sets – Massive concurrency – Globally deployed over multiple sites – No downtime tolerated – Able to grow with user needs – High uncertainty in sizing – Fast scaling needs – Delivers a seamless and consistent experience
- 16. What MongoDB is NOT • An analytical suite – Not competing with SAS or SPSS • A data warehouse technology – Not competing with Teradata, Netezza, Vertica • A BI tool – Not competing with Tableau or QlikView • Backoffice transaction processing – Not competing with IBM Mainframes • Backend for a billing system or general ledger system – Not competing with Oracle RAC • A search engine – Not competing with Elasticsearch or SOLR
- 17. MongoDB and Enterprise IT Stack
- 18. MongoDB and Enterprise IT Stack OLTP OLAP
- 19. MongoDB Strategic Advantages Horizontally Scalable -Sharding Agile Flexible High Performance & Strong Consistency Application Highly Available -Replica Sets { author: “eliot”, date: new Date(), text: “MongoDB”, tags: [“database”, “flexible”, “JSON”]}
- 20. Document Data Model Relational MongoDB { first_name: ‘Paul’, surname: ‘Miller’, city: ‘London’, location: [45.123,47.232], cars: [ { model: ‘Bentley’, year: 1973, value: 100000, … }, { model: ‘Rolls Royce’, year: 1965, value: 330000, … } ] }
- 21. Do More With Your Data MongoDB { first_name: ‘Paul’, surname: ‘Miller’, city: ‘London’, location: [45.123,47.232], cars: [ { model: ‘Bentley’, year: 1973, value: 100000, … }, { model: ‘Rolls Royce’, year: 1965, value: 330000, … } } } Rich Queries Find Paul’s cars Find everybody in London with a car built between 1970 and 1980 Geospatial Find all of the car owners within 5km of Trafalgar Sq. Text Search Find all the cars described as having leather seats Aggregation Calculate the average value of Paul’s car collection Map Reduce What is the ownership pattern of colors by geography over time? (is purple trending up in China?)
- 22. How Databases Stack Up Requirement RDBMS Key/value Wide column MongoDB Hierarchical data Poor Poor Good Great Dynamic schema Poor Poor Poor Great Native OOP lang Poor Great Great Great Software cost Poor Great Great Great Performance Poor Great Great Great Scale Poor Great Great Great Data consistency Great Poor Poor Great Rich querying Great Poor Poor Great Ease of use Good Good Poor Great
- 23. Requirement RDBMS Key/value Wide column MongoDB Hierarchical data Poor Poor Good Great Dynamic schema Poor Poor Poor Great Native OOP lang Poor Great Great Great Software cost Poor Great Great Great Performance Poor Great Great Great Scale Poor Great Great Great Data consistency Great Poor Poor Great Rich querying Great Poor Poor Great Ease of use Good Good Poor Great How Databases Stack Up VALUE OF NOSQL
- 24. Requirement RDBMS Key/value Wide column MongoDB Hierarchical data Poor Poor Good Great Dynamic schema Poor Poor Poor Great Native OOP lang Poor Great Great Great Software cost Poor Great Great Great Performance Poor Great Great Great Scale Poor Great Great Great Data consistency Great Poor Poor Great Rich querying Great Poor Poor Great Ease of use Good Good Poor Great How Databases Stack Up VALUE OF NOSQL VALUE OF MONGODB
- 25. MongoDB does well • Straightforward replication • High performance on mixed workloads of reads, inserts, and updates • Scaling on demand • Location based deployment • Geo spatial queries • High Availability and auto failover • Flexible schema & secondary indexing • Agile development in most programming languages • Commodity infrastructure • Real time analytics • Text indexing • Data consistency • Compression As a database, where does MongoDB shine? Easy to initiate All reads, mixed, and mostly writes No expensive overprovisioning One cluster can span the globe Easy to build relevant mobile apps Low stress operations No need for complex data modeling No need to give up your favorite development language No vendor lock-in through hardware Get value from data right away ! Basic search feature Simpler app design With new version 3.0
- 26. MongoDB does less well • Resource management * • Collection scanning under load * • Absolute write availability • Faceted search • Joins across collections • SQL* • Transactions over multiple docs As a database, where does MongoDB shine? Needs to be done at infrastructure level Concurrent scans can disrupt the working set Consistency vs Availability Core value of search engines Doc model mitigates need for this Some partial solutions (ODBC) Pushed to application level. Rarely needed with good schema design
- 27. MongoDB Use Cases Single View Internet of Things Mobile Real-Time Analytics Catalog Personalization Content Management
- 28. MongoDB is good for • Single View • Internet of Things – sensor data • Mobile apps – geospatial • Real-time analytics • Catalog • Personalization • Content management • Inventory management • Personalization engines • Shopping cart • Dependent datamarts • Archiving for fast lookup • Collaboration tools • Messaging applications • Log file aggregation • Caching • Adserving • …… Use Cases where MongoDB shines Mixture of analytics and archiving Build information from data as it comes in Extract from DW for analysis Large volume, targeted queries Sharing in near real time Twitter-like apps E.g., SPLUNK Enable massive reads on consolidated data
- 29. MongoDB is less good for • Search engine • Slicing and dicing of data requiring joins and full collections scans • Nanosecond latency writing (real time tick data) • Uptime beyond 99.999%, instant failover • Batch processing Use cases where MongoDB shines Text indexing only for elementary uses Working set should fit in RAM. Specialty DBs like Kdb are built for this MongoDB needs a few seconds for a failover That’s what Hadoop is for…. Note: transaction processing does not require database transactions. Move money from account A to account B is never instantaneous and requires actual processing…. Usually in batch
- 30. Strategic Reporting Data Consolidation Data Warehouse Real-time or Batch Engagement Applicaiton Engagement Applicaiton Operational Data Hub Benefits • Real-time • Complete details • Agile • Higher customer retention • Increase wallet share • Proactive exception handling Operational Reporting Cards Loans Deposits CardsData Source 1 LoansData Source 2 Deposits … Data Source n
- 31. Data Hub for Large Investment Bank Feeds & Batch data • Pricing • Accounts • Securities Master • Corporate actions Source Master Data (RDBMS) Batch Batch Batch Batch Batch Batch Batch Destination Data (RDBMS) Each represents • People $ • Hardware $ • License $ • Reg penalty $ • & other downstream problems
- 32. Data Hub for Large Investment Bank Feeds & Batch data • Pricing • Accounts • Securities Master • Corporate actions Source Master Data (RDBMS) Batch Batch Batch Batch Batch Batch Batch Destination Data (RDBMS) Each represents • People $ • Hardware $ • License $ • Reg penalty $ • & other downstream problems • Delays up to 36 hours in distributing data by batch • Charged multiple times globally for same data • Incurring regulatory penalties from missing SLAs • Had to manage 20 distributed systems with same data
- 33. Data Hub for Large Investment Bank Feeds & Batch data • Pricing • Accounts • Securities Master • Corporate actions Real-time Real-time Real-time Real-time Real-time Real-time Real-time Each represents • No people $ • Less hardware $ • Less license $ • No penalty $ • & many less problems MongoDB Secondaries MongoDB Primary
- 34. Data Hub for Large Investment Bank Feeds & Batch data • Pricing • Accounts • Securities Master • Corporate actions Real-time Real-time Real-time Real-time Real-time Real-time Real-time Each represents • No people $ • Less hardware $ • Less license $ • No penalty $ • & many less problems MongoDB Secondaries MongoDB Primary • Will save about $40,000,000 in costs and penalties over 5 years • Only charged once for data • Data in sync globally and read locally • Capacity to move to one global shared data service
- 35. IoT: Large Industrial Vehicle Manufacturer Shard 1 Secondary Shard 2 Secondary Shard 3 Secondary Shard 1 Primary Shard 1 Secondary Shard 1 Primary Shard 1 Secondary Shard 1 Primary Shard 1 Secondary Central Hub Regional Hub Regional Hub Regional Hub
- 36. Molecular Similarity Database • Store Chemical Compound Fingerprints • Find compounds which are “close” to a given compound • Tanimoto association coefficient compares two compounds based on their common fingerprints • Aggregation framework $setIntersection Source: Chemical Similarity Search in MongoDB by Matt Swain 01001011 [2, 5, 7, 8, …]
- 37. Equity Price Database • Equity prices: 77M float64 equals 600MB • 3.5M rows/sec Python, 15M rows/sec Java - versus 15 to 40 seconds for proprietary tick database • MongoDB throughput doubles as worker threads double Source: James Blackburn
- 38. Seismic Modeling • 2000 x 2000 x 2000 cubic data set • 8 billion floats • Relational model can take several minutes for some calculations • MongoDB query performs in ~1 second { "_id": ObjectId("55e7358e1a317d0fb177b31e"), "x": 100, "y": 25, "z": [0.8506244646719524, 0.18891124618195854, 0.14090160846138955, ... ] }
- 39. • Store files larger than 16MB i.e. video, images • Atomically sync files with their metadata • Shard and distribute around the cluster GridFS doc.jpg doc.jpg (meta data) doc.jpg (1) GridFS API fs.files fs.chunks Driver
- 40. What database do you need for your business?
- 41. What vehicle do you want for a race?
- 42. WHAT ARE YOU TRYING TO ACHIEVE?
- 43. The important aspect of MongoDB • MongoDB was not designed for niche use cases • MongoDB strives to have excellent characteristics applicable to a very broad range of use cases MongoDB is the most balanced database for Enterprise applications and performance
- 44. Technical: Why MongoDB • High performance (1000’s – millions queries / sec) - reads & writes • Need flexible schema, rich querying with any number of secondary indexes • Need for replication across multiple data centers, even globally • Need to deploy rapidly and scale on demand (start small and fast, grow easily) • 99.999% availability • Real time analysis in the database, under load • Geospatial querying • Processing in real time, not in batch • Need to promote agile coding methodologies • Deploy over commodity computing and storage architectures • Point in Time recovery • Need strong data consistency • Advanced security
- 45. Technical: Why MongoDB • High performance (1000’s – millions queries / sec) - reads & writes • Need flexible schema, rich querying with any number of secondary indexes • Need for replication across multiple data centers, even globally • Need to deploy rapidly and scale on demand (start small and fast, grow easily) • 99.999% availability • Real time analysis in the database, under load • Geospatial querying • Processing in real time, not in batch • Need to promote agile coding methodologies • Deploy over commodity computing and storage architectures • Point in Time recovery • Need strong data consistency • Advanced security
- 46. Business: Why MongoDB • Management tooling and services • Ease of hiring • Commercial license • Ease of developer adoption • Global Support • Global Professional Services • IT ecosystem integration • Company stability • De facto standard for next generation database
- 47. Business: Why MongoDB • Management tooling and services • Ease of hiring • Commercial license • Ease of developer adoption • Global Support • Global Professional Services • IT ecosystem integration • Company stability • De facto standard for next generation database
- 48. Summary • MongoDB is for Systems of Engagement • Complements search engines, Hadoop and Data Warehouses – Does not replace these technologies • Wide range of use cases – and that’s the core point ! – Excellent across many possible use cases, not just a few • Recognized by Gartner and Forrester • De facto standard for next generation database • Enterprise maturity and integration
- 49. We Can Help MongoDB Enterprise Advanced The best way to run MongoDB in your data center MongoDB Cloud Manager The easiest way to run MongoDB in the cloud Production Support In production and under control Development Support Let’s get you running Consulting We solve problems Training Get your teams up to speed
Editor's Notes
- #6: There are many forces at work changing how we build and run applications today: Development methods have shifted from waterfall patterns that unfold over 12-24 months to iterative patterns that evolve on a monthly basis. Organizations need software and infrastructure that support fast time to market. Application costs have shifted, from being dominated by costs associated with infrastructure to being dominated by costs associated with engineers. Organizations need software and infrastructure that help to lower engineering costs. In the background, there is what Gartner calls a “nexus of forces” that are driving massive change in how organizations run their business. Mobile usage is now >50% of all internet usage. Users are online continuously, throughout the day, and there are more of them than ever before. Social dominates use of the internet, including 93% of businesses use social media. Data growth is unprecedented. 90% of all data created in the history of mankind was created in the last two years. Unstructured growing at 2x structured. Cloud infrastructure costs have been declining approximately 30% YOY for the past two decades. MongoDB was designed to help organizations capitalize on these trends by providing a database that dramatically speeds how quickly applications can be brought to market, and leverages modern infrastructure trends to drive down costs.
- #8: between 7-9 sensors, plus camera picture and videos, GPS, voice this doesn't even cover IoT
- #9: 1971 same year as RDBMS creation
- #13: Looking at the other technologies in the market… Relational databases laid the foundation for what you’d want out of your database Rich and fast access to the data, using an expressive query language and secondary indexes Strong consistency, so you know you’re always getting the most up to date version of the data But they weren’t built for the world we just talked about Built for waterfall dev cycles, structured data Built for internal users, not large numbers of users all across the global (From vendors who want large license fees upfront) --> So what they have in data access and consistency, they lack in flexibility, scalability and performance
- #14: NoSQL databases have tried to address the new world… They all have relatively flexible data models They were all built to scale out horizontall And they were built for performance But in doing so, they have sacrificed the core database capabilities you’ve come to expect and rely on in order to build fully functional apps, like rich querying, secondary indexes and strong consistency
- #15: MongoDB was built to address the way the world has changed while preserving the core database capabilities required to build functional apps MongoDB is the only database that harnesses the innovations of NoSQL and maintains the foundation of relational databases
- #16: MongoDB was built to address the way the world has changed while preserving the core database capabilities required to build functional apps MongoDB is the only database that harnesses the innovations of NoSQL and maintains the foundation of relational databases
- #18: This is where MongoDB fits into the existing enterprise IT stack MongoDB is an operational data store used for online data, in the same way that Oracle is an operational data store. It supports applications that ingest, store, manage and even analyze data in real-time. (Compared to Hadoop and data warehouses, which are used for offline, batch analytical workloads.)
- #19: This is where MongoDB fits into the existing enterprise IT stack MongoDB is an operational data store used for online data, in the same way that Oracle is an operational data store. It supports applications that ingest, store, manage and even analyze data in real-time. (Compared to Hadoop and data warehouses, which are used for offline, batch analytical workloads.)
- #21: Here we have greatly reduced the relational data model for this application to two tables. In reality no database has two tables. It is much more common to have hundreds or thousands of tables. And as a developer where do you begin when you have a complex data model?? If you’re building an app you’re really thinking about just a hand full of common things, like products, and these can be represented in a document much more easily that a complex relational model where the data is broken up in a way that doesn’t really reflect the way you think about the data or write an application.
- #23: Add H-M-L
- #24: Add H-M-L
- #25: Add H-M-L
- #37: map reduce not needed here
- #38: few researchers working concurrently
- #50: What We Sell We are the MongoDB experts. Over 1,000 organizations rely on our commercial offerings, including leading startups and 30 of the Fortune 100. We offer software and services to make your life easier: MongoDB Enterprise Advanced is the best way to run MongoDB in your data center. It’s a finely-tuned package of advanced software, support, certifications, and other services designed for the way you do business. MongoDB Management Service (MMS) is the easiest way to run MongoDB in the cloud. It makes MongoDB the system you worry about the least and like managing the most. Production Support helps keep your system up and running and gives you peace of mind. MongoDB engineers help you with production issues and any aspect of your project. Development Support helps you get up and running quickly. It gives you a complete package of software and services for the early stages of your project. MongoDB Consulting packages get you to production faster, help you tune performance in production, help you scale, and free you up to focus on your next release. MongoDB Training helps you become a MongoDB expert, from design to operating mission-critical systems at scale. Whether you’re a developer, DBA, or architect, we can make you better at MongoDB.