MongoDB Hadoop DC

Oct 19, 2009Download as KEY, PDF8 likes1,345 views

Presentation on MongoDB given at the Hadoop DC meetup in October 2009. Some of the slides at the end are extra examples that didn't appear in the talk, but might be of interest.

open-source, high-performance,
schema-free, document-oriented
database

Schema-free

• Loosening constraints - added ﬂexibility
• Dynamically typed languages
• Migrations

Dynamic queries

• Administration
• Ease of development
• Familiarity

Good at

• The web
• Caching
• High volume data
• Scalability

Less good at

• Highly transactional
• Ad-hoc business intelligence
• Problems that require SQL

Post

{author: “mike”,
date: new Date(),
text: “my blog post...”,
tags: [“mongodb”, “dc”, “hadoop”]}

Comment

{author: “eliot”,
date: new Date(),
text: “great post!”}

New post

post = {author: “mike”,
date: new Date(),
text: “my blog post...”,
tags: [“mongodb”, “dc”, “hadoop”]}

db.posts.save(post)

$Embedding a comment c = {author: “eliot”, date: new Date(), text: “great post!”} db.posts.update({_id: post._id}, {$push: {comments: c}})$

Posts by author

db.posts.find({author: “mike”})

Last 10 posts

db.posts.find()
.sort({date: -1})
.limit(10)

$Posts in the last week last_week = new Date(2009, 9, 9) db.posts.find({date: {$gt: last_week}})$

Terminology
• Shard key
• Chunk
• Range of the value space
• (collection, key, min_val, max_val)
• Shard
• Single node (or replica pair)
• Responsible for set of chunks

Other cool stuff

• Aggregation and map reduce
• Capped collections
• Unique indexes
• Mongo shell
• GridFS

• Download MongoDB
http://www.mongodb.org

• Try it out
• Let us know what you think

• http://www.mongodb.org
• irc.freenode.net#mongodb
• mongodb-user on google groups
• @mongodb, @mdirolf
• mike@10gen.com
• http://www.slideshare.net/mdirolf

Posts ending with
‘Hadoop’

db.posts.find({text: /hadoop$/})

Posts with a tag
db.posts.find({tag: “mongodb”})

... and fast
db.posts.ensureIndex({tag: 1})

Counting posts

db.posts.count()

db.posts.find({author: “mike”}).count()

Basic paging

page = 2
page_size = 15

db.posts.find().limit(page_size)
.skip(page * page_size)

$Migration: adding titles • Easy - just start adding them: post = {author: “mike”, date: new Date(), text: “another blog post...”, tags: [“meetup”, “hadoop”], title: “Review from Hadoop DC”} post_id = db.posts.save(post)$

Advanced queries

• $gt, $lt, $gte, $lte, $ne, $all, $in, $nin
• where()
db.posts.find({$where: “this.author == ‘mike’”})

MongoDB is an open-source, schema-free, document-oriented database that provides high performance, flexibility and scalability. It uses JSON-like documents with dynamic schemas, instead of the traditional table-based relational database structure. MongoDB is especially useful for web applications, caching, and scaling to handle large volumes of data. While it is less suited to highly transactional workloads or problems requiring SQL, MongoDB provides a simple interface and scales horizontally across commodity servers.

MongoDB at RuPyMike Dirolf

This document provides an overview of MongoDB, an open-source, schema-free, document-oriented database. It discusses how MongoDB offers more flexibility and scalability compared to traditional RDBMS systems. Key features covered include dynamic queries, replication, auto-sharding, and support for many platforms/languages. Examples are given for common operations like creating, querying, and updating document structures in MongoDB.

MongoDB Mojo: Building a Basic Perl AppStennie Steneker

The document provides an overview of MongoDB, describing it as a document-oriented, open source, horizontally scalable database with high performance. It discusses how MongoDB uses memory-mapped files and the BSON data format for fast performance. The document then demonstrates how to build a basic library application in Perl using MongoDB and the MongoDB Perl driver to store book data with embedded documents for authors, publishers, etc. It recommends several MongoDB Perl modules available on CPAN that provide additional functionality like object mapping.

MongoDB at FrozenRailsMike Dirolf

Webinar: What's new in the .NET DriverMongoDB

Recent releases of the .NET driver have added lots of cool new features. In this webinar we will highlight some of the most important ones. We will begin by discussing serialization. We will describe how serialization is normally handled, and how you can customize the process when you need to, including some tips on migration strategies when your class definitions change. We will continue with a discussion of the new Query builder, which now includes support for typed queries. A major new feature of recent releases is support for LINQ queries. We will show you how the .NET driver supports LINQ and discuss what kinds of LINQ queries are supported. Finally, we will discuss what you need to do differently in your application when authentication is enabled at the server.

A Presentation on MongoDB Introduction - HabilelabsHabileLabs

This document introduces MongoDB, an open-source document-oriented database. It discusses how MongoDB stores data as JSON-like documents rather than in tables, supports dynamic schemas, and is horizontally scalable. Some common use cases for MongoDB are also listed, including single view applications, IoT, mobile, real-time analytics, personalization, catalogs, and content management. The document concludes by covering how Habilelabs uses MongoDB with Node.js for REST API projects.

MongoDB_Sharan_Prakash_BabuSharan

MongoDB is an open source, schema-free, document-oriented database that stores data in flexible, JSON-like documents. It aims to provide high performance, horizontal scalability, and flexibility. MongoDB uses a document model where data is stored in documents which can contain multiple types of key-value pairs. It does not support joins or relational integrity like a traditional SQL database but is well suited for scaling out, caching, and high volume applications.

MongoDBSerdar Buyuktemiz

This document discusses MongoDB and provides information on why it is useful, how it works, and best practices. Specifically, it notes that MongoDB is a noSQL database that is easy to use, scalable, and supports high performance and availability. It is well-suited for flexible schemas, embedded documents, and complex relationships. The document also covers topics like BSON, CRUD operations, indexing, map reduce, transactions, replication, and sharding in MongoDB.

Living with SQL and NoSQL at craigslist, a Pragmatic ApproachJeremy Zawodny

From the 2012 Percona Live MySQL Conference in Santa Clara, CA. Craigslist uses a variety of data storage systems in its backend systems: in-memory, SQL, and NoSQL. This talk is an overview of how craigslist works with a focus on the data storage and management choices that were made in each of its major subsystems. These include MySQL, memcached, Redis, MongoDB, Sphinx, and the filesystem. Special attention will be paid to the benefits and tradeoffs associated with choosing from the various popular data storage systems, including long-term viability, support, and ease of integration.

Introducción a NoSQLMongoDB

Mongodb tutorial at Easylearning GuruKCC Software Ltd. & Easylearning.guru

Mango Database - Web Developmentmssaman

Introduction to mongoDBCuelogic Technologies Pvt. Ltd.

This document provides an introduction to MongoDB, including what it is, why it is useful, how to install it, and how its basic functionality compares to SQL databases like MySQL. MongoDB is a flexible, scalable NoSQL database that allows dynamic queries and storage of data without a defined schema. It provides alternatives to SQL commands for create, read, update and delete operations that are more flexible than traditional relational databases.

Introduction to mongodbneela madheswari

The document is a slide presentation on MongoDB that introduces the topic and provides an overview. It defines MongoDB as a document-oriented, open source database that provides high performance, high availability, and easy scalability. It also discusses MongoDB's use for big data applications, how it is non-relational and stores data as JSON-like documents in collections without a defined schema. The presentation provides steps for installing MongoDB and describes some basic concepts like databases, collections, documents and commands.

Introduction to mongo dbRohit Bishnoi

The document discusses MongoDB operations like inserting, finding, updating, and deleting documents. It provides examples of inserting documents with different data structures like arrays embedded documents. It also demonstrates various find operations with filters, projections, sorting, skipping, limiting results. Operations to count and get distinct values are also covered. The document concludes by discussing how Thoughtbuzz uses MongoDB to store heterogeneous social media data from different sources in a single collection to provide unified analytics without requiring joins.

10gen MongoDB Video Presentation at WebGeek DevCupWebGeek Philippines

Why MongoDB over other Databases - HabilelabsHabileLabs

MongoDB SF PythonMike Dirolf

MongoDB World 2016: Poster Sessions eBookMongoDB

MongoDB for Coder Training (Coding Serbia 2013)Uwe Printz

Slides of my MongoDB Training given at Coding Serbia Conference on 18.10.2013 Agenda: 1. Introduction to NoSQL & MongoDB 2. Data manipulation: Learn how to CRUD with MongoDB 3. Indexing: Speed up your queries with MongoDB 4. MapReduce: Data aggregation with MongoDB 5. Aggregation Framework: Data aggregation done the MongoDB way 6. Replication: High Availability with MongoDB 7. Sharding: Scaling with MongoDB

Introduction to MongoDBRavi Teja

MongoDB Introduction - Document Oriented Nosql DatabaseSudhir Patil

- MongoDB is a document-oriented, non-relational database that uses JSON-like documents with dynamic schemas, horizontal scaling with sharding and replication, and high performance. - It is used by many large companies and is a good fit for huge, unstructured data or when dynamic schemas are needed. However, it does not support transactions or have the same data integrity features as relational databases. - MongoDB can store data in flexible document formats, allows ad hoc queries, and supports common operations like insert, update, delete. Features include replication, sharding, indexing, geospatial queries and MapReduce.

Sphinx at Craigslist in 2012Jeremy Zawodny

Mongo DB Tata Consultancy Services

MongoDB NYC PythonMike Dirolf

The document describes MongoDB, an open-source, high-performance, schema-free, document-oriented database that addresses some shortcomings of relational databases like scalability and flexibility. It discusses some key MongoDB concepts like documents, collections, indexing, embedding data, and querying capabilities. An example blog application is provided to illustrate common operations like creating, retrieving, and counting documents in a MongoDB deployment using PyMongo.

An introduction to MongoDBCésar Trigo

Introduction to MongoDBJustin Smestad

This document contains information about Justin Smestad and MongoDB. It includes Justin's contact information and background working as a software engineer with skills in Ruby, JavaScript, Clojure, and passion for DevOps. It also provides an overview of MongoDB, describing it as a scalable, high-performance, open source, schema-free, document-oriented database. Key features of MongoDB like indexing, master-slave replication, and horizontal scaling with replica sets and sharding are summarized.

MongoDB at CodeMash 2.0.1.0Mike Dirolf

MongoDB is a document-oriented, schema-free, high-performance NoSQL database. It uses dynamic queries on JSON-like documents with various data structures and scales horizontally. MongoDB is good for high-volume data, scalability, and the web. It is less suited for highly transactional or SQL-focused workloads. Documents are stored in collections and can be queried, updated, and indexed dynamically without rigid schemas.

MongoDB and Ruby on Railsrfischer20

More Related Content

What's hot (20)

MongoDBSerdar Buyuktemiz

Living with SQL and NoSQL at craigslist, a Pragmatic ApproachJeremy Zawodny

Introducción a NoSQLMongoDB

Mongodb tutorial at Easylearning GuruKCC Software Ltd. & Easylearning.guru

Mango Database - Web Developmentmssaman

Introduction to mongoDBCuelogic Technologies Pvt. Ltd.

Introduction to mongodbneela madheswari

Introduction to mongo dbRohit Bishnoi

10gen MongoDB Video Presentation at WebGeek DevCupWebGeek Philippines

Why MongoDB over other Databases - HabilelabsHabileLabs

MongoDB SF PythonMike Dirolf

MongoDB World 2016: Poster Sessions eBookMongoDB

MongoDB for Coder Training (Coding Serbia 2013)Uwe Printz

Introduction to MongoDBRavi Teja

MongoDB Introduction - Document Oriented Nosql DatabaseSudhir Patil

Sphinx at Craigslist in 2012Jeremy Zawodny

Mongo DB Tata Consultancy Services

MongoDB NYC PythonMike Dirolf

An introduction to MongoDBCésar Trigo

Introduction to MongoDBJustin Smestad

MongoDBSerdar Buyuktemiz

Living with SQL and NoSQL at craigslist, a Pragmatic ApproachJeremy Zawodny

Introducción a NoSQLMongoDB

Mongodb tutorial at Easylearning GuruKCC Software Ltd. & Easylearning.guru

Mango Database - Web Developmentmssaman

Introduction to mongoDBCuelogic Technologies Pvt. Ltd.

Introduction to mongodbneela madheswari

Introduction to mongo dbRohit Bishnoi

10gen MongoDB Video Presentation at WebGeek DevCupWebGeek Philippines

Why MongoDB over other Databases - HabilelabsHabileLabs

MongoDB SF PythonMike Dirolf

MongoDB World 2016: Poster Sessions eBookMongoDB

MongoDB for Coder Training (Coding Serbia 2013)Uwe Printz

Introduction to MongoDBRavi Teja

MongoDB Introduction - Document Oriented Nosql DatabaseSudhir Patil

Sphinx at Craigslist in 2012Jeremy Zawodny

Mongo DB Tata Consultancy Services

MongoDB NYC PythonMike Dirolf

An introduction to MongoDBCésar Trigo

Introduction to MongoDBJustin Smestad

Similar to MongoDB Hadoop DC (20)

MongoDB at CodeMash 2.0.1.0Mike Dirolf

MongoDB and Ruby on Railsrfischer20

Mongodb introchristkv

Christian Kvalheim gave an introduction to NoSQL and MongoDB. Some key points: 1) MongoDB is a scalable, high-performance, open source NoSQL database that uses a document-oriented model. 2) It supports indexing, replication, auto-sharding for horizontal scaling, and querying. 3) Documents are stored in JSON-like records which can contain various data types including nested objects and arrays.

MongoDB London PHPMike Dirolf

MongoDB is an open-source, schema-free, document-oriented database that provides high performance and scalability. It addresses some limitations of relational databases like flexibility and scalability. MongoDB uses a document-based data model which allows dynamic schemas and easier integration with dynamic languages. It is a good fit for applications that need to store large volumes of unstructured or semi-structured data.

Mongo db eveningschemadesignMongoDB APAC

MongoDB is a document-oriented, open source database that is high performing, horizontally scalable, and full featured. It uses a flexible schema and stores data in flexible JSON-like documents which allows for an evolving schema. MongoDB can be easily scaled out across commodity servers and provides high availability with automatic replication and recovery. It supports dynamic queries and indexing and has drivers for many languages.

Building your first app with MongoDBNorberto Leite

Norberto Leite gives an introduction to MongoDB. He discusses that MongoDB is a document database that is open source, high performance, and horizontally scalable. He demonstrates how to install MongoDB, insert documents into collections, query documents, and update documents. Leite emphasizes that MongoDB allows for flexible schema design and the ability to evolve schemas over time to match application needs.

MongoDB at RubyEnRails 2009Mike Dirolf

This document provides an overview of MongoDB, an open-source, schema-free, document-oriented database. It discusses how MongoDB provides flexibility and ease of development through schema-free and dynamically typed documents. It also describes how MongoDB is well-suited for high volume web applications and scaling out but less suited for highly transactional workloads. The document provides examples of common operations like creating, querying, and indexing MongoDB documents.

MongoDB Introduction talk at Dr Dobbs Conference, MongoDB Evenings at Bangalo...Prasoon Kumar

MongoDB is a leading nosql database. It is horizonatally scalable, document datastore. In this introduction given at Dr Dobbs Conference, Bangalore and Pune in April 2014, I show schema design with an example blog application and Python code snippets. I delivered the same in the maiden MongoDB Evening event at Delhi and Gurgaon in May 2014. When constructing a data model for your MongoDB collection for CMS, there are various options you can choose from, each of which has its strengths and weaknesses. The three basic patterns are: 1.Store each comment in its own document. 2.Embed all comments in the “parent” document. 3.A hybrid design, stores comments separately from the “parent,” but aggregates comments into a small number of documents, where each contains many comments. Code sample and wiki documentation is available on https://github.com/prasoonk/mycms_mongodb/wiki.

Introduction to MongoDBSean Laurent

This document summarizes a presentation about MongoDB given by Sean Laurent of StudyBlue, Inc. It introduces MongoDB and its features, including its document-oriented data model, flexible schemas, querying and updating capabilities, indexing, drivers, replication and sharding for scalability. Useful MongoDB tools are also discussed like the mongo shell, mongostat, mongotop and MMS monitoring. The document concludes with MongoDB's strengths like horizontal scaling and rapidly evolving schemas, and weaknesses like not being a drop-in replacement for SQL and limitations around transactions.

MongoDB at ZPUGDCMike Dirolf

This document provides an overview and introduction to MongoDB, an open-source, high-performance, schema-free, document-oriented database. It describes MongoDB's data model using documents and collections rather than tables, its dynamic queries, indexing and scaling capabilities. The document also compares MongoDB to traditional relational databases and discusses some common use cases and programming interfaces for MongoDB.

MongoDB BasicsSarang Shravagi

2016 feb-23 pyugre-py_mongoMichael Bright

Michael Bright presented on using MongoDB and Python. Some key points: 1) MongoDB is a document-oriented NoSQL database that uses JSON-like documents with dynamic schemas, horizontal scaling, and high performance. It provides an alternative to relational databases for applications that need flexibility and scalability. 2) PyMongo is the main Python driver for working with MongoDB, but there are also frameworks and ORMs that provide higher-level APIs. Basic operations like inserting, finding, updating, and deleting documents can be done from the Python shell or code. 3) MongoDB supports indexing, sorting, projections and aggregation to optimize queries. The aggregation framework provides data processing pipelines to transform and analyze data in MongoDB.

Using MongoDB and PythonMike Bright

MongoDB can be used to store and query document-oriented data, and provides scalability through horizontal scaling. The document stores provide more flexibility than relational databases by allowing dynamic schemas with embedded documents. MongoDB combines the rich querying of relational databases with the flexibility and scalability of NoSQL databases. It uses indexes to improve query performance and supports features like aggregation, geospatial queries, and text search.

MongoDB: a gentle, friendly overviewAntonio Pintus

This document provides a gentle, friendly overview of MongoDB. It discusses that MongoDB is a document-oriented, non-relational database that uses JSON-like documents with dynamic schemas. It also covers MongoDB's query language, indexing, data storage and querying, drivers like PyMongo, and how MongoDB provides horizontal scalability through sharding and replication. The document concludes by noting some common use cases for MongoDB and areas it is less suited for.

Introduction to MongoDBMike Dirolf

MongoDB is an open-source, document-oriented database that provides high performance and horizontal scalability. It uses a document-model where data is organized in flexible, JSON-like documents rather than rigidly defined rows and tables. Documents can contain multiple types of nested objects and arrays. MongoDB is best suited for applications that need to store large amounts of unstructured or semi-structured data and benefit from horizontal scalability and high performance.

MongoDB in FSMongoDB

MongoDB is a document-oriented, high performance, highly available, and horizontally scalable operational database. It addresses challenges with traditional RDBMS like handling high volumes of data, semi-structured and unstructured data types, and the need for agile development. MongoDB can be used for financial services use cases like high volume data feeds, risk analytics, product catalogs, trade capture, reporting, reference data management, portfolio management, quantitative analysis, and automated trading. It provides features like flexible schemas, indexing, aggregation, scaling out through sharding, and integration with Hadoop.

CouchDB introductionSander van de Graaf

Dev Jumpstart: Build Your First App with MongoDBMongoDB

New to MongoDB? This talk will introduce the philosophy and features of MongoDB. We’ll discuss the benefits of the document-based data model that MongoDB offers by walking through how one can build a simple app to store books. We’ll cover inserting, updating, and querying the database of books. This session will jumpstart your knowledge of MongoDB development, providing you with context for the rest of the day's content.

Using Spring with NoSQL databases (SpringOne China 2012)Chris Richardson

MongoDB Tick Data PresentationMongoDB

The document discusses using MongoDB as a tick store for financial data. It provides an overview of MongoDB and its benefits for handling tick data, including its flexible data model, rich querying capabilities, native aggregation framework, ability to do pre-aggregation for continuous data snapshots, language drivers and Hadoop connector. It also presents a case study of AHL, a quantitative hedge fund, using MongoDB and Python as their market data platform to easily onboard large volumes of financial data in different formats and provide low-latency access for backtesting and research applications.

MongoDB at CodeMash 2.0.1.0Mike Dirolf

MongoDB and Ruby on Railsrfischer20

Mongodb introchristkv

MongoDB London PHPMike Dirolf

Mongo db eveningschemadesignMongoDB APAC

Building your first app with MongoDBNorberto Leite

MongoDB at RubyEnRails 2009Mike Dirolf

MongoDB Introduction talk at Dr Dobbs Conference, MongoDB Evenings at Bangalo...Prasoon Kumar

Introduction to MongoDBSean Laurent

MongoDB at ZPUGDCMike Dirolf

MongoDB BasicsSarang Shravagi

2016 feb-23 pyugre-py_mongoMichael Bright

Using MongoDB and PythonMike Bright

MongoDB: a gentle, friendly overviewAntonio Pintus

Introduction to MongoDBMike Dirolf

MongoDB in FSMongoDB

CouchDB introductionSander van de Graaf

Dev Jumpstart: Build Your First App with MongoDBMongoDB

Using Spring with NoSQL databases (SpringOne China 2012)Chris Richardson

MongoDB Tick Data PresentationMongoDB

More from Mike Dirolf (9)

IndexingMike Dirolf

Inside MongoDB: the Internals of an Open-Source DatabaseMike Dirolf

Inside PyMongo - MongoNYCMike Dirolf

This document discusses PyMongo, a Python driver for MongoDB. It provides an overview of common PyMongo operations like connecting to a database, inserting and querying documents, and using GridFS for storing and retrieving files. It also covers newer PyMongo features like commands, stored JavaScript, and awareness of datetime limits. The document encourages involvement in the PyMongo open source project.

FrozenRails TrainingMike Dirolf

Python Development (MongoSF)Mike Dirolf

While some parts of Django like its URL routing, templates, and caching are not dependent on Django's ORM, integrating MongoDB would require replacing Django's default SQLite database and models with MongoDB-specific database and ODM libraries to support MongoDB's document-oriented data structure and queries. Several third-party libraries provide MongoDB support by replacing Django's ORM with a MongoDB ODM to define schemas and queries.

MongoDB: How it WorksMike Dirolf

MongoDB hearts Django? (Django NYC)Mike Dirolf

MongoDB at RubyConfMike Dirolf

MongoDB SF RubyMike Dirolf

IndexingMike Dirolf

Inside MongoDB: the Internals of an Open-Source DatabaseMike Dirolf

Inside PyMongo - MongoNYCMike Dirolf

FrozenRails TrainingMike Dirolf

Python Development (MongoSF)Mike Dirolf

MongoDB: How it WorksMike Dirolf

MongoDB hearts Django? (Django NYC)Mike Dirolf

MongoDB at RubyConfMike Dirolf

MongoDB SF RubyMike Dirolf

Recently uploaded (20)

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

Automation Dreamin': Capture User Feedback From AnywhereLynda Kane

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Asthma presentación en inglés abril 2025 pdfVanessaRaudez

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Procurement Insights Cost To Value Guide.pptxJon Hansen

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Automation Hour 1/28/2022: Capture User Feedback from AnywhereLynda Kane

Datastucture-Unit 4-Linked List Presentation.pptxkaleeswaric3

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

#AdminHour presents: Hour of Code2018 slide deck from 12/6/2018Lynda Kane

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

Automation Dreamin': Capture User Feedback From AnywhereLynda Kane

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Asthma presentación en inglés abril 2025 pdfVanessaRaudez

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Procurement Insights Cost To Value Guide.pptxJon Hansen

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Automation Hour 1/28/2022: Capture User Feedback from AnywhereLynda Kane

Datastucture-Unit 4-Linked List Presentation.pptxkaleeswaric3

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

AI and Data Privacy in 2025: Global TrendsInData Labs

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

#AdminHour presents: Hour of Code2018 slide deck from 12/6/2018Lynda Kane

MongoDB Hadoop DC

1. open-source, high-performance, schema-free, document-oriented database

3. JSON-style documents

4. Schema-free • Loosening constraints - added ﬂexibility • Dynamically typed languages • Migrations

5. Dynamic queries • Administration • Ease of development • Familiarity

6. Focus on performance

7. Replication

8. Auto-sharding

9. Many supported platforms / languages

10. Good at • The web • Caching • High volume data • Scalability

11. Less good at • Highly transactional • Ad-hoc business intelligence • Problems that require SQL

12. Quick example: blog back-end

13. Post {author: “mike”, date: new Date(), text: “my blog post...”, tags: [“mongodb”, “dc”, “hadoop”]}

14. Comment {author: “eliot”, date: new Date(), text: “great post!”}

15. New post post = {author: “mike”, date: new Date(), text: “my blog post...”, tags: [“mongodb”, “dc”, “hadoop”]} db.posts.save(post)

16. Embedding a comment c = {author: “eliot”, date: new Date(), text: “great post!”} db.posts.update({_id: post._id}, {$push: {comments: c}})

17. Posts by author db.posts.find({author: “mike”})

18. Last 10 posts db.posts.find() .sort({date: -1}) .limit(10)

19. Posts in the last week last_week = new Date(2009, 9, 9) db.posts.find({date: {$gt: last_week}})

20. Sharding

21. Terminology • Shard key • Chunk • Range of the value space • (collection, key, min_val, max_val) • Shard • Single node (or replica pair) • Responsible for set of chunks

24. Other cool stuff • Aggregation and map reduce • Capped collections • Unique indexes • Mongo shell • GridFS

25. • Download MongoDB http://www.mongodb.org • Try it out • Let us know what you think

26. • http://www.mongodb.org • irc.freenode.net#mongodb • mongodb-user on google groups • @mongodb, @mdirolf • [email protected] • http://www.slideshare.net/mdirolf

27. Posts ending with ‘Hadoop’ db.posts.find({text: /hadoop$/})

28. Posts with a tag db.posts.find({tag: “mongodb”}) ... and fast db.posts.ensureIndex({tag: 1})

29. Counting posts db.posts.count() db.posts.find({author: “mike”}).count()

30. Basic paging page = 2 page_size = 15 db.posts.find().limit(page_size) .skip(page * page_size)

31. Migration: adding titles • Easy - just start adding them: post = {author: “mike”, date: new Date(), text: “another blog post...”, tags: [“meetup”, “hadoop”], title: “Review from Hadoop DC”} post_id = db.posts.save(post)

32. Advanced queries • $gt, $lt, $gte, $lte, $ne, $all, $in, $nin • where() db.posts.find({$where: “this.author == ‘mike’”})

MongoDB Hadoop DC

Recommended

More Related Content

What's hot (20)

Similar to MongoDB Hadoop DC (20)

More from Mike Dirolf (9)

Recently uploaded (20)

MongoDB Hadoop DC