ArangoDB 3.7 Roadmap: Performance at Scale

Feb 13, 20200 likes1,057 views

Find the recording of this webinar here: https://www.arangodb.com/arangodb-events/3-7-roadmap-performance-at-scale/ After the release of ArangoDB 3.6 we are starting to work on the next version with even more exciting features. As an open-source project we would love to hear your ideas and discuss the roadmap with our community. Would you like to learn more about Satellite Graphs, Schema Validation, a number of performance and security improvements? Than join Jörg Schad, Head of Engineering and Machine Learning at ArangoDB, who will share the latest plans for the upcoming ArangoDB 3.7 release as well as the long term roadmap.

+ +
Copyright © ArangoDB Inc., 2020
3.7
@joerg_schad

Copyright © ArangoDB Inc., 2019 - Conﬁdential
ArangoDB 3.7
tl;dr
▸ Satellite Graphs [EE]
▸ Graph Performance
▸ Cluster/Failover Performance
▸ (optional) Schema Validation
▸ Security
▸ Operability/Metrics
▸ Fuzzy ArangoSearch
▸ Improved DC2DC Replication
Deprecation of MMFiles Storage Engine.

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Jörg Schad, PhD
●
○
○
○
○
@joerg_schad

Copyright © ArangoDB Inc., 2020
First native Multi-Model database
Open source and enterprise editions
ArangoDB 1.0 GA in Aug 2012
60+ Employees
HQs: San Francisco, CA & Cologne, Germany
ArangoDB
4

Copyright © ArangoDB Inc., 2020
Native Multi-Model Approach
5
● Native Multi Model Database
○ Stores, K/V, Documents & Graphs
● Distributed
○ Graphs can span multiple nodes
● AQL - SQL-like multi-model query language
● ACID Transactions including Multi
Collection Transactions

Copyright © ArangoDB Inc., 2020
10m+ Downloads
550+ Production installations
9,200+ Stargazers at GitHub
Community
6

Copyright © ArangoDB Inc., 2019 - Conﬁdential
ArangoML Pipeline Cloud

Copyright © ArangoDB Inc., 2020 - Conﬁdential

Copyright © ArangoDB Inc., 2019 - Conﬁdential
Recall v3.6

Copyright © ArangoDB Inc., 2019 - Conﬁdential
ArangoDB 3.6
▸ OneShard Database Scalability
▸ Observability, Operability
● Inspector
▸ Metrics
▸ ArangoSearch Improvements
▸ Performance Improvements
● Subquery Optimization
▸ Parallel AQL
▸ Hot Backup Improvements

Copyright © ArangoDB Inc., 2020 - Conﬁdential
OneShard Database
11
❖ Replicated Single Server Behavior
➢ Single Server performance
➢ ACID transactions
➢ Failover safe

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Scalability, Observability, Operability
12
❖ Operatibilty for scale
➢ Insights
➢ Metrics based alerting
➢ Sharding & Replication
❖ Inspector
➢ Serverside collection of cluster
setup and status
➢ Across diﬀerent deployment
➢ Structured debug information
❖ Metrics
➢ Structured statics API
➢ Default dashboards
➢ Alerting recommendations

Copyright © ArangoDB Inc., 2019 - Conﬁdential
Performance Optimization
Subquery Optimization Parallel AQL (Stage 1)
▸ Multiple servers in parallel

Copyright © ArangoDB Inc., 2020 - Conﬁdential
ArangoDB 3.7
Roadmap*

Copyright © ArangoDB Inc., 2020 - Conﬁdential
3.7
15
❖ Satellite Graphs [EE]
❖ Performance
➢ Parallel Traversal for Graphs
➢ Graph Optimizations
➢ Faster MoveShard
➢ InSync Improvements
➢ Subqueries Optimization
❖ Schema Validation
❖ Security
➢ Encryption Key/JWT/TLS Rotation [partially EE]
❖ Operatabilty
➢ Metrics (Agency, Performance)
❖ ArangoSearch
➢ Fuzzy Queries (Regex/Preﬁx)
❖ OneShard Datacenter Replication
}Graph performance
} Cluster/Failover performance
ETA: End of April

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Joins
Coordinator
REST FOXX
Products
V8
DB1 DB2
Customer

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Satellite Graphs
17
❖ Satellite Collections are dealing
with the distributed performance
of JOINS
❖ How to deal with distributed graph
traversals?
➢ Solution: Satellite Graphs

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Default Graph Traversal
DB1
DB2
DB3
Coordinator
1. Fetch data
1. Fetch data
1. Fetch data
1. Fetch all data
2. Perform Traversal
2. Perform Traversal
Simplified: Lots of traversal communication needed

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Traversal Satellite Graph
DB1
DB2
DB3
Coordinator
2. Returns traversal result
1. Perform Traversal
2. Fetch result
3. Join
1. Performs traversal
1. Start Query

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Use case: IoT
- Multiple seismic sensors which are storing huge amount of
collected data
- Collection of metadata stored inside the graph
- e.g. location: Sensor → City → Region → Country → Continent
- Example Query:
- Extract all earthquake measurements from California
- Fast traversal California → Cities → Sensors (db nodes locally and
parallel)

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Schema Validation (optional)
▸ Schemaless docs are great
● But sometimes…
● JSON Schema

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Performance
22
❖ Parallel Traversal for Graphs
❖ Graph Optimizations
❖ Faster MoveShard
❖ InSync Improvements
❖ Subqueries Optimization

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Security
23
❖ Encryption Key Rotation
❖ JWT Token Rotation
❖ TLS Certiﬁcate Rotation

Copyright © ArangoDB Inc., 2020 - Conﬁdential
MMFile Deprecation

Copyright © ArangoDB Inc., 2020 - Conﬁdential
Curious?
Get involved and test!
▸ Monthly “Alpha” Builds
▸ Open Issues
▸ Check the Blog!
https://www.arangodb.com/blog/

Copyright © ArangoDB Inc., 2019 - Conﬁdential
Demo

We all know good training data is crucial for data scientists to build quality machine learning models. But when productionizing Machine Learning, Metadata is equally important. Consider for example: - Provenance of model allowing for reproducible builds - Context to comply with GDPR, CCPA requirements - Identifying data shift in your production data This is the reason we built ArangoML Pipeline, a flexible Metadata store which can be used with your existing ML Pipeline. Today we are happy to announce a release of ArangoML Pipeline Cloud. Now you can start using ArangoML Pipeline without having to even start a separate docker container. In this webinar, we will show how to leverage ArangoML Pipeline Cloud with your Machine Learning Pipeline by using an example notebook from the TensorFlow tutorial. Find the video here: https://www.arangodb.com/arangodb-events/arangoml-pipeline-cloud/

Running complex data queries in a distributed systemArangoDB Database

With the always-growing amount of data, it is getting increasingly hard to store and get it back efficiently. While the first versions of distributed databases have put all the burden of sharding on the application code, there are now some smarter solutions that handle most of the data distribution and resilience tasks inside the database. This poses some interesting questions, e.g. - how are other than by-primary-key queries actually organized and executed in a distributed system, so that they can run most efficiently? - how do the contemporary distributed databases actually achieve transactional semantics for non-trivial operations that affect different shards/servers? This talk will give an overview of these challenges and the available solutions that some open source distributed databases have picked to solve them.

Webinar: ArangoDB 3.8 Preview - Analytics at Scale ArangoDB Database

Guacamole Fiesta: What do avocados and databases have in common?ArangoDB Database

First, our CTO, Frank Celler, does a quick overview of the latest feature developments and what is new with ArangoDB. Then, Senior Graph Specialist, Michael Hackstein talks about multi-model database movement, diving deeper into main advantages and technological benefits. He introduces three data-models of ArangoDB (Documents, Graphs and Key-Values) and the reasons behind the technology. We have a look at the ArangoDB Query language (AQL) with hands-on examples. Compare AQL to SQL, see where the differences are and what makes AQL better comprehensible for developers. Finally, we touch the Foxx Microservice framework which allows to easily extend ArangoDB and include it in your microservices landscape.

Webinar: How native multi model works in ArangoDBArangoDB Database

Custom Pregel Algorithms in ArangoDBArangoDB Database

Are you a Tortoise or a Hare?ArangoDB Database

Different applications need different performance guarantees. Some applications need fastest possible ingest of a dataset (a hare). Other applications need write rate guarantees for every single record (a tortoise). The choice between the two becomes critical as CPU cores, memory size, and disk throughput decrease to save money on cloud virtual machines / AWS instances. This presentation demonstrates how to convert RocksDB's natural "hare mode" into "tortoise mode" for timing sensitive applications and/or lower cost, lower capability hardware. RocksDB's stalls and stops are explained.

Graph Analytics with ArangoDBArangoDB Database

This document discusses using graphs and graph databases for machine learning. It provides an overview of graph analytics algorithms that can be used to solve problems with graph data, including recommendations, fraud detection, and network analysis. It also discusses using graph embeddings and graph neural networks for tasks like node classification and link prediction. Finally, it discusses how graphs can be used for machine learning infrastructure and metadata tasks like data provenance, audit trails, and privacy.

A Graph Database That Scales - ArangoDB 3.7 Release WebinarArangoDB Database

örg Schad (Head of Engineering and ML) and Chris Woodward (Developer Relations Engineer) introduce the new capabilities to work with graph in a distributed setting. In addition explain and showcase the new fuzzy search within ArangoDB's search engine as well as JSON schema validation. Get started with ArangoDB: https://www.arangodb.com/arangodb-tra... Explore ArangoDB Cloud for free with 1-click demos: https://cloud.arangodb.com/home ArangoDB is a native multi-model database written in C++ supporting graph, document and key/value needs with one engine and one query language. Fulltext search and ranking is supported via ArangoSearch the fully integrated C++ based search engine in ArangoDB.

An E-commerce App in action built on top of a Multi-model DatabaseArangoDB Database

This talk presents a genuine use case of ArangoDB's native multi-model approach, by means of the example of an e-commerce app. First the main advantages of a "multi-model" database are explained. Then we dive deep into the native multi-model database ArangoDB and its query language - AQL. We give an introduction to the three data-models ArangoDB covers (Documents, Graphs and Key-Values), and explain that AQL is a uniform query language that can cover all three data-models of ArangoDB, so no context switches are necessary. The major part of the talk will explain the data model and show concrete AQL queries that would occur in an e-commerce platform. Max will demonstrate the multi-model advantages of AQL and how they lead to better performance and to a simpler life for developers. Video: https://youtu.be/9MUhdPpPpPc

ArangoDB 3.9 - Further Powering Graphs at ScaleArangoDB Database

Deep dive into the native multi model database ArangoDBArangoDB Database

The document describes ArangoDB, a multi-model database that can function as a document store, key-value store, and graph database. It offers querying across these models using its AQL language. The document also discusses how ArangoDB is extensible through JavaScript, can run as a microservice using Foxx, and integrates with data center operating systems like Mesosphere DC/OS for resource management and fault tolerance.

ArangoDB – A different approach to NoSQLArangoDB Database

ArangoDB is an open source multi-model NoSQL database that can be used as a document store, key-value store, and graph database. It provides a query language called AQL that is similar to SQL. Documents and data can be easily extended and manipulated using JavaScript. ArangoDB is highly performant, space efficient, and can scale horizontally. It has been in development since 2011 with the goal of providing a full-featured database while avoiding the downsides of other NoSQL solutions.

Arango DBNexThoughts Technologies

Introduction to ArangoDB (nosql matters Barcelona 2012)ArangoDB Database

- The document discusses ArangoDB, an open source multi-model database that supports documents, graphs, and key-value stores. - It began development in 2011 and reached version 1.0 in 2012. The database aims to provide a universal solution as requirements change and scale. - ArangoDB offers high performance, a query language, extensions via actions, and supports features like replication and sharding.

Bridging Structured and Unstructred Data with Apache Hadoop and VerticaSteve Watt

ArangoDBArangoDB Database

Hugfr SPARK & RIAK -20160114_hug_franceModern Data Stack France

Presentation faite lors du Hadoop User Group France du 14 janvier 2016. L’analytique temps réel avec Riak et Spark par Michael Carney (Basho) et Olivier Girardot de Lateral Thoughts Selon un rapport de Salesforce, le nombre de sources de données analysées par les entreprises progressera de 83% au cours des cinq prochaines années, ainsi les organisations veulent désormais fournir des connaissances en temps réel même sur les appareils mobiles. Le traitement temps réel est donc, le futur de l’analyse big data. Ce talk présentera des nouveautés en matière de l’analyse temps réel autour de la famille SGBD Riak et Spark. Michael Carney est le Directeur Commercial de Basho pour le Sud d’Europe. Fondateur de MySQL France et de MariaDB, Michael a rejoint Basho en janvier 2015 pour explorer le monde de données sans tables ! Olivier Girardot est le CTO de Lateral Thoughts, il est développeur et formateur au sujet de Spark et également spécialiste de Java/Python dans le domaine de la finance de marché.

An introduction to multi-model databasesBerta Hermida Plaza

Apache Spark Side of FunnelsDatabricks

Last year we decided to build an in-house solution for Funnel analysis which should be accessible to our business user through our BI tool. Backend part should run on Ap;ache Spark and since the BI tool can only run SQL queries that implies that the solution is a pure Spark SQL implementation of Funnel analysis. In this talk we will cover various Spark SQL features we have used to optimize query performance and implement various filters which enable end users to get actionable insights. KEY TAKEAWAYS: – single query approach to Funnel analysis (can be applied to any funnel-like problem) – using window functions to ensure ordering of the events in the funnel – examples of higher order functions to calculate funnel metrics

How The Weather Company Uses Apache Spark to Serve Weather Data Fast at Low CostDatabricks

The Weather Company (TWC) collects weather data across the globe at the rate of 34 million records per hour, and the TWC History on Demand application serves that historical weather data to users via an API, averaging 600,000 requests per day. Users are increasingly consuming large quantities of historical data to train analytics models, and require efficient asynchronous APIs in addition to existing synchronous ones which use ElasticSearch. We present our architecture for asynchronous data retrieval and explain how we use Spark together with leading edge technologies to achieve an order of magnitude cost reduction while at the same time boosting performance by several orders of magnitude and tripling weather data coverage from land only to global.

Spark Concepts - Spark SQL, Graphx, StreamingPetr Zapletal

This document provides an overview of Apache Spark modules including Spark SQL, GraphX, and Spark Streaming. Spark SQL allows querying structured data using SQL, GraphX provides APIs for graph processing, and Spark Streaming enables scalable stream processing. The document discusses Resilient Distributed Datasets (RDDs), SchemaRDDs, querying data with SQLContext, GraphX property graphs and algorithms, StreamingContext, and input/output operations in Spark Streaming.

Common Strategies for Improving Performance on Your Delta LakehouseDatabricks

The Delta Architecture pattern has made the lives of data engineers much simpler, but what about improving query performance for data analysts? What are some common places to look at for tuning query performance? In this session we will cover some common techniques to apply to our delta tables to make them perform better for data analysts queries. We will look at a few examples of how you can analyze a query, and determine what to focus on to deliver better performance results.

Deep Dive on ArangoDBMax Neunhöffer

ArangoDB is a multi-model database that can be used as a document store, key-value store, and graph database. It offers queries across different data models using its query language AQL. Developers can also extend its functionality through JavaScript modules. ArangoDB can run on Apache Mesos clusters to provide automatic scaling and fault tolerance. It aims to provide polyglot persistence through a single database technology.

Query Languages for Document StoresInteractiveCologne

The document discusses query languages for document stores. It notes that while document stores today provide different proprietary querying mechanisms, there is no standard query language like SQL for relational databases. It presents ArangoDB's AQL and JSONiq as two query languages designed for querying JSON documents that support features like joins and aggregation. The document encourages trying these languages and providing feedback to help advance querying in document stores.

Introduction to Foxx by our community member Iskandar Soesman @ikandarsArangoDB Database

Foxx is a JavaScript framework for building data-centric HTTP microservices that run directly inside ArangoDB. It allows embedding application logic directly in the database, reducing network overhead and keeping data access and storage logic unified. Foxx provides benefits like a common API, making applications closer to the database, and shielding clients from changes to internal data structures. It has features similar to Express and allows full-stack JavaScript development with access to ArangoDB functionality.

Acid ORC, Iceberg and Delta LakeMichal Gancarski

The document compares three table formats for large scale data storage and analytics: ACID ORC, Apache Iceberg, and Delta Lake. ACID ORC provides ACID transactions for Hive tables stored as ORC files but has slow metadata operations. Iceberg supports multiple file formats, robust schema changes, and time travel capabilities but lacks commercial support. Delta Lake has great Spark integration, SQL merge syntax, and time travel with optimized compaction, but only supports Parquet files and multicluster writes on HDFS.

Experience with C++11 in ArangoDBMax Neunhöffer

ArangoDB is an open source, multi-model NoSQL database that is written in C++ and embeds Google's V8 engine to implement the higher levels of its functionality in JavaScript. Recently we decided to switch from C++03 to C++11 for the database kernel. In this talk I will first give a short overview of the software architecture of ArangoDB and proceed to tell you about our practical experiences with the switch to C++11. I will explain which of the parts of the "new" standard have been more important and which have been less useful, and I will report about the difficulties we encountered.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData

The document discusses how CSS Electronics stores and visualizes telematic data collected from CAN bus networks using InfluxDB and Grafana. Specifically, it summarizes: 1) CSS Electronics develops CAN bus data loggers and sensors to collect data from vehicles and industrial equipment. They implemented InfluxDB to store the decoded telematic data and Grafana to visualize it in customizable dashboards. 2) The process involves logging raw CAN bus data, decoding it using Python scripts, and writing it to InfluxDB. Grafana then pulls the data from InfluxDB to generate intuitive dashboards without coding. 3) Examples are shown of heavy vehicle, automotive, maritime, and sensor fusion dashboards. The solution is open source

More Related Content

What's hot (20)

A Graph Database That Scales - ArangoDB 3.7 Release WebinarArangoDB Database

An E-commerce App in action built on top of a Multi-model DatabaseArangoDB Database

ArangoDB 3.9 - Further Powering Graphs at ScaleArangoDB Database

Deep dive into the native multi model database ArangoDBArangoDB Database

ArangoDB – A different approach to NoSQLArangoDB Database

Arango DBNexThoughts Technologies

Introduction to ArangoDB (nosql matters Barcelona 2012)ArangoDB Database

Bridging Structured and Unstructred Data with Apache Hadoop and VerticaSteve Watt

ArangoDBArangoDB Database

Hugfr SPARK & RIAK -20160114_hug_franceModern Data Stack France

An introduction to multi-model databasesBerta Hermida Plaza

Apache Spark Side of FunnelsDatabricks

How The Weather Company Uses Apache Spark to Serve Weather Data Fast at Low CostDatabricks

Spark Concepts - Spark SQL, Graphx, StreamingPetr Zapletal

Common Strategies for Improving Performance on Your Delta LakehouseDatabricks

Deep Dive on ArangoDBMax Neunhöffer

Query Languages for Document StoresInteractiveCologne

Introduction to Foxx by our community member Iskandar Soesman @ikandarsArangoDB Database

Acid ORC, Iceberg and Delta LakeMichal Gancarski

Experience with C++11 in ArangoDBMax Neunhöffer

A Graph Database That Scales - ArangoDB 3.7 Release WebinarArangoDB Database

An E-commerce App in action built on top of a Multi-model DatabaseArangoDB Database

ArangoDB 3.9 - Further Powering Graphs at ScaleArangoDB Database

Deep dive into the native multi model database ArangoDBArangoDB Database

ArangoDB – A different approach to NoSQLArangoDB Database

Arango DBNexThoughts Technologies

Introduction to ArangoDB (nosql matters Barcelona 2012)ArangoDB Database

Bridging Structured and Unstructred Data with Apache Hadoop and VerticaSteve Watt

ArangoDBArangoDB Database

Hugfr SPARK & RIAK -20160114_hug_franceModern Data Stack France

An introduction to multi-model databasesBerta Hermida Plaza

Apache Spark Side of FunnelsDatabricks

How The Weather Company Uses Apache Spark to Serve Weather Data Fast at Low CostDatabricks

Spark Concepts - Spark SQL, Graphx, StreamingPetr Zapletal

Common Strategies for Improving Performance on Your Delta LakehouseDatabricks

Deep Dive on ArangoDBMax Neunhöffer

Query Languages for Document StoresInteractiveCologne

Introduction to Foxx by our community member Iskandar Soesman @ikandarsArangoDB Database

Acid ORC, Iceberg and Delta LakeMichal Gancarski

Experience with C++11 in ArangoDBMax Neunhöffer

Similar to ArangoDB 3.7 Roadmap: Performance at Scale (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData

State of GeoServer 2.10Jody Garnett

- GeoServer is an open source Java web application for sharing geospatial data. It publishes data from any major spatial data source using open standards like WMS, WFS, WCS, and WPS. - The GeoServer team has 13 releases in 2016 with a focus on maintenance and technical debt. New features include improved raster data support, styling enhancements, and configuration changes. - Looking ahead, focus areas include vector data improvements, raster optimizations, maintenance, and improving support for newer Java versions and standards.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Galaxy Big Data with MariaDBMariaDB Corporation

State of GeoServer - FOSS4G 2016GeoSolutions

State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.

How a distributed graph analytics platform uses Apache Kafka for data ingesti...HostedbyConfluent

Using Kafka to stream data into TigerGraph, a distributed graph database, is a common pattern in our customers’ data architecture. In the TigerGraph database, Kafka Connect framework was used to build the native S3 data loader. In TigerGraph Cloud, we will be building native integration with many data sources such as Azure Blob Storage and Google Cloud Storage using Kafka as an integrated component for the Cloud Portal. In this session, we will be discussing both architectures: 1. built-in Kafka Connect framework within TigerGraph database; 2. using Kafka cluster for cloud native integration with other popular data sources. Demo will be provided for both data streaming processes.

Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software

Once in a while, there really is something new under the sun. The rise of cloud-hosted data has fueled innovation in spatial data storage, enabling a brand new serverless architectural approach to spatial data sharing. Join us in our upcoming webinar to learn all about these new ways to organize your data, and leverage data shared by others. Explore the potential of Cloud Native Geospatial Formats in your workflows with FME, as we introduce five new formats: COGs, COPC, FlatGeoBuf, GeoParquet, STAC and ZARR. Learn from industry experts Michelle Roby from Radiant Earth and Chris Holmes from Planet about these cloud-native geospatial data formats and how they can make data easier to manage, share, and analyze. To get us started, they’ll explain the goals of the Cloud-Native Geospatial Foundation and provide overviews of cloud-native technologies including the Cloud-Optimized GeoTIFF (COG), SpatioTemporal Asset Catalogs (STAC), and GeoParquet. Following this, our seasoned FME team will guide you through practical demonstrations, showcasing how to leverage each format to its fullest potential. Learn strategic approaches for seamless integration and transition, along with valuable tips to enhance performance using these formats in FME. Discover how these formats are reshaping geospatial data handling and how you can seamlessly integrate them into your FME workflows and harness the explosion of cloud-hosted data.

New Developments in SparkDatabricks

Comparing three data ingestion approaches where Apache Kafka integrates with ...HostedbyConfluent

Using Kafka to stream data into TigerGraph, a distributed graph database, is a common pattern in our customers’ data architecture. We have seen the integration in three different layers around TigerGraph’s data flow architecture, and many key use case areas such as customer 360, entity resolution, fraud detection, machine learning, and recommendation engine. Firstly, TigerGraph’s internal data ingestion architecture relies on Kafka as an internal component. Secondly, TigerGraph has a builtin Kafka Loader, which can connect directly with an external Kafka cluster for data streaming. Thirdly, users can use an external Kafka cluster to connect other cloud data sources to TigerGraph cloud database solutions through the built-in Kafka Loader feature. In this session, we will present the high-level architecture in three different approaches and demo the data streaming process.

AquaQ Analytics Kx Event - Data Direct Networks PresentationAquaQ Analytics

This document discusses using DDN's parallel file systems to improve the performance of kdb+ analytics queries on large datasets. Running kdb+ on a parallel file system can significantly reduce query latency by distributing data and queries across multiple file system servers. This allows queries to achieve near linear speedups as more servers are added. The shared namespace also allows multiple independent kdb+ instances to access the same consolidated datasets.

Stream Processing and Real-Time Data PipelinesVladimír Schreiner

This document discusses stream processing and Hazelcast Jet. It defines stream processing as processing big volumes of continuous data with low latency. Some key challenges of stream processing discussed include handling infinite input streams, late arriving events, fault tolerance, and complexity. Hazelcast Jet is presented as a stream processing engine that favors simplicity and speed over other solutions like Spark Streaming. Example applications of Jet are provided.

5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks

In this session, learn how to quickly supplement your on-premises Hadoop environment with a simple, open, and collaborative cloud architecture that enables you to generate greater value with scaled application of analytics and AI on all your data. You will also learn five critical steps for a successful migration to the Databricks Lakehouse Platform along with the resources available to help you begin to re-skill your data teams.

State of GeoServer 2.14Jody Garnett

State of GeoServer provides an update on our community and reviews the new and noteworthy features for 2018. GeoServer is a web service for publishing your geospatial data. using industry standards for vector, raster and mapping. We have an active community and a lot to cover for 2.12 and 2.13 release, as well what is cooking in September’s 2.14 release. Each release provides exciting new features, this talk covers diverse improvements across GeoServer: * OGC compliance work for WFS 2.0 and WMTS 1.0, WFS 3.0 support * improvements for cloud deployments * cascade WMTS services * progress in NetCDF support * getting ready for the Java 18.9 roadmap * And much more… Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what GeoServer can do for you.

Scalability 09262012Mike Miller

IBM World of Watson 2016 - DB2 Analytics Accelerator on CloudDaniel Martin

IBM is introducing a new deployment option for the DB2 Analytics Accelerator on Cloud using dashDB as the acceleration engine. This provides customers with a hybrid cloud offering that gives the flexibility of running the Accelerator either on-premises or in the cloud. The Cloud deployment offers benefits like monthly pricing, hardware provisioning by IBM, and fast provisioning time. Initial focus areas include basic Accelerator functionality for offloading queries to the cloud, with a roadmap to continuously expand features and functionality.

Testing data streaming applicationsLars Albertsson

As companies adopt data processing technologies and add data-driven features to user-facing products, the need for effective automated test techniques for data processing applications increase. We go through anatomy of scalable data streaming applications, and how to set up test harnesses for reliable integration testing of such applications. We cover a few common anti-patterns that make asynchronous tests fragile, and corresponding patterns for remediation. We will also mention virtualisation components suitable for our testing scenarios.

RAPIDS cuGraph – Accelerating all your Graph needsConnected Data World

The relationships between data sets matter. Discovering, analyzing, and learning those relationships is a central part to expanding our understand, and is a critical step to being able to predict and act upon the data. Unfortunately, these are not always simple or quick tasks. To help the analyst we introduce RAPIDS, a collection of open-source libraries, incubated by NVIDIA and focused on accelerating the complete end-to-end data science ecosystem. Graph analytics is a critical piece of the data science ecosystem for processing linked data, and RAPIDS is pleased to offer cuGraph as our accelerated graph library. Simply accelerating algorithms only addressed a portion of the problem. To address the full problem space, RAPIDS cuGraph strives to be feature-rich, easy to use, and intuitive. Rather than limiting the solution to a single graph technology, cuGraph supports Property Graphs, Knowledge Graphs, Hyper-Graphs, Bipartite graphs, and the basic directed and undirected graph. A Python API allows the data to be manipulated as a DataFrame, similar and compatible with Pandas, with inputs and outputs being shared across the full RAPIDS suite, for example with the RAPIDS machine learning package, cuML. This talk will present an overview of RAPIDS and cuGraph. Discuss and show examples of how to manipulate and analyze bipartite and property graph, plus show how data can be shared with machine learning algorithms. The talk will include some performance and scalability metrics. Then conclude with a preview of upcoming features, like graph query language support, and the general RAPIDS roadmap.

Big data should be simpleDori Waldman

Netflix Open Source Meetup Season 4 Episode 2aspyker

In this episode, we will take a close look at 2 different approaches to high-throughput/low-latency data stores, developed by Netflix. The first, EVCache, is a battle-tested distributed memcached-backed data store, optimized for the cloud. You will also hear about the road ahead for EVCache it evolves into an L1/L2 cache over RAM and SSDs. The second, Dynomite, is a framework to make any non-distributed data-store, distributed. Netflix's first implementation of Dynomite is based on Redis. Come learn about the products' features and hear from Thomson and Reuters, Diego Pacheco from Ilegra and other third party speakers, internal and external to Netflix, on how these products fit in their stack and roadmap.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData

State of GeoServer 2.10Jody Garnett

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Galaxy Big Data with MariaDBMariaDB Corporation

State of GeoServer - FOSS4G 2016GeoSolutions

How a distributed graph analytics platform uses Apache Kafka for data ingesti...HostedbyConfluent

Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software

New Developments in SparkDatabricks

Comparing three data ingestion approaches where Apache Kafka integrates with ...HostedbyConfluent

AquaQ Analytics Kx Event - Data Direct Networks PresentationAquaQ Analytics

Stream Processing and Real-Time Data PipelinesVladimír Schreiner

5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks

State of GeoServer 2.14Jody Garnett

Scalability 09262012Mike Miller

IBM World of Watson 2016 - DB2 Analytics Accelerator on CloudDaniel Martin

Testing data streaming applicationsLars Albertsson

RAPIDS cuGraph – Accelerating all your Graph needsConnected Data World

Big data should be simpleDori Waldman

Netflix Open Source Meetup Season 4 Episode 2aspyker

More from ArangoDB Database (17)

ATO 2022 - Machine Learning + Graph Databases for Better Recommendations (3)....ArangoDB Database

This document summarizes techniques for combining machine learning and graph databases for better recommendations. It discusses using collaborative filtering with AQL, content-based recommendations with TFIDF and FAISS, and graph neural networks with PyTorch. The document also describes an ArangoFlix demo project that combines these techniques on a movie recommendation system using ArangoDB as the backend graph database.

Machine Learning + Graph Databases for Better Recommendations V2 08/20/2022ArangoDB Database

Machine Learning + Graph Databases for Better Recommendations V1 08/06/2022ArangoDB Database

GraphSage vs Pinsage #InsideArangoDBArangoDB Database

Getting Started with ArangoDB OasisArangoDB Database

Hacktoberfest 2020 - Intro to Knowledge GraphsArangoDB Database

gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?ArangoDB Database

View the video of this webinar here: https://www.arangodb.com/arangodb-events/gvisor-kata-containers-firecracker-docker/ Containers* have revolutionized the IT landscape and for a long time. Docker seemed to be the default whenever people were talking about containerization technologies**. But traditional container technologies might not be suitable if strong isolation guarantees are required. So recently new technologies such as gVisor, Kata Container, or firecracker have been introduced to close the gap between the strong isolation of virtual machines and the small resource footprint of containers. In this talk, we will provide an overview of the different containerization technologies, discuss their tradeoffs, and provide guidance for different use cases. * We will define the term container in more detailed during the talk ** and yes we will also cover some of the pre-docker container space!

Webinar: What to expect from ArangoDB OasisArangoDB Database

The long-awaited Managed Service for ArangoDB is finally here! Users have a fully managed document, graph, and key/value store, plus a search engine, in one place. As we thought of such a powerful service — something that gives you room to breathe, relax, and having someone else taking care of everything —, we called it Oasis. In this live webinar, Ewout Prangsma, Architect & Teamlead of ArangoDB Oasis, walks you through all the main capabilities of the new service, including high availability, elastic scalability, enterprise-grade security, and also demo the different deployment modes you have at your fingertips. Before the Q&A part, Ewout also shares what you will be capable of in the future.

ArangoDB 3.5 Feature Overview Webinar - Sept 12, 2019ArangoDB Database

The new ArangoDB 3.5 release is here and includes a number of minor and major new features. For example, the ability to perform distributed JOIN operations with SmartJoins, new text search features in ArangoSearch, new consistent backup mechanism, and extended graph database features including k-shortest path queries and the new PRUNE keyword for more efficient queries. Jörg Schad, our Head of Engineering and Machine Learning, will discuss these new features and provide a hands-on demo on how to leverage them for your use case.

3.5 webinar ArangoDB Database

An introduction to multi-model databasesArangoDB Database

The Computer Science Behind a modern Distributed DatabaseArangoDB Database

What we see in the modern data store world is a race between different approaches to achieve a distributed and resilient storage of data. Every application needs a stateful layer which holds the data. There are several different necessary components which are anything but trivial to combine, and, of course, even more challenging when attempting to optimize for performance. Over the past years there has been significant progress in both the science and practical implementations of such data stores. In this talk Dan Larkin-York will introduce the audience to some of the challenges, address the difficulties of their interplay, and cover key approaches taken by some of the industry’s leaders (ArangoDB, Cassandra, CockroachDB, MarkLogic, and more).

Fishing Graphs in a Hadoop Data LakeArangoDB Database

Hadoop clusters can store nearly everything in a cheap and blazingly fast way to your data lake. Answering questions and gaining insights out of this ever growing stream becomes the decisive part for many businesses. Increasingly data has a natural structure as a graph, with vertices linked by edges, and many questions arising about the data involve graph traversals or other complex queries, for which one does not have an a priori given bound on the length of paths.

Creating Fault Tolerant Services on MesosArangoDB Database

Fault-tolerant and thus distributed applications are hard, but Mesos is the ultimate breeding ground for them. Rule number one for designing such beasts is to use well-known, tried and tested, and in particular proven methods and tools as building blocks. Video recording of the talk: https://www.youtube.com/watch?v=6O_Wuc9FUXg&index=1&list=PLbzoR-pLrL6pLSHrXSg7IYgzSlkOh132K

Handling Billions of Edges in a Graph DatabaseArangoDB Database

By Michael Hackstein (@mchacki) The complexity and amount of data rises. Modern graph databases are designed to handle the complexity but still not for the amount of data. When hitting a certain size of a graph many dedicated graph databases reach their limits in vertical or most common horizontal scalability. In this talk I´ll provide a brief overview about current approaches and their limits towards scalability. Dealing with complex data in a complex system doesn't make things easier... but more fun finding a solution. Join me on my journey to handle billions of edges in a graph database.

Polyglot Persistence & Multi-Model DatabasesArangoDB Database

Polyglot Persistence & Multi-Model Databases by Michael Hackstein @mchacki In many modern applications the database side is realized using polyglot persistence – store each data format (graphs, documents, etc.) in an appropriate separate database. This approach yields several benefits, databases are optimized for their specific duty, however there are also drawbacks: - keep all databases in sync - queries might require data from several databases - experts needed for all used systems A multi-model database is not restricted to one data format, but can cope with several of them. In this talk I will present how a multi-model database can be used in a polyglot persistence setup and how it will reduce the effort drastically. http://www.jugh.de/termine/polyglot-persistence-multi-model-nosql-databases-69.html

Software + BabiesArangoDB Database

How to design software and APIs for parallelism on modern hardware - Richard Parker, mathematician and freelance computer programmer in Cambridge, England I see only three techniques capable of speeding up well written but old software by a factor of ten or more, namely - Using multiple cores - Making good use of cache memory - Using the full power of a single processor. So far, commercial software seems to have ignored recent changes in hardware. Often, performance does not really matter, but when it does matter, it requires changes to the design and coding of the computer software. I have been looking into the changes needed for several years now, and it is gradually emerging that one aspect sticks out as being more important than all the others. If functions, subroutines, methods etc. do a large number of whatever they do, rather than just one, it becomes possible to write clever implementations that run much faster. Several examples of this will be discussed. I suggest that software designed and written today should take this into account, making it easier to speed it up if and when it becomes necessary to do so.

ATO 2022 - Machine Learning + Graph Databases for Better Recommendations (3)....ArangoDB Database

Machine Learning + Graph Databases for Better Recommendations V2 08/20/2022ArangoDB Database

Machine Learning + Graph Databases for Better Recommendations V1 08/06/2022ArangoDB Database

GraphSage vs Pinsage #InsideArangoDBArangoDB Database

Getting Started with ArangoDB OasisArangoDB Database

Hacktoberfest 2020 - Intro to Knowledge GraphsArangoDB Database

gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?ArangoDB Database

Webinar: What to expect from ArangoDB OasisArangoDB Database

ArangoDB 3.5 Feature Overview Webinar - Sept 12, 2019ArangoDB Database

3.5 webinar ArangoDB Database

An introduction to multi-model databasesArangoDB Database

The Computer Science Behind a modern Distributed DatabaseArangoDB Database

Fishing Graphs in a Hadoop Data LakeArangoDB Database

Creating Fault Tolerant Services on MesosArangoDB Database

Handling Billions of Edges in a Graph DatabaseArangoDB Database

Polyglot Persistence & Multi-Model DatabasesArangoDB Database

Software + BabiesArangoDB Database

Recently uploaded (20)

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Are Cloud PBX Providers in India Reliable for Small Businesses (1).pdfTelecoms Supermarket

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Greenhouse_Monitoring_Presentation.pptx.hpbmnnxrvb

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Cyber Awareness overview for 2025 month of securityriccardosl1

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Build Your Own Copilot & Agents For DevsBrian McKeiver

Mastering Advance Window Functions in SQL.pdfSpiral Mantra

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Are Cloud PBX Providers in India Reliable for Small Businesses (1).pdfTelecoms Supermarket

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Greenhouse_Monitoring_Presentation.pptx.hpbmnnxrvb

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Cyber Awareness overview for 2025 month of securityriccardosl1

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Build Your Own Copilot & Agents For DevsBrian McKeiver

Mastering Advance Window Functions in SQL.pdfSpiral Mantra

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

AI and Data Privacy in 2025: Global TrendsInData Labs

ArangoDB 3.7 Roadmap: Performance at Scale

2. Copyright © ArangoDB Inc., 2019 - Conﬁdential ArangoDB 3.7 tl;dr ▸ Satellite Graphs [EE] ▸ Graph Performance ▸ Cluster/Failover Performance ▸ (optional) Schema Validation ▸ Security ▸ Operability/Metrics ▸ Fuzzy ArangoSearch ▸ Improved DC2DC Replication Deprecation of MMFiles Storage Engine.

5. Copyright © ArangoDB Inc., 2020 Native Multi-Model Approach 5 ● Native Multi Model Database ○ Stores, K/V, Documents & Graphs ● Distributed ○ Graphs can span multiple nodes ● AQL - SQL-like multi-model query language ● ACID Transactions including Multi Collection Transactions

10. Copyright © ArangoDB Inc., 2019 - Conﬁdential ArangoDB 3.6 ▸ OneShard Database Scalability ▸ Observability, Operability ● Inspector ▸ Metrics ▸ ArangoSearch Improvements ▸ Performance Improvements ● Subquery Optimization ▸ Parallel AQL ▸ Hot Backup Improvements

12. Copyright © ArangoDB Inc., 2020 - Conﬁdential Scalability, Observability, Operability 12 ❖ Operatibilty for scale ➢ Insights ➢ Metrics based alerting ➢ Sharding & Replication ❖ Inspector ➢ Serverside collection of cluster setup and status ➢ Across diﬀerent deployment ➢ Structured debug information ❖ Metrics ➢ Structured statics API ➢ Default dashboards ➢ Alerting recommendations

15. Copyright © ArangoDB Inc., 2020 - Conﬁdential 3.7 15 ❖ Satellite Graphs [EE] ❖ Performance ➢ Parallel Traversal for Graphs ➢ Graph Optimizations ➢ Faster MoveShard ➢ InSync Improvements ➢ Subqueries Optimization ❖ Schema Validation ❖ Security ➢ Encryption Key/JWT/TLS Rotation [partially EE] ❖ Operatabilty ➢ Metrics (Agency, Performance) ❖ ArangoSearch ➢ Fuzzy Queries (Regex/Preﬁx) ❖ OneShard Datacenter Replication }Graph performance } Cluster/Failover performance ETA: End of April

17. Copyright © ArangoDB Inc., 2020 - Conﬁdential Satellite Graphs 17 ❖ Satellite Collections are dealing with the distributed performance of JOINS ❖ How to deal with distributed graph traversals? ➢ Solution: Satellite Graphs

18. Copyright © ArangoDB Inc., 2020 - Conﬁdential Default Graph Traversal DB1 DB2 DB3 Coordinator 1. Fetch data 1. Fetch data 1. Fetch data 1. Fetch all data 2. Perform Traversal 2. Perform Traversal Simplified: Lots of traversal communication needed

19. Copyright © ArangoDB Inc., 2020 - Conﬁdential Traversal Satellite Graph DB1 DB2 DB3 Coordinator 2. Returns traversal result 1. Perform Traversal 2. Fetch result 3. Join 1. Performs traversal 1. Start Query

20. Copyright © ArangoDB Inc., 2020 - Conﬁdential Use case: IoT - Multiple seismic sensors which are storing huge amount of collected data - Collection of metadata stored inside the graph - e.g. location: Sensor → City → Region → Country → Continent - Example Query: - Extract all earthquake measurements from California - Fast traversal California → Cities → Sensors (db nodes locally and parallel)

26. What is on your roadmap? 3.8? 4.0?

27. Thank you!

ArangoDB 3.7 Roadmap: Performance at Scale

Recommended

More Related Content

What's hot (20)

Similar to ArangoDB 3.7 Roadmap: Performance at Scale (20)

More from ArangoDB Database (17)

Recently uploaded (20)

ArangoDB 3.7 Roadmap: Performance at Scale