Building the Foundation for a Latency-Free Life

Mar 7, 2018Download as PPTX, PDF2 likes524 views

The document discusses how MemSQL is able to process 1 trillion rows per second on 12 Intel servers running MemSQL. It demonstrates this throughput by running a query to count the number of trades for the top 10 most traded stocks from a dataset of over 115 billion rows of simulated NASDAQ trade data. The document argues that a latency-free operational and analytical data platform like MemSQL that can handle both high-volume operational workloads and complex queries is key to powering real-time analytics and decision making.

Building the Foundation
of a Latency-Free Life
Nikita Shamgunov, CEO, MemSQL
7 March 2018

Building the Foundation for a Latency-Free Life

More Sequences
More Matches
More Preventative Care

1 in 7 men
Diagnosed with
prostate cancer
American Cancer Society

1 TRILLION ROWS PER SECOND
• 12 Intel servers running MemSQL
• Scale-out architecture
• Operations on encoded data
• Query Vectorization
with GROUP BY using SIMD and AVX-2

1 TRILLION ROWS PER SECOND
DATA
• 115 billion rows simulated NASDAQ trades
• Columnstore on-disk workload
• Partitioned by stock_symbol, key(stock_symbol)
HARDWARE
• 12 Intel servers, each with:
• 2 Skylake Processors, 26 cores per chip
• Numa enabled and 616 leaf cores

1 TRILLION ROWS PER SECOND
QUERY “TOP 10 most traded stocks”
SELECT stock_symbol, COUNT (*)
FROM trade
GROUP BY stock_symbol
ORDER BY c desc LIMIT 10;
DATA SIZE
SELECT FORMAT (COUNT (*), 0)
as row_count
FROM trade;
row_count 115,587,416,064
+--------------+----------+
| stock_symbol | c |
+--------------+----------+
| AAPL | 78905344 |
| AMGN | 78905344 |
| BIDU | 78643200 |
| CSCO | 78643200 |
| KHC | 78381056 |
| CHTR | 78381056 |
| QCOM | 78381056 |
| CELG | 78381056 |
| FB | 78381056 |
| GOOG | 78381056 |
+--------------+----------+
10 rows in set (0.10 sec)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

BIG NUMBERS
1,000,000,000,000
BIG SAVINGS
$$$$$$$$$$$$$
>

THINKING FASTER IS THINKING BETTER
Why 1 Trillion Rows per Second
is the Future of Analytics
TODAY | MEMSQL BOOTH | 11:00 AM

Applications and AnalyticsOperational Data Real-Time Data Platform
Operational AND Analytical
Latency Free Is Within Reach

Picking an operational, latency-free platform
For the front lines of the business
Keep pace with operational data (inserts, updates, deletes)
Provide easy compatibility within the data ecosystem
Focused on value and infrasturcutre consolidation

Analytics in Real Time,
the [Grey’s] Anatomy
of Event Streaming
with guest from Disney ABC TV
TODAY | ROOM 230B | 11:50 AM

On the journey to latency-free
our choices are here today

The document provides an overview of the changing analytic environment and the evolution of the data warehouse. It discusses how new requirements like performance, usability, optimization, and ecosystem integration are driving the adoption of a real-time data warehouse approach. A real-time data warehouse is described as having low latency ingestion, in-memory and disk-optimized storage, and the ability to power both operational and machine learning applications. Examples are given of companies using a real-time data warehouse to enable real-time analytics and improve business processes.

Architecting Data in the AWS EcosystemSingleStore

How Kafka and Modern Databases Benefit Apps and AnalyticsSingleStore

This document provides an overview of how Kafka and modern databases like MemSQL can benefit applications and analytics. It discusses how businesses now require faster data access and intra-day processing to drive real-time decisions. Traditional database solutions struggle to meet these demands. MemSQL is presented as a solution that provides scalable SQL, fast ingestion of streaming data, and high concurrency to enable both transactions and analytics on large datasets. The document demonstrates how MemSQL distributes data and queries across nodes and allows horizontal scaling through its architecture.

Building a Machine Learning Recommendation Engine in SQLSingleStore

This document discusses building machine learning recommendation engines using SQL. It begins with an overview of data and analytics trends including the convergence of operational and analytical databases. The rise of machine learning is then covered along with how databases are integrating machine learning capabilities. A live demo is presented using the Yelp dataset to build a recommendation engine directly in SQL, leveraging the database's extensibility, stored procedures, and user defined functions. The document argues that training can be done externally but operational scoring can and should be done directly in the database for real-time applications.

Five ways database modernization simplifies your data lifeSingleStore

This document provides an overview of how database modernization with MemSQL can simplify a company's data life. It discusses five common customer scenarios where database limitations are impacting data-driven initiatives: 1) Slow event to insight delays, 2) High concurrency causing "wait in line" analytics, 3) Costly performance requiring specialized hardware, 4) Slow queries limiting big data analytics, and 5) Deployment inflexibility restricting multi-cloud usage. For each scenario, it provides an example customer situation and solution using MemSQL, highlighting benefits like real-time insights, scalable user access, cost efficiency, accelerated big data analytics, and deployment flexibility. The document also introduces MemSQL capabilities for fast data ingestion, instant

Building the Next-gen Digital Meter Platform for FluviusDatabricks

Fluvius is the network operator for electricity and gas in Flanders, Belgium. Their goal is to modernize the way people look at energy consumption using a digital meter that captures consumption and injection data from any electrical installation in Flanders ranging from households to large companies. After full roll-out there will be roughly 7 million digital meters active in Flanders collecting up to terabytes of data per day. Combine this with regulation that Fluvius has to maintain a record of these reading for at least 3 years, we are talking petabyte scale. delaware BeLux was assigned by Fluvius to setup a modern data platform and did so on Azure using Databricks as the core component to collect, store, process and serve these volumes of data to every single consumer and beyond in Flanders. This enables the Belgian energy market to innovate and move forward. Maarten took up the role as project manager and solution architect.

Real-Time Analytics with Confluent and MemSQLSingleStore

This document discusses enabling real-time analytics for IoT applications. It describes how industries like auto, transportation, energy, warehousing and logistics, and healthcare need real-time analytics to handle streaming data from IoT sensors. It also discusses how Confluent's Kafka stream processing platform can be used to build applications that ingest IoT data at high speeds, transform the data, and power real-time analytics and user interfaces. MemSQL's in-memory database is presented as a fast and scalable storage option to support real-time analytics on the large volumes of IoT data.

Building an IoT Kafka Pipeline in Under 5 MinutesSingleStore

This document discusses building an IoT Kafka pipeline using MemSQL in under 5 minutes. It begins with an overview of IoT, Kafka, and operational data warehouses. It then discusses MemSQL and how it functions as an operational data warehouse by continuously loading and querying data in real-time. The document demonstrates launching a MemSQL cluster, creating schemas and pipelines to ingest, transform, persist and analyze IoT data from Kafka. It emphasizes MemSQL's ability to handle different data types and scales from IoT at high throughput with low latency.

From Spark to Ignition: Fueling Your Business on Real-Time AnalyticsSingleStore

This document summarizes a presentation about MemSQL, a real-time database for transactions and analytics. It discusses MemSQL's capabilities for handling both transactions and analytics within a single database, as well as use cases for combining MemSQL with Spark for stream processing, live dashboards, and extending analytics. It also provides an example of MemSQL's geospatial capabilities using real-time location data from taxi trips.

Real-Time Analytics with Spark and MemSQLSingleStore

Intuit Analytics Cloud 101DataWorks Summit/Hadoop Summit

The document discusses Intuit's vision to transform customers' lives by unleashing the power of data. It describes Intuit's Analytics Cloud (IAC), which provides a data platform and foundational services to derive value from data. The IAC allows for real-time and batch data ingestion from various sources and provides services like business lookups, unified customer profiles, and personalization. An example use case of using tax data to personalize the tax preparation experience is also mentioned. The document outlines Intuit's journey to building the IAC, including initially lifting existing systems to the cloud and now focusing on real-time streaming capabilities. Key practices for planning, deploying and managing the IAC are also listed.

MemSQL - The Real-time Analytics PlatformSingleStore

HP Discover: Real Time Insights from Big DataRob Winters

Driving the On-Demand Economy with Predictive AnalyticsSingleStore

Getting It Right Exactly Once: Principles for Streaming ArchitecturesSingleStore

Building Pinterest Real-Time Ads Platform Using Kafka Streams confluent

Building Pinterest Real-Time Ads Platform Using Kafka Streams (Liquan Pei + Boyang Chen, Pinterest) Kafka Summit SF 2018 In this talk, we are sharing the experience of building Pinterest’s real-time Ads Platform utilizing Kafka Streams. The real-time budgeting system is the most mission-critical component of the Ads Platform as it controls how each ad is delivered to maximize user, advertiser and Pinterest value. The system needs to handle over 50,000 queries per section (QPS) impressions, requires less than five seconds of end-to-end latency and recovers within five minutes during outages. It also needs to be scalable to handle the fast growth of Pinterest’s ads business. The real-time budgeting system is composed of real-time stream-stream joiner, real-time spend aggregator and a spend predictor. At Pinterest’s scale, we need to overcome quite a few challenges to make each component work. For example, the stream-stream joiner needs to maintain terabyte size state while supporting fast recovery, and the real-time spend aggregator needs to publish to thousands of ads servers while supporting over one million read QPS. We choose Kafka Streams as it provides milliseconds latency guarantee, scalable event-based processing and easy-to-use APIs. In the process of building the system, we performed tons of tuning to RocksDB, Kafka Producer and Consumer, and pushed several open source contributions to Apache Kafka. We are also working on adding a remote checkpoint for Kafka Streams state to reduce the time of code start when adding more machines to the application. We believe that our experience can be beneficial to people who want to build real-time streaming solutions at large scale and deeply understand Kafka Streams.

Real-Time Geospatial Intelligence at Scale SingleStore

This document introduces MemSQL 5, a real-time database platform for transactions and analytics. It discusses how MemSQL is designed for modern workloads by providing scalable SQL on in-memory and solid-state storage across distributed data centers or the cloud. MemSQL allows for real-time processing through features like stream processing and real-time dashboards. Examples are given of using MemSQL for Internet of Things applications to monitor wind turbines and taxi ride data.

Denodo DataFest 2017: Integrating Big Data and Streaming Data with Enterprise...Denodo

Watch live presentation here: https://goo.gl/UcZEHU Big data projects are becoming mature and consistent. However, they remain siloed compared to the enterprise data. In addition, now new streaming data needs to integrated as well. Watch this Denodo DataFest 2017 session to discover: • How big data projects can be combined with other enterprise data. • How to integrate streaming data into the mix. • Benefits of aggregating the data without having to move them into a centralized repository.

Personalization Journey: From Single Node to Cloud StreamingDatabricks

In the online gaming industry we receive a vast amount of transactions that need to be handled in real time. Our customers get to choose from hundreds or even thousand options, and providing a seamless experience is crucial in our industry. Recommendation systems can be the answer in such cases but require handling loads of data and need to utilize large amounts of processing power. Towards this goal, in the last two years we have taken down the road of machine learning and AI in order to transform our customer’s daily experience and upgrade our internal services.

How Yellowbrick Data Integrates to Existing Environments WebcastYellowbrick Data

This document discusses how Yellowbrick can integrate into existing data environments. It describes Yellowbrick's data warehouse capabilities and how it compares to other solutions. The document recommends upgrading from single server databases or traditional MPP systems to Yellowbrick when data outgrows a single server or there are too many disparate systems. It also recommends moving from pre-configured or cloud-only systems to Yellowbrick to significantly reduce costs while improving query performance. The document concludes with a security demonstration using a netflow dataset.

Billions of Rows, Millions of Insights, Right NowRob Winters

In-Memory Computing Webcast. Market Predictions 2017SingleStore

1) In-memory computing is growing rapidly, with the total data market expected to grow from $69 billion in 2015 to $132 billion in 2020. 2) In-memory databases are gaining popularity for applications that require fast response times, like telecommunications and mobile advertising, as memory access is faster than disk access. 3) Modern applications are driving adoption of in-memory solutions as they generate more data from more users and transactions and require faster performance to handle growing traffic. 4) Two examples presented were DellEMC using MemSQL for a real-time customer 360 application and an IoT logistics application called MemEx that processes sensor data from warehouses for predictive analytics.

Add Historical Analysis of Operational Data with Easy Configurations in Fivet...Databricks

Fivetran makes it easy to automate data ingestion particularly for operational data sources such as Salesforce, Zendesk, and Oracle Eloqua, no matter how source schemas and APIs change. Achieving historical analysis is cumbersome, time-consuming, and costly to build and maintain manually. A common approach is to include snapshots, which only take into account changes at a given time. Plus, the additional storage requirements can become unwieldy to manage. Type 2 Slowly Changing Dimension (SCD) allows you to track any change at any point in time. This session shows how Fivetran History Mode, which uses Type 2 SCD, can be easily configured and then switched on with 1-click and synchronized for a desired time period. This accelerates time to insights, making it easy to both automate data ingestion and historical analysis.

Transforming and Scaling Large Scale Data Analytics: Moving to a Cloud-based ...DataWorks Summit

The Census Bureau is the U.S. government's largest statistical agency with a mission to provide current facts and figures about America's people, places and economy. The Bureau operates a large number of surveys to collect this data, the most well known being the decennial population census. Data is being collected in increasing volumes and the analytics solutions must be able to scale to meet the ever increasing needs while maintaining the confidentiality of the data. Past data analytics have occurred in processing silos inhibiting the sharing of information and common reference data is replicated across multiple system. The use of the Hortonworks Data Platform, Hortonworks Data Flow and other open-source technologies is enabling the creation of a cloud-based enterprise data lake and analytics platform. Cloud object stores are used to provide scalable data storage and cloud compute supports permanent and transient clusters. Data governance tools are used to track the data lineage and to provide access controls to sensitive data.

Building Data Lakes with Apache AirflowGary Stafford

Migrating Big Data Workloads to the CloudRobert Sanders

Cloud Services have become an integral part of many organizations’ workloads. With the ease of spinning up instances to react to changing or increased business demands, it’s certainly not hard to see why. Many organizations that once relied on internal data centers are even considering migrating to the cloud to take advantage of not just the ability to spin up instances rapidly, but also to leverage all the services that are available with these offerings. Such as Elastic Map Reduce from Amazon and HD Insight from Microsoft. In this talk, we will go over the various methods and strategies you can employ to migrate your data and workloads to the cloud and what all options this opens up for your business and IT.

See who is using MemSQLjenjermain

MemSQL is an in-memory distributed database that provides fast data processing for real-time analytics. It allows companies to extract greater insights from big data in real time. MemSQL is used by companies for applications like ad targeting, recommendations, fraud detection, and more. It provides rapid data loading and querying, horizontal scalability, and supports both relational and JSON data. Case studies describe how companies like Comcast, Zynga, CPXi, and others use MemSQL to power applications that require real-time insights from massive datasets.

Michael Hummel - Stop Storing Data! - ParstreamBusiness of Software Conference

Adventures in RDS Load TestingMike Harnish

This document summarizes load testing experiments conducted on Amazon RDS using an Oracle database. The tests aimed to evaluate RDS performance under different configurations and provide a basis for future load testing. Tests were run using m2.4xlarge and m1.xlarge instance types with varying provisioned IOPS. Key results showed that provisioned IOPS had a significant impact on throughput and latency. Higher IOPS configurations achieved thousands of transactions per second but also had periods of high latency. Lower IOPS configurations had more stable performance but lower throughput. The experiments provided insights into how different factors like instance type, IOPS provisioning, and read/write ratios influence RDS and database performance under load.

More Related Content

What's hot (20)

Building an IoT Kafka Pipeline in Under 5 MinutesSingleStore

From Spark to Ignition: Fueling Your Business on Real-Time AnalyticsSingleStore

Real-Time Analytics with Spark and MemSQLSingleStore

Intuit Analytics Cloud 101DataWorks Summit/Hadoop Summit

MemSQL - The Real-time Analytics PlatformSingleStore

HP Discover: Real Time Insights from Big DataRob Winters

Driving the On-Demand Economy with Predictive AnalyticsSingleStore

Getting It Right Exactly Once: Principles for Streaming ArchitecturesSingleStore

Building Pinterest Real-Time Ads Platform Using Kafka Streams confluent

Real-Time Geospatial Intelligence at Scale SingleStore

Denodo DataFest 2017: Integrating Big Data and Streaming Data with Enterprise...Denodo

Personalization Journey: From Single Node to Cloud StreamingDatabricks

How Yellowbrick Data Integrates to Existing Environments WebcastYellowbrick Data

Billions of Rows, Millions of Insights, Right NowRob Winters

In-Memory Computing Webcast. Market Predictions 2017SingleStore

Add Historical Analysis of Operational Data with Easy Configurations in Fivet...Databricks

Transforming and Scaling Large Scale Data Analytics: Moving to a Cloud-based ...DataWorks Summit

Building Data Lakes with Apache AirflowGary Stafford

Migrating Big Data Workloads to the CloudRobert Sanders

See who is using MemSQLjenjermain

Building an IoT Kafka Pipeline in Under 5 MinutesSingleStore

From Spark to Ignition: Fueling Your Business on Real-Time AnalyticsSingleStore

Real-Time Analytics with Spark and MemSQLSingleStore

Intuit Analytics Cloud 101DataWorks Summit/Hadoop Summit

MemSQL - The Real-time Analytics PlatformSingleStore

HP Discover: Real Time Insights from Big DataRob Winters

Driving the On-Demand Economy with Predictive AnalyticsSingleStore

Getting It Right Exactly Once: Principles for Streaming ArchitecturesSingleStore

Building Pinterest Real-Time Ads Platform Using Kafka Streams confluent

Real-Time Geospatial Intelligence at Scale SingleStore

Denodo DataFest 2017: Integrating Big Data and Streaming Data with Enterprise...Denodo

Personalization Journey: From Single Node to Cloud StreamingDatabricks

How Yellowbrick Data Integrates to Existing Environments WebcastYellowbrick Data

Billions of Rows, Millions of Insights, Right NowRob Winters

In-Memory Computing Webcast. Market Predictions 2017SingleStore

Add Historical Analysis of Operational Data with Easy Configurations in Fivet...Databricks

Transforming and Scaling Large Scale Data Analytics: Moving to a Cloud-based ...DataWorks Summit

Building Data Lakes with Apache AirflowGary Stafford

Migrating Big Data Workloads to the CloudRobert Sanders

See who is using MemSQLjenjermain

Similar to Building the Foundation for a Latency-Free Life (20)

Michael Hummel - Stop Storing Data! - ParstreamBusiness of Software Conference

Adventures in RDS Load TestingMike Harnish

SQREAM DB on IBM Power9Ganesan Narayanasamy

GPU data warehouse Sqream DB provides a massively parallel processing engine powered by GPUs that is faster and more efficient than CPU-based systems. It can ingest terabytes of data per hour onto a single GPU and handle petabytes of data stored in a compact 2U server. With familiar SQL queries and connectors, Sqream DB accelerates analytics by 100x over traditional warehouses through its GPU-accelerated processing and columnar storage.

"Democratizing Big Data", Ami Gal, CEO & Co-Founder of SQream TechnologiesDataconomy Media

"Democratizing Big Data", Ami Gal, CEO & Co-Founder of SQream Technologies Watch more from Data Natives Tel Aviv 2016 here: http://bit.ly/2hw1MY0 Visit the conference website to learn more: http://telaviv.datanatives.io/ Follow Data Natives: https://www.facebook.com/DataNatives https://twitter.com/DataNativesConf Stay Connected to Data Natives by Email: Subscribe to our newsletter to get the news first about Data Natives 2017: http://bit.ly/1WMJAqS About the Author: Ami Gal is the Co-Founder and CEO at SqreamTechnologies where he is producing a very fast SQL Big Database at SQream Technologies, crunching all the way from a few Terabytes to Petabytes with high performance. He is a hands-on entepreneur, a mentor at Seedcamp and SmartCamp Mentor at IBM.

Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...Flink Forward

One of the main characteristics of the good streaming pipeline is correctness for event time processing. Real challenges become when such pipeline should be resilient to different types of failures. In this talk, we describe how Criteo runs Flink on one of the biggest Yarn clusters in Europe and computes 100k messages per second to acknowledge revenue of our platform within the delay of 5 minutes. Real-time revenue monitoring system calculates data under 1% of discrepancies and minimizes business impact in case of revenue anomalies.

ClickHouse Analytical DBMS. Introduction and usage, by Alexander ZaitsevAltinity Ltd

The document outlines an agenda for a ClickHouse event, including presentations on ClickHouse features and usage. ClickHouse is introduced as a fast, flexible, and free open source columnar database management system. It is described as being very fast for analytical queries, with the ability to ingest and aggregate data at low latency and perform distributed computations and fault-tolerant data warehousing at large scale. Successful production deployments are listed in domains like analytics, advertising, operations, and security. The growth and adoption of ClickHouse is discussed.

Top 10 tips for Oracle performanceGuy Harrison

This document provides 9 hints for optimizing Oracle database performance: 1. Take a methodical and empirical approach to tuning by focusing on root causes, measuring performance before and after changes, and avoiding "silver bullets". 2. Design databases and applications with performance in mind from the beginning. 3. Index wisely by only creating useful indexes that improve performance without excessive overhead. 4. Leverage built-in Oracle tools like DBMS_XPLAN and SQL Trace to measure performance. 5. Tune the optimizer by adjusting parameters and statistics to encourage better execution plans. 6. Focus SQL and PL/SQL tuning on problem queries, joins, sorts, and DML statements. 7. Address

Q1 Memory Fabric Forum: Using CXL with AI Applications - Steve Scargall.pptxMemory Fabric Forum

Tsinghua University: Two Exemplary Applications in ChinaDataStax Academy

In this talk, we will share the experiences of applying Cassandra with two real customers in China. In the first use case, we deployed Cassandra at Sany Group, a leading company of Machinery manufacturing, to manage the sensor data generated by construction machinery. By designing a specific schema and optimizing the write process, we successfully managed over 1.5 billion historical data records and achieved the online write throughput of 10k write operations per second with 5 servers. MapReduce is also used on Cassandra for valued-added services, e.g. operations management, machine failure prediction, and abnormal behavior mining. In the second use case, Cassandra is deployed in the China Meteorological Administration to manage the Meteorological data. We design a hybrid schema to support both slice query and time window based query efficiently. Also, we explored the optimized compaction and deletion strategy for meteorological data in this case.

MySQL NDB Cluster 8.0 SQL faster than NoSQL Bernd Ocklin

Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez

Los sistemas distribuidos son difíciles. Los sistemas distribuidos de alto rendimiento, más. Latencias de red, mensajes sin confirmación de recibo, reinicios de servidores, fallos de hardware, bugs en el software, releases problemáticas, timeouts... hay un montón de motivos por los que es muy difícil saber si un mensaje que has enviado se ha recibido y procesado correctamente en destino. Así que para asegurar mandas el mensaje otra vez.. y otra... y cruzas los dedos para que el sistema del otro lado tenga tolerancia a los duplicados. QuestDB es una base de datos open source diseñada para alto rendimiento. Nos queríamos asegurar de poder ofrecer garantías de "exactly once", deduplicando mensajes en tiempo de ingestión. En esta charla, te cuento cómo diseñamos e implementamos la palabra clave DEDUP en QuestDB, permitiendo deduplicar y además permitiendo Upserts en datos en tiempo real, añadiendo solo un 8% de tiempo de proceso, incluso en flujos con millones de inserciones por segundo. Además, explicaré nuestra arquitectura de log de escrituras (WAL) paralelo y multithread. Por supuesto, todo esto te lo cuento con demos, para que veas cómo funciona en la práctica.

Scylla Summit 2019 Keynote - Dor Laor - Beyond CassandraScyllaDB

ScyllaDB CEO Dor Laor lays out the ten million dollar engineering problem for distributed systems, and how only Scylla is architected to address the issue at the heart of Big Data ROI. He then introduces ScyllaDB's Glauber Costa and Packet's James Malachowski to reveal a new level of performance for a persistent NoSQL datastore. Dor concludes his talk with a bold proposition about how Scylla is uniquely positioned to help companies easily create and scale the software they need to achieve their vision.

Splunk App for StreamSplunk

Wire data provides deep insights across IT, security and business use cases by capturing the communications transmitted over the wire between machines and applications in real-time. The Splunk App for Stream enables new operational intelligence by indexing this wire data without needing instrumentation. It provides enhanced visibility, efficient cloud-ready collection, and fast time to value through interface-driven deployment. Key features include protocol decoding, attribute filtering, aggregations, and custom content extraction for analysis in Splunk.

Calum McCrea, Software Engineer at Kx Systems, "Kx: How Wall Street Tech can ...Dataconomy Media

EDA Meets Data Engineering – What's the Big Deal?confluent

Presenter: Guru Sattanathan, Systems Engineer, Confluent Event-driven architectures have been around for many years, much like Apache Kafka®, which first open sourced in 2011. The reality is that the true potential of Kafka is only being realised now. Kafka is becoming the central nervous system of many of today’s enterprises. It is bringing a profound paradigm shift to the way we think about enterprise IT. What has changed in Kafka to enable this paradigm shift? Is it not just a message broker, and how are enterprises using it today? This session will explore these key questions. Sydney: https://content.deloitte.com.au/20200221-tel-event-tech-community-syd-registration Melbourne: https://content.deloitte.com.au/20200221-tel-event-tech-community-mel-registration

Using druid for interactive count distinct queries at scale @ nmcIdo Shilon

This document discusses Nielsen's use of Druid for interactive count-distinct queries at scale. It describes Nielsen's need to calculate unique devices encountered over date ranges and attributes in real time from large volumes of streaming data. Previous attempts using Elasticsearch were slow and inefficient. Druid uses sketch algorithms like ThetaSketch to approximate distinct counts quickly while balancing speed and accuracy. It has a columnar data store that allows fast roll-up queries of pre-aggregated sketches. Nielsen was able to reduce query times from hours to milliseconds and costs from $80k to $55k per month by ingesting data into Druid instead of Elasticsearch. The document provides guidelines for setting up, monitoring, modeling data, optimizing queries, and batch ingest

Scaling paypal workloads with oracle rac ssAnil Nair

PayPal workloads scale efficiently with Oracle Real Application Clusters (RAC). Oracle RAC provides high availability, scalability, and performance for PayPal's workloads. Oracle RAC utilizes features like cache fusion, dynamic resource management, and fine-grained processes to optimize performance on modern CPU architectures. Oracle RAC also provides near-zero downtime for reconfiguration and patching through optimizations like recovery buddies. PayPal leverages over 250 Oracle RAC clusters with over 90 petabytes of database storage to handle its transaction processing and analytics workloads at scale with high performance.

6Tisch telecom_bretagne_2016Pascal Thubert

The document discusses key trends in industrial networking including deterministic networking, clock synchronization, software-defined networking (SDN), and fog computing. It focuses on 6TiSCH (IPv6 over the TSCH mode of IEEE 802.15.4) which provides deterministic IPv6 networking over low-power wireless networks. 6TiSCH aims to converge industrial control networks to IP, make IP operations more efficient, and emulate existing industrial protocols to support the industrial internet. It leverages standards like RPL, 6LoWPAN, and TSCH to provide both deterministic routing for critical flows and stochastic routing for large-scale monitoring.

MCSoC'13 Keynote Talk "Taming Big Data Streams"Hideyuki Kawashima

This document discusses techniques for processing big data streams. It begins with an overview of various data stream processing systems and techniques such as complex event processing, machine learning, and incremental computation. It then discusses research topics including Falcon, an in-database stream analytics system, window operators accelerated by FPGAs, and privacy-preserving stream data processing. Specific techniques covered in more detail include a multiple query optimization scheme for change point detection on Falcon, a novel architecture for a merging network to accelerate handshake joins, and a wire-speed implementation of a sliding-window aggregate operator over out-of-order data streams.

Achitecture Aware Algorithms and Software for Peta and Exascaleinside-BigData.com

Michael Hummel - Stop Storing Data! - ParstreamBusiness of Software Conference

Adventures in RDS Load TestingMike Harnish

SQREAM DB on IBM Power9Ganesan Narayanasamy

"Democratizing Big Data", Ami Gal, CEO & Co-Founder of SQream TechnologiesDataconomy Media

Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...Flink Forward

ClickHouse Analytical DBMS. Introduction and usage, by Alexander ZaitsevAltinity Ltd

Top 10 tips for Oracle performanceGuy Harrison

Q1 Memory Fabric Forum: Using CXL with AI Applications - Steve Scargall.pptxMemory Fabric Forum

Tsinghua University: Two Exemplary Applications in ChinaDataStax Academy

MySQL NDB Cluster 8.0 SQL faster than NoSQL Bernd Ocklin

Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez

Scylla Summit 2019 Keynote - Dor Laor - Beyond CassandraScyllaDB

Splunk App for StreamSplunk

Calum McCrea, Software Engineer at Kx Systems, "Kx: How Wall Street Tech can ...Dataconomy Media

EDA Meets Data Engineering – What's the Big Deal?confluent

Using druid for interactive count distinct queries at scale @ nmcIdo Shilon

Scaling paypal workloads with oracle rac ssAnil Nair

6Tisch telecom_bretagne_2016Pascal Thubert

MCSoC'13 Keynote Talk "Taming Big Data Streams"Hideyuki Kawashima

Achitecture Aware Algorithms and Software for Peta and Exascaleinside-BigData.com

More from SingleStore (20)

MemSQL 201: Advanced Tips and Tricks WebcastSingleStore

This document summarizes a webinar on advanced tips and tricks for MemSQL. It discusses the differences between rowstore and columnstore storage models and when each is best used. It also covers data ingestion using MemSQL Pipelines for real-time loading, data sharding and query tuning techniques like using reference tables. Additionally, it discusses monitoring memory usage, workload management using management views, and query optimization tools like analyzing and optimizing tables.

Introduction to MemSQLSingleStore

Mike Boyarski gave a presentation on MemSQL, an operational data warehouse that provides real-time analytics capabilities. He discussed challenges with traditional databases around slow data loading, lengthy query times, and low concurrency. MemSQL addresses these issues with fast data ingestion, low latency queries, and high scalability. It can ingest streaming data, run on a variety of platforms, and provides security, SQL support, and integration with common data tools. MemSQL was shown augmenting an existing IoT architecture to enable real-time analytics through fast data loading, consolidated data storage, and high query performance.

An Engineering Approach to Database EvaluationsSingleStore

Building a Fault Tolerant Distributed ArchitectureSingleStore

Stream Processing with Pipelines and Stored ProceduresSingleStore

Curriculum Associates Strata NYC 2017SingleStore

The document describes Curriculum Associates' journey to develop a real-time application architecture to provide teachers and students with real-time feedback. They started with batch ETL to a data warehouse and migrated to an in-memory database. They added Kafka message queues to ingest real-time event data and integrated a data lake. Now their system uses MemSQL, Kafka, and a data lake to provide real-time and batch processed data to users.

Image Recognition on Streaming DataSingleStore

Learn how to leverage MPP technology and distributed data to deliver high volume transactional and analytical work loads which result in real time dashboards on rapidly changing data using standard SQL tools. Demonstrations will include the streaming of structured and JSON data from Kafka messages through a micro-batch ETL process into the MemSQL database where the data is then queried using standard SQL tools and visualized leveraging Tableau. This session will focus on image recognition, the techniques available, and how to put those techniques into production. It will further explore algebraic operations on tensors, and how that can assist in large-scale, high-throughput, highly-parallel image recognition. LIVE DEMO: Constructing and executing a real-time image recognition pipeline using Kafka and Spark. Speaker: Neil Dahlke, MemSQL Senior Solutions Engineer

Spark Summit Dublin 2017 - MemSQL - Real-Time Image RecognitionSingleStore

The document discusses real-time image recognition using Apache Spark. It describes how images are analyzed to extract histogram of oriented gradients (HOG) descriptors, which are stored as feature vectors in a MemSQL table. Similar images can then be identified by comparing feature vectors using dot products, enabling searches of millions of images per second. A demo is shown generating HOG descriptors from an image and storing them as a vector for fast similarity matching.

How Database Convergence Impacts the Coming Decades of Data ManagementSingleStore

Teaching Databases to Learn in the World of AISingleStore

The document discusses how databases need to learn and adapt like artificial intelligence in order to power real-time applications, highlighting that databases must be simple, capable of real-time processing, and adaptable by learning behaviors and making autonomous decisions. It also promotes MemSQL's vision of teaching databases to learn by consolidating infrastructure, enabling real-time queries on fresh data, and allowing both transactions and analytics workloads.

Gartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid CloudSingleStore

This document discusses a data warehouse blueprint for machine learning, artificial intelligence, and hybrid cloud. It provides a live demonstration of k-means clustering in SQL with MemSQL. The demonstration loads YouTube tag data, sets up k-means clustering functions using MemSQL extensibility, runs the k-means algorithm to train the data, and outputs insights into important tags and representative channels. It also briefly discusses MemSQL's capabilities for a real-time data warehouse and hybrid cloud deployments to support analytics, machine learning, and artificial intelligence workloads.

Gartner Catalyst 2017: Image Recognition on Streaming DataSingleStore

This document discusses using MemSQL to perform real-time image recognition on streaming data. Key points include: - Feature vectors extracted from images using models like TensorFlow can be stored in MemSQL tables for analysis. - MemSQL allows querying these feature vectors to find similar images based on cosine similarity calculations. - This enables applications like detecting duplicate or illegal images in real-time streams.

Spark Summit West 2017: Real-Time Image Recognition with MemSQL and SparkSingleStore

Real-Time Analytics at Uber ScaleSingleStore

James Burkhart explains how Uber supports millions of analytical queries daily across real-time data with Apollo. James covers the architectural decisions and lessons learned building an exactly-once ingest pipeline storing raw events across in-memory row storage and on-disk columnar storage and a custom metalanguage and query layer leveraging partial OLAP result set caching and query canonicalization. Putting all the pieces together provides thousands of Uber employees with subsecond p95 latency analytical queries spanning hundreds of millions of recent events.

Machines and the Magic of Fast LearningSingleStore

Human-machine interaction is no longer the exclusive province of science fiction. The advance of the internet and connected devices has inspired data scientists to create machine-learning applications to extract value from these new forms of data. So what's the next frontier? Join MemSQL Engineer Michael Andrews and Sr. Director Mike Boyarski to learn how to use real-time data as a vehicle for operationalizing machine-learning models. Michael and Mike will explore advanced tools, including TensorFlow, Apache Spark, and Apache Kafka, and compelling use cases demonstrating the power of machine learning to effect positive change. You will learn: Top technologies for building the ideal machine-learning stack How to power machine-learning applications with real-time data A use case and demo of machine learning for social good

Machines and the Magic of Fast Learning - Strata KeynoteSingleStore

Enabling Real-Time Analytics for IoTSingleStore

Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingSingleStore

The Real-Time CDO and the Cloud-Forward Path to Predictive AnalyticsSingleStore

Nikita Shamgunov presented on the Real-Time Chief Data Officer and the cloud-forward path to predictive analytics. He discussed how MemSQL provides a modern data architecture that enables real-time access to all data, flexible deployments across public/private clouds, and a 360 view of the business without data silos. He showcased several customer use cases that demonstrated transforming analytics from weekly to daily using MemSQL and reducing latency from days to minutes. Finally, he proposed strategies for building a hybrid cloud approach and real-time analytics infrastructure to gain faster historical insights and predictive capabilities.

Enabling Real-Time Analytics for IoTSingleStore

Rick Negrin discusses enabling real-time analytics for IoT applications. He describes how industries are increasingly needing real-time analytics due to trends like the on-demand economy and rise of IoT. He then outlines an architecture using Kafka for messaging and MemSQL for real-time analytics. MemSQL is presented as a SQL database that can ingest millions of events per second while analyzing petabytes of data. Finally, Negrin demonstrates an IoT application called MemEx that combines MemSQL, Kafka and Spark to enable predictive analytics on sensor data for supply chain management.

MemSQL 201: Advanced Tips and Tricks WebcastSingleStore

Introduction to MemSQLSingleStore

An Engineering Approach to Database EvaluationsSingleStore

Building a Fault Tolerant Distributed ArchitectureSingleStore

Stream Processing with Pipelines and Stored ProceduresSingleStore

Curriculum Associates Strata NYC 2017SingleStore

Image Recognition on Streaming DataSingleStore

Spark Summit Dublin 2017 - MemSQL - Real-Time Image RecognitionSingleStore

How Database Convergence Impacts the Coming Decades of Data ManagementSingleStore

Teaching Databases to Learn in the World of AISingleStore

Gartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid CloudSingleStore

Gartner Catalyst 2017: Image Recognition on Streaming DataSingleStore

Spark Summit West 2017: Real-Time Image Recognition with MemSQL and SparkSingleStore

Real-Time Analytics at Uber ScaleSingleStore

Machines and the Magic of Fast LearningSingleStore

Machines and the Magic of Fast Learning - Strata KeynoteSingleStore

Enabling Real-Time Analytics for IoTSingleStore

Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingSingleStore

The Real-Time CDO and the Cloud-Forward Path to Predictive AnalyticsSingleStore

Enabling Real-Time Analytics for IoTSingleStore

Recently uploaded (20)

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

tecnologias de las primeras civilizaciones.pdffjgm517

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

tecnologias de las primeras civilizaciones.pdffjgm517

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Mobile App Development Company in Saudi ArabiaSteve Jonas

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

TrsLabs - Fintech Product & Business ConsultingTrs Labs

How analogue intelligence complements AIPaul Rowe

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Building the Foundation for a Latency-Free Life

1. Building the Foundation of a Latency-Free Life Nikita Shamgunov, CEO, MemSQL 7 March 2018

7. Time Matters

8. Real-Time Analytics for Cancer Research

9. More Sequences More Matches More Preventative Care

10. 1 in 7 men Diagnosed with prostate cancer American Cancer Society

11. Speed + Comprehensiveness

12. 1 TRILLION ROWS PER SECOND

13. 1 TRILLION ROWS PER SECOND • 12 Intel servers running MemSQL • Scale-out architecture • Operations on encoded data • Query Vectorization with GROUP BY using SIMD and AVX-2

14. 1 TRILLION ROWS PER SECOND DATA • 115 billion rows simulated NASDAQ trades • Columnstore on-disk workload • Partitioned by stock_symbol, key(stock_symbol) HARDWARE • 12 Intel servers, each with: • 2 Skylake Processors, 26 cores per chip • Numa enabled and 616 leaf cores

15. 1 TRILLION ROWS PER SECOND QUERY “TOP 10 most traded stocks” SELECT stock_symbol, COUNT (*) FROM trade GROUP BY stock_symbol ORDER BY c desc LIMIT 10; DATA SIZE SELECT FORMAT (COUNT (*), 0) as row_count FROM trade; row_count 115,587,416,064 +--------------+----------+ | stock_symbol | c | +--------------+----------+ | AAPL | 78905344 | | AMGN | 78905344 | | BIDU | 78643200 | | CSCO | 78643200 | | KHC | 78381056 | | CHTR | 78381056 | | QCOM | 78381056 | | CELG | 78381056 | | FB | 78381056 | | GOOG | 78381056 | +--------------+----------+ 10 rows in set (0.10 sec) 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

16. ~$20 TRILLION GDP ~2 TRILLION Galaxies

17. All this on 12 Servers

18. BIG NUMBERS 1,000,000,000,000 BIG SAVINGS $$$$$$$$$$$$$ >

19. THINKING FASTER IS THINKING BETTER Why 1 Trillion Rows per Second is the Future of Analytics TODAY | MEMSQL BOOTH | 11:00 AM

20. Operational and Analytical Together

22. Applications and AnalyticsOperational Data Real-Time Data Platform Operational AND Analytical Latency Free Is Within Reach

23. Picking an operational, latency-free platform For the front lines of the business Keep pace with operational data (inserts, updates, deletes) Provide easy compatibility within the data ecosystem Focused on value and infrasturcutre consolidation

24. Analytics in Real Time, the [Grey’s] Anatomy of Event Streaming with guest from Disney ABC TV TODAY | ROOM 230B | 11:50 AM

25. On the journey to latency-free our choices are here today

26. Thank you!

Building the Foundation for a Latency-Free Life

Recommended

More Related Content

What's hot (20)

Similar to Building the Foundation for a Latency-Free Life (20)

More from SingleStore (20)

Recently uploaded (20)

Building the Foundation for a Latency-Free Life