Apache Flink and what it is used for

Oct 3, 2018Download as PPTX, PDF0 likes1,824 views

Aljoscha Krettek is the PMC chair of Apache Flink and Apache Beam, and co-founder of data Artisans. Apache Flink is an open-source platform for distributed stream and batch data processing. It allows for stateful computations over data streams in real-time and historically. Flink supports batch and stream processing using APIs like DataSet and DataStream. Data Artisans originated Flink and provides an application platform powered by Flink and Kubernetes for building stateful stream processing applications.

Aljoscha Krettek – PMC of Apache Flink and Apache Beam, Co-Founder at data Artisans
Apache Flink® and what it is used for

© 2018 data Artisans2
About Data Artisans
Original Creators of
Apache Flink®
RealTime Stream Processing
Enterprise Ready
2008 2009 2011
Studying and working at IBM
Development on Stratosphere begins
I joinTU Berlin research group with other co-founders
2014
data Artisans is founded

© 2018 data Artisans3
What is Apache Flink?
Queries
Applications
Devices
etc.
Database
Stream
File / Object
Storage
Historic
Data
Streams
Application
Stateful computations over streams
real-time and historic
fast, scalable, fault tolerant, in-memory,
event time, large state, exactly-once

© 2018 data Artisans4
Overview of Flink Use Cases
Event-driven
applications
Stream
Processing
Batch
processing

© 2018 data Artisans5
Batch Processing
a.k.a. collect now, figure
out later

© 2018 data Artisans6
Batch Processing Technologies Supported by Flink
DataSet
API

© 2018 data Artisans7
Observation 1
The origin of data are streams

© 2018 data Artisans8
Stream Processing
we can build applications directly
on data streams

© 2018 data Artisans9
Stream Processing Technologies Supported by Flink
DataStream
API

© 2018 data Artisans10
Observation 2
Stream Processing changes the database-centric
architecture

© 2018 data Artisans11
Changing the Two-Tier Architecture
reads/writes across
tier boundary
asynchronous writes
of large blobs
all modifications
are local
Classic tiered architecture Streaming architectureClassic tiered architecture
database
layer
compute
layer
application working state
+ historic state
compute
+
stream storage
and
snapshot storage
(backup)
application state
Streaming architecture

© 2018 data Artisans12
Keystone Routing Pipeline at Netflix
(as presented at Flink Forward San Francisco, 2018)
@
 Athena X
 SQL to define metrics
 Thresholds and actions to trigger
 Blends analytics and
actions
Streams from
Hadoop, Kafka, etc
SQL, thresholds,
actions
Analytics
Alerts
Derived streams

© 2018 data Artisans13
Observation 3
Stream Processing is about building applications,
not platforms

© 2018 data Artisans14
Internal streaming data platforms
built with Apache Flink

© 2018 data Artisans15
KubernetesResource Manager
Logging
Metrics
CI / CD
Application Platforms
deploying new
applications
scaling
applications
Kubernetes

© 2018 data Artisans16
Kubernetes
Database
Kubernetes
• Example: Scaling down a replicated database
• 3 replicas, 4 node scale down
need to move or
reorganize data
before container
shutdown
Kubernetes & stateful applications What about stateful containers?

© 2018 data Artisans17
• consistent stateful upgrades
‒application evolution and bug fixes
• migration of application state
‒cluster migration, A/B testing
• re-processing and reinstatement
‒fix corrupt results, bootstrap new applications
• state evolution (schema evolution)
A B
Stateful Questions
Container-based
Resource Orchestration
Stateful Stream
Processing & Snapshots
Kubernetes Apache Flink
Container-based
platform for stateful
data-driven applications
dA Platform
Code, Resource, Config, and
Snapshot Management
Application
Manager

© 2018 data Artisans18
Architecture
Apache Flink
Stateful stream processing
Kubernetes
Container platform
Logging
Metrics
dA Application
Manager
Application
lifecycle
management
Storage
In Action
App
Manager
Kubernetes
Resource
Allocation
Job Control
Snapshot
Management
CI/CDWeb
interface

© 2018 data Artisans19
Powered by Apache Flink

© 2018 data Artisans20
Free Trial Download of data Artisans Platform
data-artisans.com/download

THANK YOU! WE ARE HIRING
data-artisans.com/careers
@aljoscha
@dataArtisans
@ApacheFlink

This document provides an introduction to Apache Flink. It begins with an overview of the presenters and structure of the presentation. It then discusses Flink's APIs, architecture, and execution model. Key concepts are explained like streaming vs batch processing, scaling, the job manager and task managers. It provides a demo of Flink's DataSet API for batch processing and explains a WordCount example program. The goal is to get attendees started with Apache Flink.

What Is Apache Spark? | Introduction To Apache Spark | Apache Spark Tutorial ...Simplilearn

This presentation about Apache Spark covers all the basics that a beginner needs to know to get started with Spark. It covers the history of Apache Spark, what is Spark, the difference between Hadoop and Spark. You will learn the different components in Spark, and how Spark works with the help of architecture. You will understand the different cluster managers on which Spark can run. Finally, you will see the various applications of Spark and a use case on Conviva. Now, let's get started with what is Apache Spark. Below topics are explained in this Spark presentation: 1. History of Spark 2. What is Spark 3. Hadoop vs Spark 4. Components of Apache Spark 5. Spark architecture 6. Applications of Spark 7. Spark usecase What is this Big Data Hadoop training course about? The Big Data Hadoop and Spark developer course have been designed to impart an in-depth knowledge of Big Data processing using Hadoop and Spark. The course is packed with real-life projects and case studies to be executed in the CloudLab. What are the course objectives? Simplilearn’s Apache Spark and Scala certification training are designed to: 1. Advance your expertise in the Big Data Hadoop Ecosystem 2. Help you master essential Apache and Spark skills, such as Spark Streaming, Spark SQL, machine learning programming, GraphX programming and Shell Scripting Spark 3. Help you land a Hadoop developer job requiring Apache Spark expertise by giving you a real-life industry project coupled with 30 demos What skills will you learn? By completing this Apache Spark and Scala course you will be able to: 1. Understand the limitations of MapReduce and the role of Spark in overcoming these limitations 2. Understand the fundamentals of the Scala programming language and its features 3. Explain and master the process of installing Spark as a standalone cluster 4. Develop expertise in using Resilient Distributed Datasets (RDD) for creating applications in Spark 5. Master Structured Query Language (SQL) using SparkSQL 6. Gain a thorough understanding of Spark streaming features 7. Master and describe the features of Spark ML programming and GraphX programming Who should take this Scala course? 1. Professionals aspiring for a career in the field of real-time big data analytics 2. Analytics professionals 3. Research professionals 4. IT developers and testers 5. Data scientists 6. BI and reporting professionals 7. Students who wish to gain a thorough understanding of Apache Spark Learn more at https://www.simplilearn.com/big-data-and-analytics/apache-spark-scala-certification-training

Plasmapheresis in ICUMuhammad Asim Rana

Plasmapheresis is a medical procedure that involves the separation and removal of plasma from whole blood. The document summarizes guidelines from the American Academy of Neurology (AAN), American Society for Apheresis (ASFA), and American Association of Blood Banks (AABB) on the use of plasmapheresis to treat various medical conditions. The guidelines categorize conditions into four categories based on the evidence for the efficacy of plasmapheresis as a treatment. Category I conditions have the strongest evidence that plasmapheresis is an effective first-line therapy. This includes Guillain-Barré syndrome, chronic inflammatory demyelinating polyneuropathy, and thrombotic thrombocytopenic purp

Đề tài: Nghiên cứu thuật toán K-nearest neighbor, HAY, 9đDịch vụ viết bài trọn gói ZALO 0917193864

Autoscaling Flink with Reactive ModeFlink Forward

Flink Forward San Francisco 2022. Resource Elasticity is a frequently requested feature in Apache Flink: Users want to be able to easily adjust their clusters to changing workloads for resource efficiency and cost saving reasons. In Flink 1.13, the initial implementation of Reactive Mode was introduced, later releases added more improvements to make the feature production ready. In this talk, we’ll explain scenarios to deploy Reactive Mode to various environments to achieve autoscaling and resource elasticity. We’ll discuss the constraints to consider when planning to use this feature, and also potential improvements from the Flink roadmap. For those interested in the internals of Flink, we’ll also briefly explain how the feature is implemented, and if time permits, conclude with a short demo. by Robert Metzger

final report.pdfGouravSharmaAmbah

This document describes a movie recommendation system project submitted for a bachelor's degree. It includes declarations by the students, certificates, acknowledgments, and an abstract. The methodology section explains that the project uses a content-based filtering approach to recommend the top 5 most similar movies to users based on movies they search for, in order to save users time. It analyzes movie data to build a machine learning model for providing personalized movie recommendations.

Apache Spark - Basics of RDD | Big Data Hadoop Spark Tutorial | CloudxLabCloudxLab

Big Data with Hadoop & Spark Training: http://bit.ly/2L4rPmM This CloudxLab Basics of RDD tutorial helps you to understand Basics of RDD in detail. Below are the topics covered in this tutorial: 1) What is RDD - Resilient Distributed Datasets 2) Creating RDD in Scala 3) RDD Operations - Transformations & Actions 4) RDD Transformations - map() & filter() 5) RDD Actions - take() & saveAsTextFile() 6) Lazy Evaluation & Instant Evaluation 7) Lineage Graph 8) flatMap and Union 9) Scala Transformations - Union 10) Scala Actions - saveAsTextFile(), collect(), take() and count() 11) More Actions - reduce() 12) Can We Use reduce() for Computing Average? 13) Solving Problems with Spark 14) Compute Average and Standard Deviation with Spark 15) Pick Random Samples From a Dataset using Spark

Hadoop OozieMadhur Nawandar

Oozie is a workflow scheduler system for Apache Hadoop that allows scheduling Hadoop jobs such as MapReduce, Pig, Hive, Sqoop, and DistCp jobs. It consists of a workflow engine that defines and runs workflows as directed acyclic graphs (DAGs) of Hadoop jobs, and a coordinator engine that runs workflows based on schedules and data availability. Oozie features include scaling to manage thousands of workflows, rerunning failed workflows, and submitting workflow definitions for immediate or later execution from clients to the Oozie server.

Introduction to Apache Flink - Fast and reliable big data processingTill Rohrmann

This presentation introduces Apache Flink, a massively parallel data processing engine which currently undergoes the incubation process at the Apache Software Foundation. Flink's programming primitives are presented and it is shown how easily a distributed PageRank algorithm can be implemented with Flink. Intriguing features such as dedicated memory management, Hadoop compatibility, streaming and automatic optimisation make it an unique system in the world of Big Data processing.

Apache flinkAhmed Nader

Apache Flink is an open source platform for distributed stream and batch data processing. It provides two APIs - a DataStream API for real-time streaming and a DataSet API for batch processing. The document introduces Flink's core concepts like sources, sinks, transformations, and windows. It also provides instructions on setting up a Flink project and describes some use cases like processing Twitter feeds. Additional resources like tutorials, documentation and mailing lists are referenced to help users get started with Flink.

Introduction to Apache Flinkdatamantra

This document provides an overview and introduction to Apache Flink, a stream-based big data processing engine. It discusses the evolution of big data frameworks to platforms and the shortcomings of Spark's RDD abstraction for streaming workloads. The document then introduces Flink, covering its history, key differences from Spark like its use of streaming as the core abstraction, and examples of using Flink for batch and stream processing.

Apache Kafka Best PracticesDataWorks Summit/Hadoop Summit

Apache Kafka becoming the message bus to transfer huge volumes of data from various sources into Hadoop. It's also enabling many real-time system frameworks and use cases. Managing and building clients around Apache Kafka can be challenging. In this talk, we will go through the best practices in deploying Apache Kafka in production. How to Secure a Kafka Cluster, How to pick topic-partitions and upgrading to newer versions. Migrating to new Kafka Producer and Consumer API. Also talk about the best practices involved in running a producer/consumer. In Kafka 0.9 release, we’ve added SSL wire encryption, SASL/Kerberos for user authentication, and pluggable authorization. Now Kafka allows authentication of users, access control on who can read and write to a Kafka topic. Apache Ranger also uses pluggable authorization mechanism to centralize security for Kafka and other Hadoop ecosystem projects. We will showcase open sourced Kafka REST API and an Admin UI that will help users in creating topics, re-assign partitions, Issuing Kafka ACLs and monitoring Consumer offsets.

Apache NiFi in the Hadoop Ecosystem DataWorks Summit/Hadoop Summit

The document discusses Apache NiFi and its role in the Hadoop ecosystem. It provides an overview of NiFi, describes how it can be used to integrate with Hadoop components like HDFS, HBase, and Kafka. It also discusses how NiFi supports stream processing integrations and outlines some use cases. The document concludes by discussing future work, including improving NiFi's high availability, multi-tenancy, and expanding its ecosystem integrations.

Unified Stream and Batch Processing with Apache FlinkDataWorks Summit/Hadoop Summit

The document discusses Apache Flink, an open source stream processing framework. It provides high throughput and low latency processing of both streaming and batch data. Flink allows for explicit handling of event time, stateful stream processing with exactly-once semantics, and high performance. It also supports features like windowing, sessionization, and complex event processing that are useful for building streaming applications.

Flink vs. SparkSlim Baltagi

Kafka Streams State Stores Being Persistentconfluent

Kafka Streams vs. KSQL for Stream Processing on top of Apache KafkaKai Wähner

Spoilt for Choice – Kafka Streams vs. KSQL for Stream Processing on top of Apache Kafka: Apache Kafka is a de facto standard streaming data processing platform. It is widely deployed as event streaming platform. Part of Kafka is its stream processing API “Kafka Streams”. In addition, the Kafka ecosystem now offers KSQL, a declarative, SQL-like stream processing language that lets you define powerful stream-processing applications easily. What once took some moderately sophisticated Java code can now be done at the command line with a familiar and eminently approachable syntax. This session discusses and demos the pros and cons of Kafka Streams and KSQL to understand when to use which stream processing alternative for continuous stream processing natively on Apache Kafka infrastructures. The end of the session compares the trade-offs of Kafka Streams and KSQL to separate stream processing frameworks such as Apache Flink or Spark Streaming.

Flink Forward San Francisco 2019: Moving from Lambda and Kappa Architectures ...Flink Forward

Moving from Lambda and Kappa Architectures to Kappa+ at Uber Kappa+ is a new approach developed at Uber to overcome the limitations of the Lambda and Kappa architectures. Whether your realtime infrastructure processes data at Uber scale (well over a trillion messages daily) or only a fraction of that, chances are you will need to reprocess old data at some point. There can be many reasons for this. Perhaps a bug fix in the realtime code needs to be retroactively applied (aka backfill), or there is a need to train realtime machine learning models on last few months of data before bringing the models online. Kafka's data retention is limited in practice and generally insufficient for such needs. So data must be processed from archives. Aside from addressing such situations, enabling efficient stream processing on archived as well as realtime data also broadens the applicability of stream processing. This talk introduces the Kappa+ architecture which enables the reuse of streaming realtime logic (stateful and stateless) to efficiently process any amounts of historic data without requiring it to be in Kafka. We shall discuss the complexities involved in such kind of processing and the specific techniques employed in Kappa+ to tackle them.

kafkaAmikam Snir

Kafka is an open-source distributed commit log service that provides high-throughput messaging functionality. It is designed to handle large volumes of data and different use cases like online and offline processing more efficiently than alternatives like RabbitMQ. Kafka works by partitioning topics into segments spread across clusters of machines, and replicates across these partitions for fault tolerance. It can be used as a central data hub or pipeline for collecting, transforming, and streaming data between systems and applications.

Apache Flink internalsKostas Tzoumas

This document provides an overview of Apache Flink internals. It begins with an introduction and recap of Flink programming concepts. It then discusses how Flink programs are compiled into execution plans and executed in a pipelined fashion, as opposed to being executed eagerly like regular code. The document outlines Flink's architecture including the optimizer, runtime environment, and data storage integrations. It also covers iterative processing and how Flink handles iterations both by unrolling loops and with native iterative datasets.

Apache Kafka Fundamentals for Architects, Admins and Developersconfluent

This document summarizes a presentation about Apache Kafka. It introduces Apache Kafka as a modern, distributed platform for data streams made up of distributed, immutable, append-only commit logs. It describes Kafka's scalability similar to a filesystem and guarantees similar to a database, with the ability to rewind and replay data. The document discusses Kafka topics and partitions, partition leadership and replication, and provides resources for further information.

Evening out the uneven: dealing with skew in FlinkFlink Forward

Flink Forward San Francisco 2022. When running Flink jobs, skew is a common problem that results in wasted resources and limited scalability. In the past years, we have helped our customers and users solve various skew-related issues in their Flink jobs or clusters. In this talk, we will present the different types of skew that users often run into: data skew, key skew, event time skew, state skew, and scheduling skew, and discuss solutions for each of them. We hope this will serve as a guideline to help you reduce skew in your Flink environment. by Jun Qin & Karl Friedrich

Introduction to Apache KafkaJeff Holoman

The document provides an introduction and overview of Apache Kafka presented by Jeff Holoman. It begins with an agenda and background on the presenter. It then covers basic Kafka concepts like topics, partitions, producers, consumers and consumer groups. It discusses efficiency and delivery guarantees. Finally, it presents some use cases for Kafka and positioning around when it may or may not be a good fit compared to other technologies.

Real-time Analytics with Trino and Apache PinotXiang Fu

Exactly-Once Financial Data Processing at Scale with Flink and PinotFlink Forward

Flink Forward San Francisco 2022. At Stripe we have created a complete end to end exactly-once processing pipeline to process financial data at scale, by combining the exactly-once power from Flink, Kafka, and Pinot together. The pipeline provides exactly-once guarantee, end-to-end latency within a minute, deduplication against hundreds of billions of keys, and sub-second query latency against the whole dataset with trillion level rows. In this session we will discuss the technical challenges of designing, optimizing, and operating the whole pipeline, including Flink, Kafka, and Pinot. We will also share our lessons learned and the benefits gained from exactly-once processing. by Xiang Zhang & Pratyush Sharma & Xiaoman Dong

Apache Kafka Architecture & Fundamentals Explainedconfluent

Watch this talk here: https://www.confluent.io/online-talks/apache-kafka-architecture-and-fundamentals-explained-on-demand This session explains Apache Kafka’s internal design and architecture. Companies like LinkedIn are now sending more than 1 trillion messages per day to Apache Kafka. Learn about the underlying design in Kafka that leads to such high throughput. This talk provides a comprehensive overview of Kafka architecture and internal functions, including: -Topics, partitions and segments -The commit log and streams -Brokers and broker replication -Producer basics -Consumers, consumer groups and offsets This session is part 2 of 4 in our Fundamentals for Apache Kafka series.

Tame the small files problem and optimize data layout for streaming ingestion...Flink Forward

Flink Forward San Francisco 2022. In modern data platform architectures, stream processing engines such as Apache Flink are used to ingest continuous streams of data into data lakes such as Apache Iceberg. Streaming ingestion to iceberg tables can suffer by two problems (1) small files problem that can hurt read performance (2) poor data clustering that can make file pruning less effective. To address those two problems, we propose adding a shuffling stage to the Flink Iceberg streaming writer. The shuffling stage can intelligently group data via bin packing or range partition. This can reduce the number of concurrent files that every task writes. It can also improve data clustering. In this talk, we will explain the motivations in details and dive into the design of the shuffling stage. We will also share the evaluation results that demonstrate the effectiveness of smart shuffling. by Gang Ye & Steven Wu

Spark architectureGauravBiswas9

The document discusses Apache Spark, an open source cluster computing framework for real-time data processing. It notes that Spark is up to 100 times faster than Hadoop for in-memory processing and 10 times faster on disk. The main feature of Spark is its in-memory cluster computing capability, which increases processing speeds. Spark runs on a driver-executor model and uses resilient distributed datasets and directed acyclic graphs to process data in parallel across a cluster.

The Past, Present, and Future of Apache Flink®Aljoscha Krettek

Flink has evolved from a batch processor to a unified stream and batch processing framework. It now supports event-time processing, state, and low-level streaming with ProcessFunction. Looking ahead, Flink aims to improve elasticity, fault tolerance, SQL support, and handling large state through incremental snapshots. It also plans to offer more control over resource allocation and scaling through both active and reactive modes.

(Past), Present, and Future of Apache FlinkAljoscha Krettek

This document discusses the past, present, and future of Apache Flink. It describes how Flink enables stateful computations over data streams, as well as batch and stream processing. New features in Flink 1.5 include improved integration with resource managers, localized failure recovery, and a 50% rewritten network stack. Upcoming features in Flink 1.6 involve autoscaling, hot-standby replication for high availability, and zero-downtime upgrades. The document concludes that Flink is already the best open-source stream processing system and more exciting features are planned for the future.

More Related Content

What's hot (20)

Introduction to Apache Flink - Fast and reliable big data processingTill Rohrmann

Apache flinkAhmed Nader

Introduction to Apache Flinkdatamantra

Apache Kafka Best PracticesDataWorks Summit/Hadoop Summit

Apache NiFi in the Hadoop Ecosystem DataWorks Summit/Hadoop Summit

Unified Stream and Batch Processing with Apache FlinkDataWorks Summit/Hadoop Summit

Flink vs. SparkSlim Baltagi

Kafka Streams State Stores Being Persistentconfluent

Kafka Streams vs. KSQL for Stream Processing on top of Apache KafkaKai Wähner

Flink Forward San Francisco 2019: Moving from Lambda and Kappa Architectures ...Flink Forward

kafkaAmikam Snir

Apache Flink internalsKostas Tzoumas

Apache Kafka Fundamentals for Architects, Admins and Developersconfluent

Evening out the uneven: dealing with skew in FlinkFlink Forward

Introduction to Apache KafkaJeff Holoman

Real-time Analytics with Trino and Apache PinotXiang Fu

Exactly-Once Financial Data Processing at Scale with Flink and PinotFlink Forward

Apache Kafka Architecture & Fundamentals Explainedconfluent

Tame the small files problem and optimize data layout for streaming ingestion...Flink Forward

Spark architectureGauravBiswas9

Introduction to Apache Flink - Fast and reliable big data processingTill Rohrmann

Apache flinkAhmed Nader

Introduction to Apache Flinkdatamantra

Apache Kafka Best PracticesDataWorks Summit/Hadoop Summit

Apache NiFi in the Hadoop Ecosystem DataWorks Summit/Hadoop Summit

Unified Stream and Batch Processing with Apache FlinkDataWorks Summit/Hadoop Summit

Flink vs. SparkSlim Baltagi

Kafka Streams State Stores Being Persistentconfluent

Kafka Streams vs. KSQL for Stream Processing on top of Apache KafkaKai Wähner

Flink Forward San Francisco 2019: Moving from Lambda and Kappa Architectures ...Flink Forward

kafkaAmikam Snir

Apache Flink internalsKostas Tzoumas

Apache Kafka Fundamentals for Architects, Admins and Developersconfluent

Evening out the uneven: dealing with skew in FlinkFlink Forward

Introduction to Apache KafkaJeff Holoman

Real-time Analytics with Trino and Apache PinotXiang Fu

Exactly-Once Financial Data Processing at Scale with Flink and PinotFlink Forward

Apache Kafka Architecture & Fundamentals Explainedconfluent

Tame the small files problem and optimize data layout for streaming ingestion...Flink Forward

Spark architectureGauravBiswas9

Similar to Apache Flink and what it is used for (20)

The Past, Present, and Future of Apache Flink®Aljoscha Krettek

(Past), Present, and Future of Apache FlinkAljoscha Krettek

Flink Forward San Francisco 2018: Robert Metzger & Patrick Lucas - "dA Platfo...Flink Forward

The document discusses dA Platform, a stream processing solution built on Apache Flink and Kubernetes. It addresses the need for streaming platforms, provides tools for stream processing out of the box, and enables operations for stateful streaming applications on stateless containers through Flink on Kubernetes. It describes the declarative specification and control of Flink deployments, managing stateful streaming applications and state, and an application manager for the declarative lifecycle management of streaming jobs. The architecture runs Flink on Kubernetes with components for metrics, logging and application management. The platform aims to simplify stream processing with upgrades, configuration changes, and state migrations.

dA Platform OverviewRobert Metzger

dA Platform is a production-ready platform for stream processing with Apache Flink®. The Platform includes open source Apache Flink, a stateful stream processing and event-driven application framework, and dA Application Manager, a central deployment and management component. dA Platform schedules clusters on Kubernetes, deploys stateful Flink applications, and controls these applications and their state.

The Past, Present, and Future of Apache FlinkAljoscha Krettek

Stream processing still evolves and changes at a speed that can make it hard to keep up with the developments. Being at the forefront of stream processing technology, the evolution of Apache Flink has mirrored many of these developments and continues to do so. We will take you on a journey through the major milestones of stream processing technology in past years, diving into the latest additions that Apache Flink and other communities introduced to the stream processing landscape, such as Streamng SQL, Time Versioned Tables, cluster-library-duality, language portability, etc. We will take a sneak peek into our crystal ball and present in what the Flink community is working on next.

Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...Flink Forward

Leveraging Mainframe Data for Modern Analyticsconfluent

The document provides an overview of leveraging mainframe data for modern analytics using Attunity Replicate and Confluent streaming platform powered by Apache Kafka. It discusses the history of mainframes and data migration, how Attunity enables real-time data migration from mainframes, the Confluent streaming platform for building applications using data streams, and how Attunity and Confluent can be combined to modernize analytics using mainframe data streams. Use cases discussed include query offloading and cross-system customer data integration.

Real-time Analysis of Data Processing Pipelines with Spring Cloud Data Flow a...VMware Tanzu

Stream processing for the practitioner: Blueprints for common stream processi...Aljoscha Krettek

Aljoscha Krettek offers an overview of the modern stream processing space, details the challenges posed by stateful and event-time-aware stream processing, and shares core archetypes ("application blueprints”) for stream processing drawn from real-world use cases with Apache Flink. Topics include: * Aggregating IoT event data, in which event-time-aware processing, handling of late data, and state are important * Data enrichment, in which a stream of real-time events is “enriched” with data from a slowly changing database of supplemental data points * Dynamic stream processing, in which a stream of control messages and dynamically updated user logic is used to process a stream of events for use cases such as alerting and fraud detection

Big Data LDN 2018: STREAM PROCESSING TAKES ON EVERYTHINGMatt Stubbs

Date: 14th November 2018 Location: Fast Data Theatre Time: 12:30 - 13:00 Speaker: Konstantin Knauf Organisation: Data Artisans About: In this session we will discuss how stream processing is evolving from a technology in the sidelines of Big Data to a technology that covers real-time computations, ACID transactions on event data, and also completely subsume batch processing through the work that data Artisans and other prominent members of the Flink community have been reporting on. In addition, we will discuss how stream processing is transforming businesses to adopt a more customer-oriented, real-time, and data-driven mindset resulting in realized business transformations

Streaming in the Wild with Apache FlinkKostas Tzoumas

This talk is an application-driven walkthrough to modern stream processing, exemplified by Apache Flink, and how this enables new applications and makes old applications easier and more efficient. In this talk, we will walk through several real-world stream processing application scenarios of Apache Flink, highlighting unique features in Flink that make these applications possible. In particular, we will see (1) how support for handling out of order streams enables real-time monitoring of cloud infrastructure, (2) how the ability handle high-volume data streams with low latency SLAs enables real-time alerts in network equipment, (3) how the combination of high throughput and the ability to handle batch as a special case of streaming enables an architecture where the same exact program is used for real-time and historical data processing, and (4) how stateful stream processing can enable an architecture that eliminates the need for an external database store, leading to more than 100x performance speedup, among many other benefits.

Confluent kafka meetupseattle jan2017Nitin Kumar

This document provides an overview of the Confluent streaming platform and Apache Kafka. It discusses how streaming platforms can be used to publish, subscribe and process streams of data in real-time. It also highlights challenges with traditional architectures and how the Confluent platform addresses them by allowing data to be ingested from many sources and processed using stream processing APIs. The document also summarizes key components of the Confluent platform like Kafka Connect for streaming data between systems, the Schema Registry for ensuring compatibility, and Control Center for monitoring the platform.

Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next LevelHortonworks

Overview of Apache Fink: the 4 G of Big Data Analytics FrameworksSlim Baltagi

Slides of my talk at the Hadoop Summit Europe in Dublin, Ireland on April 13th, 2016. The talk introduces Apache Flink as both a multi-purpose Big Data analytics framework and real-world streaming analytics framework. It is focusing on Flink's key differentiators and suitability for streaming analytics use cases. It also shows how Flink enables novel use cases such as distributed CEP (Complex Event Processing) and querying the state by behaving like a key value data store.

Overview of Apache Flink: the 4G of Big Data Analytics FrameworksDataWorks Summit/Hadoop Summit

This document provides an overview of Apache Flink and discusses why it is suitable for real-world streaming analytics. The document contains an agenda that covers how Flink is a multi-purpose big data analytics framework, why streaming analytics are emerging, why Flink is suitable for real-world streaming analytics, novel use cases enabled by Flink, who is using Flink, and where to go from here. Key points include Flink innovations like custom memory management, its DataSet API, rich windowing semantics, and native iterative processing. Flink's streaming features that make it suitable for real-world use include its pipelined processing engine, stream abstraction, performance, windowing support, fault tolerance, and integration with Hadoop.

Overview of Apache Fink: The 4G of Big Data Analytics FrameworksSlim Baltagi

Apache Flink: Real-World Use Cases for Streaming AnalyticsSlim Baltagi

This face to face talk about Apache Flink in Sao Paulo, Brazil is the first event of its kind in Latin America! It explains how Apache Flink 1.0 announced on March 8th, 2016 by the Apache Software Foundation (link), marks a new era of Big Data analytics and in particular Real-Time streaming analytics. The talk maps Flink's capabilities to real-world use cases that span multiples verticals such as: Financial Services, Healthcare, Advertisement, Oil and Gas, Retail and Telecommunications. In this talk, you learn more about: 1. What is Apache Flink Stack? 2. Batch vs. Streaming Analytics 3. Key Differentiators of Apache Flink for Streaming Analytics 4. Real-World Use Cases with Flink for Streaming Analytics 5. Who is using Flink? 6. Where do you go from here?

Cloud-Native Patterns for Data-Intensive ApplicationsVMware Tanzu

Are you interested in learning how to schedule batch jobs in container runtimes? Maybe you’re wondering how to apply continuous delivery in practice for data-intensive applications? Perhaps you’re looking for an orchestration tool for data pipelines? Questions like these are common, so rest assured that you’re not alone. In this webinar, we’ll cover the recent feature improvements in Spring Cloud Data Flow. More specifically, we’ll discuss data processing use cases and how they simplify the overall orchestration experience in cloud runtimes like Cloud Foundry and Kubernetes. Please join us and be part of the community discussion! Presenters : Sabby Anandan, Product Manager Mark Pollack, Software Engineer, Pivotal

xGem Data Stream ProcessingJorge Hirtz

This document provides an overview of data stream processing. It discusses what streaming data is and examples like IoT sensors, social media, and website monitoring. It also outlines the typical components of a streaming data pipeline including collecting and ingesting data from various sources, processing the data in real-time, storing the processed data, and serving it for analytics, search, and dashboards. Key streaming technologies mentioned include Apache Kafka, Apache NiFi, and various stream processing frameworks. It also introduces Stishovite as a console for managing an entire streaming data platform built from open source components.

Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...Flink Forward

This document discusses a new technology called Streaming Ledger that provides ACID transaction guarantees for streaming data. Streaming Ledger allows applications to read and modify multiple data rows/keys within a transaction, sharing state between streams. It uses logical clocks to define a conflict-free processing schedule and handles key contention well. Streaming Ledger is built on Apache Flink and provides a new capability beyond Flink's existing exactly-once processing of single keys.

The Past, Present, and Future of Apache Flink®Aljoscha Krettek

(Past), Present, and Future of Apache FlinkAljoscha Krettek

Flink Forward San Francisco 2018: Robert Metzger & Patrick Lucas - "dA Platfo...Flink Forward

dA Platform OverviewRobert Metzger

The Past, Present, and Future of Apache FlinkAljoscha Krettek

Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...Flink Forward

Leveraging Mainframe Data for Modern Analyticsconfluent

Real-time Analysis of Data Processing Pipelines with Spring Cloud Data Flow a...VMware Tanzu

Stream processing for the practitioner: Blueprints for common stream processi...Aljoscha Krettek

Big Data LDN 2018: STREAM PROCESSING TAKES ON EVERYTHINGMatt Stubbs

Streaming in the Wild with Apache FlinkKostas Tzoumas

Confluent kafka meetupseattle jan2017Nitin Kumar

Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next LevelHortonworks

Overview of Apache Fink: the 4 G of Big Data Analytics FrameworksSlim Baltagi

Overview of Apache Flink: the 4G of Big Data Analytics FrameworksDataWorks Summit/Hadoop Summit

Overview of Apache Fink: The 4G of Big Data Analytics FrameworksSlim Baltagi

Apache Flink: Real-World Use Cases for Streaming AnalyticsSlim Baltagi

Cloud-Native Patterns for Data-Intensive ApplicationsVMware Tanzu

xGem Data Stream ProcessingJorge Hirtz

Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...Flink Forward

More from Aljoscha Krettek (12)

Apache Flink(tm) - A Next-Generation Stream ProcessorAljoscha Krettek

In diesem Vortrag wird es zunächst einen kurzen Überblick über den aktuellen Stand im Bereich der Streaming-Datenanalyse geben. Danach wird es mit einer kleinen Einführung in das Apache-Flink-System zur Echtzeit-Datenanalyse weitergehen, bevor wir tiefer in einige der interessanten Eigenschaften eintauchen werden, die Flink von den anderen Spielern in diesem Bereich unterscheidet. Dazu werden wir beispielhafte Anwendungsfälle betrachten, die entweder direkt von Nutzern stammen oder auf unserer Erfahrung mit Nutzern basieren. Spezielle Eigenschaften, die wir betrachten werden, sind beispielsweise die Unterstützung für die Zerlegung von Events in einzelnen Sessions basierend auf der Zeit, zu der ein Ereignis passierte (event-time), Bestimmung von Zeitpunkten zum jeweiligen Speichern des Zustands eines Streaming-Programms für spätere Neustarts, die effiziente Abwicklung bei sehr großen zustandsorientierten Streaming-Berechnungen und die Zugänglichkeit des Zustandes von außerhalb.

Talk Python To Me: Stream Processing in your favourite Language with Beam on ...Aljoscha Krettek

Flink is a great stream processor, Python is a great programming language, Apache Beam is a great programming model and portability layer. Using all three together is a great idea! We will demo and discuss writing Beam Python pipelines and running them on Flink. We will cover Beam's portability vision that led here, what you need to know about how Beam Python pipelines are executed on Flink, and where Beam's portability framework is headed next (hint: Python pipelines reading from non-Python connectors)

The Evolution of (Open Source) Data ProcessingAljoscha Krettek

Beginning with MapReduce and its first popular open-source implementation in Apache Hadoop the data processing landscape has evolved quite a bit. Since then we have seen several paradigm shifts and open-source systems evolved to support new types of applications and to attract new audiences. We will follow developments using the example of the open-source stream processing system Apache Flink and in the end we will see how expressive APIs, support for event-driven applications, Flink SQL for seamless batch and stream processing, and a powerful runtime enable a wide range of applications.

Python Streaming Pipelines with Beam on FlinkAljoscha Krettek

Python is popular amongst data scientists and engineers for data processing tasks. The big data ecosystem has traditionally been rather JVM centric. Often Java (or Scala) are the only viable option to implement data processing pipelines. That sometimes poses an adoption barrier for organizations that have already invested in other language ecosystems. The Apache Beam project provides a unified programming model for data processing and its ongoing portability effort aims to enable multiple language SDKs (currently Java, Python and Go) on a common set of runners. The combination of Python streaming on the Apache Flink runner is one example. Let’s take a look how the Flink runner translates the Beam model into the native DataStream (or DataSet) API, how the runner is changing to support portable pipelines, how Python user code execution is coordinated with gRPC based services and how a sample pipeline runs on Flink.

Robust stream processing with Apache FlinkAljoscha Krettek

Aljoscha Krettek offers a very short introduction to stream processing before diving into writing code and demonstrating the features in Apache Flink that make truly robust stream processing possible, with a focus on correctness and robustness in stream processing. All of this will be done in the context of a real-time analytics application that we’ll be modifying on the fly based on the topics we’re working though, as Aljoscha exercises Flink’s unique features, demonstrates fault recovery, clearly explains why event time is such an important concept in robust, stateful stream processing, and covers the features you need in a stream processor to do robust, stateful stream processing in production. We’ll also use a real-time analytics dashboard to visualize the results we’re computing in real time, allowing us to easily see the effects of the code we’re developing as we go along. Topics include: * Apache Flink * Stateful stream processing * Event time versus processing time * Fault tolerance * State management in the face of faults * Savepoints * Data reprocessing

Unified stateful big data processing in Apache Beam (incubating)Aljoscha Krettek

Apache Beam lets you process unbounded, out-of-order, global-scale data with portable high-level pipelines, but not all use cases are pipelines of simple “map” and “combine” operations. Aljoscha Krettek introduces Beam’s new State API, which brings scalability and consistency to fine-grained stateful processing while interoperating with Beam’s other features such as consistent event-time windowing and windowed side inputs—all while remaining portable to any Beam runner, including Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Aljoscha covers the new state and timer features in Beam and shows how to use them to express common real-world use cases in a backend-agnostic manner. Examples of new use cases unlocked by Beam’s new mutable state and timers include: * Microservice-like streaming applications such as new user account verification and digital ordering * Complex aggregations that cannot easily be expressed as an efficient associative combiner * Output based on customized conditions, such as limiting to only “significant” changes in a learned model (resulting in potentially large cost savings in subsequent processing) * Fine control over retrieval and storage of intermediate values during aggregation * Reading from and writing to external systems with detailed management of the nature and size of requests

Advanced Flink Training - Design patterns for streaming applicationsAljoscha Krettek

The document describes requirements for a platform to detect suspicious behavior in an organization. It involves three patterns: 1) Time-based aggregations to detect behaviors like many login failures within a short time. Windowing and aggregating events is needed. 2) Data enrichment to report details of alerts, like fetching user profiles to identify users. Side inputs allow querying external databases during event processing. 3) Dynamic processing since rules change over time. Broadcast state stores evolving rules and connects them to user event streams for continuous checking.

Apache Flink - A Stream Processing EngineAljoscha Krettek

Apache Flink is a distributed stream processing engine that allows for stateful stream processing. It provides scalable embedded state that can access data at memory speed and scales with parallel operators. Flink also enables restoring state to different programs for bugfixes, upgrades, A/B testing, and reprocessing data streams from any point by reloading state and resetting positions in input streams.

Adventures in Timespace - How Apache Flink Handles Time and WindowsAljoscha Krettek

If you are in the business of processing a stream of events you sooner or later come upon different notions of time. There is processing time, the current time of the machine your program is running on and event time, the local time at which an event occurred. In this talk we will look at why this distinction is relevant and also how Flink manages to work with these different ideas of time. We will look at how Flink tracks the progress of time and how you can employ windows to perform aggregating operations on an infinite stream of events.

Flink 0.10 - Upcoming FeaturesAljoscha Krettek

The upcoming Apache Flink 0.10 release will include features such as high availability of the JobManager through Zookeeper, live monitoring of accumulators and metrics, improved event-time and windowing capabilities using watermarks, and exactly-once fault tolerance through distributed snapshots. A demo will also show how fault tolerance works to ensure state consistency during failures. More improvements are still being worked on for this release.

Data Analysis with Apache Flink (Hadoop Summit, 2015)Aljoscha Krettek

Apache Flink Hands-OnAljoscha Krettek

Apache Flink(tm) - A Next-Generation Stream ProcessorAljoscha Krettek

Talk Python To Me: Stream Processing in your favourite Language with Beam on ...Aljoscha Krettek

The Evolution of (Open Source) Data ProcessingAljoscha Krettek

Python Streaming Pipelines with Beam on FlinkAljoscha Krettek

Robust stream processing with Apache FlinkAljoscha Krettek

Unified stateful big data processing in Apache Beam (incubating)Aljoscha Krettek

Advanced Flink Training - Design patterns for streaming applicationsAljoscha Krettek

Apache Flink - A Stream Processing EngineAljoscha Krettek

Adventures in Timespace - How Apache Flink Handles Time and WindowsAljoscha Krettek

Flink 0.10 - Upcoming FeaturesAljoscha Krettek

Data Analysis with Apache Flink (Hadoop Summit, 2015)Aljoscha Krettek

Apache Flink Hands-OnAljoscha Krettek

Recently uploaded (20)

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john