Apache Spark Introduction
Download as pptx, pdf0 likes250 views
This document summarizes a Spark conference in Taiwan in 2016. It provides an overview of Spark including its key features like being fast, easy to use, general purpose, scalable and fault tolerant. It then discusses Spark core concepts like RDDs, transformations, actions, caching and provides examples. It also covers developing Spark applications using Spark shell, Zeppelin and Spark submit.
1 of 24
Download to read offline
Recommended
Dive into Spark Streaming
Dive into Spark StreamingGerard Maas The document discusses Spark Streaming and its execution model. It describes how Spark Streaming receives data streams, divides them into micro-batches, and processes the micro-batches using Spark. It also covers transformations and actions that can be performed on DStreams, window operations, and deployment options for Spark Streaming including local, standalone, and cluster modes.
Strata NYC 2015: What's new in Spark Streaming
Strata NYC 2015: What's new in Spark StreamingDatabricks Spark Streaming allows processing of live data streams at scale. Recent improvements include:
1) Enhanced fault tolerance through a write-ahead log and replay of unprocessed data on failure.
2) Dynamic backpressure to automatically adjust ingestion rates and ensure stability.
3) Visualization tools for debugging and monitoring streaming jobs.
4) Support for streaming machine learning algorithms and integration with other Spark components.
Apache Spark RDDs
Apache Spark RDDsDean Chen Spark is a general engine for large-scale data processing. It introduces Resilient Distributed Datasets (RDDs) which allow in-memory caching for fault tolerance and act like familiar Scala collections for distributed computation across clusters. RDDs provide a programming model with transformations like map and reduce and actions to compute results. Spark also supports streaming, SQL, machine learning, and graph processing workloads.
Beneath RDD in Apache Spark by Jacek Laskowski
Beneath RDD in Apache Spark by Jacek LaskowskiSpark Summit This document provides an overview of SparkContext and Resilient Distributed Datasets (RDDs) in Apache Spark. It discusses how to create RDDs using SparkContext functions like parallelize(), range(), and textFile(). It also covers DataFrames and converting between RDDs and DataFrames. The document discusses partitions and the level of parallelism in Spark, as well as the execution environment involving DAGScheduler, TaskScheduler, and SchedulerBackend. It provides examples of RDD lineage and describes Spark clusters like Spark Standalone and the Spark web UI.
Spark Summit East 2015 Advanced Devops Student Slides
Spark Summit East 2015 Advanced Devops Student SlidesDatabricks This document provides an agenda for an advanced Spark class covering topics such as RDD fundamentals, Spark runtime architecture, memory and persistence, shuffle operations, and Spark Streaming. The class will be held in March 2015 and include lectures, labs, and Q&A sessions. It notes that some slides may be skipped and asks attendees to keep Q&A low during the class, with a dedicated Q&A period at the end.
Spark & Spark Streaming Internals - Nov 15 (1)
Spark & Spark Streaming Internals - Nov 15 (1)Akhil Das This document summarizes Spark and Spark Streaming internals. It discusses the Resilient Distributed Dataset (RDD) model in Spark, which allows for fault tolerance through lineage-based recomputation. It provides an example of log mining using RDD transformations and actions. It then discusses Spark Streaming, which provides a simple API for stream processing by treating streams as series of small batch jobs on RDDs. Key concepts discussed include Discretized Stream (DStream), transformations, and output operations. An example Twitter hashtag extraction job is outlined.
Deep Dive with Spark Streaming - Tathagata Das - Spark Meetup 2013-06-17
Deep Dive with Spark Streaming - Tathagata Das - Spark Meetup 2013-06-17spark-project Slides from Tathagata Das's talk at the Spark Meetup entitled "Deep Dive with Spark Streaming" on June 17, 2013 in Sunnyvale California at Plug and Play. Tathagata Das is the lead developer on Spark Streaming and a PhD student in computer science in the UC Berkeley AMPLab.
Apache Spark - Intro to Large-scale recommendations with Apache Spark and Python
Apache Spark - Intro to Large-scale recommendations with Apache Spark and PythonChristian Perone This document provides an introduction to Apache Spark and collaborative filtering. It discusses big data and the limitations of MapReduce, then introduces Apache Spark including Resilient Distributed Datasets (RDDs), transformations, actions, and DataFrames. It also covers Spark Machine Learning (ML) libraries and algorithms such as classification, regression, clustering, and collaborative filtering.
Intro to apache spark stand ford
Intro to apache spark stand fordThu Hiền Here are the steps to complete the assignment:
1. Create RDDs to filter each file for lines containing "Spark":
val readme = sc.textFile("README.md").filter(_.contains("Spark"))
val changes = sc.textFile("CHANGES.txt").filter(_.contains("Spark"))
2. Perform WordCount on each:
val readmeCounts = readme.flatMap(_.split(" ")).map((_,1)).reduceByKey(_ + _)
val changesCounts = changes.flatMap(_.split(" ")).map((_,1)).reduceByKey(_ + _)
3. Join the two RDDs:
val joined = readmeCounts.join(changes
Apache Spark Architecture
Apache Spark ArchitectureAlexey Grishchenko This is the presentation I made on JavaDay Kiev 2015 regarding the architecture of Apache Spark. It covers the memory model, the shuffle implementations, data frames and some other high-level staff and can be used as an introduction to Apache Spark
Intro to Apache Spark
Intro to Apache SparkRobert Sanders Introduction to Apache Spark. With an emphasis on the RDD API, Spark SQL (DataFrame and Dataset API) and Spark Streaming.
Presented at the Desert Code Camp:
http://oct2016.desertcodecamp.com/sessions/all
Introduction to Spark with Scala
Introduction to Spark with ScalaHimanshu Gupta Knoldus organized a Meetup on 1 April 2015. In this Meetup, we introduced Spark with Scala. Apache Spark is a fast and general engine for large-scale data processing. Spark is used at a wide range of organizations to process large datasets.
Introduction to Spark Streaming & Apache Kafka | Big Data Hadoop Spark Tutori...
Introduction to Spark Streaming & Apache Kafka | Big Data Hadoop Spark Tutori...CloudxLab Big Data with Hadoop & Spark Training: http://bit.ly/2L6bZbn
This CloudxLab Introduction to Spark Streaming & Apache Kafka tutorial helps you to understand Spark Streaming and Kafka in detail. Below are the topics covered in this tutorial:
1) Spark Streaming - Workflow
2) Use Cases - E-commerce, Real-time Sentiment Analysis & Real-time Fraud Detection
3) Spark Streaming - DStream
4) Word Count Hands-on using Spark Streaming
5) Spark Streaming - Running Locally Vs Running on Cluster
6) Introduction to Apache Kafka
7) Apache Kafka Hands-on on CloudxLab
8) Integrating Spark Streaming & Kafka
9) Spark Streaming & Kafka Hands-on
Introduction to Apache Spark Developer Training
Introduction to Apache Spark Developer TrainingCloudera, Inc. Apache Spark is a next-generation processing engine optimized for speed, ease of use, and advanced analytics well beyond batch. The Spark framework supports streaming data and complex, iterative algorithms, enabling applications to run 100x faster than traditional MapReduce programs. With Spark, developers can write sophisticated parallel applications for faster business decisions and better user outcomes, applied to a wide variety of architectures and industries.
Learn What Apache Spark is and how it compares to Hadoop MapReduce, How to filter, map, reduce, and save Resilient Distributed Datasets (RDDs), Who is best suited to attend the course and what prior knowledge you should have, and the benefits of building Spark applications as part of an enterprise data hub.
Apache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & InternalsAnton Kirillov Slides cover Spark core concepts of Apache Spark such as RDD, DAG, execution workflow, forming stages of tasks and shuffle implementation and also describes architecture and main components of Spark Driver. The workshop part covers Spark execution modes , provides link to github repo which contains Spark Applications examples and dockerized Hadoop environment to experiment with
Ml2
Ml2poovarasu maniandan Microsoft R Server allows users to run R code on large datasets in a distributed, parallel manner across SQL Server, Spark, and Hadoop without code changes. It provides scalable machine learning algorithms and tools to operationalize models for real-time scoring. The document discusses how R code can be run remotely on Hadoop and Spark clusters using technologies like RevoScaleR and Sparklyr for scalability.
Spark and spark streaming internals
Spark and spark streaming internalsSigmoid Spark and Spark Streaming internals allow for low latency, fault tolerance, and diverse workloads. Spark uses a Resilient Distributed Dataset (RDD) model where data is partitioned across a cluster. A directed acyclic graph (DAG) is used to schedule tasks across stages in an optimized way. Spark Streaming runs streaming computations as small deterministic batch jobs by chopping live streams into batches and processing them using RDD transformations and actions.
Apache Spark Introduction and Resilient Distributed Dataset basics and deep dive
Apache Spark Introduction and Resilient Distributed Dataset basics and deep diveSachin Aggarwal We will give a detailed introduction to Apache Spark and why and how Spark can change the analytics world. Apache Spark's memory abstraction is RDD (Resilient Distributed DataSet). One of the key reason why Apache Spark is so different is because of the introduction of RDD. You cannot do anything in Apache Spark without knowing about RDDs. We will give a high level introduction to RDD and in the second half we will have a deep dive into RDDs.
How Apache Spark fits into the Big Data landscape
How Apache Spark fits into the Big Data landscapePaco Nathan Boulder/Denver Spark Meetup, 2014-10-02 @ Datalogix
http://www.meetup.com/Boulder-Denver-Spark-Meetup/events/207581832/
Apache Spark is intended as a general purpose engine that supports combinations of Batch, Streaming, SQL, ML, Graph, etc., for apps written in Scala, Java, Python, Clojure, R, etc.
This talk provides an introduction to Spark — how it provides so much better performance, and why — and then explores how Spark fits into the Big Data landscape — e.g., other systems with which Spark pairs nicely — and why Spark is needed for the work ahead.
Apache Spark Tutorial
Apache Spark TutorialAhmet Bulut Your data is getting bigger while your boss is getting anxious to have insights! This tutorial covers Apache Spark that makes data analytics fast to write and fast to run. Tackle big datasets quickly through a simple API in Python, and learn one programming paradigm in order to deploy interactive, batch, and streaming applications while connecting to data sources incl. HDFS, Hive, JSON, and S3.
Introduction to Apache Spark
Introduction to Apache SparkAnastasios Skarlatidis This presentation is an introduction to Apache Spark. It covers the basic API, some advanced features and describes how Spark physically executes its jobs.
Building production spark streaming applications
Building production spark streaming applicationsJoey Echeverria Designing, implementing, and testing an Apache Spark Streaming application is necessary to deploy to production but is not sufficient for long term management and monitoring. Simply learning the Spark Streaming APIs only gets you part of the way there. In this talk, I’ll be focusing on everything that happens after you’ve implemented your application in the context of a real-time alerting system for IT operational data.
Apache Spark Introduction - CloudxLab
Apache Spark Introduction - CloudxLabAbhinav Singh Hands-on Session on Big Data processing using Apache Spark and Hadoop Distributed File System
This is the first session in the series of "Apache Spark Hands-on"
Topics Covered
+ Introduction to Apache Spark
+ Introduction to RDD (Resilient Distributed Datasets)
+ Loading data into an RDD
+ RDD Operations - Transformation
+ RDD Operations - Actions
+ Hands-on demos using CloudxLab
Apache Spark, the Next Generation Cluster Computing
Apache Spark, the Next Generation Cluster ComputingGerger This document provides a 3 sentence summary of the key points:
Apache Spark is an open source cluster computing framework that is faster than Hadoop MapReduce by running computations in memory through RDDs, DataFrames and Datasets. It provides high-level APIs for batch, streaming and interactive queries along with libraries for machine learning. Spark's performance is improved through techniques like Catalyst query optimization, Tungsten in-memory columnar formats, and whole stage code generation.
Spark DataFrames: Simple and Fast Analytics on Structured Data at Spark Summi...
Spark DataFrames: Simple and Fast Analytics on Structured Data at Spark Summi...Databricks Spark DataFrames: Simple and Fast Analytics on Structured Data
Presentation by Michael Armbrust at Spark Summit 2015
Apache Spark: What's under the hood
Apache Spark: What's under the hoodAdarsh Pannu This document provides an overview of Apache Spark's architectural components through the life of simple Spark jobs. It begins with a simple Spark application analyzing airline on-time arrival data, then covers Resilient Distributed Datasets (RDDs), the cluster architecture, job execution through Spark components like tasks and scheduling, and techniques for writing better Spark applications like optimizing partitioning and reducing shuffle size.
Spark Study Notes
Spark Study NotesRichard Kuo This document discusses Apache Spark, an open-source cluster computing framework. It provides an overview of Spark, including its main concepts like RDDs (Resilient Distributed Datasets) and transformations. Spark is presented as a faster alternative to Hadoop for iterative jobs and machine learning through its ability to keep data in-memory. Example code is shown for Spark's programming model in Scala and Python. The document concludes that Spark offers a rich API to make data analytics fast, achieving speedups of up to 100x over Hadoop in real applications.
Spark core
Spark coreFreeman Zhang Spark is a distributed data processing framework that uses RDDs (Resilient Distributed Datasets) to represent data distributed across a cluster. RDDs support transformations like map, filter, and actions like reduce to operate on the distributed data in a parallel and fault-tolerant manner. Key concepts include lazy evaluation of transformations, caching of RDDs, and use of broadcast variables and accumulators for sharing data across nodes.
Workshop
WorkshopBeth Kanter This document provides an overview of using social media effectively for social change. It discusses adopting a network mindset in leadership and strategy. Key aspects include understanding, engaging with, and tuning organizational networks. Measurement is presented as essential for becoming data-informed and improving practices incrementally. Specific metrics and tools are outlined. Managing attention online through mindfulness is also covered as an important networking skill. The overall message is that social change is increasingly network-centric, and nonprofits can progress from crawling to flying in their use of social media through small experiments, benchmarking, and developing a data-informed culture.
Datomic
DatomicJordan Leigh This document discusses Datomic, a database that treats data as immutable values. It explains concepts like entities, attributes, facts, and schemas. Datomic stores facts as datoms, which are tuples with an entity, attribute, value and timestamp. Apps can query and manipulate data using patterns and datalog. The document outlines advantages like reproducibility and being language independent. It also notes Datomic is decoupled from storage and has functions in the database, but has downsides like not being open source and requiring a paid license for production use.
More Related Content
What's hot (20)
Intro to apache spark stand ford
Intro to apache spark stand fordThu Hiền Here are the steps to complete the assignment:
1. Create RDDs to filter each file for lines containing "Spark":
val readme = sc.textFile("README.md").filter(_.contains("Spark"))
val changes = sc.textFile("CHANGES.txt").filter(_.contains("Spark"))
2. Perform WordCount on each:
val readmeCounts = readme.flatMap(_.split(" ")).map((_,1)).reduceByKey(_ + _)
val changesCounts = changes.flatMap(_.split(" ")).map((_,1)).reduceByKey(_ + _)
3. Join the two RDDs:
val joined = readmeCounts.join(changes
Apache Spark Architecture
Apache Spark ArchitectureAlexey Grishchenko This is the presentation I made on JavaDay Kiev 2015 regarding the architecture of Apache Spark. It covers the memory model, the shuffle implementations, data frames and some other high-level staff and can be used as an introduction to Apache Spark
Intro to Apache Spark
Intro to Apache SparkRobert Sanders Introduction to Apache Spark. With an emphasis on the RDD API, Spark SQL (DataFrame and Dataset API) and Spark Streaming.
Presented at the Desert Code Camp:
http://oct2016.desertcodecamp.com/sessions/all
Introduction to Spark with Scala
Introduction to Spark with ScalaHimanshu Gupta Knoldus organized a Meetup on 1 April 2015. In this Meetup, we introduced Spark with Scala. Apache Spark is a fast and general engine for large-scale data processing. Spark is used at a wide range of organizations to process large datasets.
Introduction to Spark Streaming & Apache Kafka | Big Data Hadoop Spark Tutori...
Introduction to Spark Streaming & Apache Kafka | Big Data Hadoop Spark Tutori...CloudxLab Big Data with Hadoop & Spark Training: http://bit.ly/2L6bZbn
This CloudxLab Introduction to Spark Streaming & Apache Kafka tutorial helps you to understand Spark Streaming and Kafka in detail. Below are the topics covered in this tutorial:
1) Spark Streaming - Workflow
2) Use Cases - E-commerce, Real-time Sentiment Analysis & Real-time Fraud Detection
3) Spark Streaming - DStream
4) Word Count Hands-on using Spark Streaming
5) Spark Streaming - Running Locally Vs Running on Cluster
6) Introduction to Apache Kafka
7) Apache Kafka Hands-on on CloudxLab
8) Integrating Spark Streaming & Kafka
9) Spark Streaming & Kafka Hands-on
Introduction to Apache Spark Developer Training
Introduction to Apache Spark Developer TrainingCloudera, Inc. Apache Spark is a next-generation processing engine optimized for speed, ease of use, and advanced analytics well beyond batch. The Spark framework supports streaming data and complex, iterative algorithms, enabling applications to run 100x faster than traditional MapReduce programs. With Spark, developers can write sophisticated parallel applications for faster business decisions and better user outcomes, applied to a wide variety of architectures and industries.
Learn What Apache Spark is and how it compares to Hadoop MapReduce, How to filter, map, reduce, and save Resilient Distributed Datasets (RDDs), Who is best suited to attend the course and what prior knowledge you should have, and the benefits of building Spark applications as part of an enterprise data hub.
Apache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & InternalsAnton Kirillov Slides cover Spark core concepts of Apache Spark such as RDD, DAG, execution workflow, forming stages of tasks and shuffle implementation and also describes architecture and main components of Spark Driver. The workshop part covers Spark execution modes , provides link to github repo which contains Spark Applications examples and dockerized Hadoop environment to experiment with
Ml2
Ml2poovarasu maniandan Microsoft R Server allows users to run R code on large datasets in a distributed, parallel manner across SQL Server, Spark, and Hadoop without code changes. It provides scalable machine learning algorithms and tools to operationalize models for real-time scoring. The document discusses how R code can be run remotely on Hadoop and Spark clusters using technologies like RevoScaleR and Sparklyr for scalability.
Spark and spark streaming internals
Spark and spark streaming internalsSigmoid Spark and Spark Streaming internals allow for low latency, fault tolerance, and diverse workloads. Spark uses a Resilient Distributed Dataset (RDD) model where data is partitioned across a cluster. A directed acyclic graph (DAG) is used to schedule tasks across stages in an optimized way. Spark Streaming runs streaming computations as small deterministic batch jobs by chopping live streams into batches and processing them using RDD transformations and actions.
Apache Spark Introduction and Resilient Distributed Dataset basics and deep dive
Apache Spark Introduction and Resilient Distributed Dataset basics and deep diveSachin Aggarwal We will give a detailed introduction to Apache Spark and why and how Spark can change the analytics world. Apache Spark's memory abstraction is RDD (Resilient Distributed DataSet). One of the key reason why Apache Spark is so different is because of the introduction of RDD. You cannot do anything in Apache Spark without knowing about RDDs. We will give a high level introduction to RDD and in the second half we will have a deep dive into RDDs.
How Apache Spark fits into the Big Data landscape
How Apache Spark fits into the Big Data landscapePaco Nathan Boulder/Denver Spark Meetup, 2014-10-02 @ Datalogix
http://www.meetup.com/Boulder-Denver-Spark-Meetup/events/207581832/
Apache Spark is intended as a general purpose engine that supports combinations of Batch, Streaming, SQL, ML, Graph, etc., for apps written in Scala, Java, Python, Clojure, R, etc.
This talk provides an introduction to Spark — how it provides so much better performance, and why — and then explores how Spark fits into the Big Data landscape — e.g., other systems with which Spark pairs nicely — and why Spark is needed for the work ahead.
Apache Spark Tutorial
Apache Spark TutorialAhmet Bulut Your data is getting bigger while your boss is getting anxious to have insights! This tutorial covers Apache Spark that makes data analytics fast to write and fast to run. Tackle big datasets quickly through a simple API in Python, and learn one programming paradigm in order to deploy interactive, batch, and streaming applications while connecting to data sources incl. HDFS, Hive, JSON, and S3.
Introduction to Apache Spark
Introduction to Apache SparkAnastasios Skarlatidis This presentation is an introduction to Apache Spark. It covers the basic API, some advanced features and describes how Spark physically executes its jobs.
Building production spark streaming applications
Building production spark streaming applicationsJoey Echeverria Designing, implementing, and testing an Apache Spark Streaming application is necessary to deploy to production but is not sufficient for long term management and monitoring. Simply learning the Spark Streaming APIs only gets you part of the way there. In this talk, I’ll be focusing on everything that happens after you’ve implemented your application in the context of a real-time alerting system for IT operational data.
Apache Spark Introduction - CloudxLab
Apache Spark Introduction - CloudxLabAbhinav Singh Hands-on Session on Big Data processing using Apache Spark and Hadoop Distributed File System
This is the first session in the series of "Apache Spark Hands-on"
Topics Covered
+ Introduction to Apache Spark
+ Introduction to RDD (Resilient Distributed Datasets)
+ Loading data into an RDD
+ RDD Operations - Transformation
+ RDD Operations - Actions
+ Hands-on demos using CloudxLab
Apache Spark, the Next Generation Cluster Computing
Apache Spark, the Next Generation Cluster ComputingGerger This document provides a 3 sentence summary of the key points:
Apache Spark is an open source cluster computing framework that is faster than Hadoop MapReduce by running computations in memory through RDDs, DataFrames and Datasets. It provides high-level APIs for batch, streaming and interactive queries along with libraries for machine learning. Spark's performance is improved through techniques like Catalyst query optimization, Tungsten in-memory columnar formats, and whole stage code generation.
Spark DataFrames: Simple and Fast Analytics on Structured Data at Spark Summi...
Spark DataFrames: Simple and Fast Analytics on Structured Data at Spark Summi...Databricks Spark DataFrames: Simple and Fast Analytics on Structured Data
Presentation by Michael Armbrust at Spark Summit 2015
Apache Spark: What's under the hood
Apache Spark: What's under the hoodAdarsh Pannu This document provides an overview of Apache Spark's architectural components through the life of simple Spark jobs. It begins with a simple Spark application analyzing airline on-time arrival data, then covers Resilient Distributed Datasets (RDDs), the cluster architecture, job execution through Spark components like tasks and scheduling, and techniques for writing better Spark applications like optimizing partitioning and reducing shuffle size.
Spark Study Notes
Spark Study NotesRichard Kuo This document discusses Apache Spark, an open-source cluster computing framework. It provides an overview of Spark, including its main concepts like RDDs (Resilient Distributed Datasets) and transformations. Spark is presented as a faster alternative to Hadoop for iterative jobs and machine learning through its ability to keep data in-memory. Example code is shown for Spark's programming model in Scala and Python. The document concludes that Spark offers a rich API to make data analytics fast, achieving speedups of up to 100x over Hadoop in real applications.
Spark core
Spark coreFreeman Zhang Spark is a distributed data processing framework that uses RDDs (Resilient Distributed Datasets) to represent data distributed across a cluster. RDDs support transformations like map, filter, and actions like reduce to operate on the distributed data in a parallel and fault-tolerant manner. Key concepts include lazy evaluation of transformations, caching of RDDs, and use of broadcast variables and accumulators for sharing data across nodes.
Viewers also liked (20)
Workshop
WorkshopBeth Kanter This document provides an overview of using social media effectively for social change. It discusses adopting a network mindset in leadership and strategy. Key aspects include understanding, engaging with, and tuning organizational networks. Measurement is presented as essential for becoming data-informed and improving practices incrementally. Specific metrics and tools are outlined. Managing attention online through mindfulness is also covered as an important networking skill. The overall message is that social change is increasingly network-centric, and nonprofits can progress from crawling to flying in their use of social media through small experiments, benchmarking, and developing a data-informed culture.
Datomic
DatomicJordan Leigh This document discusses Datomic, a database that treats data as immutable values. It explains concepts like entities, attributes, facts, and schemas. Datomic stores facts as datoms, which are tuples with an entity, attribute, value and timestamp. Apps can query and manipulate data using patterns and datalog. The document outlines advantages like reproducibility and being language independent. It also notes Datomic is decoupled from storage and has functions in the database, but has downsides like not being open source and requiring a paid license for production use.
Datomic
DatomicChristophe Marchal This document describes Datom, a database that provides:
1) A flexible, time-based store of facts that supports queries and joins.
2) Elastic scalability and ACID transactions.
3) An entity-attribute-value model to represent facts as transactions over time.
Datomic
Datomicjperkelens Datomic is a database that uses an immutable data model where data is never updated or erased, only added to over time. It uses distributed transactions where transactions are processed serially by transactors and changes are transmitted to peers. Peers cache data and submit transactions, handling queries using a merged view of the cache and latest data from the transactor. The data model consists of immutable datoms that are entities, attributes, values, and the transaction time, allowing queries over time.
Selena Gomez
Selena Gomezguest5fa9931 Selena Gomez is an American actress and singer born in 1992 in Texas. She began her career acting in Barney and befriending Demi Lovato. She released her first album with her band The Scene in 2008 and contributed songs to the Wizards of Waverly Place soundtrack. The Disney Channel TV show Wizards of Waverly Place, in which Gomez stars as the main character Alex Russo, premiered in 2007 and won an Emmy in 2009. Gomez has also starred in several Disney Channel movies and has upcoming roles in Ramona and Beezus and Monte Carlo.
Management Consulting
Management ConsultingAlexandros Chatzopoulos Deloitte is one of the "Big Four" global accounting and consulting firms, with over 220,000 professionals providing audit, consulting, tax, and advisory services in more than 150 countries. It has a long history dating back to 1845 and is the largest private professional services network in the world. Deloitte focuses on creating value for clients through industry-leading services in areas like consulting, audit, tax, and risk management. Its vision is to be the standard of excellence through high quality work, inclusion, collaboration, and opportunity.
Sap fiori
Sap fioriAnudeep Bhatia The document discusses an SAP Fiori starter package offered by Nsight, an SAP partner. The starter package includes:
- Activating and configuring standard SAP Fiori apps in a development environment.
- Installing additional standard SAP Fiori apps and customizing standard apps.
- Configuring single sign-on with SAP Fiori apps and testing.
- Branding of standard SAP Fiori apps and providing documentation and training.
The package is aimed at customers seeking to provide better user interfaces, implement standard SAP Fiori apps, and evaluate SAP Fiori and UI tools. The document outlines the scope of work, considerations, and
French Property Market 2014
French Property Market 2014David Bourla The French property investment market totaled €15.1 billion in 2013, a 1% increase from 2012. While investment volume was stable, the number of transactions declined. Large portfolio deals represented a smaller portion of the market compared to previous years. Office properties accounted for most investment in the Paris region, totaling €11.1 billion or 74% of the French market. Retail properties drove investment in other French regions, totaling €4 billion or 26% of the market. The top investors in France were from France, the United States, and the United Kingdom. The office sector saw more interest in higher risk assets while retail and industrial remained active. Overall, the French market remained stable but uncertainties remained around the economic recovery
ReactJs
ReactJsLearningTech This document is a tutorial on React js that covers getting started with React, creating components, composing components with properties, adding Markdown, and hooking up components to a data model. It includes sections on your first component, React developer tools, using component properties, adding Markdown, and connecting components to data through multiple steps. The tutorial aims to teach developers how to build React applications.
Medical devices
Medical devicesSomnath Zambare The document defines medical devices and their classification according to various regulatory bodies. It begins by defining a medical device as any instrument intended for internal or external use in the diagnosis, treatment, or prevention of disease. It then discusses the classification of devices by the US FDA, CDSCO, and the European Union as Class I, II, or III based on increasing risk levels. The document provides examples of devices that fall into each class and outlines the regulatory processes, including premarket approval or clearance, that manufacturers must go through for devices in each class to be legally marketed.
French Property market 2015 - Cushman & Wakefield
French Property market 2015 - Cushman & WakefieldDavid Bourla This report outlines market trends in 2014 and provides growth prospects for the investment, office, logistics and retail property markets in France.
ReactJS | 서버와 클라이어트에서 동시에 사용하는
ReactJS | 서버와 클라이어트에서 동시에 사용하는Taegon Kim ReactJS에 대한 소개와 특징, 동형 자바스크립트(Isomorphic JavaScript) 그리고 one more thing.
Elon Musk
Elon MuskMiloš Ivković Elon Musk is a South African-born American entrepreneur and industrialist who founded SpaceX, Tesla Motors, and Neuralink. He is the CEO of both SpaceX and Tesla, where he oversees the development of advanced rockets, electric vehicles, and brain-computer interfaces. His ultimate goal is to make humanity a multi-planetary species by establishing human colonies on Mars.
Simo Ahava - Tag Management Solutions – Best. Data. Ever. MKTFEST 2014
Simo Ahava - Tag Management Solutions – Best. Data. Ever. MKTFEST 2014Marketing Festival Get videos from all our lectures - http://video.marketingfestival.cz
Marketing Festival - World-Class Digital Marketing Event #mktfest Czech Republic
Reverse Engineering
Reverse Engineeringdswanson This document outlines a WebQuest project for a 10th grade engineering class that involves reverse engineering simple machines. Students will be assigned to groups to disassemble, analyze, and reassemble a simple machine. They will investigate why it was designed a certain way and explain how it works using Newton's laws of motion. Students will then give a speech to present their findings and submit a report summarizing what they learned. The project aims to engage students hands-on and spark curiosity about everyday items and engineering principles.
Chess
ChessChuck Vohs This document provides information about the requirements and history of the Chess Merit Badge. It discusses the origins and development of chess, including how the standard Staunton chess set was established. It outlines the requirements for earning the badge, including explaining the benefits of chess, proper etiquette, teaching another Scout how to play, demonstrating different checkmates and ways a game can end in a draw, and explaining elements of strategy and tactics. The document provides detailed descriptions and diagrams to demonstrate chess concepts like piece movement, notation, checkmates, and tactical ideas.
Personal Development
Personal DevelopmentSeta Wicaksana A personal development plan helps individuals and organizations map out goals and steps for career growth. It involves assessing current skills and qualifications, identifying strengths and weaknesses, setting long-term aims and required future skills. The plan then outlines how to achieve goals through setting short-term milestones and timelines. Benefits include motivation, focus on self-improvement, and encouraging employees' career planning. However, businesses must consider if high expectations from plans could cause more harm than not offering them.
GridGain 6.0: Open Source In-Memory Computing Platform - Nikita Ivanov
GridGain 6.0: Open Source In-Memory Computing Platform - Nikita IvanovJAXLondon2014 This document discusses Apache Ignite, an open source in-memory data fabric for real-time processing of big data. It provides an overview of Ignite's capabilities including in-memory caching and computing, distributed processing, streaming and complex event processing. Examples are given of how to use Ignite for distributed caching, transactions, MapReduce jobs and accelerating Hadoop workloads.
Digital Data Tips Tuesday #1 - Tag Management: Simo Ahava - NetBooster
Digital Data Tips Tuesday #1 - Tag Management: Simo Ahava - NetBoosterWebanalisten .nl This document summarizes Simo Ahava's presentation on tag management systems (TMS). Some key points include:
- A TMS bridges the gap between developers and marketers by allowing tags to be managed centrally without embedding them directly into code.
- While TMS aims to provide an easy solution, proper planning is required for migrating tags and ongoing management.
- When implemented correctly, a TMS can make tagging and analytics more agile. However, it also introduces some performance overhead and flexibility must be balanced with stability.
- The presenter cautions against overselling a TMS as a "miracle cure" and advocates focusing on how it facilitates tagging to achieve desired analytics goals
Similar to Apache Spark Introduction (20)
Introduction to Apache Spark
Introduction to Apache SparkMohamed hedi Abidi This is my slides from ebiznext workshop : Introduction to Apache Spark.
Please download code sources from https://github.com/MohamedHedi/SparkSamples
Apache Spark Workshop
Apache Spark WorkshopMichael Spector This document summarizes an Apache Spark workshop that took place in September 2017 in Stockholm. It introduces the speaker's background and experience with Spark. It then provides an overview of the Spark ecosystem and core concepts like RDDs, DataFrames, and Spark Streaming. Finally, it discusses important Spark concepts like caching, checkpointing, broadcasting, and resilience.
Apache Spark: What? Why? When?
Apache Spark: What? Why? When?Massimo Schenone Apache Spark is a cluster computing framework that allows for fast, easy, and general processing of large datasets. It extends the MapReduce model to support iterative algorithms and interactive queries. Spark uses Resilient Distributed Datasets (RDDs), which allow data to be distributed across a cluster and cached in memory for faster processing. RDDs support transformations like map, filter, and reduce and actions like count and collect. This functional programming approach allows Spark to efficiently handle iterative algorithms and interactive data analysis.
20130912 YTC_Reynold Xin_Spark and Shark
20130912 YTC_Reynold Xin_Spark and SharkYahooTechConference In this talk, we present two emerging, popular open source projects: Spark and Shark. Spark is an open source cluster computing system that aims to make data analytics fast — both fast to run and fast to write. It outperform Hadoop by up to 100x in many real-world applications. Spark programs are often much shorter than their MapReduce counterparts thanks to its high-level APIs and language integration in Java, Scala, and Python. Shark is an analytic query engine built on top of Spark that is compatible with Hive. It can run Hive queries much faster in existing Hive warehouses without modifications.
These systems have been adopted by many organizations large and small (e.g. Yahoo, Intel, Adobe, Alibaba, Tencent) to implement data intensive applications such as ETL, interactive SQL, and machine learning.
Apache spark basics
Apache spark basicssparrowAnalytics.com Apache Spark is an open source Big Data analytical framework. It introduces the concept of RDDs (Resilient Distributed Datasets) which allow parallel operations on large datasets. The document discusses starting Spark, Spark applications, transformations and actions on RDDs, RDD creation in Scala and Python, and examples including word count. It also covers flatMap vs map, custom methods, and assignments involving transformations on lists.
Bring the Spark To Your Eyes
Bring the Spark To Your EyesDemi Ben-Ari Demi Ben-Ari is a senior software engineer at Windward Ltd. who has a BS in computer science. They previously worked as a software team leader and senior Java engineer developing missile defense and alert systems. The presentation discusses Spark, an open-source cluster computing framework, and how Windward uses Spark for data filtering, management, predictions and more through Java applications running on YARN clusters.
Spark 101
Spark 101Mohit Garg Spark is an in-memory cluster computing framework that provides high performance for large-scale data processing. It excels over Hadoop by keeping data in memory as RDDs (Resilient Distributed Datasets) for faster processing. The document provides an overview of Spark architecture including its core-based execution model compared to Hadoop's JVM-based model. It also demonstrates Spark's programming model using RDD transformations and actions through an example of log mining, showing how jobs are lazily evaluated and distributed across the cluster.
Spark core
Spark corePrashant Gupta Apache Spark is a fast and general engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
Apache Spark Fundamentals Meetup Talk
Apache Spark Fundamentals Meetup TalkEren Avşaroğulları The document provides an overview of Apache Spark fundamentals including what Spark is, its ecosystem and terminology, how to create RDDs and use different operations like transformations and actions, RDD lineage and evolution from RDDs to DataFrames and DataSets. It also discusses concepts like job lifecycle, persistency, and running Spark on a YARN cluster. Code samples are shown to demonstrate different Spark features. The presenter has a computer engineering background and currently works on data analytics and transformations using Spark.
Apache spark - Architecture , Overview & libraries
Apache spark - Architecture , Overview & librariesWalaa Hamdy Assy This document provides an overview of Apache Spark, an open-source unified analytics engine for large-scale data processing. It discusses Spark's core APIs including RDDs and transformations/actions. It also covers Spark SQL, Spark Streaming, MLlib, and GraphX. Spark provides a fast and general engine for big data processing, with explicit operations for streaming, SQL, machine learning, and graph processing. The document includes installation instructions and examples of using various Spark components.
Spark basic.pdf
Spark basic.pdfssuser8b6c85 Apache Spark is a distributed programming framework for big data processing based on functional programming. It implements distributed Scala collections and is built on top of the Akka actor framework. Resilient Distributed Datasets (RDDs) store data in partitions across several computers and record lineage to allow recomputing partitions if servers fail. Spark supports transformations like map, filter, and reduce and actions like collect, count, and save that trigger computation.
SparkR: Enabling Interactive Data Science at Scale on Hadoop
SparkR: Enabling Interactive Data Science at Scale on HadoopDataWorks Summit SparkR enables interactive data science at scale on Hadoop by providing an R interface to Apache Spark. Some key points:
- SparkR allows users to manipulate distributed datasets (RDDs) using familiar R operations like map, filter, reduceByKey.
- It integrates R and Spark by running R code on Spark executors via JNI, allowing R scripts to process large datasets in parallel.
- Examples show how to do tasks like word count and logistic regression on Spark using R code, demonstrating the ability to scale R for data science on big data.
Introduction to Apache Spark 
Introduction to Apache Spark Hubert Fan Chiang This document provides an introduction and overview of Apache Spark. It discusses what Spark is, its performance advantages over Hadoop MapReduce, its core abstraction of resilient distributed datasets (RDDs), and how Spark programs are executed. Key features of Spark like its interactive shell, transformations and actions on RDDs, and Spark SQL are explained. Recent new features in Spark like DataFrames, external data sources, and the Tungsten performance optimizer are also covered. The document aims to give attendees an understanding of Spark's capabilities and how it can provide faster performance than Hadoop for certain applications.
Introduction to Apache Spark
Introduction to Apache SparkRahul Jain Apache Spark is a In Memory Data Processing Solution that can work with existing data source like HDFS and can make use of your existing computation infrastructure like YARN/Mesos etc. This talk will cover a basic introduction of Apache Spark with its various components like MLib, Shark, GrpahX and with few examples.
Apache Spark Fundamentals Training
Apache Spark Fundamentals TrainingEren Avşaroğulları This presentation aims to be useful for the beginners by going through Apache Spark fundamentals topics such as Ecosystem, Operation Types (Transformation & Actions), Spark Data Structures, Persistency, Code Execution Tiers, Spark on YARN etc.
Parallelizing Existing R Packages
Parallelizing Existing R PackagesCraig Warman These slides were presented by Hossein Falaki of Databricks to the Atlanta Apache Spark User Group on Thursday, March 9, 2017: https://www.meetup.com/Atlanta-Apache-Spark-User-Group/events/238120227/
Apache spark sneha challa- google pittsburgh-aug 25th
Apache spark sneha challa- google pittsburgh-aug 25thSneha Challa The document is a presentation about Apache Spark given on August 25th, 2015 in Pittsburgh by Sneha Challa. It introduces Spark as a fast and general cluster computing engine for large-scale data processing. It discusses Spark's Resilient Distributed Datasets (RDDs) and transformations/actions. It provides examples of Spark APIs like map, reduce, and explains running Spark on standalone, Mesos, YARN, or EC2 clusters. It also covers Spark libraries like MLlib and running machine learning algorithms like k-means clustering and logistic regression.
Brief Intro to Apache Spark @ Stanford ICME
Brief Intro to Apache Spark @ Stanford ICMEPaco Nathan Brief introduction to Apache Spark, prior to a demo of Databricks Cloud by Timothy Hunter. Sponsored by Prof. Reza Zadeh @ Stanford ICME
Advanced spark training advanced spark internals and tuning reynold xin
Advanced spark training advanced spark internals and tuning reynold xincaidezhi655 This document provides an overview of Spark's RDD abstraction and the life cycle of a Spark application.
It defines RDDs as distributed collections characterized by partitions, dependencies, a compute function, and optional properties like a partitioner. It describes how Spark builds a DAG of stages from transformations and actions, and schedules tasks across executors.
The document also covers performance debugging techniques like identifying slow stages, stragglers, garbage collection issues, and profiling tasks locally. Debugging tools discussed include the Spark UI, executor logs, jstack, and YourKit.
More from Rich Lee (11)
COSCUP 2023 Building Portable and Reliable Applications on Google Cloud
COSCUP 2023 Building Portable and Reliable Applications on Google CloudRich Lee This document discusses building portable and reliable cloud native applications on Google Cloud. It covers cloud native principles, distributed systems communication patterns using sidecars, and problems with monolithic applications. It then introduces Dapr as a way to develop applications that are decoupled from infrastructure and can run anywhere. Dapr provides components, bindings, and APIs to build distributed, resilient applications. The document demonstrates using Dapr with Google Cloud Firestore and shows how resiliency patterns like retry and circuit breaker can be applied across Dapr.
2021 JCConf 使用Dapr簡化Java微服務應用開發
2021 JCConf 使用Dapr簡化Java微服務應用開發Rich Lee This document discusses using Dapr to simplify Java microservices application development. It introduces Dapr as a distributed application runtime that provides components like service discovery, configuration management, API gateways, and event messaging out of the box. It compares Dapr to Spring Cloud, noting that Dapr uses a sidecar container model instead of integrating directly with the application runtime. The document demonstrates building blocks of Dapr like state management, pub/sub, bindings and shows how to use the Dapr REST API and SDKs.
GDG Taipei 2020 - Cloud and On-premises Applications Integration Using Event-...
GDG Taipei 2020 - Cloud and On-premises Applications Integration Using Event-...Rich Lee This document provides an overview and demonstration of integrating cloud and on-premises applications using event-driven architecture. It discusses Function-as-a-Service (FaaS) platforms like Google Cloud Functions. It also describes Kafka Connect for scalably streaming data between Apache Kafka and other systems like Google Cloud Pub/Sub using source and sink connectors. The document demonstrates configuring Pub/Sub connectors to integrate Kafka topics with Cloud Pub/Sub topics.
JCConf.tw 2020 - Building cloud-native applications with Quarkus
JCConf.tw 2020 - Building cloud-native applications with QuarkusRich Lee An Introduction to Quarkus framework and extensions.
Quarkus is a Kubernetes-native Java framework introduced by RedHat in 2019.
• Container First
• Cloud Native
• Kubernetes Native
Redis Cache design
Redis Cache designRich Lee The document discusses cache service design using Redis. It proposes using HTTP cache control directives like max-age, private and no-store to control caching of responses. A flow diagram shows the first request fetching data while a second unchanged request gets data from cache, improving performance. An example API GET request to /dbee/v1/notifications endpoint is also included.
Couchbase & FTS
Couchbase & FTSRich Lee This document discusses indexing strategies for Couchbase databases. It provides examples of creating indexes on specific fields to enable efficient querying and explains how to determine which indexes to create. Array indexing is also covered, allowing indexing into array elements for queries. Best practices are outlined such as indexing fields commonly queried and avoiding wide indexes.
Centralized log-management-with-elastic-stack
Centralized log-management-with-elastic-stackRich Lee Centralized log management is implemented using the Elastic Stack including Filebeat, Logstash, Elasticsearch, and Kibana. Filebeat ships logs to Logstash which transforms and indexes the data into Elasticsearch. Logs can then be queried and visualized in Kibana. For large volumes of logs, Kafka may be used as a buffer between the shipper and indexer. Backups are performed using Elasticsearch snapshots to a shared file system or cloud storage. Logs are indexed into time-based indices and a cron job deletes old indices to control storage usage.
Microservice Architecture
Microservice ArchitectureRich Lee The document discusses microservices architecture. It defines microservices as an approach to developing a single application as a suite of small services that communicate with each other via lightweight mechanisms like HTTP APIs. Each service runs independently, is built around business capabilities, and can be deployed independently. There is minimal centralized management of services, which can use different programming languages and data storage technologies.
AWS IoT in action
AWS IoT in actionRich Lee The document discusses Amazon Web Services (AWS) IoT, including key services like the device gateway, device shadow, and rule engine. It provides examples of how to connect devices to AWS IoT using the JavaScript SDK and manipulate thing shadows to update device states. Security features for device certification are also mentioned.
Realtime web development
Realtime web developmentRich Lee Share the course of Realtime web development
Link: http://eighty20.cc/apps/e2-rtw-v01/index.html
Event sourcing
Event sourcingRich Lee Event sourcing is an approach to data management where changes to application state are stored as a sequence of events. This allows the entire history of data changes to be reconstructed. Pros include avoiding impedance mismatch between objects and databases, enabling undo functionality, and facilitating after-the-fact analysis. Event sourcing is best suited for building rich domain models, where accountability is important, or versioning and undo of data is needed. Popular frameworks that support event sourcing include Event Store, Akka Persistence, and EventStore2.
Recently uploaded (20)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)Eugene Fidelin Marko.js is an open-source JavaScript framework created by eBay back in 2014. It offers super-efficient server-side rendering, making it ideal for big e-commerce sites and other multi-page apps where speed and SEO really matter. After over 10 years of development, Marko has some standout features that make it an interesting choice. In this talk, I’ll dive into these unique features and showcase some of Marko's innovative solutions. You might not use Marko.js at your company, but there’s still a lot you can learn from it to bring to your next project.
Measuring Microsoft 365 Copilot and Gen AI Success
Measuring Microsoft 365 Copilot and Gen AI SuccessNikki Chapple Session | Measuring Microsoft 365 Copilot and Gen AI Success with Viva Insights and Purview
Presenter | Nikki Chapple 2 x MVP and Principal Cloud Architect at CloudWay
Event | European Collaboration Conference 2025
Format | In person Germany
Date | 28 May 2025
📊 Measuring Copilot and Gen AI Success with Viva Insights and Purview
Presented by Nikki Chapple – Microsoft 365 MVP & Principal Cloud Architect, CloudWay
How do you measure the success—and manage the risks—of Microsoft 365 Copilot and Generative AI (Gen AI)? In this ECS 2025 session, Microsoft MVP and Principal Cloud Architect Nikki Chapple explores how to go beyond basic usage metrics to gain full-spectrum visibility into AI adoption, business impact, user sentiment, and data security.
🎯 Key Topics Covered:
Microsoft 365 Copilot usage and adoption metrics
Viva Insights Copilot Analytics and Dashboard
Microsoft Purview Data Security Posture Management (DSPM) for AI
Measuring AI readiness, impact, and sentiment
Identifying and mitigating risks from third-party Gen AI tools
Shadow IT, oversharing, and compliance risks
Microsoft 365 Admin Center reports and Copilot Readiness
Power BI-based Copilot Business Impact Report (Preview)
📊 Why AI Measurement Matters: Without meaningful measurement, organizations risk operating in the dark—unable to prove ROI, identify friction points, or detect compliance violations. Nikki presents a unified framework combining quantitative metrics, qualitative insights, and risk monitoring to help organizations:
Prove ROI on AI investments
Drive responsible adoption
Protect sensitive data
Ensure compliance and governance
🔍 Tools and Reports Highlighted:
Microsoft 365 Admin Center: Copilot Overview, Usage, Readiness, Agents, Chat, and Adoption Score
Viva Insights Copilot Dashboard: Readiness, Adoption, Impact, Sentiment
Copilot Business Impact Report: Power BI integration for business outcome mapping
Microsoft Purview DSPM for AI: Discover and govern Copilot and third-party Gen AI usage
🔐 Security and Compliance Insights: Learn how to detect unsanctioned Gen AI tools like ChatGPT, Gemini, and Claude, track oversharing, and apply eDLP and Insider Risk Management (IRM) policies. Understand how to use Microsoft Purview—even without E5 Compliance—to monitor Copilot usage and protect sensitive data.
📈 Who Should Watch: This session is ideal for IT leaders, security professionals, compliance officers, and Microsoft 365 admins looking to:
Maximize the value of Microsoft Copilot
Build a secure, measurable AI strategy
Align AI usage with business goals and compliance requirements
🔗 Read the blog https://nikkichapple.com/measuring-copilot-gen-ai/
Introducing FME Realize: A New Era of Spatial Computing and AR
Introducing FME Realize: A New Era of Spatial Computing and ARSafe Software A new era for the FME Platform has arrived – and it’s taking data into the real world.
Meet FME Realize: marking a new chapter in how organizations connect digital information with the physical environment around them. With the addition of FME Realize, FME has evolved into an All-data, Any-AI Spatial Computing Platform.
FME Realize brings spatial computing, augmented reality (AR), and the full power of FME to mobile teams: making it easy to visualize, interact with, and update data right in the field. From infrastructure management to asset inspections, you can put any data into real-world context, instantly.
Join us to discover how spatial computing, powered by FME, enables digital twins, AI-driven insights, and real-time field interactions: all through an intuitive no-code experience.
In this one-hour webinar, you’ll:
-Explore what FME Realize includes and how it fits into the FME Platform
-Learn how to deliver real-time AR experiences, fast
-See how FME enables live, contextual interactions with enterprise data across systems
-See demos, including ones you can try yourself
-Get tutorials and downloadable resources to help you start right away
Whether you’re exploring spatial computing for the first time or looking to scale AR across your organization, this session will give you the tools and insights to get started with confidence.
Introducing the OSA 3200 SP and OSA 3250 ePRC
Introducing the OSA 3200 SP and OSA 3250 ePRCAdtran Adtran's latest Oscilloquartz solutions make optical pumping cesium timing more accessible than ever. Discover how the new OSA 3200 SP and OSA 3250 ePRC deliver superior stability, simplified deployment and lower total cost of ownership. Built on a shared platform and engineered for scalable, future-ready networks, these models are ideal for telecom, defense, metrology and more.
From Legacy to Cloud-Native: A Guide to AWS Modernization.pptx
From Legacy to Cloud-Native: A Guide to AWS Modernization.pptxMohammad Jomaa From Legacy to Cloud-Native: A Guide
to AWS Modernization
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCPSambhav Kothari MCP Dev Summit Talk By Sambhav Kothari - Head of AI Productivity at Bloomberg.
Break Down of Service Mesh Concepts and Implementation in AWS EKS.pptx
Break Down of Service Mesh Concepts and Implementation in AWS EKS.pptxMohammad Jomaa Break Down of Service Mesh Concepts and
Implementation in AWS EKS
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...SOFTTECHHUB With the introduction of Claude Opus 4 and Sonnet 4, Anthropic's newest generation of AI models is not just an incremental step but a pivotal moment, fundamentally reshaping what's possible in software development, complex problem-solving, and intelligent business automation.
UiPath Community Berlin: Studio Tips & Tricks and UiPath Insights
UiPath Community Berlin: Studio Tips & Tricks and UiPath InsightsUiPathCommunity Join the UiPath Community Berlin (Virtual) meetup on May 27 to discover handy Studio Tips & Tricks and get introduced to UiPath Insights. Learn how to boost your development workflow, improve efficiency, and gain visibility into your automation performance.
📕 Agenda:
- Welcome & Introductions
- UiPath Studio Tips & Tricks for Efficient Development
- Best Practices for Workflow Design
- Introduction to UiPath Insights
- Creating Dashboards & Tracking KPIs (Demo)
- Q&A and Open Discussion
Perfect for developers, analysts, and automation enthusiasts!
This session streamed live on May 27, 18:00 CET.
Check out all our upcoming UiPath Community sessions at:
👉 https://community.uipath.com/events/
Join our UiPath Community Berlin chapter:
👉 https://community.uipath.com/berlin/
TrustArc Webinar: Mastering Privacy Contracting
TrustArc Webinar: Mastering Privacy ContractingTrustArc As data privacy regulations become more pervasive across the globe and organizations increasingly handle and transfer (including across borders) meaningful volumes of personal and confidential information, the need for robust contracts to be in place is more important than ever.
This webinar will provide a deep dive into privacy contracting, covering essential terms and concepts, negotiation strategies, and key practices for managing data privacy risks.
Whether you're in legal, privacy, security, compliance, GRC, procurement, or otherwise, this session will include actionable insights and practical strategies to help you enhance your agreements, reduce risk, and enable your business to move fast while protecting itself.
This webinar will review key aspects and considerations in privacy contracting, including:
- Data processing addenda, cross-border transfer terms including EU Model Clauses/Standard Contractual Clauses, etc.
- Certain legally-required provisions (as well as how to ensure compliance with those provisions)
- Negotiation tactics and common issues
- Recent lessons from recent regulatory actions and disputes
Talk: On an adventure into the depths of Maven - Kaya Weers
Talk: On an adventure into the depths of Maven - Kaya WeersKaya Weers Talk: On an adventure into the depths of Maven
By: Kaya Weers
Security Operations and the Defense Analyst - Splunk Certificate
Security Operations and the Defense Analyst - Splunk CertificateVICTOR MAESTRE RAMIREZ Security Operations and the Defense Analyst - Splunk Certificate
Content and eLearning Standards: Finding the Best Fit for Your-Training
Content and eLearning Standards: Finding the Best Fit for Your-TrainingRustici Software Tammy Rutherford, Managing Director of Rustici Software, walks through the pros and cons of different standards to better understand which standard is best for your content and chosen technologies.
Fully Open-Source Private Clouds: Freedom, Security, and Control
Fully Open-Source Private Clouds: Freedom, Security, and ControlShapeBlue In this presentation, Swen Brüseke introduced proIO's strategy for 100% open-source driven private clouds. proIO leverage the proven technologies of CloudStack and LINBIT, complemented by professional maintenance contracts, to provide you with a secure, flexible, and high-performance IT infrastructure. He highlighted the advantages of private clouds compared to public cloud offerings and explain why CloudStack is in many cases a superior solution to Proxmox.
--
The CloudStack European User Group 2025 took place on May 8th in Vienna, Austria. The event once again brought together open-source cloud professionals, contributors, developers, and users for a day of deep technical insights, knowledge sharing, and community connection.
Kubernetes Cloud Native Indonesia Meetup - May 2025
Kubernetes Cloud Native Indonesia Meetup - May 2025Prasta Maha Kubernetes Cloud Native Indonesia Meetup - May 2025
Droidal: AI Agents Revolutionizing Healthcare
Droidal: AI Agents Revolutionizing HealthcareDroidal LLC Droidal’s AI Agents are transforming healthcare by bringing intelligence, speed, and efficiency to key areas such as Revenue Cycle Management (RCM), clinical operations, and patient engagement. Built specifically for the needs of U.S. hospitals and clinics, Droidal's solutions are designed to improve outcomes and reduce administrative burden.
Through simple visuals and clear examples, the presentation explains how AI Agents can support medical coding, streamline claims processing, manage denials, ensure compliance, and enhance communication between providers and patients. By integrating seamlessly with existing systems, these agents act as digital coworkers that deliver faster reimbursements, reduce errors, and enable teams to focus more on patient care.
Droidal's AI technology is more than just automation — it's a shift toward intelligent healthcare operations that are scalable, secure, and cost-effective. The presentation also offers insights into future developments in AI-driven healthcare, including how continuous learning and agent autonomy will redefine daily workflows.
Whether you're a healthcare administrator, a tech leader, or a provider looking for smarter solutions, this presentation offers a compelling overview of how Droidal’s AI Agents can help your organization achieve operational excellence and better patient outcomes.
A free demo trial is available for those interested in experiencing Droidal’s AI Agents firsthand. Our team will walk you through a live demo tailored to your specific workflows, helping you understand the immediate value and long-term impact of adopting AI in your healthcare environment.
To request a free trial or learn more:
https://droidal.com/
STKI Israel Market Study 2025 final v1 version
STKI Israel Market Study 2025 final v1 versionDr. Jimmy Schwarzkopf nnual (33 years) study of the Israeli Enterprise / public IT market. Covering sections on Israeli Economy, IT trends 2026-28, several surveys (AI, CDOs, OCIO, CTO, staffing cyber, operations and infra) plus rankings of 760 vendors on 160 markets (market sizes and trends) and comparison of products according to support and market penetration.
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptxJasper Oosterveld My slides for ECS 2025.
Contributing to WordPress With & Without Code.pptx
Contributing to WordPress With & Without Code.pptxPatrick Lumumba Contributing to WordPress: Making an Impact on the Test Team—With or Without Coding Skills
WordPress survives on collaboration, and the Test Team plays a very important role in ensuring the CMS is stable, user-friendly, and accessible to everyone.
This talk aims to deconstruct the myth that one has to be a developer to contribute to WordPress. In this session, I will share with the audience how to get involved with the WordPress Team, whether a coder or not.
We’ll explore practical ways to contribute, from testing new features, and patches, to reporting bugs. By the end of this talk, the audience will have the tools and confidence to make a meaningful impact on WordPress—no matter the skill set.
Apache Spark Introduction
- 1. Spark Conf Taiwan 2016
- 3. Agenda Spark overview Spark core RDD Spark Application Develop Spark Shell Zeppline Application
- 6. Spark Overview Apache Spark is a fast and general-purpose cluster computing system Key Features: Fast Ease of Use General-purpose Scalable Fault tolerant Logistic regression in Hadoop and Spark
- 8. Spark Overview Cluster Mode Local Standalone Hadoop YARN Apache Mesos
- 10. Spark Overview Spark High Level Architecture Driver Program Cluster Management Worker Node Executor Task
- 12. Spark Overview Install and startup Download http://spark.apache.org/downloads.html Start Master and Worker ./sbin/start-all.sh http://localhost:8080 Start History server ./sbin/start-history-server.sh hdfs://localhost:9000/spark/directory
- 13. RDD Resilient Distributed Datase RDD represents a collection of partitioned data elements that can be operated on in parallel. It is the primary data abstraction mechanism in Spark. Partitioned Fault Tolerant Interface In Memory
- 14. RDD Create RDD parallelize val xs = (1 to 10000).toList val rdd = sc.parallelize(xs) textFile val lines = sc.textFile("/input/README.md") val lines = sc.textFile("file:///RICH_HD/BigData_Tools/spark-1.6.2/README.md") HDFS - "hdfs://" Amazon S3 - "s3n://" Cassandra, HBase
- 15. RDD
- 16. RDD Transformation Creates a new RDD by performing a computation on the source RDD map val txtFile = sc.textFile("/input/README.md") val lengths = lines map { l => l.length} flatMap val words = lines flatMap { l => l.split(" ")} filter val longLines = lines filter { l => l.length > 80}
- 17. RDD Action Return a value to a driver program first val numbersRdd = sc.parallelize(List(10, 5, 3, 1)) val firstElement = numbersRdd.first max numbersRdd.max reduce val sum = numbersRdd.reduce((x, y) => x + y) val product = numbersRdd.reduce((x, y) => x * y)
- 18. RDD Filter log example: val logs = sc.textFile("path/to/log-files") val errorLogs = logs filter { l => l.contains("ERROR")} val warningLogs = logs filter { l => l.contains("WARN")} val errorCount = errorLogs.count val warningCount = warningLogs.count log RDD error RDD warn RDD count count
- 19. RDD Caching Stores an RDD in the memory or storage When an application caches an RDD in memory, Spark stores it in the executor memory on each worker node. Each executor stores in memory the RDD partitions that it computes. cache persist MEMORY_ONLY DISK_ONLY MEMORY_AND_DISK
- 20. RDD Cache example: val logs = sc.textFile("path/to/log-files") val errorsAndWarnings = logs filter { l => l.contains("ERROR") || l.contains("WARN")} errorsAndWarnings.cache() val errorLogs = errorsAndWarnings filter { l => l.contains("ERROR")} val warningLogs = errorsAndWarnings filter { l => l.contains("WARN")} val errorCount = errorLogs.count val warningCount = warningLogs.count
- 22. Spark Application Develop Spark-Shell Zeppline Application (Java/Scala) spark-submit
- 23. Spark Application Develop WordCount val textFile = sc.textFile("/input/README.md") val wcData = textFile.flatMap(line => line.split(" ")) .map((_, 1)) .reduceByKey(_ + _) wcData.collect().foreach(println)
- 24. 工商時間 Taiwan Hadoop User Group https://www.facebook.com/groups/hadoop.tw/ Taiwan Spark User Group https://www.facebook.com/groups/spark.tw/