Big Data DIY

Mar 19, 2014Download as PPTX, PDF0 likes1,037 views

Big Data DIY auf der Microsoft CeBIT Bühne. Big Data ist einer der großen IT-Trends und doch für viele noch Neuland. In dieser Session stellen wir vor, wie man Big Data selber mit Hilfe von Tweets bauen kann. Anhand einer Windows Azure Applikation für die Echtzeit-Analyse von Twitter-Daten schildern wir die Rolle der Microsoft Technologien und wie Open Source Technologien, wie Hadoop, in Windows Azure integriert ist. Unser Szenario kann leicht „nachgebaut“ werden und ist ein guter Ausgangspunkt für eigene Entwicklungen.

Big Data Do-It-Yourself
mit Microsoft
Olivia Klose
Technical Evangelist, Microsoft Deutschland GmbH
aka.ms/oliviaklose, @oliviaklose

Die 3 Vs
MB
GB
TB
PB
batch
periodic
real
time
table
data
base
un-
struc-
tured
web
Big Data, Gesellschaft für Informatik, 2013,
http://www.gi.de/service/informatiklexikon/
detailansicht/article/big-data.html

Demo
Demo
Tweets extrahieren: Echtzeit-Dashboard

Extract
StreamInsight
Azure SQL
Azure Blob
Storage
Real-Time
Dashboard
Twitter
Tweets extrahieren

Demo
Demo
Tweets speichern im
Windows Azure Blob Storage

Analyze
Hive Tables
…
Azure Blob
Storage
Azure Blob
Storage
Mash Up &
Visualise
Tweets in HDInsight Analyze
Azure SQL
Real-Time
Dashboard
Twitter
Extract
StreamInsight

Analyze
Hive Tables
…
Azure Blob
Storage
Azure Blob
Storage
Mash Up &
Visualise
Hive in HDInsight Analyze
Hive Tables
…
Azure SQL
Real-Time
Dashboard
Twitter
Extract
StreamInsight

Mash Up &
VisualiseAzure SQL
Tweets visualisieren
Mash Up &
Visualise
Analyze
Hive Tables
…
Real-Time
Dashboard
Twitter
Extract
StreamInsight
Azure SQL
Azure Blob
Storage

Extract
StreamInsight
Azure SQL
Azure Blob
Storage
Real-Time
Dashboard
Twitter
Big Data Twitter Infrastruktur
Mash Up &
Visualise
Analyze
Hive Tables
…

Big Data DIY in der MVA
http://aka.ms/BigDataDIY

Weitere Informationen
olivia.klose
@microsoft.com
aka.ms/oliviaklose
Twitter:
@oliviaklose
Big Data DIY Kurs
http://aka.ms/BigDataDIY
Windows Azure Trial
http://aka.ms/azurenow
HDInsight
http://tinyurl.com/hdinsight
Hortonworks for Windows
http://aka.ms/hdp
Microsoft Big Data Support
http://aka.ms/bigdatasupport

The document discusses implementing an event sourcing strategy on Azure. Event sourcing stores an entire history of events and allows for reconstructing application state. It is beneficial for write-heavy workloads and provides an audit log. The document demonstrates using Cosmos DB as the central data store, Event Hubs to capture events, Azure Functions to handle events, and materialized views from the change feed to enable efficient querying. Key advantages are scalability, concurrency, and auditability of data changes over time.

Building event-driven Serverless Apps with Azure Functions and Azure Cosmos DBMicrosoft Tech Community

Migration of a large IT-InfrastrukturAndreas Lezgus

Roadshow: Windows Server 2016 «vNext»Digicomp Academy AG

Mit der neusten Version in der Windows Server Familie geht Microsoft den konsequenten Weg weiter in die Public-, Private- oder Hybrid-Cloud. Oliver Ryf zeigte den Teilnehmern unserer Roadshow einen Überblick der nächsten Windows-Server-Version. Hyper-V, Failover Clustering und Storage Services sind nur einige Highlights. Wirklich coole Neuerungen verbergen sich auch hinter RDS, ADFS und WebApp Proxy. Und zum Schluss gibts noch das Zückerchen in Form von PowerShell 5.0.

Microsoft System Center Day 2011netlogix

Modernes Rechenzentrum Microsoft Österreich

Der flexible Arbeitsplatz von Microsoft - Windows 8ProTechnology GmbH

Infrastructure Solution Day | PrivateMicrosoft Österreich

Data Governance in Apache Falcon - Hadoop Summit Brussels 2015 Seetharam Venkatesh

Apache Falcon is a data management platform that allows users to centrally manage data lifecycles across Hadoop clusters. It defines data entities like clusters, feeds, and processes to represent data pipelines. Falcon then automatically generates workflows to orchestrate the movement of data according to defined policies for replication, retention, and late data handling. It also provides data governance features like lineage tracing, auditing, and tagging. The latest version of Falcon includes new capabilities for disaster recovery mirroring and replication to cloud storage services.

Infrastructure Solution Day | FinalMicrosoft Österreich

Microsoft Lizenzierung – ServerMicrosoft Österreich

Microsoft: #DigitaleHelden Symposium - Graphic RecordingMicrosoft Österreich

Modernes Rechenzentrum - Future DecodedMicrosoft Österreich

Wsus best practicesConcentrated Technology

This slide deck presentation on best practices for architecting and implementing Windows Server Update Services (WSUS) was used at a technology conference. The document provides an overview and outline of the presentation topics, which include WSUS architecture designs, implementation, troubleshooting tips, and a demonstration. Contact information is provided for the presenting company for additional information.

Microsoft Trusted Cloud - Harald Leitenmüller (Microsoft)Microsoft Österreich

The document discusses security, privacy, and control of customer data in Microsoft's trusted cloud. It addresses questions about whether customer data is safe, whether it belongs to customers, and whether customers have control. It outlines Microsoft's technical and process controls to encrypt customer data, ensure only authorized access, and give customers choice over and deletion of their data. These controls are aimed to address issues raised by the invalidation of the EU's Safe Harbor framework and ensure compliance with European data protection laws.

Tipps & Tricks zum Aufbau einer Unternehmenscloud mit CC13OPITZ CONSULTING Deutschland

In diesem Vortrag ging es um die praktische Umsetzung von verschiedenen Cloud-Varianten: - DBaaS - IaaS - PaaS - MWaaS Wir zeigen an konkreten Beispielen, wie man eine Cloud auf einer Exadata aufsetzt. Dabei werden unterschiedliche Architekturaspekte angesprochen: - VLAN Tagging - Backup mit ZFS - Exadata Vorteile - ZFS Storage Appliance Unsere Experten Stefan Seck und Borys Neselovskyi hielten diesen Vortrag am 15.11.2017 bei der DOAG Konferenz in Nürnberg.

Wsus sample scriptsConcentrated Technology

This document provides an overview of sample scripts for Windows Server Update Services (WSUS). It describes scripts that can remotely install the WSUS client, enumerate installed and missing patches on multiple computers, perform on-demand patching of multiple machines, and match security updates to their corresponding Microsoft advisory numbers. The scripts are offered without warranty and are intended to demonstrate what can be automated through scripting WSUS functionality.

SharePoint 2010 Infrastruktur Planung in UnternehmenMichael Kirst-Neshva

Microsoft Lizenzierung – Schwerpunkt DesktopprogrammeMicrosoft Österreich

Windows 10 im UnternehmenA. Baggenstos & Co. AG

Introduction to Azure Stream AnalyticsSlava Kokaev

This document provides an introduction and overview of Azure Stream Analytics presented by Slava Kokaev. The summary includes: - Slava Kokaev introduces Azure Stream Analytics and discusses its key capabilities including ease of use, low cost, reliability, connectivity, ability to join streams with reference data, and scalability. - The architecture of Azure Stream Analytics is explained, including how it connects to data sources like Event Hubs and outputs data to services like Power BI. Stream analytics jobs have inputs, queries to transform data, and outputs. - The presentation covers the Stream Analytics query language and temporal windows like tumbling, hopping, and sliding windows that can be used to analyze streaming data.

Real Time Power BIDavide Mauri

Real-Time PowerBISolidQIT

MSDN - Converting an existing ASP.NET application to Windows AzureMaarten Balliauw

Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim

This document discusses using Azure services for big data analytics and data insights. It provides an overview of Azure services like Azure Batch, Azure Data Lake, Azure HDInsight and Power BI. It then describes a demo solution that uses these Azure services to analyze job posting data, including collecting data using a .NET application, storing in Azure Data Lake Store, processing with Azure Data Lake Analytics and Azure HDInsight, and visualizing results in Power BI. The presentation includes architecture diagrams and discusses implementation details.

Power BI for Big Data and the New Look of Big Data SolutionsJames Serra

New features in Power BI give it enterprise tools, but that does not mean it automatically creates an enterprise solution. In this talk we will cover these new features (composite models, aggregations tables, dataflow) as well as Azure Data Lake Store Gen2, and describe the use cases and products of an individual, departmental, and enterprise big data solution. We will also talk about why a data warehouse and cubes still should be part of an enterprise solution, and how a data lake should be organized.

Internet of Things in TbilisiAlexey Bokov

Microsoft Azure IoT 手把手實作 @ K.NET by Maduka (2017-8-12)Jeff Chu

SharePoint Days Casablanca 2016 - Tout ce que vous devez savoir sur Power BI v2Benoit Jester

This document provides an overview of Power BI version 2. It introduces Power BI Desktop for creating reports and visualizations, PowerBI.com for publishing dashboards and connecting to data sources, and the Power BI mobile app. Key concepts discussed include dashboards, reports, datasets, tiles, and content packs. The document also demonstrates connecting to various data sources, integrating Power BI visualizations, and using the REST API. It concludes that Power BI is a powerful, easy to use, and extensible business intelligence tool.

Building Cloud-Native Applications with Microsoft Windows AzureBill Wilder

Cloud computing is here to stay, and it is never too soon to begin understanding the impact it will have on application architecture. In this talk we will discuss the two most significant architectural mind-shifts, discussing the key patterns changes generally and seeing how these new cloud patterns map naturally into specific programming practices in Windows Azure. Specifically this relates to (a) Azure Roles and Queues and how to combine them using cloud-friendly design patterns, and (b) the combination of relational data and non-relational data, how to decide among them, and how to combine them. The goal is for mere mortals to build highly reliable applications that scale economically. The concepts discussed in this talk are relevant for developers and architects building systems for the cloud today, or who want to be prepared to move to the cloud in the future. This talk was delivered by Bill Wilder at the Vermont Code Camp 2 on 11-Sept-2010.

More Related Content

Viewers also liked (12)

Data Governance in Apache Falcon - Hadoop Summit Brussels 2015 Seetharam Venkatesh

Infrastructure Solution Day | FinalMicrosoft Österreich

Microsoft Lizenzierung – ServerMicrosoft Österreich

Microsoft: #DigitaleHelden Symposium - Graphic RecordingMicrosoft Österreich

Modernes Rechenzentrum - Future DecodedMicrosoft Österreich

Wsus best practicesConcentrated Technology

Microsoft Trusted Cloud - Harald Leitenmüller (Microsoft)Microsoft Österreich

Tipps & Tricks zum Aufbau einer Unternehmenscloud mit CC13OPITZ CONSULTING Deutschland

Wsus sample scriptsConcentrated Technology

SharePoint 2010 Infrastruktur Planung in UnternehmenMichael Kirst-Neshva

Microsoft Lizenzierung – Schwerpunkt DesktopprogrammeMicrosoft Österreich

Windows 10 im UnternehmenA. Baggenstos & Co. AG

Data Governance in Apache Falcon - Hadoop Summit Brussels 2015 Seetharam Venkatesh

Infrastructure Solution Day | FinalMicrosoft Österreich

Microsoft Lizenzierung – ServerMicrosoft Österreich

Microsoft: #DigitaleHelden Symposium - Graphic RecordingMicrosoft Österreich

Modernes Rechenzentrum - Future DecodedMicrosoft Österreich

Wsus best practicesConcentrated Technology

Microsoft Trusted Cloud - Harald Leitenmüller (Microsoft)Microsoft Österreich

Tipps & Tricks zum Aufbau einer Unternehmenscloud mit CC13OPITZ CONSULTING Deutschland

Wsus sample scriptsConcentrated Technology

SharePoint 2010 Infrastruktur Planung in UnternehmenMichael Kirst-Neshva

Microsoft Lizenzierung – Schwerpunkt DesktopprogrammeMicrosoft Österreich

Windows 10 im UnternehmenA. Baggenstos & Co. AG

Similar to Big Data DIY (20)

Introduction to Azure Stream AnalyticsSlava Kokaev

Real Time Power BIDavide Mauri

Real-Time PowerBISolidQIT

MSDN - Converting an existing ASP.NET application to Windows AzureMaarten Balliauw

Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim

Power BI for Big Data and the New Look of Big Data SolutionsJames Serra

Internet of Things in TbilisiAlexey Bokov

Microsoft Azure IoT 手把手實作 @ K.NET by Maduka (2017-8-12)Jeff Chu

SharePoint Days Casablanca 2016 - Tout ce que vous devez savoir sur Power BI v2Benoit Jester

Building Cloud-Native Applications with Microsoft Windows AzureBill Wilder

How to manage one million messages per second using Azure, Radu Vunvulea, ITD...Radu Vunvulea

At the beginning of a project it is simple to promise to clients different things, but when you need to prove them you might have discover that is impossible. Living in the IoT era we need to be able to process large amounts of content per second. This is why in this session we will see how we can construct a solution around Azure that can handle very easy 1M messages per second. We will start the session with a real time demo and we will continue to describe how we can construct such a system using Azure Services in less than 8h. Each Azure component that was used for the demo will be describes in detail and will see what are the pros and cons of it.

Microsoft Build 2020: Data Science RecapMark Tabladillo

Democratizing Artificial IntelligenceDmitry Petukhov

This document summarizes the evolution of machine learning tools in the cloud from 2015 to 2017. It describes how in 2015, major cloud providers like Azure, Amazon, and Google launched early machine learning services. From 2015 to 2016, these providers also released popular deep learning frameworks like TensorFlow as open source. During this time period, the providers began offering deep learning models and GPU computing as cloud services. The document argues that these developments have helped democratize artificial intelligence and machine learning.

Big Data, Bigger BrainsDenny Lee

Go Serverless with Cosmos DB, Azure Functions and BlazorTimothy McAliley

This document discusses building serverless applications using Azure Functions, Azure Cosmos DB, and Blazor. It describes how serverless applications differ from traditional apps by having micro-functionality, dynamic scaling, and abstraction of servers. Benefits include focusing on business logic, faster development, and reduced DevOps. Common triggers for Functions include events from Cosmos DB, Blob storage, webhooks, and APIs. Suggestions are provided for getting started with serverless development using Azure Functions and related services.

Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.

This document summarizes how businesses can transform through business intelligence (BI) and advanced analytics using Microsoft's modern BI platform. It outlines the Power BI and Azure Analysis Services tools for visualization, data modeling, and analytics. It also discusses how Collective Intelligence and Microsoft can help customers accelerate their move to a data-driven culture and realize benefits like increased productivity and cost savings by implementing BI and advanced analytics solutions in the cloud. The presentation includes demonstrations of Power BI and Azure Analysis Services.

Modern business intelligenceMichael Stephenson

Azure Functions Hands-on lab | Global Azure Bootcamp | Radu VunvuleaRadu Vunvulea

The document discusses how Azure Functions work and their uses. Azure Functions can be triggered by events on a schedule, HTTP requests, Azure services like storage, queues, and event hubs. Functions support inputs from these services and can write outputs to storage, queues, databases. Popular uses of Functions include timer-based processing, service event processing, serverless applications, backends, and real-time processing.

Ch-ch-ch-ch-changes....Stitch Triggers - Andrew MorganMongoDB

Intelligent apps are emerging as the next frontier in analytics and application development. Learn how to build intelligent apps on MongoDB powered by Google Cloud with TensorFlow for machine learning and DialogFlow for artificial intelligence. Get your developers and data scientists to finally work together to build applications that understand your customer, automate their tasks, and provide knowledge and decision support.

Pbi iot data vizDavid Moss

This document discusses using Power BI to create real-time dashboards for IoT data. It introduces Azure IoT services like IoT Hub and Cortana Intelligence Suite for collecting and analyzing IoT data. It demonstrates using Power BI Desktop to build dashboards and connecting them to real-time data streams from PubNub or Azure Stream Analytics. APIs allow programmatically pushing IoT data to Power BI for real-time visualization of metrics like device telemetry. Integration with Azure services enables scalable real-time dashboards for IoT applications and devices.

Introduction to Azure Stream AnalyticsSlava Kokaev

Real Time Power BIDavide Mauri

Real-Time PowerBISolidQIT

MSDN - Converting an existing ASP.NET application to Windows AzureMaarten Balliauw

Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim

Power BI for Big Data and the New Look of Big Data SolutionsJames Serra

Internet of Things in TbilisiAlexey Bokov

Microsoft Azure IoT 手把手實作 @ K.NET by Maduka (2017-8-12)Jeff Chu

SharePoint Days Casablanca 2016 - Tout ce que vous devez savoir sur Power BI v2Benoit Jester

Building Cloud-Native Applications with Microsoft Windows AzureBill Wilder

How to manage one million messages per second using Azure, Radu Vunvulea, ITD...Radu Vunvulea

Microsoft Build 2020: Data Science RecapMark Tabladillo

Democratizing Artificial IntelligenceDmitry Petukhov

Big Data, Bigger BrainsDenny Lee

Go Serverless with Cosmos DB, Azure Functions and BlazorTimothy McAliley

Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.

Modern business intelligenceMichael Stephenson

Azure Functions Hands-on lab | Global Azure Bootcamp | Radu VunvuleaRadu Vunvulea

Ch-ch-ch-ch-changes....Stitch Triggers - Andrew MorganMongoDB

Pbi iot data vizDavid Moss

More from Olivia Klose (9)

Evolution of AI - Why is my computer still so dumb?Olivia Klose

The document discusses deep learning and artificial intelligence. It provides an overview of the history and development of AI from early attempts at machine translation and reasoning to current successes in deep learning. It discusses how deep learning is achieving human-level performance in areas like image recognition, speech recognition, and Go due to factors like increased computing power, large datasets, and improved algorithms. However, it also notes limitations in AI's understanding of language, context, and semantics. The document points to future areas of development like multi-modal interaction, context-aware conversations, and smarter hardware.

Deep Learning for New User Interactions (Gestures, Speech and Emotions)Olivia Klose

Who doesn't know of the super cool scenes in "Minority Report": intelligent machines and innovative user interfaces with speech and gestures? In this deep dive, we will talk about how deep learning can enable such interactions using some Microsoft projects in the area of NUI (Natural User Interfaces): Kinect, Handpose, Skype Translator etc. Which predictive models are being used? What do we do if we don't have sufficient data? Finally we will dare an outlook into the future how new and innovative human-machine-interaction concepts can change our user experience with computers and in light of industry 4.0.

TechCamps - Internet of ThingsOlivia Klose

The document discusses Internet of Things (IoT) and Azure IoT services. It provides an overview of IoT scenarios across different industries like home, transportation, healthcare, buildings and cities. It then discusses how Azure IoT services can be used for device connectivity, analytics, security and command and control capabilities. It also includes examples of using Event Hubs and Stream Analytics for IoT data ingestion and processing.

What does Bob really want? Recommenders in the CloudOlivia Klose

What does Bob really want? Building recommendation systems based on cloud technologies Machine Learning or Data Science are one of today's hottest buzzwords. The scenarios in which Machine Learning can be applied are diverse and can range from predicting football scores to personalised recommendations in online shops to predictive maintenance in manufacturing. In this session I will present Azure Machine Learning - a service in Microsoft Azure that anyone can use to build predictive models using the provided machine learning algorithms and deploy it as a web service. Here, I will go through various options on how to use AzureML when going beyond just finding the products in retail that are in high demand: predicting the taste and preferences of customers (old and new) and giving appropriate recommendations.

Developer Week 2015: Azure Machine LearningOlivia Klose

Machine Learning oder Data Science sind in einer Zeit, in der die Menge an Daten stetig zunimmt, wertvolle Hilfsmittel. Dementsprechend gehören Data Scientists derzeit zu den begehrtesten Experten in der IT-Branche. Die Einsatzbereiche sind vielfältig und reichen von der Vorhersage von Fußballergebnissen über persönliche Kaufempfehlungen in Online-Shops bis zum Ergreifen präventiver Wartungsmaßnahmen in der industriellen Produktion. In diesem Vortrag werden wir Microsoft Azure Machine Learning vorstellen - ein Dienst von Microsoft Azure, mit dem Entwickler Predictive Analytics-Modelle anhand von Machine Learning-Algorithmen bauen und als Cloud Service veröffentlichen können. Dabei gehen wir einen End-to-End Workflow durch, mit dem wir die Überlebenschancen auf der Titanic berechnen können: wir entnehmen existierende Daten, erstellen darauf basiert verschiedene Modelle, die gleich in Anwendungen eingebaut werden können.

Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndOlivia Klose

Predictive Analytics oder Data Science sind in einer Zeit, in der die Menge an Daten stetig zunimmt, wertvolle Hilfsmittel. Die Einsatzbereiche sind vielfältig und reichen von der Vorhersage von Fußballergebnissen über persönliche Kaufempfehlungen in Online-Shops bis zum Ergreifen präventiver Wartungsmaßnahmen in der industriellen Produktion. In diesem Vortrag werden verschiedene Dienste der Azure-Datenplattform vorgestellt, mit denen aus der Datenflut hilfreiche Erkenntnisse gewonnen werden können.

Would I have survived the Titanic? Machine Learning in Microsoft AzureOlivia Klose

Machine Learning or Data Science are one of today's hottest buzzwords. The scenarios in which Machine Learning can be applied are diverse and can range from predicting football scores to personalised recommendations in online shops to predictive maintenance in manufacturing. In this session I will present Azure Machine Learning - a service in Microsoft Azure that anyone can use to build predictive models using the provided machine learning algorithms and deploy it as a web service. Here, I will go through an end-to-end workflow in which I will predict the survival chances on the Titanic.

Jumpstarting big data projects / Architectural Considerations of HDInsight Ap...Olivia Klose

Hadoop is everywhere, also in the fashion e-commerce. We recently built a solution with a leader in fashion e-commerce to drive their visitor experience and provide a personalised view using recommendations. In this presentation, we will walk through the architectural considerations and decisions made in building the solution on Microsoft Azure and especially in HDInsight (the Hadoop implementation as a platform as a service on Microsoft Azure), highlighting the following stages: • Data Storage • Data Ingestion • Data Processing • Orchestration • Validation & Troubleshooting As we go through each stage, we present the technology options (both from the Microsoft Azure and Open Source stack) and our reasoning for selecting the optimal one in our case.

Big Data mit Microsoft?Olivia Klose

This document summarizes a presentation about how HDInsight, SQL Server 2014, and Excel can work together with Big Data. It provides an overview of how these Microsoft technologies integrate with Hadoop on HDInsight to extract, analyze, and visualize large, diverse datasets. Examples are given of real-time dashboards and mashups created with these tools to analyze Twitter data stored on HDInsight clusters on Azure.

Evolution of AI - Why is my computer still so dumb?Olivia Klose

Deep Learning for New User Interactions (Gestures, Speech and Emotions)Olivia Klose

TechCamps - Internet of ThingsOlivia Klose

What does Bob really want? Recommenders in the CloudOlivia Klose

Developer Week 2015: Azure Machine LearningOlivia Klose

Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndOlivia Klose

Would I have survived the Titanic? Machine Learning in Microsoft AzureOlivia Klose

Jumpstarting big data projects / Architectural Considerations of HDInsight Ap...Olivia Klose

Big Data mit Microsoft?Olivia Klose

Recently uploaded (20)

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Mobile App Development Company in Saudi ArabiaSteve Jonas

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

Big Data DIY

1. Big Data Do-It-Yourself mit Microsoft Olivia Klose Technical Evangelist, Microsoft Deutschland GmbH aka.ms/oliviaklose, @oliviaklose

2. Die 3 Vs MB GB TB PB batch periodic real time table data base un- struc- tured web Big Data, Gesellschaft für Informatik, 2013, http://www.gi.de/service/informatiklexikon/ detailansicht/article/big-data.html

3. Daten

4. Demo Demo Tweets extrahieren: Echtzeit-Dashboard

5. StreamInsight

6. Extract StreamInsight Azure SQL Azure Blob Storage Real-Time Dashboard Twitter Tweets extrahieren

7. Demo Demo Tweets speichern im Windows Azure Blob Storage

8. Hadoop

9. Hadoop

10. MapReduce

11. MapReduce

12. MapReduce: Map

13. MapReduce: Reduce

14. Analyze Hive Tables … Azure Blob Storage Azure Blob Storage Mash Up & Visualise Tweets in HDInsight Analyze Azure SQL Real-Time Dashboard Twitter Extract StreamInsight

16. HDInsight auf PowerShell

17. Analyze Hive Tables … Azure Blob Storage Azure Blob Storage Mash Up & Visualise Hive in HDInsight Analyze Hive Tables … Azure SQL Real-Time Dashboard Twitter Extract StreamInsight

19. Mash Up & VisualiseAzure SQL Tweets visualisieren Mash Up & Visualise Analyze Hive Tables … Real-Time Dashboard Twitter Extract StreamInsight Azure SQL Azure Blob Storage

20. Demo Demo Tweets visualisieren

21. Demo Demo Tweets visualisieren

22. Extract StreamInsight Azure SQL Azure Blob Storage Real-Time Dashboard Twitter Big Data Twitter Infrastruktur Mash Up & Visualise Analyze Hive Tables …

23. Big Data DIY in der MVA http://aka.ms/BigDataDIY

24. Weitere Informationen olivia.klose @microsoft.com aka.ms/oliviaklose Twitter: @oliviaklose Big Data DIY Kurs http://aka.ms/BigDataDIY Windows Azure Trial http://aka.ms/azurenow HDInsight http://tinyurl.com/hdinsight Hortonworks for Windows http://aka.ms/hdp Microsoft Big Data Support http://aka.ms/bigdatasupport

Big Data DIY

Recommended

More Related Content

Viewers also liked (12)

Similar to Big Data DIY (20)

More from Olivia Klose (9)

Recently uploaded (20)

Big Data DIY