Mortar: Hadoop-as-a-Service + Open Source Framework | AWS re: Invent public …

Dec 11, 20124 likes1,214 views

Presentation from AWS re: Invent, where Mortar announced it's public availability on stage. Mortar facilitates Hadoop data development in two parts: an open source data development framework (like Rails for Hadoop) and a PaaS (like Heroku for Hadoop). The open source framework allows for sharing/repeating/maintaining code history, automated testing, and one-button deploy. The PaaS provides high availability execution, full job history, and helps users identify problems.

Mortar: Hadoop-as-a-Service + Open Source Framework | AWS re: Invent public …

Open-source software
development frameworks

Open-source software dev frameworks

(and many more...)

Every platform needs
open-source,
code-based dev frameworks
• Avoid repeat work
• Remain 100% customizable
• Escape vendor lock-in

Data work today
• Proprietary / GUI / No framework
• Not reusable
• Little collaboration
• Too many errors, too slow to fix

“Mortar takes something complex
and makes it simple and intuitive.”
—Jon Coveney, Twitter

What big data system should I use? Hadoop, HPCC, Disco, Storm…
What Hadoop distro should I use?
How much will this cost? Should I do it some other way?
How long is this going to take to learn? Should I do it some other way?
How many machines should I buy?
Can I run in the cloud?
How should I interact with it? Pig, Hive, Cascading, Scalding, Cascalog

Weeks
Can I use libraries I need?
How do I install everything?
How can my team share code?
How can I reuse code?
Is my workload typical?
How can I safely deploy?
How do I know if what I've written is correct?
Are there any libraries I could start with?
Can I connect to my key-value store?
Can I do machine learning in Hadoop?
Is it secure?
What if I need help?

—Alan Gates, Hortonworks co-founder
OPEN SOURCED PIG

“Our focus in designing Pig has always been to
make Hadoop easy...

Mortar's approach is right on—they extend our
quick start and ease of use focuses with pre-
built Hadoop clusters, clear examples, code
organization templates, and github for social
sharing of the code.”

Can Mortar help you?
Mortar is for analyzing lots of data in AWS.

Who is Mortar for?
Mortar serves companies of all sizes from any
industry.

—Dwight Merriman
FOUNDER OF 10GEN (MAKER OF MONGODB), DOUBLECLICK (ACQ.
GOOGLE), SHOPWIKI, BUSINESS INSIDER, GILT GROUPE

“...Mortar fits right in with our vision of the
future...
With this exciting launch, MongoDB users can
now also seamlessly use Mortar.”

By and for engineers
and data scientists

Pig is easy to learn
(and we’ve made it easier)

Illustrate is awesome
• Find your mistakes
• Understand code before collaborating
• Automated tests: a way to test every condition

Hadoop & Python are powerful data science tools

...but they haven’t worked together before.

Now you can use Hadoop & real Python on Mortar

What you just saw
• Installed Mortar
• Made a new project
• Cloned a project
• Ran the project
• Illustrated project
• Use Python and other libraries on Hadoop

2 options for using Mortar:

- Git Projects: modularity, testability, code
sharing, local dev, and revision control.

- Web Projects: zero install, in the browser

One-hour challenge
• Use your browser
• Minutes to connect data
• Productive in one hour

How does Mortar fit with other
As a good citizen, Mortar has a rich API

How about speed?
Full speed, directly on Hadoop

Mortar revolutionizes
your data pipeline.
• Easy start
• Keeps you productive
• Collaborate with data
• No lock-in
• Easy to budget

Tiers
• Free | Service use unlimited | 10 node-hours
• Pay as you Go | $0.89/node-hour | support
• Enterprise | $3,000/month | $0.69/node-hour | live
support

This document summarizes a presentation about Kappa Architecture 2.0 given by Juantomás García. It discusses the origins of Kappa Architecture as coined by Jay Kreps in 2014 for handling real-time data. It then outlines how Kappa Architecture uses tools like Apache Kafka, Apache Spark, and Apache Samza to handle real-time and batch data processing. The presentation also provides examples of how Kappa Architecture has been applied to a use case of monitoring car data in real-time and scaling REST APIs. It concludes by discussing future improvements and variations of Kappa Architecture.

Codemotion madrid 2017 Arquitectura kappa 2.0Juantomás García Molina

How to create a personal knowledge graph IBM Meetup Big Data Madrid 2017Juantomás García Molina

This document discusses how to create a personal knowledge graph. It begins by explaining why a knowledge graph is needed, as the speaker manages a lot of information from different sources and needs a way to organize and query it. It then discusses how to build a knowledge graph using concepts like explicit and implicit information, graph databases, and collective intelligence. The speaker advocates using cloud services, containers, notebooks and machine learning to build the knowledge graph. The first steps proposed are to name the project "Boosterme" and start a GitHub repository.

Gdg cloud london 2017 kappa architecture 2.0 copiaJuantomás García Molina

This document summarizes a presentation by Juantomás García on Kappa Architecture 2.0. It introduces Kappa Architecture, which was coined in 2014 as a way to handle both batch and real-time processing of streaming data. The presentation describes the traditional data flow, and how Kappa Architecture uses tools like Apache Kafka, Apache Spark, and Apache Samza to allow for real-time and batch processing of data. It also provides examples of how Kappa Architecture has been applied to use cases involving monitoring vehicle data in real-time and scaling APIs to handle many requests.

Scalaua 2017 kyev kappa architecture 2.0Juantomás García Molina

This document discusses Kappa Architecture 2.0 and tools for real-time data processing. It introduces Jay Kreps, who coined the term "Kappa Architecture" and has worked on several related projects. The document then contrasts the usual batch processing data flow with the Kappa Architecture approach of combining real-time and batch processing. It provides examples of using Spark and Kafka for real-time analytics and discusses taking the Kappa Architecture to version 3.0 with additional tools like Apache Druid, Kafka Streams, and Google Cloud.

Meetup big data developers 2017 madrid - spark real use casesJuantomás García Molina

This document discusses Spark real use cases and the Kappa architecture. It introduces Juantomás García and provides background on Jay Kreps who coined the term "Kappa Architecture". The document then describes the usual data flow versus the Kappa Architecture approach. It provides examples of tools that can be used and highlights some favorite Spark features. The document also discusses some real use cases including monitoring car data and scaling REST interfaces and queries. It emphasizes thinking big, using lightweight technologies, and mixing tools from different sources.

Not Just Another Overview of Apache HadoopAdaryl "Bob" Wakefield, MBA

Getting started with GCP ( Google Cloud Platform)bigdata trunk

This document provides an overview and introduction to Google Cloud Platform (GCP). It begins with introductions and an agenda. It then discusses cloud computing concepts like deployment models and service models. It provides details on specific GCP computing, storage, machine learning, and other services. It describes how to set up Qwiklabs to do hands-on labs with GCP. Finally, it discusses next steps like training and certification for expanding GCP knowledge.

Recommender Trends 2014Torben Brodt

Lightning talk: building a cloud of faresRalph Ligtenberg

Ralph Ligtenberg discusses moving Travix's "Fare Cache" system for storing airline fare search results from an on-premise Cassandra database to Google Cloud. The original system was difficult to scale and maintain. The new "Fare Cloud" uses microservices written in Go hosted on Google Cloud Platform services like BigTable, Datastore, and Dataflow. It took 6 months to implement and provides better performance and cost savings compared to the original system. The new architecture stores fare search results in the cloud to serve multiple use cases for Travix's products.

Introduction to Azure HDInsightStéphane Fréchette

Apache Hadoop is a platform that has emerged to help extract insight from all that data. In this session, you will learn the basics of Hadoop, how to get up and running with Hadoop in the cloud using Microsoft Azure HDInsight, and how you can leverage the deeper integration of Visual Studio to integrate Big Data with your existing applications. No previous experience with Hadoop is required. Presented @ MSDEVMTL on Saturday February , 2015

GigaOM 2013 highlightsFrancesco Bovoli

Google laid its own underwater cables to improve its cloud infrastructure and hosts 3 million applications. CERN adopted OpenStack to manage its increasing computing needs without reinventing the wheel. BMW built a private cloud to manage over 100,000 devices and plans with absolute zero downtime, going live in 2013. Facebook started the open compute project to apply open source principles to hardware and eliminate proprietary elements in its servers.

M gray ands_ttt2_perth_pawsey_training_dsw2018ARDC

JBCN barcelona 2017 kappa architecture 2.0Juantomás García Molina

This document provides an overview of Kappa Architecture presented by Juantomás García. It includes: 1) A brief history of Kappa Architecture, which was coined in 2014 by Jay Kreps to describe an architecture using real-time streaming data and batch processing. 2) An explanation of how Kappa Architecture works, using streaming data pipelines to continuously update real-time views and batch jobs to rebuild views from historical data. 3) A real use case example of how OpenSistemas used Kappa Architecture to monitor vehicle data from many cars in real-time and perform analytics.

LogDNA and CloudFoundry Webinar: Open Ecosystems, Interoperability + Multi-Cl...LogDNA

OTTO-multicloudOtto (GmbH & Co KG)

This document discusses the pros and cons of a multicloud approach versus using a single cloud provider. It acknowledges that while a multicloud strategy is important for reducing vendor lock-in, in practice it may be better for new teams to start with AWS due to existing knowledge and support structures. The document provides guidance on how to adopt a multicloud approach over time while still allowing individual teams to choose the cloud provider that best fits their current needs and experience.

Google Cloud Platform (GCP)Chetan Sharma

Cloud computing is the delivery of computing resources like servers, storage, databases, and software over the Internet. There are different types of cloud including public, private, and hybrid clouds. Google Cloud Platform (GCP) provides various computing, storage, networking, security, and other services to users. GCP offers products and services for compute, storage, networking, security, big data, machine learning, and management tools to build solutions in the cloud. Some advantages of GCP include flexible billing, fast scaling, global datacenter network, and petabyte data processing capabilities.

Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Chris Jang

This document discusses Google Cloud Platform and its data and analytics capabilities. It begins by explaining the evolution of cloud computing models from virtualized data centers to true on-demand cloud services. It then highlights some of Google Cloud Platform's key differentiators like true cloud economics, future-proof infrastructure, access to innovation, and Google-grade security. The document provides overviews of Google Cloud Platform's storage, database, big data, and machine learning offerings and common use cases for each. It also showcases some of Google's innovations in data analytics and machine learning technologies.

Google cloudvipin ojha

Google Cloud Platform provides cloud computing services such as compute power, database storage, applications, and other IT services via remote servers accessed over the internet. It launched services starting in 2008 and has grown to include compute engine, storage, networking, databases, machine learning, and more. Pricing is based on usage with free tiers and discounts for heavy usage to reduce costs compared to maintaining own hardware.

How Open Source / Open Technology Could Help On Your ProjectWan Leung Wong

IoT is Something to Figure OutPeter Hoddie

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache ApexApache Apex

Azure Notebooks - Jupyter for the CloudCameron Vetter

This document provides an overview and introduction to Azure Notebooks and Jupyter notebooks. It discusses what Jupyter notebooks are, how they can be used for tasks like data analysis, and how Azure Notebooks builds on Jupyter by providing a cloud-based notebook environment. The document then demonstrates various features of notebooks like code execution, markdown, and data visualization using examples. It also discusses where notebooks fit best versus other tools and environments.

Cloud computing and Hadoop introductionchristian.perez

This document introduces BioCloud, a tool for using cloud computing platforms like Hadoop to process large biological datasets in parallel. It discusses how biology applications are becoming more resource-intensive and how cloud platforms can provide scalable computing resources at a lower cost than local hardware. It provides an overview of Hadoop and MapReduce as an framework for processing vast amounts of data across clusters of machines. Examples of companies using Hadoop include Google, Yahoo, and Facebook for applications involving terabytes of data.

Keynote at Converge 2019Travis Oliphant

How bigtop leveraged docker for build automation and one click hadoop provis...Evans Ye

Architecting Your First Big Data ImplementationAdaryl "Bob" Wakefield, MBA

This document provides an overview of architecting a first big data implementation. It defines key concepts like Hadoop, NoSQL databases, and real-time processing. It recommends asking questions about data, technology stack, and skills before starting a project. Distributed file systems, batch tools, and streaming systems like Kafka are important technologies for big data architectures. The document emphasizes moving from batch to real-time processing as a major opportunity.

Ice dec05-04-wan leungChun Ming Au Yeung

This document discusses the use of open source tools for entrepreneurship and software development. It begins by stating that the talk is intended for newcomers to open source, startups, and those interested in software projects or careers. It then provides background on the speaker and their experience before defining open source as promoting universal access and redistribution of designs. The document lists many popular open source databases, frameworks, servers and other tools that can be used for projects. It emphasizes asking the right questions about goals, users, and requirements before choosing tools. It also stresses system design, testing features with users, and ongoing maintenance like security, backups and monitoring.

Choosing the right Technologies for your next unicorn.Gladson DSouza

Startup India had its 5th Meetup on "Choosing The Right Technologies For Your Next Unicorn” on August, 05 2017! We’re had the coolest techies speak about the latest and tested technologies used by the Best global tech enterprises. From what to why for you to reach your ultimate Goal – to become a Unicorn! We cover a range of topics like: • Technologies that aren't disrupted • Languages and frameworks • Agile Project Management • Web Security • Automated Testing • Tech stacks of Whatsapp, Uber, Facebook and other large enterprises Why should you have attend? • To understand the future of technology and which direction is recommended as of 2017 • Great Insights on present Latest Technologies • Growing tech adoption trend globally and in India • Ready case studies of present Unicorns.

Getting Started with Big Data in the CloudRightScale

More Related Content

What's hot (11)

Recommender Trends 2014Torben Brodt

Lightning talk: building a cloud of faresRalph Ligtenberg

Introduction to Azure HDInsightStéphane Fréchette

GigaOM 2013 highlightsFrancesco Bovoli

M gray ands_ttt2_perth_pawsey_training_dsw2018ARDC

JBCN barcelona 2017 kappa architecture 2.0Juantomás García Molina

LogDNA and CloudFoundry Webinar: Open Ecosystems, Interoperability + Multi-Cl...LogDNA

OTTO-multicloudOtto (GmbH & Co KG)

Google Cloud Platform (GCP)Chetan Sharma

Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Chris Jang

Google cloudvipin ojha

Recommender Trends 2014Torben Brodt

Lightning talk: building a cloud of faresRalph Ligtenberg

Introduction to Azure HDInsightStéphane Fréchette

GigaOM 2013 highlightsFrancesco Bovoli

M gray ands_ttt2_perth_pawsey_training_dsw2018ARDC

JBCN barcelona 2017 kappa architecture 2.0Juantomás García Molina

LogDNA and CloudFoundry Webinar: Open Ecosystems, Interoperability + Multi-Cl...LogDNA

OTTO-multicloudOtto (GmbH & Co KG)

Google Cloud Platform (GCP)Chetan Sharma

Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Chris Jang

Google cloudvipin ojha

Similar to Mortar: Hadoop-as-a-Service + Open Source Framework | AWS re: Invent public … (20)

How Open Source / Open Technology Could Help On Your ProjectWan Leung Wong

IoT is Something to Figure OutPeter Hoddie

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache ApexApache Apex

Azure Notebooks - Jupyter for the CloudCameron Vetter

Cloud computing and Hadoop introductionchristian.perez

Keynote at Converge 2019Travis Oliphant

How bigtop leveraged docker for build automation and one click hadoop provis...Evans Ye

Architecting Your First Big Data ImplementationAdaryl "Bob" Wakefield, MBA

Ice dec05-04-wan leungChun Ming Au Yeung

Choosing the right Technologies for your next unicorn.Gladson DSouza

Getting Started with Big Data in the CloudRightScale

Dev Ops without the OpsKonstantin Gredeskoul

Do you need Ops in your new startup? If not now, then when? And...what is Ops? Learn how to scale ruby-based distributed software infrastructure in the cloud to serve 4,000 requests per second, handle 400 updates per second, and achieve 99.97% uptime – all while building the product at the speed of light. Unimpressed? Now try doing the above altogether without the Ops team, while growing your traffic 100x in 6 months and deploying 5-6 times a day! It could be a dream, but luckily it's a reality that could be yours.

Public PaaS Throwdown!Ronak Mallik

The document summarizes a comparison of various public Platform as a Service (PaaS) options, including AWS Elastic Beanstalk, CloudBees, Cloud Foundry, Heroku, and OpenShift. Key criteria for comparison include features like polygot support, speed of deployment, scalability, lock-in, open source status, ability to go to production, and portability. While all contenders have a free tier and allow for quick deployment, they differ in areas like community/support, post-free costs based on workload, and production readiness. The document concludes that no option is clearly superior and that developers should focus on coding, deploying, and innovating.

All about that reactive uiPaul van Zyl

Slides from my last presentation at the Cape Town Meteor meetup, on optimising the UI, specifically for Hybrid apps and for Meteor JS hybrid apps. The main thrust is really more about design patterns, and carefully controlling data management in your mobile app, with great examples of these patterns out in the real world. see the mobile patterns video here : https://www.youtube.com/watch?v=e6WWX4TF3UI

Habitat OverviewMandi Walls

Habitat is a tool for building and running distributed applications. It aims to standardize packaging and running applications across different environments. With Habitat, applications are packaged into "harts" which contain all their dependencies and can be run on any system. Habitat handles configuration, service discovery, and updates to provide a uniform way to deploy applications. Plans are used to define how to build harts in a reproducible way. The Habitat runtime then manages running applications as services.

Choosing the right parallel compute architecture corehard_by

Multi-core architecture is the present and future way in which the market is addressing Moore’s law limitations. Multi-core workstations, high performance computers, GPUs and the focus on hybrid/ public cloud technologies for offloading and scaling applications is the direction development is heading. Leveraging multiple cores in order to increase application performance and responsiveness is expected especially from classic high-throughput executions such as rendering, simulations, and heavy calculations. Choosing the correct multi-core strategy for your software requirements is essential, making the wrong decision can have serious implications on software performance, scalability, memory usage and other factors. In this overview, we will inspect various considerations for choosing the correct multi-core strategy for your application’s requirement and investigate the pros and cons of multi-threaded development vs multi-process development. For example, Boost’s GIL (Generic Image Library) provides you with the ability to efficiently code image processing algorithms. However, deciding whether your algorithms should be executed as multi-threaded or multi-process has a high impact on your design, coding, future maintenance, scalability, performance, and other factors. A partial list of considerations to take into account before taking this architectural decision includes: - How big are the images I need to process - What risks can I have in terms of race-conditions, timing issues, sharing violations – does it justify multi-threading programming? - Do I have any special communication and synchronization requirements? - How much time would it take my customers to execute a large scenario? - Would I like to scale processing performance by using the cloud or cluster? We will then examine these issues in real-world environments. In order to learn how this issue is being addressed in a real-world scenario, we will examine common development and testing environments we are using in our daily work and compare the multi-core strategies they have implemented in order to promote higher development productivity.

Hadoop-Automation-Tool_RamkishorTakRam Kishor Tak

This document discusses Linux World Training and Developing Center and their work with Linux and open source technologies. It then provides details about using Hadoop for distributed storage and computing of big data through frameworks like HDFS, MapReduce, Pig and Hive. It describes the hardware, software and technology requirements and introduces tools for automating Hadoop cluster deployment and management that can also be accessed through iOS devices. Key innovations discussed are supporting replication of the namenode and enabling cluster deployment and management from an iOS device.

2014 Picking a Platform by Anand KulkarniEuropean Innovation Academy

The document discusses choosing a platform for building an early-stage startup product. It recommends focusing first on speed of development and getting customers, rather than scalability or complex frameworks. Online prototyping tools that require under an hour are ideal initially to test ideas. For more serious apps, Firebase, Meteor or Parse are good options as they are easy to use and allow hosting on services like Heroku, avoiding server management. The goal should be a minimum viable product rather than perfection at the early stages.

Software Engineering in StartupsDusan Omercevic

Apache deep learning 101DataWorks Summit

In my talk I will discuss and show examples of using Apache Hadoop, Apache Hive, Apache MXNet, Apache OpenNLP, Apache NiFi and Apache Spark for deep learning applications. As part of my talk I will walk through using Apache NXNet Pre-Built Models, MXNet's New Model Server with Apache NiFi, executing MXNet with Apache NiFi and running Apache MXNet on edge nodes utilizing Python and Apache MiniFi. This talk is geared towards Data Engineers interested in the basics of Deep Learning with open source Apache tools in a Big Data environment. I will walk through source code examples available in github and run the code live on an Apache Hadoop / YARN / Apache Spark cluster. This will be an introduction to executing Deep Learning Pipelines in an Apache Big Data environment. My talk at Data Works Summit Sydney was listed in top 7 -> https://hortonworks.com/blog/7-sessions-dataworks-summit-sydney-see/ Also have speak at and run Future of Data Princeton and at Oracle Code NYC. Ref: https://community.hortonworks.com/articles/83100/deep-learning-iot-workflows-with-raspberry-pi-mqtt.html https://community.hortonworks.com/articles/146704/edge-analytics-with-nvidia-jetson-tx1-running-apac.html https://dzone.com/refcardz/introduction-to-tensorflow Speaker Timothy Spann, Solutions Engineer, Hortonworks

How Open Source / Open Technology Could Help On Your ProjectWan Leung Wong

IoT is Something to Figure OutPeter Hoddie

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache ApexApache Apex

Azure Notebooks - Jupyter for the CloudCameron Vetter

Cloud computing and Hadoop introductionchristian.perez

Keynote at Converge 2019Travis Oliphant

How bigtop leveraged docker for build automation and one click hadoop provis...Evans Ye

Architecting Your First Big Data ImplementationAdaryl "Bob" Wakefield, MBA

Ice dec05-04-wan leungChun Ming Au Yeung

Choosing the right Technologies for your next unicorn.Gladson DSouza

Getting Started with Big Data in the CloudRightScale

Dev Ops without the OpsKonstantin Gredeskoul

Public PaaS Throwdown!Ronak Mallik

All about that reactive uiPaul van Zyl

Habitat OverviewMandi Walls

Choosing the right parallel compute architecture corehard_by

Hadoop-Automation-Tool_RamkishorTakRam Kishor Tak

2014 Picking a Platform by Anand KulkarniEuropean Innovation Academy

Software Engineering in StartupsDusan Omercevic

Apache deep learning 101DataWorks Summit

More from mortardata (8)

Daeil Kim: Machine Learning at the New York Timesmortardata

1) Machine learning models were used to help uncover suspicious comments related to faulty Takata airbags. Logistic regression identified over 700 new potentially suspicious comments that were previously missed. 2) Topic modeling techniques like LDA can extract interpretable topics from large collections of documents. BNPy and Refinery provide tools for performing scalable topic modeling and analyzing results. 3) Machine learning is also being used for non-journalistic problems like predicting newspaper print quantities, understanding international audiences, and making personalized recommendations. The goal is to better understand readers and strengthen relationships.

Jonathan Coveney: Why Pig?mortardata

Pig is a useful tool for exploring data sets and describing data flows easily through scripts. However, it has some weaknesses like inconsistent syntax, lack of testing support, and an aging code base. While Pig works well for many companies, its suitability may decline as companies' data needs grow more complex with distributed teams of data scientists and engineers. For Pig to remain useful, it will need improvements in areas like types, performance, UDF support, and testing to better support "big data" teams in the future.

Pig on Sparkmortardata

Can Big Data Save the World? By Jake Porwaymortardata

Max Shron, Thinking with Data at the NYC Data Science Meetupmortardata

Drew Conway: A Social Scientist's Perspective on Data Sciencemortardata

This document summarizes a social scientist's perspectives on data science. It discusses that data comes from many sources and in many formats, which requires data scientists to know how to obtain data and work with different file types and APIs. It also notes that real data is often messy, with duplicates, missing values, and inconsistent formats, and combining data from multiple sources requires tools like UNIX commands, scripting languages, and databases. The document discusses that while data munging takes 80% of effort, teaching hacking skills is straightforward by borrowing from computer science curriculums. It also discusses exploring and modeling data through methods that scale and match different data types like text, geospatial, and web-scale data. The document advocates focusing

Data Science at Tumblrmortardata

Hadoop, Pig, and Python (PyData NYC 2012)mortardata

Daeil Kim: Machine Learning at the New York Timesmortardata

Jonathan Coveney: Why Pig?mortardata

Pig on Sparkmortardata

Can Big Data Save the World? By Jake Porwaymortardata

Max Shron, Thinking with Data at the NYC Data Science Meetupmortardata

Drew Conway: A Social Scientist's Perspective on Data Sciencemortardata

Data Science at Tumblrmortardata

Hadoop, Pig, and Python (PyData NYC 2012)mortardata

Recently uploaded (20)

Connect and Protect: Networks and Network SecurityVICTOR MAESTRE RAMIREZ

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/ HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client. Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience. In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including - Accessing the console - Locating and interpreting log files - Accessing the data folder within the browser’s cache (using OPFS) - Understand the difference between single- and multi-user scenarios - Utilizing Client Clocking

UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à GenèveUiPathCommunity

Nous vous convions à une nouvelle séance de la communauté UiPath en Suisse romande. Cette séance sera consacrée à un retour d'expérience de la part d'une organisation non gouvernementale basée à Genève. L'équipe en charge de la plateforme UiPath pour cette NGO nous présentera la variété des automatisations mis en oeuvre au fil des années : de la gestion des donations au support des équipes sur les terrains d'opération. Au délà des cas d'usage, cette session sera aussi l'opportunité de découvrir comment cette organisation a déployé UiPath Automation Suite et Document Understanding. Cette session a été diffusée en direct le 7 mai 2025 à 13h00 (CET). Découvrez toutes nos sessions passées et à venir de la communauté UiPath à l’adresse suivante : https://community.uipath.com/geneva/.

AsyncAPI v3 : Streamlining Event-Driven API Designleonid54

The Future of Cisco Cloud Security: Innovations and AI IntegrationRe-solution Data Ltd

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

AI 3-in-1: Agents, RAG, and Local Models - Brent LasterAll Things Open

Presented at All Things Open RTP Meetup Presented by Brent Laster - President & Lead Trainer, Tech Skills Transformations LLC Talk Title: AI 3-in-1: Agents, RAG, and Local Models Abstract: Learning and understanding AI concepts is satisfying and rewarding, but the fun part is learning how to work with AI yourself. In this presentation, author, trainer, and experienced technologist Brent Laster will help you do both! We’ll explain why and how to run AI models locally, the basic ideas of agents and RAG, and show how to assemble a simple AI agent in Python that leverages RAG and uses a local model through Ollama. No experience is needed on these technologies, although we do assume you do have a basic understanding of LLMs. This will be a fast-paced, engaging mixture of presentations interspersed with code explanations and demos building up to the finished product – something you’ll be able to replicate yourself after the session!

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Webinar - Top 5 Backup Mistakes MSPs and Businesses Make .pptxMSP360

Data loss can be devastating — especially when you discover it while trying to recover. All too often, it happens due to mistakes in your backup strategy. Whether you work for an MSP or within an organization, your company is susceptible to common backup mistakes that leave data vulnerable, productivity in question, and compliance at risk. Join 4-time Microsoft MVP Nick Cavalancia as he breaks down the top five backup mistakes businesses and MSPs make—and, more importantly, explains how to prevent them.

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Web and Graphics Designing Training in RajpuraErginous Technology

Web & Graphics Designing Training at Erginous Technologies in Rajpura offers practical, hands-on learning for students, graduates, and professionals aiming for a creative career. The 6-week and 6-month industrial training programs blend creativity with technical skills to prepare you for real-world opportunities in design. The course covers Graphic Designing tools like Photoshop, Illustrator, and CorelDRAW, along with logo, banner, and branding design. In Web Designing, you’ll learn HTML5, CSS3, JavaScript basics, responsive design, Bootstrap, Figma, and Adobe XD. Erginous emphasizes 100% practical training, live projects, portfolio building, expert guidance, certification, and placement support. Graduates can explore roles like Web Designer, Graphic Designer, UI/UX Designer, or Freelancer. For more info, visit erginous.co.in , message us on Instagram at erginoustechnologies, or call directly at +91-89684-38190 . Start your journey toward a creative and successful design career today!

Build 3D Animated Safety Induction - Tech EHSTECH EHS Solution

Train Smarter, Not Harder – Let 3D Animation Lead the Way! Discover how 3D animation makes inductions more engaging, effective, and cost-efficient. Check out the slides to see how you can transform your safety training process! Slide 1: Why 3D animation changes the game Slide 2: Site-specific induction isn’t optional—it’s essential Slide 3: Visitors are most at risk. Keep them safe Slide 4: Videos beat text—especially when safety is on the line Slide 5: TechEHS makes safety engaging and consistent Slide 6: Better retention, lower costs, safer sites Slide 7: Ready to elevate your induction process? Can an animated video make a difference to your site's safety? Let's talk.

Vibe Coding_ Develop a web application using AI (1).pdfBaiju Muthukadan

GyrusAI - Broadcasting & Streaming Applications Driven by AI and MLGyrus AI

Gyrus AI: AI/ML for Broadcasting & Streaming Gyrus is a Vision Al company developing Neural Network Accelerators and ready to deploy AI/ML Models for Video Processing and Video Analytics. Our Solutions: Intelligent Media Search Semantic & contextual search for faster, smarter content discovery. In-Scene Ad Placement AI-powered ad insertion to maximize monetization and user experience. Video Anonymization Automatically masks sensitive content to ensure privacy compliance. Vision Analytics Real-time object detection and engagement tracking. Why Gyrus AI? We help media companies streamline operations, enhance media discovery, and stay competitive in the rapidly evolving broadcasting & streaming landscape. 🚀 Ready to Transform Your Media Workflow? 🔗 Visit Us: https://gyrus.ai/ 📅 Book a Demo: https://gyrus.ai/contact 📝 Read More: https://gyrus.ai/blog/ 🔗 Follow Us: LinkedIn - https://www.linkedin.com/company/gyrusai/ Twitter/X - https://twitter.com/GyrusAI YouTube - https://www.youtube.com/channel/UCk2GzLj6xp0A6Wqix1GWSkw Facebook - https://www.facebook.com/GyrusAI

Hybridize Functions: A Tool for Automatically Refactoring Imperative Deep Lea...Raffi Khatchadourian

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a refactoring tool that automatically determines when it is safe and potentially advantageous to migrate imperative DL code to graph execution and vice-versa.

AI Agents at Work: UiPath, Maestro & the Future of DocumentsUiPathCommunity

Do you find yourself whispering sweet nothings to OCR engines, praying they catch that one rogue VAT number? Well, it’s time to let automation do the heavy lifting – with brains and brawn. Join us for a high-energy UiPath Community session where we crack open the vault of Document Understanding and introduce you to the future’s favorite buzzword with actual bite: Agentic AI. This isn’t your average “drag-and-drop-and-hope-it-works” demo. We’re going deep into how intelligent automation can revolutionize the way you deal with invoices – turning chaos into clarity and PDFs into productivity. From real-world use cases to live demos, we’ll show you how to move from manually verifying line items to sipping your coffee while your digital coworkers do the grunt work: 📕 Agenda: 🤖 Bots with brains: how Agentic AI takes automation from reactive to proactive 🔍 How DU handles everything from pristine PDFs to coffee-stained scans (we’ve seen it all) 🧠 The magic of context-aware AI agents who actually know what they’re doing 💥 A live walkthrough that’s part tech, part magic trick (minus the smoke and mirrors) 🗣️ Honest lessons, best practices, and “don’t do this unless you enjoy crying” warnings from the field So whether you’re an automation veteran or you still think “AI” stands for “Another Invoice,” this session will leave you laughing, learning, and ready to level up your invoice game. Don’t miss your chance to see how UiPath, DU, and Agentic AI can team up to turn your invoice nightmares into automation dreams. This session streamed live on May 07, 2025, 13:00 GMT. Join us and check out all our past and upcoming UiPath Community sessions at: 👉 https://community.uipath.com/dublin-belfast/

Make GenAI investments go further with the Dell AI FactoryPrincipled Technologies

The cost benefit of implementing a Dell AI Factory solution versus AWS and Azure Our research shows that hosting GenAI workloads on premises, either in a traditional Dell solution or using managed Dell APEX Subscriptions, could significantly lower your GenAI costs over 4 years compared to hosting these workloads in the cloud. In fact, we found that a Dell AI Factory on-premises solution could reduce costs by at much as 71 percent vs. a comparable AWS SageMaker solution and as much as 61 percent vs. a comparable Azure ML solution. These results show that organizations looking to implement GenAI and reap the business benefits to come can find many advantages in an on-premises Dell AI Factory solution, whether they opt to purchase and manage it themselves or engage with Dell APEX Subscriptions. Choosing an on-premises Dell AI Factory solution could save your organization significantly over hosting GenAI in the cloud, while giving you control over the security and privacy of your data as well as any updates and changes to the environment, and while ensuring your environment is managed consistently.