Building a Great Team in Open Source - Open Agile 2011

Nov 2, 20111 like543 views

Andrei Savu

Lessons I learned over the last 2 years as an open source contributor at The Apache Software Foundation.

Building A Great Team
Around Open Source Projects

@ Open Agile 2011

Past

Started by doing php, html, css & js ...

... moved to python, jvm, distributed systems,
large scale deployments & open source

worked at Facebook and Adobe

See more on LinkedIn

Now

Software Engineer @ cloudsoftcorp.com

● Apache Whirr
● jclouds

Apache Whirr PMC Member @ ASF

... lessons learned
over 2+ years at The Apache Software Foundation

Note: Strong Bias Towards The
Apache Software Foundation
* not the only way of doing open source

Warning: I am not a lawyer
* seek third party assistance as required

a software license that gives
you certain freedoms

a license shapes the
community and the code

the Apache License asks
for credit attribution

talk to your lawyer!
~ 64 OSI Approved Licenses

provides protection for
the project identity
Apache Foo as trademark

not simply a group of
projects sharing a server,
but rather a community of
developers and users

a desire to create high
quality software

why use open source?
why contribute back?

use to leverage
existing tested code
as a way to reduce your costs

contribute to minimize
maintainance costs
there is no such thing as perfect software

why develop as
open source?
starting from scratch

by building a community
maintain - support - extend

Do we build advanced
products by accident !?

#1 Community over code
see communityovercode.com

#3 It's about what you do.
Those who do, decide.

#8 Discuss in the open
email lists, IRC, issue tracking, wiki

#9 Develop in the open
public repository, CI server

50% of changes made by
2.5% of the developers
Linux 2.6.20 - see lwn.net

The ethical implications of our work can be staggering but how do we balance commercial needs, ethical requirements, and productivity? Taking a pragmatic approach through starting with simple checklists evolving to the use of automation and structured processes, I look at how we can make our work more robust from an ethical perspective. Step 0: Get alignment Step 1: Make others think before you start Step 2: Work robustly Step 3: Maintain vigilance

Digitalisation from the back office to the factory floorStephanie Locke

AI is a huge set of tools for making computers behave intelligently - Andrew Ng 70% of implementations fail to meet their stated aims. Following the holistic triple transformation approach taken by ‘lighthouses’ seems like a sensible approach to take. Industry 4.0: Reimagining manufacturing operations after COVID-19 McKinsey Get started with AI: - Start small with pilot projects to gain momentum - Strong business case - Build a team around this - Provide broad training - Longer-term develop an AI strategy that aligns with your business objectives

Open Source Summit - AI4CI.pdfAakankshaDuggal2

AI4CI is a concept that uses artificial intelligence and machine learning to improve the continuous integration (CI) process. It collects data from open sources like TestGrid, Prow, and GitHub to analyze build logs, PR merge times, and other metrics. The goals are to provide automated workflows and dashboards to help identify issues in the CI infrastructure and pinpoint failures in the development or testing process. Developers and data scientists can explore AI4CI notebooks and models, engage with the community, and contribute to ongoing work to enhance CI/CD with AIOps techniques.

Scaling Data Science: Engineering a PlatformDataScience

Strata+hadoop data kitchen-seven-steps-to-high-velocity-data-analytics-with d...DataKitchen

The document outlines seven steps for implementing DataOps to help analytic teams deliver insights faster with higher quality. The steps are: 1) add data and logic tests, 2) use a version control system, 3) branch and merge, 4) use multiple environments, 5) reuse and containerize components, 6) parameterize processing, and 7) use simple storage. A case study example describes how one data engineer supports 12 analysts making weekly schema changes without issues using DataOps.

Delivering Insights: Building the DataScience Web ApplicationDataScience

Cloud-native Enterprise Data Science TeamsBoston Consulting Group

1) BCG's Gamma division provides data science teams and expertise to clients. It has over 550 analytics practitioners worldwide with experience across industries. 2) Gamma organizes data science teams with a mix of roles including data scientists, software engineers, and data engineers. It advocates for surgical teams based on principles from the 1970s. 3) Gamma views people, platform, and process as pillars of transformative analytics. It structures teams, advises on integrated systems to streamline projects, and takes a business-led approach through pilots and roadmaps.

The Five-Week Transformation: How the Department of Defense’s Public Web Serv...Atlassian

The Defense Media Activity’s Public web program supports more than 10,000 soldiers, sailors, airmen and Marines globally with the ability to rapidly move news, images and video to worldwide audiences via official military websites and the ability to integrate that content on social media sites. In September 2014, DMA's CIO Leslie Benito realized that to deliver world-class service, DMA needed to transform its Public Web service desk. In this session, Leslie will explain how they completed that within weeks, under stringent security requirements, while improving IT productivity and customer satisfaction. carried out the projects and what we achieved along the way.

2017 09-14 AAATE SteppingStonesSteve Lee

This document discusses SteppingStones, an open source framework of HTML components designed to help those with low cognitive abilities or digital literacy gain confidence and skills in using digital technologies. The components provide different levels of complexity and can be included in web or native apps. While the SteppingStones framework saw interest from developers during an EU project, the developer of OpenDirective is now looking to better connect with stakeholders and market the project and related commercial services to continue its development and use.

Sustainable manufacturing with AIStephanie Locke

Sustainable manufacturing with AI Improve your processes: Defect detection to reduce waste Predictive maintenance to improve energy efficiency Generative design to reduce materials used in products Process optimisation to improve energy usage Inventory optimisation to reduce materials held Improve your IT: Go paperless Move to carbon neutral clouds Adopt green software products Optimise your compute usage Improve with Nightingale HQ We’re doing bespoke and pilot projects with manufacturers and adjacent industries. Make your business more sustainable. bit.ly/nhqaichat

Embedding usability from scratchMichele Ide-Smith

This document outlines steps to embed usability into an organization from scratch, including: 1. Create awareness of usability benefits through data, examples, and user profiling. 2. Develop in-house skills through training, guides, and consultancy to turn theory into practice. 3. Change processes and governance to integrate usability into projects through measures, business cases, and highlighting failures without UX. 4. Establish a toolkit including a mobile usability lab, note-taking tools, and web analytics tools.

App Development Disrupted: Answers and results from the 2017 State Of App Dev...OutSystems

In this presentation, we look at the results of that State of App Dev 2017 research to answer five important questions: 1- What are the major challenges facing IT professionals today? 2- Is the demand for applications growing and, if so, what are the implications? 3- What are the highest priority application types, systems, and development approaches that make up the digital transformation landscape? 4- How are organizations dealing with the rise of citizen developers and the developer skills gap? 5- Are organizations embracing new approaches, like low-code platforms, to accelerate digital transformation?

AgileHead - Product Development Services for Startupsjeswinpk

This document describes AgileHead, an 18-member consulting group in Bangalore, India that provides product development services using an agile approach. They propose using a small core team of highly experienced developers, testers, and managers rather than large outsourced teams. Their process focuses on rapid, incremental releases and modern technologies to improve efficiency. They provide estimates for building example applications ranging from $10,000-$27,000 within 5 weeks.

Rapid Product Design in the Wild - Agile IcelandMichele Ide-Smith

A version of my Rapid Product Design in the Wild talk at Agile Iceland 2014. http://www.agileisland.is How do you know you're developing the right product? This talk will help you think creatively about how to do customer development using Agile and Lean User Experience methods. I share what we learnt about using rapid, iterative prototyping techniques to develop a minimum viable product at a software conference. In August 2012 we attended Kscope, a conference for Oracle developers. Instead of doing the usual product demonstrations, we turned our stand into a live lab and took Agile development processes out of the office and in front of our customers. Our stand included an area for customer research, a Kanban board and information radiators in the form of a whiteboard, blank wall and a large digital screen. Over 3 days we ran 9 sprints and conducted 25 customer interviews, using a paper prototype to get feedback. We collected invaluable information about our customers' development environments, how they work with their teams, their processes, tasks and pain points. By the end of the conference my colleague had developed an interactive HTML/CSS prototype which potential customers could evaluate. The team went through several rapid build-measure-learn cycles to improve our product concept and validate the market need. Opening up our development process at a trade show provided visitors to the stand with an opportunity to experience Agile and Lean methods first-hand.

Low code - empower the capability to accelerate | Swatantra KumarSwatantra Kumar

In today’s fast-changing environment customers are better informed, better connected and more demanding than ever before. Digitization is no longer a choice, it is indispensable. Irrespective of the size and industry you are in, your organization needs to continuously transform to survive in the evolving and demanding business environments. Traditional application development falls short and cannot keep up with the demands from the business. Low-code platforms proved over the last years to provide a solution to deal with both business and IT challenges. Low-code software development can therefore be a serious accelerator, driving the digital transformation of your organization! This article looks at the potential and the reality of low-code development platforms and how low-code can drive digital transformation within organizations. It illustrates how to start your low-code journey, what it entails and how to make low-code software development a success for your organization.

5 Level of AI Assistants from the Chatbot ConferenceStefan Kojouharov

OPEN SOURCE HORROR STORIES (AND LESSONS LEARNED)FINOS

Gil Yehuda, Oath: Open Source Horror Stories (and lessons learned). Open Source is not just about unicorns and rainbows where nice developers give you free code and fix it for you. This talk will feature a few cringeworthy but real-world stories of open source situations gone bad. We’ll talk about cases where people published things they should not have, licenses with terms you’d never agree with, employees who forget who signs their paychecks, DMCA takedowns that kill your code, and situations where you now own someone else’s mistakes. Names and some details will be withheld to protect the innocent and guilty alike. But each case points to a policy which you should put in place to protect your projects and your interests in the world of open source. At the end of this talk you’ll see why many companies manage an open source program the way they do.

Open Source Horror Stories and Lessons LearnedOpen Source Strategy Forum

The document discusses open source horror stories and lessons learned from managing open source programs at large companies. It provides tips for creating practices that match open source policies to build trust, conducting rational audits of build processes to address legal and security issues, and establishing fast approval processes for contributor license agreements to avoid barriers. The key takeaway is that companies need coordinated open source programs to help engineers ask for guidance and implement proper processes that enable speed while ensuring better long-term technical and legal outcomes.

Hadoop Meets ScrumRommel Garcia

Overcoming the Fear of Contributing to Open SourceAll Things Open

The document discusses overcoming the fear of contributing to open source projects. It recommends getting a support system by introducing yourself in chat groups, reaching out to maintainers, and knowing others who can help. The document also suggests starting small by picking achievable issues, thoroughly reading documentation, and joining project triage teams. Following best practices like linking pull requests to issues and checking contributing guidelines can help set up success. Specific open source projects mentioned to contribute to for Hacktoberfest include Julia, Open Sauced, Virtual Coffee, and Forem. The document encourages taking little steps towards the goal of open source contribution without rushing.

Metrics All The Way: Data Driven DevOps (devconf.cz 2022).pdfHemaVeeradhi1

This document summarizes a presentation on using metrics and data to influence a DevOps culture. It discusses how aggregating data in meaningful ways can provide greater visibility into teams' work and help with decision making. Presenting metrics in different visualizations like Jupyter notebooks or dashboards allows users to quickly answer questions by combining data sources or changing the granularity. The document provides examples of metric categorization and collection sources. It promotes an "operate first" concept of incorporating operational experience into software projects and includes references to related tools and repositories.

Accidental DataOpsSteve Ross

Usually, DataOps means applying DevOps principles to existing data analytics projects. We accidentally reversed it, taking a DevOps initiative and catalyzing adoption of data-driven practices across our company. What started as a practical initiative to bring better reliability and visibility to our software product had the unexpected effect of catalyzing a transformation that helped our organization become more data-driven across the company. What we learned in the process was how and why DevOps principles can naturally expand the role of a traditional operations team and bring wider culture change to the organization.

Headstart Morgenseminar: Working as a NetworkSeismonaut

Agile myth 1 no plan and no docJames Mills

Agile projects do involve planning contrary to a common myth. There are five levels of planning - product vision, roadmap, release plan, iteration plan, and daily plan. While detailed upfront planning is not done, planning occurs continuously. Another myth is that there is no feedback on progress without a plan, but product and sprint backlogs provide burn down visibility. Finally, while the scope may be adjusted, Agile projects have timeboxes and budgets, and documentation is still created when prioritized and not a roadblock to delivery.

Modeling Webinar: The Key to KeysDATAVERSITY

So many of us have learned data modeling and database design approaches from working with one database or data technology. We may have used only one data modeling tool. That means our vocabularies around identifiers and keys tend to be product specfic. Do you know the difference between a unique index and a unique key? What about the difference between RI, FK and AK? In this webinar we'll look at the generic and proprietary terms for these concepts, as well as where they fit in the data modeling and database design process. We'll also look at implementation options across a few commercial DBMSs and datastores. Bring your developers and DBAs, too. These concepts span data activities and it's important that your team understand each other and where they, their tools and approaches need to support these features, too.

The 3 Key Barriers Keeping Companies from Deploying Data Products Dataiku

Getting from raw data to deploying data-driven solutions requires technology, data, and people. All of which exist. So why aren’t we seeing more truly data-driven companies: what's missing and why? During Strata Hadoop World Singapore 2015, Pauline Brown, Director of Marketing at Dataiku, explains how lack of collaboration is what is keeping companies from building and deploying data products effectively. Learn more about Dataiku and Data Science Studio: www.dataiku.com

Accelerate: AI Trends in 2018Aarthi Srinivasan

This document discusses trends in artificial intelligence (AI) funding and applications. It notes that AI funding has grown unprecedentedly, reaching over $15 billion in 2017. Popular investment areas for startups include healthcare diagnostics, automation, cybersecurity, and autonomous vehicles. Corporations are also increasingly investing in AI, focusing on platforms, business process automation, and understanding customers. The document provides recommendations for companies looking to adopt AI, such as starting small with cost savings projects, creating a product team using agile practices, and identifying key data needs.

Open Source: What’s this all about?Brad Montgomery

How to get started in Open Source!Pradeep Singh

Discover the Power of Open Source Project CollaborationYashikaSharma391629

More Related Content

What's hot (19)

2017 09-14 AAATE SteppingStonesSteve Lee

Sustainable manufacturing with AIStephanie Locke

Embedding usability from scratchMichele Ide-Smith

App Development Disrupted: Answers and results from the 2017 State Of App Dev...OutSystems

AgileHead - Product Development Services for Startupsjeswinpk

Rapid Product Design in the Wild - Agile IcelandMichele Ide-Smith

Low code - empower the capability to accelerate | Swatantra KumarSwatantra Kumar

5 Level of AI Assistants from the Chatbot ConferenceStefan Kojouharov

OPEN SOURCE HORROR STORIES (AND LESSONS LEARNED)FINOS

Open Source Horror Stories and Lessons LearnedOpen Source Strategy Forum

Hadoop Meets ScrumRommel Garcia

Overcoming the Fear of Contributing to Open SourceAll Things Open

Metrics All The Way: Data Driven DevOps (devconf.cz 2022).pdfHemaVeeradhi1

Accidental DataOpsSteve Ross

Headstart Morgenseminar: Working as a NetworkSeismonaut

Agile myth 1 no plan and no docJames Mills

Modeling Webinar: The Key to KeysDATAVERSITY

The 3 Key Barriers Keeping Companies from Deploying Data Products Dataiku

Accelerate: AI Trends in 2018Aarthi Srinivasan

2017 09-14 AAATE SteppingStonesSteve Lee

Sustainable manufacturing with AIStephanie Locke

Embedding usability from scratchMichele Ide-Smith

App Development Disrupted: Answers and results from the 2017 State Of App Dev...OutSystems

AgileHead - Product Development Services for Startupsjeswinpk

Rapid Product Design in the Wild - Agile IcelandMichele Ide-Smith

Low code - empower the capability to accelerate | Swatantra KumarSwatantra Kumar

5 Level of AI Assistants from the Chatbot ConferenceStefan Kojouharov

OPEN SOURCE HORROR STORIES (AND LESSONS LEARNED)FINOS

Open Source Horror Stories and Lessons LearnedOpen Source Strategy Forum

Hadoop Meets ScrumRommel Garcia

Overcoming the Fear of Contributing to Open SourceAll Things Open

Metrics All The Way: Data Driven DevOps (devconf.cz 2022).pdfHemaVeeradhi1

Accidental DataOpsSteve Ross

Headstart Morgenseminar: Working as a NetworkSeismonaut

Agile myth 1 no plan and no docJames Mills

Modeling Webinar: The Key to KeysDATAVERSITY

The 3 Key Barriers Keeping Companies from Deploying Data Products Dataiku

Accelerate: AI Trends in 2018Aarthi Srinivasan

Similar to Building a Great Team in Open Source - Open Agile 2011 (20)

Open Source: What’s this all about?Brad Montgomery

How to get started in Open Source!Pradeep Singh

Discover the Power of Open Source Project CollaborationYashikaSharma391629

Open Source Software in LibrariesSukhdev Singh

Introduction To Open SourceUchechukwu Obimma

This document provides an introduction to open source software. It discusses the history of open source beginning with software sharing at MIT in the 1970s. It describes Richard Stallman founding the Free Software Movement in response to proprietary software taking over. The Open Source movement began in the late 1990s. Today, open source software is widely adopted due to benefits like community support, transparency, reliability, and lower costs compared to proprietary software.

[Workshop] Building an Integration Agile Digital Enterprise with Open Source ...WSO2

This document provides an overview of open source software. It discusses why organizations use open source software, noting benefits like more control over the software, increased security, support for interoperability, and guaranteed future development. It also covers the differences between free and open source software. The document outlines several open source foundations and their major projects. It explores open source philosophies like community over code and the cathedral and bazaar models of development. Finally, it addresses understanding open source infrastructure like mailing lists, version control, issue trackers, wikis, documentation, and websites.

Open sourceYin-Ta Pan

SFO15-TR1: The Philosophy of Open Source DevelopmentLinaro

SFO15-TR1: The Philosophy of Open Source Development Speaker: Jorge Ramirez-Ortiz Date: September 22, 2015 ★ Session Description ★ FLOSS - Free / Libre Open Source Software [1] What _is_ “the community”? What do they want from you? What do you get in return? [1] http://en.wikipedia.org/wiki/Free\_and\_open-source\_software ★ Resources ★ Video: Presentation: Etherpad: pad.linaro.org/p/sfo15-tr1 Pathable: https://sfo15.pathable.com/meetings/302926 ★ Event Details ★ Linaro Connect San Francisco 2015 - #SFO15 September 21-25, 2015 Hyatt Regency Hotel http://www.linaro.org http://connect.linaro.org

Opensource development and apache software foundationEran Chinthaka Withana

The document discusses the Apache Software Foundation (ASF), an open source software foundation. It describes ASF as a non-profit organization that provides infrastructure and legal/organizational support for various open source projects. It operates based on principles of meritocracy, consensus-based decision making, and collaborative development. The document encourages both individuals and companies to contribute to open source projects at ASF, noting there are many benefits to contributing including skills development, networking opportunities, and ensuring technologies stay supported.

Open Source Compliance at TwitterChris Aniszczyk

- Twitter relies heavily on open source software and contributes a significant amount of code back to the open source community. - In 2011, Twitter created an Open Source Office to direct all open source efforts related to compliance, standards, and engineering outreach. - The Open Source Office established review processes, licensing guidelines, and development best practices to manage open source code in a transparent and compliant manner while still facilitating contributions and collaboration.

Open Source & Open Development Sander van der Waal

This document provides an overview of open source software and open development. It discusses the history of open source software and definitions of key terms. It also presents two case studies of successful open source projects: TexGen, a textile CAD modeler, and Apache Wookie, a widget server. Both projects benefited from collaboration, publicity, and new partnerships by being open source. The document also briefly covers legal aspects of open source like copyright.

Best practices for using open source software in the enterpriseMarcel de Vries

Marcel de Vries discusses best practices for using open source software in enterprises. He notes that 80% of software is based on open source components and that awareness is key. He demonstrates how to use an artifact repository like Nexus to publish components after builds, scan for licenses and vulnerabilities, and gain insights. While repositories help with transparency and analysis, additional tools and processes are needed for component selection, community engagement, and contribution management to fully address open source usage in enterprises.

كيف تبدأ مشروعك مفتوح المصدرguest3155bc

Intro to open source - 101 presentationJavier Perez

This document provides an overview of open-source software and how to get started with it. It discusses the history of open-source software dating back to 1955. It defines key open-source concepts like licenses, roles, and best practices for contributing. It also highlights the large open-source ecosystems existing today and the top companies contributing to open-source. The document aims to address common questions or concerns about open-source software.

How to start your own open source projectVstoria

09 Myths About Open Source SoftwareSuyati Technologies

Open source software by Tushar JoshiTushar Joshi

The document discusses open source software, including that it is freely available to download without cost, has openly accessible source code under an open source license, and has alternatives to major proprietary software. It encourages attending user groups and contributing to open source projects to gain skills, collaborate, and demonstrate abilities to future employers. Suggestions are given for how to get involved, such as identifying alternatives, joining communities, filing issues and requests, and starting with user groups or existing open source projects.

Open Source Presentation To Portal Partners2Viet NguyenHoang

The document discusses open source software licenses. It defines open source and compares it to public domain and freeware licenses. The main open source licenses discussed are the GNU General Public License (GPL) and Berkeley Software Distribution (BSD) license. The GPL requires derivatives to also use the GPL while the BSD allows derivatives to use other licenses. Pros of open source development cited include peer review, motivated community contributions, and avoidance of vendor lock-in. Potential cons include projects becoming niche or fragmented.

"Open Source and the Choice to Cooperate" by Brian Behlendorf @ eLiberatica 2007eLiberatica

This is a presentation held at eLiberatica 2007. http://www.eliberatica.ro/2007/ One of the biggest events of its kind in Eastern Europe, eLiberatica brings community leaders from around the world to discuss about the hottest topics in FLOSS movement, demonstrating the advantages of adopting, using and developing Open Source and Free Software solutions. The eLiberatica organizational committee together with our speakers and guests, have graciously allowed media representatives and all attendees to photograph, videotape and otherwise record their sessions, on the condition that the photos, videos and recordings are licensed under the Creative Commons Share-Alike 3.0 License.

Open Source LicensesOrtus Solutions, Corp

This document provides an overview of Ortus Solutions, an established software development firm that specializes in mobile and web application design and development. It has created over 250 web development tools and is an open source software publisher. The document discusses open source vs proprietary software and the history of open source adoption. It also covers various open source licenses like MIT, Apache 2.0, GPL, LGPL, MPL and their differences. Finally, it discusses strategies for monetizing open source software through services, subscriptions and commercial versions.

Open Source: What’s this all about?Brad Montgomery

How to get started in Open Source!Pradeep Singh

Discover the Power of Open Source Project CollaborationYashikaSharma391629

Open Source Software in LibrariesSukhdev Singh

Introduction To Open SourceUchechukwu Obimma

[Workshop] Building an Integration Agile Digital Enterprise with Open Source ...WSO2

Open sourceYin-Ta Pan

SFO15-TR1: The Philosophy of Open Source DevelopmentLinaro

Opensource development and apache software foundationEran Chinthaka Withana

Open Source Compliance at TwitterChris Aniszczyk

Open Source & Open Development Sander van der Waal

Best practices for using open source software in the enterpriseMarcel de Vries

كيف تبدأ مشروعك مفتوح المصدرguest3155bc

Intro to open source - 101 presentationJavier Perez

How to start your own open source projectVstoria

09 Myths About Open Source SoftwareSuyati Technologies

Open source software by Tushar JoshiTushar Joshi

Open Source Presentation To Portal Partners2Viet NguyenHoang

"Open Source and the Choice to Cooperate" by Brian Behlendorf @ eLiberatica 2007eLiberatica

Open Source LicensesOrtus Solutions, Corp

More from Andrei Savu (20)

The Evolving Landscape of Data EngineeringAndrei Savu

The document discusses the evolving landscape of data engineering. It provides context on the past, present, and future of data engineering. Specifically, it notes that in the past, data engineering was driven by open source communities and the early histories of AWS and Google Cloud. It describes common present-day patterns like serverless architectures and data locality. Finally, it outlines a future wish list, including data catalogs, monitoring systems, and more intelligent data infrastructure. The document concludes by offering recommendations on where to start with technologies, Google Cloud courses, and developing domain knowledge.

The Evolving Landscape of Data EngineeringAndrei Savu

Data Engineering is a relatively new, but fast evolving discipline that spans multiple environments and technologies, from traditional data centers to hyper-scale cloud providers, a discipline that combines closed-source, homegrown and open source software to create scalable data pipelines and power incredible new product features. In this presentation, we will go over the last 5-10 years of technology trends and advancements and bring all of that together in a story about modern day Data Engineering and the magic behind it.

Recap on AWS Lambda after re:Invent 2015Andrei Savu

One Hadoop, Multiple Clouds - NYC Big Data MeetupAndrei Savu

Introducing Cloudera Director at Big Data BashAndrei Savu

APIs & Underlying Protocols #APICraftSFAndrei Savu

Challenges for running Hadoop on AWS - AdvancedAWS MeetupAndrei Savu

Nowadays we've got all the tools we need to spin-up and tear-down clusters with hundreds of nodes in minutes and this puts more pressure on the tools we use to configure and monitor our applications. This challenge is even more interesting when we have to deal with long running distributed data storage and processing systems like Hadoop. In this talk we will look into some of the challenges we need to deal with when creating and managing Hadoop clusters in AWS, we will discuss improvement opportunities in monitoring (e.g. detecting and dealing with instance failure, resource contention & noisy neighbors) and a bit about the future and how we should go about disconnecting workload dispatch from cluster lifecycle.

Cloud as a Data PlatformAndrei Savu

Apache Provisionr (incubating) - Bucharest JUG 10Andrei Savu

Creating pools of Virtual Machines - ApacheCon NA 2013Andrei Savu

Data Scientist ToolboxAndrei Savu

This document provides an overview of the data science process and tools for a data science project. It discusses identifying important business questions to answer with data, extracting relevant data from sources, cleaning and sampling the data, analyzing samples to create models and check hypotheses, applying results to full data sets, visualizing findings, automating and deploying solutions, and continuously learning and improving through an iterative process. Key tools mentioned include Hadoop, R, Python, Excel, and various data wrangling, analysis, and visualization tools.

Axemblr Provisionr 0.3.x OverviewAndrei Savu

Simple Service for Managing Pools of 10s or 100s of Virtual Machines With Provisionr we want to solve the problem of cloud portability by hiding completely the API and only focusing on building a cluster that matches the same set of assumptions on all clouds, assumptions like: running a specific operating system (e.g. Ubuntu LTS), having the same set of pre-installed packages and binaries, sane dns settings (forward & reverse ip resolution - as needed for Hadoop), ntp settings, networking settings, ssh admin access, vpn access etc.

2012 in Review - Bucharest JUGAndrei Savu

The document summarizes the Bucharest JUG (Java User Group) meetings from May 2012 to November 2012. It provides details on the monthly meetings including average attendance of 25-80 people, topics covered such as Guava, Maven, JavaScript UI for REST, and thanks to speakers and sponsors. It outlines future plans such as live streaming international speakers, a donations/job board, and potential future topics around alternative build systems, deployment options, and monitoring tools. Contact details are provided.

Metrics for Web Applications - Netcamp 2012Andrei Savu

Counters with Riak on Amazon EC2 at HackoverAndrei Savu

The document discusses using distributed counters with Riak on Amazon EC2. It introduces Riak as a distributed key-value database focused on availability, fault tolerance, simplicity and scalability. It describes using Riak features like consistent hashing, replication and automatic load balancing to implement a REST API for counters with eventual consistency. The demo shows implementing and accessing counters across local machines and EC2 regions to demonstrate the architecture.

Simple REST with DropwizardAndrei Savu

This document provides an overview of using Dropwizard, an open-source Java framework, to build RESTful web services. It discusses REST concepts like resources and representations, REST verbs like GET and POST, and architectures for REST APIs. It then introduces Dropwizard and its components for building HTTP services with features like Jetty, Jersey, Jackson, and metrics support. The document demonstrates a sample Dropwizard TODO list application with REST endpoints and resources and discusses considerations for development, testing, and deployment.

Guava Overview Part 2 Bucharest JUG #2 Andrei Savu

This document provides an overview of Guava and discusses caches and services. Guava is Google's core Java library that contains utilities like caches, primitives, collections, and concurrency libraries. Caches can improve performance by storing values to avoid expensive re-computation. Services in Guava define lifecycles for objects with operational state and allow asynchronous starting and stopping. The document describes cache eviction strategies, service implementations, and where to find more information on Guava features like functional idioms and concurrency.

Guava Overview. Part 1 @ Bucharest JUG #1 Andrei Savu

Guava is a Java library developed by Google that includes common libraries such as collections, caching, primitives support, concurrency libraries, and generalized utility classes. The talk covered the basic utilities in Guava including using and avoiding null, preconditions, common object utilities, ordering, and primitive array utilities. It also discussed the collections in Guava including immutable collections, new collection types like multisets and multimaps, collection utilities, and ways to extend the collections framework with decorators.

Polyglot Persistence & Big Data in the CloudAndrei Savu

This document discusses polyglot persistence and deploying big data technologies in the cloud. It introduces databases like HBase, Cassandra, MongoDB, CouchDB, and Riak for storing large amounts of data. Technologies like Elasticsearch and Solr are presented for search. Hadoop is described as a framework for distributed processing of large datasets. The document concludes by discussing how the Apache Whirr project can be used to deploy these technologies on cloud infrastructure.

Apache WhirrAndrei Savu

Apache Whirr is a set of libraries for running cloud services on-demand in a cloud-neutral way. It provides common APIs and defaults for deploying clusters running Hadoop, Cassandra, HBase, and Zookeeper on EC2 and Rackspace. Whirr configurations allow deploying typical clusters with a single command. It is being developed further to support private clouds and new services, and to integrate with Hudson for testing fault injection scenarios on small test clusters.

The Evolving Landscape of Data EngineeringAndrei Savu

Recap on AWS Lambda after re:Invent 2015Andrei Savu

One Hadoop, Multiple Clouds - NYC Big Data MeetupAndrei Savu

Introducing Cloudera Director at Big Data BashAndrei Savu

APIs & Underlying Protocols #APICraftSFAndrei Savu

Challenges for running Hadoop on AWS - AdvancedAWS MeetupAndrei Savu

Cloud as a Data PlatformAndrei Savu

Apache Provisionr (incubating) - Bucharest JUG 10Andrei Savu

Creating pools of Virtual Machines - ApacheCon NA 2013Andrei Savu

Data Scientist ToolboxAndrei Savu

Axemblr Provisionr 0.3.x OverviewAndrei Savu

2012 in Review - Bucharest JUGAndrei Savu

Metrics for Web Applications - Netcamp 2012Andrei Savu

Counters with Riak on Amazon EC2 at HackoverAndrei Savu

Simple REST with DropwizardAndrei Savu

Guava Overview Part 2 Bucharest JUG #2 Andrei Savu

Guava Overview. Part 1 @ Bucharest JUG #1 Andrei Savu

Polyglot Persistence & Big Data in the CloudAndrei Savu

Apache WhirrAndrei Savu

Recently uploaded (20)

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Cyber Awareness overview for 2025 month of securityriccardosl1

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Procurement Insights Cost To Value Guide.pptxJon Hansen

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

tecnologias de las primeras civilizaciones.pdffjgm517

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Cyber Awareness overview for 2025 month of securityriccardosl1

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Procurement Insights Cost To Value Guide.pptxJon Hansen

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

tecnologias de las primeras civilizaciones.pdffjgm517

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Mobile App Development Company in Saudi ArabiaSteve Jonas

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Building a Great Team in Open Source - Open Agile 2011

1. Building A Great Team Around Open Source Projects @ Open Agile 2011

2. Andrei Savu asavu @ apache.org

3. Past Started by doing php, html, css & js ... ... moved to python, jvm, distributed systems, large scale deployments & open source worked at Facebook and Adobe See more on LinkedIn

4. Now Software Engineer @ cloudsoftcorp.com ● Apache Whirr ● jclouds Apache Whirr PMC Member @ ASF

5. ... lessons learned over 2+ years at The Apache Software Foundation

6. community engagement

7. software development

8. distributed teams

9. Note: Strong Bias Towards The Apache Software Foundation * not the only way of doing open source

10. Warning: I am not a lawyer * seek third party assistance as required

11. let's define some terms

12. what is open source?

13. a software license that gives you certain freedoms

14. #1 free distribution

15. #2 access to source code