History of Engine Yard's relationship with PostgreSQL. How we went from minimal PostgreSQL support to making it our new default.
Video is available here: http://www.youtube.com/watch?v=sFfJjfOk9NA
From the new consensus based clustering to active data exploration, RavenDB 3.5 contains quite a lot of new features, improvement and fixes. In this keynote Oren Eini will showcase RavenDB 3.5 new features. Including SLAs, I/O monitoring, improved performance and stability, smarter replication, and more.
1) RDI uses RavenDB embedded in over 36,000 restaurants with around 500,000 individual machines processing $50,000 per second in payments.
2) RavenDB allows for unit testing without mocking the database, advanced statistics on data persistence, and transparent replication with high availability.
3) The challenges of using RavenDB on specialized older hardware with low memory and ESENT include fine-tuning memory usage, disabling caching, and automating recovery from unclean shutdowns with ESENTUTL.EXE.
Oren Eini discusses the next major version of RavenDB 4.0, running on the CoreCLR, and skim over topics of performance (much higher), flexibility and ease of use.
Zapping ever faster: how Zap sped up by two orders of magnitude using RavenDBOren Eini
Join a real uplift experience with Hagay Albo, the CTO of the Zap/Yellow Page Group in Israel, in which he explains how his team was able to take a legacy (slow and hard to modify) group of sites and make them easier to work with, MUCH faster and greatly simplified the operational environment.
By prioritizing high availability, flexible data modeling and focusing on raw speed Zap was able to reduce its load times by Two Orders of Magnitudes. Using RavenDB as the core engine behind Zap's new sites had improved site traffic, reduced time to market and made it possible to implement the next-gen features that were previously beyond reach.
The Stack Exchange infrastructure supports 560 million page views and 34TB of data transferred per month across 1665 requests per second on average. To ensure high performance, Stack Exchange uses load balancers, web servers, caching, and databases in a redundant configuration. Careful performance monitoring and optimization has resulted in homepage and question page render times of 52ms and 33ms respectively.
Know thy cost (or where performance problems lurk)Oren Eini
Performance happens. Whether you're designed for it or not it doesn’t matter, she is always invited to the party (and you better find her in a good mood). Knowing the cost of every operation, and how it distributes on every subsystem will ensure that when you are building that proof-of-concept (that always ends up in production) or designing the latest’s enterprise-grade application; you will know where those pesky performance bugs like to inhabit. In this session, we will go deep into the inner working of every performance sensitive subsystem. From the relative safety of the client to the binary world of Voron.
Drupal High Availability High Performance 2012Amazee Labs
This document discusses strategies for achieving high availability and high performance with Drupal. It recommends using redundant web and database servers, load balancers, caching with Varnish and Memcache, and a distributed file system like GlusterFS. MySQL master-slave replication is suggested for database redundancy. The goal is a scalable system with no single point of failure and fast response times.
Lessons from the Trenches - Building Enterprise Applications with RavenDBOren Eini
It's easy, fun, and simple to get a prototype application built with RavenDB, but what happens when you get to the point of shipping v1.0 into Production? Many of the subtle decisions made during development can have undesirable consequences in Production. In this session, Dan Bishop will explore some of the pain points that arise when building, deploying, and supporting enterprise-grade applications with RavenDB.
1) SSDs provide significantly better performance than HDDs for WordPress.com, reducing costs by 75% while improving performance and capacity 6 times.
2) An experiment replacing HDD RAID with SSDs was very successful, but initial production deployment had critical bugs and required restarting the migration process.
3) While SSDs save money and users' time, maximizing their performance requires substantial research, testing, and software optimization from system administrators.
Deploying MongoDB can be a challenge if you don't understand how resources are used nor how to plan for the capacity of your systems. If you need to deploy, or grow, a MongoDB single instance, replica set, or tens of sharded clusters then you probably share the same challenges in trying to size that deployment. This talk will cover what resources MongoDB uses, and how to plan for their use in your deployment. Topics covered will include understanding how to model and plan capacity needs from the perspective of a new deployment, growing an existing one, and defining where the steps along scalability on your path to the top. The goal of this presentation will be to provide you with the tools needed to be successful in managing your MongoDB capacity planning tasks.
This document provides an overview of using Object Relational Mapping (ORM) with Python SQLAlchemy and MariaSQL. It discusses using ORM for database access, mapping database tables to Python classes, querying relationships between tables, and more advanced topics like adding virtual columns without changing the database schema. The document also includes examples of querying data from multiple related tables and creating database views using alembic migrations.
This document discusses various techniques for optimizing website performance in order to improve search engine optimization (SEO) rankings. It outlines strategies for reducing page load time such as compressing files, lazy loading images, minimizing requests, caching content, and using modules like Apache's mod_pagespeed. The document stresses that the primary goal should be improving the user experience rather than solely focusing on achieving full scores on Google's Pagespeed Insights tool.
This document discusses moving a web application to Amazon Web Services (AWS) and managing it with RightScale. It outlines the challenges of the previous single-server deployment, including lack of scalability and single point of failure. The solution presented uses AWS services like EC2, S3, EBS and RDS combined with RightScale for management and Zend Server for the application architecture. This provides auto-scaling, high availability, backups and easier management compared to the previous setup. Alternatives to AWS and RightScale are also briefly discussed.
Cache solutions that can be used when developing applications have been examined. Redis, MemCache, JCache, and Hazelcast comparisons were made.
Performance, Security, Storage Capability and Eviction Policy, Maintenance, Reliability, Cost and also Who's using what.
SenchaCon 2016 - How to Auto Generate a Back-end in MinutesMalin Weiss
Connecting your JavaScript application to a database is tedious. Back-end developers spend hours modeling the database, securing connections, writing SQL, optimizing queries, deploying to a server, and fixing bugs. In this session, you'll learn how Ext Speeder gives your front-end team a tool to automatically generate a full back-end. In minutes, a REST API between a Sencha Ext JS Grid application and a relational database is created. This will save you a huge amount of time and also minimizes the risk of human error. Application time-to-market has never been shorter.
Server Check.in case study - Drupal and Node.jsJeff Geerling
Server Check.in is a simple, inexpensive website and server monitor. See how Server Check.in was built, and how it uses Drupal and Node.js together to build an easy-to-use and powerful web application. See more at https://servercheck.in/
This document discusses and compares single page applications (SPAs) and multi-page applications (MPAs). It notes that SPAs load faster, run faster, and work offline as only the content is loaded via AJAX/JSON while the main page remains the same. Popular SPA frameworks mentioned include AngularJS, ReactJS, ExtJS, KnockoutJS, and EmberJS. While SPAs provide advantages for speed, development, and debugging, disadvantages include issues with search engine optimization, back button functionality, and testing. The document emphasizes that neither approach is a one-size-fits-all solution and developers should decide what best fits their needs based on considering advantages and disadvantages. It also stresses the importance of
The document provides an overview of various MySQL storage engines. It discusses key storage engines like MyISAM, InnoDB, MEMORY, and MERGE. It describes that storage engines manage how data tables are handled and each engine has its own advantages and purposes. The selection of a storage engine depends on the user's table type and purpose, considering factors like transactions, backups, and special features.
Building Enterprise Search Engines using Open Source TechnologiesRahul Singh
Enterprise Search is a challenging problem for most organizations. Public search technologies such as Google can index content and use link popularity to rank content in addition to the basic keyword matches. Enterprise Search is different. Sometimes it requires specially designed indexes as well as several processing steps.
At the U.S. Patent & Trademark Office, part of the Department of Commerce, a team of professionals is building the next generation of search tools using open source technologies. Like any large undertaking, it’s not a simple plug and play project.
Main topics to be covered in this talk:
+ Architectures for Large Scale Enterprise Search
+ Leveraging Apache Cassandra & Spark
+ Customizing / Configuring Apache SolR and Indexing
+ Writing a custom Parser for SolR in Scala
MongoDB and Amazon Web Services: Storage Options for MongoDB DeploymentsMongoDB
When using MongoDB and AWS, you want to design your infrastructure to avoid storage bottlenecks and make the best use of your available storage resources. AWS offers a myriad of storage options, including ephemeral disks, EBS, Provisioned IOPS, and ephemeral SSD's, each offering different performance and persistence characteristics. In this session, we’ll evaluate each of these options in the context of your MongoDB deployment, assessing the benefits and drawbacks of each.
This document provides an overview of Azure SQL database and related services including:
- Azure SQL Database which provides single database and elastic pool models for predictable or shared workloads.
- Azure SQL Managed Instance which provides high compatibility with SQL Server in a PaaS model.
- Related Azure data and analytics services for ingestion, storage, preparation, modeling and serving of data.
- Key capabilities of Azure SQL Database around data migration, programmability, security and operations.
1. The document discusses how OpsWorks has made the presenter's life easier as a developer who also handles operations. OpsWorks provides hosted infrastructure on AWS for deploying applications using Chef recipes.
2. It describes the main structures in OpsWorks - stacks, layers, apps, and instances. Stacks represent entire applications, layers define different parts like web servers, apps contain specific settings, and instances define the servers.
3. The presenter discusses using OpsWorks with Ruby on Rails applications, including customizing Chef recipes, deploying code, and integrating other AWS services for monitoring, security, and scaling. While documentation can be confusing, OpsWorks provides an easy way for developers to manage operations.
Building Codealike: a journey into the developers analytics worldOren Eini
Codealike plugins in Visual Studio, Eclipse and Chrome, track developers while they code and perform analytic calculations at the millisecond level. For such write heavy workloads and using RavenDB as the main and only database was not without challenge. In this talk, we will reveal how we built and scaled such a solution, how we were able to improve performance with Voron and glance at our own mistakes and architectural choices down the line.
Flynn Bundy - 60 micro-services in 6 months WinOps Conf
In this talk, I want to take the audience on a journey of how we (Coolblue) migrated 60 .Net micro-services to the AWS Cloud. This talk covers the high’s, low’s and everything in between when working in a multi-disciplinary Developer / Operations Cloud team. This talk will cover the evolution of our processes and toolsets to align with Chaos Engineering best practices. Most importantly, I want to highlight how we changed the way we thought about services and servers in general.
The key takeaways from this talk would be related to:
Continous Inspection (TeamCity)
Continous Deployment (Octopus Deploy)
Infrastructure as Code (Cloudformation)
Chaos Engineering (Chaos Monkey)
Monitoring and Logging (Datadog and Splunk)
.Net and .Net Core (on Windows Server 2016)
Automation in AWS Cloud
Given at CraftConf 2015: http://craft-conf.com/2015
Accompanying talk repo: https://github.com/randommood/Craftconf2015
Video: http://www.ustream.tv/recorded/61449003
Let's face it, testing distributed systems is hard. Large number of inputs, partial failures, and asynchrony make these systems seemingly impossible to verify. Formal testing methods are onerous and system correctness continues to elude us. Despite the difficulty, we need to have a way to change our systems with confidence. Integration and unit tests are vital to our sanity and we know it's good for us to use continuous integration to ensure functional consistency across our products.
Come to this talk for a fresh and practical look into the various aspects of distributed systems testing and integration. We will cover CI pipelines: their strengths, weaknesses, and ways to improvement them. Get ready to rediscover the untapped power of your integration practices and develop a burning desire to make them more awesome!
The document announces Ricon East 2013 in NYC and that Riak is now generally available with full installation, configuration, monitoring, alerting, and backup support. It also expresses excitement to be back and thanks attendees.
Computational Patterns of the Cloud - QCon NYC 2014Ines Sombra
This document summarizes a presentation about computational patterns in the cloud. It discusses four key patterns: reclaimable resources, where cloud applications provision resources on demand and release them when not needed; harvesting services, where applications consume external services via APIs rather than maintaining standalone components; distributed systems, where resources and services come together to form distributed systems as the new norm; and continuous everything, where the cloud enables continuous delivery, deployment, and testing practices. The document provides examples and stories about implementing these patterns and discusses challenges organizations may face in adopting cloud-native approaches.
1) SSDs provide significantly better performance than HDDs for WordPress.com, reducing costs by 75% while improving performance and capacity 6 times.
2) An experiment replacing HDD RAID with SSDs was very successful, but initial production deployment had critical bugs and required restarting the migration process.
3) While SSDs save money and users' time, maximizing their performance requires substantial research, testing, and software optimization from system administrators.
Deploying MongoDB can be a challenge if you don't understand how resources are used nor how to plan for the capacity of your systems. If you need to deploy, or grow, a MongoDB single instance, replica set, or tens of sharded clusters then you probably share the same challenges in trying to size that deployment. This talk will cover what resources MongoDB uses, and how to plan for their use in your deployment. Topics covered will include understanding how to model and plan capacity needs from the perspective of a new deployment, growing an existing one, and defining where the steps along scalability on your path to the top. The goal of this presentation will be to provide you with the tools needed to be successful in managing your MongoDB capacity planning tasks.
This document provides an overview of using Object Relational Mapping (ORM) with Python SQLAlchemy and MariaSQL. It discusses using ORM for database access, mapping database tables to Python classes, querying relationships between tables, and more advanced topics like adding virtual columns without changing the database schema. The document also includes examples of querying data from multiple related tables and creating database views using alembic migrations.
This document discusses various techniques for optimizing website performance in order to improve search engine optimization (SEO) rankings. It outlines strategies for reducing page load time such as compressing files, lazy loading images, minimizing requests, caching content, and using modules like Apache's mod_pagespeed. The document stresses that the primary goal should be improving the user experience rather than solely focusing on achieving full scores on Google's Pagespeed Insights tool.
This document discusses moving a web application to Amazon Web Services (AWS) and managing it with RightScale. It outlines the challenges of the previous single-server deployment, including lack of scalability and single point of failure. The solution presented uses AWS services like EC2, S3, EBS and RDS combined with RightScale for management and Zend Server for the application architecture. This provides auto-scaling, high availability, backups and easier management compared to the previous setup. Alternatives to AWS and RightScale are also briefly discussed.
Cache solutions that can be used when developing applications have been examined. Redis, MemCache, JCache, and Hazelcast comparisons were made.
Performance, Security, Storage Capability and Eviction Policy, Maintenance, Reliability, Cost and also Who's using what.
SenchaCon 2016 - How to Auto Generate a Back-end in MinutesMalin Weiss
Connecting your JavaScript application to a database is tedious. Back-end developers spend hours modeling the database, securing connections, writing SQL, optimizing queries, deploying to a server, and fixing bugs. In this session, you'll learn how Ext Speeder gives your front-end team a tool to automatically generate a full back-end. In minutes, a REST API between a Sencha Ext JS Grid application and a relational database is created. This will save you a huge amount of time and also minimizes the risk of human error. Application time-to-market has never been shorter.
Server Check.in case study - Drupal and Node.jsJeff Geerling
Server Check.in is a simple, inexpensive website and server monitor. See how Server Check.in was built, and how it uses Drupal and Node.js together to build an easy-to-use and powerful web application. See more at https://servercheck.in/
This document discusses and compares single page applications (SPAs) and multi-page applications (MPAs). It notes that SPAs load faster, run faster, and work offline as only the content is loaded via AJAX/JSON while the main page remains the same. Popular SPA frameworks mentioned include AngularJS, ReactJS, ExtJS, KnockoutJS, and EmberJS. While SPAs provide advantages for speed, development, and debugging, disadvantages include issues with search engine optimization, back button functionality, and testing. The document emphasizes that neither approach is a one-size-fits-all solution and developers should decide what best fits their needs based on considering advantages and disadvantages. It also stresses the importance of
The document provides an overview of various MySQL storage engines. It discusses key storage engines like MyISAM, InnoDB, MEMORY, and MERGE. It describes that storage engines manage how data tables are handled and each engine has its own advantages and purposes. The selection of a storage engine depends on the user's table type and purpose, considering factors like transactions, backups, and special features.
Building Enterprise Search Engines using Open Source TechnologiesRahul Singh
Enterprise Search is a challenging problem for most organizations. Public search technologies such as Google can index content and use link popularity to rank content in addition to the basic keyword matches. Enterprise Search is different. Sometimes it requires specially designed indexes as well as several processing steps.
At the U.S. Patent & Trademark Office, part of the Department of Commerce, a team of professionals is building the next generation of search tools using open source technologies. Like any large undertaking, it’s not a simple plug and play project.
Main topics to be covered in this talk:
+ Architectures for Large Scale Enterprise Search
+ Leveraging Apache Cassandra & Spark
+ Customizing / Configuring Apache SolR and Indexing
+ Writing a custom Parser for SolR in Scala
MongoDB and Amazon Web Services: Storage Options for MongoDB DeploymentsMongoDB
When using MongoDB and AWS, you want to design your infrastructure to avoid storage bottlenecks and make the best use of your available storage resources. AWS offers a myriad of storage options, including ephemeral disks, EBS, Provisioned IOPS, and ephemeral SSD's, each offering different performance and persistence characteristics. In this session, we’ll evaluate each of these options in the context of your MongoDB deployment, assessing the benefits and drawbacks of each.
This document provides an overview of Azure SQL database and related services including:
- Azure SQL Database which provides single database and elastic pool models for predictable or shared workloads.
- Azure SQL Managed Instance which provides high compatibility with SQL Server in a PaaS model.
- Related Azure data and analytics services for ingestion, storage, preparation, modeling and serving of data.
- Key capabilities of Azure SQL Database around data migration, programmability, security and operations.
1. The document discusses how OpsWorks has made the presenter's life easier as a developer who also handles operations. OpsWorks provides hosted infrastructure on AWS for deploying applications using Chef recipes.
2. It describes the main structures in OpsWorks - stacks, layers, apps, and instances. Stacks represent entire applications, layers define different parts like web servers, apps contain specific settings, and instances define the servers.
3. The presenter discusses using OpsWorks with Ruby on Rails applications, including customizing Chef recipes, deploying code, and integrating other AWS services for monitoring, security, and scaling. While documentation can be confusing, OpsWorks provides an easy way for developers to manage operations.
Building Codealike: a journey into the developers analytics worldOren Eini
Codealike plugins in Visual Studio, Eclipse and Chrome, track developers while they code and perform analytic calculations at the millisecond level. For such write heavy workloads and using RavenDB as the main and only database was not without challenge. In this talk, we will reveal how we built and scaled such a solution, how we were able to improve performance with Voron and glance at our own mistakes and architectural choices down the line.
Flynn Bundy - 60 micro-services in 6 months WinOps Conf
In this talk, I want to take the audience on a journey of how we (Coolblue) migrated 60 .Net micro-services to the AWS Cloud. This talk covers the high’s, low’s and everything in between when working in a multi-disciplinary Developer / Operations Cloud team. This talk will cover the evolution of our processes and toolsets to align with Chaos Engineering best practices. Most importantly, I want to highlight how we changed the way we thought about services and servers in general.
The key takeaways from this talk would be related to:
Continous Inspection (TeamCity)
Continous Deployment (Octopus Deploy)
Infrastructure as Code (Cloudformation)
Chaos Engineering (Chaos Monkey)
Monitoring and Logging (Datadog and Splunk)
.Net and .Net Core (on Windows Server 2016)
Automation in AWS Cloud
Given at CraftConf 2015: http://craft-conf.com/2015
Accompanying talk repo: https://github.com/randommood/Craftconf2015
Video: http://www.ustream.tv/recorded/61449003
Let's face it, testing distributed systems is hard. Large number of inputs, partial failures, and asynchrony make these systems seemingly impossible to verify. Formal testing methods are onerous and system correctness continues to elude us. Despite the difficulty, we need to have a way to change our systems with confidence. Integration and unit tests are vital to our sanity and we know it's good for us to use continuous integration to ensure functional consistency across our products.
Come to this talk for a fresh and practical look into the various aspects of distributed systems testing and integration. We will cover CI pipelines: their strengths, weaknesses, and ways to improvement them. Get ready to rediscover the untapped power of your integration practices and develop a burning desire to make them more awesome!
The document announces Ricon East 2013 in NYC and that Riak is now generally available with full installation, configuration, monitoring, alerting, and backup support. It also expresses excitement to be back and thanks attendees.
Computational Patterns of the Cloud - QCon NYC 2014Ines Sombra
This document summarizes a presentation about computational patterns in the cloud. It discusses four key patterns: reclaimable resources, where cloud applications provision resources on demand and release them when not needed; harvesting services, where applications consume external services via APIs rather than maintaining standalone components; distributed systems, where resources and services come together to form distributed systems as the new norm; and continuous everything, where the cloud enables continuous delivery, deployment, and testing practices. The document provides examples and stories about implementing these patterns and discusses challenges organizations may face in adopting cloud-native approaches.
Are you running a database in the cloud? Worried that you're doing it wrong?
Engine Yard supports a broad set of databases with flexibility for customers to modify and configure. However, freedom to adapt and extend standard functionality comes with unexpected negative consequences: modifications can seriously affect durability and performance. I've observed common problems, patterns and best practices with big (and not so big) data. I'll highlight the most common pitfalls and discuss how to avoid them.
Video for this talk is available here: http://vimeo.com/83755776
QCon SF 2015: https://qconsf.com/sf2015/keynote/so-we-hear-you-like-papers
Repo: https://github.com/Randommood/QConSF2015
Given with Caitie McCaffrey - https://twitter.com/caitie | https://speakerdeck.com/caitiem20
Surprisingly enough academic papers can be interesting and very relevant to the work we do as computer science practitioners. Papers come in many kinds/ areas of focus and sometimes finding the right one can be difficult. But when you do, it can radically change your perspective and introduce you to new ideas.
Distributed Systems has been an active area of research since the 1960s, and many of the problems we face today in our industry have already had solutions proposed, and have inspired new research. Join us for a guided tour of papers from past and present research that have reshaped the way we think about building large scale distributed systems.
NoSQL Databases in the Cloud - Great Wide Open 2014Ines Sombra
In this session we'll introduce NoSQL databases and the movement's emerging patterns. We will contrast them to the concepts presented in workshop 1 (attendance is not mandatory). We will discuss a few of the most common open source NoSQL databases, their strengths, use cases, and their operational stories when running in the Cloud.
Note: This talk is aimed to developers
Architectural Patterns of Resilient Distributed SystemsInes Sombra
This document contains the slides from a presentation given by Ines Sombra at Strangeloop 2015 about architectural patterns for building resilient distributed systems. The presentation discusses defining resilience, models of resilience from literature like probabilistic availability and decomposition/orthogonality. It also discusses insights from industry systems like Netflix, Google Chubby, Twitter Truce, and resilient architectural patterns like redundancies, gossip protocols, and prioritizing operability and the ability to handle unknown unknowns.
This document summarizes DreamObjects, an object storage platform powered by Ceph. It discusses the hardware used in storage and support nodes, including Intel and AMD processors, RAM, disks, and networking components. The document also provides details on Ceph configuration including replication, CRUSH mapping, OSD configuration, and application tuning. Monitoring tools discussed include Chef, pdsh, Sensu, collectd, graphite, logstash, Jenkins and future plans.
This document summarizes a meetup recap of the 2013 AWS re:Invent conference. It discusses several new services and updates announced at the conference, including Amazon WorkSpaces (virtual desktops), IAM supporting SAML, Trusted Advisor improvements, Amazon AppStream, RDS adding support for PostgreSQL, new C3, G2, and I2 EC2 instance types, DynamoDB adding global secondary indexes, and previews of Amazon Kinesis for real-time streaming data and AWS CloudTrail for API call auditing. The meetup also covered breakout sessions on optimizing EC2 and EBS performance and managing infrastructure as code instead of by individual resources.
Transitioning From SQL Server to MySQL - Presentation from Percona Live 2016Dylan Butler
What if you were asked to support a database platform that you had never worked with before? First you would probably say no, but after you lost that fight, then what? That is exactly how I came to support MySQL. Over the last year my team has worked to learn MySQL, architect a production environment, and figure out how to support it alongside our other platforms (Microsoft SQL Server and Oracle). Along the way, I have also come to appreciate the unique offering of this platform and see it as an important part of our environment going forward.
To make things even more challenging, our first MySQL databases were the backend for a critical, web based application that needed to be highly available across multiple data centers. This meant that we did not have the luxury of standing up a simpler environment to start with and building confidence there. Our final architecture ended up using a five node Percona XtraDB Cluster spread across three data centers.
This session will focus on lessons learned along the way, as well as challenges related to supporting more than one database platforms. It should be interesting to anyone who is new to MySQL, anyone who is being asked to support more than one database platform, or anyone who wants to see how an outsider views the platform.
This document discusses using PostgreSQL with Amazon RDS. It begins with an introduction to Amazon RDS and then discusses setting up a PostgreSQL RDS instance, available features like backups and monitoring, limitations, pricing, and references for further reading. The document is intended to provide an overview of deploying and managing PostgreSQL on Amazon RDS.
I3 - Running SharePoint 2016 in Azure the do's and dont's - Jasjit ChopraSPS Paris
In this session we are going to discuss the entire process of planning and successfully running SharePoint 2016 in the cloud. We will cover topics related to Security, Performance, Scalability, High Availability, Backup & Restore and Disaster Recovery. We will also cover the IaC (Infrastructure as Code) use case scenario in this deployment.
ECMDay2015 - Kent Agerlund – Configuration Manager 2012 – A Site ReviewKenny Buntinx
Ever experienced sluggish ConfigMgr administrator console performance or collections taking forever to refresh? Join Kent Agerlund as he will walk you thru a ConfigMgr site review and reveal why so many ConfigMgr installations don’t perform as they should. This sessions will be packed with tip and tricks, SQL secrets and PowerShell scripts that will optimize your environment and bring ConfigMgr into the state it was supposed to be from the beginning
At Adjust we use PostgreSQL the way a lot of people may use Hadoop or other big data platforms. This presentation goes through three of our environments to discuss how we go about doing this and the challenges we face.
Batch to near-realtime: inspired by a real production incidentShivji Kumar Jha
This slide deck was used for the platformatory streams meetup in Bengaluru on July 7, 2024.
This is a real world account from an Apache Druid cluster in production. A story of 48 hours of debugging, learning and understanding batch vs stream better, filing a couple of issues in Druid open source projects and finally a stable production pipeline again thanks to the Druid community. We will discuss what parts of your design could be impacted, how you should change the related systems so the cascading failures don’t bring down your complete production availability. As an example, we will discuss the bottlenecks we had in overlord, slot issues for Peons in middle managers, coordinator bottlenecks, how to mitigated task and segment flooding, what configs we changed sprinkled with real world numbers and snapshots from our Grafana dashboards.
Finally we will list all the leanings and how we made sure we never repeat the same mistakes in production systems.
Move your on prem data to a lake in a Lake in CloudCAMMS
With the boom in data; the volume and its complexity, the trend is to move data to the cloud. Where and How do we do this? Azure gives you the answer. In this session, I will give you an introduction to Azure Data Lake and Azure Data Factory, and why they are good for the type of problem we are talking about. You will learn how large datasets can be stored on the cloud, and how you could transport your data to this store. The session will briefly cover Azure Data Lake as the modern warehouse for data on the cloud,
Sql Start! 2020 - SQL Server Lift & Shift su AzureMarco Obinu
Slide of the session delivered during SQL Start! 2020, where I illustrate different approaches to determine the best landing zone for you SQL Server workloads.
Video (ITA): https://youtu.be/1hqT_xHs0Qs
StudyBlue provides an online service for students to store, study, and share course materials. They implemented MongoDB to address scaling issues with their PostgreSQL database as usage and data grew rapidly. MongoDB allowed for horizontal scaling across shards for improved write performance and high availability. Key challenges included adjusting to the document model versus relational, sharding and rebalancing data, and managing replication lag in an eventually consistent system.
PostgreSQL 15 and its Major Features -(Aakash M - Mydbops) - Mydbops Opensour...Mydbops
PostgreSQL 15 was released on October 13. This presentation on the major features and improvements in PostgreSQL 15, and how they can help for better performance and brings more reliability.
Skypicker is a flight ticket search and booking engine that processes hundreds of terabytes of airline data monthly and sells thousands of tickets daily in Europe, Russia, and China. It uses PostgreSQL extensively to power its API and databases. The document discusses Skypicker's PostgreSQL infrastructure, which includes 5 database clusters with over 0.5TB of memory each that handle 20 million updates per hour. It also covers optimizations made to scale the databases, such as table partitioning, cascading replication, and query tuning. Skypicker is currently preparing for a large increase in data and is hiring database masters and developers.
You want to use MySQL in Amazon RDS, Rackspace Cloud, Google Cloud SQL or HP Helion Public Cloud? Check this out, from Percona Live London 2014. (Note that pricing of Google Cloud SQL changed prices on the same day after the presentation)
Best Practices? That’s like asking how long is a piece of string! While every environment is different, there are however a number of configurations, tweaks and methods that can be of great benefit for your Nagios XI environment. This talk will cover a variety of Best Practice topics for Nagios XI ranging from flexible object configurations through to back end performance enhancements.
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?DATAVERSITY
Wordnik migrated from a MySQL relational database to the non-relational MongoDB database for 5 key reasons: speed, stability, scaling, simplicity, and fitting their object model better. They tested MongoDB extensively, iteratively improving their data mapping and access patterns. The migration was done without downtime by switching between the databases. While inserts were much faster in MongoDB, updates could be slow due to disk I/O. Wordnik addressed this through optimizations like pre-fetching on updates and moving to local storage. Overall, MongoDB was a better fit for Wordnik's large and evolving datasets.
Porting ASP.NET applications to Windows AzureGunnar Peipman
Hosting applications on Windows Azure is simple but there are things to change when cloud-enabling existing web applications because cloud is conceptually different than on-premises or shared hosting environment. This sessions goes through main issues one will face when moving applications to cloud. Real-life examples provide elegant solutions to problems and through demos the audience will see how to deploy applications to cloud and how to test and run cloud and hybrid applications on your development machine.
Agile Oracle to PostgreSQL migrations (PGConf.EU 2013)Gabriele Bartolini
Migrating an Oracle database to Postgres is never an automated operation. And it rarely (never?) involve just the database. Experience brought us to develop an agile methodology for the migration process, involving schema migration, data import, migration of procedures and queries up to the generation of unit tests for QA.
Pitfalls, technologies and main migration opportunities will be outlined, focusing on the reduction of total costs of ownership and management of a database solution in the middle-long term (without reducing quality and business continuity requirements).
Given at Monitorama 2015 -https://github.com/Randommood/ZerotoCapacityPlanning
Video: https://vimeo.com/131377938
Agile, Rugged, and Lean - The Paper EditionInes Sombra
Goto London Day 1 Keynote
gotocon.com/goto-london-2015
Surprisingly enough academic papers can be interesting and very relevant to the work we do as computer science practitioners. Papers come in many kinds/ areas of focus and sometimes finding the right one can be difficult. Websites like The Morning Paper (http://blog.acolyer.org/) and organizations like Papers We Love (http://paperswelove.org/) aim to bring research closer to practitioners and we want you to be a part of them!
Join us for a guided tour of our favorite agile, lean, and rugged papers. We will explore papers that have laid the foundation of Computer Science and papers that push the boundaries of what we know using the three themes of our conference as guide.
Are you running a Database in the cloud? Worried that you’re doing it wrong?
Engine Yard supports a broad set of databases, with lots of
flexibility for customers to modify and configure their installations. But the freedom to adapt and extend standard functionality comes at the risk of unexpected negative consequences: seemingly benign modifications can seriously affect durability and performance.
During our years of helping customers, I've had the unique opportunity to observe common problems, patterns, and best practices with big (and not so big) data. In this talk I'll highlight the most common pitfalls and tell you how to avoid them (I will most likely rant about other things too!).
http://www.meetup.com/nycdevops/events/181986002/
In October 2013 I stopped by Lancaster University's Highwire program to give a seminar on the Cloud and industry disruptions.
Abstract:
Everyone is talking about The Cloud. From disrupting the way we do business to the way we live our lives, it has undoubtedly shifted the way we think about computing, IT operations, innovation, and entrepreneurship. But how should we think about it and why has it brought a paradigm change? What specific technologies can we leverage to improve our lives and how will the next iteration of cloud-based systems look like?
In this seminar, I will introduce you to cloud computing’s history and discuss its applications with practical examples from Engine Yard’s customers, peers, and partners.
See http://www.highwire.lancs.ac.uk/events/Preview/1058 for more information.
Relational Databases in the Cloud - Great Wide Open 2014Ines Sombra
In this session we'll go over the two most common open source relational databases. We'll start with a quick introduction to relational theory and an overview of why this technology is still powerful and relevant. We will address the challenges and operational specifics of developing against relational databases on Cloud environments.
Note: This talk is aimed to developers
This document discusses different types of databases including relational databases which structure data in tables and allow querying similar to how one thinks, as well as NoSQL databases which prioritize practical use over theoretical structure and require database-specific querying. It provides examples of some NoSQL databases, lists databases commonly used, and recommends resources for learning more about Ruby on Rails and databases from Stanford University professors.
The document discusses the importance of welcoming and supporting beginners in a community to help the community grow and thrive. It recommends producing introductory content and mentoring newcomers to help them get involved. It also stresses the need to advocate for diverse viewpoints, partner with other communities, enforce policies against bullying, and acknowledge implicit community rules can change over time to create a more inclusive environment for all.
Getting started with Riak in the Cloud involves provisioning a Riak cluster on Engine Yard and optimizing it for performance. Key steps include choosing instance types like m1.large or m1.xlarge that are EBS-optimized, having at least 5 nodes, setting the ring size to 256, disabling swap, using the Bitcask backend, enabling kernel optimizations, and monitoring and backing up the cluster. Benchmarks show best performance from high I/O instance types like hi1.4xlarge that use SSDs rather than EBS storage.
The document discusses using Riak, an open source NoSQL database, in the cloud to provide highly available and fault tolerant storage for applications. It describes how the authors' application struggled with availability when hosted on AWS, and their research led them to choose Riak as a solution. Riak provides features like consistent hashing, hinted handoff, and active anti-entropy that allow it to scale linearly and remain available even during failures or added/reduced nodes. The document provides guidance on deploying a Riak cluster in the cloud, including choosing instance types, sizing the cluster, disabling swap, using the right filesystem and scheduler, and monitoring and scaling the cluster over time.
This document provides an introduction to relational databases, NoSQL databases, and data in general. It includes the following:
- An overview of relational databases and their ACID properties. Relational databases are best for structured, centralized data and scale vertically.
- A survey of several popular NoSQL databases like MongoDB, Cassandra, Redis, and HBase. NoSQL databases are best for unstructured, large quantities of data and scale horizontally.
- General advice that the data and query models, durability needs, scalability needs, and consistency requirements should determine the best database choice. Trying different options is recommended.
Mobile App Development Company in Saudi ArabiaSteve Jonas
EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.
Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane
Slide Deck from Buckeye Dreamin' 2024 presentation Assessing and Resolving Technical Debt. Focused on identifying technical debt in Salesforce and working towards resolving it.
Rock, Paper, Scissors: An Apex Map Learning JourneyLynda Kane
Slide Deck from Presentations to WITDevs (April 2021) and Cleveland Developer Group (6/28/2023) on using Rock, Paper, Scissors to learn the Map construct in Salesforce Apex development.
"Rebranding for Growth", Anna VelykoivanenkoFwdays
Since there is no single formula for rebranding, this presentation will explore best practices for aligning business strategy and communication to achieve business goals.
Learn the Basics of Agile Development: Your Step-by-Step GuideMarcel David
New to Agile? This step-by-step guide is your perfect starting point. "Learn the Basics of Agile Development" simplifies complex concepts, providing you with a clear understanding of how Agile can improve software development and project management. Discover the benefits of iterative work, team collaboration, and flexible planning.
Hands On: Create a Lightning Aura Component with force:RecordDataLynda Kane
Slide Deck from the 3/26/2020 virtual meeting of the Cleveland Developer Group presentation on creating a Lightning Aura Component using force:RecordData.
Leading AI Innovation As A Product Manager - Michael JidaelMichael Jidael
Unlike traditional product management, AI product leadership requires new mental models, collaborative approaches, and new measurement frameworks. This presentation breaks down how Product Managers can successfully lead AI Innovation in today's rapidly evolving technology landscape. Drawing from practical experience and industry best practices, I shared frameworks, approaches, and mindset shifts essential for product leaders navigating the unique challenges of AI product development.
In this deck, you'll discover:
- What AI leadership means for product managers
- The fundamental paradigm shift required for AI product development.
- A framework for identifying high-value AI opportunities for your products.
- How to transition from user stories to AI learning loops and hypothesis-driven development.
- The essential AI product management framework for defining, developing, and deploying intelligence.
- Technical and business metrics that matter in AI product development.
- Strategies for effective collaboration with data science and engineering teams.
- Framework for handling AI's probabilistic nature and setting stakeholder expectations.
- A real-world case study demonstrating these principles in action.
- Practical next steps to begin your AI product leadership journey.
This presentation is essential for Product Managers, aspiring PMs, product leaders, innovators, and anyone interested in understanding how to successfully build and manage AI-powered products from idea to impact. The key takeaway is that leading AI products is about creating capabilities (intelligence) that continuously improve and deliver increasing value over time.
How Can I use the AI Hype in my Business Context?Daniel Lehner
𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨?
Everyone’s talking about AI but is anyone really using it to create real value?
Most companies want to leverage AI. Few know 𝗵𝗼𝘄.
✅ What exactly should you ask to find real AI opportunities?
✅ Which AI techniques actually fit your business?
✅ Is your data even ready for AI?
If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john
Analyze the growth of meme coins from mere online jokes to potential assets in the digital economy. Explore the community, culture, and utility as they elevate themselves to a new era in cryptocurrency.
Semantic Cultivators : The Critical Future Role to Enable AIartmondano
By 2026, AI agents will consume 10x more enterprise data than humans, but with none of the contextual understanding that prevents catastrophic misinterpretations.
AI and Data Privacy in 2025: Global TrendsInData Labs
In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy.
This infographic contains:
-AI and data privacy: Key findings
-Statistics on AI data privacy in the today’s world
-Tips on how to overcome data privacy challenges
-Benefits of AI data security investments.
Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55
We’re bringing the TDX energy to our community with 2 power-packed sessions:
🛠️ Workshop: MuleSoft for Agentforce
Explore the new version of our hands-on workshop featuring the latest Topic Center and API Catalog updates.
📄 Talk: Power Up Document Processing
Dive into smart automation with MuleSoft IDP, NLP, and Einstein AI for intelligent document workflows.
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company
Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock
Building 10x Organizations with Modern Productivity Metrics
10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’
Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them.
But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?