Beyond basic web development
2 likes1,416 views
Talk about tools that web developers should use that go beyond just using the basic stack you are familiar with. Knocked together for barcamp North East 2
1 of 27
Downloaded 43 times
Recommended
You're Going To Need A Bigger Toolbox
You're Going To Need A Bigger ToolboxGareth Rushgrove Talk from Design It Build It conference in Newcastle. Convincing people to look outside their current development tools for inspiration
Message Queues for Web Applications
Message Queues for Web ApplicationsGareth Rushgrove A short introduction to message queues for web developers. Presented at the first Cambridge Geek Night
Puppet Data Mining
Puppet Data MiningGareth Rushgrove Talk given at the 6th PuppetCamp in Edinburgh.
Covers some of the useful information puppet stores and how to get at it.
Learnings from govuk
Learnings from govukGareth Rushgrove The document summarizes a presentation about building the GOV.UK website from the UK Government Digital Service. It describes the project of building a single domain for the UK government with a focus on citizen needs. The team consisted of around 30 people. Some of the things they liked included the people, dashboards for monitoring, continuous integration, and open source code. Things they wanted to improve included the working environment, processes, managing complexity, the development environment, and knowledge sharing.
What we can learn from CDNs about Web Development, Deployment, and Performance
What we can learn from CDNs about Web Development, Deployment, and PerformanceSergeyChernyshev CDNs have become a core part of internet infrastructure, and application owners are building them into development and product roadmaps for improved efficiency, transparency and performance.
In his talk, Hooman shares recent learnings about the world of CDNs, how they're changing, and how Devs, Ops, and DevOps can integrate with them for optimal deployment and performance.
Hooman Beheshti is VP of Technology at Fastly, where he develops web performance services for the world's smartest CDN platform. A pioneer in the application acceleration space, Hooman helped design one of the original load balancers while at Radware and has held senior technology positions with Strangeloop Networks and Crescendo Networks. He has worked on the core technologies that make the Internet work faster for nearly 20 years and is an expert and frequent speaker on the subjects of load balancing, application performance, and content delivery networks.
MongoDB from Basics to Scale
MongoDB from Basics to ScaleMoshe Kaplan This week I had a session w/ one the Israeli largest Telcos, regarding BillRun!, their new billing solution: an open source billing solution that is based on MongoDB. We covered in this 3 days course: 1) NoSQL background, 2) MongoDB introduction and setup; 3) NoSQL Data Model; 4) NoSQL query language and aggregation framework; 5) Performance tuning; 6) Operations: backup, restore, monitoring and security and 7) HA and scale using Replica set and Sharding
Graphite
GraphiteOleg Obleukhov This document provides an overview of Graphite and Grafana, open-source tools for monitoring and visualizing time series data. It discusses Graphite's core components including Carbon for receiving metrics, Whisper/Ceres for time-series storage, and the Graphite web interface. It also covers Grafana for building dashboards and alerts. The document outlines Graphite and Grafana installation, sending metrics, possible architectures like client-carbon, and storage integration options including Whisper, Ceres, ClickHouse.
Running PHP on Nginx / PHP wgtn
Running PHP on Nginx / PHP wgtnHarald Zeitlhofer my slides about running PHP on Nginx / tips and tricks for high performance websites, presented on the PHP Wellington meetup in New Zealand in April 2015
Apache Spark & Hadoop : Train-the-trainer
Apache Spark & Hadoop : Train-the-trainerIMC Institute The document outlines an upcoming training course on Apache Spark and Hadoop from June 27th to July 1st 2016. It will cover topics like HDFS, HBase, Hive, Spark, Spark SQL, Spark Streaming, Spark Mllib and Kafka. Participants will launch an Azure virtual machine instance, install Docker and pull the Cloudera QuickStart VM to run hands-on exercises with these big data technologies. The course will include sessions on importing/exporting data to HDFS, connecting to Hadoop nodes via SSH, and using tools like HBase, Hive and their related commands and interfaces.
Scaling WordPress
Scaling WordPressMark Jaquith This document discusses optimizing a WordPress site to handle high traffic loads. It provides tips for caching at various levels (opcode, object, page, fragment) using tools like Nginx, PHP-FPM, memcached. It also recommends using a CDN, handling traffic variability, and scaling to multiple application servers with a load balancer. Benchmark results show performance improving from serving 50k pages/day to over 8k requests/second after these optimizations.
Measuring User Experience
Measuring User ExperienceAlois Reitbauer This document discusses measuring user experience by capturing performance metrics from web applications. It outlines challenges in measurement due to lack of standards and introduces W3C specifications for Navigation Timing, Resource Timing, and User Timing that expose timing data from browsers. Examples are given for measuring page load, resource download, and custom timing events. Open issues remain around sending performance data to servers, full browser support, and efficiently measuring bandwidth.
Install Apache Hadoop for Development/Production
Install Apache Hadoop for Development/ProductionIMC Institute This document provides instructions for installing Hadoop for development and production using open source distributions. It discusses installing Hadoop sandboxes like Cloudera Quickstart and Hortonworks Sandbox for development on local machines or clouds. It also covers installing Cloudera Express clusters for production on AWS, including launching EC2 instances and configuring security groups.
Big Data Analytics Using Hadoop Cluster On Amazon EMR
Big Data Analytics Using Hadoop Cluster On Amazon EMRIMC Institute This document outlines steps for running a hands-on workshop on using Hadoop and Amazon EMR. It includes instructions for creating an AWS account and EMR cluster, importing sample data, writing and running a MapReduce word count program in Eclipse, and using Hive to create tables and query data on the EMR cluster. The workshop covers fundamental Hadoop and Hive concepts and commands to analyze big data on Amazon EMR.
Apache Spark in Action
Apache Spark in ActionIMC Institute This document outlines a workshop on Apache Spark given by Dr. Thanachart Numnonda. The workshop covers launching an Azure instance, installing Docker and Cloudera Quickstart, importing and exporting data to HDFS, connecting to the master node via SSH, and an introduction to Spark including RDDs and transformations. Hands-on exercises are provided to demonstrate importing data, connecting to nodes, and using HDFS and Spark APIs.
DansGuardian open source content filtering
DansGuardian open source content filteringAndrew Vandever DansGuardian is an open source content filtering proxy server that can block offensive, malicious, or time-wasting content. It works by pairing with proxy servers like Squid or TinyProxy to filter web traffic. DansGuardian can be configured to log blocked content, apply user-based or group-based filters, and uses blacklist and whitelist files to determine what content to allow or block. Basic configuration of DansGuardian involves editing configuration files to specify the proxy port and blacklist files, while more advanced options allow regular expression matching and separate filter profiles for different user groups.
Analyse Tweets using Flume 1.4, Hadoop 2.7 and Hive
Analyse Tweets using Flume 1.4, Hadoop 2.7 and HiveIMC Institute This document outlines steps to analyze tweets using Flume, Hadoop, and Hive. It describes installing Flume and a jar file, creating a Twitter application to get API keys, configuring an Flume agent to fetch tweets from Twitter and store in HDFS, and using Hive to analyze the tweets by user followers count. The workshop instructions provide commands to stream tweets from Twitter to HDFS using Flume, view the stored tweets files, and run queries in Hive to find the user with the most followers.
MongoDB & Hadoop, Sittin' in a Tree
MongoDB & Hadoop, Sittin' in a TreeMongoDB K Young, CEO of Mortar, gave a presentation on using MongoDB and Hadoop/Pig together. He began with a brief introduction to Hadoop and Pig, explaining their uses for processing large datasets. He then demonstrated how to load data from MongoDB into Pig using a connector, and store data from Pig back into MongoDB. The rest of the presentation focused on use cases for combining MongoDB and Pig, such as being able to separately manage data storage and processing. Young also showed some Mortar utilities for working with MongoDB data in Pig.
API analytics with Redis and Google Bigquery. NoSQL matters edition
API analytics with Redis and Google Bigquery. NoSQL matters editionjavier ramirez At teowaki we have a system for API use analytics using Redis as a fast intermediate store and bigquery as a big data backend. As a result, we can launch aggregated queries on our traffic/usage data in a few seconds and we can try and find for usage patterns that wouldn’t be obvious otherwise. In this session I will speak of the alternatives we evaluated and how we are using Redis and Bigquery to solve our problem.
Conquering the command line for code hackers
Conquering the command line for code hackersPavan M This document provides an overview of using the command line for code searching and hacking. It discusses various commands for navigating directories, listing files, editing text, and searching codebases. Specific commands covered include cd, ls, pwd, find, grep, ack, ag, and git. Examples are given for using each command to search code for things like databases, sessions, passwords, vulnerabilities, and frameworks. The document concludes by discussing how to extend search capabilities and when to use grep versus other tools.
Web Scrapping with Python
Web Scrapping with PythonMiguel Miranda de Mattos Introduction on how to crawl for sites and content from the unstructured data on the web. using the Python programming language and some existing python modules.
Analyse Tweets using Flume, Hadoop and Hive
Analyse Tweets using Flume, Hadoop and HiveIMC Institute This document outlines the steps to analyze tweets using Apache Flume, Hadoop, and Hive. It describes how to install and configure Flume to stream Twitter data to HDFS. It also provides instructions for analyzing the Twitter data stored in HDFS using Hive, including registering a JSON SerDe jar file and running sample queries. The goal is to find the Twitter user with the most followers from the streamed data.
What to Build with Google App Engine
What to Build with Google App EngineGareth Rushgrove This document summarizes what can be built with Google App Engine and highlights some of its key features. It lists examples like a simple issue tracker, aggregator, personal image hosting, and IM application. Some of the features highlighted include Python and Django support, a clean API design, open SDK, one click deployment, management console, and testing stubs. It also discusses stateless request handling, non-relational databases, offline processing, quotas, and future APIs like XMPP, task queues, and other languages. In the end, it invites questions from the audience.
App Engine for Python Developers
App Engine for Python DevelopersGareth Rushgrove A short presentation about what I like about App Engine, aimed at Python developers but relevant for all.
Given at the Cambridge Python User Group on the 3rd of March
A First Class Web Citizen
A First Class Web CitizenGareth Rushgrove Presentation from The Highland Fling conference on things to understand when designing APIs along with a few design guidelines.
Devops
DevopsGareth Rushgrove The document discusses the challenges between development and operations (dev and ops) teams, and introduces the concept of DevOps as a way to improve collaboration between the teams. It provides examples of tools like Puppet and Cucumber that can be used to automate infrastructure provisioning and application testing. The document emphasizes that DevOps is about processes, communication, and automation between devs and ops, not just the use of specific tools. It recommends several blogs and resources for further reading on DevOps.
Parsing Microformats
Parsing MicroformatsGareth Rushgrove The document discusses various tools for parsing microformats from web pages, including hKit (PHP), Mofo (Ruby), Sumo (Javascript), XSLT, ufXtract and Optimus (web services), and the Social Graph API. It provides code examples for extracting microformat data like hCards using each of these tools and APIs.
Config managament for development environments iii
Config managament for development environments iiiPuppet The document discusses using configuration management tools like Puppet and Vagrant to create consistent development environments across different platforms. It describes problems that can arise from differences in developer environments. Vagrant is presented as a solution to create virtual development environments that are automatically configured through tools like Puppet and provisioned to be identical to production. Examples are given of using Vagrant and Puppet together to define environments through a Vagrantfile and Puppet manifests.
Continuously Testing Infrastructure - Beyond Module Testing - PuppetConf 2014
Continuously Testing Infrastructure - Beyond Module Testing - PuppetConf 2014Puppet The document discusses continuously testing infrastructure by testing images, containers, and infrastructure as a service using tools like Packer, Serverspec, and Expect. It advocates applying test-driven development principles to infrastructure provisioning and management. Specifically, it suggests writing tests against an infrastructure API to define policies and desired functionality before provisioning resources. The document also describes testing based on data from PuppetDB to automatically generate and run configuration checks.
Gareth Rushgrove (Puppet) - Ubiquity at #DOXLON
Gareth Rushgrove (Puppet) - Ubiquity at #DOXLONOutlyer Ubiquity - Moving past file, package and service with Puppet Gareth Rushgrove Puppet Labs
In the last few years we've all got much better at managing the configuration of node level resources like files and packages. But our infrastructures are only getting larger and more complex, and today we're more likely to be talking about clusters and distributed systems than individual hosts. This talk will cover a number of things Puppet is doing to make this shift easier - from support for hardware devices and tools like etcd to cloud provisioning and docker.
Video: http://youtu.be/Z2mv9Istg90
Join DevOps Exchange London here: http://www.meetup.com/DevOps-Exchange-London/
Follow DOXLON on twitter http://www.twitter.com/doxlon
Vagrant and Configuration Management
Vagrant and Configuration ManagementGareth Rushgrove Short talk given to engineers and operations folk at The Guardian introducing the Vagrant virtualisation management tool.
More Related Content
What's hot (13)
Apache Spark & Hadoop : Train-the-trainer
Apache Spark & Hadoop : Train-the-trainerIMC Institute The document outlines an upcoming training course on Apache Spark and Hadoop from June 27th to July 1st 2016. It will cover topics like HDFS, HBase, Hive, Spark, Spark SQL, Spark Streaming, Spark Mllib and Kafka. Participants will launch an Azure virtual machine instance, install Docker and pull the Cloudera QuickStart VM to run hands-on exercises with these big data technologies. The course will include sessions on importing/exporting data to HDFS, connecting to Hadoop nodes via SSH, and using tools like HBase, Hive and their related commands and interfaces.
Scaling WordPress
Scaling WordPressMark Jaquith This document discusses optimizing a WordPress site to handle high traffic loads. It provides tips for caching at various levels (opcode, object, page, fragment) using tools like Nginx, PHP-FPM, memcached. It also recommends using a CDN, handling traffic variability, and scaling to multiple application servers with a load balancer. Benchmark results show performance improving from serving 50k pages/day to over 8k requests/second after these optimizations.
Measuring User Experience
Measuring User ExperienceAlois Reitbauer This document discusses measuring user experience by capturing performance metrics from web applications. It outlines challenges in measurement due to lack of standards and introduces W3C specifications for Navigation Timing, Resource Timing, and User Timing that expose timing data from browsers. Examples are given for measuring page load, resource download, and custom timing events. Open issues remain around sending performance data to servers, full browser support, and efficiently measuring bandwidth.
Install Apache Hadoop for Development/Production
Install Apache Hadoop for Development/ProductionIMC Institute This document provides instructions for installing Hadoop for development and production using open source distributions. It discusses installing Hadoop sandboxes like Cloudera Quickstart and Hortonworks Sandbox for development on local machines or clouds. It also covers installing Cloudera Express clusters for production on AWS, including launching EC2 instances and configuring security groups.
Big Data Analytics Using Hadoop Cluster On Amazon EMR
Big Data Analytics Using Hadoop Cluster On Amazon EMRIMC Institute This document outlines steps for running a hands-on workshop on using Hadoop and Amazon EMR. It includes instructions for creating an AWS account and EMR cluster, importing sample data, writing and running a MapReduce word count program in Eclipse, and using Hive to create tables and query data on the EMR cluster. The workshop covers fundamental Hadoop and Hive concepts and commands to analyze big data on Amazon EMR.
Apache Spark in Action
Apache Spark in ActionIMC Institute This document outlines a workshop on Apache Spark given by Dr. Thanachart Numnonda. The workshop covers launching an Azure instance, installing Docker and Cloudera Quickstart, importing and exporting data to HDFS, connecting to the master node via SSH, and an introduction to Spark including RDDs and transformations. Hands-on exercises are provided to demonstrate importing data, connecting to nodes, and using HDFS and Spark APIs.
DansGuardian open source content filtering
DansGuardian open source content filteringAndrew Vandever DansGuardian is an open source content filtering proxy server that can block offensive, malicious, or time-wasting content. It works by pairing with proxy servers like Squid or TinyProxy to filter web traffic. DansGuardian can be configured to log blocked content, apply user-based or group-based filters, and uses blacklist and whitelist files to determine what content to allow or block. Basic configuration of DansGuardian involves editing configuration files to specify the proxy port and blacklist files, while more advanced options allow regular expression matching and separate filter profiles for different user groups.
Analyse Tweets using Flume 1.4, Hadoop 2.7 and Hive
Analyse Tweets using Flume 1.4, Hadoop 2.7 and HiveIMC Institute This document outlines steps to analyze tweets using Flume, Hadoop, and Hive. It describes installing Flume and a jar file, creating a Twitter application to get API keys, configuring an Flume agent to fetch tweets from Twitter and store in HDFS, and using Hive to analyze the tweets by user followers count. The workshop instructions provide commands to stream tweets from Twitter to HDFS using Flume, view the stored tweets files, and run queries in Hive to find the user with the most followers.
MongoDB & Hadoop, Sittin' in a Tree
MongoDB & Hadoop, Sittin' in a TreeMongoDB K Young, CEO of Mortar, gave a presentation on using MongoDB and Hadoop/Pig together. He began with a brief introduction to Hadoop and Pig, explaining their uses for processing large datasets. He then demonstrated how to load data from MongoDB into Pig using a connector, and store data from Pig back into MongoDB. The rest of the presentation focused on use cases for combining MongoDB and Pig, such as being able to separately manage data storage and processing. Young also showed some Mortar utilities for working with MongoDB data in Pig.
API analytics with Redis and Google Bigquery. NoSQL matters edition
API analytics with Redis and Google Bigquery. NoSQL matters editionjavier ramirez At teowaki we have a system for API use analytics using Redis as a fast intermediate store and bigquery as a big data backend. As a result, we can launch aggregated queries on our traffic/usage data in a few seconds and we can try and find for usage patterns that wouldn’t be obvious otherwise. In this session I will speak of the alternatives we evaluated and how we are using Redis and Bigquery to solve our problem.
Conquering the command line for code hackers
Conquering the command line for code hackersPavan M This document provides an overview of using the command line for code searching and hacking. It discusses various commands for navigating directories, listing files, editing text, and searching codebases. Specific commands covered include cd, ls, pwd, find, grep, ack, ag, and git. Examples are given for using each command to search code for things like databases, sessions, passwords, vulnerabilities, and frameworks. The document concludes by discussing how to extend search capabilities and when to use grep versus other tools.
Web Scrapping with Python
Web Scrapping with PythonMiguel Miranda de Mattos Introduction on how to crawl for sites and content from the unstructured data on the web. using the Python programming language and some existing python modules.
Analyse Tweets using Flume, Hadoop and Hive
Analyse Tweets using Flume, Hadoop and HiveIMC Institute This document outlines the steps to analyze tweets using Apache Flume, Hadoop, and Hive. It describes how to install and configure Flume to stream Twitter data to HDFS. It also provides instructions for analyzing the Twitter data stored in HDFS using Hive, including registering a JSON SerDe jar file and running sample queries. The goal is to find the Twitter user with the most followers from the streamed data.
Similar to Beyond basic web development (20)
What to Build with Google App Engine
What to Build with Google App EngineGareth Rushgrove This document summarizes what can be built with Google App Engine and highlights some of its key features. It lists examples like a simple issue tracker, aggregator, personal image hosting, and IM application. Some of the features highlighted include Python and Django support, a clean API design, open SDK, one click deployment, management console, and testing stubs. It also discusses stateless request handling, non-relational databases, offline processing, quotas, and future APIs like XMPP, task queues, and other languages. In the end, it invites questions from the audience.
App Engine for Python Developers
App Engine for Python DevelopersGareth Rushgrove A short presentation about what I like about App Engine, aimed at Python developers but relevant for all.
Given at the Cambridge Python User Group on the 3rd of March
A First Class Web Citizen
A First Class Web CitizenGareth Rushgrove Presentation from The Highland Fling conference on things to understand when designing APIs along with a few design guidelines.
Devops
DevopsGareth Rushgrove The document discusses the challenges between development and operations (dev and ops) teams, and introduces the concept of DevOps as a way to improve collaboration between the teams. It provides examples of tools like Puppet and Cucumber that can be used to automate infrastructure provisioning and application testing. The document emphasizes that DevOps is about processes, communication, and automation between devs and ops, not just the use of specific tools. It recommends several blogs and resources for further reading on DevOps.
Parsing Microformats
Parsing MicroformatsGareth Rushgrove The document discusses various tools for parsing microformats from web pages, including hKit (PHP), Mofo (Ruby), Sumo (Javascript), XSLT, ufXtract and Optimus (web services), and the Social Graph API. It provides code examples for extracting microformat data like hCards using each of these tools and APIs.
Config managament for development environments iii
Config managament for development environments iiiPuppet The document discusses using configuration management tools like Puppet and Vagrant to create consistent development environments across different platforms. It describes problems that can arise from differences in developer environments. Vagrant is presented as a solution to create virtual development environments that are automatically configured through tools like Puppet and provisioned to be identical to production. Examples are given of using Vagrant and Puppet together to define environments through a Vagrantfile and Puppet manifests.
Continuously Testing Infrastructure - Beyond Module Testing - PuppetConf 2014
Continuously Testing Infrastructure - Beyond Module Testing - PuppetConf 2014Puppet The document discusses continuously testing infrastructure by testing images, containers, and infrastructure as a service using tools like Packer, Serverspec, and Expect. It advocates applying test-driven development principles to infrastructure provisioning and management. Specifically, it suggests writing tests against an infrastructure API to define policies and desired functionality before provisioning resources. The document also describes testing based on data from PuppetDB to automatically generate and run configuration checks.
Gareth Rushgrove (Puppet) - Ubiquity at #DOXLON
Gareth Rushgrove (Puppet) - Ubiquity at #DOXLONOutlyer Ubiquity - Moving past file, package and service with Puppet Gareth Rushgrove Puppet Labs
In the last few years we've all got much better at managing the configuration of node level resources like files and packages. But our infrastructures are only getting larger and more complex, and today we're more likely to be talking about clusters and distributed systems than individual hosts. This talk will cover a number of things Puppet is doing to make this shift easier - from support for hardware devices and tools like etcd to cloud provisioning and docker.
Video: http://youtu.be/Z2mv9Istg90
Join DevOps Exchange London here: http://www.meetup.com/DevOps-Exchange-London/
Follow DOXLON on twitter http://www.twitter.com/doxlon
Vagrant and Configuration Management
Vagrant and Configuration ManagementGareth Rushgrove Short talk given to engineers and operations folk at The Guardian introducing the Vagrant virtualisation management tool.
Config managament for development environments ii
Config managament for development environments iiGareth Rushgrove Talk for the London Ruby User Group about using configuration management tools to manage development environments. Lots of Vagrant and Chef code examples.
Automating web site deployment
Automating web site deploymentGareth Rushgrove You really should automate the deployment of your web site or application. Stop using your source control system for deployment, and definitely stop relying on FTP. This presentations talks about why, what you should be doing and importantly how to go about doing it.
Presented at barcamp brighton 4
Встраиваем python для появления аналитики в проекте на С++. Александр Боргард...
Встраиваем python для появления аналитики в проекте на С++. Александр Боргард...corehard_by The document describes the architecture of an online shop platform. It evolved over time from 1999 to present day. Key components include Nginx, Postgresql, and services written in C++ using libraries like Asio and Boost. Python and Lua were later incorporated to allow dynamic behavior. The platform was improved to reduce startup time from 15 minutes to 5 minutes and number of machines through techniques like file caching and C++ extensions for Python.
DevOps For Small Teams
DevOps For Small TeamsJoe Ferguson DevOps is a large part of a company of any size. In the 9+ years that I have been a professional developer I have always taken an interest in DevOps and have been the "server person" for most of the teams I have been a part of. I would like to teach others how easy it is to implement modern tools to make their everyday development and development processes better. I will cover a range of topics from "Stop using WAMP/MAMP and start using Vagrant", "version control isn't renaming files", "Automate common tasks with shell scripts / command line PHP apps" and "From Vagrant to Production".
Exploring Execution Plans, Learning to Read SQL Server Execution Plans
Exploring Execution Plans, Learning to Read SQL Server Execution PlansGrant Fritchey Getting started reading execution plans is very straight forward. The real issue is understanding the plans as they grow in size and complexity. This session will show you how to explore the nooks and crannies of an execution plan in order to more easily find the necessary information needed to make what the plan is telling you crystal clear. The information presented here will better empower you to traverse the execution plans you’ll see on your own servers. That knowledge will make it possible to more efficiently and accurately tune and troubleshoot your queries.
Metrics with Ganglia
Metrics with GangliaGareth Rushgrove Talk about using Ganglia and other tools for storing all kinds of web application metrics for both operations and business purposes. Presented at Cambridge Geek Night
Type "Google.com" into the Browser and Hit Enter: What Happens Next?
Type "Google.com" into the Browser and Hit Enter: What Happens Next?Graeme Mathieson The document summarizes the steps a browser takes when a user enters "google.com" in the address bar. It checks if it is a valid URL, determines if HTTPS is preferred, checks the browser and OS caches for the domain IP address, performs a DNS lookup if needed to obtain the IP address, sets up a secure TCP connection on port 443, and sends an HTTP GET request to fetch the requested resource.
No API? No Problem! Let the Robot Do Your Work! Web Scraping and Automation W...
No API? No Problem! Let the Robot Do Your Work! Web Scraping and Automation W...OutSystems Considering how popular APIs are these days, it’s frustrating to run into a service or site without one. But, it’s actually quite common. If you need to collect data or perform an action on the web without access to an API, there are a couple ways you can hack it using OutSystems.
Varnish Caching
Varnish CachingGareth Rushgrove Lightning talk given at Refresh Cambridge event on 6th July 2011. Very quick introduction to where an HTTP Caching solution fits in, and an example of the kind of effect it could have on performance.
Madison PHP 2015 - DevOps For Small Teams
Madison PHP 2015 - DevOps For Small TeamsJoe Ferguson DevOps is a large part of a company of any size. In the 9+ years that I have been a professional developer I have always taken an interest in DevOps and have been the "server person" for most of the teams I have been a part of. I would like to teach others how easy it is to implement modern tools to make their everyday development and development processes better. I will cover a range of topics from "Stop using WAMP/MAMP and start using Vagrant", "version control isn't renaming files", "Automate common tasks with shell scripts / command line PHP apps" and "From Vagrant to Production".
ZendCon 2015 - DevOps for Small Teams
ZendCon 2015 - DevOps for Small TeamsJoe Ferguson Joe Ferguson discusses how small development teams can implement DevOps practices. He recommends using version control for all code and configurations, developing on the same environments that are deployed (using Vagrant), implementing continuous integration and testing, and automating common tasks through aliases, scripts, and cron jobs. The talk provides many specific tools and resources for setting up version control, continuous integration, testing, and automation for small teams.
More from Gareth Rushgrove (14)
Communications Between Tribes
Communications Between TribesGareth Rushgrove A discussion of the importance of communication between people in different teams or working in different disciplines, with lots of examples from my time introducing devops practices to the UK Government.
The Challenges of Container Configuration
The Challenges of Container ConfigurationGareth Rushgrove A look at some of the configuration issues that containers introduce, and how to avoid or fix them. Discusses immutable infrastructure, the difference between build-time and runtime configuration, scheduler configuration and more.
Puppet and Openshift
Puppet and OpenshiftGareth Rushgrove A short look at various integrations between Puppet and Red Hat Openshift, looking at running Puppet on Atomic Host and at the Kubernetes integration.
Two Sides of Google Infrastructure for Everyone Else
Two Sides of Google Infrastructure for Everyone ElseGareth Rushgrove A two sided debate about the #GIFEE meme and the art of software adoption in different types of organisations.
Thinking Evil Thoughts
Thinking Evil ThoughtsGareth Rushgrove This document discusses threat modeling and how to properly scope security assessments. It provides examples of how threat modeling can be applied, including getting the full scope of the system correct and identifying risks. The document warns that developer laptops and conferences pose security risks and outlines some mitigation approaches like two-factor authentication and separation of duties. The overall message is that modern development approaches require keeping security top of mind.
Web operations
Web operationsGareth Rushgrove a short presentation given to the new UK Government Digital Service to introduce web operations as a discipline.
Self Education for Web Professionals
Self Education for Web ProfessionalsGareth Rushgrove The document discusses various methods for self-education as a web professional, including attending conferences, reading blogs and publications, participating in local user groups, writing, presenting, contributing to open source projects, and playing with new technologies. It provides quotes from several individuals about their approaches and perspectives on ongoing learning and professional development.
Testing Django Applications
Testing Django ApplicationsGareth Rushgrove The document is a presentation on practical testing for Django developers. It discusses various aspects of testing Django applications including:
- The basic unittest framework in Python and how it can be used for testing Django apps
- Different types of tests like unit tests, integration tests, and functional tests
- What parts of a Django app should be tested like models, views, templates
- Tools for writing tests like custom assertions, test runners, and test coverage reporting
- Best practices for testing like separating test suites and improving test speed
It encourages developers to write tests for their Django applications.
Design Strategies for a Distributed Web
Design Strategies for a Distributed WebGareth Rushgrove Presentation from Xtech in Dublin 2008 on advantages, problems and potential solutions for bringing a mashups to larger commercial web application development
Things you probably don't do (or tying to make project automation sexy)
Things you probably don't do (or tying to make project automation sexy)Gareth Rushgrove 10 things you should do on every web project - starting with source control up to build scripts. Delivered at barcamplondon3
Notes from (Web 2.0) Revolution
Notes from (Web 2.0) RevolutionGareth Rushgrove A short presentation about what anyone building software can learn from the Web 2.0 success stories. Delivered to a group of IT Managers for Codeworks Connect.
Rails flavoured OpenId
Rails flavoured OpenIdGareth Rushgrove Rails flavored OpenID, which is an open, decentralized framework that allows users to log in to websites using existing identities from sites like blogs, photo streams, and profiles. OpenID takes advantage of existing internet technologies by allowing these online identities to be used as accounts on sites that support OpenID logins. With OpenID, users can easily transform existing URIs into accounts that can be used to log in to multiple websites.
Shiny Content Management with Radiant
Shiny Content Management with RadiantGareth Rushgrove A whistle stop tour of the Radiant CMS presented at the Newcastle Ruby and Rails usergroup
RESTful Rabbits
RESTful RabbitsGareth Rushgrove RESTful Rabbits The North tm Representational State Transfer (REST) is a style of software architecture for distributed hypermedia systems such as the World Wide Web. HTTP verbs like GET, POST, PUT, DELETE etc are used to act on resources identified by URIs. No advance coordination is needed between servers and clients as long as they agree on relevant specifications. This document provides examples of RESTful APIs from Flickr, Nabaztag and others that follow best practices of using HTTP verbs to manipulate identifiable resources.
Recently uploaded (20)
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/
HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client.
Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience.
In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including
- Accessing the console
- Locating and interpreting log files
- Accessing the data folder within the browser’s cache (using OPFS)
- Understand the difference between single- and multi-user scenarios
- Utilizing Client Clocking
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock Building 10x Organizations with Modern Productivity Metrics
10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’
Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them.
But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?
How Can I use the AI Hype in my Business Context?
How Can I use the AI Hype in my Business Context?Daniel Lehner 𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨?
Everyone’s talking about AI but is anyone really using it to create real value?
Most companies want to leverage AI. Few know 𝗵𝗼𝘄.
✅ What exactly should you ask to find real AI opportunities?
✅ Which AI techniques actually fit your business?
✅ Is your data even ready for AI?
If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025
https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/
Is AI just another technology, or does it fundamentally change the way we live and think?
Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater.
At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts.
At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsInData Labs In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy.
This infographic contains:
-AI and data privacy: Key findings
-Statistics on AI data privacy in the today’s world
-Tips on how to overcome data privacy challenges
-Benefits of AI data security investments.
Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/
HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar.
Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten.
In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich
- Zugriff auf die Konsole
- Auffinden und Interpretieren von Protokolldateien
- Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS)
- Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien
- Nutzung der Client Clocking-Funktion
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Splunk Security Update
Sprecher: Marcel Tanuatmadja
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdffjgm517 descaripcion detallada del avance de las tecnologias en mesopotamia, egipto, roma y grecia.
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityriccardosl1 Cyber awareness training educates employees on risk associated with internet and malicious emails
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo From predictive maintenance to robotic automation, AI is driving the future of manufacturing. But without high-quality annotated data, even the smartest models fall short.
Discover how data annotation services are powering accuracy, safety, and efficiency in AI-driven manufacturing systems.
Precision in data labeling = Precision on the production floor.
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Mobile App Development Company in Saudi Arabia
Mobile App Development Company in Saudi ArabiaSteve Jonas EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc. Impelsys provided a robust testing solution, leveraging a risk-based and requirement-mapped approach to validate ICU Connect and CritiXpert. A well-defined test suite was developed to assess data communication, clinical data collection, transformation, and visualization across integrated devices.
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma My talk for the Indian School of Business (ISB) Emerging Leaders Program Cohort 9. In this talk, I discussed key issues around adoption of GenAI in business - benefits, opportunities and limitations. I also discussed how my research on Theory of Cognitive Chasms helps address some of these issues
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru Introduction to LPIC-1 Exam - overview, exam details, price and job opportunities
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo Cloudflare Q4 Financial Results Presentation