Talk @ API Days Paris, 13/12/2016
Simplifying development and deployment of serverless applications with Open Source frameworks and tools: Serverless, Gordon, Chalice, etc.
This document summarizes serverless computing using AWS Lambda. It discusses how AWS Lambda allows developers to deploy code without managing infrastructure. Various frameworks are presented that simplify development and deployment of serverless applications using AWS Lambda, including the Serverless framework, Gordon, and the new AWS Serverless Application Model (SAM). Serverless architectures with AWS Lambda provide scalability and pay-per-use pricing for event-driven applications.
Developing and deploying serverless applications (February 2017)Julien SIMON
- The document discusses developments and tools for serverless applications on AWS Lambda. It begins with an overview of new Lambda features like environment variables and Step Functions for orchestrating Lambda functions.
- Several serverless frameworks are demonstrated, including the Serverless Framework, Gordon, and Chalice, which simplify developing and deploying Lambda functions and event sources.
- The AWS Serverless Application Model (SAM) is presented as a way to bundle Lambda functions, APIs, and events using CloudFormation for simplified deployment. Additional resources on Lambda are also listed.
Continuous Deployment with Amazon Web ServicesJulien SIMON
This document summarizes a webinar about continuous deployment with Amazon Web Services. It defines concepts like continuous integration, continuous delivery, and DevOps. It then demonstrates how to set up continuous integration/continuous delivery pipelines on AWS using services like CodeCommit, CodeBuild, CodeDeploy, and CodePipeline. The pipelines shown include building and deploying a C library and a Java web application. Potential issues that may occur with deployments are also discussed.
An introduction to serverless architectures (February 2017)Julien SIMON
An introduction to serverless
AWS Lambda
Amazon API Gateway
Demo: writing your first Lambda function
Demo: building a serverless pipeline
Additional resources
Infrastructure as code with Amazon Web ServicesJulien SIMON
This document summarizes a presentation on infrastructure as code using AWS services like CloudFormation, Terraform, and Troposphere. The presentation covers why infrastructure as code is useful for automating deployments, making builds predictable and testable. It also provides examples of typical use cases and demos of creating, updating and deleting stacks with the different services. CloudFormation, Terraform and Troposphere are compared in terms of features and interfaces. Additional resources for learning more about infrastructure as code and AWS are also listed.
This document discusses serverless frameworks on AWS like AWS Lambda, the Serverless framework, Gordon, and AWS Chalice. It provides an overview of each tool and code samples to define and deploy Lambda functions from the command line or within the frameworks. Various options are presented for developing, testing, and deploying serverless applications locally and to AWS.
DevOps with Amazon Web Services (November 2016)Julien SIMON
This document discusses DevOps practices using Amazon Web Services. It describes how AWS services like CodeCommit, CodeDeploy, and CodePipeline can help implement a continuous delivery pipeline for developing and deploying microservices architectures. These services provide automated testing, deployment to multiple environments including production, and integration with third-party tools to streamline the release process for development teams. The document provides examples of how to set up a continuous delivery pipeline using AWS Code services and recommends further resources for learning more.
Running Open Source Platforms on AWS (November 2016)Julien SIMON
This document discusses running open source platforms on AWS. It provides an overview of AWS infrastructure including regions, availability zones, and data centers. It then covers virtual machines and operating systems available on AWS, including Amazon EC2 instances, Amazon Linux, and other Linux AMIs. It also discusses language SDKs, Docker, and common Docker orchestrators like Docker Swarm and Kubernetes. The document concludes by covering additional AWS services for development infrastructure, databases, data processing, and other open source technologies.
This document discusses building a serverless data pipeline using AWS Lambda and other AWS managed services. It provides a 12 step process to create a serverless architecture that collects event data via API calls, stores it in DynamoDB, processes it with Lambda, sends it to Kinesis and Kinesis Firehose, and archives it in S3. This allows building scalable and cost-effective data pipelines and applications without having to manage any servers.
Deployment and Management on AWS: A Deep Dive on Options and ToolsDanilo Poccia
This document provides an overview and comparison of different options for deploying and managing applications on AWS: AWS Elastic Beanstalk, AWS OpsWorks, AWS CloudFormation, and raw Amazon EC2. It discusses the tradeoffs between convenience, control, and complexity for each option. It also includes code samples and descriptions of features for each service.
A 60-minute tour of AWS Compute (November 2016)Julien SIMON
This document summarizes a 60-minute tour of AWS compute services, including Amazon EC2, Elastic Beanstalk, EC2 Container Service, and AWS Lambda. It provides an overview of each service, including its core capabilities and use cases. Examples and demos are shown for Elastic Beanstalk, EC2 Container Service, and AWS Lambda. Additional resources are referenced for going deeper with ECS and Lambda.
Running Docker clusters on AWS (November 2016)Julien SIMON
This document discusses running Docker clusters on AWS. It describes Amazon ECS for running Docker containers on AWS and managing clusters of containers. It provides several case studies of companies using Amazon ECS, such as Coursera, Remind, and Segment. It then covers different architectures for running applications on ECS, including using Elastic Load Balancers, Weave, and Consul for service discovery. It concludes with additional resources and links for learning more about Amazon ECS.
An Overview of AWS IoT (November 2016)Julien SIMON
This document discusses IoT projects running on Amazon Web Services (AWS). It provides an overview of the AWS IoT platform, which allows connection of IoT devices, collection of data using MQTT protocol, and storage/analysis of data in AWS services. It also demonstrates connecting an Arduino device to AWS IoT and subscribing/publishing data to topics.
This document discusses AWS CloudFormation, which allows users to automate the deployment of AWS resources through templates. It describes how CloudFormation templates define resources using JSON, how templates can include parameters, mappings, and conditions. Common uses of CloudFormation include replicating environments, deploying to different regions, and disaster recovery. The presentation includes a demo of creating a VPC and LAMP stack using CloudFormation.
Devops with Amazon Web Services (January 2017)Julien SIMON
This document discusses Amazon Web Services tools for DevOps practices like microservices architecture, continuous delivery, and deployment pipelines. It introduces AWS services for source control (CodeCommit), building (CodeBuild), deployment (CodeDeploy), and release management (CodePipeline). These services help teams implement best practices like automated testing, releases to multiple environments without downtime, and rollbacks. The document provides an example pipeline of using CodeCommit, CodeBuild, CodeDeploy and CodePipeline together to deploy code from a GitHub repository to development and production environments. It also briefly introduces the X-Ray service for distributed application debugging.
The document discusses AWS services for DevOps workflows including infrastructure as code (AWS CloudFormation), container management (Amazon ECS and ECR), continuous integration and delivery (AWS CodeCommit, CodeBuild, CodeDeploy, CodePipeline). It provides an overview of each service and examples of how they can be used together in a continuous deployment pipeline to develop, build, test and deploy applications on AWS.
Bonnes pratiques pour la gestion des opérations de sécurité AWSJulien SIMON
Modèle de sécurité partagée
Protection des données
Gestion des utilisateurs et des autorisations
Journalisation des données
Automatisation des vérifications
This document provides an introduction and overview of Amazon's AI services including Amazon Polly, Amazon Lex, and Amazon Rekognition. Amazon Polly is a text-to-speech service that converts text into natural-sounding speech for 47 voices across 24 languages. Amazon Lex builds conversational interfaces using natural language understanding. Amazon Rekognition provides deep learning capabilities for image analysis, including object detection, facial analysis, face comparison and face recognition.
Big Data answers in seconds with Amazon AthenaJulien SIMON
This document discusses Amazon Athena, a new serverless query service that allows users to run SQL queries directly on data stored in Amazon S3 without having to load the data into databases or manage servers. With Athena, users can analyze exabyte-scale data using standard SQL and get results within seconds without having to learn complex big data technologies. The document provides an overview of how Athena works, the types of data formats it supports, how to query and analyze data with it, and examples using the GDELT data set to demonstrate its capabilities.
Presentation in Norwegian on Internet of Things and Privacy.
Presentation is mostly images and bullet points, not intended as a standalone presentation.
El Día de Andalucía se celebra el 28 de febrero para conmemorar el referéndum de 1980 que otorgó la autonomía a Andalucía. Además de celebrar su cultura única, el día también sirve para reflexionar sobre los desafíos continuos de la región, especialmente la alta tasa de desempleo. La bandera de Andalucía consta de tres franjas horizontales verdes y blancas y representa la pureza, la esperanza y el paisaje de la región. El himno fue escrito por Blas Infante y
Labo XX Antwerp - Densification strategies for the 20th century belt (BUUR)Kevin Penalva-Halpin
Study of the densification of the 20th century belt
http://buur.be/project-item/labo-xx-antwerpen/
https://www.antwerpen.be/nl/info/577bc9d7bb42c47b4b247ada/labo-xx
Following a competition organised by the City of Antwerp, BUUR in association with ‘Futureproofed’, was selected with three other teams for the realisation of a prestigious research project entitled ‘Labo XX’. The mission included the development of a strategy for urban renewal and densification of the twentieth century belt around the city of Antwerp. The strategy aimed to create housing for another 100,000 inhabitants by 2030.
The belt around the city centre is as an amalgam of; monotonous neighbourhoods lacking a strong identity, fragments of industry, transformed historic towns, beautifully landscaped parks, undefined residual spaces, remnants of agricultural landscapes and so on. It was thus clear that all the elements were in place in order to create a quality urban environment, including: housing, parks and open spaces, economy and employment and local urban centres. We found a remarkable number of attractions at both the urban and regional scale.
Through creating links, BUUR studied the possibilities of progressively integrating existing functions to transform the belt into a pleasant and attractive area that is complementary to Antwerp’s city centre. In order to create distinguishable areas, it was necessary to define additional functions. The existing radial tramlines could be integrated by a north-south tangental line to form a ‘network’ at the local a urban level.
Through the study, BUUR analysed the integration of an urban system that is tangental to the existing radial network while looking at densification and renovation opportunities.
LOCATION: Antwerp
PERIOD: 2013 > 2014
CLIENT: City of Antwerp
TEAM: BUUR with Futureproofed
Ilmu kepolisian ditinjau dari filsafat ilmu meliputi tiga aspek: (1) obyek materialnya adalah manusia, kepolisian sebagai fungsi dan organisasi, serta masyarakat; (2) obyek formalnya meliputi ilmu alam, sosial, dan humaniora; (3) epistemologi ilmu kepolisian terkait dengan pengetahuan yang diperoleh melalui pengalaman dan akal.
The document summarizes announcements from AWS re:Invent 2016, including:
- New generally available services such as AWS OpsWorks for Chef Automate, EC2 Systems Manager, CodeBuild, X-Ray, Personal Health Dashboard, Shield, Pinpoint, Glue, Batch, and Step Functions.
- New features for Lambda including C# support, Lambda@Edge, and Step Functions integration.
- Previews for services like X-Ray, Shield Advanced, and Batch.
- Updates to services including CloudFormation, ECS, and improvements to the Well-Architected Framework.
Running Open Source Platforms on AWS (November 2016)Julien SIMON
This document discusses running open source platforms on AWS. It provides an overview of AWS infrastructure including regions, availability zones, and data centers. It then covers virtual machines and operating systems available on AWS, including Amazon EC2 instances, Amazon Linux, and other Linux AMIs. It also discusses language SDKs, Docker, and common Docker orchestrators like Docker Swarm and Kubernetes. The document concludes by covering additional AWS services for development infrastructure, databases, data processing, and other open source technologies.
This document discusses building a serverless data pipeline using AWS Lambda and other AWS managed services. It provides a 12 step process to create a serverless architecture that collects event data via API calls, stores it in DynamoDB, processes it with Lambda, sends it to Kinesis and Kinesis Firehose, and archives it in S3. This allows building scalable and cost-effective data pipelines and applications without having to manage any servers.
Deployment and Management on AWS: A Deep Dive on Options and ToolsDanilo Poccia
This document provides an overview and comparison of different options for deploying and managing applications on AWS: AWS Elastic Beanstalk, AWS OpsWorks, AWS CloudFormation, and raw Amazon EC2. It discusses the tradeoffs between convenience, control, and complexity for each option. It also includes code samples and descriptions of features for each service.
A 60-minute tour of AWS Compute (November 2016)Julien SIMON
This document summarizes a 60-minute tour of AWS compute services, including Amazon EC2, Elastic Beanstalk, EC2 Container Service, and AWS Lambda. It provides an overview of each service, including its core capabilities and use cases. Examples and demos are shown for Elastic Beanstalk, EC2 Container Service, and AWS Lambda. Additional resources are referenced for going deeper with ECS and Lambda.
Running Docker clusters on AWS (November 2016)Julien SIMON
This document discusses running Docker clusters on AWS. It describes Amazon ECS for running Docker containers on AWS and managing clusters of containers. It provides several case studies of companies using Amazon ECS, such as Coursera, Remind, and Segment. It then covers different architectures for running applications on ECS, including using Elastic Load Balancers, Weave, and Consul for service discovery. It concludes with additional resources and links for learning more about Amazon ECS.
An Overview of AWS IoT (November 2016)Julien SIMON
This document discusses IoT projects running on Amazon Web Services (AWS). It provides an overview of the AWS IoT platform, which allows connection of IoT devices, collection of data using MQTT protocol, and storage/analysis of data in AWS services. It also demonstrates connecting an Arduino device to AWS IoT and subscribing/publishing data to topics.
This document discusses AWS CloudFormation, which allows users to automate the deployment of AWS resources through templates. It describes how CloudFormation templates define resources using JSON, how templates can include parameters, mappings, and conditions. Common uses of CloudFormation include replicating environments, deploying to different regions, and disaster recovery. The presentation includes a demo of creating a VPC and LAMP stack using CloudFormation.
Devops with Amazon Web Services (January 2017)Julien SIMON
This document discusses Amazon Web Services tools for DevOps practices like microservices architecture, continuous delivery, and deployment pipelines. It introduces AWS services for source control (CodeCommit), building (CodeBuild), deployment (CodeDeploy), and release management (CodePipeline). These services help teams implement best practices like automated testing, releases to multiple environments without downtime, and rollbacks. The document provides an example pipeline of using CodeCommit, CodeBuild, CodeDeploy and CodePipeline together to deploy code from a GitHub repository to development and production environments. It also briefly introduces the X-Ray service for distributed application debugging.
The document discusses AWS services for DevOps workflows including infrastructure as code (AWS CloudFormation), container management (Amazon ECS and ECR), continuous integration and delivery (AWS CodeCommit, CodeBuild, CodeDeploy, CodePipeline). It provides an overview of each service and examples of how they can be used together in a continuous deployment pipeline to develop, build, test and deploy applications on AWS.
Bonnes pratiques pour la gestion des opérations de sécurité AWSJulien SIMON
Modèle de sécurité partagée
Protection des données
Gestion des utilisateurs et des autorisations
Journalisation des données
Automatisation des vérifications
This document provides an introduction and overview of Amazon's AI services including Amazon Polly, Amazon Lex, and Amazon Rekognition. Amazon Polly is a text-to-speech service that converts text into natural-sounding speech for 47 voices across 24 languages. Amazon Lex builds conversational interfaces using natural language understanding. Amazon Rekognition provides deep learning capabilities for image analysis, including object detection, facial analysis, face comparison and face recognition.
Big Data answers in seconds with Amazon AthenaJulien SIMON
This document discusses Amazon Athena, a new serverless query service that allows users to run SQL queries directly on data stored in Amazon S3 without having to load the data into databases or manage servers. With Athena, users can analyze exabyte-scale data using standard SQL and get results within seconds without having to learn complex big data technologies. The document provides an overview of how Athena works, the types of data formats it supports, how to query and analyze data with it, and examples using the GDELT data set to demonstrate its capabilities.
Presentation in Norwegian on Internet of Things and Privacy.
Presentation is mostly images and bullet points, not intended as a standalone presentation.
El Día de Andalucía se celebra el 28 de febrero para conmemorar el referéndum de 1980 que otorgó la autonomía a Andalucía. Además de celebrar su cultura única, el día también sirve para reflexionar sobre los desafíos continuos de la región, especialmente la alta tasa de desempleo. La bandera de Andalucía consta de tres franjas horizontales verdes y blancas y representa la pureza, la esperanza y el paisaje de la región. El himno fue escrito por Blas Infante y
Labo XX Antwerp - Densification strategies for the 20th century belt (BUUR)Kevin Penalva-Halpin
Study of the densification of the 20th century belt
http://buur.be/project-item/labo-xx-antwerpen/
https://www.antwerpen.be/nl/info/577bc9d7bb42c47b4b247ada/labo-xx
Following a competition organised by the City of Antwerp, BUUR in association with ‘Futureproofed’, was selected with three other teams for the realisation of a prestigious research project entitled ‘Labo XX’. The mission included the development of a strategy for urban renewal and densification of the twentieth century belt around the city of Antwerp. The strategy aimed to create housing for another 100,000 inhabitants by 2030.
The belt around the city centre is as an amalgam of; monotonous neighbourhoods lacking a strong identity, fragments of industry, transformed historic towns, beautifully landscaped parks, undefined residual spaces, remnants of agricultural landscapes and so on. It was thus clear that all the elements were in place in order to create a quality urban environment, including: housing, parks and open spaces, economy and employment and local urban centres. We found a remarkable number of attractions at both the urban and regional scale.
Through creating links, BUUR studied the possibilities of progressively integrating existing functions to transform the belt into a pleasant and attractive area that is complementary to Antwerp’s city centre. In order to create distinguishable areas, it was necessary to define additional functions. The existing radial tramlines could be integrated by a north-south tangental line to form a ‘network’ at the local a urban level.
Through the study, BUUR analysed the integration of an urban system that is tangental to the existing radial network while looking at densification and renovation opportunities.
LOCATION: Antwerp
PERIOD: 2013 > 2014
CLIENT: City of Antwerp
TEAM: BUUR with Futureproofed
Ilmu kepolisian ditinjau dari filsafat ilmu meliputi tiga aspek: (1) obyek materialnya adalah manusia, kepolisian sebagai fungsi dan organisasi, serta masyarakat; (2) obyek formalnya meliputi ilmu alam, sosial, dan humaniora; (3) epistemologi ilmu kepolisian terkait dengan pengetahuan yang diperoleh melalui pengalaman dan akal.
The document summarizes announcements from AWS re:Invent 2016, including:
- New generally available services such as AWS OpsWorks for Chef Automate, EC2 Systems Manager, CodeBuild, X-Ray, Personal Health Dashboard, Shield, Pinpoint, Glue, Batch, and Step Functions.
- New features for Lambda including C# support, Lambda@Edge, and Step Functions integration.
- Previews for services like X-Ray, Shield Advanced, and Batch.
- Updates to services including CloudFormation, ECS, and improvements to the Well-Architected Framework.
The document discusses connecting devices to the Internet of Things (IoT) using AWS IoT. It describes how AWS IoT provides services for connecting devices, securely transmitting and storing device data, and building applications that integrate with connected devices and AWS services. These services include device SDKs, rules engines, device shadowing, authentication/authorization, and a device registry.
Património Cultural Português - Panteões de Portugal e Edifícios da Soberania...Artur Filipe dos Santos
Durante os vários séculos que leva já a história de Portugal vários têm sido os edifícios que simbolizaram o ideal de soberania nacional, como são exemplos maiores a Assembleia da República, o Palácio de Belém (já estudado nesta cadeira), o Palácio das Necessidades ou ainda os edifícios dos Ministérios no Terreiro do Paço.
Stranger Danger: Securing Third Party Components (Tech2020)Guy Podjarny
Building software today involves more assembly than actual coding. Much of our code is in fact pulled in open source packages, and the applications heavily rely on surrounding third party binaries. These third parties make us more productive - but they also introduce an enormous risk. Each third party component is a potential source of vulnerabilities or malicious code, each third party service a potential door into our system.
This talk contains more information about this risk, create a framework for digesting and tackling it, and lists a myriad of tools that can help.
Python in the Serverless Era (PyCon IL 2016)Benny Bauer
This document discusses serverless architecture and the Python ecosystem for serverless applications. It introduces serverless computing and its benefits like automatic scaling and pay per use billing. Popular serverless platforms like AWS Lambda are examined along with their limitations. Frameworks for Python serverless development are presented, including the Serverless Framework for deploying AWS Lambda functions and Zappa for deploying WSGI applications on Lambda. The talk concludes that serverless architecture is the next evolution of cloud computing and an opportunity for Python developers.
- Lambdaless refers to a serverless architecture that does not use AWS Lambda functions. It utilizes AWS API Gateway to directly call other AWS services.
- Some examples of how Lambdaless can be used include building a URL shortener service using S3 redirects and access logs or building a basic CRUD API that stores data in DynamoDB.
- Lambdaless is best suited for simple tasks that involve calling a single AWS service API, while more complex business logic requiring data joins or computation should use Lambda functions.
A 60-mn tour of AWS compute (March 2016)Julien SIMON
This document summarizes a 60-minute talk on AWS compute technologies including EC2, ECS, Lambda, and Elastic Beanstalk. The talk provides an introduction to each service, demos of launching EC2 instances, deploying apps with Elastic Beanstalk and ECS, and implementing APIs with Lambda. It also lists upcoming user group events and a new book on AWS Lambda.
AWS Community Day Bangkok 2019 - Building & Deploying AWS Lambda with Serverl...AWS User Group - Thailand
This document discusses deploying AWS Lambda functions using the Serverless Application Model (SAM). SAM allows defining serverless applications in a template file that specifies functions, events that trigger them, and permissions. It also covers packaging and deploying Lambda functions with SAM, managing credentials, continuous delivery options like CodePipeline, and safe deployment techniques like canary deployments.
The document summarizes James Beswick's presentation on AWS re:Invent 2020 recaps for the ServerlessToronto meetup group. It highlights several new features from re:Invent including Lambda extensions and container image support, larger Lambda functions with more memory and CPUs, and other service releases. It also lists some on-demand sessions from re:Invent on serverless topics. Beswick thanks the attendees and invites them to join the ServerlessToronto community.
The “Twelve-Factor” application model has come to represent twelve best practices for building modern, cloud-native applications. With guidance on things like configuration, deployment, runtime, and multiple service communication, the Twelve-Factor model prescribes best practices that apply to everything from web applications to APIs to data processing applications.
Although serverless computing and AWS Lambda have changed how application development is done, the “Twelve-Factor” best practices remain relevant and applicable in a serverless world. In this talk, Chris will share with you how to apply the “Twelve-Factor” model to serverless application development with AWS Lambda and Amazon API Gateway and show you how these services enable you to build scalable, low cost, and low administration applications.
Node.js Development with Apache NetBeansRyan Cuprak
This session covers the basics of developing Node.js applications with NetBeans. NetBeans includes fully integrated support for both JavaScript and Node.js. You’ll get a tour of the features and learn how NetBeans can accelerate your projects. The presentation looks at basic code editing capabilities provided by the IDE, tool integration (npm/Grunt/Bower/Webpack), frameworks such as Express, and debugging capabilities. You’ll see why NetBeans is the best free JavaScript/Node.js IDE.
Julien Simon - Deep Dive: Compiling Deep Learning ModelsJulien SIMON
We discuss deep learning compilation, from the early days of TensorFlow to PyTorch 2. Along the way, you'll learn about key technologies such as XLA, PyTorch/XLA, OpenXLA, TorchScript, HLO, TorchDynamo, TorchInductor, and more. You'll see where they fit and how they help accelerate models on a wide range of devices, including custom chips like Google TPU and AWS Inferentia 2. Of course, we'll also share some simple examples, including how to easily accelerate Hugging Face models with PyTorch 2 and torch.compile().
Julien Simon - Deep Dive - Model MergingJulien SIMON
Companion slides for https://youtu.be/cvOpX75Kz4M + https://youtu.be/qbAvOgGmFuE
Model Merging
Model Soups
SLERP
Task Arithmetic
TIES
DARE
Franken-merging
Model Breadcrumbs
Model Stock
DELLA
An introduction to computer vision with Hugging FaceJulien SIMON
In this code-level talk, Julien will show you how to quickly build and deploy computer vision applications based on Transformer models. Along the way, you'll learn about the portfolio of open source and commercial Hugging Face solutions, and how they can help you deliver high-quality solutions faster than ever before.
Reinventing Deep Learning with Hugging Face TransformersJulien SIMON
The document discusses how transformers have become a general-purpose architecture for machine learning, with various transformer models like BERT and GPT-3 seeing widespread adoption. It introduces Hugging Face as a company working to make transformers more accessible through tools and libraries. Hugging Face has seen rapid growth, with its hub hosting over 73,000 models and 10,000 datasets that are downloaded over 1 million times daily. The document outlines Hugging Face's vision of facilitating the entire machine learning process from data to production through tools that support tasks like transfer learning, hardware acceleration, and collaborative model development.
Building NLP applications with TransformersJulien SIMON
The document discusses how transformer models and transfer learning (Deep Learning 2.0) have improved natural language processing by allowing researchers to easily apply pre-trained models to new tasks with limited data. It presents examples of how HuggingFace has used transformer models for tasks like translation and part-of-speech tagging. The document also discusses tools from HuggingFace that make it easier to train models on hardware accelerators and deploy them to production.
Building Machine Learning Models Automatically (June 2020)Julien SIMON
This document discusses automating machine learning model building. It introduces AutoML and describes scenarios where it can help build models without expertise, empower more people, and experiment at scale. It discusses the importance of transparency and control. The agenda covers using Amazon SageMaker Studio for zero-code AutoML, Amazon SageMaker Autopilot and SDK for AutoML, and open source AutoGluon. SageMaker Autopilot automates all model building steps and provides a transparent notebook. AutoGluon is an open source AutoML toolkit that can automate tasks for tabular, text, and image data in just a few lines of code.
Starting your AI/ML project right (May 2020)Julien SIMON
In this talk, we’ll see how you can put your AI/ML project on the right track from the get-go. Applying common sense and proven best practices, we’ll discuss skills, tools, methods, and more. We’ll also look at several real-life projects built by AWS customers in different industries and startups.
Scale Machine Learning from zero to millions of users (April 2020)Julien SIMON
This document discusses scaling machine learning models from initial development to production deployment for millions of users. It outlines several options for scaling models from a single instance to large distributed systems, including using Amazon EC2 instances with automation, Docker clusters on ECS/EKS, or the fully managed SageMaker service. SageMaker is recommended for ease of scaling training and inference with minimal infrastructure management required.
An Introduction to Generative Adversarial Networks (April 2020)Julien SIMON
Generative adversarial networks (GANs) use two neural networks, a generator and discriminator, that compete against each other. The generator creates synthetic samples and the discriminator evaluates them as real or fake. This training process allows the generator to produce highly realistic samples. GANs have been used to generate new images like faces, as well as music, dance motions, and design concepts. Resources for learning more about GANs include online courses, books, and example notebooks.
AIM410R1 Deep learning applications with TensorFlow, featuring Fannie Mae (De...Julien SIMON
Fannie Mae leverages Amazon SageMaker for machine learning applications to more accurately value properties and reduce mortgage risk. Amazon SageMaker provides a fully managed service that enables Fannie Mae to focus on modeling while ensuring data security, self-service access, and end-to-end governance through techniques like private subnets, encryption, IAM policies, and operating zones. The presentation demonstrates how to get started with TensorFlow on Amazon SageMaker.
This is the keynote of the Into the Box conference, highlighting the release of the BoxLang JVM language, its key enhancements, and its vision for the future.
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs
At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
Procurement Insights Cost To Value Guide.pptxJon Hansen
Procurement Insights integrated Historic Procurement Industry Archives, serves as a powerful complement — not a competitor — to other procurement industry firms. It fills critical gaps in depth, agility, and contextual insight that most traditional analyst and association models overlook.
Learn more about this value- driven proprietary service offering here.
Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada
Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB
Want to learn practical tips for designing systems that can scale efficiently without compromising speed?
Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development.
As you explore key principles of designing low-latency systems with Rust, you will learn how to:
- Create and compile a real-world app with Rust
- Connect the application to ScyllaDB (NoSQL data store)
- Negotiate tradeoffs related to data modeling and querying
- Manage and monitor the database for consistently low latencies
TrsLabs - Fintech Product & Business ConsultingTrs Labs
Hybrid Growth Mandate Model with TrsLabs
Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant.
An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices.
Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company
Talk to us & Unlock the competitive advantage
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan
This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
How Can I use the AI Hype in my Business Context?Daniel Lehner
𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨?
Everyone’s talking about AI but is anyone really using it to create real value?
Most companies want to leverage AI. Few know 𝗵𝗼𝘄.
✅ What exactly should you ask to find real AI opportunities?
✅ Which AI techniques actually fit your business?
✅ Is your data even ready for AI?
If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock
Building 10x Organizations with Modern Productivity Metrics
10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’
Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them.
But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?
Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark?
At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍
Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀
Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity
This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots.
📕 Here's what you can expect:
- Modeling: Build end-to-end processes using BPMN.
- Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes.
- Operating: Control process instances with rewind, replay, pause, and stop functions.
- Monitoring: Use dashboards and embedded analytics for real-time insights into process instances.
This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes.
👨🏫 Speaker:
Andrei Vintila, Principal Product Manager @UiPath
This session streamed live on April 29, 2025, 16:00 CET.
Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix
Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025
https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/
Is AI just another technology, or does it fundamentally change the way we live and think?
Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater.
At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts.
At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/
HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar.
Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten.
In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich
- Zugriff auf die Konsole
- Auffinden und Interpretieren von Protokolldateien
- Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS)
- Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien
- Nutzung der Client Clocking-Funktion
3. AWS Lambda
• Announced at re:Invent 2014
• Deploy pure functions in Java, Python, Node.js and C#
• Just code, without the infrastructure drama
• Built-in scalability and high availability
• Integrated with many AWS services
• Pay as you go
• Combination of execution time (100ms slots) & memory used
• Starts at $0.000000208 per 100ms
• Free tier available: first 1 million requests per month are free
http://aws.amazon.com/lambda
AWS re:Invent 2014 | (MBL202) NEW LAUNCH: Getting Started with AWS Lambda https://www.youtube.com/watch?v=UFj27laTWQA
4. What can you do with AWS Lambda?
• Grow ‘connective tissue’ in your AWS infrastructure
– Example: http://www.slideshare.net/JulienSIMON5/building-a-serverless-pipeline
• Build event-driven applications
• Build APIs together with Amazon API Gateway
• RESTful APIs
• Resources, methods
• Stages
http://aws.amazon.com/apigateway
6. Typical development workflow
1. Write and deploy a Lambda function
2. Create and deploy a REST API with API Gateway
3. Connect the API to the Lambda function
4. Invoke the API
5. Test, debug and repeat ;)
7. "
Simplifying Development "
"Code samples available at https://github.com/juliensimon/aws/tree/master/lambda_frameworks "
"
8. The Serverless framework "
formerly known as JAWS: Just AWS Without Servers
• Announced at re:Invent 2015 by Austen Collins and Ryan Pendergast
• Supports Node.js, as well as Python and Java (with restrictions)
• Auto-deploys and runs Lambda functions, locally or remotely
• Auto-deploys your Lambda event sources: API Gateway, S3, DynamoDB, etc.
• Creates all required infrastructure with CloudFormation
• Simple configuration in YML
http://github.com/serverless/serverless
https://serverless.com
AWS re:Invent 2015 | (DVO209) https://www.youtube.com/watch?v=D_U6luQ6I90 & https://vimeo.com/141132756
9. Serverless: “Hello World” API
$ serverless create
Edit handler.js, serverless.yml and event.json
$ serverless deploy [--stage stage_name]
$ serverless invoke [--local] --function function_name
$ serverless info
$ http $URL
10. Gordon
• Released in Oct’15 by Jorge Batista
• Supports Python, Javascript, Golang, Java, Scala, Kotlin (including in the same project)
• Auto-deploys and runs Lambda functions, locally or remotely
• Auto-deploys your Lambda event sources: API Gateway, CloudWatch Events, DynamoDB
Streams, Kinesis Streams, S3
• Creates all required infrastructure with CloudFormation
• Simple configuration in YML
https://github.com/jorgebastida/gordon
https://news.ycombinator.com/item?id=11821295
11. Gordon: “Hello World” API
$ gordon startproject helloworld
$ gordon startapp helloapp
Write hellofunc() function
$ gordon build
$ echo '{"name":"Julien"}' | gordon run helloapp.hellofunc
$ gordon apply [--stage stage_name]
$ http post $URL name=Julien
12. AWS Chalice "
Think of it as a serverless framework for Flask apps"
• Released in Jul’16, still in beta
• Just add your Python code
– Deploy with a single call and zero config
– The API is created automatically, the IAM policy is auto-generated
• Run APIs locally on port 8000 (similar to Flask)
• Fast & lightweight framework
– 100% boto3 calls (AWS SDK for Python) à fast
– No integration with CloudFormation à no creation of event sources
https://github.com/awslabs/chalice
https://aws.amazon.com/blogs/developer/preview-the-python-serverless-microframework-for-aws/
13. AWS Chalice: “Hello World” API
$ chalice new-project helloworld
Write your function in app.py
$ chalice local
$ chalice deploy
$ export URL=`chalice url`
$ http $URL
$ http put $URL/hello/julien
$ chalice logs [ --include-lambda-messages ]
14. AWS Chalice: PUT/GET in S3 bucket
$ chalice new-project s3test
Write your function in app.py
$ chalice local
$ http put http://localhost:8000/objects/doc.json value1=5 value2=8
$ http get http://localhost:8000/objects/doc.json
$ chalice deploy [stage_name]
$ export URL=`chalice url`
$ http put $URL/objects/doc.json value1=5 value2=8
$ http get $URL/objects/doc.json
15. Summing things up
Serverless
The most popular
serverless framework
Built with and for Node.js.
Python and Java: YMMV
Rich features, many event
sources
Not a web framework
Gordon
Great challenger!
Node.js, Python, Java,
Scala, Golang
Comparable to Serverless
feature-wise
Not a web framework
Chalice
AWS project, in beta
Python only
Does only one thing, but
does it great
Dead simple, zero config
Flask web framework
16. More Lambda frameworks
• Kappa https://github.com/garnaat/kappa
– Released Dec’14 by Mitch Garnaat, author of boto and the AWS CLI (still maintained?)
– Python only, multiple event sources
• Apex https://github.com/apex/apex
– Released in Dec’15 by TJ Holowaychuk
– Python, Javascript, Java, Golang
– Terraform integration to manage infrastructure for event sources
• Zappa https://github.com/Miserlou/Zappa
– Released in Feb’16 by Rich Jones
– Python web applications on AWS Lambda + API Gateway
• Docker-lambda https://github.com/lambci/docker-lambda
– Released in May’16 by Michael Hart
– Run functions in Docker images that “replicate” the live Lambda environment
17. 2 Java tools for AWS Lambda
https://java.awsblog.com/post/TxWZES6J1RSQ2Z/Testing-Lambda-functions-using-the-AWS-Toolkit-for-Eclipse
https://aws.amazon.com/blogs/developer/aws-toolkit-for-eclipse-serverless-application
https://github.com/awslabs/aws-serverless-java-container
Eclipse plug-in
• Code, test and deploy Lambdas from Eclipse
• Run your functions locally and remotely
• Test with local events and Junit4
• Deploy standalone functions, or with the "
AWS Serverless Application Model (Dec’16)
Serverless Java Container
• Run Java RESTful APIs as-is
• Default implementation of the
Java servlet
HttpServletRequest "
HttpServletResponse
• Support for Java frameworks
such as Jersey or Spark
19. AWS Serverless Application Model (SAM)"
• CloudFormation extension released in Nov’16 to bundle
Lambda functions, APIs & events
• 3 new CloudFormation resource types
– AWS::Serverless::Function
– AWS::Serverless::Api
– AWS::Serverless::SimpleTable (DynamoDB)
• 2 new CloudFormation CLI commands
– ‘aws cloudformation package’
– ‘aws cloudformation deploy’
• Integration with CodeBuild and CodePipeline for CI/CD
• Expect SAM to be integrated in most / all frameworks
https://aws.amazon.com/fr/blogs/compute/introducing-simplified-serverless-application-deplyoment-and-management
https://github.com/awslabs/serverless-application-model/
20. AWSTemplateFormatVersion: '2010-09-09'
Transform: AWS::Serverless-2016-10-31
Description: Get items from a DynamoDB table.
Resources:
GetFunction:
Type: AWS::Serverless::Function
Properties:
Handler: index.get
Runtime: nodejs4.3
Policies: AmazonDynamoDBReadOnlyAccess
Environment:
Variables:
TABLE_NAME: !Ref Table
Events:
GetResource:
Type: Api
Properties:
Path: /resource/{resourceId}
Method: get
Table:
Type: AWS::Serverless::SimpleTable
Sample SAM template for:
• Lambda function
• HTTP GET API
• DynamoDB table
22. The AWS edge
North America
South America
EMEA
APAC
POPs
Cities
Countries
Continents
Regional Edge Caches
23. Lambda@Edge
• Lambda@Edge is an extension of AWS Lambda that allows you to run
Node.js code at AWS global edge locations.
• Bring your own code to the edge and customize your content very
close to your users, improving the end-user experience.
• Typical use cases
• Customize content, based on user/device properties
• Validate visitors: check tokens, filter bot traffic
• Rewrite URLs: inject ads, hide file structure
• Run A/B testing
25. Lambda@Edge Service Limits
Items Lambda@Edge Lambda
Timeout 50 ms 300 seconds
Function “Power Level” 128 MB 128 MB – 1.5 GB
Function Deployment
Package Size
1MB 50MB
• Runtime: Node.js 4.3
• Triggered by CloudFront events
• Access: No network connections, AWS region access, disk
access or Amazon VPC
26. Lambda@Edge demo: the Metal A/B test m/
• Static website in S3, distributed to CloudFront
http://d2eb9d90qk3238.cloudfront.net
• The index page references an image file that
doesn’t exist in the S3 bucket
<img src="http://d2eb9d90qk3238.cloudfront.net/album.jpg">
• A Lambda function is triggered on the “Origin
request” event and replaces album.jpg with a
random file
28. New Lambda videos from re:Invent 2016
AWS re:Invent 2016: What’s New with AWS Lambda (SVR202)
https://www.youtube.com/watch?v=CwxWhyGteNc
AWS re:Invent 2016: Serverless Apps with AWS Step Functions (SVR201)
https://www.youtube.com/watch?v=75MRve4nv8s
AWS re:Invent 2016: Real-time Data Processing Using AWS Lambda (SVR301)
https://www.youtube.com/watch?v=VFLKOy4GKXQ
AWS re:Invent 2016: Serverless Architectural Patterns and Best Practices (ARC402)
https://www.youtube.com/watch?v=b7UMoc1iUYw
AWS re:Invent 2016: Bringing AWS Lambda to the Edge (CTD206)
https://www.youtube.com/watch?v=j26novaqF6M
AWS re:Invent 2016: Ubiquitous Computing with Greengrass (IOT201)
https://www.youtube.com/watch?v=XQQjX8GTEko
29. The only Lambda book you need to read
Written by AWS Technical
Evangelist Danilo Poccia
Released in December 2016
https://www.amazon.com/Aws-Lambda-Action-
Event-driven-Applications/dp/1617293717/