PyParis2017 / Function-as-a-service - a pythonic perspective on severless computing, by Josef Spillner
0 likes587 views
This document discusses function-as-a-service (FaaS) computing from a Python perspective. It begins with an overview of FaaS and some existing tools. Then it discusses Limbadi, a tool that can decompose Python functions for FaaS deployment. It also discusses Snafu, a Pythonic serverless computing platform that can execute functions across FaaS ecosystems and provides interactive and daemon modes for development and hosting functions. Hands-on examples are provided for Limbadi and Snafu.
1 of 32
Downloaded 11 times
![3
Your Tutorial Instructor
Josef Spillner <josef.spillner@zhiw.ch>
●
works it Zurich University of Applied Sciences
●
lectures Python progrimming to undergriduites
& misters of idvinced studies
●
performs reseirch in the Service Prototyping Lib
●
co-iuthored «Architecturil Trinsformitions in
Network Services ind Distributed Systems»
●
wrote miny rirely used Python things since 2003
[LS16]](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-3-320.jpg)
![5
What is FaaS?
[mizikglobil.com]
“functions“
contiiners
pickiges
ictuil functions
FaaS
●
running functions in the cloud
(hosted functions)
●
reil “piy per use“ (per invocition,
per loid x time unit, e.g. GHz/100ms)
●
seemingly “serverless“](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-5-320.jpg)
![6
Examples of FaaS
[openwhisk.org]
monitoring event
sensor diti
log entry
git push
...
HTTP
XMPP
AMQP
...
mix 1 per hour
...
Your Python
functions!
JSON
pliin text
...](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-6-320.jpg)
![7
The FaaS Space
AWS Lambda
OpenWhisk
Functions
PyWren
[Limbdi]
Docker-LimbCI
Effe
OpenLimbdi
Lever OS
Fission
Funktion
Kubeless
Picisso
Serverless Frimework
[Limbdi, OW, GCF, AF]
Step Functions
[Limbdi]
X-Riy
[Limbdi]
Zippi
[Limbdi] Apex
[Limbdi]
Snafu
- in Python](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-7-320.jpg)
![11
FaaS Synopsis in Python
def limbdi_hindler(event, context):
‘‘‘
event: dict
context: meti informition object
returns: dict, string, number, ...
‘‘‘
# ...
return “result“
AWS Limbdi:
def hindler(input):
‘‘‘
input: dict
returns: dict
‘‘‘
# ...
return {}
OpenWhisk:
def miin():
‘‘‘
input: vii flisk.request.get_diti()
returns: str
‘‘‘
# ...
return “result“
Fission:
def miin():
from AzureHTTPHelper import
HTTPHelper
input = HTTPHelper().post
# ...
open(os.environ[“res“], “w“).write(
json.dumps({“body“: “...“}))
miin()
Azure Functions:
Further differences:
● function scoping (e.g. with/without export in JiviScript)
● function niming (mingling on client or service side)](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-11-320.jpg)
![20
Lambada
Code Trinsformition
Rewrite rules, vii AST:
return 9 print(“hello“) local_func()
------------------- return 9 ----------------------
return {“ret“: 9} ----------------------------------------- local_func_stub()
return {“ret: 9“, “stdout“: “hello“}
Stubs, vii templites:
def func_stub(x):
input = json.dumps({“x“: x})
output = boto3.client(“lambda“).invoke(FN=“func“, Payload=input)
y = json.loads(output[“Payload“].read().decode(“utf-8“))](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-20-320.jpg)
![22
Lambada
Code Deployment + Activition
Locil mode: source code modified locilly is copy
Remote mode: rewritten source code deployed ind invoked
$ limbidi [--locil] [--debug] [--endpoint <ep>] <file.py>
$ python3 -m limbidi <file.py>
>>> import limbidi
>>> limbidi.move(globils() [, endpoint=“...“])](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-22-320.jpg)
![23
Lambada - Hands-on Time!
[d0wn.com]](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-23-320.jpg)
![27
Snafu
Stindilone mode
●
cill functions interictively
●
bitch mode with/without input pipe
●
performince, robustness & correctness tests
●
development
$ snifu
$ snifu -x <function> [<file/dir>]
$ snifu -l sqlite -e jivi -c limbdi -C messiging](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-27-320.jpg)
![30
Snafu - Hands-on Time!
[pinterest.com]](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-30-320.jpg)
![31
Q&A / Live help session
[dribbble.com]](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-31-320.jpg)
![32
Further Reading and FaaS Fun
Limi, Limbickup:
●
https://arxiv.org/abs/1701.05945
Podilizer:
●
https://arxiv.org/abs/1702.05510
Snifu:
●
https://arxiv.org/abs/1703.07562
Limbidi
●
https://arxiv.org/abs/1705.08169
On irXiv Anilytics: On GitHub:
[github.com/
serviceprototypinglab]](https://image.slidesharecdn.com/pyparis2017function-as-a-service-apythonicperspectiveonseverlesscomputingjosefspillner-170727131133/85/PyParis2017-Function-as-a-service-a-pythonic-perspective-on-severless-computing-by-Josef-Spillner-32-320.jpg)
Ad
Recommended
Joblib for cloud computing
Joblib for cloud computingAlexandre Abadie This document discusses Joblib, a Python package for parallel computing and caching. It provides an overview of Joblib's capabilities including: making parallel computing easy using an embarrassingly parallel helper; efficient caching of computations on disk to avoid recomputation; persistence of arbitrary objects; and support for multiple parallel and caching backends including threading, multiprocessing, distributed, and Hadoop. The document also discusses using Joblib for cloud computing by configuring parallel backends to run on multiple machines and extending caching to cloud storage backends like S3 and HDFS. Future work includes in-memory caching, overriding parallel backends, replacing multiprocessing, and expanding cloud provider support.
All you need to know about the JavaScript event loop
All you need to know about the JavaScript event loopSaša Tatar The document discusses the JavaScript event loop and call stack. It explains that JavaScript is single-threaded with an event loop that processes tasks in the order they are received. There is a call stack that processes code synchronously, and an event queue that holds asynchronous callbacks from events like timers, promises, etc. The event loop continually checks the call stack and event queue, running tasks from the queue after the stack is empty. This allows asynchronous code to run without blocking synchronous code.
Blazing Fast Windows 8 Apps using Visual C++
Blazing Fast Windows 8 Apps using Visual C++Microsoft Developer Network (MSDN) - Belgium and Luxembourg The document discusses using C++ Accelerated Massive Parallelism (AMP) to improve performance by offloading work to the GPU. It shows how to wrap array data in an array_view to make it accessible to the GPU, then use parallel_for_each to execute a lambda function that increments each element in parallel on the GPU. By leveraging the massive parallelism of the GPU, this operation can see significant performance gains over executing it solely on the CPU.
Machine learning with py torch
Machine learning with py torchRiza Fahmi The document provides a comprehensive introduction to PyTorch, a Python machine learning library focused on research and dynamic computation, showcasing its features, installation, handling datasets, and building neural networks. It covers basic concepts such as tensors, autograd for automatic differentiation, and hands-on examples like creating a feedforward neural network to classify the iris dataset. Additionally, it discusses loss functions and optimization techniques for training models in PyTorch.
Ruby meets Go
Ruby meets GoNTT Communications Technology Development The document discusses a presentation by Masaki Matsushita on integrating Go with Ruby, specifically focusing on the Go 1.5 feature 'buildmode c-shared' for creating shared libraries. It covers the use of cgo to call Go functions from Ruby using libraries like FFI and Fiddle, along with practical examples and techniques to avoid unnecessary string copies and manage memory. The presentation also includes guidance on writing Ruby extension libraries using Go and how to create a Ruby gem that includes Go code.
あなたのScalaを爆速にする７つの方法
あなたのScalaを爆速にする７つの方法x1 ichi Vector and ListBuffer have similar performance for random reads. Benchmarking showed no significant difference in throughput, average time, or sample times between reading randomly from a Vector versus a ListBuffer. Vectors are generally faster than Lists for random access due to Vectors being implemented as arrays under the hood.
RubyKaigi2015 making robots-with-mruby
RubyKaigi2015 making robots-with-mrubyyamanekko This document summarizes Yurie Yamane's presentation on using mruby to make robots. It discusses using mruby and TOPPERS on the LEGO EV3 to create an inverted pendulum self-balancing robot. It then covers creating a DIY self-balancing robot using a Raspberry Pi, gyro sensor, DC motors, and a motor driver. Code examples are provided for reading sensor values, controlling motors with PWM, and implementing a balancing algorithm using a balancer class. Source code links are included for further reference.
node.js and native code extensions by example
node.js and native code extensions by examplePhilipp Fehre The document discusses integrating C/C++ with Node.js for performance enhancements, specifically using the Couchbase database and the Couchnode library. It highlights the evolution of Node.js extensions with the NAN library and showcases practical examples, such as wrapping a C library for hashing. Additionally, it invites readers to participate in a bug bash for Couchbase Server 3.0 beta, offering prizes for reporting issues.
Internship final report@Treasure Data Inc.
Internship final report@Treasure Data Inc.Ryuichi ITO Ryuchi Ito completed an internship at Treasure Data Inc. where he worked on the open source machine learning library Hivemall. He conducted benchmarks of Hivemall's performance on logistic regression and random forest algorithms. He also added new features to Hivemall including a system testing framework, feature binning, feature selection, and Spark integrations. The benchmarks showed that Hivemall was relatively slow for logistic regression compared to other tools but had good scalability. For random forests, Hivemall performed well on small to medium datasets but struggled on very large datasets.
Functional Reactive Programming with RxJS
Functional Reactive Programming with RxJSstefanmayer13 The document discusses functional reactive programming (FRP) in JavaScript, detailing its concepts, advantages, and practical applications. It covers functional programming principles, reactive programming fundamentals, and how to create and utilize observables in different scenarios like autocomplete and drag-and-drop. Additionally, it mentions popular libraries like RxJS and educational resources for learning FRP.
JavaScript Engines and Event Loop
JavaScript Engines and Event Loop Tapan B.K. This document discusses JavaScript engines and event loops. It explains key concepts like the call stack, event queue, microtasks vs macrotasks, and how JavaScript creates the illusion of being asynchronous through the event loop. The event loop constantly checks the call stack and queue, executing functions to give the appearance of multithreading on a single thread. Web APIs also provide asynchronous capabilities that interact with the event loop.
Javascript Everywhere
Javascript EverywherePascal Rettig This document covers various aspects of JavaScript, including debugging, optimizing, local and offline storage, and server-side JavaScript with web sockets. It presents tools, frameworks, and best practices for debugging (like Firebug), automated testing (e.g., QUnit, Jasmine), performance optimization techniques, and the use of local storage and session storage. It also discusses server-side JavaScript with Node.js and how to implement real-time messaging using web sockets.
Letswift19-clean-architecture
Letswift19-clean-architectureJung Kim Here are the key points about GRASP patterns:
1. GRASP stands for General Responsibility Assignment Software Patterns. It is a set of 9 patterns used to assign responsibilities to classes in object-oriented design.
2. Properly assigning responsibilities and distributing them among classes is a core part of object-oriented design. Developers and designers should be familiar with these patterns.
3. The 9 GRASP patterns are: Information Expert, Creator, Controller, Low Coupling, High Cohesion, Indirection, Polymorphism, Pure Fabrication, and Protected Variations. Each pattern provides guidance on distributing responsibilities in a certain context.
4. When designing a system, analyzing which classes should have which responsibilities based
Swift after one week of coding
Swift after one week of codingSwiftWro The document discusses Karol Kubicki's experience learning Swift after being asked to give a talk on it. It provides examples of code snippets comparing implementations of common patterns like singletons, error handling, laziness, structs, and curried functions between Swift and Objective-C. Key differences highlighted include Swift being more thread-safe, having cleaner syntax, and providing language support for features like laziness while Objective-C requires more boilerplate code. Real-world use cases are presented to illustrate concepts like currying functions.
Event loop
Event loopcodepitbull The document discusses concepts related to event loops and concurrency in programming. It includes code snippets in Java showing the use of NIO selectors and channels for non-blocking I/O. Diagrams are shown illustrating reactor patterns and Vert.x modules deployed across multiple CPUs. The summary provides an overview of the main topics and techniques discussed in the technical document.
History of asynchronous in .NET
History of asynchronous in .NETMarcin Tyborowski The history of asynchronous programming in .NET began with threads and the thread pool to handle concurrency. Later, patterns like the Asynchronous Programming Model (APM) and Event-based Asynchronous Pattern (EAP) simplified asynchronous code but it remained complex. The Task Parallel Library (TPL) and async/await further abstracted asynchronous operations so code more closely resembled synchronous code. Now, asynchronous code no longer requires Wait() or GetAwaiter().GetResult() and avoids potential deadlocks.
R and C++
R and C++Romain Francois - Rcpp is a package that facilitates interoperability between R and C++ by providing data structures and functions that make it easy to write C++ code that integrates with R. It has been released 54 times since 2008 with over 170 CRAN packages depending on it.
- Rcpp allows users to source C++ code from R using sourceCpp() and export C++ functions to R using attributes like // [[Rcpp::export]]. This improves performance over pure R code by leveraging fast C++ implementations.
- dplyr is a popular R package for data manipulation that achieves great performance through its use of Rcpp. Functions like arrange(), filter(), and summarise() are much faster when
Extending Node.js using C++
Extending Node.js using C++Kenneth Geisshirt The document discusses extending Node.js using C++. It covers wrapping C++ classes for use in JavaScript, including setters, getters, exceptions, and instantiating objects. Examples are provided for wrapping Book and Person classes to be accessible from JavaScript. Building the extension using waf or gyp build systems is also covered. The presenter's background and the agenda are outlined initially.
RxSwift to Combine
RxSwift to CombineBo-Young Park The document discusses the Combine framework in Swift, which provides a declarative API for handling asynchronous events by using publishers and subscribers. It contrasts Combine with RxSwift, highlighting the differences in their implementation of publishers and observables, and outlines specific Combine operators that are unique compared to RxSwift. Example code snippets illustrate the usage of Combine in fetching and processing data asynchronously.
Python to scala
Python to scalakao kuo-tung The document provides an overview of key differences between Python and Scala. Some key points summarized:
1. Python is a dynamically typed, interpreted language while Scala is statically typed and compiles to bytecode. Scala supports both object-oriented and functional programming paradigms.
2. Scala has features like case classes, traits, and pattern matching that Python lacks. Scala also has features like type parameters, implicit conversions, and tail call optimization that Python does not support natively.
3. Common data structures like lists and maps are implemented differently between the languages - Scala uses immutable Lists while Python uses mutable lists. Scala also has features like lazy vals.
4. Control
Simple ETL in python 3.5+ with Bonobo - PyParis 2017
Simple ETL in python 3.5+ with Bonobo - PyParis 2017Romain Dorgueil The document discusses Bonobo, a simple ETL framework for Python 3.5 and above, designed for data integration using code as configuration. It emphasizes Bonobo's ability to create, manage, and execute ETL jobs easily, incorporating libraries like joblib and pandas, while noting its distinct features compared to existing tools. The text also outlines the history, current status, and future plans for the Bonobo framework, including open-source goals and enhancements for developer experience.
RxSwift to Combine
RxSwift to CombineBo-Young Park The document discusses the integration of Combine and RxSwift for handling asynchronous events in Swift applications, highlighting the benefits of using Combine for its declarative API. It compares various elements such as publishers, subscribers, and operators between Combine and RxSwift. Additionally, it provides coding examples for fetching and processing data with both frameworks.
Theads services
Theads servicesTraining Guide This document discusses background processes in Android, including threads, services, and notifications. It explains that threads are used to perform long-running tasks without blocking the main UI thread. Services are intended for long-running background tasks rather than threads, and can be started and stopped from an activity. Notifications allow services to display status information in the status bar and notify the user of events even when the app is not visible.
PlantUML
PlantUMLLeo Liang This document discusses PlantUML, an open source tool that allows users to draw UML diagrams from text-based descriptions. Some key benefits of the text-based approach include faster editing with a keyboard, easier version control and merging with other systems. PlantUML supports common UML diagram types like sequence diagrams, class diagrams, activity diagrams, component diagrams, and state diagrams. It can be used from a web editor or integrated with tools like Eclipse.
Scala Future & Promises
Scala Future & PromisesKnoldus Inc. The document discusses asynchronous programming with futures and promises in Scala. It covers key topics like:
1) Futures provide a way to reason about parallel operations efficiently in a non-blocking way. Futures represent asynchronous computations with results that can be accessed later.
2) Promises allow completing a future with a value or exception. Callbacks allow accessing future results asynchronously once completed.
3) Functional composition with futures uses methods like map, flatMap, recover to transform and compose futures. For-comprehensions provide a cleaner way to compose futures.
Flux and InfluxDB 2.0 by Paul Dix
Flux and InfluxDB 2.0 by Paul DixInfluxData The document provides a comprehensive overview of Flux and InfluxDB 2.0, detailing its functional data scripting language, features like multi-tenancy, and migration paths. It discusses structures such as buckets, tasks, and roles, as well as code examples for data retrieval, filtering, and processing tasks. Notably, it covers various functional elements such as loops, error handling, and packages for building and managing data scripts.
Python Objects
Python ObjectsQuintagroup - Python uses reference counting and a cyclic garbage collector to manage memory and free objects that are no longer referenced. It allocates memory for objects in blocks and assigns them to size classes based on their size.
- Objects in Python have a type and attributes. They are created via type constructors and can have specific attributes like __dict__, __slots__, and descriptors.
- At the Python virtual machine level, code is represented as code objects that contain details like the bytecode, constants, and variable names. Code objects are compiled from Python source files.
Serverless computing and Function-as-a-Service (FaaS)
Serverless computing and Function-as-a-Service (FaaS)Moritz Strube This document discusses serverless computing and Function as a Service (FaaS). It defines FaaS and compares it to PaaS, listing some key differences like FaaS using functions as the unit of computation and being job-oriented without provisioning. It lists several popular FaaS providers like AWS Lambda and provides examples of using FaaS for different use cases like Alexa skills and AWS IoT. It also discusses the serverless.com platform for developing and deploying serverless applications and functions. Finally, it notes some pros and cons of FaaS, like its lean development but potential challenges with debugging.
Five myths about Network Function Virtualization (NFV)
Five myths about Network Function Virtualization (NFV) srichakra komatineni The document discusses key myths surrounding Network Functions Virtualization (NFV), including the potential for new revenue streams, total cost of ownership (TCO) gains, system reliability ('five nines'), and the evolution of operational support systems (OSS) and business support systems (BSS). It emphasizes that while NFV could enable quicker service launches and improved operational efficiencies, significant cultural and process changes are necessary for its success. Ultimately, challenges like manual processes and market uncertainties may hinder the full realization of NFV’s benefits.
Function as a Service: IT forum expo 2017
Function as a Service: IT forum expo 2017Igor Rosa Macedo Igor Rosa Macedo é um entusiasta de tecnologia que atua como consultor de DevOps e ALM, ajudando clientes a melhorar sua cadeia de entrega de valor. Ele também é integrante do time de ALM|DevOps Rangers, voluntários que constroem ferramentas e guias para a comunidade Visual Studio.
More Related Content
What's hot (19)
Internship final report@Treasure Data Inc.
Internship final report@Treasure Data Inc.Ryuichi ITO Ryuchi Ito completed an internship at Treasure Data Inc. where he worked on the open source machine learning library Hivemall. He conducted benchmarks of Hivemall's performance on logistic regression and random forest algorithms. He also added new features to Hivemall including a system testing framework, feature binning, feature selection, and Spark integrations. The benchmarks showed that Hivemall was relatively slow for logistic regression compared to other tools but had good scalability. For random forests, Hivemall performed well on small to medium datasets but struggled on very large datasets.
Functional Reactive Programming with RxJS
Functional Reactive Programming with RxJSstefanmayer13 The document discusses functional reactive programming (FRP) in JavaScript, detailing its concepts, advantages, and practical applications. It covers functional programming principles, reactive programming fundamentals, and how to create and utilize observables in different scenarios like autocomplete and drag-and-drop. Additionally, it mentions popular libraries like RxJS and educational resources for learning FRP.
JavaScript Engines and Event Loop
JavaScript Engines and Event Loop Tapan B.K. This document discusses JavaScript engines and event loops. It explains key concepts like the call stack, event queue, microtasks vs macrotasks, and how JavaScript creates the illusion of being asynchronous through the event loop. The event loop constantly checks the call stack and queue, executing functions to give the appearance of multithreading on a single thread. Web APIs also provide asynchronous capabilities that interact with the event loop.
Javascript Everywhere
Javascript EverywherePascal Rettig This document covers various aspects of JavaScript, including debugging, optimizing, local and offline storage, and server-side JavaScript with web sockets. It presents tools, frameworks, and best practices for debugging (like Firebug), automated testing (e.g., QUnit, Jasmine), performance optimization techniques, and the use of local storage and session storage. It also discusses server-side JavaScript with Node.js and how to implement real-time messaging using web sockets.
Letswift19-clean-architecture
Letswift19-clean-architectureJung Kim Here are the key points about GRASP patterns:
1. GRASP stands for General Responsibility Assignment Software Patterns. It is a set of 9 patterns used to assign responsibilities to classes in object-oriented design.
2. Properly assigning responsibilities and distributing them among classes is a core part of object-oriented design. Developers and designers should be familiar with these patterns.
3. The 9 GRASP patterns are: Information Expert, Creator, Controller, Low Coupling, High Cohesion, Indirection, Polymorphism, Pure Fabrication, and Protected Variations. Each pattern provides guidance on distributing responsibilities in a certain context.
4. When designing a system, analyzing which classes should have which responsibilities based
Swift after one week of coding
Swift after one week of codingSwiftWro The document discusses Karol Kubicki's experience learning Swift after being asked to give a talk on it. It provides examples of code snippets comparing implementations of common patterns like singletons, error handling, laziness, structs, and curried functions between Swift and Objective-C. Key differences highlighted include Swift being more thread-safe, having cleaner syntax, and providing language support for features like laziness while Objective-C requires more boilerplate code. Real-world use cases are presented to illustrate concepts like currying functions.
Event loop
Event loopcodepitbull The document discusses concepts related to event loops and concurrency in programming. It includes code snippets in Java showing the use of NIO selectors and channels for non-blocking I/O. Diagrams are shown illustrating reactor patterns and Vert.x modules deployed across multiple CPUs. The summary provides an overview of the main topics and techniques discussed in the technical document.
History of asynchronous in .NET
History of asynchronous in .NETMarcin Tyborowski The history of asynchronous programming in .NET began with threads and the thread pool to handle concurrency. Later, patterns like the Asynchronous Programming Model (APM) and Event-based Asynchronous Pattern (EAP) simplified asynchronous code but it remained complex. The Task Parallel Library (TPL) and async/await further abstracted asynchronous operations so code more closely resembled synchronous code. Now, asynchronous code no longer requires Wait() or GetAwaiter().GetResult() and avoids potential deadlocks.
R and C++
R and C++Romain Francois - Rcpp is a package that facilitates interoperability between R and C++ by providing data structures and functions that make it easy to write C++ code that integrates with R. It has been released 54 times since 2008 with over 170 CRAN packages depending on it.
- Rcpp allows users to source C++ code from R using sourceCpp() and export C++ functions to R using attributes like // [[Rcpp::export]]. This improves performance over pure R code by leveraging fast C++ implementations.
- dplyr is a popular R package for data manipulation that achieves great performance through its use of Rcpp. Functions like arrange(), filter(), and summarise() are much faster when
Extending Node.js using C++
Extending Node.js using C++Kenneth Geisshirt The document discusses extending Node.js using C++. It covers wrapping C++ classes for use in JavaScript, including setters, getters, exceptions, and instantiating objects. Examples are provided for wrapping Book and Person classes to be accessible from JavaScript. Building the extension using waf or gyp build systems is also covered. The presenter's background and the agenda are outlined initially.
RxSwift to Combine
RxSwift to CombineBo-Young Park The document discusses the Combine framework in Swift, which provides a declarative API for handling asynchronous events by using publishers and subscribers. It contrasts Combine with RxSwift, highlighting the differences in their implementation of publishers and observables, and outlines specific Combine operators that are unique compared to RxSwift. Example code snippets illustrate the usage of Combine in fetching and processing data asynchronously.
Python to scala
Python to scalakao kuo-tung The document provides an overview of key differences between Python and Scala. Some key points summarized:
1. Python is a dynamically typed, interpreted language while Scala is statically typed and compiles to bytecode. Scala supports both object-oriented and functional programming paradigms.
2. Scala has features like case classes, traits, and pattern matching that Python lacks. Scala also has features like type parameters, implicit conversions, and tail call optimization that Python does not support natively.
3. Common data structures like lists and maps are implemented differently between the languages - Scala uses immutable Lists while Python uses mutable lists. Scala also has features like lazy vals.
4. Control
Simple ETL in python 3.5+ with Bonobo - PyParis 2017
Simple ETL in python 3.5+ with Bonobo - PyParis 2017Romain Dorgueil The document discusses Bonobo, a simple ETL framework for Python 3.5 and above, designed for data integration using code as configuration. It emphasizes Bonobo's ability to create, manage, and execute ETL jobs easily, incorporating libraries like joblib and pandas, while noting its distinct features compared to existing tools. The text also outlines the history, current status, and future plans for the Bonobo framework, including open-source goals and enhancements for developer experience.
RxSwift to Combine
RxSwift to CombineBo-Young Park The document discusses the integration of Combine and RxSwift for handling asynchronous events in Swift applications, highlighting the benefits of using Combine for its declarative API. It compares various elements such as publishers, subscribers, and operators between Combine and RxSwift. Additionally, it provides coding examples for fetching and processing data with both frameworks.
Theads services
Theads servicesTraining Guide This document discusses background processes in Android, including threads, services, and notifications. It explains that threads are used to perform long-running tasks without blocking the main UI thread. Services are intended for long-running background tasks rather than threads, and can be started and stopped from an activity. Notifications allow services to display status information in the status bar and notify the user of events even when the app is not visible.
PlantUML
PlantUMLLeo Liang This document discusses PlantUML, an open source tool that allows users to draw UML diagrams from text-based descriptions. Some key benefits of the text-based approach include faster editing with a keyboard, easier version control and merging with other systems. PlantUML supports common UML diagram types like sequence diagrams, class diagrams, activity diagrams, component diagrams, and state diagrams. It can be used from a web editor or integrated with tools like Eclipse.
Scala Future & Promises
Scala Future & PromisesKnoldus Inc. The document discusses asynchronous programming with futures and promises in Scala. It covers key topics like:
1) Futures provide a way to reason about parallel operations efficiently in a non-blocking way. Futures represent asynchronous computations with results that can be accessed later.
2) Promises allow completing a future with a value or exception. Callbacks allow accessing future results asynchronously once completed.
3) Functional composition with futures uses methods like map, flatMap, recover to transform and compose futures. For-comprehensions provide a cleaner way to compose futures.
Flux and InfluxDB 2.0 by Paul Dix
Flux and InfluxDB 2.0 by Paul DixInfluxData The document provides a comprehensive overview of Flux and InfluxDB 2.0, detailing its functional data scripting language, features like multi-tenancy, and migration paths. It discusses structures such as buckets, tasks, and roles, as well as code examples for data retrieval, filtering, and processing tasks. Notably, it covers various functional elements such as loops, error handling, and packages for building and managing data scripts.
Python Objects
Python ObjectsQuintagroup - Python uses reference counting and a cyclic garbage collector to manage memory and free objects that are no longer referenced. It allocates memory for objects in blocks and assigns them to size classes based on their size.
- Objects in Python have a type and attributes. They are created via type constructors and can have specific attributes like __dict__, __slots__, and descriptors.
- At the Python virtual machine level, code is represented as code objects that contain details like the bytecode, constants, and variable names. Code objects are compiled from Python source files.
Viewers also liked (20)
Serverless computing and Function-as-a-Service (FaaS)
Serverless computing and Function-as-a-Service (FaaS)Moritz Strube This document discusses serverless computing and Function as a Service (FaaS). It defines FaaS and compares it to PaaS, listing some key differences like FaaS using functions as the unit of computation and being job-oriented without provisioning. It lists several popular FaaS providers like AWS Lambda and provides examples of using FaaS for different use cases like Alexa skills and AWS IoT. It also discusses the serverless.com platform for developing and deploying serverless applications and functions. Finally, it notes some pros and cons of FaaS, like its lean development but potential challenges with debugging.
Five myths about Network Function Virtualization (NFV)
Five myths about Network Function Virtualization (NFV) srichakra komatineni The document discusses key myths surrounding Network Functions Virtualization (NFV), including the potential for new revenue streams, total cost of ownership (TCO) gains, system reliability ('five nines'), and the evolution of operational support systems (OSS) and business support systems (BSS). It emphasizes that while NFV could enable quicker service launches and improved operational efficiencies, significant cultural and process changes are necessary for its success. Ultimately, challenges like manual processes and market uncertainties may hinder the full realization of NFV’s benefits.
Function as a Service: IT forum expo 2017
Function as a Service: IT forum expo 2017Igor Rosa Macedo Igor Rosa Macedo é um entusiasta de tecnologia que atua como consultor de DevOps e ALM, ajudando clientes a melhorar sua cadeia de entrega de valor. Ele também é integrante do time de ALM|DevOps Rangers, voluntários que constroem ferramentas e guias para a comunidade Visual Studio.
Managing change in the data center network
Managing change in the data center networkInterop This document discusses managing change in the data center network as it transitions to a more virtualized environment. It provides a brief history of computing eras from mainframes to today's virtual era. It then discusses the need for data center network management to change to address challenges of legacy networks in supporting virtualization and scale. Specifically, it argues that next generation data center networks require automation, dynamic resource optimization, and unified infrastructure management. The document proposes Dell's Advanced Infrastructure Manager as a way to unify management of compute, storage and networking infrastructure from a single console. It also discusses emerging technologies like iSCSI, FCoE, and DCB that can help data centers transition while maintaining investment in current technologies.
Data center interconnect seamlessly through SDN
Data center interconnect seamlessly through SDNFelecia Fierro The document provides an overview of Broadcom's data center interconnect (DCI) solutions using their switch silicon, emphasizing enhancements in bandwidth and flexibility since 2010. It outlines various DCI use cases, such as disaster recovery and workload mobility, while highlighting benefits like service resiliency, resource efficiency, and ease of management through Pluribus Networks' open networking approach. Additionally, it presents customer examples showcasing the implementation of DCI in mid-sized enterprises and cloud service providers, emphasizing the importance of visibility and multi-tenancy in these solutions.
Arista Networks - Building the Next Generation Workplace and Data Center Usin...
Arista Networks - Building the Next Generation Workplace and Data Center Usin...Aruba, a Hewlett Packard Enterprise company The document discusses the evolution of workplace and data center networking, focusing on software-defined networking (SDN) architectures from Arista Networks and Aruba. It highlights trends such as the increased prevalence of BYOD, the demand for low-latency communication, and the integration of technical solutions aimed at optimizing network performance. Arista's portfolio features advanced switching technologies and software solutions designed to address the challenges posed by modern data workloads and network visibility needs.
Nexus 7000 Series Innovations: M3 Module, DCI, Scale
Nexus 7000 Series Innovations: M3 Module, DCI, ScaleTony Antony The document provides an overview of the Cisco Nexus 7000 series switches, focusing on their capabilities in data center interconnect (DCI) with an emphasis on investment protection, architectural flexibility, and operational simplicity. It details the evolution of hardware modules, networking technologies, and interoperability features, alongside the benefits of various protocols for Layer 2 and Layer 3 interconnects. The document also highlights the advanced functionalities of the Nexus 7000 series and their role in modern data center infrastructure.
Haxe dci-presentation by Andreas SÖDERLUND
Haxe dci-presentation by Andreas SÖDERLUNDGrégory PARODI The document provides an overview of Data, Context, and Interaction (DCI) architecture. It discusses how earlier approaches to modeling a restaurant ordering system using classes and interfaces lost the original user mental model. DCI is introduced as a way to separate an application into Data (the objects), Context (the user mental models), and Interactions (the runtime behavior). Roles are attached to data objects dynamically based on the current Context. This allows modeling the restaurant use case where employees take on roles like Chef or Waiter depending on the serving guests context.
DCI - the architecture from the future
DCI - the architecture from the futureAndrzej Krzywda The document discusses the DCI (Data, Context, Interaction) architecture, emphasizing its benefits in object-oriented programming and its successful implementation in production. Key takeaways include improved testing and fewer objects through role-focused design, along with some limitations encountered in Ruby. It also mentions Marvin, a programming language tailored to support DCI, building on the fundamentals of C#.
The New Network for the Data Center
The New Network for the Data CenterJuniper Networks Juniper Networks introduced a new architecture for data centers that emphasizes simplification, automation, and security. This approach aims to overcome the limitations of traditional multi-layered networks by reducing complexity, enhancing performance, and lowering costs. Key innovations include a two-tier network fabric and new security solutions to meet the demands of modern cloud computing environments.
06 - IDNOG04 - Dion Leung (Coriant) - Emerging Trends & Real Deployments for ...
06 - IDNOG04 - Dion Leung (Coriant) - Emerging Trends & Real Deployments for ...Indonesia Network Operators Group Coriant, founded in 2013, aims to lead in global optical transport networking, serving major service providers and enterprises worldwide. The document discusses trends in Data Center Interconnection (DCI), including the shift towards open line systems (OLS) and the need for high-speed connectivity between data centers across various regions. It highlights the growing demand for flexible optical solutions, miniaturization of components, and advanced network management capabilities to optimize DCI applications.
Alcatel-Lucent Cloud: Shaping the Future NFV OSS David Amzallag TM Forum 2013
Alcatel-Lucent Cloud: Shaping the Future NFV OSS David Amzallag TM Forum 2013Alcatel-Lucent Cloud The document discusses the transformative potential of Network Functions Virtualization (NFV) in the telecommunications industry, highlighting its goals and the need for a new operational support system (OSS). It outlines the evolution from proof of concepts in 2013 to live trials in 2014, emphasizing operational simplicity, agility, and cost efficiency. The emphasis is on collaborative development and addressing operational challenges to harness the full capabilities of NFV for future carriers.
How to adopt SDN/NFV Technology into the BSS & OSS stack and shorten the time...
How to adopt SDN/NFV Technology into the BSS & OSS stack and shorten the time...Comarch The document discusses the adoption of SDN/NFV technologies into the Business Support System (BSS) and Operations Support System (OSS) to expedite the market launch of new services. It outlines the evolution of network virtualization, the shift towards independence from hardware, and the role of network nodes as micro-data centers. Additionally, it emphasizes the necessity of model-driven fulfillment and the integration of real-time OSS in the context of NFV.
Integrating SDN into the Data Center
Integrating SDN into the Data CenterJuniper Networks This white paper discusses the integration of software-defined networking (SDN) into data centers, driven by the need for improved agility and lower costs for increasingly complex virtualized applications. It emphasizes the transition from traditional networking to SDN to accommodate evolving application architectures, aiming to connect diverse resources while maintaining legacy infrastructure. Juniper Networks' MX Series 3D Universal Edge Routers are highlighted as a solution for bridging new SDN environments with existing deployments.
Data Center Interconnects: An Overview
Data Center Interconnects: An OverviewXO Communications This report discusses Data Center Interconnects (DCIs), which allow organizations to link multiple data centers for disaster recovery and business continuity, focusing on the major DCI technologies and their advantages and disadvantages. It highlights the complexities involved in implementing DCIs due to the limitations of Ethernet technology and explores various options such as dark fiber, MPLS services, and vendor-specific technologies. The report emphasizes the importance of utilizing effective routing and technology solutions to overcome challenges like traffic trombones and server migrations between data centers.
Managing and Implementing Network Function Virtualization with Intelligent OSS
Managing and Implementing Network Function Virtualization with Intelligent OSSComarch The document discusses the management and implementation of Network Function Virtualization (NFV) and Software-Defined Networking (SDN) by focusing on the evolution of network architecture from traditional setups to virtualized environments. It emphasizes the benefits of using NFV and SDN for dynamic resource allocation, improved customer experiences, and efficient service fulfillment, especially for enterprise VPN services. Additionally, it includes examples and insights into the role of Operational Support Systems (OSS) in managing both physical and virtual network resources.
Container as a Service with Docker
Container as a Service with DockerPatrick Chanezon This document discusses Docker Containers as a Service (CaaS). It begins by showing how Docker aims to build tools for mass innovation by creating a software layer to program the internet across various hardware and applications. It then discusses how CaaS provides an IT-managed secure environment for developers to build and deploy applications. Finally, it outlines the key characteristics of Docker's CaaS platform which supports the full application lifecycle across languages, operating systems and infrastructures through open APIs and ecosystem support.
OSS in the era of SDN and NFV: Evolution vs Revolution - What we can learn f...
OSS in the era of SDN and NFV: Evolution vs Revolution - What we can learn f...Colt Technology Services The document discusses the evolution of operational support systems (OSS) in the context of Software Defined Networking (SDN) and Network Function Virtualization (NFV), emphasizing the transition from traditional to more dynamic network services influenced by cloud computing. It highlights the challenges and necessary adaptations in OSS for effective integration of SDN/NFV, suggesting a need for better operational management and real-time analytics. The author calls for collaboration among vendors and developers to enhance service delivery and maintain agility in a hybrid IT environment.
How will virtual networks, controlled by software, impact OSS systems?
How will virtual networks, controlled by software, impact OSS systems?Comarch The document discusses the impact of software-defined networking (SDN) and network function virtualization (NFV) on operations support systems (OSS). It highlights the significant growth in global internet traffic and emphasizes the need for improved quality of service and network management. The text also explores the benefits of SDN and NFV in facilitating rapid deployment and scalability of network services, along with a detailed analysis of traditional OSS roles and their transformation in the context of SDN and NFV.
Data Center Network Trends - Lin Nease
Data Center Network Trends - Lin NeaseHPDutchWorld This document discusses trends in data center networks and strategies for addressing challenges. It describes how legacy data centers can be transformed into next generation data centers through standardization, virtualization, and automation. This allows for reduced costs, better asset utilization, lower power consumption, and higher system uptime. It also discusses various types of data center networks, the growth of 10Gb Ethernet, and topology approaches like using top-of-rack switches. The document outlines a strategy for network automation and virtualizing the data center network through representing it as an inventory of virtual connections.
Arista Networks - Building the Next Generation Workplace and Data Center Usin...
Arista Networks - Building the Next Generation Workplace and Data Center Usin...Aruba, a Hewlett Packard Enterprise company
06 - IDNOG04 - Dion Leung (Coriant) - Emerging Trends & Real Deployments for ...
06 - IDNOG04 - Dion Leung (Coriant) - Emerging Trends & Real Deployments for ...Indonesia Network Operators Group
OSS in the era of SDN and NFV: Evolution vs Revolution - What we can learn f...
OSS in the era of SDN and NFV: Evolution vs Revolution - What we can learn f...Colt Technology Services
Ad
Similar to PyParis2017 / Function-as-a-service - a pythonic perspective on severless computing, by Josef Spillner (20)
PyParis2017 / Tutorial transcript - Function-as-a-service : a pythonic perspe...
PyParis2017 / Tutorial transcript - Function-as-a-service : a pythonic perspe...Pôle Systematic Paris-Region This document is a tutorial on using Function-as-a-Service (FaaS) with Python, providing practical insights on programming conventions, tools, and service providers. It covers the utilization of software like Lambada and Snafu for deploying simple Python applications to AWS Lambda and orchestrating functions using Fission and OpenLambda. The tutorial includes code listings and commands necessary for creating and deploying a sample temperature application and demonstrates the process of testing and running functions locally before deployment.
Python in the land of serverless
Python in the land of serverlessDavid Przybilla The document details a presentation by David Przybilla on serverless computing, focusing on its applications, tools, and common mistakes in a data stream processing context. It explains the advantages of using function as a service (FaaS) and highlights the need for proper project structuring when working with serverless architectures. The talk also introduces various serverless tools like Serverless Framework, Chalice, and Zappa, along with examples of how they can be leveraged for API development and data processing tasks.
PyCon AU 2012 - Debugging Live Python Web Applications
PyCon AU 2012 - Debugging Live Python Web ApplicationsGraham Dumpleton The document discusses methods for debugging live Python web applications, highlighting the importance of systematic approaches to identify and reduce bugs. It covers various types of bugs, risk management strategies, monitoring tools, and techniques for logging and profiling, including the use of specific libraries and services. Additionally, it emphasizes the necessity of combining multiple tools for effective debugging and the establishment of structured debugging processes.
Microservices and serverless in python projects
Microservices and serverless in python projectsJose Manuel Ortega Candel The document discusses microservices and serverless architectures for Python projects. It covers microservices concepts and frameworks like asyncio and GraphQL. Serverless computing with AWS Lambda and frameworks like Zappa and Chalice are explained. Benefits of microservices include separation of concerns while serverless offers automatic scaling and lower costs. Frameworks make it easier to deploy Python code to AWS Lambda.
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...Alexandre Moneger The document discusses advancements in fuzzing binary protocols for enhanced code coverage, particularly emphasizing the limitations of traditional fuzzing techniques and the need for a more effective approach. It presents a new methodology that leverages gate functions and real-time code coverage tracking to optimize fuzzing processes, particularly in network protocols. The presentation culminates with insights from a proof-of-concept demonstration involving the Remote Desktop Protocol (RDP) and highlights the potential for improving network fuzzing strategies.
«Что такое serverless-архитектура и как с ней жить?» Николай Марков, Aligned ...
«Что такое serverless-архитектура и как с ней жить?» Николай Марков, Aligned ...it-people The document discusses what serverless computing is and how it can be used for building applications. Serverless applications rely on third party services to manage server infrastructure and are event-triggered. Popular serverless frameworks like AWS Lambda, Google Cloud Functions, Microsoft Azure Functions, and Zappa allow developers to write code that runs in a serverless environment and handle events and triggers without having to manage servers.
Python testing like a pro by Keith Yang
Python testing like a pro by Keith YangPYCON MY PLT This document provides an overview of software testing strategies and tools for Python projects. It recommends:
1. Using tools like IPython, linters, yapf, pytest, and hypothesis to find errors early through static and dynamic testing. This allows issues to be identified and addressed before deployment.
2. Enabling easy debugging in production with tools like Sentry, IPython, and alog to monitor and diagnose runtime errors.
3. Preparing for failures through defensive programming techniques and testing backup plans, as "no tested backup plan equals no backup." Thorough testing during development helps maximize uptime and minimize surprises once software is deployed.
FireWorks overview
FireWorks overviewAnubhav Jain The document provides an introduction and overview of FireWorks workflow software. Some key points:
- FireWorks is an open-source, Python-based workflow management software that uses MongoDB and is pip-installable.
- It is used by several large DOE projects and materials science groups for tasks like materials modeling, machine learning, and document processing. Over 100 million CPU-hours have been used with everyday production use.
- FireWorks allows for very dynamic workflows that can modify themselves intelligently and add/remove tasks over long periods of time in response to results. It also features job detection and status persistence.
Next Level Testing Revisited
Next Level Testing RevisitedJames Saryerwinnie The document discusses next-level testing techniques, focusing on property-based testing, state-based testing, and fuzz testing, while also providing examples in Python using the Hypothesis library. It explains concepts such as generating random input data and asserting function properties, as well as includes code snippets for deploying AWS Lambda functions using the Chalice framework. Additionally, it outlines deployment properties and detailed steps for managing functions using a stateful testing approach.
FireWorks workflow software
FireWorks workflow softwareAnubhav Jain FireWorks is Python workflow software that was created to address issues with running computational jobs like VASP calculations. It has no error detection, failure recovery, or ability to rerun jobs that failed. FireWorks provides features like automatic storage of job details, error detection and recovery, ability to rerun failed jobs with one command, and scaling of jobs without manual effort. It uses a Launchpad to define and launch workflows of FireTasks that can run jobs on different machines and directories.
AWS Serverless with Chalice
AWS Serverless with Chalice Suman Debnath The document discusses serverless computing using AWS Lambda. It provides an overview of serverless architecture and patterns, describing how Lambda functions can be triggered by events from other AWS services asynchronously or invoked directly. It also demonstrates how to create a Python Lambda function that returns a greeting based on an event payload, including zipping the code, creating an IAM role, and deploying the function.
Python in the serverless era (PyCon 2017)
Python in the serverless era (PyCon 2017)Benny Bauer The document discusses the concept of serverless architecture, specifically focusing on Function as a Service (FaaS), which provides a fully-managed compute environment for deploying code with minimal operational overhead. It highlights the benefits of serverless, such as cost-effectiveness and automatic scaling, while also noting potential limitations, including cold start latency and vendor lock-in. Additionally, it provides an overview of Python frameworks for FaaS, like Chalice and Zappa, and emphasizes the opportunities they present for developing serverless applications.
A Crash Course on Serverless Applications in Python
A Crash Course on Serverless Applications in PythonJames Saryerwinnie The document outlines a crash course on serverless applications using Python, focusing on AWS Lambda. It explains the architecture and functionality of serverless computing, demonstrating how to create, invoke, and manage Lambda functions with examples and code snippets. Key topics include event triggers, asynchronous and synchronous invocations, and integration with AWS services such as API Gateway and S3.
Si fa presto a dire serverless
Si fa presto a dire serverlessAlessio Coser This document discusses serverless computing and function as a service (FaaS). It begins with an introduction to serverless and FaaS concepts like functions being custom code that runs ephemerally in response to events. The document then shares experiences developing and operating a serverless photo platform called PhotoVogue at scale. Challenges discussed include vendor lock-in and managing shared dependencies between functions. Disaster recovery and testing operations are also covered. The document concludes with considerations for when FaaS may or may not be a good fit.
The Best Practices and Hard Lessons Learned of Serverless Applications
The Best Practices and Hard Lessons Learned of Serverless ApplicationsAmazon Web Services LATAM This document discusses best practices for building serverless applications using AWS Lambda. It covers topics such as using Lambda functions without servers to manage, paying only for compute resources used, leveraging services like API Gateway and Step Functions for orchestration, optimizing performance through techniques like smart resource allocation and reducing cold starts, and developing efficient Lambda function code.
Function as a Service
Function as a Servicerich fernandez This document discusses building a Slack bot using AWS Lambda and the Chalice framework. It describes how FaaS works, options for running functions through AWS Lambda including Python support. It then outlines how to build a Slack bot with Chalice that allows users to query Stack Overflow through natural language requests in Slack. Key steps include setting up the bot to handle requests, retrieving secrets securely, formatting responses, and deploying the code to AWS Lambda to be accessible through Slack. It also briefly discusses additional uses of FaaS beyond a basic bot including cron jobs and handling external events.
OpenFaaS - zero serverless in 60 seconds anywhere with case-studies
OpenFaaS - zero serverless in 60 seconds anywhere with case-studiesAlex Ellis The document discusses OpenFaaS, a framework that simplifies the deployment of serverless functions, highlighting its use cases such as image conversion, machine learning, and chatbots. It provides insights into its community-driven development, key contributors, and quick deployment capabilities. Several case studies from institutions like the University of Washington illustrate practical applications of OpenFaaS in diverse fields.
SFScon 21 - Duc Ly Vu - LastPyMile: a lightweight approach for securing Pytho...
SFScon 21 - Duc Ly Vu - LastPyMile: a lightweight approach for securing Pytho...South Tyrol Free Software Conference The document discusses a research project funded by various EU Horizon 2020 programs, focusing on a lightweight method called LastPymile for securing the Python ecosystem against software supply chain attacks. It highlights the prevalence of discrepancies between source code and distributed packages on PyPI, with a significant percentage of packages containing malicious code vulnerabilities. The paper outlines the challenges of verifying package security at scale and proposes solutions to improve the detection and prevention of code injection threats.
Serverless Function With Python and AWS Lambda
Serverless Function With Python and AWS LambdaFitrah Elly Firdaus This document provides an overview of serverless functions using Python and AWS Lambda. It introduces AWS Lambda as a compute service that lets you run code without provisioning or managing servers, and pays only for the compute time used. It also discusses API Gateway for creating and maintaining APIs, and how to structure Python functions for Lambda. Example Python code is provided for Lambda function syntax, logging, and exception handling.
Gluecon 2018 - The Best Practices and Hard Lessons Learned of Serverless Appl...
Gluecon 2018 - The Best Practices and Hard Lessons Learned of Serverless Appl...Chris Munns The document discusses best practices and lessons learned in developing serverless applications using AWS Lambda. It outlines key areas such as optimization, resource allocation, function lifecycle, and error handling through mechanisms like dead letter queues. Additionally, practical insights on performance improvements and configuration guidance are provided for effective serverless architecture.
PyParis2017 / Tutorial transcript - Function-as-a-service : a pythonic perspe...
PyParis2017 / Tutorial transcript - Function-as-a-service : a pythonic perspe...Pôle Systematic Paris-Region
SFScon 21 - Duc Ly Vu - LastPyMile: a lightweight approach for securing Pytho...
SFScon 21 - Duc Ly Vu - LastPyMile: a lightweight approach for securing Pytho...South Tyrol Free Software Conference
Ad
More from Pôle Systematic Paris-Region (20)
OSIS19_IoT :Transparent remote connectivity to short-range IoT devices, by Na...
OSIS19_IoT :Transparent remote connectivity to short-range IoT devices, by Na...Pôle Systematic Paris-Region The document discusses the challenges and proposed solutions for transparent remote connectivity to short-range IoT devices using Bluetooth Low Energy (BLE). It introduces the Remote Connection Manager (RCM), which enables application-agnostic access to remote BLE devices without modifying existing applications, thereby simplifying connectivity. Experimental evaluations demonstrate the feasibility and performance of RCM implemented on Linux and Android environments.
OSIS19_Cloud : SAFC: Scheduling and Allocation Framework for Containers in a ...
OSIS19_Cloud : SAFC: Scheduling and Allocation Framework for Containers in a ...Pôle Systematic Paris-Region Le document présente le SAFc (Scheduling and Allocation Framework for Containers), un nouveau framework d'ordonnancement de conteneurs visant à optimiser leur gestion dans un environnement cloud. Il propose un modèle économique basé sur deux classes de SLA qui dynamise le calcul des ressources allouées aux conteneurs, tout en minimisant l'utilisation des cœurs de calcul. Des expériences effectuées montrent que ce framework consomme 10% moins de cœurs par rapport à un modèle traditionnel tout en offrant une exécution légèrement plus lente.
OSIS19_Cloud : Qu’apporte l’observabilité à la gestion de configuration? par ...
OSIS19_Cloud : Qu’apporte l’observabilité à la gestion de configuration? par ...Pôle Systematic Paris-Region The document discusses the importance of observability in configuration management, highlighting its role in error detection and the maintenance of system consistency. It defines key concepts such as observability, monitoring, and event sourcing while addressing challenges faced in modern management environments. The content also emphasizes the necessity of understanding system states through external outputs and outlines practical implementations in a configuration management context.
OSIS19_Cloud : Performance and power management in virtualized data centers, ...
OSIS19_Cloud : Performance and power management in virtualized data centers, ...Pôle Systematic Paris-Region The document discusses 'drowsy-dc', a power management paradigm for data centers that draws inspiration from smartphone technology to maximize energy efficiency. It highlights the importance of idleness-aware VM consolidation and presents experimental results showing significant energy savings (up to 81%) compared to existing methods. The proposed approach focuses on optimizing resource usage by consolidating workloads based on expected idleness, ultimately aiming to enhance power management in data centers.
OSIS19_Cloud : Des objets dans le cloud, et qui y restent -- L'expérience du ...
OSIS19_Cloud : Des objets dans le cloud, et qui y restent -- L'expérience du ...Pôle Systematic Paris-Region The document discusses the development of Creson, a system designed for efficient support of shared objects over a NoSQL database, providing strong consistency guarantees for concurrent accesses. It highlights the shortcomings of traditional object-relational mappings (ORMs) and introduces Creson's unique architecture, which utilizes a listenable key-value store to manage remote operations on objects stored in the cloud. Additionally, it presents a use case of Creson with Stacksync, an open-source cloud storage alternative to Dropbox, detailing its metadata management enhancements over traditional relational databases.
OSIS19_Cloud : Attribution automatique de ressources pour micro-services, Alt...
OSIS19_Cloud : Attribution automatique de ressources pour micro-services, Alt...Pôle Systematic Paris-Region Le document traite de la stratégie de placement par le biais du clustering, incluant l'évaluation du placement et l'utilisation de données autres (métadonnées). Il mentionne également la mise à jour des contraintes si nécessaire.
OSIS19_IoT : State of the art in security for embedded systems and IoT, by Pi...
OSIS19_IoT : State of the art in security for embedded systems and IoT, by Pi...Pôle Systematic Paris-Region Le document traite de la sécurité des systèmes embarqués et de l'IoT, en soulignant les défis posés par les attaques et la nécessité de normes telles que l'IEC 62443. Il met en évidence les différences entre la sécurité informatique et opérationnelle, ainsi que l'importance des choix de composants et méthodes dès la conception pour assurer la sécurité. Les exemples d'attaques célèbres illustrent les risques liés à un défaut de conception et à une configuration inadéquate des dispositifs connectés.
Osis19_IoT: Proof of Pointer Programs with Ownership in SPARK, by Yannick Moy
Osis19_IoT: Proof of Pointer Programs with Ownership in SPARK, by Yannick MoyPôle Systematic Paris-Region The document discusses the implementation of pointer programs with ownership in Spark, highlighting features like first-class arrays, strong typing, and non-aliasing checks that enhance safety in concurrency. It outlines pointer ownership operations including 'move', 'borrow', and 'observe', along with their implications on data accessibility and memory management. Limitations of Spark's approach are addressed, including pool-specific access types and the absence of Rust-like lifetime annotations.
Osis18_Cloud : Pas de commun sans communauté ?
Osis18_Cloud : Pas de commun sans communauté ?Pôle Systematic Paris-Region Le document aborde le concept de 'commun', une ressource partagée qui bénéficie à tous les membres d'une communauté, façonnée par une gouvernance collective. Il souligne l'importance de parler du commun culturel pour éviter des malentendus et appelle à un internet libre et ouvert, considéré comme un bien commun. Enfin, il soulève l'idée d'améliorer l'accessibilité et l'entretien des ressources partagées pour le bénéfice de tous.
Osis18_Cloud : Projet Wolphin
Osis18_Cloud : Projet Wolphin Pôle Systematic Paris-Region Le document présente le projet Wolphin, axé sur la facturation des consommations en conteneurs et sur l'orchestration, avec une avancée de 75 % prévue pour début 2019. Il aborde également les systèmes d'ordonnancement dynamiques et les défis liés à l'automatisation du dimensionnement des conteneurs, ainsi que les besoins en métriques pour optimiser ce dimensionnement. De plus, il discute des résultats récents et des publications associées à des stratégies multi-critères et des évaluations de l'usage de la mémoire.
Osis18_Cloud : Virtualisation efficace d’architectures NUMA
Osis18_Cloud : Virtualisation efficace d’architectures NUMAPôle Systematic Paris-Region Le document se concentre sur l’efficacité de la virtualisation dans les architectures NUMA pour le cloud computing, mettant en évidence que les technologies actuelles n'exploitent pas pleinement la puissance des machines modernes. Il aborde les problèmes de latence mémoire et propose une approche de coopération entre hyperviseurs et systèmes invités pour optimiser le placement des données. Plusieurs stratégies de gestion de mémoire sont également évaluées pour améliorer la performance.
Osis18_Cloud : DeepTorrent Stockage distribué perenne basé sur Bittorrent
Osis18_Cloud : DeepTorrent Stockage distribué perenne basé sur BittorrentPôle Systematic Paris-Region This document describes DeepTorrent, a distributed storage system based on Bittorrent that aims to provide permanent storage. It discusses issues with cloud storage like high energy consumption, limited security, and legal restrictions. DeepTorrent uses Python and C libraries and Redis for control flow. It allows uploading and downloading files and managing storers. DeepTorrent is being tested for archiving production logs and medical imaging data. Future work includes access control and distributed control flow using DHT.
Osis18_Cloud : Software-heritage
Osis18_Cloud : Software-heritagePôle Systematic Paris-Region The document discusses the Software Heritage initiative, which aims to collect, preserve, and share the source code of all publicly available software. It notes that software is culturally and economically important but fragile, as source code is often lost. The initiative builds an archive of software source code and history using free and open source methods. It has already archived over 150 terabytes of open source software from repositories like GitHub, and seeks more support to continue its work of preserving software for current and future use.
OSIS18_IoT: L'approche machine virtuelle pour les microcontrôleurs, le projet...
OSIS18_IoT: L'approche machine virtuelle pour les microcontrôleurs, le projet...Pôle Systematic Paris-Region Le document présente le projet omicrob, qui utilise une approche machine virtuelle pour programmer des microcontrôleurs avec un langage de haut niveau comme OCaml, visant à faciliter la programmation tout en assurant la portabilité. Il discute des diverses caractéristiques des microcontrôleurs, de leur utilisation dans différents secteurs, ainsi que des avantages d'une abstraction matérielle pour réduire les erreurs et améliorer la sécurité du code. Le projet inclut des exemples de code et des détails sur l'architecture et les langages de programmation appliqués.
OSIS18_IoT: La securite des objets connectes a bas cout avec l'os et riot
OSIS18_IoT: La securite des objets connectes a bas cout avec l'os et riotPôle Systematic Paris-Region The document discusses the security challenges associated with low-end IoT devices, highlighting the importance of open-source operating systems like RIOT for programmability and control. It outlines the varying architectures of low-end devices, IoT attack vectors, and inherent trade-offs between performance, privacy, and security. The presentation also addresses trends in IoT security, including the role of trusted hardware and cryptographic primitives in mitigating risks.
OSIS18_IoT : Solution de mise au point pour les systemes embarques, par Julio...
OSIS18_IoT : Solution de mise au point pour les systemes embarques, par Julio...Pôle Systematic Paris-Region The document outlines an embedded software engineering framework focused on system configuration and management using the Maestro server. It provides details about target management, including hardware integrations, configuration files, and command-line interface functionality. Additionally, it discusses managing communication ports, locking targets, and utilizing GDB for debugging and program execution benchmarks.
OSIS18_IoT : Securisation du reseau des objets connectes, par Nicolas LE SAUZ...
OSIS18_IoT : Securisation du reseau des objets connectes, par Nicolas LE SAUZ...Pôle Systematic Paris-Region The document outlines Nokia's vision for securely managing connected devices through its Future Spaces project, focusing on intuitive user interfaces and automation for seamless organization. Key features include fine-grained access control, isolation of devices, and advanced network management to enhance user privacy and security. It also discusses potential use cases in smart homes, offices, and industries, emphasizing the importance of crowd-sourced trust evaluation for IoT devices.
OSIS18_IoT : Ada and SPARK - Defense in Depth for Safe Micro-controller Progr...
OSIS18_IoT : Ada and SPARK - Defense in Depth for Safe Micro-controller Progr...Pôle Systematic Paris-Region The document discusses the Spark programming language, particularly its application in security and software assurance through formal methods and flow analysis. It also highlights various projects utilizing Spark, such as the Muen separation kernel and Componolit secure phone, which focus on providing secure operating systems and devices. Additionally, it mentions resources and tools available for adopting Spark in secure software development.
OSIS18_IoT : RTEMS pour l'IoT professionnel, par Pierre Ficheux (Smile ECS)
OSIS18_IoT : RTEMS pour l'IoT professionnel, par Pierre Ficheux (Smile ECS)Pôle Systematic Paris-Region Le document présente une vue d'ensemble de RTEMS, un système d'exploitation en temps réel conçu pour les systèmes embarqués, avec des origines militaires et une large adoption dans les missions spatiales. Il évoque également les défis et opportunités liés à l'Internet des objets (IoT), mettant en évidence les protocoles et normes nécessaires pour l'interopérabilité. Des développements récents, ainsi que des solutions proposées pour l'utilisation de RTEMS dans l'IoT, sont également discutés.
PyParis 2017 / Un mooc python, by thierry parmentelat
PyParis 2017 / Un mooc python, by thierry parmentelatPôle Systematic Paris-Region The document discusses a MOOC on Python programming offered on the FUN platform in France. It provides details on the audience, which is French-speaking students with some exposure to programming. Around 33,000 students have registered across 3 sessions so far. The course materials include videos, quizzes, and Jupyter notebooks hosted on a separate infrastructure that allows notebooks to be viewed within the online course platform. The content covers basic and advanced Python concepts across 7 weeks. Feedback is welcomed to help update the course for an upcoming session that will transition to teaching Python 3.
OSIS19_IoT :Transparent remote connectivity to short-range IoT devices, by Na...
OSIS19_IoT :Transparent remote connectivity to short-range IoT devices, by Na...Pôle Systematic Paris-Region
OSIS19_Cloud : SAFC: Scheduling and Allocation Framework for Containers in a ...
OSIS19_Cloud : SAFC: Scheduling and Allocation Framework for Containers in a ...Pôle Systematic Paris-Region
OSIS19_Cloud : Qu’apporte l’observabilité à la gestion de configuration? par ...
OSIS19_Cloud : Qu’apporte l’observabilité à la gestion de configuration? par ...Pôle Systematic Paris-Region
OSIS19_Cloud : Performance and power management in virtualized data centers, ...
OSIS19_Cloud : Performance and power management in virtualized data centers, ...Pôle Systematic Paris-Region
OSIS19_Cloud : Des objets dans le cloud, et qui y restent -- L'expérience du ...
OSIS19_Cloud : Des objets dans le cloud, et qui y restent -- L'expérience du ...Pôle Systematic Paris-Region
OSIS19_Cloud : Attribution automatique de ressources pour micro-services, Alt...
OSIS19_Cloud : Attribution automatique de ressources pour micro-services, Alt...Pôle Systematic Paris-Region
OSIS19_IoT : State of the art in security for embedded systems and IoT, by Pi...
OSIS19_IoT : State of the art in security for embedded systems and IoT, by Pi...Pôle Systematic Paris-Region
Osis19_IoT: Proof of Pointer Programs with Ownership in SPARK, by Yannick Moy
Osis19_IoT: Proof of Pointer Programs with Ownership in SPARK, by Yannick MoyPôle Systematic Paris-Region
Osis18_Cloud : DeepTorrent Stockage distribué perenne basé sur Bittorrent
Osis18_Cloud : DeepTorrent Stockage distribué perenne basé sur BittorrentPôle Systematic Paris-Region
OSIS18_IoT: L'approche machine virtuelle pour les microcontrôleurs, le projet...
OSIS18_IoT: L'approche machine virtuelle pour les microcontrôleurs, le projet...Pôle Systematic Paris-Region
OSIS18_IoT: La securite des objets connectes a bas cout avec l'os et riot
OSIS18_IoT: La securite des objets connectes a bas cout avec l'os et riotPôle Systematic Paris-Region
OSIS18_IoT : Solution de mise au point pour les systemes embarques, par Julio...
OSIS18_IoT : Solution de mise au point pour les systemes embarques, par Julio...Pôle Systematic Paris-Region
OSIS18_IoT : Securisation du reseau des objets connectes, par Nicolas LE SAUZ...
OSIS18_IoT : Securisation du reseau des objets connectes, par Nicolas LE SAUZ...Pôle Systematic Paris-Region
OSIS18_IoT : Ada and SPARK - Defense in Depth for Safe Micro-controller Progr...
OSIS18_IoT : Ada and SPARK - Defense in Depth for Safe Micro-controller Progr...Pôle Systematic Paris-Region
OSIS18_IoT : RTEMS pour l'IoT professionnel, par Pierre Ficheux (Smile ECS)
OSIS18_IoT : RTEMS pour l'IoT professionnel, par Pierre Ficheux (Smile ECS)Pôle Systematic Paris-Region
Recently uploaded (20)
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdfPriyanka Aash Oh, the Possibilities - Balancing Innovation and Risk with Generative AI
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure SolutionsMichele Leroux Bustamante Delivering solutions to Azure may involve a variety of architecture patterns involving your applications, APIs data and associated Azure resources that comprise the solution. This session will use reference architectures to illustrate the security considerations to protect your Azure resources and data, how to achieve Zero Trust, and why it matters. Topics covered will include specific security recommendations for types Azure resources and related network security practices. The goal is to give you a breadth of understanding as to typical security requirements to meet compliance and security controls in an enterprise solution.
"Scaling in space and time with Temporal", Andriy Lupa.pdf
"Scaling in space and time with Temporal", Andriy Lupa.pdfFwdays Design patterns like Event Sourcing and Event Streaming have long become standards for building real-time analytics systems. However, when the system load becomes nonlinear with fast and often unpredictable spikes, it's crucial to respond quickly in order not to lose real-time operating itself.
In this talk, I’ll share my experience implementing and using a tool like Temporal.io. We'll explore the evolution of our system for maintaining real-time report generation and discuss how we use Temporal both for short-lived pipelines and long-running background tasks.
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model LibraryPetraVukmirovic Threat Model Library Launch at OWASP Barcelona 2025
https://owasp.org/www-project-threat-model-library/
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik - Passionate Tech EnthusiastRaman Bhaumik A Junior Software Developer with a flair for innovation, Raman Bhaumik excels in delivering scalable web solutions. With three years of experience and a solid foundation in Java, Python, JavaScript, and SQL, she has streamlined task tracking by 20% and improved application stability.
10 Key Challenges for AI within the EU Data Protection Framework.pdf
10 Key Challenges for AI within the EU Data Protection Framework.pdfPriyanka Aash 10 Key Challenges for AI within the EU Data Protection Framework
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Salesforce Summer '25 Release Frenchgathering.pptx.pdfyosra Saidani Salesforce Summer '25 Release Frenchgathering.pptx.pdf
UserCon Belgium: Honey, VMware increased my bill
UserCon Belgium: Honey, VMware increased my billstijn40 VMware’s pricing changes have forced organizations to rethink their datacenter cost management strategies. While FinOps is commonly associated with cloud environments, the FinOps Foundation has recently expanded its framework to include Scopes—and Datacenter is now officially part of the equation. In this session, we’ll map the FinOps Framework to a VMware-based datacenter, focusing on cost visibility, optimization, and automation. You’ll learn how to track costs more effectively, rightsize workloads, optimize licensing, and drive efficiency—all without migrating to the cloud. We’ll also explore how to align IT teams, finance, and leadership around cost-aware decision-making for on-prem environments. If your VMware bill keeps increasing and you need a new approach to cost management, this session is for you!
AI Agents and FME: A How-to Guide on Generating Synthetic Metadata
AI Agents and FME: A How-to Guide on Generating Synthetic MetadataSafe Software In the world of AI agents, semantics is king. Good metadata is thus essential in an organization's AI readiness checklist. But how do we keep up with the massive influx of new data? In this talk we go over the tips and tricks in generating synthetic metadata for the consumption of human users and AI agents alike.
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025pcprocore 👉𝗡𝗼𝘁𝗲:𝗖𝗼𝗽𝘆 𝗹𝗶𝗻𝗸 & 𝗽𝗮𝘀𝘁𝗲 𝗶𝗻𝘁𝗼 𝗚𝗼𝗼𝗴𝗹𝗲 𝗻𝗲𝘄 𝘁𝗮𝗯> https://pcprocore.com/ 👈◀
CapCut Pro Crack is a powerful tool that has taken the digital world by storm, offering users a fully unlocked experience that unleashes their creativity. With its user-friendly interface and advanced features, it’s no wonder why aspiring videographers are turning to this software for their projects.
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo1pcity Studios, Inc AI VIDEO MAGAZINE - r/aivideo community newsletter – Exclusive Tutorials: How to make an AI VIDEO from scratch, PLUS: How to make AI MUSIC, Hottest ai videos of 2025, Exclusive Interviews, New Tools, Previews, and MORE - JUNE 2025 ISSUE -
cnc-processing-centers-centateq-p-110-en.pdf
cnc-processing-centers-centateq-p-110-en.pdfAmirStern2 מרכז עיבודים תעשייתי בעל 3/4/5 צירים, עד 22 החלפות כלים עם כל אפשרויות העיבוד הדרושות. בעל שטח עבודה גדול ומחשב נוח וקל להפעלה בשפה העברית/רוסית/אנגלית/ספרדית/ערבית ועוד..
מסוגל לבצע פעולות עיבוד שונות המתאימות לענפים שונים: קידוח אנכי, אופקי, ניסור, וכרסום אנכי.
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and SwecoSafe Software Managing airport and airspace data is no small task, especially when you’re expected to deliver it in AIXM format without spending a fortune on specialized tools. But what if there was a smarter, more affordable way?
Join us for a behind-the-scenes look at how Sweco partnered with Swedavia, the Swedish airport operator, to solve this challenge using FME and Esri.
Learn how they built automated workflows to manage periodic updates, merge airspace data, and support data extracts – all while meeting strict government reporting requirements to the Civil Aviation Administration of Sweden.
Even better? Swedavia built custom services and applications that use the FME Flow REST API to trigger jobs and retrieve results – streamlining tasks like securing the quality of new surveyor data, creating permdelta and baseline representations in the AIS schema, and generating AIXM extracts from their AIS data.
To conclude, FME expert Dean Hintz will walk through a GeoBorders reading workflow and highlight recent enhancements to FME’s AIXM (Aeronautical Information Exchange Model) processing and interpretation capabilities.
Discover how airports like Swedavia are harnessing the power of FME to simplify aviation data management, and how you can too.
Securing Account Lifecycles in the Age of Deepfakes.pptx
Securing Account Lifecycles in the Age of Deepfakes.pptxFIDO Alliance Securing Account Lifecycles in the Age of Deepfakes
Quantum AI Discoveries: Fractal Patterns Consciousness and Cyclical Universes
Quantum AI Discoveries: Fractal Patterns Consciousness and Cyclical UniversesSaikat Basu Embark on a cosmic journey exploring the intersection of quantum
computing, consciousness, and ancient wisdom. Together we'll uncover the
recursive patterns that bind our reality.
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to productionMichele Leroux Bustamante We live in an ever evolving landscape for cyber threats creating security risk for your production systems. Mitigating these risks requires participation throughout all stages from development through production delivery - and by every role including architects, developers QA and DevOps engineers, product owners and leadership. No one is excused! This session will cover examples of common mistakes or missed opportunities that can lead to vulnerabilities in production - and ways to do better throughout the development lifecycle.
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdfPriyanka Aash A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?Shashi Sathyanarayana, Ph.D This slide illustrates a side-by-side comparison between human-written, AI-written, and ambiguous content. It highlights subtle cues that help readers assess authenticity, raising essential questions about the future of communication, trust, and thought leadership in the age of generative AI.
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdfPriyanka Aash Cracking the Code - Unveiling Synergies Between Open Source Security and AI
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to productionMichele Leroux Bustamante
PyParis2017 / Function-as-a-service - a pythonic perspective on severless computing, by Josef Spillner
- 1. Zürcher Fachhochschule Function-as-a-tervice: A Pythonic Perspective on terverless Computing Josef Spillner <[email protected]> Service Prototyping Lib (blog.zhiw.ch/icclib) Zurich University of Applied Sciences Jun 13, 2017 | PyPiris
- 2. 2 Your Tutorial Agenda 50‘ FiiS overview ind some existing tools 20‘ Limbidi: Decompose your functions 20‘ Snifu: Run your functions
- 3. 3 Your Tutorial Instructor Josef Spillner <[email protected]> ● works it Zurich University of Applied Sciences ● lectures Python progrimming to undergriduites & misters of idvinced studies ● performs reseirch in the Service Prototyping Lib ● co-iuthored «Architecturil Trinsformitions in Network Services ind Distributed Systems» ● wrote miny rirely used Python things since 2003 [LS16]
- 4. 4 Service Prototyping Lab + ICCLab
- 5. 5 What is FaaS? [mizikglobil.com] “functions“ contiiners pickiges ictuil functions FaaS ● running functions in the cloud (hosted functions) ● reil “piy per use“ (per invocition, per loid x time unit, e.g. GHz/100ms) ● seemingly “serverless“
- 6. 6 Examples of FaaS [openwhisk.org] monitoring event sensor diti log entry git push ... HTTP XMPP AMQP ... mix 1 per hour ... Your Python functions! JSON pliin text ...
- 7. 7 The FaaS Space AWS Lambda OpenWhisk Functions PyWren [Limbdi] Docker-LimbCI Effe OpenLimbdi Lever OS Fission Funktion Kubeless Picisso Serverless Frimework [Limbdi, OW, GCF, AF] Step Functions [Limbdi] X-Riy [Limbdi] Zippi [Limbdi] Apex [Limbdi] Snafu - in Python
- 8. 8 The FaaS Space AWS Lambda OpenWhisk Functions PyWren Webtisk.io Hook.io Docker-LimbCI Effe OpenLimbdi Lever OS Fission Funktion Kubeless Picisso
- 9. 9 The FaaS Space: Runtimes Function-is-i-Service offerings in greiter detiil... Trend: Sooner or liter → gips will be filled
- 10. 10 The FaaS Space: Python runtimes
- 11. 11 FaaS Synopsis in Python def limbdi_hindler(event, context): ‘‘‘ event: dict context: meti informition object returns: dict, string, number, ... ‘‘‘ # ... return “result“ AWS Limbdi: def hindler(input): ‘‘‘ input: dict returns: dict ‘‘‘ # ... return {} OpenWhisk: def miin(): ‘‘‘ input: vii flisk.request.get_diti() returns: str ‘‘‘ # ... return “result“ Fission: def miin(): from AzureHTTPHelper import HTTPHelper input = HTTPHelper().post # ... open(os.environ[“res“], “w“).write( json.dumps({“body“: “...“})) miin() Azure Functions: Further differences: ● function scoping (e.g. with/without export in JiviScript) ● function niming (mingling on client or service side)
- 12. 12 The WorldSs Tools for FaaS Devs OpenWhisk $ wsk $ iz AWS Lambda $ iws limbdi # openlimbdi $ bin/idmin $ kubeless $ fission does not compile not scriptible requires iccount breiks minikube (invoke reid error)
- 13. 13 Open Lambda - Hands-on Time!
- 14. 14 Fission - Hands-on Time!
- 15. 15 Overlay Approach: PyWren Improved conveyince of “serverless“ piridigm ● no explicit deployment prior to execution ● rither, deploys while executing How it works: ● cloudpickle to AWS S3 ● executes Limbdi function which reids/writes from/to S3 ● pirillelisition through mip functions def my_function(b): x = np.random.normal(0, b, 1024) A = np.random.normal(0, b, (1024, 1024)) return np.dot(A, x) pwex = pywren.default_executor() res = pwex.map(my_function, np.linspace(0.1, 100, 1000))
- 16. 16
- 17. 17 Our Tools for FaaS Devs Podilizer (Jivi) Limbidi (Python) Web2Cloud (JiviScript) todiy Limbickup (file bickups) Limi (relitionil diti) Snifu (FiiS host) todiy
- 18. 18 Lambada Definition of “FiiSificition“ → Process of iutomited decomposition of softwire ipplicition into i set of deployed ind reidily composed function-level services. FiiSificition := code inilysis + trinsformition + deployment + on-demind ictivition Integrition Citegories: ● generic (code/function unit generition) ● single-provider integrition ● multi-provider integrition Decomposition Citegories: ● stitic code inilysis ● dynimic code inilysis → Limbidi: FiiSificition for Python (currently limited to Limbdificition) Depth Citegories: ● shillow (file to function) ● medium (function to lines) ● deep (line to miny lines)
- 19. 19 Lambada Code Anilysis Dependencies ● imported modules ● globil viriibles ● dependency functions ● defined in other module ● defined in sime module Input/Output ● printed lines ● input stitements ● tiinting ● stiteful function splitting import time import mith level = 12 counter = 0 def fib(x): globil counter counter += 1 for i in ringe(counter): i = mith.sin(counter) if x in (1, 2): return 1 return fib(x - 1) + fib(x - 2) if __nime__ == "__miin__": fib(level)
- 20. 20 Lambada Code Trinsformition Rewrite rules, vii AST: return 9 print(“hello“) local_func() ------------------- return 9 ---------------------- return {“ret“: 9} ----------------------------------------- local_func_stub() return {“ret: 9“, “stdout“: “hello“} Stubs, vii templites: def func_stub(x): input = json.dumps({“x“: x}) output = boto3.client(“lambda“).invoke(FN=“func“, Payload=input) y = json.loads(output[“Payload“].read().decode(“utf-8“))
- 21. 21 Lambada Code Trinsformition Stiteful proxies for Object-Oriented Progrimming: class Test: → class Proxy: def __init__(self): def __new__(cls, clsname, p=True): self.x = 9 if p: # __new__ must return callable return lambda: Proxy(clsname, False) def test(self): else: return self.x * 2 return object.__new__(cls) def __init__(self, clsname, ignoreproxy): ... def __getattr__(self, name): ... → Test becomes Proxy(“Test“), Test() then invokes proxy → test() becomes remote_test({“x“: 9}) through network proxy cliss → iutomiticilly upon import of cliss
- 22. 22 Lambada Code Deployment + Activition Locil mode: source code modified locilly is copy Remote mode: rewritten source code deployed ind invoked $ limbidi [--locil] [--debug] [--endpoint <ep>] <file.py> $ python3 -m limbidi <file.py> >>> import limbidi >>> limbidi.move(globils() [, endpoint=“...“])
- 23. 23 Lambada - Hands-on Time! [d0wn.com]
- 24. 24
- 25. 25 Snafu The Swiss Army Knife of Serverless Computing
- 26. 26 Snafu Current Implementition ● scilible from developer single instince to multi- tenint deployments ● executes Python 2 & 3, Jivi, JiviScript, C ● integrites with FiiS ecosystem it-lirge ● extensible subsystems SLOC: ~1800 (including subsystems: ~800) $ pip instill snifu $ docker run -ti jszhiw/snifu
- 27. 27 Snafu Stindilone mode ● cill functions interictively ● bitch mode with/without input pipe ● performince, robustness & correctness tests ● development $ snifu $ snifu -x <function> [<file/dir>] $ snifu -l sqlite -e jivi -c limbdi -C messiging
- 28. 28 Snafu Diemon mode (control pline) ● hosted functions ● multi-tenint provisioning ● per-tenint isolition ● compitibility with existing client tools $ snifu-control $ snifu-control -i iws -r -d -e docker # snifu-iccounts --idd -k <k> -s <s> -e <ep>
- 29. 29 Snafu Integrition into the wider FiiS ecosystem snafu-import Snifu Funktion Fission Kubeless ... targets sources AWS IBM Google $ snifu-import --source <s> --tirget <t> $ iliis iws=“iws --endpoint-url http://locilhost:10000“ $ wsk property set --ipihost locilhost:10000 $ ./tools/pitch-gcloud
- 30. 30 Snafu - Hands-on Time! [pinterest.com]
- 31. 31 Q&A / Live help session [dribbble.com]
- 32. 32 Further Reading and FaaS Fun Limi, Limbickup: ● https://arxiv.org/abs/1701.05945 Podilizer: ● https://arxiv.org/abs/1702.05510 Snifu: ● https://arxiv.org/abs/1703.07562 Limbidi ● https://arxiv.org/abs/1705.08169 On irXiv Anilytics: On GitHub: [github.com/ serviceprototypinglab]