Windows Azure Service Bus

Feb 13, 2014Download as PPTX, PDF2 likes1,416 views

This document provides an overview of Microsoft Azure Service Bus and compares it to Azure Queues. Service Bus allows applications and services to communicate over reliable messaging even if they are not connected all the time. It supports queuing and publish/subscribe capabilities. Service Bus Queues offer more features than Azure Queues, including larger message sizes, unlimited time-to-live for messages, and publish/subscribe capabilities using topics and subscriptions. The document also describes how to configure applications to use Service Bus Queues and Relay for communication between apps and services.

Service Bus
Pavlo Revenkov
EPAM Cloud Computing Competency Center
Email: pavlo_revenkov@epam.com
Skype: rp_risingstar

Windows Azure Queue

2
Worker-role

Web-role

Worker-role
Web-role

Worker-role

Windows Azure Services Bus
Worker-role

Web-role

Queue #1

Worker-role
Web-role

Topic

Queue #N

Worker-role

3

4
Windows Azure
Queues

Windows Azure
Service Bus Queues

- No ordering guarantee

- First-In-First-Out

- At-Least-Once delivery

- At-Least-Once, At-Most-Once

- Message size up to 64 KB

- Message size up to 256 KB

- Queue size up to 100 TB

- Queue size up to 5 GB

- One-to-one message delivery

- Publish/Subscriber

- Time-to-live up to 7 days

- Time-to-live unlimited

- In-place update

- No in-place update

Management

5

URI: sb://<namespace>.servicebus.windows.net/
Namespace Manager
Management
Queues

Topics

Subscriptions

QueueClient

TopicClient

SubscriptionClient

Send

Receive

Workflow

6

var namespaceManager =
NamespaceManager.CreateFromConnectionString(
CloudConfigurationManager.GetSetting(connectionString));
if (!namespaceManager.SubscriptionExists(path))
namespaceManager.CreateSubscription(new SubscriptionDescription(path));
var subscriptionClient = Microsoft.ServiceBus.Messaging.SubscriptionClient
.CreateFromConnectionString(...);
var message = subscriptionClient.Receive();
try
{
...
message.Complete();
}
catch (Exception)
{
message.Abandon();
}

Service Bus Relay

7

Worker-role
Web-role

WCF-service

Client

Configuration
Everything you need is to change “*.config” file!
<extensions>
<bindingExtensions>
<add name=“netTcpRelayBinding”
type=“Microsoft...NetTcpRelayBindingCollectionElement” />
...
<behaviorExtensions>
<add name=“transportClientEndpointBehavior”
type=“Microsoft...TransportClientEndpointBehaviorElement” />
...

<behavior name=“sbTokenProvider”>
<transportClientEndpointBehavior>
<tokenProvider>
<sharedSecret issuerName=“[NAME]” issuerSecret=“[KEY]” />
...
<endpoint contract=“<contractname>”
binding=“netTcpRelayBinding”
address=“sb://<namespace>.servicebus.windows.net/<servicename>”
behaviorConfiguration=“sbTokenProvider” />

8

References

10

How to use the Service Bus



windowsazure.com/en-us/develop/net/how-to-guides/service-bus-queues/
windowsazure.com/en-us/develop/net/how-to-guides/service-bus-topics/

Hybrid application using Service Bus Relay


windowsazure.com/en-us/develop/net/tutorials/hybrid-solution/

Windows Azure Queues vs. Windows Azure Service Bus


msdn.microsoft.com/en-us/library/windowsazure/hh767287.aspx

There are times when you should consider setting up secure communications between your software components across network boundaries. Here are just a few: * Your application is enormous (e.g., the global deployment of a marketing site targeting billions of people) * Remoteness (e.g., your company has branch office locations around the globe) * Your network constraints prevent communication (e.g., your machines in Azure Cloud Services are unable to talk to each other directly) * You don't know the network conditions (e.g., IoT or mobile devices) Yves Goeleven and Sean Feldman show how to overcome such challenges using Azure Service Bus.

Making communications across boundaries simple with NServiceBusParticular Software

MailerqnewpresentationCopernica BV

Asynchronous AMQPRinat Khabibiev

This document summarizes using async AMQP with kombu and gevent. It discusses using queues with AMQP for process synchronization, deferred computations, and slow I/O. It provides an overview of AMQP including brokers, messages, exchanges, queues, and bindings. It then explains how to use kombu and gevent together for asynchronous publishing and consuming of messages. Useful links are also provided for further information.

Introduction to NServiceBusAdam Fyles

This document introduces NServiceBus, an open source service bus for .NET. It discusses why a service bus is useful, describing it as providing fundamental services like messaging for complex architectures. It covers common messaging patterns in NServiceBus like point-to-point, publish/subscribe, and request/response. It also discusses capabilities like scalability, long-running workflows, and handling failures. The key benefits of a service bus are less coupling between services, flexibility, and handling issues like reliability. NServiceBus aims to provide messaging infrastructure while leaving applications to focus on domain logic.

Zebus - Pitfalls of a P2P service busKévin LOVATO

How Postman adopted DockerShamasis Bhattacharya

Работаем с RabbitMQ в Python используя kombu + gevent. (Rinat khabibiev)IT-Доминанта

NServiceBus - introduction to a message based distributed architectureMauro Servienti

This document provides an introduction and overview of NServiceBus, an open source toolkit for building distributed applications using a message-based architecture. It discusses key concepts like messages, components, services, and endpoints. It also demonstrates request/reply and event-based messaging patterns. The document highlights features for handling failures, scaling out to multiple endpoints, and implementing long-running processes through sagas.

Load Balancing with ApacheBradley Holt

This is a presentation made at the Burlington, Vermont PHP Users Group about configuring load balancing using the Apache HTTP Server. Load balancing is a technique that can distribute work across multiple server nodes—here we will discuss load balancing HTTP (i.e. web) traffic. There are many software and hardware load balancing options available including HAProxy, Varnish, Pound, Perlbal, Squid, nginx, and Linux-HA (High-Availability Linux) on Linux Standard Base (LSB). However, many web developers are already familiar with Apache as a web server and it is relatively easy to also configure Apache as a load balancer. Related concepts such as shared nothing architecture are discussed. We also take a look at some basic load balancing scenarios and features including sticky sessions and proxying requests based on HTTP method. Distributed load testing with Tsung is briefly discussed as well.

PAC 2019 virtual Mark TomlinsonNeotys

This document discusses web performance optimization techniques. It is a summary of rules for web performance by Mark Tomlinson, who has 27 years of experience in performance. Some of the key techniques discussed include reducing HTTP requests, optimizing file compression, minimizing code, improving web font and image performance, prefetching resources, avoiding unnecessary redirects, and optimizing infrastructure and databases. The document emphasizes measuring performance through load testing and monitoring to identify bottlenecks.

Containerization - The DevOps RevolutionYulian Slobodyan

Containerization allows for standardized and isolated application deployment across infrastructure through container runtimes like Docker. Key features that enable containers include namespaces which isolate processes and their views of the system, cgroups which control resource usage, and copy-on-write storage for efficient application packaging. A container orchestration system like Mesos provides scalability, fault tolerance, and unified resource management across clusters. This allows maximizing infrastructure utilization through flexible scheduling of containerized applications and services on shared clusters.

3.2 Streaming and Messaging振东刘

Building and Scaling a WebSockets Pubsub SystemKapil Reddy

Ankara Cloud Meetup 6. Etkinlik Scaling Real-Time Messaging on Cloud Sunumuİbrahim Gürses

Ozan Yerli discusses scaling real-time messaging on cloud infrastructure. Some key points: 1) Connected2.me uses open standards like XMPP and keeps the system simple by using DNS load balancing and clustering for scalability. 2) The system is decentralized to eliminate single points of failure and allow infinite scalability. Authentication is decentralized through anonymous client-side nickname generation. 3) Existing services like Amazon S3, Redis, and CloudSearch are used where possible rather than reinventing functionality. This provides automatic scaling. 4) The system is designed to let crashes happen but recover quickly through a supervisor process that maintains health and recovers from failures.

XMPP Academy #2Mickaël Rémond

- Backends in ejabberd are pluggable modules that store data to provide to feature modules. This allows ejabberd to be more stateless. Common backends include Mnesia, MySQL, PostgreSQL, Riak, and custom backends. - Message carbons allow messages to be copied to all connected clients so the full conversation history is visible, but they do not work in MUC rooms due to the anonymous nature of MUC chats. - To learn XMPP, it is best to start at the protocol level by using a client like PSI that allows inspecting and crafting XMPP packets directly rather than starting from libraries that abstract the protocol.

Amazon Cloud OverviewYulian Slobodyan

Amazon Cloud Hands-On provides an overview of Amazon Web Services including Elastic Compute Cloud (EC2) for computing resources, Simple Storage Service (S3) for storage, and Simple Queue Service (SQS) for message queuing. EC2 allows scaling computing power up or down within minutes and starts at 10 cents per hour for 1 EC unit equal to 1.7 GHz x86 processor and 1.7 GB RAM. S3 stores objects up to 5GB in size with SOAP and REST interfaces and affordable pricing, while SQS retains messages for 4 days with a maximum size of 8KB and supports SOAP and queries.

Speed Up WordPress Websites - Part 1 - WordPress Cairo MeetupAhmed Mohammed Nagdy

Speeding up a WordPress site involves optimizing images, using a content delivery network (CDN) to improve load times, selecting fast hosting, and implementing caching. Page speed is important for user experience and retention - users leave sites that take over 4 seconds to load. Optimizing images reduces file sizes while maintaining quality. A CDN stores content on globally distributed servers to deliver pages faster. Caching saves page content for quick retrieval to improve load times.

Ejabberd with xmppPrem Narain

Ejabberd is an open-source XMPP instant messaging server written in Erlang. It is cross-platform, distributed, fault-tolerant, and based on open XMPP standards. Ejabberd supports features like internal and external authentication, virtual hosting, IPv6, and extensions for messaging, presence, file transfers and more. It can be installed on Linux, Windows and other platforms. Basic configuration involves setting up an admin user, hosts, and adding/managing other users.

XMPP Academy #1Mickaël Rémond

This is the slide deck for ProcessOne first live XMPP Academy. Here are the questions covered: 1. ejabberd SaaS architecture questions - What is the best way to archive user messages if we do not want to sync data from user device? - Why does ejabberd SaaS not use async mechanisms for archiving messages to customer back-end server? - Mobile XMPP support: Explain standby, push and detached modes. 2. XMPP / ejabberd questions - How does ejabberd internally store messages which are not yet delivered? - How are privacy lists managed in ejabberd? - What is on the ejabberd roadmap ? OAuth !

Evaluating persistent, replicated message queuesAdam Warski

Scaling PostgreSQL with SkytoolsGavin Roy

This document discusses scaling PostgreSQL databases using open-source tools from Skype including pgBouncer, PGQ, Londiste, and PL/Proxy. It describes how these tools can be used to improve concurrency, add read replicas, replicate data changes, and shard queries across multiple databases. Configuration files and SQL functions are shown as examples of setting up and using these tools to horizontally scale a PostgreSQL deployment.

"High-load is at the intersection of DevOps and PHP development", Fwdays

Let's talk about how software solutions and business needs understanding can make life easier: CQRS-architecture in action. The story of a seamless move to another DC. Cross-DC infrastructure and data processing. Software solutions for cross-DC interaction. Technical details of the transit, methods, and technical stack in terms of software engineering: Mysql (Galera Cluster + StandAlone), RabbitMQ, Cache Warming Strategy, Redis Replication, RabbitMQ-tools.

Apache ActiveMQ - Enterprise messaging in actiondejanb

Introducing envoy-based service mesh at Booking.comIvan Kruglov

Service mesh is a dedicated layer of a company's infrastructure which should simplify communication between services and make it reliable, secure and observable. In this talk, we'll go deep into Booking.com's case study of introducing service mesh. We will discover the reasons and objectives of the project. Why Envoy was selected as the base rather than other available options. Find out what is the setup and features of the homegrown control plane. We will expand on what service is provided for developers and how they safely deploy potentially dangerous configuration changes. Finally, we will talk about pitfalls met along the way.

Micro services infrastructure with AWS and AnsibleBamdad Dashtban

The document summarizes the process of migrating a legacy monolithic codebase to a microservices architecture on AWS using Ansible for configuration management and continuous delivery. Some key points: - The legacy codebase had issues like slow performance, high maintenance costs, and difficulty developing new features. - A strangler pattern was used to gradually introduce microservices in front of the existing monolith. Teams were reorganized around microservices. - AWS services like EC2, ELB, Auto Scaling were used to host the microservices. Ansible provisioned and deployed the services. - Challenges included managing complexity, service discovery, resizing load balancers, deployment time, and keeping Ansible configurations up to

Zingme practice for building scalable website with PHPChau Thanh

This document discusses best practices for building scalable PHP websites, as demonstrated by ZingMe's architecture. It describes how ZingMe uses a scale-out approach with load balancing, centralized session storage, and an automated code deployment system. The key aspects covered are load balancing with HAProxy, overriding PHP's session handling to use Memcached, and configuring servers identically through version control and scripts. The goal is to gracefully handle increasing traffic by adding commodity servers within 5 minutes while maintaining a consistent environment.

ProcessOne Push Platform: XMPP-based Push SolutionsMickaël Rémond

XMPP can provide a flexible and scalable solution for real-time push notifications across devices and platforms. ProcessOne offers an XMPP-based push platform as a service to enable reliable delivery of notifications to users. Case studies demonstrate how the platform supports use cases like radio program updates, social media feeds, and mobile applications. ProcessOne's expertise in XMPP pubsub helps make these services highly scalable and able to support new features over time.

Roy Lenders from Capgemini; Nick Wyss from Panalpina; Chris Saynor from eyef...eyefortransport

Azure Service BusJosh Lane

This document provides an overview of Azure Service Bus and its capabilities for cloud-scale messaging and events. It describes the core components of Service Bus including queues for brokered messaging, topics for publish/subscribe messaging, Relay for enabling communication between private and public clouds, and Event Hubs for high-volume event ingestion. It also outlines common usage scenarios and provides a brief history of distributed systems and messaging technologies to provide context. The document concludes with a demonstration of Service Bus topics and Event Hubs.

More Related Content

What's hot (20)

NServiceBus - introduction to a message based distributed architectureMauro Servienti

Load Balancing with ApacheBradley Holt

PAC 2019 virtual Mark TomlinsonNeotys

Containerization - The DevOps RevolutionYulian Slobodyan

3.2 Streaming and Messaging振东刘

Building and Scaling a WebSockets Pubsub SystemKapil Reddy

Ankara Cloud Meetup 6. Etkinlik Scaling Real-Time Messaging on Cloud Sunumuİbrahim Gürses

XMPP Academy #2Mickaël Rémond

Amazon Cloud OverviewYulian Slobodyan

Speed Up WordPress Websites - Part 1 - WordPress Cairo MeetupAhmed Mohammed Nagdy

Ejabberd with xmppPrem Narain

XMPP Academy #1Mickaël Rémond

Evaluating persistent, replicated message queuesAdam Warski

Scaling PostgreSQL with SkytoolsGavin Roy

"High-load is at the intersection of DevOps and PHP development", Fwdays

Apache ActiveMQ - Enterprise messaging in actiondejanb

Introducing envoy-based service mesh at Booking.comIvan Kruglov

Micro services infrastructure with AWS and AnsibleBamdad Dashtban

Zingme practice for building scalable website with PHPChau Thanh

ProcessOne Push Platform: XMPP-based Push SolutionsMickaël Rémond

NServiceBus - introduction to a message based distributed architectureMauro Servienti

Load Balancing with ApacheBradley Holt

PAC 2019 virtual Mark TomlinsonNeotys

Containerization - The DevOps RevolutionYulian Slobodyan

3.2 Streaming and Messaging振东刘

Building and Scaling a WebSockets Pubsub SystemKapil Reddy

Ankara Cloud Meetup 6. Etkinlik Scaling Real-Time Messaging on Cloud Sunumuİbrahim Gürses

XMPP Academy #2Mickaël Rémond

Amazon Cloud OverviewYulian Slobodyan

Speed Up WordPress Websites - Part 1 - WordPress Cairo MeetupAhmed Mohammed Nagdy

Ejabberd with xmppPrem Narain

XMPP Academy #1Mickaël Rémond

Evaluating persistent, replicated message queuesAdam Warski

Scaling PostgreSQL with SkytoolsGavin Roy

"High-load is at the intersection of DevOps and PHP development", Fwdays

Apache ActiveMQ - Enterprise messaging in actiondejanb

Introducing envoy-based service mesh at Booking.comIvan Kruglov

Micro services infrastructure with AWS and AnsibleBamdad Dashtban

Zingme practice for building scalable website with PHPChau Thanh

ProcessOne Push Platform: XMPP-based Push SolutionsMickaël Rémond

Viewers also liked (10)

Roy Lenders from Capgemini; Nick Wyss from Panalpina; Chris Saynor from eyef...eyefortransport

Azure Service BusJosh Lane

Azure Service Bus OverviewBizTalk360

1 -mr. alain flausch-alf byd-london_01042014Rat Brasov

This document discusses UITP's approach to promoting zero-emission public transportation. It outlines UITP's Bus Committee activities, including its Fuel & Traction Systems Observatory which monitors electric bus technologies. It also describes UITP projects like EBSF that study electrification and the iBS Roadmap for innovative bus systems. A major project is ZeEUS, an EU-funded demonstration of electric buses across 8 cities to evaluate feasibility and support market uptake of zero-emission buses.

Bio Bus Schedule & Feecommsgreenschool

This document provides a schedule and fee structure for shuttle services between Ubud and Canggu to the Green School in Bali. The Ubud route lists pickup and drop off times and locations, with service from 7am to 5:15pm. The Canggu route also lists times and places from 7:10am to 4:30pm. Price options include 800,000IDR for 1 month pass, 250,000IDR for 1 week, 60,000IDR for a day pass, and 30,000IDR for a single one-way trip.

Azure Service Bus for Loosely-Coupled Enterprise Software.Chase Aucoin

Azure Service Bus This discussion aims to be an introduction into building scalable, hybrid cloud/on-prem software. Outline What is a Service Bus: Service Messages Queues Publisher Subscriber Extending Legacy Systems Fault Tolerance Scalability Business Flexibility Reusability Powerful BI Leveraging Event Streams About the speaker: Chase Q. Aucoin is currently a .Net Beam-Lead at VinSolutions and has had over a decade of experience creating fault-tolerant distributed systems for companies such as Fed-Ex and Microsoft.

Calgary azure dev camp - Service Buswearsy

Kent Weare provides an introduction to Microsoft Azure Service Bus. Service Bus enables integration, routing, coordination, and messaging capabilities in the cloud. It includes Service Bus Relay for interconnectivity across network boundaries, queues for decoupled messaging with load balancing and disconnected clients, and topics for publish-subscribe capabilities. The presentation demonstrates usage of Service Bus queues and topics with a scenario of a power generation company updating a dashboard on generator commitments and dispatching via mobile devices.

Microsoft MicroservicesChase Aucoin

Pros And Cons Of Outsourcing Bus OperationsJaspal Singh

Outsourcing Bus Operations - How to make it Financially SustainableValoriser Consultants

Roy Lenders from Capgemini; Nick Wyss from Panalpina; Chris Saynor from eyef...eyefortransport

Azure Service BusJosh Lane

Azure Service Bus OverviewBizTalk360

1 -mr. alain flausch-alf byd-london_01042014Rat Brasov

Bio Bus Schedule & Feecommsgreenschool

Azure Service Bus for Loosely-Coupled Enterprise Software.Chase Aucoin

Calgary azure dev camp - Service Buswearsy

Microsoft MicroservicesChase Aucoin

Pros And Cons Of Outsourcing Bus OperationsJaspal Singh

Outsourcing Bus Operations - How to make it Financially SustainableValoriser Consultants

Similar to Windows Azure Service Bus (20)

Deploying your web application with AWS ElasticBeanstalkJulien SIMON

This document summarizes AWS Elastic Beanstalk, which is a PaaS that allows developers to deploy and manage applications in the AWS cloud. It supports many programming languages and frameworks out of the box. Elastic Beanstalk handles the infrastructure management including provisioning servers, load balancing, auto-scaling and monitoring. Developers can focus on their code without worrying about managing the underlying infrastructure. The document provides an example of deploying a Ruby on Rails application to Elastic Beanstalk and accessing other AWS services.

AWS as platform for scalable applicationsRoman Gomolko

The document describes building a link shortening application called YA.LS using Amazon Web Services. It discusses: 1) Developing the application using Node.js, Express, and other packages and deploying it to AWS Elastic Beanstalk. 2) Storing shortened links and target URLs in DynamoDB and caching them locally. 3) Redirecting requests using the stored URLs. 4) Enhancing it to take screenshots, store them in S3, and record analytics using SQS, Lambda, and Kinesis. 5) Configuring authentication with IAM and deploying the infrastructure with CloudFormation.

Azure Functions @ global azure day 2017Sean Feldman

Scaling GraphQL SubscriptionsАртём Курапов

The document discusses scaling GraphQL subscriptions. It begins by introducing the speaker, Artjom Kurapov, and his background working with GraphQL for the past 3 years. The bulk of the document then discusses how Pipedrive scaled their GraphQL subscriptions to handle over 80GB of traffic per day by implementing a solution using WebSocket transports, Apollo Server, and Redis pub/sub channels to allow subscriptions to scale horizontally across multiple workers. It also covers performance testing showing it can handle over 200 events per second for a single entity type while being deployed across all of Pipedrive's customers.

Node proxyIlya Starostin

Multitenancy: Kafka clusters for everyone at LINEkawamuray

Yuto Kawamura from LINE Corporation presented on their use of Apache Kafka clusters to provide multitenancy for different internal teams. They face challenges in ensuring isolation between client workloads and preventing abusive clients. Their solutions include request quotas to limit client resource usage, slow logs to identify slow requests, and changes to the broker code to pre-warm caches and minimize the impact of disk reads during message fetching. With these approaches, they are able to reliably operate shared Kafka clusters with high throughput and multiple tenants.

Cloud Architecture Tutorial - Running in the Cloud (3of3)Adrian Cockcroft

Windows Azure Zero Downtime UpgradePavel Revenkov

This document compares different approaches for performing zero downtime upgrades of applications hosted on Microsoft Azure: Web Deploy, VIP-swap, load balanced endpoints, and Traffic Manager. Web Deploy allows automatic updates of web roles with minor changes but requires an RDP connection. VIP-swap uses DNS swapping to test upgrades on a staging environment with fast redirection. Load balanced endpoints provides easy scaling but requires manual upgrades and running multiple versions simultaneously. Traffic Manager also uses DNS for isolated testing and fast redirection between environments, but incurs additional costs.

Building big data pipelines with Kafka and KubernetesVenu Ryali

This document discusses setting up a streaming platform using Apache Kafka and Kubernetes. It describes containerizing Kafka and Kafka Streams applications and deploying them on Kubernetes for scalability, fault tolerance, and easy upgrades. It also covers performance tuning of the platform, including optimizations for RocksDB, state stores, and network traffic. Troubleshooting performance issues within containers is discussed, such as installing profiling tools in separate containers. The goal is to provide a modern, scalable platform for data pipelines and microservices.

DB proxy server test: run tests on tens of virtual machines with Jenkins, Vag...Timofey Turenko

The presentation describes CI environment for our product - Maxscale - database proxy server. To test such product we need a setup that consists of tens of machines: locally hosted virtual machines as well as machines from different clouds. All our Jenkins jobs are implemented in the form of Jenkins Job Builder code. Presentations also tells about our tool to manage virtual machines (wrapper over Vagrant)- MDBCI.

Codemotion Rome 2018 Docker Swarm ModeSimone Soldateschi

Run high-available web-application in the Cloud on Docker Swarm Mode. The latest Docker Engine version (1.12+) comes with interesting features that streamline setting-up new cluster and maintenance tasks for Ops. Throughout the talk engineers will learn how to set up a new Docker Swarm cluster, scale in and out and make nodes join and leave cluster in automated fashion. Furthermore single region and multi-region cluster scenarios will be discussed.

Scaling Mapufacture on Amazon Web ServicesAndrew Turner

Building Linux IPv6 DNS Server (Complete Presentation)Hari

This document summarizes a project that implemented IPv6 and enabled cross-platform communication between IPv6 and IPv4 devices. The project involved compiling a new kernel with IPv6 support, setting up a lookup service to register IPv6 clients, configuring DNS to resolve IPv6 and IPv4 names, and testing cross-platform communication between an IPv6 server and IPv4 and IPv6 clients. The conclusion is that the project provides a scalable and secure IPv6 solution to resolve long-term addressing issues and allows communication across different platforms.

NoSQL afternoon in Japan Kumofs & MessagePackSadayuki Furuhashi

Sadayuki Furuhashi created Kumofs, a distributed key-value store, and MessagePack, a cross-language object serialization library. Kumofs is optimized for low latency with zero-hop reads and no single points of failure. It scales out linearly as servers are added without impacting applications. MessagePack is a compact binary format like JSON used for cross-language communication. MessagePack-RPC is a cross-language messaging library that uses an asynchronous, pipelined protocol over an event-driven I/O model.

NoSQL afternoon in Japan kumofs & MessagePackSadayuki Furuhashi

- Sadayuki Furuhashi is a computer science student at the University of Tsukuba who created Kumofs, a distributed key-value store, and MessagePack, a cross-language communication library. - Kumofs is optimized for low-latency and scalability through a consistent hashing algorithm and dynamic rebalancing without impacting applications. It has no single point of failure. - MessagePack is a compact binary serialization format like JSON used for fast cross-language communication. MessagePack-RPC builds on this to enable asynchronous, pipelined RPC between languages.

Extending Piwik At R7.comLeo Lorieri

Fighting Against Chaotically Separated Values with EmbulkSadayuki Furuhashi

The Future is Now: Leveraging the Cloud with RubyRobert Dempsey

Blue host using openstack in a traditional hosting environmentOpenStack Foundation

Using OpenStack in a traditional hosting environment posed scaling challenges that required automating provisioning across multiple data centers. OpenStack was chosen for its open source support, typical cloud features, and ability to transition to a future cloud offering. Bluehost implemented OpenStack across over 10,000 servers, addressing issues like unstable messaging, overloaded MySQL, and premature networking plugins. Solutions involved read-only databases, optimized configurations, and custom scheduler, quantum, and nova components.

Blue host openstacksummit_2013Jun Park

Using OpenStack in a traditional hosting environment posed scaling challenges that required automating provisioning across multiple data centers. OpenStack was chosen for its support, scalability, and ability to support future cloud offerings. Bluehost implemented optimizations like using MySQL slaves, custom schedulers, and replacing Qpid with ZeroMQ to address scalability issues with messaging, databases, and APIs under heavy load. The enhanced OpenStack deployment now supports over 10,000 physical servers being added daily.

Deploying your web application with AWS ElasticBeanstalkJulien SIMON

AWS as platform for scalable applicationsRoman Gomolko

Azure Functions @ global azure day 2017Sean Feldman

Scaling GraphQL SubscriptionsАртём Курапов

Node proxyIlya Starostin

Multitenancy: Kafka clusters for everyone at LINEkawamuray

Cloud Architecture Tutorial - Running in the Cloud (3of3)Adrian Cockcroft

Windows Azure Zero Downtime UpgradePavel Revenkov

Building big data pipelines with Kafka and KubernetesVenu Ryali

DB proxy server test: run tests on tens of virtual machines with Jenkins, Vag...Timofey Turenko

Codemotion Rome 2018 Docker Swarm ModeSimone Soldateschi

Scaling Mapufacture on Amazon Web ServicesAndrew Turner

Building Linux IPv6 DNS Server (Complete Presentation)Hari

NoSQL afternoon in Japan Kumofs & MessagePackSadayuki Furuhashi

NoSQL afternoon in Japan kumofs & MessagePackSadayuki Furuhashi

Extending Piwik At R7.comLeo Lorieri

Fighting Against Chaotically Separated Values with EmbulkSadayuki Furuhashi

The Future is Now: Leveraging the Cloud with RubyRobert Dempsey

Blue host using openstack in a traditional hosting environmentOpenStack Foundation

Blue host openstacksummit_2013Jun Park

More from Pavel Revenkov (17)

Azure Recovery ServicesPavel Revenkov

This document discusses Azure Backup (Recovery Services) and provides an overview of its key concepts and usage scenarios. Azure Backup allows backing up of on-premises servers and virtual machines to Azure storage. It uses storage vaults mapped to Azure Blob storage to store backup recovery points. The Azure Backup Agent installs on machines to perform backups and restores and manage the backup schedule. Site Recovery allows disaster recovery between on-premises and Azure environments, or between two on-premises sites. References and contacts are provided for further information.

Microsoft Azure Media ServicesPavel Revenkov

This document provides an overview of Microsoft Azure Media Services for encoding, packaging and streaming media. It describes Media Services' support for common input/output formats and codecs for video and audio encoding. Tasks define processing instructions for assets containing media files and associated metadata. Jobs coordinate task execution across processors. Streaming can be static via packaged files or dynamic via just-in-time encoding. Pricing is based on data processed and reserved units for parallel tasks or streaming bandwidth.

Windows Azure PowerShell CmdLetsPavel Revenkov

Command line tools like PowerShell, Bash, and Bash allow you to manage Azure resources and perform operations through simple commands and syntax. These tools provide a unified standard to manage resources across platforms using REST APIs under the hood. SDKs act as wrappers that make REST API usage easier from various programming languages, while command line tools allow managing subscriptions, storage accounts, virtual machines, databases, and other resources through intuitive verbs and parameters. PowerShell cmdlets support all typical PowerShell features like variables, indexing, filtering and properties to provide full control and automation capabilities.

IaaS: Windows Azure Virtual MachinesPavel Revenkov

IaaS: Virtual Machines provides an overview of virtual machines on the Microsoft Azure platform. It discusses that virtual machines can be used to deploy various application types like web applications, services, and websites. It also describes the different sizes and configurations of virtual machines available on Azure, including their CPU, memory, disk space allocations. The document outlines key considerations for using virtual machines like storage, availability sets, service level agreements and licensing.

Windows Azure CachingPavel Revenkov

This document discusses caching services available on Windows Azure, including content delivery networks (CDNs) and caching. It describes how CDNs deliver content closer to end users, and caching stores frequently accessed data closer to Azure applications. Caching on Azure can be done through dedicated roles, co-location with applications, or shared caching services. The document outlines characteristics of CDNs like dedicated endpoints and worldwide datacenters. It also provides examples of caching configuration and workflows in Visual Studio and code samples for putting and getting items from the cache.

Windows Azure Active DirectoryPavel Revenkov

Windows Azure Active Directory provides identity and access management in the cloud. It acts as an identity provider and security token service, supporting protocols like WS-Federation, OAuth 2.0 and SAML 2.0. It offers single sign-on for Azure applications, manages users and groups, and can integrate with on-premises Active Directory. Benefits include not needing to implement your own authorization and avoiding single points of failure compared to Active Directory Federation Services.

Windows Azure Versioning StrategiesPavel Revenkov

This document discusses different versioning strategies for cloud services. It presents strategies for versioning production and staging environments, isolating environments for different roles like QA and developers, using separate subscriptions to isolate environments and billing, and approaches for versioning SQL databases and WCF contracts. The key strategies covered include using slots or instances to separate environments, federating SQL databases by tenant or version, and supporting multiple versions of WCF contracts through single or multiple endpoints. References are provided for further reading on managing cloud services, versioning SQL databases, and WCF versioning strategies.

Windows Azure DrivePavel Revenkov

The document discusses Windows Azure Drive, which allows mounting cloud storage as a virtual disk. It provides examples of uploading files to Azure blob storage using page blobs. There are different modes for accessing the drive, including lease mode and snapshot mode. The workflow involves mounting the drive, handling exceptions by remounting from a snapshot, and unmounting. The document compares storage emulators to Azure storage services and provides a reference to learn more about Windows Azure Drive.

SQL AzurePavel Revenkov

This document discusses SQL Azure, Microsoft's relational database service. It describes the logical and physical structure, including that databases are organized at the subscription and server level, and SQL Azure uses sharding across SQL Server instances. Key points are that each database is limited to 150GB in size, there is a built-in firewall, and data is committed using a quorum-based scheme across replicas. Migration options like SSIS and the Generate Script Wizard are also outlined.

Storage ServicesPavel Revenkov

This document provides an overview of Microsoft Azure storage services, including tables, queues, and blobs. It describes the common features like access via REST API and automatic replication. Tables store structured non-relational data with mandatory fields like partition and row keys. Queues provide asynchronous message processing between roles. Blobs support block and page objects at different maximum sizes, stored within containers. Code examples demonstrate retrieving references and contexts for tables, queues, and blobs.

Windows azure startPavel Revenkov

This document provides an overview of application deployment and services on the Windows Azure platform. It discusses deploying applications as virtual machines, web sites, or cloud services running Java, PHP, Linux, or ASP.NET. Tools include the Azure SDK and subscriptions for SQL databases, storage, queues and blobs. The project structure involves web and worker roles. The deployment workflow includes building, packaging, uploading and loading roles to the staging or production environments. References for introductions and step-by-step guides on Azure are also provided.

SQL Azure FederationsPavel Revenkov

SQL Azure Federations allow horizontal scaling of databases in SQL Azure. Federations partition database tables across multiple database servers or shards. Each federation member contains a subset of rows from a table based on the federation key value. The root member contains metadata and global data while federation members provide physical data separation and can have their own schemas. However, federations have limitations such as requiring an INT, BIGINT, UNIQUEIDENTIFIER or VARBINARY distribution key and not supporting NULL values or IDENTITY properties for federated columns.

Windows Azure PowerShell CmdletsPavel Revenkov

This document discusses PowerShell cmdlets for managing cloud resources on Microsoft Azure. It provides an overview of development tools and SDKs for Azure, describes how to use REST APIs and SDKs to manage resources from various devices and platforms. It also outlines several command line tools including PowerShell for Windows, Bash for Linux and Mac, and how they can be used to manage subscriptions, storage accounts, virtual machines, databases and other Azure resources through cmdlets. Syntax examples and references are provided for getting started with the PowerShell cmdlets.

Starting with windows azurePavel Revenkov

Windows Azure Service BusPavel Revenkov

Windows Azure Storage servicesPavel Revenkov

Windows Azure DrivePavel Revenkov

The document discusses Windows Azure Drive, which allows mounting cloud storage as a disk volume. It describes uploading files to Azure blob storage by writing them in pages. It also covers how to work with Azure Drive, including mounting, unmounting, and retrying operations using snapshots if an exception occurs. The drive can be mounted in read-only or read-write modes, and files can be accessed directly as if they were on a local disk.

Azure Recovery ServicesPavel Revenkov

Microsoft Azure Media ServicesPavel Revenkov

Windows Azure PowerShell CmdLetsPavel Revenkov

IaaS: Windows Azure Virtual MachinesPavel Revenkov

Windows Azure CachingPavel Revenkov

Windows Azure Active DirectoryPavel Revenkov

Windows Azure Versioning StrategiesPavel Revenkov

Windows Azure DrivePavel Revenkov

SQL AzurePavel Revenkov

Storage ServicesPavel Revenkov

Windows azure startPavel Revenkov

SQL Azure FederationsPavel Revenkov

Windows Azure PowerShell CmdletsPavel Revenkov

Starting with windows azurePavel Revenkov

Windows Azure Service BusPavel Revenkov

Windows Azure Storage servicesPavel Revenkov

Windows Azure DrivePavel Revenkov

Recently uploaded (20)

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/ HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client. Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience. In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including - Accessing the console - Locating and interpreting log files - Accessing the data folder within the browser’s cache (using OPFS) - Understand the difference between single- and multi-user scenarios - Utilizing Client Clocking

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage