How We Defined Our Own Cloud.pdf

May 19, 20222 likes600 views

This document summarizes Andrew Hajinikitas' work developing Rakuten's private cloud infrastructure. It describes the key components of Rakuten's infrastructure including metal instances, microservers, and GPU servers. It provides details on Rakuten's software stack and their goals to expand managed services. Currently, Rakuten operates 9 data centers in Japan and overseas providing around 30,000 servers to support their ecosystem. Their future plans include extending network self-service, making GPU resources available as a platform service, and improving efficiency through optimized hardware selection.

How We Defined Our Own Cloud
May 19th, 2022
Andrew Hajinikitas
Cloud Platform Department
Rakuten Group, Inc.

2
About Me
Andrew Hajinikitas
Worked in industry over 20+ years! ~ seen a lot of change
and made a a lot of change!
Currently working in Rakuten’s: Cloud platform Department
Core Infrastructure Section as Vice Senior Manager
Started at Rakuten in 2018 as an Architect in Cloud platform
Department - Core Infrastructure – Network Group
Specializing in pipelining automation, infrastructure,
networking, security, and much much more! ! !

3
CONTENTS
1. Some of Rakuten's key infrastructure
2. About the current cloud platform
3. Potential future efforts

4
Metal Instance
A machine is one of fundamental bricks of our Cloud, alongside the network
We’re here providing building blocks Metal
Containers / Hypervisors
Internet projects
Customer projects
One Cloud Services

5
Microservers
Quanta X11C-8N
• Intel Xeon E-2100 system.
• Four DDR4 DIMM slots.
• For storage, each sled has a 2.5” SFF SATA drive bay
• Can use either two M.2 drives or two NF1 drives with the sled.
• Networking is provided by either dual 10GbE or a single 25GbE uplink
Reference Page: https://qct.io/product/index/Server/rackmount-
server/Microserver/QuantaMicro-X11C-8N

6
Internals to a Sled
Reference Page: https://qct.io/product/index/Server/rackmount-server/Microserver/QuantaMicro-X11C-8N

7
GPU Servers
Quanta SYS-420GP-TNAR
• 2x 32 core Intel Xeon 8358 @2.6 Ghz
• 2 Terrabyte of RAM
• 8x A100 - 80 GB NVidia GPU
• 2x 960 GB (OS)
• 4x 3.84 TB (data)
• 8x HDR (200 Gbs, GPU)
• 2x HDR (200 Gbs, CPU)
• 2x 100 Gbs
• 2x 200 Gbs 0.16 PFlops (FP32)
• 1.25 PFlops (FP32+TC) Reference Page:
https://www.supermicro.com/en/products/system/GPU/4U/SYS-420GP-TNAR

10
US EU
9data centers in operation in Japan and overseas
Providing around 30,000servers
• Expansion of new managed services
• Expanding the implementation / use of study sessions for in-house users
LBaaS DBaaS Storage
CaaS Monitoring
JP
Current Status
New Managed Services

11
What’s Coming Up?
• Extension of network self-service
• Making GPU resources a platform service
• Efficiency including DC resources
• Resource-efficient physical equipment selection
according to the usage of each upper service layer
• HW / NW resource management and stable supply
(responding to silicon shortage)
• Network CI / CD (automation of upgrades and
verifications)
未来を想像させる画像

12
What’s Coming Up?
• We have built a full-fledged integrated private cloud
to support the Rakuten ecosystem and have begun
using it in production environments.
• Steer towards managed services and simplify core
infrastructure.
• Providing high-performance physical server /
network resources at low cost.
• Multi-tenant support / Clarify the scope of
responsibility between each platform and user.
• We are promoting the use of Rakuten services not
only in Japan but also overseas, and have already
expanded to 9 DCs in Japan and overseas.
未来を想像させる画像

13
Goal ~ “Manage the Instance Life Cycle from One Dashboard”

Rakuten is a Japanese e-commerce company founded in 1997 with over 9,000 employees worldwide and 50+ online services. To improve efficiency and scalability, Rakuten transitioned its infrastructure to a private cloud model between 2010-2013. This involved virtualizing servers, implementing a 3PAR storage area network, and developing internal cloud management tools. The private cloud successfully supported growth of Rakuten's flagship SuperSale events and allowed for global data center expansion. While technology was crucial, internal support, training, and balancing costs/risks were also important for adoption.

楽天ネットワークエンジニアたちが目指す、次世代データセンターとはRakuten Group, Inc.

PostgreSQLをKubernetes上で活用するためのOperator紹介！（Cloud Native Database Meetup #3 発表資料）NTT DATA Technology & Innovation

Kubernetesによる機械学習基盤への挑戦Preferred Networks

2018年12月4日　Japan Container Days　講演資料谷脇大輔 Preferred Networksでは1000個以上のGPUとInfiniBandからなるオンプレミスのクラスターを自社で構築しており、研究者が様々な目的、リソース量、実行時間の機械学習ジョブをKubernetes上で実行して研究成果を出しています。 KubernetesはKubeflowの登場など、機械学習基盤としても非常に注目されている一方で、現実的には未だ発展途上です。講演では機械学習基盤としてのKubernetesの導入理由、その実用性と将来性、Preferred Networksの挑戦についてお話ししました。

楽天における安全な秘匿情報管理への道のりRakuten Group, Inc.

チームトポロジーから学び、データプラットフォーム組織を考え直した話.pptxRakuten Commerce Tech (Rakuten Group, Inc.)

チームトポロジーというものがあります。コンウェイの法則や認知負荷など様々な要素が組織論にはあり、チームトポロジーはそれらを組み合わせ、組織を設計するためのパターンを教えてくれます。チームが価値創造に集中できるように、チームの役割を明確にし、コミュニケーションをデザインし、ボトルネックを見つけ出す。簡単に聞こえるけど、すごく難しいですよね？発表の中で、カジュアルにチームトポロジーの紹介と自分がどのように利用したかをご紹介します。

Anthos を使ったエンタープライズ向けクラスタの設計とアップグレード戦略のススメ（CloudNative Days Tokyo 2021 発表資料）NTT DATA Technology & Innovation

PGOを用いたPostgreSQL on Kubernetes入門（PostgreSQL Conference Japan 2022 発表資料）NTT DATA Technology & Innovation

Apache Kafkaって本当に大丈夫？～故障検証のオーバービューと興味深い挙動の紹介～NTT DATA OSS Professional Services

今、改めて考えるPostgreSQLプラットフォーム - マルチクラウドとポータビリティ -（PostgreSQL Conference Japan 20...NTT DATA Technology & Innovation

Kubernetesでの性能解析～なんとなく遅いからの脱却～（Kubernetes Meetup Tokyo #33 発表資料）NTT DATA Technology & Innovation

10分でわかる Cilium と XDP / BPFShuji Yamada

[RakutenTechConf2013] [C-1] Rakuten new infrastructureRakuten Group, Inc.

Connectivity for the data centric eraDESMOND YUEN

Intel® Ethernet Series Delivering Real-World Value. As computing and networking scale in performance, interconnect technologies play a critical role in ensuring systems reach their full potential in the speed at which they move data. Intel has been at the forefront of research and development into interconnect technologies since the dawn of the PC era. Today in the data center, Intel is working to deliver greater levels of intelligence within its connectivity solutions to overcome network bottlenecks and accelerate applications. Between PC and peripherals, Intel is heavily involved with the industry as it brings the latest technologies to market for the best user experiences. At the chip level, Intel is leading the industry in advanced packaging with technologies that connect chiplets and modules in order to deliver Moore’s Law advances, while also working to reduce latency between memory and CPU. From “Microns to Miles,” Intel’s investments in interconnect technologies are among the broadest in the industry.

More Related Content

What's hot (20)

Supporting Internal Customers as Technical Account Managers.pdfRakuten Group, Inc.

楽天サービスとインフラ部隊Rakuten Group, Inc.

大規模なリアルタイム監視の導入と展開Rakuten Group, Inc.

楽天市場で使われている技術、エンジニアに必要なコアスキルとはTechnology used in Rakuten, core skills neede...Rakuten Group, Inc.

Travel & Leisure Platform Department's tech infoRakuten Group, Inc.

Rakuten PlatformRakuten Group, Inc.

社内エンジニアを支えるテクニカルアカウントマネージャーRakuten Group, Inc.

楽天における大規模データベースの運用Rakuten Group, Inc.

Rakuten's Private CloudRakuten Group, Inc.

楽天ネットワークエンジニアたちが目指す、次世代データセンターとはRakuten Group, Inc.

PostgreSQLをKubernetes上で活用するためのOperator紹介！（Cloud Native Database Meetup #3 発表資料）NTT DATA Technology & Innovation

Kubernetesによる機械学習基盤への挑戦Preferred Networks

楽天における安全な秘匿情報管理への道のりRakuten Group, Inc.

チームトポロジーから学び、データプラットフォーム組織を考え直した話.pptxRakuten Commerce Tech (Rakuten Group, Inc.)

Anthos を使ったエンタープライズ向けクラスタの設計とアップグレード戦略のススメ（CloudNative Days Tokyo 2021 発表資料）NTT DATA Technology & Innovation

PGOを用いたPostgreSQL on Kubernetes入門（PostgreSQL Conference Japan 2022 発表資料）NTT DATA Technology & Innovation

Apache Kafkaって本当に大丈夫？～故障検証のオーバービューと興味深い挙動の紹介～NTT DATA OSS Professional Services

今、改めて考えるPostgreSQLプラットフォーム - マルチクラウドとポータビリティ -（PostgreSQL Conference Japan 20...NTT DATA Technology & Innovation

Kubernetesでの性能解析～なんとなく遅いからの脱却～（Kubernetes Meetup Tokyo #33 発表資料）NTT DATA Technology & Innovation

10分でわかる Cilium と XDP / BPFShuji Yamada

Supporting Internal Customers as Technical Account Managers.pdfRakuten Group, Inc.

楽天サービスとインフラ部隊Rakuten Group, Inc.

大規模なリアルタイム監視の導入と展開Rakuten Group, Inc.

楽天市場で使われている技術、エンジニアに必要なコアスキルとはTechnology used in Rakuten, core skills neede...Rakuten Group, Inc.

Travel & Leisure Platform Department's tech infoRakuten Group, Inc.

Rakuten PlatformRakuten Group, Inc.

社内エンジニアを支えるテクニカルアカウントマネージャーRakuten Group, Inc.

楽天における大規模データベースの運用Rakuten Group, Inc.

Rakuten's Private CloudRakuten Group, Inc.

楽天ネットワークエンジニアたちが目指す、次世代データセンターとはRakuten Group, Inc.

PostgreSQLをKubernetes上で活用するためのOperator紹介！（Cloud Native Database Meetup #3 発表資料）NTT DATA Technology & Innovation

Kubernetesによる機械学習基盤への挑戦Preferred Networks

楽天における安全な秘匿情報管理への道のりRakuten Group, Inc.

チームトポロジーから学び、データプラットフォーム組織を考え直した話.pptxRakuten Commerce Tech (Rakuten Group, Inc.)

Anthos を使ったエンタープライズ向けクラスタの設計とアップグレード戦略のススメ（CloudNative Days Tokyo 2021 発表資料）NTT DATA Technology & Innovation

PGOを用いたPostgreSQL on Kubernetes入門（PostgreSQL Conference Japan 2022 発表資料）NTT DATA Technology & Innovation

Apache Kafkaって本当に大丈夫？～故障検証のオーバービューと興味深い挙動の紹介～NTT DATA OSS Professional Services

今、改めて考えるPostgreSQLプラットフォーム - マルチクラウドとポータビリティ -（PostgreSQL Conference Japan 20...NTT DATA Technology & Innovation

Kubernetesでの性能解析～なんとなく遅いからの脱却～（Kubernetes Meetup Tokyo #33 発表資料）NTT DATA Technology & Innovation

10分でわかる Cilium と XDP / BPFShuji Yamada

Similar to How We Defined Our Own Cloud.pdf (20)

[RakutenTechConf2013] [C-1] Rakuten new infrastructureRakuten Group, Inc.

Connectivity for the data centric eraDESMOND YUEN

Optimize Content Delivery with Multi-Access Edge ComputingRebekah Rodriguez

Edge applications today require strong networks and connections to core data center products. Supermicro’s Twin systems deliver performance from the edge to the core or cloud data center and leverage our latest content delivery network (CDN) technologies. Join this webinar to learn about the different Supermicro CDN technologies that support Edge Computing based on 3GPP standards and have proven successful for our customers. Product experts will also discuss the importance of an elastic CDN to optimize the availability of resources for low-latency and high-bandwidth applications and share an introduction to our new GrandTwin® server.

Cisco Connect Toronto 2017 - UCS and Hyperflex updateCisco Canada

Cisco Connect Toronto 2017 covered updates on Cisco UCS and Hyperflex. Cisco UCS continues gaining customers with over 60,000 and growing, handling over 1 exabyte of total storage deployed. The presentation introduced the new UCS M5 portfolio and detailed the UCS S3260 modular platform and UCS GPU portfolio. Hyperflex was also discussed, highlighting its complete hyperconvergence, next generation data management, and future ready architecture.

Mellanox's Technological AdvantageMellanox Technologies

Mellanox's Chief Technology Officer Michael Kagan presented on Mellanox's technological advantage and roadmap. He discussed how the volume of data is growing exponentially and will reach 20 zettabytes by 2020. Mellanox is addressing this growth through innovations in high-speed interconnects like InfiniBand that use RDMA to provide high bandwidth and low latency connectivity for data centers and cloud computing. Mellanox has also achieved a strong track record of executing on its product roadmap over the past 15 years to deliver successive generations of InfiniBand and Ethernet adapters, switches, and software.

Consumption Based On-Demand Private Cloud in a BoxRebekah Rodriguez

Introducing the new On-Demand Private Cloud. Supermicro and InMotion Hosting joined forces to design a Data Center POD solution that allows data centers to take control of their cloud costs by lowering the total cost per VM. This all-in-one solution consisting of small hyper-converged building blocks, are built for your business to achieve significant on-demand flexibility and scalability. Utilizing a consumption based model eliminates multiple vendors by consolidating hardware, software, networking, management, and administration enabling your data center to grow and shrink based on your business’ needs. Bring your business to the next level with an On-Demand Private Cloud, let it help you achieve greater profitability by eliminating overpriced inflated, high-cost licensing fees. This streamlined model removes overpriced licensing fees, and enables you to increase profits while reducing overhead costs. This On-Demand Private Cloud solution is built with Supermicro’s green, power efficient and high density, compute servers; OpenStack’s open-source software, and Ceph’s object, file, and block storage. Join this webinar to hear industry experts from InMotion Hosting and Supermicro discuss: - Building your next-generation data center infrastructure - Enables private data centers with validated solutions from Supermicro and InMotion - Hosting to improve operational efficiency - Reach new segments with Kubernetes, Machine Learning, and Artificial Intelligence - Achieve on-demand cloud computing, high availability, data redundancy, and flexibility - Take control of your cloud costs and lower your total cost of ownership - Hyper-dense hardware enables economies of scale for power, cooling, and physical space

Rendering in the CloudBenjamin Shrive

Softlayer began in 2005 and was acquired by IBM in 2013. It provides cloud computing infrastructure including IaaS, PaaS and SaaS. Rendering animation requires huge computing resources and time. Rendering a single animated film can require 300+ artists, 17,000+ CPU cores, 75 million CPU hours and 500 million digital files. Keeping resources on-premises to render films can cost millions whereas cloud infrastructure from Softlayer provides scalable resources more cost effectively. While security and cost concerns still hold the media industry back from fully adopting the cloud, its popularity for rendering is projected to grow to 88% within a year and 60% within 5 years.

Cisco connect winnipeg 2018 compute infrastructure for a hybrid cloudCisco Canada

This document discusses compute infrastructure for hybrid clouds and Cisco's Unified Computing System (UCS). It provides an overview of the Cisco UCS portfolio including the UCS M5 servers and fabric interconnects. It also covers Cisco HyperFlex systems, a hyperconverged infrastructure solution, and its benefits such as operational simplicity, resource efficiency, and workload scaling. The document positions Cisco solutions as the foundation for integrated and hyperconverged infrastructures.

Introduction to HPC & Supercomputing in AITyrone Systems

Db2 analytics accelerator on ibm integrated analytics system technical over...Daniel Martin

High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez

The Supermicro Cloud DC is the perfect combination of performance, reliability, craftsmanship and flexibility for deploying MinIO object storage. MinIO on the Cloud DC platform outperforms and is more cost-effective than equivalently-sized hardware from other manufacturers. We recently benchmarked a cluster of four Cloud DC servers with NVMe drives and measured an impressive 42.57 GB/s average read (GET) throughput and 24.69 GB/s average write (PUT) throughput. This first class performance demonstrates that MinIO on Supermicro Cloud DC is a compelling solution for object storage intensive workloads such as advanced analytics, AI/ML and other modern, cloud-native applications. In this webinar, you will learn: Best use cases and deployment considerations for MinIO object storage How to design and size a MinIO object storage cluster on Supermicro Cloud DC How to deploy a distributed MinIO cluster onto a Cloud DC server cluster Watch the Webinar: https://www.brighttalk.com/webcast/17278/519401

Disaggregation a Primer: Optimizing design for Edge Cloud & Bare Metal applic...Netronome

From the Infra//Structure Conference May 2019 by Ron Renwick of Netronome Disaggregation a Primer: Optimizing design for Edge Cloud & Bare Metal applications Hyperscalers and Edge Cloud providers have recognized economic value of disaggregated infrastructure. Netronome Agilio SmartNICs enable disaggregated architectures to perform with up to 30x lower tail latency while encrypting every session using KTLS security.

CSCfi Computing Services 12/2014Olli-Pekka Lehto

The document discusses CSC's high performance computing capabilities and developments from 2012-2014. It summarizes that CSC upgraded its Sisu and Taito systems in 2014 with new Intel Haswell CPUs, increasing cores by 50% and reducing energy usage. The upgrades boosted Sisu's performance to 1700 TFlops, making it the 37th most powerful system in the world. CSC now provides a total of 2.54 PFlops of computing power and is the most powerful academic computing facility in the Nordic countries.

Proposal FinishedTrevor Moon

Building Efficient Edge Nodes for Content Delivery NetworksRebekah Rodriguez

Supermicro, Intel®, and Varnish are delivering an optimized CDN solution built with the Intel Xeon-D processor in a Supermicro Superserver running Varnish Enterprise. This solution delivers strong performance in a compact form factor with low idle power and excellent performance per watt. Join Supermicro, Intel, and Varnish experts as they discuss their collaboration and how their respective technologies work together to improve the performance and lower the TCO of an edge caching server.

Compute Infrastructure for Hybrid CloudCisco Canada

The document discusses Cisco's compute infrastructure solutions for hybrid cloud environments, including the Cisco Unified Computing System (UCS) and Cisco HyperFlex hyperconverged infrastructure solutions. It provides an overview of the new UCS M5 blade and rack servers featuring dual Intel Skylake processors with support for GPUs. It also summarizes Cisco HyperFlex systems which provide complete hyperconvergence with a next generation data platform and future-ready architecture.

Compute Infrastructure for a Hybrid CloudCisco Canada

The document discusses Cisco's compute infrastructure solutions for hybrid cloud environments, including the Cisco Unified Computing System (UCS) and Cisco HyperFlex hyperconverged infrastructure system. It provides an overview of Cisco's UCS portfolio including the new fifth generation UCS M5 servers and fabric interconnects. It also summarizes Cisco HyperFlex and its capabilities such as independent scaling of compute and storage capacity, and all-flash configurations that deliver up to 6 times the input/output operations per second and 1/5 the latency of hybrid configurations.

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc

Webinar Session - https://youtu.be/_5MfGMf8PG4 In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance. We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.

Microsofts Configurable CloudChris Genazzio

Microsoft's Production Configurable Cloud leverages FPGAs and a programmable infrastructure to provide accelerated computing capabilities. Key aspects include: - Using FPGAs on servers and smartNICs to accelerate networking, storage, security and other functions through reconfigurable hardware. - Developing a pod architecture that connects multiple FPGAs within a rack for low-latency sharing of resources. - Creating a programmable "configurable cloud" infrastructure that allows workloads to be accelerated locally, through infrastructure enhancements, or remotely on other servers' FPGAs. - Early FPGA applications provided significant query latency and throughput improvements for Bing search functions. The approach is now used broadly in

Cisco connect montreal 2018 compute v finalCisco Canada

[RakutenTechConf2013] [C-1] Rakuten new infrastructureRakuten Group, Inc.

Connectivity for the data centric eraDESMOND YUEN

Optimize Content Delivery with Multi-Access Edge ComputingRebekah Rodriguez

Cisco Connect Toronto 2017 - UCS and Hyperflex updateCisco Canada

Mellanox's Technological AdvantageMellanox Technologies

Consumption Based On-Demand Private Cloud in a BoxRebekah Rodriguez

Rendering in the CloudBenjamin Shrive

Cisco connect winnipeg 2018 compute infrastructure for a hybrid cloudCisco Canada

Introduction to HPC & Supercomputing in AITyrone Systems

Db2 analytics accelerator on ibm integrated analytics system technical over...Daniel Martin

High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez

Disaggregation a Primer: Optimizing design for Edge Cloud & Bare Metal applic...Netronome

CSCfi Computing Services 12/2014Olli-Pekka Lehto

Proposal FinishedTrevor Moon

Building Efficient Edge Nodes for Content Delivery NetworksRebekah Rodriguez

Compute Infrastructure for Hybrid CloudCisco Canada

Compute Infrastructure for a Hybrid CloudCisco Canada

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc

Microsofts Configurable CloudChris Genazzio

Cisco connect montreal 2018 compute v finalCisco Canada

More from Rakuten Group, Inc. (14)

EPSS （Exploit Prediction Scoring System）モニタリングツールの開発Rakuten Group, Inc.

EPSS（Exploit Prediction Scoring System）は、FIRST が管理・運用する脆弱性が実際に悪用される可能性を予測するスコアリングシステムです。脆弱性管理における優先順位をつける際の指標の１つとして注目されていますが、継続的にモニタリングを行う方法に課題を感じていました。この課題を解決するためのスクリプトを AI アシスタント (Rakuten AI) との共同開発しました。このプレゼンは開発過程について紹介し、実際の適用例、今後の改善点についてご紹介しています。

コードレビュー改善のためにJenkinsとIntelliJ IDEAのプラグインを自作してみた話Rakuten Group, Inc.

CI/CDツールであるJenkinsとIDEであるIntelliJ IDEA。両者の共通点は、Javaで書かれている点と、プラグインによって機能を拡張できる点です。つまり、Javaを用いてプラグインを実装することで、自分が欲しい機能を追加することができます。本セッションでは、コードレビュープロセスを改善するためにJenkinsとIntelliJ IDEAのプラグインを自作した経験を踏まえて、実装方法に触れつつ、得られた結果や苦労した点について話します。

What Makes Software Green?Rakuten Group, Inc.

This document discusses how to make software more green and environmentally friendly. It defines green software as software that is carbon efficient, energy efficient, hardware efficient, and carbon aware. It provides recommendations for various roles within an organization on driving green initiatives, including focusing on efficiency for CxOs, architects, infrastructure engineers, and developers. Examples include optimizing resource usage, using public clouds effectively, prioritizing equipment standardization, and developing applications that can run more efficiently.

Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product At...Rakuten Group, Inc.

The document proposes a knowledge-driven query expansion approach for question answering (QA)-based product attribute extraction. It trains QA models using attribute-value pairs from training data as knowledge, while mimicking imperfect knowledge at test time through techniques like knowledge dropout and token mixing. This helps induce better query representations, especially for rare and ambiguous attributes. Experiments on a cleaned product attribute dataset show the proposed approach with all techniques outperforms baseline methods in both macro and micro F1 scores.

DataSkillCultureを浸透させる楽天の取り組みRakuten Group, Inc.

Travel & Leisure Platform Department's tech infoRakuten Group, Inc.

The document discusses the Travel & Leisure Platform Dept and its responsibilities related to data and platform management. It provides an overview of the technical stack including private/public clouds, databases, containers, and automation/monitoring tools. It then discusses recent projects involving business continuity, containerization, alert integration, and automation. Finally, it describes open roles for a DBA and DevOps position and their responsibilities related to database provisioning, backup/recovery, infrastructure as code, and providing platforms and tools for developers.

OWASPTop10_IntroductionRakuten Group, Inc.

Introduction of GORA API Group technologyRakuten Group, Inc.

Gora API Group technology provides a microservices architecture and APIs for Rakuten's golf course reservation system, improving the user experience and increasing customer loyalty and annual golf rounds. The architecture migrates the monolithic reservation system to microservices using Kotlin, Spring Boot, and other technologies, exposing APIs for the frontend and new products while sustaining the legacy system through services, queues, continuous delivery, and operations monitoring.

Kafka & Hadoop in RakutenRakuten Group, Inc.

Unclouding Container ChallengesRakuten Group, Inc.

Functional Programming in Pattern-Match-Oriented Programming Style <Programmi...Rakuten Group, Inc.

The document discusses pattern-match-oriented programming (PMOP) using the Egison programming language. PMOP aims to clarify programming with patterns by showing examples that confine explicit recursions in patterns. The key features of Egison that enable PMOP include non-linear pattern matching with multiple results, polymorphic patterns via matchers, and built-in patterns like loop patterns. The document presents several PMOP design patterns like join-cons patterns for lists, cons patterns for multisets, and tuple patterns for comparing multiple data. Examples demonstrate using patterns to define functions like map, intersection, and difference.

アジャイル開発とメトリクスRakuten Group, Inc.

近年日本のソフトウェア開発チームでも取り入れられるようになったアジャイル/DevOps開発では,今まで主流であったウォーターフォール開発と異なり,短い開発サイクルの中で小刻みなフィードバックループと改善活動を繰り返しながら開発する特徴がある.そのため,品質保証や信頼性でのメトリクス活用においても,メトリクスにもとづいたQAテストを実施することは依然重要であるが,それに加え開発から運用までの一連のプロセスの中でプロダクトとプロセスの品質を見える化し継続的な改善活動を促進するフィードバックを提供することがアジャイル開発では求められる.また、DevOps開発では本番稼働中のシステムについてもレジリエンスの枠組みで障害やバグに関するフィードバックを獲得し継続的に学習する.本講演ではアジャイル /DevOps の品質保証と信頼性におけるメトリクス活用の方法について事例も交えながら紹介する.

AR/SLAM and IoTRakuten Group, Inc.

Introduction of Rakuten Commerce QA Night#2Rakuten Group, Inc.

This document provides an overview of a QA Night event hosted by Rakuten's Service Quality Assurance Group. It includes an introduction to the event as well as an agenda with times and speakers. The agenda focuses on utilizing data from the software testing life cycle (STLC) for various purposes like process improvement, automation frameworks, and reporting to stakeholders. Speakers will provide case studies and examples of how they apply STLC data. The event aims to discuss best practices for collecting, utilizing, and improving the use of testing data throughout the software development life cycle at Rakuten.

EPSS （Exploit Prediction Scoring System）モニタリングツールの開発Rakuten Group, Inc.

コードレビュー改善のためにJenkinsとIntelliJ IDEAのプラグインを自作してみた話Rakuten Group, Inc.

What Makes Software Green?Rakuten Group, Inc.

Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product At...Rakuten Group, Inc.

DataSkillCultureを浸透させる楽天の取り組みRakuten Group, Inc.

Travel & Leisure Platform Department's tech infoRakuten Group, Inc.

OWASPTop10_IntroductionRakuten Group, Inc.

Introduction of GORA API Group technologyRakuten Group, Inc.

Kafka & Hadoop in RakutenRakuten Group, Inc.

Unclouding Container ChallengesRakuten Group, Inc.

Functional Programming in Pattern-Match-Oriented Programming Style <Programmi...Rakuten Group, Inc.

アジャイル開発とメトリクスRakuten Group, Inc.

AR/SLAM and IoTRakuten Group, Inc.

Introduction of Rakuten Commerce QA Night#2Rakuten Group, Inc.

Recently uploaded (20)

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Splunk Security Update | Public Sector Summit Germany 2025Splunk

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Build Your Own Copilot & Agents For DevsBrian McKeiver

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Splunk Security Update | Public Sector Summit Germany 2025Splunk

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Build Your Own Copilot & Agents For DevsBrian McKeiver

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

How Can I use the AI Hype in my Business Context?Daniel Lehner

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Mobile App Development Company in Saudi ArabiaSteve Jonas

How analogue intelligence complements AIPaul Rowe

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

How We Defined Our Own Cloud.pdf

1. How We Defined Our Own Cloud May 19th, 2022 Andrew Hajinikitas Cloud Platform Department Rakuten Group, Inc.

2. 2 About Me Andrew Hajinikitas Worked in industry over 20+ years! ~ seen a lot of change and made a a lot of change! Currently working in Rakuten’s: Cloud platform Department Core Infrastructure Section as Vice Senior Manager Started at Rakuten in 2018 as an Architect in Cloud platform Department - Core Infrastructure – Network Group Specializing in pipelining automation, infrastructure, networking, security, and much much more! ! !

3. 3 CONTENTS 1. Some of Rakuten's key infrastructure 2. About the current cloud platform 3. Potential future efforts

4. 4 Metal Instance A machine is one of fundamental bricks of our Cloud, alongside the network We’re here providing building blocks Metal Containers / Hypervisors Internet projects Customer projects One Cloud Services

5. 5 Microservers Quanta X11C-8N • Intel Xeon E-2100 system. • Four DDR4 DIMM slots. • For storage, each sled has a 2.5” SFF SATA drive bay • Can use either two M.2 drives or two NF1 drives with the sled. • Networking is provided by either dual 10GbE or a single 25GbE uplink Reference Page: https://qct.io/product/index/Server/rackmount- server/Microserver/QuantaMicro-X11C-8N

6. 6 Internals to a Sled Reference Page: https://qct.io/product/index/Server/rackmount-server/Microserver/QuantaMicro-X11C-8N

7. 7 GPU Servers Quanta SYS-420GP-TNAR • 2x 32 core Intel Xeon 8358 @2.6 Ghz • 2 Terrabyte of RAM • 8x A100 - 80 GB NVidia GPU • 2x 960 GB (OS) • 4x 3.84 TB (data) • 8x HDR (200 Gbs, GPU) • 2x HDR (200 Gbs, CPU) • 2x 100 Gbs • 2x 200 Gbs 0.16 PFlops (FP32) • 1.25 PFlops (FP32+TC) Reference Page: https://www.supermicro.com/en/products/system/GPU/4U/SYS-420GP-TNAR

8. 8 GPU Servers

9. 9 Software Tech Stack

10. 10 US EU 9data centers in operation in Japan and overseas Providing around 30,000servers • Expansion of new managed services • Expanding the implementation / use of study sessions for in-house users LBaaS DBaaS Storage CaaS Monitoring JP Current Status New Managed Services

11. 11 What’s Coming Up? • Extension of network self-service • Making GPU resources a platform service • Efficiency including DC resources • Resource-efficient physical equipment selection according to the usage of each upper service layer • HW / NW resource management and stable supply (responding to silicon shortage) • Network CI / CD (automation of upgrades and verifications) 未来を想像させる画像

12. 12 What’s Coming Up? • We have built a full-fledged integrated private cloud to support the Rakuten ecosystem and have begun using it in production environments. • Steer towards managed services and simplify core infrastructure. • Providing high-performance physical server / network resources at low cost. • Multi-tenant support / Clarify the scope of responsibility between each platform and user. • We are promoting the use of Rakuten services not only in Japan but also overseas, and have already expanded to 9 DCs in Japan and overseas. 未来を想像させる画像

13. 13 Goal ~ “Manage the Instance Life Cycle from One Dashboard”

How We Defined Our Own Cloud.pdf

Recommended

More Related Content

What's hot (20)

Similar to How We Defined Our Own Cloud.pdf (20)

More from Rakuten Group, Inc. (14)

Recently uploaded (20)

How We Defined Our Own Cloud.pdf