SlideShare a Scribd company logo
Nise BOSH In Action
Iwasaki Yudai @i_yudai
NTT Software Innovation Center
2013-04-26
Installing cf-release jobs with Nise BOSH
– What’s cf-release?
– What’s Nise BOSH?
– How to use
DEA/NG and CCv1 compatibility
– How to revert BuildPack support
Agenda
Installing cf-release jobs with Nise BOSH
 Preconfigured CF source code set
– For installation with BOSH
– Well-tested by many users
– Portable
• Minimum dependencies on apt packages
• Including mysqlclient, imagemagick and so on...
What’s cf-release?
Tool chain for distributed systems
– Release engineering
– Lifecycle management
– Works with IaaS layers (CPI)
• AWS, vSphere, vCloud and OpenStack
What’s BOSH?
(c) EMC & VMware
http://docs.cloudfoundry.com/docs/running/bosh/
Photo by yeowatzup from http://www.flickr.com/photos/yeowatzup/173818958/
Heavybut worth trying
A lightweight BOSH (nearly) emulator
– Works on a local machine
– Without any CPI
What’s Nise BOSH
https://github.com/nttlabs/nise_bosh
./bin/init
– Stemcell-like environment builder
./bin/nise-bosh
– Package installer
./bin/run-job
– Job launcher
Main Three Scripts
VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent
Sets up Stemcell-like environment
– Installs apt packages, create users and so on...
Ported from Stemcell Builder stages
– https://github.com/cloudfoundry/bosh/tree/master/stemcell_builder/
./bin/init
Stemcell ≈ OS + bosh_agent + α
= Basic VM image
VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent
Installs packages and job templates
– Automatically resolving dependencies
– Running packaging scripts
– Filling templates with deploy manifest
./bin/nise-bosh
Packages:
• References to source code
• Packaging(installer) scripts
Job templates:
• Package list
• Configuration file/Control script/monitrc templates VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent
Job launcher
– Reads monitrc file from job templates
• Resolving task dependencies
– start/stop/status
./bin/run-job
Entry on Cloud Foundry.com
– http://blog.cloudfoundry.com/2013/04/15/ntt-contributes-nise-bosh-a-tool-to-speed-up-bosh-development/
README.md
How To Use
Ubuntu 10.04 64bit
– Recommended for cf-release
Example: Installing dea_next (1)
sudo apt-get install git-core
# Clone Nise BOSH and initialize the environment
git clone https://github.com/nttlabs/nise_bosh.git
cd nise_bosh
sudo ./bin/init
sudo reboot
# Install ruby with rbenv
cd ~
git clone git://github.com/sstephenson/rbenv.git ~/.rbenv
echo 'export PATH="$HOME/.rbenv/bin:$PATH"' >> ~/.bash_profile
echo 'eval "$(rbenv init -)"' >> ~/.bash_profile
exec $SHELL –l
git clone https://github.com/sstephenson/ruby-build.git ~/.rbenv/plugins/ruby-build
rbenv install 1.9.3-p327
rbenv global 1.9.3-p327
# Install required gems
gem install bundler
gem install bosh_cli
rbenv rehash
Ubuntu 10.04 64bit is recommended for cf-release
Generating package archives
– `bosh craete release` creates pre-
packaged tar files in .dev_builds
Example: Installing dea_next (2)
# Clone cf-release
git clone https://github.com/cloudfoundry/cf-release.git
cd cf-release
./update # check out submodules
# Create release packages
bosh create release –force # give ‘appcloud’ for the prompt
Deployment manifest
– Compatible with BOSH
Example: Install dea_next (3)
vi ~/deploy.conf
---
properties:
domain: vcap.me
networks:
apps: default
management: default
nats:
user: nats
password: nats
address: 127.0.0.1
port: 4222
dea_next:
streaming_timeout: 60
memory_mb: 4096
memory_overcommit_factor: 1
disk_mb: 32000
disk_overcommit_factor: 1
num_instances: 30
Installing dea_next job template
Example: Installing dea_next (4)
cd ~/nise_bosh
sudo env PATH=$PATH bundle install
sudo env PATH=$PATH bundle exec ./bin/nise-bosh ~/cf-release ~/deploy.conf
dea_next
Launching processes
Example: Installing dea_next (5)
sudo env PATH=$PATH bundle exec ./bin/run-job start
./bin/nise-bosh has some options
– See README.md
DEA/NG and CCv1 compatibility
2013-04-26
Photo from http://pdphoto.org/PictureDetail.php?mat=pdef&pg=8344
CCv1
DEA/NG
Stager
Impact of Buildpack
The Commitment
https://github.com/cloudfoundry/dea_ng/commit/169f2c7b9137196f3f6e2dac291417395aeba310
Rest In Peace CCv1
Reverted and works
– https://github.com/yudai/dea_ng/commit/ccce77553deff7cfc9b5
a6191e12046207a42ced
– Copy runtimes from CCv1
• ~/cloudfoundry/.deployments
• Removed from cf-release
• https://github.com/cloudfoundry/cf-release/commit/82984735556f931caacf010cf7b52a59032c401f
– Disable integrated Stager
– Add runtimes in config file
The Return of CCv1

More Related Content

PDF
Building and Customizing CoreOS
PPTX
DevOps Practices: Configuration as Code
PDF
이미지 기반의 배포 패러다임 Immutable infrastructure
PDF
Install openstack
PPTX
Archlinux dev environment
PDF
CoreOS + Kubernetes @ All Things Open 2015
PDF
Launching containers with fleet
PDF
Robert collins openstack on openstack 201304162
Building and Customizing CoreOS
DevOps Practices: Configuration as Code
이미지 기반의 배포 패러다임 Immutable infrastructure
Install openstack
Archlinux dev environment
CoreOS + Kubernetes @ All Things Open 2015
Launching containers with fleet
Robert collins openstack on openstack 201304162

What's hot (20)

PDF
Deploying with Super Cow Powers (Hosting your own APT repository with reprepro)
ODP
Aloofix
PDF
XPDS13: Xenserver-core: What it is, how it is built and how to get involved -...
PDF
Mesos DC/OS on opensuse
PPTX
CentOS Virt SIG - Community virtualization packages on an immutable core
TXT
Ftp configuration
PDF
Install and Configure Ubuntu for Hadoop Installation for beginners
PDF
recent CF repositories
PPTX
AWS 기반 Docker, Kubernetes
PPTX
How to manage Microsoft Azure with open source
PDF
Using Capifony for Symfony apps deployment (updated)
PDF
Deploying to Ubuntu on Linode
PDF
Docker puppetcamp london 2013
PDF
Wocker @WordBench Osaka No.41
PDF
Getting instantly up and running with Docker and Symfony
PDF
Introduction to FreeNAS development by John Hixson
PDF
Cobbler, Func and Puppet: Tools for Large Scale Environments
PDF
What's new in SUSE Studio land
PDF
My First BCC
PDF
Automating Kubernetes Environments with Ansible
Deploying with Super Cow Powers (Hosting your own APT repository with reprepro)
Aloofix
XPDS13: Xenserver-core: What it is, how it is built and how to get involved -...
Mesos DC/OS on opensuse
CentOS Virt SIG - Community virtualization packages on an immutable core
Ftp configuration
Install and Configure Ubuntu for Hadoop Installation for beginners
recent CF repositories
AWS 기반 Docker, Kubernetes
How to manage Microsoft Azure with open source
Using Capifony for Symfony apps deployment (updated)
Deploying to Ubuntu on Linode
Docker puppetcamp london 2013
Wocker @WordBench Osaka No.41
Getting instantly up and running with Docker and Symfony
Introduction to FreeNAS development by John Hixson
Cobbler, Func and Puppet: Tools for Large Scale Environments
What's new in SUSE Studio land
My First BCC
Automating Kubernetes Environments with Ansible
Ad

Viewers also liked (19)

PDF
Cloud Foundry Admin UI v2を使ってみた
PDF
Pivotal Web Services - a Real World Example of Running Cloud Foundry at Scale...
PDF
Epm fm-1111x-provisioning-whitepape-133674
PPT
Connect and combine
PPT
Marks Sattin Accounting Sector Market Research Presentation - Sydney
PPTX
PPTX
The marketing benefits of e-cigarettes: a tobacco industry perspective
PDF
Customer Bulletin 0515 A Comparison of ISO ISO-C1 and HT-300
PPT
Helmet verkkoon hankekoulu_vuosikello
PDF
めんどうくさくないWardenハンズオン
PPTX
Material necessari per a fer un hort urbà
PPTX
Social media + Local Search - Liana Evans- Digitizing
PDF
Master Strokes
PPTX
Workle presentation june 2012
PPT
פסיכיאטריה קהילתית 2
PDF
Online smart investor courses
PDF
Co-Op/MDF Whitepaper by Computer Market Research
PDF
News Flash - March 2013 - abm & associates
Cloud Foundry Admin UI v2を使ってみた
Pivotal Web Services - a Real World Example of Running Cloud Foundry at Scale...
Epm fm-1111x-provisioning-whitepape-133674
Connect and combine
Marks Sattin Accounting Sector Market Research Presentation - Sydney
The marketing benefits of e-cigarettes: a tobacco industry perspective
Customer Bulletin 0515 A Comparison of ISO ISO-C1 and HT-300
Helmet verkkoon hankekoulu_vuosikello
めんどうくさくないWardenハンズオン
Material necessari per a fer un hort urbà
Social media + Local Search - Liana Evans- Digitizing
Master Strokes
Workle presentation june 2012
פסיכיאטריה קהילתית 2
Online smart investor courses
Co-Op/MDF Whitepaper by Computer Market Research
News Flash - March 2013 - abm & associates
Ad

Similar to Nise BOSH in Action (20)

PPTX
Altoros Cloud Foundry Training: hands-on workshop for DevOps, Architects and ...
PPTX
Cloud Foundry: Hands-on Deployment Workshop
PPTX
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
PPTX
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
PPTX
Cloud Foundry and OpenStack – Marriage Made in Heaven !
PDF
Cloud Foundry and OpenStack: How They Fit - Cloud Expo 2014
PDF
Cloud Foundry Overview
PPTX
Extending Cloud Foundry - London CF User Group Sept 2014.pptx
PPTX
Cloud Foundry and OpenStack
PDF
MNAssociationEnterpriseArchitectsCloudFoundryJuly2017
PPTX
Automated Lifecycle Management - CloudFoundry on OpenStack
PDF
Cloud Foundry Introduction and Overview
PDF
Cloud Foundry, the Open Platform as a Service - Oscon - July 2012
PDF
Cloud foundry and openstackcloud
PPTX
What's New in the Cloud Foundry Ecosystem?
PDF
As a Service: Cloud Foundry on OpenStack - Lessons Learnt
PDF
PHP Buildpacks in the Cloud on Bluemix
 
PDF
Cloud Foundry for PHP developers
PDF
Structure and Opinions - Software Deployments with Cloud Foundry
PPTX
Cloud Foundry at VMware
Altoros Cloud Foundry Training: hands-on workshop for DevOps, Architects and ...
Cloud Foundry: Hands-on Deployment Workshop
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
Cloud Foundry and OpenStack - A Marriage Made in Heaven! (Cloud Foundry Summi...
Cloud Foundry and OpenStack – Marriage Made in Heaven !
Cloud Foundry and OpenStack: How They Fit - Cloud Expo 2014
Cloud Foundry Overview
Extending Cloud Foundry - London CF User Group Sept 2014.pptx
Cloud Foundry and OpenStack
MNAssociationEnterpriseArchitectsCloudFoundryJuly2017
Automated Lifecycle Management - CloudFoundry on OpenStack
Cloud Foundry Introduction and Overview
Cloud Foundry, the Open Platform as a Service - Oscon - July 2012
Cloud foundry and openstackcloud
What's New in the Cloud Foundry Ecosystem?
As a Service: Cloud Foundry on OpenStack - Lessons Learnt
PHP Buildpacks in the Cloud on Bluemix
 
Cloud Foundry for PHP developers
Structure and Opinions - Software Deployments with Cloud Foundry
Cloud Foundry at VMware

More from i_yudai (9)

PDF
Autoscaling Cloud Foundry with BOSH
PDF
OSTree: OSイメージとパッケージシステムの間にGitのアプローチを
PDF
BOSHで始めるImmutable Infrastructure
PDF
BOSH-lite で 1VM Cloud Foundry
PDF
DevStackで始めるCloud FoundryとBOSH
PDF
BOSHでお手軽CFデプロイon AWS
PDF
マスタリング DEA/NG 第2版
PDF
すごく分かるwarden
PDF
すごいBOSHたのしく学ぼう
Autoscaling Cloud Foundry with BOSH
OSTree: OSイメージとパッケージシステムの間にGitのアプローチを
BOSHで始めるImmutable Infrastructure
BOSH-lite で 1VM Cloud Foundry
DevStackで始めるCloud FoundryとBOSH
BOSHでお手軽CFデプロイon AWS
マスタリング DEA/NG 第2版
すごく分かるwarden
すごいBOSHたのしく学ぼう

Recently uploaded (20)

PDF
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
PPTX
Telecom Fraud Prevention Guide | Hyperlink InfoSystem
PPTX
ABU RAUP TUGAS TIK kelas 8 hjhgjhgg.pptx
PDF
Dell Pro 14 Plus: Be better prepared for what’s coming
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Google’s NotebookLM Unveils Video Overviews
PDF
Transforming Manufacturing operations through Intelligent Integrations
PDF
Modernizing your data center with Dell and AMD
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
PDF
Chapter 2 Digital Image Fundamentals.pdf
PDF
CIFDAQ's Teaching Thursday: Moving Averages Made Simple
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Event Presentation Google Cloud Next Extended 2025
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PPTX
CroxyProxy Instagram Access id login.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
Telecom Fraud Prevention Guide | Hyperlink InfoSystem
ABU RAUP TUGAS TIK kelas 8 hjhgjhgg.pptx
Dell Pro 14 Plus: Be better prepared for what’s coming
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Google’s NotebookLM Unveils Video Overviews
Transforming Manufacturing operations through Intelligent Integrations
Modernizing your data center with Dell and AMD
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Chapter 2 Digital Image Fundamentals.pdf
CIFDAQ's Teaching Thursday: Moving Averages Made Simple
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Event Presentation Google Cloud Next Extended 2025
CIFDAQ's Market Insight: SEC Turns Pro Crypto
CroxyProxy Instagram Access id login.pptx
Understanding_Digital_Forensics_Presentation.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows

Nise BOSH in Action

  • 1. Nise BOSH In Action Iwasaki Yudai @i_yudai NTT Software Innovation Center 2013-04-26
  • 2. Installing cf-release jobs with Nise BOSH – What’s cf-release? – What’s Nise BOSH? – How to use DEA/NG and CCv1 compatibility – How to revert BuildPack support Agenda
  • 3. Installing cf-release jobs with Nise BOSH
  • 4.  Preconfigured CF source code set – For installation with BOSH – Well-tested by many users – Portable • Minimum dependencies on apt packages • Including mysqlclient, imagemagick and so on... What’s cf-release?
  • 5. Tool chain for distributed systems – Release engineering – Lifecycle management – Works with IaaS layers (CPI) • AWS, vSphere, vCloud and OpenStack What’s BOSH? (c) EMC & VMware http://docs.cloudfoundry.com/docs/running/bosh/
  • 6. Photo by yeowatzup from http://www.flickr.com/photos/yeowatzup/173818958/ Heavybut worth trying
  • 7. A lightweight BOSH (nearly) emulator – Works on a local machine – Without any CPI What’s Nise BOSH https://github.com/nttlabs/nise_bosh
  • 8. ./bin/init – Stemcell-like environment builder ./bin/nise-bosh – Package installer ./bin/run-job – Job launcher Main Three Scripts VM Stemcell dea_next (Job template) common (Package) dea_next (Package) ruby (Package) Agent
  • 9. Sets up Stemcell-like environment – Installs apt packages, create users and so on... Ported from Stemcell Builder stages – https://github.com/cloudfoundry/bosh/tree/master/stemcell_builder/ ./bin/init Stemcell ≈ OS + bosh_agent + α = Basic VM image VM Stemcell dea_next (Job template) common (Package) dea_next (Package) ruby (Package) Agent
  • 10. Installs packages and job templates – Automatically resolving dependencies – Running packaging scripts – Filling templates with deploy manifest ./bin/nise-bosh Packages: • References to source code • Packaging(installer) scripts Job templates: • Package list • Configuration file/Control script/monitrc templates VM Stemcell dea_next (Job template) common (Package) dea_next (Package) ruby (Package) Agent
  • 11. Job launcher – Reads monitrc file from job templates • Resolving task dependencies – start/stop/status ./bin/run-job
  • 12. Entry on Cloud Foundry.com – http://blog.cloudfoundry.com/2013/04/15/ntt-contributes-nise-bosh-a-tool-to-speed-up-bosh-development/ README.md How To Use
  • 13. Ubuntu 10.04 64bit – Recommended for cf-release Example: Installing dea_next (1) sudo apt-get install git-core # Clone Nise BOSH and initialize the environment git clone https://github.com/nttlabs/nise_bosh.git cd nise_bosh sudo ./bin/init sudo reboot # Install ruby with rbenv cd ~ git clone git://github.com/sstephenson/rbenv.git ~/.rbenv echo 'export PATH="$HOME/.rbenv/bin:$PATH"' >> ~/.bash_profile echo 'eval "$(rbenv init -)"' >> ~/.bash_profile exec $SHELL –l git clone https://github.com/sstephenson/ruby-build.git ~/.rbenv/plugins/ruby-build rbenv install 1.9.3-p327 rbenv global 1.9.3-p327 # Install required gems gem install bundler gem install bosh_cli rbenv rehash Ubuntu 10.04 64bit is recommended for cf-release
  • 14. Generating package archives – `bosh craete release` creates pre- packaged tar files in .dev_builds Example: Installing dea_next (2) # Clone cf-release git clone https://github.com/cloudfoundry/cf-release.git cd cf-release ./update # check out submodules # Create release packages bosh create release –force # give ‘appcloud’ for the prompt
  • 15. Deployment manifest – Compatible with BOSH Example: Install dea_next (3) vi ~/deploy.conf --- properties: domain: vcap.me networks: apps: default management: default nats: user: nats password: nats address: 127.0.0.1 port: 4222 dea_next: streaming_timeout: 60 memory_mb: 4096 memory_overcommit_factor: 1 disk_mb: 32000 disk_overcommit_factor: 1 num_instances: 30
  • 16. Installing dea_next job template Example: Installing dea_next (4) cd ~/nise_bosh sudo env PATH=$PATH bundle install sudo env PATH=$PATH bundle exec ./bin/nise-bosh ~/cf-release ~/deploy.conf dea_next
  • 17. Launching processes Example: Installing dea_next (5) sudo env PATH=$PATH bundle exec ./bin/run-job start
  • 18. ./bin/nise-bosh has some options – See README.md
  • 19. DEA/NG and CCv1 compatibility
  • 23. Reverted and works – https://github.com/yudai/dea_ng/commit/ccce77553deff7cfc9b5 a6191e12046207a42ced – Copy runtimes from CCv1 • ~/cloudfoundry/.deployments • Removed from cf-release • https://github.com/cloudfoundry/cf-release/commit/82984735556f931caacf010cf7b52a59032c401f – Disable integrated Stager – Add runtimes in config file The Return of CCv1