Ansible and AWS
31 likes13,109 views
This document summarizes an Ansible and AWS meetup. It discusses using Ansible to provision and configure AWS resources like EC2 instances, security groups, ELBs, and more through idempotent playbooks. Key points covered include Ansible's agentless architecture, dynamic AWS inventory plugin, core modules like ec2 and cloudformation, templates, roles for reuse, and examples of provisioning playbooks that launch instances and apply configurations. It also briefly mentions NetflixOSS projects that use Ansible like Aminator for AMIs and Asgard for provisioning.
![Inventory
•
List of your hosts
•
•
Grouped together
Example hosts file:
/etc/ansible/hosts"
!
[webservers]"
foo.example.com"
bar.example.com"
!
[dbservers]"
one.example.com"
two.example.com"
!
[california]"
foo.example.com"
one.example.com](https://image.slidesharecdn.com/ansible-and-aws-131105120155-phpapp02/85/Ansible-and-AWS-20-320.jpg)
![.boto file
[Credentials]
aws_access_key_id = AKIABCDEFGHIJKLM
aws_secret_access_key = duhke3pth15aSECr3t0R3153](https://image.slidesharecdn.com/ansible-and-aws-131105120155-phpapp02/85/Ansible-and-AWS-24-320.jpg)
Ad
More Related Content
What's hot (20)
Viewers also liked (12)
Ad
Similar to Ansible and AWS (20)
Ad
Recently uploaded (20)
Ansible and AWS
- 1. Ansible and AWS Advanced Amazon Web Services Meetup November 4, 2013 ! ! ! ! ! Peter Sankauskas Answers for AWS @pas256 @Answers4AWS
- 2. We’re Back!
- 3. About this group Advanced Amazon Web Services
- 4. Goals • Help make you more AWeSome • Learn something new • Share techniques, tips and tricks on using AWS • Share best practices • Share war stories • Share code and tools
- 5. Assumptions • You use AWS now • • • Don’t need to be sold on it Know why it is great You know where the AWS documentation is • No “what is EC2” sessions here
- 6. “Ask not what your meetup can do for you ask what you can do for your meetup”
- 7. Speakers • Got something to share? • What are your AWS stories? • What problems have you solved? • What do you use and how do you use it? • Formats: 5, 10, 30 and 42 minute sessions
- 8. Sponsors • Want to tell us about your product/service for 10 minutes before the main presentations? • Pay for food/drinks and you can
- 9. Venue • Want to host? • • • San Francisco Peninsula You get to present too!
- 10. About Me Peter Sankauskas • From Sydney, Australia • Using AWS for 5 years • • • from a 12 person startup to a 55,000 employee enterprise 2009 AWS Startup Challenge Finalist • Beaten by Bizo
- 11. Answers for AWS • Episodes & Blog • • Ansible, Reserved Instances, CloudFormation Code • • • Nominated for NetflixOSS Cloud Prize for Ansible Playbooks Graffiti Monkey, Backup Monkey Personalized Help • Consulting services and training
- 12. Survey results Years of AWS Experience ! ! 5+ yrs 21% 1 yr 7% 2 yrs 21% ! ! ! 4 yrs 21% 3 yrs 29% What you use S3 EC2 ELB Route53 IAM VPC ASG AWS Support SNS CloudWatch CloudFormation CloudFront RDS Users Experts
- 13. Survey results Want to learn more about IAM Route53 SQS ELB CloudFront EC2 EMR S3 CloudWatch Redshift Direct Connect CloudSearch Need Want
- 14. Survey results Don’t know Alexa Web Information Service ! ! ! Alexa Web Information Service Flexible Payments Service Amazon DevPay Alexa Top Sites AWS CloudHSM Direct Connect CloudSearch ! Don’t care Storage Gateway Flexible Payments Service Amazon DevPay Alexa Top Sites Mechanical Turk Elastic Transcoder AWS Marketplace ! AWS Import/Export SES
- 15. Are you going to re:invent? It’s sold out
- 16. Ansible
- 17. History • 1st generation • • CF Engine 2nd generation • • • Puppet Chef 3rd generation • Ansible • Salt Stack
- 18. Ansible is… • • a radically simple IT orchestration engine that makes your applications and systems easier to deploy • agent-less • has AnsibleWorks as a backing company • • free, open source, & available on GitHub written in Python secure by using SSH for connections
- 19. Installation From Source ! $ $ $ $ sudo pip install paramiko PyYAML jinja2 git clone git://github.com/ansible/ansible.git cd ./ansible source ./hacking/env-setup" Using PIP $ sudo pip install ansible" Using yum $ sudo yum install ansible" Using apt $ sudo add-apt-repository ppa:rquillo/ansible $ sudo apt-get update $ sudo apt-get install ansible
- 20. Inventory • List of your hosts • • Grouped together Example hosts file: /etc/ansible/hosts" ! [webservers]" foo.example.com" bar.example.com" ! [dbservers]" one.example.com" two.example.com" ! [california]" foo.example.com" one.example.com
- 21. Targeting • Use groups in inventory to target hosts • Combine groups to get specific • Use set operators • • AND, OR, NOT Examples: ansible -m ping webservers" ansible -m ping dbservers" ansible -m ping webservers:&california" ansible -m ping webservers:!phoenix
- 22. EC2 inventory plugin • AWS has an API which is always upto-date • Generate inventory off that, return JSON • Group instances by: • region and availability zone • security groups • tags • keypairs • more… • Uses boto
- 23. boto • Python library for AWS • Written by Mitch Garnaat and then hired by Amazon • • He also writes the new AWS CLI Multiple ways to supply it with AWS credentials • Environment variables • IAM Role • .boto file
- 24. .boto file [Credentials] aws_access_key_id = AKIABCDEFGHIJKLM aws_secret_access_key = duhke3pth15aSECr3t0R3153
- 25. ec2_architecture ec2_ramdisk ec2_description ec2_region ec2_dns_name ec2_root_device_name ec2_id ec2_root_device_type EC2 inventory script collections information about each instance ec2_image_id ec2_security_group_ids ec2_instance_type ec2_security_group_names ec2_ip_address ec2_state Makes variables available to ec2_kernel ec2_state_code ec2_key_name ec2_state_reason ec2_launch_time ec2_status ec2_monitored ec2_subnet_id ec2_ownerId ec2_tag_Name ec2_placement ec2_tenancy ec2_platform ec2_virtualization_type ec2_previous_state ec2_vpc_id Instance variables • • • • • plays playbooks templates ec2_private_dns_name ec2_private_ip_address ec2_public_dns_name
- 27. Modules • All modules are part of core • No competing modules • No abandoned modules • All core modules are written in Python • You can write custom modules in any language • There is already helper code in Ruby https://github.com/ansible/ ansible-for-rubyists
- 28. ping A trivial test module, this module always returns pong on successful contact. It does not make sense in playbooks, but it is useful from /usr/bin/ansible ! # Test connection ansible webservers -m ping
- 29. Demo
- 32. Ad-hoc tasks • Target the desired instance or instances • Choose the module • Specify the arguments Buy Milk
- 33. Examples ansible -m copy -a "src=script.sh dest=/usr/bin/script owner=root group=root mode=0755" webservers" ansible -m service -a "name=apache state=restarted" --forks=2 webservers" ansible -m user -a ‘name=nsa comment="NSA" uid=9999’ dbservers"
- 34. Playbooks • Contains one or more “plays” • Written in YAML • • • Declare configuration YAML is not code Executed in the order it is written • No dependency graph
- 35. Install AWS command line tool ---" - name: Install AWS CLI" user: ubuntu" sudo: True" hosts: all" tasks:" - name: Install Python PIP" apt: pkg=python-pip state=latest" ! - name: Install boto via PIP" pip: name=boto state=latest" ! - name: Install AWS CLI" pip: name=awscli state=latest
- 37. DRY • Includes • • Reuse lists of task Roles • Reuse a set of tasks, files, variables and templates
- 38. Includes ---" - name: Install AWS CLI" user: ubuntu" sudo: True" hosts: all" tasks:" - include: install-aws-cli.yml" ! ! install-aws-cli.yml! - name: Install Python PIP" apt: pkg=python-pip state=latest" ! - name: Install boto via PIP" pip: name=boto state=latest" ! - name: Install AWS CLI" pip: name=awscli state=latest
- 39. Roles ---" - name: Set up web boxes" user: ubuntu" sudo: True" hosts: webservers" roles:" - base" - webserver" ! ! ! ! ! ! ! ! webservers.yml" dbservers.yml" roles/" base/" files/" templates/" tasks/" handlers/" vars/" meta/" webservers/" files/" templates/" tasks/" handlers/" vars/" meta/
- 40. Conditions & Loops ---" # Install everyone's favorite editors" ! - name: Install editor packages (apt)" apt: pkg={{ item }} state=latest" with_items:" - emacs23-nox" - emacs23-el" - vim" when: ansible_distribution == 'Ubuntu'" ! ! - name: Install editors packages (yum)" yum: pkg={{ item }} state=latest" with_items:" - emacs" - emacs-el" - vim-enhanced" when: ansible_distribution == 'Amazon'
- 41. Templates • File with variable substitutions • Same as Puppet and Chef templates • Uses Jinja2 instead of ERB • {{ variable }} • {{ filename | md5 }}
- 42. Provisioning • Modules for • Creating security groups • Launching EC2 instances • Assigning EIPs • Register instances with ELBs • Tagging resources • RDS, S3 and CloudFormation
- 43. Provisioning Playbook - 1 ---" - name: Example of provisioning servers" hosts: 127.0.0.1" connection: local" tasks:" - name: Create security group" local_action:" module: ec2_group" name: ep2" description: Access to the Episode2 servers" region: us-east-1" rules:" - proto: tcp" from_port: 22" to_port: 22" cidr_ip: 0.0.0.0/0
- 44. Provisioning Playbook - 2 - name: Launch instances" local_action:" module: ec2" region: us-east-1" keypair: answersforaws" group: ep2" instance_type: m1.small" image: ami-8635a9b6" count: 2" wait: yes" register: ec2" ! - name: Add EP2 instances to host group" local_action: add_host hostname={{ item.public_ip }} groupname=ep2" with_items: ec2.instances
- 45. Provisioning Playbook - 3 - name: Add tag to instances" local_action: ec2_tag resource={{ item.id }} state=present" with_items: ec2.instances" args:" tags:" Name: EP2" ! - name: Wait for SSH to be available" pause: minutes=1" ! ! - name: Configure provisioned servers" hosts: ep2" user: ubuntu" sudo: True" tasks:" - include: tasks/install-awscli.yml
- 48. AMIs • Aminator • Ansible Provisioner • Written by me ! • Packer • Ansible Provisioner • Written by Kelsey Hightower
- 49. More • Prompts • Tags • Handlers • Variable Files • Rolling Updates • Delegation • Custom inventory, plugins and modules
- 50. Video • A condensed version of this deck in video format is available at Answers for AWS • Look for Episode 2
- 51. Bonus
- 52. CloudFormation • Stack • Templates • written in JSON • • • syntax errors easy prone to typos Checks only done at Stack creation time
- 53. troposphere https://github.com/cloudtools/ troposphere • API for writing CloudFormation templates • Written in Python • Same guy has Python API for writing IAM Policies too • https://github.com/ cloudtools/awacs
- 54. cfndsl https://github.com/howech/ cfndsl • DSL for CloudFormation • Written in Ruby
- 55. We a re loo king Spea for kers, Spon and V sors enue s. Don’t be sh y Thank you! Slides available at: http://bit.ly/ansible-aws" ! ! ! ! ! Peter Sankauskas Answers for AWS @pas256 @Answers4AWS answersforaws.com