Arnold Bechtoldt, Inovex GmbH Linux systems engineer - Configuration Management with SaltStack
2 likesโข2,193 views
The document discusses configuration management using SaltStack, outlining its flexibility and ease of use in managing both physical and virtual infrastructures. It covers fundamental concepts such as user and package management, as well as the architecture and terminology related to SaltStack operations. The conclusion emphasizes the importance of choosing the right configuration management system for specific projects and highlights the capabilities of SaltStack beyond just configuration management.
![15
You specify minion targeting to apply states, pillars or commands to a desired set of
minions:
โฃโฏ Globbing: feweb*.domain.local, *.domain.local, feweb[1-3].domain.local
โฃโฏ PCRE: fe(web|mail)1.domain.local
โฃโฏ Grains: โos:CentOSโ, โsaltversion:2014.1.1โ
โฃโฏ Pillars: โrole:mailserverโ, โcluster_name:fehomepageโ
โฃโฏ Lists: feweb1.domainโฆ, feweb2.domainโฆ, feweb3.domainโฆ
โฃโฏ Nodegroups: Predefined list of minions
โฃโฏ Compound (Mix): Mix of the above targeting types (operators: and, or, not)
โฃโฏ Batch Size: 4, 10% (execute on X minions at a time)
SaltStack Inside
Minion Targeting](https://image.slidesharecdn.com/cfgmgmtwsaltstackactii-final-140516185142-phpapp02/85/Arnold-Bechtoldt-Inovex-GmbH-Linux-systems-engineer-Configuration-Management-with-SaltStack-15-320.jpg)
![postscreen_dnsbl_sites:
- zen.spamhaus.org*2
- ix.dnsbl.manitu.net*2
- dnsbl.sorbs.net=127.0.0.[2;3;5;6;7;9;10]
- list.dnswl.org=127.0.[0..255].0*-1
- list.dnswl.org=127.0.[0..255].[2..3]*-3
any:
generic:
list:
- foo: oof
bar: rab
20
type: satellite
relayhost: smtp.domain.local
inet_protocols:
- ipv4
soft_bounce: True
postscreen:
- greylisting
- pregreet
- dnsbl
mynetworks: 127.0.0.0/8 [::ffff:127...
SaltStack Inside
Pillars](https://image.slidesharecdn.com/cfgmgmtwsaltstackactii-final-140516185142-phpapp02/85/Arnold-Bechtoldt-Inovex-GmbH-Linux-systems-engineer-Configuration-Management-with-SaltStack-20-320.jpg)
 }}
โฃโฏ Grains: {{ salt[โgrains.getโ](โos_familyโ) }}
โฃโฏ Peer Publish: {{ salt[โpublish.publishโ](โweb*โ, โgrains.itemโ, โfqdnโ) }}
โฃโฏ Mine: {{ salt[โpillar.itemโ](โmine_functions:network.interfacesโ) }}
โฃโฏ Local env variables: {% set foo = โbarโ %} {{ foo }}
โฃโฏ Deserializing: load_json(โfile.jsonโ) / load_yaml(โfile.yamlโ) / โฆ
โฃโฏ โฆ
These are available in:
โฃโฏ Top Files
โฃโฏ State Files
โฃโฏ Template Files
โฃโฏ Pillar Files
โฃโฏ โฆ
SaltStack Inside
Data Access](https://image.slidesharecdn.com/cfgmgmtwsaltstackactii-final-140516185142-phpapp02/85/Arnold-Bechtoldt-Inovex-GmbH-Linux-systems-engineer-Configuration-Management-with-SaltStack-22-320.jpg)
Arnold Bechtoldt, Inovex GmbH Linux systems engineer - Configuration Management with SaltStack
- 1. Configuration Management with SaltStack Act II Arnold Bechtoldt Berlin, 14.05.14
- 2. 2 1.โฏ Configuration Management Systems 2.โฏ SaltStack Fundamentals 3.โฏ SaltStack Inside 4.โฏ Conclusions 5.โฏ Showcase/ Walkthrough Topics
- 3. 3 โฃโฏ Linux-Systems Engineer at inovex GmbH โฃโฏ Develop lots of features for (Open Source) Datacenter Management โฃโฏ Provisioning of physical & virtual infrastructure โฃโฏ SaltStack user since December, 2012 (~ v0.10.x) About me [email protected]
- 4. 4 โฃโฏ Provides a wide set of IT services: ยง๏งโฏ Application Development ยง๏งโฏ Mobile Development ยง๏งโฏ Business Intelligence ยง๏งโฏ IT Engineering & Operations ยง๏งโฏ Consulting ยง๏งโฏ Trainings โฃโฏ Cool projects with great Open Source Software โฃโฏ Teams of high-experienced engineers โฃโฏ We have excellent job offers in Karlsruhe, Cologne, Munich and Pforzheim! About inovex inovex.de
- 5. 5 Configuration Management Systems (a.k.a. CMS) Configuration Management with SaltStack Part 1
- 6. 6 โฃโฏ Support building a defined infrastructure โฃโฏ Support managing a defined infrastructure โฃโฏ Definition of infrastructure in code (โInfrastructure as codeโ) โฃโฏ Configuration Management requires Software Development Configuration Management Systems Definition
- 7. 7 1.โฏ Create a user (if needed): postfix 2.โฏ Install a package (or more): postfix, postfix-pcre 3.โฏ Create or change a file (configure a service): /etc/postfix/main.cf 4.โฏ Enable and start the service: chkconfig postfix on; service postfix start Configuration Management Systems Traditional
- 8. 8 1.โฏ User Management 2.โฏ Package Management 3.โฏ File Management 4.โฏ Service Management What if we need m o r e ? Configuration Management Systems Limitations
- 9. 9 SaltStack Fundamentals Configuration Management with SaltStack Part 2
- 10. 10 Salt โฆ 1.โฏ โฆ is extremely flexible. 2.โฏ โฆ is very easy to use. 3.โฏ โฆ has lots of exciting features. 4.โฏ โฆ is fast. 5.โฏ โฆ makes sysadminโs life easier. SaltStack Fundamentals Why Salt?
- 11. 11 โฃโฏ Itโs all about (simple) data โฃโฏ Central place for configuration โฃโฏ Asynchronous (send commands to 10,000 server at a time in seconds) โฃโฏ Configuration management โฃโฏ Remote execution โฃโฏ Core functions are available as execution modules โฃโฏ Hundreds of state + execution modules โฃโฏ Easy to extend โฃโฏ Separate data and code easily with pillars SaltStack Fundamentals Why Salt? (2)
- 12. 12 SaltStack Inside Configuration Management with SaltStack Part 3
- 13. 13 Different software, different names: โฃโฏ Minion: The client itself โฃโฏ Master: Manages minions โฃโฏ Grains: Standard set of client system information โฃโฏ Pillars: User-defined set of information โฃโฏ State: User-defined description of a state of a file, package, โฆ โฃโฏ Formulas: Collection of user-defined states โฃโฏ State Module: Set of state functions for files, packages, LVM, MySQL, โฆ โฃโฏ Execution Module: Predefined commands executed on the minions โฃโฏ Jinja: Default template renderer SaltStack Inside Terminology
- 15. 15 You specify minion targeting to apply states, pillars or commands to a desired set of minions: โฃโฏ Globbing: feweb*.domain.local, *.domain.local, feweb[1-3].domain.local โฃโฏ PCRE: fe(web|mail)1.domain.local โฃโฏ Grains: โos:CentOSโ, โsaltversion:2014.1.1โ โฃโฏ Pillars: โrole:mailserverโ, โcluster_name:fehomepageโ โฃโฏ Lists: feweb1.domainโฆ, feweb2.domainโฆ, feweb3.domainโฆ โฃโฏ Nodegroups: Predefined list of minions โฃโฏ Compound (Mix): Mix of the above targeting types (operators: and, or, not) โฃโฏ Batch Size: 4, 10% (execute on X minions at a time) SaltStack Inside Minion Targeting
- 16. 16 Components using a top file: โฃโฏ States โฃโฏ Pillars What they do: โฃโฏ Map minions with states โฃโฏ Map minions with pillars โฃโฏ Map minions with environments SaltStack Inside The Top Files
- 17. 17 Top of States dev: 'mailserver*dev*': - postfix.satellite qa: 'mailserver*qa*': - postfix.satellite prod: 'mailserver*prod*': - postfix.satellite - monitoring SaltStack Inside The Top Files (2) Top of Pillars dev: 'mailserver*dev*': - postfix.dev qa: 'mailserver*qa*': - postfix.qa prod: 'mailserver*prod*': - postfix.prod - monitoring.prod
- 18. 18 SaltStack Inside States postfix: pkg: - installed - names: - postfix - postfix-pcre service: - running - watch: - file: /etc/postfix/main.cf Dict/ Hash: State ID List/ Array: State Module Any: Parameters
- 19. 19 SaltStack Inside States (2) /etc/postfix/main.cf: file: - managed - source: salt://postfix/files/satellite.main.cf - user: root - group: postfix - mode: 640 - template: jinja
- 20. postscreen_dnsbl_sites: - zen.spamhaus.org*2 - ix.dnsbl.manitu.net*2 - dnsbl.sorbs.net=127.0.0.[2;3;5;6;7;9;10] - list.dnswl.org=127.0.[0..255].0*-1 - list.dnswl.org=127.0.[0..255].[2..3]*-3 any: generic: list: - foo: oof bar: rab 20 type: satellite relayhost: smtp.domain.local inet_protocols: - ipv4 soft_bounce: True postscreen: - greylisting - pregreet - dnsbl mynetworks: 127.0.0.0/8 [::ffff:127... SaltStack Inside Pillars
- 21. 21 Store top files, states (formulas), templates, custom modules, pillars, etc. on โฃโฏ Local filesystems โฃโฏ Git Repositories โฃโฏ SVN Repositories โฃโฏ Mercurial Repositories โฃโฏ MinionFS (distributed over several hosts) โฃโฏ Amazon S3 Separate them by โฃโฏ Environments/ teams โฃโฏ Projects โฃโฏ Pillars โฃโฏ โฆ SaltStack Inside Fileserver Backends
- 22. 22 Access data by: โฃโฏ Pillars: {{ salt[โpillar.getโ](โinet_protocolsโ, [โipv4โ, โipv6โ]) }} โฃโฏ Grains: {{ salt[โgrains.getโ](โos_familyโ) }} โฃโฏ Peer Publish: {{ salt[โpublish.publishโ](โweb*โ, โgrains.itemโ, โfqdnโ) }} โฃโฏ Mine: {{ salt[โpillar.itemโ](โmine_functions:network.interfacesโ) }} โฃโฏ Local env variables: {% set foo = โbarโ %} {{ foo }} โฃโฏ Deserializing: load_json(โfile.jsonโ) / load_yaml(โfile.yamlโ) / โฆ โฃโฏ โฆ These are available in: โฃโฏ Top Files โฃโฏ State Files โฃโฏ Template Files โฃโฏ Pillar Files โฃโฏ โฆ SaltStack Inside Data Access
- 23. 23 One tool to rule them all: โฃโฏ $ salt โ*โ state.sls ferm saltenv=prod โฃโฏ $ salt โ*โ state.highstate test=False โฃโฏ $ salt โ*โ gem.install foreman_provision โฃโฏ $ salt โ*โ hadoop.dfs ls / โฃโฏ $ salt โ*โ lxc.unfreeze bigfoot โฃโฏ $ salt โ*โ network.traceroute inovex.de โฃโฏ $ salt โ*โ pkg.install openssl refresh=True $ salt โ*โ service.restart nginx โฃโฏ $ salt โ*โ dockerio.pull index.docker.io:MyRepo/image foo โฃโฏ $ salt โ*โ tomcat.deploy_war salt://application.war /api yes http://localhost:8080/ โฃโฏ $ salt โC โI@role:mailserver and (P@os:Debian or [email protected]/24)โ โฆ SaltStack Inside Configuration Management + Remote Execution
- 24. 24 feweb1.domain.local: ---------- ID: ferm Function: pkg.installed Result: True Comment: All specified packages are already installed. Changes: ---------- ID: ferm Function: file.managed Name: /etc/ferm/ferm.conf Result: True Comment: File /etc/ferm/ferm.conf updated Changes: ---------- diff: SaltStack Inside Configuration Management + Remote Execution (2) --- @@ -1,33 +1,31 @@ ... ---------- ID: ferm Function: service.running Result: True Comment: Service restarted Changes: ---------- ferm: True Summary ------------ Succeeded: 3 Failed: 0 ------------ Total: 3
- 25. 25 Conclusions Configuration Management with SaltStack Part 4
- 26. 26 1.โฏ Choose the CMS which fits to your project, everyone is different 2.โฏ If you spend more time creating automation instead of saving it, something is wrong 3.โฏ Salt can help you managing large and complex infrastructures 4.โฏ SaltStack can do even more than CM: Salt-Cloud, Salt-Virt, Salt SSH, Salt Proxy, โฆ 5.โฏ Salt can help you making your customers and yourself happy Conclusions IMHO
- 27. 27 Basic configuration: โฃโฏ /bechtoldt/network-formula โฃโฏ /bechtoldt/time-formula DNS/ DHCP: โฃโฏ /bechtoldt/binddns-formula โฃโฏ /bechtoldt/iscdhcp-formula Lifecycle Management (physical + virtual servers): โฃโฏ Foreman: /bechtoldt/foreman-formula Cloud management: โฃโฏ OpenNebula: /bechtoldt/opennebula-formula โฃโฏ OpenStack: /EntropyWorks/salt-openstack/tree/formula Showcase/ Walkthrough Code at Github.com
- 28. 28 Github.com/bechtoldt โ Github.com/saltstack-formulas โ talks.arbe.io Thank You Questions? Contact Arnold Bechtoldt Linux-Systems Engineer inovex GmbH Office Karlsruhe Ludwig-Erhard-Allee 6 D-76131 Karlsruhe +49 (0)173 31 81 117 [email protected] โWir nutzen Technologien, um unsere Kunden glรผcklich zu machen. Und uns selbst.โ