源码包 http://pan.baidu.com/s/1eQzPJB8
应用环境:
使用salt写了个自动部署mysql的配置配置管理文件,由于mysql的有版本号,端口等不确定属性,需要使用pillar来单独配置每个minion的属性。
一,原始方法
例如,需要在salt id为10.1.1.1-centos.game.web的服务器上部署mysql,版本号为5.5.25,实例有3个,3306,3307,3308, 正常情况下的流程是这样的:
1,在/srv/salt/top.sls中添加配置信息,确保mysql对应的配置被加载
base: 10.1.1.1-centos.game.web: - centos.public_services.mysql
2,在/srv/pillar/top.sls配置minion对应的sls文件位置(ps:salt文件中不能再带”.”,否则会报错)
base: 10.1.1.1-centos.game.web: - custom.10-1-1-1-centos-game-web
3,新建/srv/pillar/custom/10-1-1-1-centos-game-web.sls,内容如下:
mysql: ports: - 3306 - 3307 - 3308 version: '5_5_25'
4,执行同步命令
salt 10.1.1.1-centos.game.web -v -t 300
二,改进方法
oh,shit,说好的自动化呢,怎么还要这么多步骤,这可不行!
利用py模式的sls配置文件(其实就是python脚本,只要返回yaml格式的字典文件就好了),我们可以将以上的操作简化成1步,思路如下:
1,/srv/pillar/top.sls中编写配置:
base: '*': - custom
2,使用py模式编写/srv/pillar/custom/init.sls,自动读取pillar配置,例如salt id是:10.1.1.1-centos.game.web,那么project为game,然后根据获取的pillar_root组合成路径/srv/pillar/custom/game/10.1.1.1-centos.game.web.yaml,利用yaml模块从文件中读取信息,返回字典
3,在/srv/salt/top.sls文件中匹配所有的minion
‘*’: - centos.public_services
4,/srv/salt/centos/public_services/init.sls文件使用py模式编写,配置会获取对应的minion的pillar信息,如果包含mysql配置信息且配置正确的话,则返回mysql实例的配置。
那现在要怎么使用呢,很简单,例如你的id为10.1.1.1-centos.game.web,首先在/srv/pillar/custom/目录下建个game目录(从salt id获取的项目名),然后在game目录先新建文件10.1.1.1-centos.game.web.yaml,里面写上配置信息:
mysql: ports: - 3306 - 3307 - 3308 version: '5_5_25' 最后执行命令:
salt 10.1.1.1-centos.game.web -v -t 300
静静的等待执行完成就好了!
三,具体代码
/srv/pillar/custom/init.sls
#!py #coding:utf-8 """ 返回minion对应的pillar信息 """ import yaml import os def run(): """ 首先获取请求的id,从id中获取project,例如id是:1.2.3.4-centos.game.web,那么project为game 然后根据获取的pillar_root组合成路径/srv/pillar/custom/game/1.2.3.4-centos.game.web.yaml,利用yaml模块从文件中读取信息,返回字典 """ config={} id=__opts__['id'] open('/tmp/test.log','w').write(os.getcwd()) project=id.split('-')[-1].split('.')[1] pillar_root=__opts__['pillar_roots']['base'][0] path='%s/custom/%s/%s.yaml'%(pillar_root,project,id) if os.path.isfile(path): s=open(path).read() config=yaml.load(s) return config
/srv/salt/centos/public_services/init.sls
#!py |
#!py #coding: utf-8 import subprocess class MY_ERROR(Exception): def __init__(self,value): self.value=value def __str__(self): return self.value def mysql(): """ 1,检查是minion中pillar是否有mysql参数,以及参数是否合法 如果参数没有问题,则返回对应版本的include配置 pillar e.q. mysql: ports: - 3306 - 3307 version: '5_5_25' """ mysql_sls_path='centos.public_services.mysql.' #必要的参数 required_keys=['version','ports'] if __pillar__.has_key('mysql'): mysql_d=__pillar__['mysql'] #不存在必要的键值对则返回None for key in required_keys: if not mysql_d.has_key(key) or str(mysql_d[key]).strip()=="": raise MY_ERROR('key error! key: %s'%(str(key))) #判断port是否合法 for port in mysql_d['ports']: if not port or not 1024<int(port)
/srv/salt/centos/public_services/mysql/5/init.sls
include: - centos.public_services.mysql.5.packet - centos.public_services.mysql.5.my_cnf - centos.public_services.mysql.5.instance
/srv/salt/centos/public_services/mysql/5/packet.sls
mysql软件包要放到相应的目录中,具体位置参考下面配置
{% set version=pillar[ 'mysql' ][ 'version' ]%} |
{%set version=pillar['mysql']['version']%} mysql: user.present: - home: /home/mysql - shell: /sbin/nologin /usr/local/nagios/libexec/check_safe -u: cmd.wait: - watch: - user: mysql /usr/local/src/mysql-{{version.replace('_','.')}}.tar.gz: file.managed: - source: salt://centos/public_services/mysql/5/{{version}}/mysql-{{version.replace('_','.')}}.tar.gz tar -xf mysql-{{version.replace('_','.')}}.tar.gz -C /usr/local/: cmd.run: - cwd: /usr/local/src - unless: ls -l /usr/local/ | grep -e ".* mysql-{{version.replace('_','.')}}$" /usr/local/mysql-{{version.replace('_','.')}}: file.directory: - user: mysql - group: mysql - recurse: - user - group /data/mysql_log: file.directory: - makedirs: True - user: mysql - group: mysql - recurse: - user - group /data/log-bin: file.directory: - makedirs: True - user: mysql - group: mysql - recurse: - user - group /usr/bin/mysql: file.symlink: - target: /usr/local/mysql-{{version.replace('_','.')}}/bin/mysql - unless: ls -l /usr/bin | grep -e " mysql$"
/srv/salt/centos/public_services/mysql/5/my_cnf.sls
注意修改最后的初始化密码
my.cnf配置文件需要放到对应的目录中,my.cnf文件中要设置对应的模板变量:
port= {{port}} #还有其它的和端口相关的配置都要改成{{port}} basedir=/usr/local/mysql-{{version}} #还有其它的和版本相关的配置都要改成{{version}}
#!py |
#!py #coding:utf-8 """ 生成my.cnf配置文件,如果文件已存在,不作任何修改 """ import os def run(): config={} version=__pillar__['mysql']['version'] for port in __pillar__['mysql']['ports']: port=str(port) if not os.path.isfile('/data/mysql_data_%s/my.cnf'%(port)): config['/data/mysql_data_%s/my.cnf'%(port)]={ 'file.managed':[ {'source':'salt://centos/public_services/mysql/5/%s/my.cnf'%(version)}, {'template':'jinja'}, {'context':{'port':port,'version':'%s'%(version.replace('_','.'))}}, {'require':[{'file':'/data/mysql_data_%s'%(port)}]}, ], } config['chown mysql.mysql /data/mysql_data_%s/my.cnf'%(port)]='cmd.run' return config
/srv/salt/centos/public_services/mysql/5/instance.sls
mysql启动脚本需要放到对应的目录中,启动脚本中要设置对应的模板变量:
basedir=/usr/local/mysql-{{version}} #还有其它的和版本相关的配置都要改成{{version}} datadir=/data/mysql_data_{{port}} #还有其它的和端口相关的配置都要改成{{port}}
{% for port in pillar[ 'mysql' ][ 'ports' ] %} |
{% for port in pillar['mysql']['ports'] %} /data/mysql_data_{{port}}: file.directory: - makedirs: True - user: mysql - group: mysql - recurse: - user - group /etc/init.d/mysqld_{{port}}: file.managed: - source: salt://centos/public_services/mysql/5/{{pillar['mysql']['version']}}/mysql.service - user: root - group: root - mode: 755 - template: jinja - context: port: {{port}} version: {{pillar['mysql']['version'].replace('_','.')}} chkconfig --add mysqld_{{port}};chkconfig --level 345 mysqld_{{port}} on;: cmd.run: - unless: chkconfig --list | grep mysqld_{{port}} #初始化库 init_mysql_{{port}}: cmd.run: - name: /usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}}/scripts/mysql_install_db --user=mysql --basedir=/usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}} --datadir=/data/mysql_data_{{port}}/ - unless: ls -l /data/mysql_data_{{port}} | grep -e ".* mysql$" /etc/init.d/mysqld_{{port}} start: cmd.wait: - watch: - cmd: init_mysql_{{port}} /usr/local/mysql-{{pillar['mysql']['version'].replace('_','.')}}/bin/mysqladmin -uroot -S /tmp/mysql_{{port}}.sock password 'yourmysqlpasswd!': cmd.wait: - watch: - cmd: init_mysql_{{port}} {%endfor%}
四,总结
这个方法不仅可以用在mysql,同样的nginx,redis等都可以举一反三,配置文件编写完成后,仅仅需要简单的在pillar中添加几个变量就可以轻松批量部署了。
转载请注明:爱开源 » saltstack应用之批量部署mysql