-ElasticSearch的单点部署集群部署多实例部署es-head和postman环境搭建

0、ElasticSearch的简单介绍1、ElasticSearch的单点部署2、ElasticSearch的集群部署3、基于二进制部署ElasticSearch3.1

准备阶段3.2

DISK:50Gelk101.oldboyedu.com10.0.0.102CPU:2C

MEMORY:4G

DISK:50Gelk102.oldboyedu.com10.0.0.103CPU:2C

MEMORY:4G

https://www.elastic.co/cn/downloads

(2)老男孩线下同学下载

elasticsearch-7.17.5-x86_64.rpm

http://192.168.15.253/ElasticStack/softwares/rpm/elasticsearch-7.17.5-x86_64.rpm(3)安装es

rpm

elasticsearch-7.17.5-x86_64.rpm

vim

/etc/elasticsearch/elasticsearch.yml

...

对ES集群外部提供http/https服务。

可以理解为对客户端提供服务。

9300端口作用:

10.0.0.101:9200如果遇到集群的uuid为_na_情况时可以执行如下操作:

vim

/etc/elasticsearch/elasticsearch.yml

[10.0.0.101]

10.0.0.101:92002、ElasticSearch的集群部署

(1)下载ES软件包

https://www.elastic.co/cn/downloads

(2)老男孩线下同学下载

elasticsearch-7.17.5-x86_64.rpm

http://192.168.15.253/ElasticStack/softwares/rpm/elasticsearch-7.17.5-x86_64.rpm(3)所有节点安装es

rpm

elasticsearch-7.17.5-x86_64.rpm

systemctl

/etc/elasticsearch/elasticsearch.yml

...#

[10.0.0.101,10.0.0.102,10.0.0.103]#

[10.0.0.101,10.0.0.102,10.0.0.103](6)将配置文件分发到其他两个节点

scp

/etc/elasticsearch/elasticsearch.yml

10.0.0.102:/etc/elasticsearch/elasticsearch.yml

scp

/etc/elasticsearch/elasticsearch.yml

10.0.0.103:/etc/elasticsearch/elasticsearch.yml(6)所有节点启动ES服务

systemctl

半数以上机器存活则集群正常为了防止脑裂半数以上机器不存活的话集群不提供对外服务[rootelk101.oldboyedu.com

~]#

elk101.oldboyedu.comheap.percent

堆内存使用百分比

((host_id101;host_id103;host_id));do

ssh-copy-id

((host_id102;host_id103;host_id))do#

使得终端输出变为绿色tput

whoamielk${host_id}.oldboyedu.com:$fullpathif

-eq

/usr/local/sbin/data_rsync.sh3.2

部署阶段

elasticsearch-7.17.5-linux-x86_64.tar.gz

http://192.168.15.253/ElasticStack/softwares/binary/elasticsearch-7.17.5-linux-x86_64.tar.gz(3)所有节点创建运行ES服务的用户

useradd

oldboyedu(4)elk101创建ElasticSearch的工作目录

4.1

/oldboyedu/{data,logs,softwares}/es7

chown

/oldboyedu/{softwares,data,logs}/es7/

/oldboyedu/{data,logs,softwares}/es7

-d4.2

/oldboyedu/{data,logs,softwares}/es7

oldboyedu

elasticsearch-7.17.5-linux-x86_64.tar.gz

/oldboyedu/softwares/es7/(6)elk101修改配置文件

~]#

/oldboyedu/softwares/es7/elasticsearch-7.17.5/config/elasticsearch.yml

cluster.name:

[elk101.oldboyedu.com,elk102.oldboyedu.com,elk103.oldboyedu.com]

[elk101.oldboyedu.com,elk102.oldboyedu.com,elk103.oldboyedu.com](7)elk101同步程序目录

~]#

/etc/security/limits.d/es7.conf*

soft

vm.max_map_count524288[rootelk101.oldboyedu.com

~]#

524288[rootelk101.oldboyedu.com

~]#

/etc/security/limits.d/es7.conf

~]#

/oldboyedu/{softwares,data,logs}/es7/

oldboyedu

/oldboyedu/softwares/es7/elasticsearch-7.17.5/bin/elasticsearch

~]#

elk101.oldboyedu.com,cluster_name

oldboyedu-linux85-binary,cluster_uuid

{number

8d61b4f7ddf931f219e3745f295ed2bbc50c8e84,build_date

2022-06-23T21:57:28.736740635Z,build_snapshot

false,lucene_version

8.11.1,minimum_wire_compatibility_version

6.8.0,minimum_index_compatibility_version

6.0.0-beta1},tagline

elk103.oldboyedu.com补充若集群UUID出现_na_状态时做如下动作所有节点操作

pkill

/usr/lib/systemd/system/es7.service

EOF

ExecStart/oldboyedu/softwares/es7/elasticsearch-7.17.5/bin/elasticsearch

Useroldboyedu

10.0.0.101:9200/_cat/nodes6.其他节点使用脚本

data_rsync.sh

/usr/lib/systemd/system/es7.service7.其他节点使用脚本管理

pkill

http://192.168.15.253/ElasticStack/softwares/binary/jdk-8u291-linux-x64.tar.gz(2)elk101解压JDK软件包

tar

/oldboyedu/softwares/(3)elk101配置系统环境变量

~]#

JAVA_HOME/oldboyedu/softwares/jdk1.8.0_291

export

PATH$PATH:$JAVA_HOME/bin[rootelk101

~]#

/oldboyedu/softwares/jdk1.8.0_291/bin/java

~]#

/usr/lib/systemd/system/es7.service

EOF

EnvironmentJAVA_HOME/oldboyedu/softwares/jdk1.8.0_291

ExecStart/oldboyedu/softwares/es7/elasticsearch-7.17.5/bin/elasticsearch

Useroldboyedu

/oldboyedu/softwares/jdk1.8.0_291/bin/java

-Xshare:auto

-Des.networkaddress.cache.ttl60

-Des.networkaddress.cache.negative.ttl10

-XX:AlwaysPreTouch

-Dio.netty.noKeySetOptimizationtrue

-Dio.netty.recycler.maxCapacityPerThread0

-Dio.netty.allocator.numDirectArenas0

-Dlog4j.shutdownHookEnabledfalse

-Dlog4j2.formatMsgNoLookupstrue

-XX:CMSInitiatingOccupancyFraction75

-XX:UseCMSInitiatingOccupancyOnly

-Djava.io.tmpdir/tmp/elasticsearch-1143701341521397671

-XX:HeapDumpPathdata

-XX:ErrorFilelogs/hs_err_pid%p.log

-XX:PrintGCDetails

-XX:PrintGCApplicationStoppedTime

-Xloggc:logs/gc.log

-XX:MaxDirectMemorySize536870912

-Des.path.home/oldboyedu/softwares/es7/elasticsearch-7.17.5

-Des.path.conf/oldboyedu/softwares/es7/elasticsearch-7.17.5/config

-Des.distribution.flavordefault

-Des.bundled_jdktrue

/oldboyedu/softwares/es7/elasticsearch-7.17.5/lib/*

org.elasticsearch.bootstrap.Elasticsearch

root

/usr/lib/systemd/system/es7.service

data_rsync.sh

/oldboyedu/softwares/jdk1.8.0_291(8)其他节点重启服务

systemctl

/oldboyedu/softwares/es7/elasticsearch-7.17.5/config/jvm.options

...

-Xmx256m(2)elk101重启服务并验证堆内存大小若不配置默认1GB

[rootelk101

/oldboyedu/softwares/es7/elasticsearch-7.17.5/config/jvm.options(4)其他节点重启服务并验证堆内存大小

~]#

/oldboyedu/{data,logs,softwares}/es6

oldboyedu

http://192.168.15.253/ElasticStack/softwares/binary/elasticsearch-6.8.23.tar.gz(3)elk101解压软件包

tar

/oldboyedu/softwares/es6/elasticsearch-6.8.23/

(4)elk101修改配置文件

/oldboyedu/softwares/es6/elasticsearch-6.8.23/config/elasticsearch.yml

cluster.name:

discovery.zen.ping.unicast.hosts:

[elk101.oldboyedu.com,elk102.oldboyedu.com,elk103.oldboyedu.com]

discovery.zen.minimum_master_nodes:

~]#

/oldboyedu/softwares/es6/elasticsearch-6.8.23/config/jvm.options

...

/usr/lib/systemd/system/es6.service

EOF

EnvironmentJAVA_HOME/oldboyedu/softwares/jdk1.8.0_291

ExecStart/oldboyedu/softwares/es6/elasticsearch-6.8.23/bin/elasticsearch

Useroldboyedu

/usr/lib/systemd/system/es6.service(8)修改各节点的配置文件

~]#

/oldboyedu/softwares/es6/elasticsearch-6.8.23/config/elasticsearch.yml

...

elk102.oldboyedu.com[rootelk103.oldboyedu.com

~]#

/oldboyedu/softwares/es6/elasticsearch-6.8.23/config/elasticsearch.yml

...

10.0.0.101:9200/_cluster/health

2/dev/null

10.0.0.101:9200/_cluster/health

2/dev/null

oldboyedu-linux85-binary,status:

green,timed_out:

0,task_max_waiting_in_queue_millis:

0,active_shards_percent_as_number:

100

解决方案:观察配置是否生效建议将-Xms和-Xmx值配置一致。

今日作业:

完成课堂的所有练习并整理思维导图;使用zabbix监控ES服务

扩展作业:

使用ansible的playbook一键搭建ES6和ES7多实例服务