问题描述#xff1a;

IPhostname10.0.0.10host1010.0.0.12host1210.0.0.13host13

在这三台主机上部署…

转载说明如果您喜欢这篇文章并打算转载它请私信作者取得授权。

感谢您喜爱本文请文明转载谢谢。

问题描述

IPhostname10.0.0.10host1010.0.0.12host1210.0.0.13host13

在这三台主机上部署一套zookeeperkafka集群环境的时候zk集群进程和端口都起来了。

然后在启动kafka的时候报错了提示连不上zk。

因为该环境要求必须开启防火墙所以想到应该是因为2181端口没有开放所以kafka去连zk提示连不上。

于是在修改了防火墙打开了2181端口和kafka的9092端口

[roothost10

/usr/local/kafka_2.11-0.11.0.0/bin/kafka-server-start.sh

/usr/local/kafka_2.11-0.11.0.0/config/server.properties

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(org.I0Itec.zkclient.ZkEventThread)

[2018-06-15

(org.apache.zookeeper.ZooKeeper)

[2018-06-15

org.I0Itec.zkclient.exception.ZkTimeoutException:

Unable

10.0.0.10:2181,10.0.0.12:2181,10.0.0.13:2181

with

org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)at

org.I0Itec.zkclient.ZkClient.init(ZkClient.java:157)at

org.I0Itec.zkclient.ZkClient.init(ZkClient.java:131)at

kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:103)at

kafka.utils.ZkUtils$.apply(ZkUtils.scala:85)at

kafka.server.KafkaServer.initZk(KafkaServer.scala:338)at

kafka.server.KafkaServer.startup(KafkaServer.scala:191)at

kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)at

kafka.Kafka$.main(Kafka.scala:65)at

[2018-06-15

(org.apache.zookeeper.ClientCnxn)

[2018-06-15

(kafka.server.KafkaServerStartable)

[2018-06-15

(kafka.server.KafkaServer)查看kafka的配置并未发现任何异常。

于是检查zk自身是否OK。

但是进程、端口都一切正常。

[roothost10

environment:zookeeper.version3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f,

built

watcherorg.apache.zookeeper.ZooKeeperMain$MyWatcher1a86f2f1

Welcome

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

localhost/0:0:0:0:0:0:0:1:2181.

Will

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

localhost/0:0:0:0:0:0:0:1:2181,

initiating

[main-SendThread(localhost:2181):ClientCnxn$SendThread1158]

Unable

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

[main-SendThread(localhost:2181):ClientCnxn$SendThread1158]

Unable

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

localhost/0:0:0:0:0:0:0:1:2181.

Will

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

localhost/0:0:0:0:0:0:0:1:2181,

initiating

[main-SendThread(localhost:2181):ClientCnxn$SendThread1158]

Unable

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

[main-SendThread(localhost:2181):ClientCnxn$SendThread1158]

Unable

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

localhost/0:0:0:0:0:0:0:1:2181.

Will

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

localhost/0:0:0:0:0:0:0:1:2181,

initiating

[main-SendThread(localhost:2181):ClientCnxn$SendThread1158]

Unable

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

1、zk的myid文件和配置文件server.xx的编号对不上

[roothost10

/usr/local/zookeeper-3.4.10/conf/zoo.cfg

The

server.310.0.0.13:2888:38882、zookeeper的配置文件zoo.cfg里面配置了三个server实际上其他两个节点没有起来因此根据zookeeper的选举算法当整个集群超过半数机器宕机zookeeper会认为集群处于不可用状态。

试着将其中一台zk节点10.0.0.10修改zoo.cfg注释掉配置的其他两个server只留本机的server配置

[roothost10

/usr/local/zookeeper-3.4.10/conf/zoo.cfg

The

#server.310.0.0.13:2888:3888然后使用zkCli.sh去检测zk状态就是OK的

[roothost10

/usr/local/zookeeper-3.4.10/bin/

[roothost10

environment:zookeeper.version3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f,

built

watcherorg.apache.zookeeper.ZooKeeperMain$MyWatcher1a86f2f1

Welcome

[main-SendThread(localhost:2181):ClientCnxn$SendThread1032]

Opening

localhost/0:0:0:0:0:0:0:1:2181.

Will

[main-SendThread(localhost:2181):ClientCnxn$SendThread876]

Socket

localhost/0:0:0:0:0:0:0:1:2181,

initiating

[main-SendThread(localhost:2181):ClientCnxn$SendThread1299]

Session

localhost/0:0:0:0:0:0:0:1:2181,

sessionid

0]于是想到是防火墙只开了zookeeper的2181端口。

zk有三个端口

1、2181对cline端提供服务

因为防火墙的作用三个节点之间2888和3888端口都是互相不通的因此集群之前没有办法通信可能就会以为是剩下两个节点都挂掉了。

于是就出现了上面的报错

[roothost10