网站设为主页功能怎么做,贵阳有做网站的公司吗,零基础学软件开发难吗,在线识别图片找原图转载说明#xff1a;如果您喜欢这篇文章并打算转载它#xff0c;请私信作者取得授权。感谢您喜爱本文#xff0c;请文明转载#xff0c;谢谢。 问题描述#xff1a;
主机信息#xff1a;
IPhostname10.0.0.10host1010.0.0.12host1210.0.0.13host13
在这三台主机上部署… 转载说明如果您喜欢这篇文章并打算转载它请私信作者取得授权。感谢您喜爱本文请文明转载谢谢。 问题描述
主机信息
IPhostname10.0.0.10host1010.0.0.12host1210.0.0.13host13
在这三台主机上部署一套zookeeperkafka集群环境的时候zk集群进程和端口都起来了。然后在启动kafka的时候报错了提示连不上zk。 因为该环境要求必须开启防火墙所以想到应该是因为2181端口没有开放所以kafka去连zk提示连不上。于是在修改了防火墙打开了2181端口和kafka的9092端口
[roothost10 ~]# firewall-cmd --list-ports
2181/tcp 9092/tcp
[roothost10 ~]#然后重新启动kafka依旧报错报错信息如下
[roothost10 ~]# /usr/local/kafka_2.11-0.11.0.0/bin/kafka-server-start.sh /usr/local/kafka_2.11-0.11.0.0/config/server.properties
[2018-06-15 11:33:25,244] INFO KafkaConfig values:advertised.host.name null
...... 省略若干信息
[2018-06-15 11:33:26,693] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,219] INFO Opening socket connection to server 10.0.0.12/10.0.0.12181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,221] INFO Socket connection established to 10.0.0.12/10.0.0.12181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,222] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,910] INFO Opening socket connection to server 10.0.0.13/10.0.0.13181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,911] INFO Socket connection established to 10.0.0.13/10.0.0.13181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:28,913] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:29,901] INFO Opening socket connection to server 10.0.0.10/10.0.0.10181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:29,902] INFO Socket connection established to 10.0.0.10/10.0.0.10181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:29,905] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:31,133] INFO Opening socket connection to server 10.0.0.12/10.0.0.12181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:31,135] INFO Socket connection established to 10.0.0.12/10.0.0.12181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:31,136] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:31,379] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-06-15 11:33:31,553] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
[2018-06-15 11:33:31,555] FATAL Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server 10.0.0.10:2181,10.0.0.12:2181,10.0.0.13:2181 with timeout of 6000 msat org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)at org.I0Itec.zkclient.ZkClient.init(ZkClient.java:157)at org.I0Itec.zkclient.ZkClient.init(ZkClient.java:131)at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:103)at kafka.utils.ZkUtils$.apply(ZkUtils.scala:85)at kafka.server.KafkaServer.initZk(KafkaServer.scala:338)at kafka.server.KafkaServer.startup(KafkaServer.scala:191)at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)at kafka.Kafka$.main(Kafka.scala:65)at kafka.Kafka.main(Kafka.scala)
[2018-06-15 11:33:31,555] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
[2018-06-15 11:33:31,562] INFO shutting down (kafka.server.KafkaServer)
[2018-06-15 11:33:31,568] INFO shut down completed (kafka.server.KafkaServer)
[2018-06-15 11:33:31,568] FATAL Exiting Kafka. (kafka.server.KafkaServerStartable)
[2018-06-15 11:33:31,571] INFO shutting down (kafka.server.KafkaServer)查看kafka的配置并未发现任何异常。于是检查zk自身是否OK。但是进程、端口都一切正常。 使用./zkCli.sh去检查zk是否正常启动出现了报错
[roothost10 bin]# ./zkCli.sh
Connecting to localhost:2181
2018-06-15 14:44:05,215 [myid:] - INFO [main:Environment100] - Client environment:zookeeper.version3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
...... #省略若干信息
2018-06-15 14:44:05,225 [myid:] - INFO [main:ZooKeeper438] - Initiating client connection, connectStringlocalhost:2181 sessionTimeout30000 watcherorg.apache.zookeeper.ZooKeeperMain$MyWatcher1a86f2f1
Welcome to ZooKeeper!
2018-06-15 14:44:05,255 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2018-06-15 14:44:05,334 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
2018-06-15 14:44:05,348 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1158] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
[zk: localhost:2181(CONNECTING) 0] 2018-06-15 14:44:05,564 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2018-06-15 14:44:05,565 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/127.0.0.1:2181, initiating session
2018-06-15 14:44:05,573 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1158] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2018-06-15 14:44:07,626 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2018-06-15 14:44:07,627 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
2018-06-15 14:44:07,629 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1158] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2018-06-15 14:44:07,929 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2018-06-15 14:44:07,930 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/127.0.0.1:2181, initiating session
2018-06-15 14:44:07,932 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1158] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2018-06-15 14:44:09,329 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2018-06-15 14:44:09,330 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
2018-06-15 14:44:09,332 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1158] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2018-06-15 14:44:09,464 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)分析
查看了网上很多的文章有以下几种说法 1、zk的myid文件和配置文件server.xx的编号对不上 2、zk只启动了一个节点其他节点没有起来
排查 1、检查myid编号和配置文件是OK的能对上
[roothost10 ~]# cat /data/zookeeper/myid
1
[roothost10 ~]#
[roothost10 ~]# vim /usr/local/zookeeper-3.4.10/conf/zoo.cfg
# The number of milliseconds of each tick
tickTime2000
# The number of ticks that the initial
...... #省略若干
server.110.0.0.10:2888:3888 #server.1和myid文件的1是能对上的
server.210.0.0.12:2888:3888
server.310.0.0.13:2888:38882、zookeeper的配置文件zoo.cfg里面配置了三个server实际上其他两个节点没有起来因此根据zookeeper的选举算法当整个集群超过半数机器宕机zookeeper会认为集群处于不可用状态。
检查了三个节点的服务都是起来了的。 试着将其中一台zk节点10.0.0.10修改zoo.cfg注释掉配置的其他两个server只留本机的server配置
[roothost10 ~]# vim /usr/local/zookeeper-3.4.10/conf/zoo.cfg
# The number of milliseconds of each tick
tickTime2000
# The number of ticks that the initial
...... #省略若干
server.110.0.0.10:2888:3888 #注释掉server.2和server.3只剩下本机节点
#server.210.0.0.12:2888:3888
#server.310.0.0.13:2888:3888然后使用zkCli.sh去检测zk状态就是OK的
[roothost10 ~]# cd /usr/local/zookeeper-3.4.10/bin/
[roothost10 bin]# ./zkCli.sh
Connecting to localhost:2181
2018-06-15 15:58:10,586 [myid:] - INFO [main:Environment100] - Client environment:zookeeper.version3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
...... #省略若干
2018-06-15 15:58:10,597 [myid:] - INFO [main:ZooKeeper438] - Initiating client connection, connectStringlocalhost:2181 sessionTimeout30000 watcherorg.apache.zookeeper.ZooKeeperMain$MyWatcher1a86f2f1
Welcome to ZooKeeper!
2018-06-15 15:58:10,627 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2018-06-15 15:58:10,708 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread876] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
[zk: localhost:2181(CONNECTING) 0] 2018-06-15 15:58:10,733 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread1299] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid 0x164023cac190003, negotiated timeout 30000WATCHER::WatchedEvent state:SyncConnected type:None path:null[zk: localhost:2181(CONNECTED) 0]于是想到是防火墙只开了zookeeper的2181端口。zk有三个端口 3个端口的作用 1、2181对cline端提供服务 2、3888选举leader使用 3、2888集群内机器通讯使用Leader监听此端口
因为防火墙的作用三个节点之间2888和3888端口都是互相不通的因此集群之前没有办法通信可能就会以为是剩下两个节点都挂掉了。于是就出现了上面的报错
解决
1、重新修改防火墙打开2888和3888端口
[roothost10 ~]# firewall-cmd --list-ports3888/tcp 2181/tcp 2888/tcp 9092/tcp
[roothost10 ~]#2、为保证万一把整个zk集群全部按照顺序重启了一遍 3、三个几点依次都用zkCli.sh去连了一下状态都是OK的 4、重新启动kafka就OK啦
备注本文为迁移博文非近期遇到的故障
