1. Zuhause
  2. Frage und Antwort
  3. Kafka Zookeeper Verbindung gibt

Kafka Zookeeper Verbindung gibt

2015-01-19 11 views
5

Ich bin mit Kafka 0.8.2-beta und haben 2 Ubuntu 14 virtuelle Maschinen:Kafka Zookeeper Verbindung gibt

  1. 172.30.141.127 läuft Zookeeper
  2. 172.30.141.184 läuft ein Kafka-Broker

Ich starte die Zookeeper-Instanz und alles ist in Ordnung. Dann versuche ich den Broker zu starten und verbinde ihn mit 172.30.141.127:2181. Es scheint in der Lage zu sein, eine Verbindung zu einem bestimmten Port herzustellen und eine Verbindung aufzubauen, aber dann verliert es die Verbindung aufgrund einer Ausnahme, die nicht protokolliert zu sein scheint.

Der Broker Ausgang:

[2015-01-19 11:03:55,029] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,030] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,031] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,031] INFO Client environment:os.arch=i386 (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,032] INFO Client environment:os.version=3.16.0-23-generic (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,033] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,033] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,037] INFO Client environment:user.dir=/home/osboxes/Desktop/kafka_2.11-0.8.2-beta (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,039] INFO Initiating client connection, connectString=172.30.141.127:2181 sessionTimeout=6000 [email protected] (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,129] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:55,186] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:55,203] WARN Session 0x0 for server 172.30.141.127/172.30.141.127:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) 
java.io.IOException: Connection reset by peer 
    at sun.nio.ch.FileDispatcherImpl.read0(Native Method) 
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) 
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) 
    at sun.nio.ch.IOUtil.read(IOUtil.java:192) 
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366) 
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 
[2015-01-19 11:03:56,552] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:56,555] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:56,567] WARN Session 0x0 for server 172.30.141.127/172.30.141.127:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) 
java.io.IOException: Connection reset by peer 
    at sun.nio.ch.FileDispatcherImpl.read0(Native Method) 
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) 
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) 
    at sun.nio.ch.IOUtil.read(IOUtil.java:192) 
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366) 
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 
[2015-01-19 11:03:57,131] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) 
[2015-01-19 11:03:58,075] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,077] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,195] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:58,196] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,251] FATAL [Kafka Server 1], Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) 
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84) 
    at kafka.server.KafkaServer.initZk(KafkaServer.scala:157) 
    at kafka.server.KafkaServer.startup(KafkaServer.scala:83) 
    at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:28) 
    at kafka.Kafka$.main(Kafka.scala:46) 
    at kafka.Kafka.main(Kafka.scala) 
[2015-01-19 11:03:58,279] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer) 
[2015-01-19 11:03:58,295] INFO [Kafka Server 1], shut down completed (kafka.server.KafkaServer) 
[2015-01-19 11:03:58,308] FATAL Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable) 
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84) 
    at kafka.server.KafkaServer.initZk(KafkaServer.scala:157) 
    at kafka.server.KafkaServer.startup(KafkaServer.scala:83) 
    at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:28) 
    at kafka.Kafka$.main(Kafka.scala:46) 
    at kafka.Kafka.main(Kafka.scala) 
[2015-01-19 11:03:58,335] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer)

Zookeper Ausgänge:

[2015-01-19 11:03:55,245] INFO Accepted socket connection from /172.30.141.184:54089 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:55,315] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:55,329] INFO Closed socket connection for client /172.30.141.184:54089 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:56,613] INFO Accepted socket connection from /172.30.141.184:54090 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:56,615] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:56,617] INFO Closed socket connection for client /172.30.141.184:54090 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:58,133] INFO Accepted socket connection from /172.30.141.184:54091 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:58,134] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:58,135] INFO Closed socket connection for client /172.30.141.184:54091 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn)

Ping arbeitet zwischen den zwei Maschinen. Telnet zu 2181 Art von Arbeiten, in dem es verbindet, aber von Zeit zu Zeit getrennt wird. Das führt mich zu der Annahme, dass das Problem bei der Zookeeper-Instanz liegt. Beide Prozesse werden als Root gestartet.

Irgendwelche Ideen, warum das passiert? Dank

Quelle

2015-01-19 sebi

Antwort

0

Keine Ahnung über die Warnung, aber ich hatte das gleiche Problem Fehler

org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    ....

In meinem Fall, als ich die Einrichtung Erzeuger und Verbraucher, I zur Verfügung gestellt falsch IP/Port. Wenn ich es änderte, um eins mit zu korrigieren:

bin/kafka-console-producer.sh --broker-list kafka_ip:kafka_port --topic test 
bin/kafka-console-consumer.sh --zookeeper zookeeper_id:zookeper_port --topic test --from-beginning

mein Problem wurde gelöst.

Quelle

2015-01-22 04:39:02

3

Sie treffen wahrscheinlich die maximale Anzahl von Verbindungen pro Host.

Das passiert, wenn Sie [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:[email protected]] - Too many connections from /127.0.0.1 - max is 10 in Ihren Tierpflegerprotokollen haben.

Beheben Sie es durch Einstellung maxClientCnxns=[something more than 10; 0 for unlimited] in Ihrem conf/zoo.cfg.

Docs (Suche nach maxClientCnxns)

Quelle

2015-09-18 09:43:31 RickyA

Verwandte Themen

 Verwandte Themen