PubSub Kafka Connect Knotenverbindung Dateiende Ausnahme

Question

Während des Laufens PubSub Kafka mit dem Befehl an:

.\bin\windows\connect-standalone.bat .\etc\kafka\WorkerConfig.properties 
.\etc\kafka\configSink.properties .\etc\kafka\configSource.properties 

ich diesen Fehler:

Sending metadata request {topics=[test]} to node -1 
could not scan file META-INF/MANIFEST.MF in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner SubTypesScanner 
could not scan file META-INF/MANIFEST.MF in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner TypeAnnotationsScanner 
could not scan file META-INF/LICENSE.txt in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner SubTypesScanner 
could not scan file META-INF/LICENSE.txt in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner TypeAnnotationsScanner 
could not scan file META-INF/NOTICE.txt in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner SubTypesScanner 
could not scan file META-INF/NOTICE.txt in url file:/C:/confluent-3.3.0/bin/../share/java/kafka-serde-tools/commons-compress-1.8.1.jar with scanner TypeAnnotationsScanner 
Connection with localhost/127.0.0.1 disconnected 
java.io.EOFException 
    at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) 
    at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) 
    at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:154) 
    at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:135) 
    at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:323) 
    at org.apache.kafka.common.network.Selector.poll(Selector.java:283) 
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260) 
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360) 
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224) 
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192) 
    at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163) 
    at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:181) 
    at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:229) 
    at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:366) 
    at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:975) 
    at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938) 
    at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:316) 
    at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:222) 
    at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170) 
    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142) 
    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140) 
    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175) 
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
    at java.lang.Thread.run(Thread.java:745) 
Node -1 disconnected. 
Bootstrap broker localhost:2181 disconnected 
Cancelled GROUP_COORDINATOR request ClientRequest(expectResponse=true, callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@643b72cb, request=RequestSend(header={api_key=10,api_version=0,correlation_id=0,client_id=consumer-1}, body={group_id=connect-CPSConnectorSink}), createdTimeMs=1504105687600, sendTimeMs=1504105687724) with correlation id 0 due to node -1 being disconnected 
Give up sending metadata request since no node is available 

Ich bin eine lokale kafka Broker und lokale zookeeper läuft . Jede Hilfe zur Lösung dieses Problems wäre großartig!

Objektdateien here

Answer 1

So, nach verschiedenen Korrekturen versuchen, fand ich heraus, dass ich die falsche Portnummer für localhost wurde mit. Der Port 2181 wurde vom Zookeeper benutzt, während der Port 9092 von Kafka Server benutzt wurde. Also, meine ursprüngliche Eigenschaft in WorkerConfig.properties war:

bootstrap.servers=localhost:2181 

Wenn es

bootstrap.server=localhost:9092 

so sein sollte, Moral der Geschichte sicher zu machen ist, dass Sie mit der richtigen Host und Portnummer Ihres Kafka-Server in Ihrer Connector-Eigenschaftendatei, wobei meine WorkerConfig ist. Dies wird gezeigt here. Das klingt nach einem gesunden Menschenverstand, aber ich habe die Portnummer geändert, während ich versucht habe, andere Fehler zu beheben, aber unwissentlich einen weiteren Fehler hinzugefügt. Wenn Sie den obigen Fehler erhalten, überprüfen Sie die Eigenschaft bootstrap.server.