0
ich habe Funken von „https://spark.apache.org/downloads.html“Fehler beim Funken im Standalone-Modus drehen
Aber kann sie nicht ausführen kann, erhalten die folgende Fehlermeldung, wenn ich versuche es im Standalone-Modus zu starten, wie hier erwähnt " https://spark.apache.org/docs/latest/spark-standalone.html ". Bitte Beratung
adminisatorsmbp:spark-2.0.1-bin-hadoop2.7 amit$ ./sbin/start-master.sh
starting org.apache.spark.deploy.master.Master, logging to /Users/amit/Documents/Analytics/kaggle/Bosch/spark-2.0.1-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.master.Master-1-adminisatorsmbp.out
failed to launch org.apache.spark.deploy.master.Master:
at java.net.InetAddress.getLocalHost(InetAddress.java:1471)
... 10 more
full log in /Users/amit/Documents/Analytics/kaggle/Bosch/spark-2.0.1-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.master.Master-1-adminisatorsmbp.out
adminisatorsmbp:spark-2.0.1-bin-hadoop2.7 amit$
Hier sind die vollständigen Protokolle
Spark Command: /Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/bin/java -cp /Users/amit/Documents/Analytics/kaggle/Bosch/spark-2.0.1-bin-hadoop2.7/conf/:/Users/amit/Documents/Analytics/kaggle/Bosch/spark-2.0.1-bin-hadoop2.7/jars/* -Xmx1g -XX:MaxPermSize=256m org.apache.spark.deploy.master.Master --host adminisatorsmbp --port 7077 --webui-port 8080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/10/24 17:40:26 INFO Master: Started daemon with process name: [email protected]
16/10/24 17:40:26 INFO SignalUtils: Registered signal handler for TERM
16/10/24 17:40:26 INFO SignalUtils: Registered signal handler for HUP
16/10/24 17:40:26 INFO SignalUtils: Registered signal handler for INT
Exception in thread "main" java.net.UnknownHostException: adminisatorsmbp: adminisatorsmbp: nodename nor servname provided, or not known
at java.net.InetAddress.getLocalHost(InetAddress.java:1475)
at org.apache.spark.util.Utils$.findLocalInetAddress(Utils.scala:866)
at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress$lzycompute(Utils.scala:859)
at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress(Utils.scala:859)
at org.apache.spark.util.Utils$$anonfun$localHostName$1.apply(Utils.scala:916)
at org.apache.spark.util.Utils$$anonfun$localHostName$1.apply(Utils.scala:916)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.util.Utils$.localHostName(Utils.scala:916)
at org.apache.spark.deploy.master.MasterArguments.<init>(MasterArguments.scala:30)
at org.apache.spark.deploy.master.Master$.main(Master.scala:1010)
at org.apache.spark.deploy.master.Master.main(Master.scala)
Caused by: java.net.UnknownHostException: adminisatorsmbp: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1295)
at java.net.InetAddress.getLocalHost(InetAddress.java:1471)
... 10 more
versuchen Sie, dies in einem Cluster auszuführen? – jtitusj
Kein Standalone nur – Amit
verwenden Sie nur einen einzigen Computer dafür? Wenn dies der Fall ist, können Sie mit './bin/spark-shell' eigenständig starten, ohne Änderungen am Download vorzunehmen. – jtitusj