Spark独立运行作业错误

Spark独立运行作业错误

已经被这个错误困扰了好几天了,迫切需要帮助。

因此,在独立部署模式下,我尝试运行示例作业,但无论作业多么简单(甚至启动 spark-shell 并计算数字数组),以下错误都会不断弹出(循环日志信息的完整周期):

INFO AppClient$ClientActor: Executor added: app-20150604024526-0001/3 on worker-20150604023842-localhost-54417 (localhost:54417) with 1 cores
INFO SparkDeploySchedulerBackend: Granted executor ID app-20150604024526-0001/3 on hostPort localhost:54417 with 1 cores, 512.0 MB RAM

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/3 is now RUNNING

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/3 is now LOADING

WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/2 is now EXITED (Command exited with code 1)

INFO SparkDeploySchedulerBackend: Executor app-20150604024526-0001/2 removed: Command exited with code 1

ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 2

任何见解或建议都将不胜感激!非常感谢!

相关内容