☰

在 Windows 10 上运行 Hadoop 2.8.0，YarnRuntimeException 权限设置不正确，应该是 rwxr-xr-x，实际值 = rw-rw-rw-

tag-icon • tag-icon hadoop
在 Windows 10 上运行 Hadoop 2.8.0，YarnRuntimeException 权限设置不正确，应该是 rwxr-xr-x，实际值 = rw-rw-rw-

我最近关注了一篇文章https://www.quora.com/How-do-I-install-Hadoop-2-8-2-on-Windows-10-for-practice，并尝试在我的 Windows 10 机器（i7，16GB RAM）上运行 Hadoop。它启动正常 - 没有问题。但是当我安装 Docker 时，反过来又启用了 Hyper-V，启动 NodeManager 时出现以下故障

18/12/19 21:29:31 INFO ipc.Server: IPC Server listener on 8040: starting
18/12/19 21:29:31 WARN localizer.ResourceLocalizationService: Permissions incorrectly set for dir /tmp/hadoop-username/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rw-rw-rw-
18/12/19 21:29:31 INFO localizer.ResourceLocalizationService: Attempting to initialize /tmp/hadoop-username/nm-local-dir
18/12/19 21:29:31 WARN localizer.ResourceLocalizationService: Permissions incorrectly set for dir /tmp/hadoop-username/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rw-rw-rw-
18/12/19 21:29:31 WARN localizer.ResourceLocalizationService: Failed to setup local dir /tmp/hadoop-username/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir /tmp/hadoop-username/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rw-rw-rw-
...

以下服务启动时没有任何问题

  • 资源管理器
  • 数据节点
  • 名称节点

答案1

将 yarn-site.xml 更改为此对我有用。在我的情况下，这是由于无法访问 Windows 域。

<configuration>

<!-- Site specific YARN configuration properties -->
     <property>
        <name>yarn.resourcemanager.hostname</name>
        <value>0.0.0.0</value>
    </property>
<property>
        <name>yarn.nodemanager.local-dirs</name>
        <value>c:\my\hadoop-2.7.1\tmp-nm</value>
</property>

    <property>
        <name>yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage</name>
        <value>98.5</value>
    </property>
</configuration>

相关内容