Hadoop Yarn connection refused 警告
$ start-dfs.sh
16/01/17 16:17:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [OpenJDK Client VM warning: You have loaded library /home/tizen/share/software/hadoop-2.7.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It"s highly recommended that you fix the library with "execstack -c <libfile>", or link it with "-z noexecstack".
namenode]
-c: Unknown cipher type "cd"
sed: -e 表达式 #1, 字符 6: “s”的未知选项↵
It"s: ssh: Could not resolve hostname it"s: Name or service not known
"execstack: ssh: Could not resolve hostname "execstack: Name or service not known
warning:: ssh: Could not resolve hostname warning:: Name or service not known
<libfile>",: ssh: Could not resolve hostname <libfile>",: Name or service not known
link: ssh: Could not resolve hostname link: No address associated with hostname
"-z: ssh: Could not resolve hostname "-z: Name or service not known
it: ssh: Could not resolve hostname it: No address associated with hostname
noexecstack".: ssh: Could not resolve hostname noexecstack".: Name or service not known
namenode: starting namenode, logging to /usr/local/hadoop/logs/hadoop-tizen-namenode-samsung.out
to: ssh: connect to host to port 22: Connection refused
VM: ssh: connect to host vm port 22: Connection timed out
16/01/17 16:17:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [OpenJDK Client VM warning: You have loaded library /home/tizen/share/software/hadoop-2.7.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It"s highly recommended that you fix the library with "execstack -c <libfile>", or link it with "-z noexecstack".
namenode]
-c: Unknown cipher type "cd"
sed: -e 表达式 #1, 字符 6: “s”的未知选项↵
It"s: ssh: Could not resolve hostname it"s: Name or service not known
"execstack: ssh: Could not resolve hostname "execstack: Name or service not known
warning:: ssh: Could not resolve hostname warning:: Name or service not known
<libfile>",: ssh: Could not resolve hostname <libfile>",: Name or service not known
link: ssh: Could not resolve hostname link: No address associated with hostname
"-z: ssh: Could not resolve hostname "-z: Name or service not known
it: ssh: Could not resolve hostname it: No address associated with hostname
noexecstack".: ssh: Could not resolve hostname noexecstack".: Name or service not known
namenode: starting namenode, logging to /usr/local/hadoop/logs/hadoop-tizen-namenode-samsung.out
to: ssh: connect to host to port 22: Connection refused
VM: ssh: connect to host vm port 22: Connection timed out
Client: ssh: connect to host client port 22: Connection timed out
尽管有这么多的警告,但是jps后发现主节点的namenode datanode secondary node 及次节点的datanode均已启动成功。
查阅很多文档,大多认为系统或者jdk是64位的,但是hadoop是32位的,因此,需要在环境变量中增加下面两行:
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"
但是我尝试后仍然无法去除上面的警告。
后来file native 下的hadoop.so.0.0.1发现,原来hadoop是64位的,而我的系统是32位的。
因此,在hadoop2.4后,官方提供的是64位的版本,因此需要自己下载source包编译。
编译过程见后续文章。
声明:该文观点仅代表作者本人,牛骨文系教育信息发布平台,牛骨文仅提供信息存储空间服务。
- 上一篇: python 判断文件和文件夹是否存在的方法
- 下一篇: Lost executor on YARN