hadoop 2.2エラーのまとめ
3304 ワード
hadoop 2.2構築
http://blog.csdn.net/pelick/article/details/12065147
1
でも、この配置にはちょっと問題があります。
＜property＞yarn.nodemanager.aux-services mapreduce.shuffle に変更する
＜property＞yarn.nodemanager.aux-services mapreduce_shuffle さもないとこのようなエラーが発生します。
java.lang.IllagalArgmentException:The ServiceName:mapredine.shuffle set in yarn.nodemanager.aux-services is in valid.The valid service name Shuld only contain a-zA-Z 0-9_
エラーログは
hadoop-23.0/logs/yarn-hadoop-nodemanager-cs 212.logs
2
追加
export HADOOP_COMMON_LIB_NATIVE_DIR={HADOOPUPREFIX}/lib/native export HADOOP_OPETS=「-Djava.library.path=$HADOOPAUPREFIX/lib」
次のエラーが発生します。
Hadoop 2.2.0-warning:You have loaded library/home/hadoop/2.2.0/lib/native/libhadoop.so.1.0 which might have disabled stack Grand.
ou add a variable on.bash_profile$nano~/.bash_profile export HADOOP_COMMON_LIB_NATIVE_DIR={HADOOPUPREFIX}/lib/native export HADOOP_OPETS=「-Djava.library.path=$HADOOPAUPREFIX/lib」
Apple it.$source~/.bash_profile
And.startingstart-all.sh
3.
centosはデフォルトでipv 6を開いています。 hadoop 8088のサービスは全く開けられません。
centos 6 linuxはIPv 6を禁止して、大量のTIME_を解決します。WAIT：：ffff：127..1:59299
多くのサービスを設置していないとアクセスできません。
http://www.qbage.com/post/48-centos6-disable-ipv6.html
eclipse hadoop fatjar安
http://mclspace.com/2015/05/10/Fatjar-install/
http://blog.csdn.net/pelick/article/details/12065147
1
でも、この配置にはちょっと問題があります。
＜property＞
＜property＞
java.lang.IllagalArgmentException:The ServiceName:mapredine.shuffle set in yarn.nodemanager.aux-services is in valid.The valid service name Shuld only contain a-zA-Z 0-9_
エラーログは
hadoop-23.0/logs/yarn-hadoop-nodemanager-cs 212.logs
2
追加
export HADOOP_COMMON_LIB_NATIVE_DIR={HADOOPUPREFIX}/lib/native export HADOOP_OPETS=「-Djava.library.path=$HADOOPAUPREFIX/lib」
次のエラーが発生します。
Hadoop 2.2.0-warning:You have loaded library/home/hadoop/2.2.0/lib/native/libhadoop.so.1.0 which might have disabled stack Grand.
Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /home/hadoop/2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
localhost]
sed: -e expression #1, char 6: unknown option to `s'
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Name or service not known
64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known
Java: ssh: Could not resolve hostname Java: Name or service not known
Server: ssh: Could not resolve hostname Server: Name or service not known
VM: ssh: Could not resolve hostname VM: Name or service not known
ou add a variable on.bash_profile$nano~/.bash_profile export HADOOP_COMMON_LIB_NATIVE_DIR={HADOOPUPREFIX}/lib/native export HADOOP_OPETS=「-Djava.library.path=$HADOOPAUPREFIX/lib」
Apple it.$source~/.bash_profile
And.startingstart-all.sh
3.
centosはデフォルトでipv 6を開いています。 hadoop 8088のサービスは全く開けられません。
centos 6 linuxはIPv 6を禁止して、大量のTIME_を解決します。WAIT：：ffff：127..1:59299
多くのサービスを設置していないとアクセスできません。
http://www.qbage.com/post/48-centos6-disable-ipv6.html
eclipse hadoop fatjar安
http://mclspace.com/2015/05/10/Fatjar-install/