Posted on | In

SecondaryNamenode Checkpoint 故障一例

SecondaryNameNode Side 错误提示

1
2
3
2012-06-19 19:56:45,711 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hadoop-user cause:java.net.ConnectException: Connection refused
2012-06-19 19:56:45,711 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint: 
2012-06-19 19:56:45,712 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: java.net.ConnectException: Connection refused
Read more »

Posted on | In

hadoop集群动态摘除节点

  • 将待解除节点的网络地址添加到exclude文件中，不更新include文件。

exclude文件只存在于namenode本地

1
2
3
4
5
6
7
8
9
10
hdfs-site.xml
<property>
<name>dfs.hosts.exclude</name>
<value>exclude</value>
</property>
mapred-site.xml
<property>
<name>mapred.hosts.exclude</name>
<value>exclude</value>
</property>
Read more »