Hadoop分布式集群搭建

1.上传jdk、hadoop-26.0-chh5.14.tar.gz并解压缩

1.1.cdh

[cdh5](http://archive.cloudera.com/cdh5/cdh/5/)

[cdh6](https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_60_packaging.html)

1.2.创建hadoop用户,配置ssh免登录

ssh-keygen (全部回车,无需输入)

ssh-copy-id -i /root/.ssh/id_rsa.pub node1

ssh-copy-id -i /root/.ssh/id_rsa.pub node2

ssh-copy-id -i /root/.ssh/id_rsa.pub node3

ssh-copy-id -i /root/.ssh/id_rsa.pub node4

ssh-copy-id -i /root/.ssh/id_rsa.pub node5

ssh node1

1.3 创建软件目录并分配权限

mkdir /opt/software && chown _R hadoop:hadoop /opt/

1.4 上传安装包

jdk、hadoop

1.5 分发到其他服务器

scp jdk-8u144-linux-x64.tar.gz slavel:opt/software/jdk-8u144-linux-x64.tar.gz 

1.6 解压

2.配置.bashrc

3.配置hadoop-env.sh

4.配置mapred-env.sh

5.配置yarn-env.sh

6.配置core-site.xml

7.配置yarn-site.xml

8.配置hdfs-site.xml

9.配置mapred-site.xml

10.将配置好的hadoop发送到其他机器

11.发送.bashrc

12.hadoop namenode -format

格式化

启动hdfs start-dfs.sh

查看 jps