手记

大数据Hadoop为什么这么受欢迎?

1、环境准备 7台机器

miniMaster1 ResourceManager1 QuorumPeerMain

miniMaster2 ResourceManager2 QuorumPeerMain

miniMaster3 QuorumPeerMain

miniSlave1 NodeManager

miniSlave2 NodeManager

miniSlave3 NodeManager

miniSlave4 NodeManager

关闭防火墙,selinux(所有虚拟机),ssh免秘钥,jdk,hosts,zk

2、YARN HA 配置

yarn-site.xml



Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->




yarn.resourcemanager.hostname

miniMaster1


yarn.nodemanager.aux-services

mapreduce_shuffle


yarn.resourcemanager.ha.enabled

true


yarn.resourcemanager.cluster-id

cluster1


yarn.resourcemanager.ha.rm-ids

rm1,rm2


yarn.resourcemanager.hostname.rm1

miniMaster1


yarn.resourcemanager.hostname.rm2

miniMaster2


yarn.resourcemanager.zk-address

miniMaster1:2181,miniMaster2:2181,miniMaster3:2181


yarn.resourcemanager.scheduler.class

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler


yarn.nodemanager.pmem-check-enabled

false


yarn.nodemanager.vmem-check-enabled

false

3、YARN 资源调度配置


Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at




作者:清风_d587
链接:https://www.jianshu.com/p/2acb35892504


0人推荐
随时随地看视频
慕课网APP