继续浏览精彩内容
慕课网APP
程序员的梦工厂
打开
继续
感谢您的支持,我会继续努力的
赞赏金额会直接到老师账户
将二维码发送给自己后长按识别
微信支付
支付宝支付

大数据Hadoop为什么这么受欢迎?

青春有我
关注TA
已关注
手记 1244
粉丝 205
获赞 1011

1、环境准备 7台机器

miniMaster1 ResourceManager1 QuorumPeerMain

miniMaster2 ResourceManager2 QuorumPeerMain

miniMaster3 QuorumPeerMain

miniSlave1 NodeManager

miniSlave2 NodeManager

miniSlave3 NodeManager

miniSlave4 NodeManager

关闭防火墙,selinux(所有虚拟机),ssh免秘钥,jdk,hosts,zk

2、YARN HA 配置

yarn-site.xml



Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->




yarn.resourcemanager.hostname

miniMaster1


yarn.nodemanager.aux-services

mapreduce_shuffle


yarn.resourcemanager.ha.enabled

true


yarn.resourcemanager.cluster-id

cluster1


yarn.resourcemanager.ha.rm-ids

rm1,rm2


yarn.resourcemanager.hostname.rm1

miniMaster1


yarn.resourcemanager.hostname.rm2

miniMaster2


yarn.resourcemanager.zk-address

miniMaster1:2181,miniMaster2:2181,miniMaster3:2181


yarn.resourcemanager.scheduler.class

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler


yarn.nodemanager.pmem-check-enabled

false


yarn.nodemanager.vmem-check-enabled

false

3、YARN 资源调度配置


Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at




作者:清风_d587
链接:https://www.jianshu.com/p/2acb35892504


打开App,阅读手记
0人推荐
发表评论
随时随地看视频慕课网APP