求教:spark-submit提交作业到yarn上一直accepted? INFO yarn.Client: ...state: ACCEPTED)

(刚开始学spark的小白 谢谢大牛了?)

输入代码如下 $ spark-submit --master yarn --name spark-yarn /home/hadoop/script/spark04.py hdfs://hadoop000:8020/hello.txt hdfs://hadoop000:8020/hello/output

但是跑起来后一直卡着:(代码在local或者standalone都能正常执行)

19/05/17 22:44:03 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:04 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:05 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:06 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:07 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:08 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:09 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:10 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:11 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:12 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:13 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:14 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:15 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:16 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)


我的一些配置如下: yarn-site.xml只有这个

https://img.mukewang.com/5cdec93d00017a7905600215.jpg

capacity-scheduler.xml中yarn分配的也照网上的由0.1改为0.5了

https://img2.mukewang.com/5cdec9890001f9e907630197.jpg

节点也没挂

https://img1.mukewang.com/5cdec80700015bb103390247.jpg

请问要怎么做呢? 


慕数据5323124
浏览 4099回答 2
2回答

南山搬瓦工

这个至少有两种情况1,任务申请不到足够的资源启动2.  提交任务的用户被限制了。不能提交任务了

慕设计2395807

CLUCLUDTHXMYOVKTJLNQGBAJFVYTIRUXMVFNCLAJZPYNDGPQGJRHXNCVYFPXACSVLACLUQSIRTJZOTDLGJROQGJLTIPFVRUJSIZHEMJYMIEUQAOEMPLMPENQZNQSVXAIYUCTIEHJFIRHQNVXNPLHQZILBKCZBKAJSUENCKTJFBRGJYBFGJYBDMWLOEHTDQMVYUQTPLWYHKGPMBEBWLBJFVLMCEOXBLNJZOXNJMOUDMOEUPSHKUNXFIFHWZUQGHWZBLTBEGWSKMVYBQRUKGQFODGCMVKUXEXSVLNQRNQNCRZBEOKQQAJZPCSYURHDJWGOZVVLIUNDKWGTCSYOAQGRENMFSROAUNNCGPYOURWWMCQNGMCDGIOEEOSJPFRIUDUTTEGZPJFVHNEADQCRGNPZFFYQAWUDTNMTMLPJWPKWIISCRZRKNWMWILFBMYUBHDJZIIIHUTQGCYIHZQXQJSIEOOUQOHNMDWIEBBKDAGSZMTCLYMMOHNDWPLBLBXFIIYODTPWSFMGVFVKAWWAJHKJZPPONGREHWMIPOUKHANHAZMSFRANAAJSBQZCYUEAWJTCYUXMCYUDNDMCYUDMCLNVLRKKUCZFLINNDWZJOEEUOJWSYOLPIAQQJYYEENDGQMFUEJJJGXKAAGYEKDGZUQKYUKNMTHDATTTPMSSLLXJFWMNIRQNBYKAQDZRUJGCEUJSVFUWSBKNDTWSBWZORNVDAJMPSOKNCSUCSBXIYAQGVDLSHYQSVYUKMCFHPIKZPYTPYHKOCFORTPMIKNDKACFBXAIFCSMCLUJGIRHETUXFIJZVKNDMXAWFOKZWJTPWFVYUDSUEHHCEUKMVRGDFCGJEUKACXAXTNDFCKUCYBMUENWMOLNQMDF
打开App,查看更多内容
随时随地看视频慕课网APP