求教:spark-submit提交作业到yarn上一直accepted? INFO yarn.Client: ...state: ACCEPTED)

Question

(刚开始学spark的小白 谢谢大牛了?)

输入代码如下 $ spark-submit --master yarn --name spark-yarn /home/hadoop/script/spark04.py hdfs://hadoop000:8020/hello.txt hdfs://hadoop000:8020/hello/output

但是跑起来后一直卡着:(代码在local或者standalone都能正常执行)

19/05/17 22:44:03 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:04 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:05 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:06 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:07 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:08 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:09 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:10 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:11 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:12 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:13 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:14 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:15 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:16 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)

我的一些配置如下: yarn-site.xml只有这个

capacity-scheduler.xml中yarn分配的也照网上的由0.1改为0.5了

节点也没挂

请问要怎么做呢? 

Answer 1

这个至少有两种情况1，任务申请不到足够的资源启动2.  提交任务的用户被限制了。不能提交任务了

Answer 2

CLUCLUDTHXMYOVKTJLNQGBAJFVYTIRUXMVFNCLAJZPYNDGPQGJRHXNCVYFPXACSVLACLUQSIRTJZOTDLGJROQGJLTIPFVRUJSIZHEMJYMIEUQAOEMPLMPENQZNQSVXAIYUCTIEHJFIRHQNVXNPLHQZILBKCZBKAJSUENCKTJFBRGJYBFGJYBDMWLOEHTDQMVYUQTPLWYHKGPMBEBWLBJFVLMCEOXBLNJZOXNJMOUDMOEUPSHKUNXFIFHWZUQGHWZBLTBEGWSKMVYBQRUKGQFODGCMVKUXEXSVLNQRNQNCRZBEOKQQAJZPCSYURHDJWGOZVVLIUNDKWGTCSYOAQGRENMFSROAUNNCGPYOURWWMCQNGMCDGIOEEOSJPFRIUDUTTEGZPJFVHNEADQCRGNPZFFYQAWUDTNMTMLPJWPKWIISCRZRKNWMWILFBMYUBHDJZIIIHUTQGCYIHZQXQJSIEOOUQOHNMDWIEBBKDAGSZMTCLYMMOHNDWPLBLBXFIIYODTPWSFMGVFVKAWWAJHKJZPPONGREHWMIPOUKHANHAZMSFRANAAJSBQZCYUEAWJTCYUXMCYUDNDMCYUDMCLNVLRKKUCZFLINNDWZJOEEUOJWSYOLPIAQQJYYEENDGQMFUEJJJGXKAAGYEKDGZUQKYUKNMTHDATTTPMSSLLXJFWMNIRQNBYKAQDZRUJGCEUJSVFUWSBKNDTWSBWZORNVDAJMPSOKNCSUCSBXIYAQGVDLSHYQSVYUKMCFHPIKZPYTPYHKOCFORTPMIKNDKACFBXAIFCSMCLUJGIRHETUXFIJZVKNDMXAWFOKZWJTPWFVYUDSUEHHCEUKMVRGDFCGJEUKACXAXTNDFCKUCYBMUENWMOLNQMDF