step1运行失败。。。是什么原因

来源:3-3 mapreduce实现矩阵相乘(2)

qq_慕姐1574696

2021-10-11 11:00

2021-10-11 10:58:32,881 INFO [org.apache.hadoop.mapreduce.JobSubmitter] - Submitting tokens for job: job_local169392388_0001

2021-10-11 10:58:32,964 INFO [org.apache.hadoop.mapreduce.Job] - The url to track the job: http://localhost:8080/

2021-10-11 10:58:32,965 INFO [org.apache.hadoop.mapreduce.Job] - Running job: job_local169392388_0001

2021-10-11 10:58:32,966 INFO [org.apache.hadoop.mapred.LocalJobRunner] - OutputCommitter set in config null

2021-10-11 10:58:32,970 INFO [org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter] - File Output Committer Algorithm version is 1

2021-10-11 10:58:32,972 INFO [org.apache.hadoop.mapred.LocalJobRunner] - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

2021-10-11 10:58:33,001 INFO [org.apache.hadoop.mapred.LocalJobRunner] - Waiting for map tasks

2021-10-11 10:58:33,001 INFO [org.apache.hadoop.mapred.LocalJobRunner] - Starting task: attempt_local169392388_0001_m_000000_0

2021-10-11 10:58:33,017 INFO [org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter] - File Output Committer Algorithm version is 1

2021-10-11 10:58:33,021 INFO [org.apache.hadoop.yarn.util.ProcfsBasedProcessTree] - ProcfsBasedProcessTree currently is supported only on Linux.

2021-10-11 10:58:33,091 INFO [org.apache.hadoop.mapred.Task] -  Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@58a52070

2021-10-11 10:58:33,094 INFO [org.apache.hadoop.mapred.MapTask] - Processing split: hdfs://192.168.191.101:9000/user/wzx/matrix/step1_input/matrix2.txt:0+115

2021-10-11 10:58:33,141 INFO [org.apache.hadoop.mapred.MapTask] - (EQUATOR) 0 kvi 26214396(104857584)

2021-10-11 10:58:33,141 INFO [org.apache.hadoop.mapred.MapTask] - mapreduce.task.io.sort.mb: 100

2021-10-11 10:58:33,141 INFO [org.apache.hadoop.mapred.MapTask] - soft limit at 83886080

2021-10-11 10:58:33,141 INFO [org.apache.hadoop.mapred.MapTask] - bufstart = 0; bufvoid = 104857600

2021-10-11 10:58:33,141 INFO [org.apache.hadoop.mapred.MapTask] - kvstart = 26214396; length = 6553600

2021-10-11 10:58:33,143 INFO [org.apache.hadoop.mapred.MapTask] - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer

2021-10-11 10:58:33,511 INFO [org.apache.hadoop.mapred.MapTask] - Starting flush of map output

2021-10-11 10:58:33,522 INFO [org.apache.hadoop.mapred.LocalJobRunner] - map task executor complete.

2021-10-11 10:58:33,525 WARN [org.apache.hadoop.mapred.LocalJobRunner] - job_local169392388_0001

java.lang.Exception: java.lang.ArrayIndexOutOfBoundsException: 1

at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)

at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)

Caused by: java.lang.ArrayIndexOutOfBoundsException: 1

at com.wzx.matrix1.Mapper1.map(Mapper1.java:27)

at com.wzx.matrix1.Mapper1.map(Mapper1.java:9)

at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)

at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

2021-10-11 10:58:33,968 INFO [org.apache.hadoop.mapreduce.Job] - Job job_local169392388_0001 running in uber mode : false

2021-10-11 10:58:33,970 INFO [org.apache.hadoop.mapreduce.Job] -  map 0% reduce 0%

2021-10-11 10:58:33,973 INFO [org.apache.hadoop.mapreduce.Job] - Job job_local169392388_0001 failed with state FAILED due to: NA

2021-10-11 10:58:33,976 INFO [org.apache.hadoop.mapreduce.Job] - Counters: 0

step1运行失败。。。


写回答 关注

0回答

还没有人回答问题,可以看看其他问题

Hadoop进阶

MapReduce原理,并实现简单的推荐

24213 学习 · 68 问题

查看课程

相似问题