执行了hadoop jar word_count_class/wordcount.jar WordCount input_wordcount output_wordcount报错误了

来源:5-3 WordCount单词计数(下)

痞子木易

2018-01-23 17:06

18/01/23 17:04:46 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.

18/01/23 17:04:46 INFO input.FileInputFormat: Total input paths to process : 2

18/01/23 17:04:46 INFO util.NativeCodeLoader: Loaded the native-hadoop library

18/01/23 17:04:46 WARN snappy.LoadSnappy: Snappy native library not loaded

18/01/23 17:04:46 INFO mapred.JobClient: Running job: job_201801222023_0005

18/01/23 17:04:47 INFO mapred.JobClient:  map 0% reduce 0%

18/01/23 17:05:00 INFO mapred.JobClient: Task Id : attempt_201801222023_0005_m_000000_0, Status : FAILED

java.lang.Throwable: Child Error

        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)

Caused by: java.io.IOException: Task process exit with nonzero status of 1.

        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)


attempt_201801222023_0005_m_000000_0: #

attempt_201801222023_0005_m_000000_0: # There is insufficient memory for the Java Runtime Environment to continue.

attempt_201801222023_0005_m_000000_0: # Native memory allocation (mmap) failed to map 99618816 bytes for committing reserved memory.

attempt_201801222023_0005_m_000000_0: # An error report file with more information is saved as:

attempt_201801222023_0005_m_000000_0: # /hadoop/mapred/local/taskTracker/root/jobcache/job_201801222023_0005/attempt_201801222023_0005_m_000000_0/work/hs_err_pid19949.log

attempt_201801222023_0005_m_000000_0: Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000f8550000, 99618816, 0) failed; error='Cannot allocate memory' (errno=12)


写回答 关注

1回答

  • 江feng
    2018-01-26 13:38:35
    已采纳

    这不是说没有有效的内存空间给java运行环境么?是不是内存不够用还是你本身没有设置函数什么的,第一个job运行失败的原因

    痞子木易

    增加虚拟机运行内存就够了

    2018-01-26 13:48:59

    共 4 条回复 >

认识Hadoop--基础篇

Hadoop入门视频教程,大数据人才的入门首选

138835 学习 · 348 问题

查看课程

相似问题