CDH Error: Java heap space

╰半夏微凉° 2022-11-07 14:31 51阅读 0赞

备注:  
CDH 6.3.1

### 文章目录 ###

*  一.问题描述
 *  二.解决方案
 *  2.1 调整HADOOP\_HEAPSIZE
 *   *  2.2 调整 排序所使用的内存数量

# 一.问题描述 #

给一个大表创建索引的时候报错，Error: Java heap space

hive> 
        > alter index ods_fact_sale_idx01 on ods_fact_sale rebuild;
    Query ID = root_20201218112050_83ecdecf-a0e5-4dfc-a1f6-30ed00f36050
    Total jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks not specified. Estimated from input data size: 469
    In order to change the average load for a reducer (in bytes):
      set hive.exec.reducers.bytes.per.reducer=<number>
    In order to limit the maximum number of reducers:
      set hive.exec.reducers.max=<number>
    In order to set a constant number of reducers:
      set mapreduce.job.reduces=<number>
    Starting Job = job_1606698967173_0321, Tracking URL = http://hp1:8088/proxy/application_1606698967173_0321/
    Kill Command = /opt/cloudera/parcels/CDH-6.3.1-1.cdh6.3.1.p0.1470567/lib/hadoop/bin/hadoop job  -kill job_1606698967173_0321
    Hadoop job information for Stage-1: number of mappers: 117; number of reducers: 469
    2020-12-18 11:20:57,402 Stage-1 map = 0%,  reduce = 0%
    2020-12-18 11:21:19,114 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 70.93 sec
    2020-12-18 11:22:19,837 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 70.93 sec
    2020-12-18 11:22:47,605 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 31.8 sec
    2020-12-18 11:23:13,284 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.45 sec
    2020-12-18 11:24:13,803 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.45 sec
    2020-12-18 11:25:14,304 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.45 sec
    2020-12-18 11:25:48,141 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 33.85 sec
    2020-12-18 11:26:04,542 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 63.83 sec
    2020-12-18 11:26:19,915 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 29.98 sec
    2020-12-18 11:26:35,282 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.78 sec
    2020-12-18 11:27:34,729 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 28.8 sec
    2020-12-18 11:27:52,148 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 57.19 sec
    2020-12-18 11:28:52,613 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 57.19 sec
    2020-12-18 11:29:33,614 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 28.8 sec
    2020-12-18 11:30:02,289 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.36 sec
    2020-12-18 11:31:02,772 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.36 sec
    2020-12-18 11:32:02,212 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 30.23 sec
    2020-12-18 11:32:17,576 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.4 sec
    2020-12-18 11:33:17,993 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.4 sec
    2020-12-18 11:33:46,629 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 28.17 sec
    2020-12-18 11:34:01,972 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 55.85 sec
    2020-12-18 11:35:02,411 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 55.85 sec
    2020-12-18 11:35:25,977 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 27.68 sec
    2020-12-18 11:35:41,355 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 55.72 sec
    2020-12-18 11:36:41,752 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 55.72 sec
    2020-12-18 11:37:42,167 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 55.72 sec
    2020-12-18 11:37:50,358 Stage-1 map = 100%,  reduce = 100%
    MapReduce Total cumulative CPU time: 55 seconds 720 msec
    Ended Job = job_1606698967173_0321 with errors
    Error during job, obtaining debugging information...
    Examining task ID: task_1606698967173_0321_m_000002 (and more) from job job_1606698967173_0321
    Examining task ID: task_1606698967173_0321_m_000002 (and more) from job job_1606698967173_0321
    
    Task with the most failures(4): 
    -----
    Task ID:
      task_1606698967173_0321_m_000002
    
    URL:
      http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1606698967173_0321&tipid=task_1606698967173_0321_m_000002
    -----
    Diagnostic Messages for this Task:
    Error: Java heap space
    
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
    MapReduce Jobs Launched: 
    Stage-Stage-1: Map: 117  Reduce: 469   Cumulative CPU: 55.72 sec   HDFS Read: 0 HDFS Write: 0 HDFS EC Read: 0 FAIL
    Total MapReduce CPU Time Spent: 55 seconds 720 msec

# 二.解决方案 #

# 2.1 调整HADOOP\_HEAPSIZE #

cd /etc/hive/conf.cloudera.hive
    
    -- 新增配置
    vim hadoop-env.sh
    export HADOOP_HEAPSIZE=2000
    
    -- 新增配置
    vim mapred-site.xml
    <property>
      <name>mapred.child.java.opts</name>
      <value>-Xmx2000m</value>
    </property>

修改完成后，同步到其它节点上。

**重新测试**  
问题依旧，证明调整 HADOOP\_HEAPSIZE的并没有起到作用

hive> alter index ods_fact_sale_idx01 on ods_fact_sale rebuild;
    Query ID = root_20201218134940_519de90e-45ae-4ed8-a9f5-8d2ee21511b9
    Total jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks not specified. Estimated from input data size: 469
    In order to change the average load for a reducer (in bytes):
      set hive.exec.reducers.bytes.per.reducer=<number>
    In order to limit the maximum number of reducers:
      set hive.exec.reducers.max=<number>
    In order to set a constant number of reducers:
      set mapreduce.job.reduces=<number>
    Starting Job = job_1606698967173_0324, Tracking URL = http://hp1:8088/proxy/application_1606698967173_0324/
    Kill Command = /opt/cloudera/parcels/CDH-6.3.1-1.cdh6.3.1.p0.1470567/lib/hadoop/bin/hadoop job  -kill job_1606698967173_0324
    Hadoop job information for Stage-1: number of mappers: 117; number of reducers: 469
    2020-12-18 13:49:49,574 Stage-1 map = 0%,  reduce = 0%
    2020-12-18 13:50:10,232 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.46 sec
    2020-12-18 13:51:10,969 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.46 sec
    2020-12-18 13:52:11,613 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 65.46 sec
    2020-12-18 13:52:31,169 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 30.22 sec
    2020-12-18 13:52:50,680 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 69.26 sec
    2020-12-18 13:53:51,205 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 69.26 sec
    2020-12-18 13:54:51,645 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 761.92 sec
    2020-12-18 13:55:52,100 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 761.92 sec
    2020-12-18 13:55:58,238 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 722.88 sec
    2020-12-18 13:56:15,664 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 754.46 sec
    2020-12-18 13:57:15,066 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 31.58 sec
    2020-12-18 13:57:31,465 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 63.36 sec
    2020-12-18 13:58:01,164 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 31.78 sec
    2020-12-18 13:58:20,600 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 67.91 sec
    2020-12-18 13:59:21,015 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 67.91 sec
    2020-12-18 13:59:47,640 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 36.13 sec
    2020-12-18 14:00:11,195 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 57.97 sec
    2020-12-18 14:01:11,582 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 57.97 sec
    2020-12-18 14:01:32,076 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 29.53 sec
    2020-12-18 14:01:49,486 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 62.05 sec
    2020-12-18 14:02:49,857 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 62.05 sec
    2020-12-18 14:03:50,239 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 575.12 sec
    2020-12-18 14:04:50,614 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 575.12 sec
    2020-12-18 14:05:05,978 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 542.6 sec
    2020-12-18 14:05:23,384 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 570.95 sec
    2020-12-18 14:05:35,668 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 28.35 sec
    2020-12-18 14:05:52,059 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.96 sec
    2020-12-18 14:06:52,423 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 58.96 sec
    2020-12-18 14:07:03,682 Stage-1 map = 0%,  reduce = 0%, Cumulative CPU 30.61 sec
    2020-12-18 14:07:08,797 Stage-1 map = 100%,  reduce = 100%
    MapReduce Total cumulative CPU time: 30 seconds 610 msec
    Ended Job = job_1606698967173_0324 with errors
    Error during job, obtaining debugging information...
    Examining task ID: task_1606698967173_0324_m_000006 (and more) from job job_1606698967173_0324
    Examining task ID: task_1606698967173_0324_m_000006 (and more) from job job_1606698967173_0324
    
    Task with the most failures(4): 
    -----
    Task ID:
      task_1606698967173_0324_m_000006
    
    URL:
      http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1606698967173_0324&tipid=task_1606698967173_0324_m_000006
    -----
    Diagnostic Messages for this Task:
    Error: Java heap space
    
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
    MapReduce Jobs Launched: 
    Stage-Stage-1: Map: 117  Reduce: 469   Cumulative CPU: 30.61 sec   HDFS Read: 0 HDFS Write: 0 HDFS EC Read: 0 FAIL
    Total MapReduce CPU Time Spent: 30 seconds 610 msec
    hive>

## 2.2 调整 排序所使用的内存数量 ##

设置 set io.sort.mb=10; 排序所使用的内存数量，默认值是100M，和mapred.child.java.opts相对应，opts默认：-Xmx200m,则mb不能超过200M，否则会OOM。

设置 set hive.map.aggr=true; 是否在 Map 端进行聚合，默认为True，会在map端进行部分数据端聚合操作。

**再次测试**  
问题终于解决

hive> 
        > alter index ods_fact_sale_idx01 on ods_fact_sale rebuild;
    Query ID = root_20201218140902_62c6147b-6419-4b4f-a19b-479e13bbf9a4
    Total jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks not specified. Estimated from input data size: 469
    In order to change the average load for a reducer (in bytes):
      set hive.exec.reducers.bytes.per.reducer=<number>
    In order to limit the maximum number of reducers:
      set hive.exec.reducers.max=<number>
    In order to set a constant number of reducers:
      set mapreduce.job.reduces=<number>
    Starting Job = job_1606698967173_0325, Tracking URL = http://hp1:8088/proxy/application_1606698967173_0325/
    Kill Command = /opt/cloudera/parcels/CDH-6.3.1-1.cdh6.3.1.p0.1470567/lib/hadoop/bin/hadoop job  -kill job_1606698967173_0325
    Hadoop job information for Stage-1: number of mappers: 117; number of reducers: 469
    2020-12-18 14:09:08,925 Stage-1 map = 0%,  reduce = 0%
    2020-12-18 14:09:27,441 Stage-1 map = 1%,  reduce = 0%, Cumulative CPU 46.07 sec
    2020-12-18 14:09:31,570 Stage-1 map = 2%,  reduce = 0%, Cumulative CPU 63.05 sec
    2020-12-18 14:09:45,967 Stage-1 map = 3%,  reduce = 0%, Cumulative CPU 90.2 sec
    2020-12-18 14:10:01,382 Stage-1 map = 4%,  reduce = 0%, Cumulative CPU 141.1 sec
    2020-12-18 14:10:05,494 Stage-1 map = 5%,  reduce = 0%, Cumulative CPU 168.93 sec
    2020-12-18 14:10:21,912 Stage-1 map = 6%,  reduce = 0%, Cumulative CPU 224.93 sec
    2020-12-18 14:10:24,984 Stage-1 map = 7%,  reduce = 0%, Cumulative CPU 230.93 sec
    2020-12-18 14:10:39,344 Stage-1 map = 8%,  reduce = 0%, Cumulative CPU 258.75 sec
    2020-12-18 14:10:41,391 Stage-1 map = 9%,  reduce = 0%, Cumulative CPU 287.43 sec
    2020-12-18 14:10:57,809 Stage-1 map = 10%,  reduce = 0%, Cumulative CPU 336.69 sec
    2020-12-18 14:11:13,194 Stage-1 map = 11%,  reduce = 0%, Cumulative CPU 364.0 sec
    2020-12-18 14:11:15,240 Stage-1 map = 12%,  reduce = 0%, Cumulative CPU 390.63 sec
    2020-12-18 14:11:31,640 Stage-1 map = 13%,  reduce = 0%, Cumulative CPU 439.61 sec
    2020-12-18 14:11:33,694 Stage-1 map = 14%,  reduce = 0%, Cumulative CPU 450.75 sec
    2020-12-18 14:11:49,065 Stage-1 map = 15%,  reduce = 0%, Cumulative CPU 498.9 sec
    2020-12-18 14:12:04,457 Stage-1 map = 16%,  reduce = 0%, Cumulative CPU 525.46 sec
    2020-12-18 14:12:06,512 Stage-1 map = 17%,  reduce = 0%, Cumulative CPU 552.07 sec
    2020-12-18 14:12:22,895 Stage-1 map = 18%,  reduce = 0%, Cumulative CPU 600.61 sec
    2020-12-18 14:12:24,960 Stage-1 map = 19%,  reduce = 0%, Cumulative CPU 612.74 sec
    2020-12-18 14:12:41,364 Stage-1 map = 20%,  reduce = 0%, Cumulative CPU 661.48 sec
    2020-12-18 14:12:42,383 Stage-1 map = 21%,  reduce = 0%, Cumulative CPU 667.91 sec
    2020-12-18 14:12:58,771 Stage-1 map = 22%,  reduce = 0%, Cumulative CPU 724.57 sec
    2020-12-18 14:13:13,119 Stage-1 map = 23%,  reduce = 0%, Cumulative CPU 745.93 sec
    2020-12-18 14:13:16,192 Stage-1 map = 24%,  reduce = 0%, Cumulative CPU 775.75 sec
    2020-12-18 14:13:32,578 Stage-1 map = 25%,  reduce = 0%, Cumulative CPU 829.0 sec
    2020-12-18 14:13:34,626 Stage-1 map = 26%,  reduce = 0%, Cumulative CPU 834.59 sec
    2020-12-18 14:13:50,021 Stage-1 map = 27%,  reduce = 0%, Cumulative CPU 885.57 sec
    2020-12-18 14:14:04,358 Stage-1 map = 28%,  reduce = 0%, Cumulative CPU 909.08 sec
    2020-12-18 14:14:08,458 Stage-1 map = 29%,  reduce = 0%, Cumulative CPU 941.71 sec
    2020-12-18 14:14:22,806 Stage-1 map = 30%,  reduce = 0%, Cumulative CPU 966.01 sec
    2020-12-18 14:14:25,878 Stage-1 map = 31%,  reduce = 0%, Cumulative CPU 997.46 sec
    2020-12-18 14:14:41,227 Stage-1 map = 32%,  reduce = 0%, Cumulative CPU 1047.54 sec
    2020-12-18 14:14:56,588 Stage-1 map = 33%,  reduce = 0%, Cumulative CPU 1076.14 sec
    2020-12-18 14:14:59,654 Stage-1 map = 34%,  reduce = 0%, Cumulative CPU 1104.24 sec
    2020-12-18 14:15:15,020 Stage-1 map = 35%,  reduce = 0%, Cumulative CPU 1131.98 sec
    2020-12-18 14:15:17,066 Stage-1 map = 36%,  reduce = 0%, Cumulative CPU 1159.76 sec
    2020-12-18 14:15:32,422 Stage-1 map = 37%,  reduce = 0%, Cumulative CPU 1209.22 sec
    2020-12-18 14:15:35,493 Stage-1 map = 38%,  reduce = 0%, Cumulative CPU 1221.26 sec
    2020-12-18 14:15:50,855 Stage-1 map = 39%,  reduce = 0%, Cumulative CPU 1269.4 sec
    2020-12-18 14:16:06,227 Stage-1 map = 40%,  reduce = 0%, Cumulative CPU 1296.18 sec
    2020-12-18 14:16:09,300 Stage-1 map = 41%,  reduce = 0%, Cumulative CPU 1329.0 sec
    2020-12-18 14:16:23,617 Stage-1 map = 42%,  reduce = 0%, Cumulative CPU 1371.65 sec
    2020-12-18 14:16:26,688 Stage-1 map = 43%,  reduce = 0%, Cumulative CPU 1383.1 sec
    2020-12-18 14:16:41,021 Stage-1 map = 44%,  reduce = 0%, Cumulative CPU 1428.2 sec
    2020-12-18 14:16:57,392 Stage-1 map = 45%,  reduce = 0%, Cumulative CPU 1457.85 sec
    2020-12-18 14:16:58,413 Stage-1 map = 46%,  reduce = 0%, Cumulative CPU 1479.24 sec
    2020-12-18 14:17:14,798 Stage-1 map = 47%,  reduce = 0%, Cumulative CPU 1534.09 sec
    2020-12-18 14:17:16,852 Stage-1 map = 48%,  reduce = 0%, Cumulative CPU 1540.41 sec
    2020-12-18 14:17:32,247 Stage-1 map = 49%,  reduce = 0%, Cumulative CPU 1588.69 sec
    2020-12-18 14:17:34,296 Stage-1 map = 50%,  reduce = 0%, Cumulative CPU 1601.09 sec
    2020-12-18 14:17:49,656 Stage-1 map = 51%,  reduce = 0%, Cumulative CPU 1639.21 sec
    2020-12-18 14:17:59,902 Stage-1 map = 52%,  reduce = 0%, Cumulative CPU 1671.02 sec
    2020-12-18 14:18:11,165 Stage-1 map = 53%,  reduce = 0%, Cumulative CPU 1709.24 sec
    2020-12-18 14:18:21,404 Stage-1 map = 54%,  reduce = 0%, Cumulative CPU 1737.11 sec
    2020-12-18 14:18:28,570 Stage-1 map = 55%,  reduce = 0%, Cumulative CPU 1765.92 sec
    2020-12-18 14:18:39,835 Stage-1 map = 56%,  reduce = 0%, Cumulative CPU 1793.52 sec
    2020-12-18 14:18:54,180 Stage-1 map = 57%,  reduce = 0%, Cumulative CPU 1842.02 sec
    2020-12-18 14:19:01,360 Stage-1 map = 58%,  reduce = 0%, Cumulative CPU 1869.44 sec
    2020-12-18 14:19:13,640 Stage-1 map = 59%,  reduce = 0%, Cumulative CPU 1903.29 sec
    2020-12-18 14:19:20,806 Stage-1 map = 60%,  reduce = 0%, Cumulative CPU 1931.88 sec
    2020-12-18 14:19:31,047 Stage-1 map = 61%,  reduce = 0%, Cumulative CPU 1959.76 sec
    2020-12-18 14:19:39,240 Stage-1 map = 62%,  reduce = 0%, Cumulative CPU 1987.32 sec
    2020-12-18 14:19:54,604 Stage-1 map = 63%,  reduce = 0%, Cumulative CPU 2036.47 sec
    2020-12-18 14:20:02,808 Stage-1 map = 64%,  reduce = 0%, Cumulative CPU 2066.78 sec
    2020-12-18 14:20:14,073 Stage-1 map = 65%,  reduce = 0%, Cumulative CPU 2098.41 sec
    2020-12-18 14:20:23,292 Stage-1 map = 66%,  reduce = 0%, Cumulative CPU 2126.41 sec
    2020-12-18 14:20:31,486 Stage-1 map = 67%,  reduce = 0%, Cumulative CPU 2153.19 sec
    2020-12-18 14:20:39,679 Stage-1 map = 68%,  reduce = 0%, Cumulative CPU 2181.37 sec
    2020-12-18 14:20:55,067 Stage-1 map = 69%,  reduce = 0%, Cumulative CPU 2229.63 sec
    2020-12-18 14:21:03,258 Stage-1 map = 70%,  reduce = 0%, Cumulative CPU 2256.41 sec
    2020-12-18 14:21:13,504 Stage-1 map = 71%,  reduce = 0%, Cumulative CPU 2289.55 sec
    2020-12-18 14:21:22,721 Stage-1 map = 72%,  reduce = 0%, Cumulative CPU 2317.1 sec
    2020-12-18 14:21:30,911 Stage-1 map = 73%,  reduce = 0%, Cumulative CPU 2344.06 sec
    2020-12-18 14:21:40,122 Stage-1 map = 74%,  reduce = 0%, Cumulative CPU 2371.86 sec
    2020-12-18 14:21:55,479 Stage-1 map = 75%,  reduce = 0%, Cumulative CPU 2420.9 sec
    2020-12-18 14:22:05,723 Stage-1 map = 76%,  reduce = 0%, Cumulative CPU 2454.82 sec
    2020-12-18 14:22:15,968 Stage-1 map = 77%,  reduce = 0%, Cumulative CPU 2482.51 sec
    2020-12-18 14:22:22,117 Stage-1 map = 78%,  reduce = 0%, Cumulative CPU 2509.92 sec
    2020-12-18 14:22:33,376 Stage-1 map = 79%,  reduce = 0%, Cumulative CPU 2537.15 sec
    2020-12-18 14:22:48,730 Stage-1 map = 80%,  reduce = 0%, Cumulative CPU 2588.85 sec
    2020-12-18 14:22:53,853 Stage-1 map = 81%,  reduce = 0%, Cumulative CPU 2614.27 sec
    2020-12-18 14:23:08,215 Stage-1 map = 82%,  reduce = 0%, Cumulative CPU 2647.66 sec
    2020-12-18 14:23:23,588 Stage-1 map = 83%,  reduce = 0%, Cumulative CPU 2672.18 sec
    2020-12-18 14:23:43,059 Stage-1 map = 84%,  reduce = 0%, Cumulative CPU 2705.46 sec
    2020-12-18 14:24:00,467 Stage-1 map = 85%,  reduce = 0%, Cumulative CPU 2732.41 sec
    2020-12-18 14:24:33,254 Stage-1 map = 86%,  reduce = 0%, Cumulative CPU 2783.96 sec
    2020-12-18 14:24:49,642 Stage-1 map = 87%,  reduce = 0%, Cumulative CPU 2810.82 sec
    2020-12-18 14:25:06,036 Stage-1 map = 88%,  reduce = 0%, Cumulative CPU 2835.03 sec
    2020-12-18 14:25:25,496 Stage-1 map = 89%,  reduce = 0%, Cumulative CPU 2867.5 sec
    2020-12-18 14:25:41,874 Stage-1 map = 90%,  reduce = 0%, Cumulative CPU 2893.55 sec
    2020-12-18 14:25:57,227 Stage-1 map = 91%,  reduce = 0%, Cumulative CPU 2933.75 sec
    2020-12-18 14:26:14,640 Stage-1 map = 92%,  reduce = 0%, Cumulative CPU 2967.1 sec
    2020-12-18 14:26:32,051 Stage-1 map = 93%,  reduce = 0%, Cumulative CPU 2996.33 sec
    2020-12-18 14:26:47,404 Stage-1 map = 94%,  reduce = 0%, Cumulative CPU 3020.02 sec
    2020-12-18 14:27:04,811 Stage-1 map = 95%,  reduce = 0%, Cumulative CPU 3047.26 sec
    2020-12-18 14:27:24,289 Stage-1 map = 96%,  reduce = 0%, Cumulative CPU 3080.97 sec
    2020-12-18 14:27:40,679 Stage-1 map = 97%,  reduce = 0%, Cumulative CPU 3107.66 sec
    2020-12-18 14:28:13,445 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 3159.18 sec
    2020-12-18 14:28:29,837 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 3186.24 sec
    2020-12-18 14:28:49,299 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 3216.55 sec
    2020-12-18 14:28:57,504 Stage-1 map = 100%,  reduce = 1%, Cumulative CPU 3232.83 sec
    2020-12-18 14:29:11,842 Stage-1 map = 100%,  reduce = 2%, Cumulative CPU 3263.59 sec
    2020-12-18 14:29:22,085 Stage-1 map = 100%,  reduce = 3%, Cumulative CPU 3284.97 sec
    2020-12-18 14:29:34,373 Stage-1 map = 100%,  reduce = 4%, Cumulative CPU 3312.72 sec
    2020-12-18 14:29:49,726 Stage-1 map = 100%,  reduce = 5%, Cumulative CPU 3342.48 sec
    2020-12-18 14:29:59,966 Stage-1 map = 100%,  reduce = 6%, Cumulative CPU 3370.95 sec
    2020-12-18 14:30:10,213 Stage-1 map = 100%,  reduce = 7%, Cumulative CPU 3392.51 sec
    2020-12-18 14:30:23,529 Stage-1 map = 100%,  reduce = 8%, Cumulative CPU 3416.85 sec
    2020-12-18 14:30:33,775 Stage-1 map = 100%,  reduce = 9%, Cumulative CPU 3437.28 sec
    2020-12-18 14:30:47,099 Stage-1 map = 100%,  reduce = 10%, Cumulative CPU 3467.36 sec
    2020-12-18 14:31:03,490 Stage-1 map = 100%,  reduce = 11%, Cumulative CPU 3502.97 sec
    2020-12-18 14:31:13,737 Stage-1 map = 100%,  reduce = 12%, Cumulative CPU 3524.65 sec
    2020-12-18 14:31:24,993 Stage-1 map = 100%,  reduce = 13%, Cumulative CPU 3548.63 sec
    2020-12-18 14:31:41,374 Stage-1 map = 100%,  reduce = 14%, Cumulative CPU 3577.65 sec
    2020-12-18 14:31:53,658 Stage-1 map = 100%,  reduce = 15%, Cumulative CPU 3608.03 sec
    2020-12-18 14:32:03,886 Stage-1 map = 100%,  reduce = 16%, Cumulative CPU 3630.71 sec
    2020-12-18 14:32:18,226 Stage-1 map = 100%,  reduce = 17%, Cumulative CPU 3660.56 sec
    2020-12-18 14:32:30,519 Stage-1 map = 100%,  reduce = 18%, Cumulative CPU 3689.06 sec
    2020-12-18 14:32:40,760 Stage-1 map = 100%,  reduce = 19%, Cumulative CPU 3711.76 sec
    2020-12-18 14:32:55,104 Stage-1 map = 100%,  reduce = 20%, Cumulative CPU 3743.03 sec
    2020-12-18 14:33:09,444 Stage-1 map = 100%,  reduce = 21%, Cumulative CPU 3777.07 sec
    2020-12-18 14:33:19,692 Stage-1 map = 100%,  reduce = 22%, Cumulative CPU 3793.45 sec
    2020-12-18 14:33:30,984 Stage-1 map = 100%,  reduce = 23%, Cumulative CPU 3824.4 sec
    2020-12-18 14:33:47,355 Stage-1 map = 100%,  reduce = 24%, Cumulative CPU 3852.97 sec
    2020-12-18 14:33:58,633 Stage-1 map = 100%,  reduce = 25%, Cumulative CPU 3876.82 sec
    2020-12-18 14:34:10,915 Stage-1 map = 100%,  reduce = 26%, Cumulative CPU 3906.18 sec
    2020-12-18 14:34:24,239 Stage-1 map = 100%,  reduce = 27%, Cumulative CPU 3932.31 sec
    2020-12-18 14:34:35,497 Stage-1 map = 100%,  reduce = 28%, Cumulative CPU 3956.31 sec
    2020-12-18 14:34:47,790 Stage-1 map = 100%,  reduce = 29%, Cumulative CPU 3986.4 sec
    2020-12-18 14:35:01,127 Stage-1 map = 100%,  reduce = 30%, Cumulative CPU 4009.62 sec
    2020-12-18 14:35:12,398 Stage-1 map = 100%,  reduce = 31%, Cumulative CPU 4039.31 sec
    2020-12-18 14:35:23,682 Stage-1 map = 100%,  reduce = 32%, Cumulative CPU 4063.23 sec
    2020-12-18 14:35:40,081 Stage-1 map = 100%,  reduce = 33%, Cumulative CPU 4098.23 sec
    2020-12-18 14:35:51,338 Stage-1 map = 100%,  reduce = 34%, Cumulative CPU 4123.96 sec
    2020-12-18 14:36:03,625 Stage-1 map = 100%,  reduce = 35%, Cumulative CPU 4147.71 sec
    2020-12-18 14:36:16,958 Stage-1 map = 100%,  reduce = 36%, Cumulative CPU 4176.45 sec
    2020-12-18 14:36:30,285 Stage-1 map = 100%,  reduce = 37%, Cumulative CPU 4205.66 sec
    2020-12-18 14:36:40,545 Stage-1 map = 100%,  reduce = 38%, Cumulative CPU 4229.18 sec
    2020-12-18 14:36:54,881 Stage-1 map = 100%,  reduce = 39%, Cumulative CPU 4257.26 sec
    2020-12-18 14:37:06,140 Stage-1 map = 100%,  reduce = 40%, Cumulative CPU 4281.72 sec
    2020-12-18 14:37:16,378 Stage-1 map = 100%,  reduce = 41%, Cumulative CPU 4305.07 sec
    2020-12-18 14:37:29,690 Stage-1 map = 100%,  reduce = 42%, Cumulative CPU 4333.39 sec
    2020-12-18 14:37:41,987 Stage-1 map = 100%,  reduce = 43%, Cumulative CPU 4360.59 sec
    2020-12-18 14:37:55,304 Stage-1 map = 100%,  reduce = 44%, Cumulative CPU 4386.42 sec
    2020-12-18 14:38:05,549 Stage-1 map = 100%,  reduce = 45%, Cumulative CPU 4407.78 sec
    2020-12-18 14:38:19,896 Stage-1 map = 100%,  reduce = 46%, Cumulative CPU 4438.86 sec
    2020-12-18 14:38:33,225 Stage-1 map = 100%,  reduce = 47%, Cumulative CPU 4470.73 sec
    2020-12-18 14:38:43,478 Stage-1 map = 100%,  reduce = 48%, Cumulative CPU 4491.1 sec
    2020-12-18 14:38:57,840 Stage-1 map = 100%,  reduce = 49%, Cumulative CPU 4521.0 sec
    2020-12-18 14:39:10,159 Stage-1 map = 100%,  reduce = 50%, Cumulative CPU 4551.05 sec
    2020-12-18 14:39:21,435 Stage-1 map = 100%,  reduce = 51%, Cumulative CPU 4572.96 sec
    2020-12-18 14:39:35,778 Stage-1 map = 100%,  reduce = 52%, Cumulative CPU 4603.79 sec
    2020-12-18 14:39:48,070 Stage-1 map = 100%,  reduce = 53%, Cumulative CPU 4631.4 sec
    2020-12-18 14:39:58,314 Stage-1 map = 100%,  reduce = 54%, Cumulative CPU 4654.47 sec
    2020-12-18 14:40:13,690 Stage-1 map = 100%,  reduce = 55%, Cumulative CPU 4690.54 sec
    2020-12-18 14:40:23,943 Stage-1 map = 100%,  reduce = 56%, Cumulative CPU 4712.64 sec
    2020-12-18 14:40:35,214 Stage-1 map = 100%,  reduce = 57%, Cumulative CPU 4738.19 sec
    2020-12-18 14:40:50,602 Stage-1 map = 100%,  reduce = 58%, Cumulative CPU 4772.92 sec
    2020-12-18 14:41:01,886 Stage-1 map = 100%,  reduce = 59%, Cumulative CPU 4795.24 sec
    2020-12-18 14:41:17,264 Stage-1 map = 100%,  reduce = 60%, Cumulative CPU 4825.99 sec
    2020-12-18 14:41:27,512 Stage-1 map = 100%,  reduce = 61%, Cumulative CPU 4847.04 sec
    2020-12-18 14:41:38,811 Stage-1 map = 100%,  reduce = 62%, Cumulative CPU 4870.94 sec
    2020-12-18 14:41:53,178 Stage-1 map = 100%,  reduce = 63%, Cumulative CPU 4897.87 sec
    2020-12-18 14:42:02,402 Stage-1 map = 100%,  reduce = 64%, Cumulative CPU 4922.12 sec
    2020-12-18 14:42:15,731 Stage-1 map = 100%,  reduce = 65%, Cumulative CPU 4950.85 sec
    2020-12-18 14:42:27,005 Stage-1 map = 100%,  reduce = 66%, Cumulative CPU 4977.93 sec
    2020-12-18 14:42:37,261 Stage-1 map = 100%,  reduce = 67%, Cumulative CPU 5001.57 sec
    2020-12-18 14:42:53,666 Stage-1 map = 100%,  reduce = 68%, Cumulative CPU 5031.89 sec
    2020-12-18 14:43:05,974 Stage-1 map = 100%,  reduce = 69%, Cumulative CPU 5061.05 sec
    2020-12-18 14:43:17,264 Stage-1 map = 100%,  reduce = 70%, Cumulative CPU 5084.75 sec
    2020-12-18 14:43:31,621 Stage-1 map = 100%,  reduce = 71%, Cumulative CPU 5113.23 sec
    2020-12-18 14:43:42,901 Stage-1 map = 100%,  reduce = 72%, Cumulative CPU 5140.54 sec
    2020-12-18 14:43:59,301 Stage-1 map = 100%,  reduce = 73%, Cumulative CPU 5170.35 sec
    2020-12-18 14:44:09,564 Stage-1 map = 100%,  reduce = 74%, Cumulative CPU 5197.5 sec
    2020-12-18 14:44:20,861 Stage-1 map = 100%,  reduce = 75%, Cumulative CPU 5219.3 sec
    2020-12-18 14:44:34,194 Stage-1 map = 100%,  reduce = 76%, Cumulative CPU 5244.79 sec
    2020-12-18 14:44:43,430 Stage-1 map = 100%,  reduce = 77%, Cumulative CPU 5265.92 sec
    2020-12-18 14:44:57,786 Stage-1 map = 100%,  reduce = 78%, Cumulative CPU 5297.58 sec
    2020-12-18 14:45:12,123 Stage-1 map = 100%,  reduce = 79%, Cumulative CPU 5327.2 sec
    2020-12-18 14:45:22,387 Stage-1 map = 100%,  reduce = 80%, Cumulative CPU 5353.69 sec
    2020-12-18 14:45:33,659 Stage-1 map = 100%,  reduce = 81%, Cumulative CPU 5376.99 sec
    2020-12-18 14:45:49,028 Stage-1 map = 100%,  reduce = 82%, Cumulative CPU 5404.56 sec
    2020-12-18 14:45:59,304 Stage-1 map = 100%,  reduce = 83%, Cumulative CPU 5427.49 sec
    2020-12-18 14:46:11,632 Stage-1 map = 100%,  reduce = 84%, Cumulative CPU 5453.1 sec
    2020-12-18 14:46:23,933 Stage-1 map = 100%,  reduce = 85%, Cumulative CPU 5480.27 sec
    2020-12-18 14:46:34,181 Stage-1 map = 100%,  reduce = 86%, Cumulative CPU 5501.1 sec
    2020-12-18 14:46:48,555 Stage-1 map = 100%,  reduce = 87%, Cumulative CPU 5531.74 sec
    2020-12-18 14:47:00,858 Stage-1 map = 100%,  reduce = 88%, Cumulative CPU 5560.47 sec
    2020-12-18 14:47:16,236 Stage-1 map = 100%,  reduce = 89%, Cumulative CPU 5589.82 sec
    2020-12-18 14:47:28,544 Stage-1 map = 100%,  reduce = 90%, Cumulative CPU 5619.28 sec
    2020-12-18 14:47:40,865 Stage-1 map = 100%,  reduce = 91%, Cumulative CPU 5641.66 sec
    2020-12-18 14:47:57,285 Stage-1 map = 100%,  reduce = 92%, Cumulative CPU 5673.06 sec
    2020-12-18 14:48:07,544 Stage-1 map = 100%,  reduce = 93%, Cumulative CPU 5695.16 sec
    2020-12-18 14:48:17,801 Stage-1 map = 100%,  reduce = 94%, Cumulative CPU 5717.5 sec
    2020-12-18 14:48:33,183 Stage-1 map = 100%,  reduce = 95%, Cumulative CPU 5748.85 sec
    2020-12-18 14:48:44,455 Stage-1 map = 100%,  reduce = 96%, Cumulative CPU 5772.3 sec
    2020-12-18 14:48:56,768 Stage-1 map = 100%,  reduce = 97%, Cumulative CPU 5803.02 sec
    2020-12-18 14:49:11,139 Stage-1 map = 100%,  reduce = 98%, Cumulative CPU 5832.86 sec
    2020-12-18 14:49:21,393 Stage-1 map = 100%,  reduce = 99%, Cumulative CPU 5851.27 sec
    2020-12-18 14:49:39,853 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 5894.13 sec
    MapReduce Total cumulative CPU time: 0 days 1 hours 38 minutes 14 seconds 130 msec
    Ended Job = job_1606698967173_0325
    Loading data to table test.test__ods_fact_sale_ods_fact_sale_idx01__
    MapReduce Jobs Launched: 
    Stage-Stage-1: Map: 117  Reduce: 469   Cumulative CPU: 5894.13 sec   HDFS Read: 31439364286 HDFS Write: 8337240559 HDFS EC Read: 0 SUCCESS
    Total MapReduce CPU Time Spent: 0 days 1 hours 38 minutes 14 seconds 130 msec
    OK
    Time taken: 2441.113 seconds
    hive>

参考:  
1.https://www.cnblogs.com/ultimateWorld/archive/2004/01/13/9050180.html