hive生产实践问题（一）在使用Hive Client跑job时，一直提示job被kill，

末蓝、 2024-02-19 19:40 28阅读 0赞

然后观察YARN的WebUI进行查看，如图：  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzIyODgxNA_size_16_color_FFFFFF_t_70]  
然后观察Hive Client的控制台输出，如下：  
Launching Job 1 out of 3  
Number of reduce tasks is set to 0 since there’s no reduce operator  
Starting Job = job\_1552895066408\_0001, Tracking URL = http://localhost:8088/proxy/application\_1552895066408\_0001/  
Kill Command = /wangqingguo/bigdata/hadoop-2.6.0-cdh5.7.0/bin/hadoop job -kill job\_1552895066408\_0001  
Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0  
2019-03-18 15:44:40,758 Stage-1 map = 0%, reduce = 0%  
Ended Job = job\_1552895066408\_0001 with errors  
Error during job, obtaining debugging information…  
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask  
MapReduce Jobs Launched:  
Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL  
Total MapReduce CPU Time Spent: 0 msec  
二.解决思路：

通过YARN的WebUI看到，发现YARN没有Core和Memory，按照常理讲，

如果不配置Core和Memeory，yarn-site.xml文件会有默认的值。

为了保险起见，我添加以下参数：

yarn.nodemanager.resource.cpu-vcores 8 yarn.nodemanager.resource.memory-mb 8192 yarn.scheduler.minimum-allocation-mb 1024 yarn.scheduler.maximum-allocation-mb 8192 重启HDFS的进程后，重新提交job，发现还是报这个错，然后通过仔细观察WebUI的log发现一句话： Hadoop MapReduce Error - /bin/bash: /bin/java: is a directory 终于找到错误的所在，原来是找不到Java。

最后我在etc/hadoop/hadoop.env.sh中配置了java\_home，问题解决。

哈哈哈，这都是若泽在高级班教我的排查方法。

有时候问题答案真心不重要，排查思路很重要！

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzIyODgxNA_size_16_color_FFFFFF_t_70]: https://image.dandelioncloud.cn/pgy_files/images/2024/01/29/2c72dbc969734816af9c7f2d8d56b45c.png