Hue解决下载10万行的限制

超、凢脫俗 2022-10-02 01:58 112阅读 0赞

[2019独角兽企业重金招聘Python工程师标准>>> ][2019_Python_] ![hot3.png][]

### 一、问题描述 ###

通过HUE impala/hive查询后，导出查询结果集最多只有10万行

### 二、问题原因 ###

Hue默认配置原因，默认现在行数为10万行，列数为100列

注意：应该以hue管理员账户登录，否则看不到配置

![5badb681568daa04bf0afe4412ad49a4d5d.jpg][]

### 三、解决方案 ###

修改hue所在机器的默认配置后，重启hue即可

具体操作：

查找配置文件所在路径，选择src那个路径

![0ce2c18eb1ccb3f003b788bf71bb0df7851.jpg][]

vi /opt/cloudera/parcels/CDH-5.12.0-1.cdh5.12.0.p0.29/lib/hue/apps/beeswax/src/beeswax/conf.py

DOWNLOAD_CELL_LIMIT = Config(
    
      key='download_cell_limit',
    
      # 表格限制的大小，行数 * 列数。加一个0即可，修改后可下载的行数变成100万
    
      default=10000000,
    
      type=int,
    
      help=_t('A limit to the number of cells (rows * columns) that can be downloaded from a query '
    
              '(e.g. - 10K rows * 1K columns = 10M cells.) '
    
              'A value of -1 means there will be no limit.'))
    
     
    
    def get_deprecated_download_cell_limit():
    
      """Get the old default"""
    
      # 表格的大小除100，就是行数，100是列数
    
      return DOWNLOAD_CELL_LIMIT.get() / 100 if DOWNLOAD_CELL_LIMIT.get() > 0 else DOWNLOAD_CELL_LIMIT.get(
    
    DOWNLOAD_ROW_LIMIT = Config(
    
      key='download_row_limit',
    
      # 行数的限制
    
      dynamic_default=get_deprecated_download_cell_limit,
    
      type=int,
    
      help=_t('A limit to the number of rows that can be downloaded from a query before it is truncated. '
    
              'A value of -1 means there will be no limit.'))

转载于:https://my.oschina.net/gordonnemo/blog/3017599

[2019_Python_]: https://my.oschina.net/u/2663968/blog/3061697
[hot3.png]: /images/20220113/3e2325acb311434481340d5841216a60.png
[5badb681568daa04bf0afe4412ad49a4d5d.jpg]: /images/20220113/e3d36ca4f6444dcc9570a9cfd97e0ecf.png
[0ce2c18eb1ccb3f003b788bf71bb0df7851.jpg]: /images/20220113/73e312144f3943a8bc6d44baaf5bbb0b.png