jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2025-12-19 18:12:08 -05:00
Code Issues Projects Releases Wiki Activity

IMPALA-12743: Fix incremental stats are filtered out by HMS due to HIVE-27114

Browse Source 
HIVE-27114 adds a new property in hive-site.xml for HMS clients to
filter out unwanted partition parameters:
  hive.metastore.partitions.parameters.exclude.pattern
It defaults to "impala_intermediate_stats_chunk%". This excludes the
incremental stats of Impala. Impala should set this to an empty string
to get rid of the impact.

Tests:
 - Ran CatalogTest#testPullIncrementalStats which failed when running on
   higher Hive versions that have HIVE-27114.

Change-Id: I033e811f4e55b3af04f7a68c69b5779c72e4b053
Reviewed-on: http://gerrit.cloudera.org:8080/20937
Reviewed-by: Laszlo Gaal <laszlo.gaal@cloudera.com>
Reviewed-by: Csaba Ringhofer <csringhofer@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
This commit is contained in:
stiga-huang
2024-01-23 12:43:45 +08:00
committed by Impala Public Jenkins
parent 3072a2110a
commit 1415a979eb
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
fe/src/test/resources/hive-site.xml.py
View File

@@ -65,7 +65,10 @@ CONFIG.update({
'hive.repl.bootstrap.dump.open.txn.timeout': '120s',
# allow both hs2 and hs2-http protocols
'hive.server2.transport.mode': 'all'
'hive.server2.transport.mode': 'all',
# Don't filter out incremental stats of Impala. The default is "impala_intermediate_stats_chunk%".
'hive.metastore.partitions.parameters.exclude.pattern': '""',
})
if variant == 'changed_external_dir':