Files
impala/testdata/workloads/functional-query/queries/QueryTest/compute-stats-with-structs.test
Csaba Ringhofer 9f98b84814 IMPALA-11431: Avoid getting stats for synthetic column row__id from HMS
Before this change Impala always tried to fetch stats for row__id in
full ACID tables, which does not exist in the metastore. Sometimes this
led to an exception from HMS, see HIVE-28498 for details.

This caused flakyness in test_compute_stats_with_structs. The test also
had side effects (it computed stats for a shared table) so it was
modified to use unique_database.

Testing:
- could reproduce the issue by starting HMS with
  hive.metastore.try.direct.sql=true and verified that the change
  fixes it

Change-Id: I759f57c99aa16e4ab5fd82aa5f6b756446291f03
Reviewed-on: http://gerrit.cloudera.org:8080/21742
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-09-06 16:16:22 +00:00

38 lines
1.3 KiB
Plaintext

====
---- QUERY
INVALIDATE METADATA complextypes_structs;
COMPUTE STATS complextypes_structs
---- RESULTS
'Updated 1 partition(s) and 2 column(s).'
---- TYPES
STRING
====
---- QUERY
# Checks that that there are no stats generated for struct columns.
SHOW COLUMN STATS complextypes_structs
---- RESULTS
'id','INT',6,0,4,4.0,-1,-1
'str','STRING',6,0,11,10.3333330154,-1,-1
'alltypes','STRUCT<ti:TINYINT,si:SMALLINT,i:INT,bi:BIGINT,b:BOOLEAN,f:FLOAT,do:DOUBLE,da:DATE,ts:TIMESTAMP,s1:STRING,s2:STRING,c1:CHAR(1),c2:CHAR(3),vc:VARCHAR(10),de1:DECIMAL(5,0),de2:DECIMAL(10,3)>',-1,-1,-1,-1.0,-1,-1
'tiny_struct','STRUCT<b:BOOLEAN>',-1,-1,-1,-1.0,-1,-1
'small_struct','STRUCT<i:INT,s:STRING>',-1,-1,-1,-1.0,-1,-1
---- TYPES
STRING,STRING,BIGINT,BIGINT,BIGINT,DOUBLE,BIGINT,BIGINT
====
---- QUERY
INVALIDATE METADATA complextypes_nested_structs;
COMPUTE STATS complextypes_nested_structs
---- RESULTS
'Updated 1 partition(s) and 1 column(s).'
---- TYPES
STRING
====
---- QUERY
# Checks that that there are no stats generated for struct columns.
SHOW COLUMN STATS complextypes_nested_structs
---- RESULTS
'id','INT',5,0,4,4.0,-1,-1
'outer_struct','STRUCT<str:STRING,inner_struct1:STRUCT<str:STRING,de:DECIMAL(8,2)>,inner_struct2:STRUCT<i:INT,str:STRING>,inner_struct3:STRUCT<s:STRUCT<i:INT,s:STRING>>>',-1,-1,-1,-1.0,-1,-1
---- TYPES
STRING,STRING,BIGINT,BIGINT,BIGINT,DOUBLE,BIGINT,BIGINT