jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2026-01-08 12:02:54 -05:00
Code Issues Projects Releases Wiki Activity
Files
60c5140ea7b8742202f211d8a9deb4883bb3fd65
impala/testdata/workloads/functional-query/queries/QueryTest
History
Martin Grund 60c5140ea7 IMPALA-1983: Warn if table stats are potentially corrupt. 
When the `numRows` parameter stored in the table properties is
errornously set to 0 and a number of non-empty files are present
the table statistics are considered to be corrupt.

To hint that there might be a problem, the explain statement will emit
an additional warning if it detects potentially corrupt table stats like
in the following example:

  Estimated Per-Host Requirements: Memory=42.00MB VCores=1
  WARNING: The following tables have potentially corrupt table and/or
  column statistics.
  compute_stats_db.corrupted

  03:AGGREGATE [FINALIZE]
  |  output: count:merge(*)
  |
  02:EXCHANGE [UNPARTITIONED]
  |
  01:AGGREGATE
  |  output: count(*)
  |
  00:SCAN HDFS [compute_stats_db.corrupted]
     partitions=1/2 files=1 size=24B

In addition, the small query optimization is disabled for such queries.

Change-Id: I0fa911f5132aa62195b854248663a94dcd8b14de
Reviewed-on: http://gerrit.cloudera.org:8080/689
Reviewed-by: Martin Grund <mgrund@cloudera.com>
Tested-by: Internal Jenkins
2015-08-26 22:19:33 +00:00
..
aggregation_no_codegen_only.test
Mark test_non_codegen_tinyint_grouping as execute_serially
2014-04-10 15:17:25 -07:00
aggregation.test
IMPALA-2089: Retain eq predicates bound by grouping slots with complex grouping exprs.
2015-08-23 04:43:37 +00:00
alter-table.test
Nested Types: Pretty print complex types in DESCRIBE.
2015-08-22 09:26:35 +00:00
analytic-fns-tpcds.test
[CDH5] Fix tpcds analytical functions test.
2014-09-26 16:56:40 -07:00
analytic-fns.test
IMPALA-2081: Add PERCENT_RANK, NTILE, CUME_DIST analytic window functions
2015-08-07 04:57:37 +00:00
avro-schema-resolution.test
Address several shortcomings with respect to the usability of Avro tables.
2015-08-25 09:52:18 +00:00
avro-writer.test
IMPALA-1185: Make Avro and Seq writers unsupported
2014-09-26 12:28:03 -07:00
chars-formats.test
Char PARQUET, AVRO, and TEXT tests
2014-09-26 12:24:07 -07:00
chars.test
IMPALA-1636: Generalize index-based partition pruning to allow constant
2015-03-07 09:51:27 +00:00
compute-stats-decimal.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
compute-stats-incremental.test
IMPALA-2199: Row count not set for empty partition when spec is used with compute incremental stats
2015-08-13 09:38:30 +00:00
compute-stats-many-partitions.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
compute-stats.test
IMPALA-1136: Support loading Avro tables without an explicit Avro schema
2015-07-31 12:13:37 +00:00
corrupt_stats.test
IMPALA-1983: Warn if table stats are potentially corrupt.
2015-08-26 22:19:33 +00:00
create.test
Address several shortcomings with respect to the usability of Avro tables.
2015-08-25 09:52:18 +00:00
data-source-tables.test
IMPALA-1025: Use converse of data source predicate operators if expr has val before slot
2014-06-09 23:54:09 -07:00
decimal_avro.test
Decimal: read from Avro
2014-05-16 22:26:11 -07:00
decimal.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
delimited-latin-text.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
delimited-text.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
describe.test
Nested Types: Pretty print complex types in DESCRIBE.
2015-08-22 09:26:35 +00:00
distinct-estimate.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
distinct.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
empty.test
IMPALA-2088: Fix planning of empty union operands with analytics.
2015-07-27 15:46:41 -07:00
explain-level0.test
ExecSummary
2014-06-11 03:10:11 -07:00
explain-level1.test
ExecSummary
2014-06-11 03:10:11 -07:00
explain-level2.test
ExecSummary
2014-06-11 03:10:11 -07:00
explain-level3.test
ExecSummary
2014-06-11 03:10:11 -07:00
exprs.test
IMPALA-2227: S3: query_test.test_queries.TestQueries.test_exprs failure
2015-08-26 00:36:51 +00:00
functions-ddl.test
S3: Some more work toward enabling additional S3 test coverage
2015-03-03 08:29:13 +00:00
grant_revoke_no_insert.test
S3: fix grant_revoke test to run against S3
2015-03-05 18:16:45 +00:00
grant_revoke.test
S3: fix grant_revoke test to run against S3
2015-03-05 18:16:45 +00:00
hbase-compute-stats-incremental.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-compute-stats.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
hbase-filters.test
IMPALA-642: Conjunctive predicates on HBase table not working...
2014-05-08 13:59:00 -07:00
hbase-inline-view.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-inserts.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
hbase-limit.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-rowkeys.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-scan-node.test
Add partition pruning tests
2014-06-24 02:14:27 -07:00
hbase-show-create-table.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-show-stats.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-subquery.test
Treat HBase as a file format for functional tests
2014-01-08 10:52:36 -08:00
hbase-top-n.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hdfs-caching-validation.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
hdfs-caching.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
hdfs-partitions.test
Removing duplicate query test
2015-07-15 03:28:36 +00:00
hdfs-scan-node.test
Add partition pruning tests
2014-06-24 02:14:27 -07:00
hdfs-text-scan.test
IMPALA-1973: Fixing crash when uninitialized, empty row is added in HdfsTextScanner
2015-05-05 00:19:12 +00:00
hdfs-tiny-scan.test
Fix IMPALA-129, IMPALA-534, and other scanner bugs.
2014-01-08 10:52:14 -08:00
hidden-files.test
IMPALA-1595: Fix exhaustive test failure
2015-04-23 19:46:31 +00:00
hive-udf.test
Throw error on unrecognized test sections.
2014-12-02 18:08:09 -08:00
impala-demo.test
Test data loading framework improvements
2014-01-08 10:46:49 -08:00
inline-view-limit.test
Query transformation of nested queries.
2014-08-29 15:35:21 -07:00
inline-view.test
IMPALA-1987: Fix TupleIsNullPredicate to return false if no tuples are
2015-06-11 03:37:18 +00:00
insert_null.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
insert_overwrite.test
Added SHOW TABLE/COLUMN STATS command.
2014-01-08 10:53:51 -08:00
insert_parquet_invalid_codec.test
Enable isilon end to end tests for Impala.
2015-05-27 22:25:12 +00:00
insert_part_key.test
Throw error on unrecognized test sections.
2014-12-02 18:08:09 -08:00
insert_permutation.test
IMPALA-945: Fix column reordering with SELECT expressions
2014-04-18 00:12:12 -07:00
insert.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
joins-against-hbase.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
joins.test
IMPALA-2015: Add support for nested loop join
2015-08-19 08:40:14 +00:00
libs_with_same_filenames.test
S3: enable more tests for S3
2015-03-11 16:39:39 -07:00
limit.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
load-hive-udfs.test
S3: enable more tests for S3
2015-03-11 16:39:39 -07:00
load.test
Fix metadata/test_load.py to work with Isilon.
2015-06-05 00:52:14 +00:00
local-filesystem.test
Enable local filesystem tables
2015-02-27 18:48:56 +00:00
misc.test
IMPALA-2239: update misc.test to match the new .test file format
2015-08-25 00:12:52 +00:00
mixed-format.test
Change the way data is loaded
2014-01-08 10:48:09 -08:00
multiple-filesystems.test
Fix S3 build v2: Adjust expected SHOW TABLE STATS output.
2015-05-16 02:47:01 +00:00
null_data.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
outer-joins.test
IMPALA-2065: Workaround IMPALA-1619 in BufferedBlockMgr::ConsumeMemory()
2015-06-27 01:17:50 +00:00
overflow.test
IMPALA-724: Support infinite / nan values in text files
2014-05-08 12:28:53 -07:00
parquet.test
IMPALA-2130: Wrong verification of Parquet file version
2015-07-14 02:52:02 +00:00
partition-col-types.test
Throw error on unrecognized test sections.
2014-12-02 18:08:09 -08:00
scanners.test
Add partition pruning tests
2014-06-24 02:14:27 -07:00
semi-joins.test
IMPALA-1919: Avoid calling ProcessBatch with out_batch->AtCapacity in right joins
2015-05-04 19:49:56 +00:00
seq-writer.test
Adding SEQUENCEFILE compressed record format
2014-11-19 17:21:36 -08:00
set.test
IMPALA-1906: PARQUET_FILE_SIZE query option overflows for values >= 2GB.
2015-08-25 23:28:13 +00:00
show-create-table.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
show-data-sources.test
S3: Some more work toward enabling additional S3 test coverage
2015-03-03 08:29:13 +00:00
show-stats.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
show.test
IMPALA-1437: Implement SHOW FILES IN <table>
2015-03-05 05:13:50 +00:00
single-node-nlj.test
IMPALA-2015: Add support for nested loop join
2015-08-19 08:40:14 +00:00
sort.test
IMPALA-1148: Do not generate a sort node if the sort tuple has no materialized slots.
2014-09-05 10:12:55 -07:00
spilling.test
IMPALA-1820: Start with small pages for hash tables during repartitioning
2015-02-28 00:42:04 +00:00
subplans.test
Nested Types: Reset() for partitioned hash join node
2015-07-08 01:51:09 +00:00
subquery.test
IMPALA-1550: Invalid rewrite when EXISTS subqueries contain aggregate
2015-04-02 19:11:00 +00:00
test-unmatched-schema.test
IMPALA-502: Impala does not return NULL for case where table has extra string column and data does not (it returns an empty string)
2014-01-08 10:52:02 -08:00
text-writer.test
IMPALA-1185: Make Avro and Seq writers unsupported
2014-09-26 12:28:03 -07:00
top-n.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
truncate-table.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
uda-mem-limit.test
S3: enable more tests for S3
2015-03-11 16:39:39 -07:00
uda.test
IMPALA-1829: UDAs with different intermediate type
2015-08-19 04:37:39 +00:00
udf-errors.test
S3: enable more tests for S3
2015-03-11 16:39:39 -07:00
udf-init-close.test
IMPALA-1030: HdfsTableSink was evaluating exprs in Prepare()
2014-06-12 02:23:20 -07:00
udf-mem-limit.test
S3: enable more tests for S3
2015-03-11 16:39:39 -07:00
udf.test
IMPALA-1589: allow up to 8 non-variadic arguments in the interpreted UDF path
2014-12-16 18:53:16 -08:00
union.test
IMPALA-1340: removing implicit casts during expr substitution is not always safe
2014-10-06 17:47:37 -07:00
use.test
Change the way data is loaded
2014-01-08 10:48:09 -08:00
values.test
Throw error on unrecognized test sections.
2014-12-02 18:08:09 -08:00
views-compatibility.test
IMPALA-995: Add plan hints embedded in comments and preserve them in views.
2014-09-18 00:36:03 -07:00
views-ddl.test
IMPALA-995: Add plan hints embedded in comments and preserve them in views.
2014-09-18 00:36:03 -07:00
views.test
Added order by query tests
2014-06-20 13:35:10 -07:00
wide-row.test
IMPALA-525: Adjust IO buffer size based on read length and other memory fixes
2014-01-08 10:54:01 -08:00
with-clause.test
IMPALA-1357: Analysis of WithClause pollutes global state
2014-10-30 16:50:00 -07:00