jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2026-01-24 15:00:45 -05:00
Code Issues Projects Releases Wiki Activity
Files
f38da0df8e7d594d1260ea05705f19adbd839db1
impala/testdata/workloads/functional-query/queries/QueryTest
History
Tim Armstrong f38da0df8e IMPALA-4400: aggregate runtime filters locally 
Move RuntimeFilterBank to QueryState(). Implement fine-grained
locking for each filter to mitigate any increased lock
contention from the change.

Make RuntimeFilterBank handle multiple producers of the
same filter, e.g. multiple instances of a partitioned
join. It computes the expected number of filters upfront
then sends the filter to the coordinator once all the
local instances have been merged together. The merging
can be done in parallel locally to improve latency of
filter propagation.

Add Or() methods to MinMaxFilter and BloomFilter, since
we now need to merge those, not just the thrift versions.

Update coordinator filter routing to expect only one
instance of a filter from each producer backend and
to only send one instance to each consumer backend
(instead of sending one per fragment).

Update memory reservations and estimates to be lower
to account for sharing of filters between fragment
instances. mt_dop plans are modified to show these
shared and non-shared resources separately.

Enable waiting for runtime filters for kudu scanner
with mt_dop.

Made min/max filters const-correct.

Testing
* Added unit tests for Or() methods.
* Added some additional e2e test coverage for mt_dop queries
* Updated planner tests with new estimates and reservation.
* Ran a single node 3-impalad stress test with TPC-H kudu and
  TPC-DS parquet.
* Ran exhaustive tests.
* Ran core tests with ASAN.

Perf
* Did a single-node perf run on TPC-H with default settings. No perf change.
* Single-node perf run with mt_dop=8 showed significant speedups:

+----------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format           | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
+----------+-----------------------+---------+------------+------------+----------------+
| TPCH(30) | parquet / none / none | 10.14   | -7.29%     | 5.05       | -11.68%        |
+----------+-----------------------+---------+------------+------------+----------------+

+----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+---------+
| Workload | Query    | File Format           | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval    |
+----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+---------+
| TPCH(30) | TPCH-Q7  | parquet / none / none | 38.87  | 38.44       |   +1.13%   |   7.17%   | * 10.92% *     | 20    |   +0.72%       | 0.72    | 0.39    |
| TPCH(30) | TPCH-Q1  | parquet / none / none | 4.28   | 4.26        |   +0.50%   |   1.92%   |   1.09%        | 20    |   +0.03%       | 0.31    | 1.01    |
| TPCH(30) | TPCH-Q22 | parquet / none / none | 2.32   | 2.32        |   +0.05%   |   2.01%   |   1.89%        | 20    |   -0.03%       | -0.36   | 0.08    |
| TPCH(30) | TPCH-Q15 | parquet / none / none | 3.73   | 3.75        |   -0.42%   |   0.84%   |   1.05%        | 20    |   -0.25%       | -0.77   | -1.40   |
| TPCH(30) | TPCH-Q13 | parquet / none / none | 9.80   | 9.83        |   -0.38%   |   0.51%   |   0.80%        | 20    |   -0.32%       | -1.30   | -1.81   |
| TPCH(30) | TPCH-Q2  | parquet / none / none | 1.98   | 2.00        |   -1.32%   |   1.74%   |   2.81%        | 20    |   -0.64%       | -1.71   | -1.79   |
| TPCH(30) | TPCH-Q6  | parquet / none / none | 1.22   | 1.25        |   -2.14%   |   2.66%   |   4.15%        | 20    |   -0.96%       | -2.00   | -1.95   |
| TPCH(30) | TPCH-Q19 | parquet / none / none | 5.13   | 5.22        |   -1.65%   |   1.20%   |   1.40%        | 20    |   -1.76%       | -3.34   | -4.02   |
| TPCH(30) | TPCH-Q16 | parquet / none / none | 2.46   | 2.56        |   -4.13%   |   2.49%   |   1.99%        | 20    |   -4.31%       | -4.04   | -5.94   |
| TPCH(30) | TPCH-Q9  | parquet / none / none | 81.63  | 85.07       |   -4.05%   |   4.94%   |   3.06%        | 20    |   -5.46%       | -3.28   | -3.21   |
| TPCH(30) | TPCH-Q10 | parquet / none / none | 5.07   | 5.50        | I -7.92%   |   0.96%   |   1.33%        | 20    | I -8.51%       | -5.27   | -22.14  |
| TPCH(30) | TPCH-Q21 | parquet / none / none | 24.00  | 26.24       | I -8.57%   |   0.46%   |   0.38%        | 20    | I -9.34%       | -5.27   | -67.47  |
| TPCH(30) | TPCH-Q18 | parquet / none / none | 8.66   | 9.50        | I -8.86%   |   0.62%   |   0.44%        | 20    | I -9.75%       | -5.27   | -55.17  |
| TPCH(30) | TPCH-Q3  | parquet / none / none | 6.01   | 6.70        | I -10.19%  |   1.01%   |   0.90%        | 20    | I -11.25%      | -5.27   | -35.76  |
| TPCH(30) | TPCH-Q12 | parquet / none / none | 2.98   | 3.39        | I -12.23%  |   1.48%   |   1.48%        | 20    | I -13.56%      | -5.27   | -27.75  |
| TPCH(30) | TPCH-Q11 | parquet / none / none | 1.69   | 2.00        | I -15.55%  |   1.63%   |   1.47%        | 20    | I -18.09%      | -5.27   | -34.60  |
| TPCH(30) | TPCH-Q4  | parquet / none / none | 2.42   | 2.87        | I -15.69%  |   1.48%   |   1.26%        | 20    | I -18.61%      | -5.27   | -39.50  |
| TPCH(30) | TPCH-Q14 | parquet / none / none | 4.64   | 6.27        | I -26.02%  |   1.35%   |   0.73%        | 20    | I -35.37%      | -5.27   | -94.07  |
| TPCH(30) | TPCH-Q20 | parquet / none / none | 3.19   | 4.37        | I -27.01%  |   1.54%   |   0.99%        | 20    | I -36.85%      | -5.27   | -80.74  |
| TPCH(30) | TPCH-Q5  | parquet / none / none | 4.57   | 6.39        | I -28.36%  |   1.04%   |   0.75%        | 20    | I -39.56%      | -5.27   | -120.02 |
| TPCH(30) | TPCH-Q17 | parquet / none / none | 3.15   | 4.71        | I -33.06%  |   1.59%   |   1.31%        | 20    | I -49.43%      | -5.27   | -87.64  |
| TPCH(30) | TPCH-Q8  | parquet / none / none | 5.25   | 7.95        | I -33.95%  |   0.95%   |   0.53%        | 20    | I -51.11%      | -5.27   | -185.02 |
+----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+---------+

Change-Id: Iabeeab5eec869ff2197250ad41c1eb5551704acc
Reviewed-on: http://gerrit.cloudera.org:8080/14538
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2020-01-29 00:58:24 +00:00
..
acid-clear-statsaccurate.test
IMPALA-8839: Remove COLUMN_STATS_ACCURATE from properties
2019-08-13 18:55:09 +00:00
acid-compaction.test
IMPALA-9068: Use different directories for external vs managed warehouse
2020-01-24 17:29:15 +00:00
acid-compute-stats.test
IMPALA-8836: Support COMPUTE STATS on insert only ACID tables
2019-08-16 23:22:53 +00:00
acid-insert-fail.test
IMPALA-8636: Implement INSERT for insert-only ACID tables
2019-07-27 13:45:51 +00:00
acid-insert.test
IMPALA-8854: fix acid insert tests
2019-08-15 13:02:55 +00:00
acid-negative.test
IMPALA-8889: Fix error messages for unsupported operations on acid tables
2019-08-27 11:58:07 +00:00
acid-nonacid-insert.test
IMPALA-8636: Implement INSERT for insert-only ACID tables
2019-07-27 13:45:51 +00:00
acid-partitioned.test
IMPALA-9093: Change ACID tests to upgrade external tables
2019-11-07 14:30:47 +00:00
acid-profile.test
IMPALA-8681: Only show ValidWriteIdLists for Acid tables
2019-07-03 20:46:45 +00:00
acid-truncate.test
IMPALA-8793: Implement TRUNCATE for insert-only ACID tables
2019-08-27 18:51:55 +00:00
acid.test
IMPALA-9093: Change ACID tests to upgrade external tables
2019-11-07 14:30:47 +00:00
admission-max-min-mem-limits.test
IMPALA-7608: Estimate row count from file size when no stats available
2019-06-21 03:28:43 +00:00
admission-reject-mem-estimate.test
IMPALA-8451,IMPALA-8905: enable admission control for dockerised tests
2019-09-27 01:54:39 +00:00
admission-reject-min-reservation.test
IMPALA-8536: Add Scalable Pool Configuration to Admission Controller.
2019-06-19 05:58:10 +00:00
aggregation_no_codegen_only.test
IMPALA-3491: Use unique db in test_scanners.py and test_aggregation.py
2016-09-13 21:57:36 +00:00
aggregation.test
IMPALA-6660: Change -0/+0 floating point to compare as equal in hash table
2019-11-26 19:14:24 +00:00
alias.test
IMPALA-9025: Handle AnalysisException caused by expr_rewrites
2019-10-16 02:04:12 +00:00
alloc-fail-init.test
IMPALA-376: add built-in functions for parsing JSON
2018-09-29 11:59:03 +00:00
alloc-fail-update.test
IMPALA-376: add built-in functions for parsing JSON
2018-09-29 11:59:03 +00:00
alter-table-hdfs-caching.test
IMPALA-4897: AnalysisException: specified cache pool does not exist
2017-02-14 05:56:33 +00:00
alter-table-set-column-stats.test
IMPALA-7659: Populate NULL count while computing column stats
2018-12-08 00:21:55 +00:00
alter-table-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
alter-table.test
IMPALA-8369: Add HIVE_MAJOR_VERSION section to EE tests + some fixes
2019-06-03 09:24:38 +00:00
analytic-fns-tpcds.test
IMPALA-7403: fix child batch mem mgmt in analytic
2018-08-08 20:51:45 +00:00
analytic-fns.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
avro_date.test
IMPALA-7368: Change supported year range for DATE values to 1..9999
2019-10-04 18:36:22 +00:00
avro-schema-changes.test
IMPALA-8198: DATE: Read from avro.
2019-09-27 17:18:35 +00:00
avro-schema-resolution.test
IMPALA-8198: DATE: Read from avro.
2019-09-27 17:18:35 +00:00
basic-spilling.test
IMPALA-6645: Enable disk spill encryption by default
2018-05-15 22:23:14 +00:00
bloom_filters_wait.test
IMPALA-5519: Allocate fragment's runtime filter memory from Buffer pool
2018-02-13 08:29:03 +00:00
bloom_filters.test
IMPALA-8698: Disable row count estimate to avoid a flaky test
2019-06-26 01:58:10 +00:00
cast_format_from_table.test
IMPALA-8703: ISO:SQL:2016 datetime patterns - Milestone 1
2019-09-19 18:46:19 +00:00
chars-formats.test
IMPALA-7647: Add HS2/Impyla dimension to TestQueries
2018-10-09 00:45:10 +00:00
chars-tmp-tables.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
chars.test
IMPALA-4123: Columnar decoding in Parquet
2018-11-17 01:48:05 +00:00
clear-statsaccurate.test
IMPALA-8839: Remove COLUMN_STATS_ACCURATE from properties
2019-08-13 18:55:09 +00:00
codegen-mem-limit.test
IMPALA-5847: Fix incorrect use of SET in .test files
2019-01-22 01:20:31 +00:00
compute-stats-avro-catalog-v2.test
IMPALA-8121: part 1: some test fixes for catalog v2
2019-05-02 23:33:32 +00:00
compute-stats-avro.test
IMPALA-8121: part 1: some test fixes for catalog v2
2019-05-02 23:33:32 +00:00
compute-stats-complextype-warning.test
IMPALA-8771: Missing stats warning for complex type columns
2019-08-06 16:38:07 +00:00
compute-stats-date.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
compute-stats-decimal.test
IMPALA-7659: Populate NULL count while computing column stats
2018-12-08 00:21:55 +00:00
compute-stats-incremental.test
IMPALA-8849: fix IllegalStateException with VARCHAR
2019-08-15 14:40:04 +00:00
compute-stats-keywords.test
IMPALA-7659: Populate NULL count while computing column stats
2018-12-08 00:21:55 +00:00
compute-stats-many-partitions.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
compute-stats.test
IMPALA-8451,IMPALA-8905: enable admission control for dockerised tests
2019-09-27 01:54:39 +00:00
corrupt-stats.test
IMPALA-8415: Fix tests broken by storage layer information
2019-04-16 22:40:13 +00:00
create-database.test
IMPALA-9068: Use different directories for external vs managed warehouse
2020-01-24 17:29:15 +00:00
create-table-as-select-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
create-table-as-select.test
IMPALA-4166: Add SORT BY sql clause
2017-05-12 15:43:30 +00:00
create-table-like-file-orc.test
IMPALA-8046: Support CREATE TABLE from an ORC file
2020-01-14 17:15:17 +00:00
create-table-like-file-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
create-table-like-file.test
IMPALA-8046: Support CREATE TABLE from an ORC file
2020-01-14 17:15:17 +00:00
create-table-like-table-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
create-table-like-table.test
IMPALA-8046: Support CREATE TABLE from an ORC file
2020-01-14 17:15:17 +00:00
create-table-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
create-table.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
data-cache.test
IMPALA-8496: Fix flakiness of test_data_cache.py
2019-05-05 02:11:55 +00:00
data-source-tables.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
datastream-sender-codegen.test
IMPALA-4356,IMPALA-7331: codegen all ScalarExprs
2019-05-15 22:34:28 +00:00
date-fileformat-support.test
IMPALA-8801: Date type support for ORC scanner
2020-01-17 18:54:33 +00:00
date-partitioning.test
IMPALA-8198: DATE: Read from avro.
2019-09-27 17:18:35 +00:00
date.test
IMPALA-7368: Change supported year range for DATE values to 1..9999
2019-10-04 18:36:22 +00:00
decimal_avro.test
IMPALA-4924: Enable Decimal V2 by default
2018-01-25 04:33:11 +00:00
decimal_min_max_filters.test
IMPALA-8064: Fix intermittent test failures from test_min_max_filters
2019-01-14 09:07:03 +00:00
decimal-exprs.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
decimal.test
IMPALA-7647: Add HS2/Impyla dimension to TestQueries
2018-10-09 00:45:10 +00:00
dedicated-coord-mem-estimates.test
IMPALA-8791: Handle the case where there is no fragment scheduled on
2019-08-14 06:11:45 +00:00
delimited-latin-text.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
delimited-text.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
describe-db.test
IMPALA-9068: Use different directories for external vs managed warehouse
2020-01-24 17:29:15 +00:00
describe-hive-db.test
IMPALA-9068: Use different directories for external vs managed warehouse
2020-01-24 17:29:15 +00:00
describe-path.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
disable-codegen.test
IMPALA-4356,IMPALA-7331: codegen all ScalarExprs
2019-05-15 22:34:28 +00:00
disable-lzo-plugin.test
IMPALA-6941: load more text scanner compression plugins
2018-05-18 03:44:46 +00:00
disable-orc-scanner.test
IMPALA-7792: fix disabling of ORC scans
2018-11-01 07:30:58 +00:00
distinct-estimate.test
Improve Hll estimate for small cardinalities.
2015-07-16 19:38:17 +00:00
distinct.test
IMPALA-6822: Add a query option to control shuffling by distinct exprs
2018-04-12 22:01:35 +00:00
empty-build-joins.test
IMPALA-3916: Reserve SQL:2016 reserved words
2018-02-02 01:13:08 +00:00
empty.test
IMPALA-2894: Move regression test into a different .test file.
2016-01-27 20:41:45 +00:00
exchange-delays-zero-rows.test
IMPALA-6512: Fix test_exchange_delays for KRPC
2018-02-15 10:55:55 +00:00
exchange-delays.test
IMPALA-6512: Fix test_exchange_delays for KRPC
2018-02-15 10:55:55 +00:00
exchange-mem-scaling.test
IMPALA-7873: Fix flakiness in TestExchangeMemUsage
2018-11-21 00:08:25 +00:00
explain-level0.test
IMPALA-6957: calc thread resource requirement in planner
2018-05-12 01:43:37 +00:00
explain-level1.test
IMPALA-8021: Add estimated cardinality to EXPLAIN output
2019-01-12 04:03:26 +00:00
explain-level2.test
IMPALA-2138: part 2: clean up result expr handling
2019-09-25 01:06:19 +00:00
explain-level3.test
IMPALA-2138: part 2: clean up result expr handling
2019-09-25 01:06:19 +00:00
exprs.test
IMPALA-9023: Fix IllegalStateException in SimplifyConditionalsRule
2019-11-07 23:56:06 +00:00
functions-ddl.test
IMPALA-7907: Fix ScalarFunction.toSql()
2018-12-11 02:47:16 +00:00
grant_revoke_kudu.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
grant_revoke.test
IMPALA-7907: Fix ScalarFunction.toSql()
2018-12-11 02:47:16 +00:00
hbase-col-filter.test
IMPALA-7929: Allow null qualifier in THBaseFilter
2019-02-07 23:05:30 +00:00
hbase-compute-stats-incremental.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
hbase-compute-stats.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
hbase-filters.test
IMPALA-642: Conjunctive predicates on HBase table not working...
2014-05-08 13:59:00 -07:00
hbase-inline-view.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-inserts.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
hbase-limit.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-rowkeys.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hbase-scan-node.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
hbase-show-stats.test
IMPALA-4962: Fix SHOW COLUMN STATS for HS2
2017-02-22 23:10:34 +00:00
hbase-subquery.test
Treat HBase as a file format for functional tests
2014-01-08 10:52:36 -08:00
hbase-top-n.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
hdfs_parquet_scan_node_profile.test
IMPALA-5448: fix invalid number of splits reported in Parquet scan node
2017-10-10 01:30:33 +00:00
hdfs_scanner_profile.test
IMPALA-4863/IMPALA-5311: Correctly account the file type and compression codec
2017-09-21 17:38:08 +00:00
hdfs-caching-validation.test
IMPALA-1595: Add 'location' to SHOW [TABLE STATS|PARTITIONS] for HDFS tables
2015-04-21 19:27:50 +00:00
hdfs-caching.test
IMPALA-9055: Impala shouldn't set expiration to NEVER for cache directives.
2019-10-18 08:15:00 +00:00
hdfs-erasure-coding.test
IMPALA-7236: Fix the parsing of ALLOW_ERASURE_CODED_FILES
2018-07-03 23:49:44 +00:00
hdfs-partitions.test
IMPALA-7369: part 1: Implement TRUNC, DATE_TRUNC, EXTRACT, DATE_PART functions for DATE
2019-06-05 14:23:23 +00:00
hdfs-scan-node.test
Add partition pruning tests
2014-06-24 02:14:27 -07:00
hdfs-scanner-thread-mem-scaling.test
IMPALA-7096: restore scanner thread memory heuristics
2018-08-16 21:25:00 +00:00
hdfs-text-scan-with-header.test
IMPALA-5287: Test skip.header.line.count on gzip
2017-05-09 01:36:46 +00:00
hdfs-text-scan.test
IMPALA-3004: Fix QueryTest tests
2016-02-19 00:03:15 -08:00
hdfs-tiny-scan.test
Fix IMPALA-129, IMPALA-534, and other scanner bugs.
2014-01-08 10:52:14 -08:00
hidden-files.test
IMPALA-3491: Use unique_database fixture in test_hidden_files.py.
2016-05-12 14:17:59 -07:00
hive2-pre-gregorian-date-orc.test
IMPALA-8801: Date type support for ORC scanner
2020-01-17 18:54:33 +00:00
hive2-pre-gregorian-date.test
IMPALA-8198: DATE: Read from avro.
2019-09-27 17:18:35 +00:00
impala-demo.test
…
incompatible_avro_partition.test
IMPALA-7411, IMPALA-7414. Fix failing tests on local filesystem
2018-08-09 19:18:08 +00:00
inline-view-limit.test
IMPALA-7647: Add HS2/Impyla dimension to TestQueries
2018-10-09 00:45:10 +00:00
inline-view.test
IMPALA-7608: Estimate row count from file size when no stats available
2019-06-21 03:28:43 +00:00
insert_bad_expr.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
insert_null.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
insert_overwrite.test
Added SHOW TABLE/COLUMN STATS command.
2014-01-08 10:53:51 -08:00
insert_parquet_invalid_codec.test
Enable isilon end to end tests for Impala.
2015-05-27 22:25:12 +00:00
insert_parquet_multi_codecs.test
IMPALA-8450: Add support for zstd in parquet
2019-06-05 11:15:04 +00:00
insert_part_key.test
Throw error on unrecognized test sections.
2014-12-02 18:08:09 -08:00
insert_permutation.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
insert-mem-limit.test
IMPALA-7010: don't run memory usage tests on non-HDFS
2018-05-11 22:41:49 +00:00
insert-random-partition.test
IMPALA-402: test for random partitioning in insert
2018-11-06 00:00:12 +00:00
insert.test
IMPALA-7010: don't run memory usage tests on non-HDFS
2018-05-11 22:41:49 +00:00
invalid_header.test
IMPALA-3004: Fix QueryTest tests
2016-02-19 00:03:15 -08:00
java-udf.test
IMPALA-8016: Fix lifecycle of classloader for UDFs.
2018-12-27 21:02:57 +00:00
joins_mt_dop.test
IMPALA-9019: fix runtime filter propagation with mt_dop
2019-10-22 04:21:51 +00:00
joins-against-hbase.test
Remove explicit references to functional_hbase tables from .test files.
2015-02-23 23:32:41 +00:00
joins.test
IMPALA-6660: Change -0/+0 floating point to compare as equal in hash table
2019-11-26 19:14:24 +00:00
kudu_alter.test
IMPALA-8506: Support RENAME TABLE statement with Kudu/HMS integration
2019-06-06 22:16:27 +00:00
kudu_create.test
IMPALA-7995: part 1: fixes for e2e dockerised impala tests
2019-04-13 02:42:32 +00:00
kudu_delete.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
kudu_describe.test
IMPALA-5351: Support storing column comment of kudu table
2019-05-03 20:28:48 +00:00
kudu_hms_alter.test
IMPALA-8506: Support RENAME TABLE statement with Kudu/HMS integration
2019-06-06 22:16:27 +00:00
kudu_insert_mem_limit.test
IMPALA-7010: don't run memory usage tests on non-HDFS
2018-05-11 22:41:49 +00:00
kudu_insert.test
IMPALA-7832: Support for IF NOT EXISTS in ALTER TABLE ADD COLUMN(S)
2019-01-24 03:14:35 +00:00
kudu_limit.test
IMPALA-6821: Push down limits into Kudu
2018-04-27 21:55:11 +00:00
kudu_partition_ddl.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
kudu_stats.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
kudu_update.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
kudu_upsert.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
kudu-overflow-ts-abort-on-error.test
IMPALA-5137: Support Kudu UNIXTIME_MICROS as Impala TIMESTAMP
2017-05-11 20:55:51 +00:00
kudu-overflow-ts.test
IMPALA-5137: Support Kudu UNIXTIME_MICROS as Impala TIMESTAMP
2017-05-11 20:55:51 +00:00
kudu-scan-mem-usage.test
IMPALA-7600: bump mem_limit for test_kudu_scan_mem_usage
2018-09-26 06:51:56 +00:00
kudu-scan-node.test
IMPALA-6187: Fix missing conjuncts evaluation with empty projection
2017-11-29 05:53:15 +00:00
kudu-stats-agg.test
IMPALA-6501: Optimize count(star) for Kudu scans
2019-10-21 20:23:56 +00:00
kudu-timeouts-impalad.test
IMPALA-5167: Reduce the number of Kudu clients created (FE)
2017-07-21 21:49:04 +00:00
large_strings.test
IMPALA-8451,IMPALA-8905: enable admission control for dockerised tests
2019-09-27 01:54:39 +00:00
libs_with_same_filenames.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
limit.test
IMPALA-7647: Add HS2/Impyla dimension to TestQueries
2018-10-09 00:45:10 +00:00
lineage.test
IMPALA-9070: Include table location in lineage for 'CREATE EXTERNAL
2019-10-21 20:12:47 +00:00
load-java-udfs.test
IMPALA-8016: Fix lifecycle of classloader for UDFs.
2018-12-27 21:02:57 +00:00
load.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
local-filesystem.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
local-timestamp-functions.test
IMPALA-7362: Add query option to set timezone
2018-08-03 17:45:25 +00:00
max-nesting-depth.test
IMPALA-6503: Support reading complex types from ORC
2019-03-08 04:39:08 +00:00
min_max_filters.test
IMPALA-8064: Fix intermittent test failures from test_min_max_filters
2019-01-14 09:07:03 +00:00
misc.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
mixed-format.test
IMPALA-5861: fix RowsRead for zero-slot table scan
2019-02-12 20:37:45 +00:00
mt-dop-auto-fallback.test
IMPALA-8997: auto fallback to mt_dop=0
2019-10-22 00:31:01 +00:00
mt-dop-compute-stats.test
Add functional tests for compute stats with mt_dop > 0.
2016-11-03 11:59:07 +00:00
mt-dop-kudu.test
IMPALA-4996: Single-threaded KuduScanNode
2017-03-17 19:33:31 +00:00
mt-dop-parquet-nested.test
IMPALA-4564,IMPALA-4565: mt_dop fixes for old aggs and joins
2016-12-02 01:46:55 +00:00
mt-dop-parquet-scheduling.test
IMPALA-4618: Fixing #Hosts and adding #Instances in exec summary
2019-11-26 07:28:23 +00:00
mt-dop-parquet.test
IMPALA-4564,IMPALA-4565: mt_dop fixes for old aggs and joins
2016-12-02 01:46:55 +00:00
mt-dop.test
IMPALA-4564,IMPALA-4565: mt_dop fixes for old aggs and joins
2016-12-02 01:46:55 +00:00
multiple-distinct-aggs.test
IMPALA-8969: Grouping aggregator can cause segmentation fault when doing multiple aggregations
2019-09-25 16:58:14 +00:00
multiple-filesystems.test
IMPALA-3577, IMPALA-3486: Partitions on multiple filesystems breaks with S3_SKIP_INSERT_STAGING
2016-05-31 23:32:11 -07:00
nested-types-basic-partitioned.test
IMPALA-6370: fix partitioned parquet tables with nested types
2018-01-05 20:44:21 +00:00
nested-types-parquet-page-index.test
IMPALA-5843: Use page index in Parquet files to skip pages
2019-05-10 11:46:38 +00:00
nested-types-parquet-stats.test
IMPALA-4985: use parquet stats of nested types for dynamic pruning
2017-11-22 22:00:16 +00:00
nested-types-runtime.test
IMPALA-2138: part 1: initial cleanup
2019-09-20 22:15:41 +00:00
nested-types-scanner-array-materialization.test
Nested types: read and materialize nested types in Parquet scanner
2015-09-02 19:23:54 +00:00
nested-types-scanner-basic.test
Nested types: read and materialize nested types in Parquet scanner
2015-09-02 19:23:54 +00:00
nested-types-scanner-maps.test
Regenerate complextypestbl files to include nested_struct.g field
2016-04-01 05:06:38 +00:00
nested-types-scanner-multiple-materialization.test
Nested types: read and materialize nested types in Parquet scanner
2015-09-02 19:23:54 +00:00
nested-types-scanner-position.test
IMPALA-4123: Columnar decoding in Parquet
2018-11-17 01:48:05 +00:00
nested-types-subplan-single-node.test
IMPALA-5847: Fix incorrect use of SET in .test files
2019-01-22 01:20:31 +00:00
nested-types-subplan.test
IMPALA-6503: Support reading complex types from ORC
2019-03-08 04:39:08 +00:00
nested-types-tpch-limit.test
IMPALA-6503: Support reading complex types from ORC
2019-03-08 04:39:08 +00:00
nested-types-tpch-mem-limit-single-node.test
IMPALA-8336: fix flaky ORC memory limit test
2019-04-09 10:23:13 +00:00
nested-types-tpch-mem-limit.test
IMPALA-6503: Support reading complex types from ORC
2019-03-08 04:39:08 +00:00
nested-types-tpch.test
IMPALA-6503: Support reading complex types from ORC
2019-03-08 04:39:08 +00:00
nested-types-with-clause.test
IMPALA-2375: Disabling/moving tests that don't work with the old HJ
2015-10-07 14:47:40 -07:00
null_data.test
Add nested types support to Create Table Like File
2015-08-22 01:46:26 +00:00
out-of-range-date-orc.test
IMPALA-8801: Date type support for ORC scanner
2020-01-17 18:54:33 +00:00
out-of-range-date.test
IMPALA-7368: Change supported year range for DATE values to 1..9999
2019-10-04 18:36:22 +00:00
out-of-range-timestamp-abort-on-error.test
IMPALA-7595: Check the validity of the time part of Parquet timestamps
2018-10-01 13:20:40 +00:00
out-of-range-timestamp-continue-on-error.test
IMPALA-7595: Check the validity of the time part of Parquet timestamps
2018-10-01 13:20:40 +00:00
out-of-range-timestamp-local-tz-conversion.test
IMPALA-4123: Columnar decoding in Parquet
2018-11-17 01:48:05 +00:00
outer-joins.test
IMPALA-5504: Fix TupleIsNullPredicate evaluation.
2017-08-19 20:56:10 +00:00
overflow.test
IMPALA-4810: add DECIMAL test case to strict_mode tests
2017-03-03 01:43:42 +00:00
parquet-abort-on-error.test
IMPALA-2736: Basic column-wise slot materialization in Parquet scanner.
2016-05-12 14:17:48 -07:00
parquet-ambiguous-list-legacy.test
IMPALA-4725: Query option to control Parquet array resolution.
2017-03-09 05:07:44 +00:00
parquet-ambiguous-list-modern.test
IMPALA-8271: Refactor the use of Thrift enums for query options
2019-03-14 22:43:50 +00:00
parquet-bad-codec.test
IMPALA-6592: add test for invalid parquet codecs
2018-03-08 04:48:36 +00:00
parquet-bad-compressed-dict-page-size.test
IMPALA-6353: Fix crash in snappy decompressor
2018-01-17 04:18:24 +00:00
parquet-continue-on-error.test
IMPALA-(3895,3859): Don't log file data on parse errors
2016-08-25 10:20:36 +00:00
parquet-corrupt-footer-len-decr.test
IMPALA-6442: Misleading file offset reporting in error messages.
2018-09-10 16:09:41 +00:00
parquet-corrupt-footer-len-incr.test
IMPALA-6442: Misleading file offset reporting in error messages.
2018-09-10 16:09:41 +00:00
parquet-corrupt-rle-counts-abort.test
IMPALA-3754: fix TestParquet.test_corrupt_rle_counts flakiness
2016-06-20 15:37:18 -07:00
parquet-corrupt-rle-counts.test
IMPALA-3754: fix TestParquet.test_corrupt_rle_counts flakiness
2016-06-20 15:37:18 -07:00
parquet-decimal-formats.test
IMPALA-5542: Impala cannot scan Parquet decimal stored as int64_t/int32_t
2018-08-02 20:21:12 +00:00
parquet-def-levels.test
IMPALA-6709: Simplify tests that copy local files to tables
2018-08-22 18:08:20 +00:00
parquet-deprecated-stats.test
IMPALA-4815, IMPALA-4817, IMPALA-4819: Write and Read Parquet Statistics for remaining types
2017-05-09 15:47:21 +00:00
parquet-error-propagation-race.test
IMPALA-8885: Improve Parquet version metadata error
2019-08-24 00:32:28 +00:00
parquet-filtering.test
IMPALA-7370: DATE: Read/Write to parquet.
2019-05-07 00:36:56 +00:00
parquet-int64-timestamps.test
IMPALA-5051: Add INT64 timestamp write support in Parquet
2019-04-09 08:54:23 +00:00
parquet-invalid-minmax-stats.test
IMPALA-6538: Fix read path when Parquet min/max statistics contain NaN
2018-02-22 00:57:46 +00:00
parquet-num-values-def-levels-mismatch.test
IMPALA-7869: break up parquet-column-readers.cc
2018-11-27 02:01:12 +00:00
parquet-page-index-alltypes-tiny-pages-plain.test
IMPALA-5843: Use page index in Parquet files to skip pages
2019-05-10 11:46:38 +00:00
parquet-page-index-alltypes-tiny-pages.test
IMPALA-5843: Use page index in Parquet files to skip pages
2019-05-10 11:46:38 +00:00
parquet-page-index-large.test
IMPALA-5843: Use page index in Parquet files to skip pages
2019-05-10 11:46:38 +00:00
parquet-page-index.test
IMPALA-5843: Use page index in Parquet files to skip pages
2019-05-10 11:46:38 +00:00
parquet-resolution-by-name.test
IMPALA-8950: Add -d, -f options to hdfs copyFromLocal, put, cp
2019-10-05 00:04:08 +00:00
parquet-rle-encoded-bool.test
IMPALA-6324: Support reading RLE-encoded boolean values in Parquet scanner
2018-03-22 02:47:33 +00:00
parquet-stats-agg.test
IMPALA-5679: Fix Parquet count(*) with group by string
2017-07-22 05:53:06 +00:00
parquet-stats.test
IMPALA-7370: DATE: Read/Write to parquet.
2019-05-07 00:36:56 +00:00
parquet-type-widening.test
IMPALA-6373: Allow primitive type widening on parquet tables
2018-08-23 15:55:53 +00:00
parquet-zero-rows.test
IMPALA-3943: Address post-merge comments.
2016-10-14 05:41:22 +00:00
parquet.test
IMPALA-8885: Improve Parquet version metadata error
2019-08-24 00:32:28 +00:00
partition-col-types.test
IMPALA-6050: Query profiles should indicate storage layer(s) used
2019-04-12 07:28:26 +00:00
partition-ddl-predicates-all-fs.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
partition-ddl-predicates-hdfs-only.test
IMPALA-8121: part 2: use local catalog in containers
2019-05-10 12:06:01 +00:00
query-resource-limits-hbase.test
IMPALA-7445: separate skippable tables from test_resource_limits
2018-08-15 04:15:46 +00:00
query-resource-limits-kudu.test
IMPALA-7445: separate skippable tables from test_resource_limits
2018-08-15 04:15:46 +00:00
query-resource-limits.test
IMPALA-8096: Add rows produced limit per query
2019-02-07 21:41:52 +00:00
random.test
IMPALA-5754: Improve randomness of rand()/random()
2017-12-13 10:04:40 +00:00
ranger_column_masking.test
IMPALA-9009: Core support for Ranger column masking
2020-01-15 05:59:11 +00:00
result-spooling.test
IMPALA-8781: Result spooling tests to cover edge cases and cancellation
2019-08-06 02:35:54 +00:00
runtime_filters_mt_dop.test
IMPALA-4400: aggregate runtime filters locally
2020-01-29 00:58:24 +00:00
runtime_filters_wait.test
IMPALA-4252: Min-max runtime filters for Kudu
2017-11-17 21:33:51 +00:00
runtime_filters.test
IMPALA-6201: Fix test_basic_filters on ASAN
2017-11-28 03:01:39 +00:00
runtime_row_filters.test
IMPALA-7608: Estimate row count from file size when no stats available
2019-06-21 03:28:43 +00:00
scanner-reservation.test
IMPALA-8742: Switch to ScanRange::bytes_to_read() instead of len()
2019-10-16 17:57:09 +00:00
scanners-many-nulls.test
IMPALA-4123: Columnar decoding in Parquet
2018-11-17 01:48:05 +00:00
scanners.test
IMPALA-5861: fix RowsRead for zero-slot table scan
2019-02-12 20:37:45 +00:00
select-lazy-timestamp.test
IMPALA-5315: Cast to timestamp fails for YYYY-M-D format
2018-03-13 22:10:18 +00:00
semi-joins-exhaustive.test
IMPALA-7446: enable buffer pool GC when near process mem limit
2019-01-09 05:26:50 +00:00
semi-joins.test
IMPALA-3491: Use unique database fixture in test_join_queries.py.
2016-08-31 03:12:30 +00:00
set.test
IMPALA-8808: Add query option default_transactional_type
2019-07-31 12:57:09 +00:00
show_grant_user.test
IMPALA-7671: Fix broken SHOW GRANT USER ON <object>
2018-10-06 07:25:49 +00:00
show-create-table-zorder.test
IMPALA-8755: Frontend support for Z-ordering
2019-09-26 18:35:06 +00:00
show-create-table.test
IMPALA-9311: Store SQLPrimaryKeys in canonical order.
2020-01-27 21:48:23 +00:00
show-data-sources.test
IMPALA-3786: Replace "cloudera" with "apache" (part 2)
2016-09-29 21:14:13 +00:00
show-stats.test
IMPALA-8771: Missing stats warning for complex type columns
2019-08-06 16:38:07 +00:00
show.test
IMPALA-3711: Remove unnecessary privilege checks in getDbsMetadata()
2016-07-07 10:41:29 -07:00
single-node-joins-with-limits-exhaustive.test
IMPALA-4674: Part 2: port backend exec to BufferPool
2017-08-05 01:03:02 +00:00
single-node-large-sorts.test
IMPALA-4674: Part 2: port backend exec to BufferPool
2017-08-05 01:03:02 +00:00
single-node-nlj-exhaustive.test
IMPALA-6679,IMPALA-6678: reduce scan reservation
2018-04-28 23:41:39 +00:00
single-node-nlj.test
IMPALA-3916: Reserve SQL:2016 reserved words
2018-02-02 01:13:08 +00:00
sort.test
IMPALA-3344: Simplify sorter and document/enforce invariants.
2016-06-02 21:33:08 -07:00
special-strings.test
IMPALA-6374: fix handling of commas in .test files
2018-10-30 22:17:49 +00:00
spilling-aggs.test
IMPALA-110: Support for multiple DISTINCT
2018-09-26 03:54:49 +00:00
spilling-large-rows.test
IMPALA-8451,IMPALA-8905: enable admission control for dockerised tests
2019-09-27 01:54:39 +00:00
spilling-naaj-no-deny-reservation.test
IMPALA-4835: switch I/O buffers to buffer pool
2018-04-28 23:41:39 +00:00
spilling-naaj.test
IMPALA-4835: switch I/O buffers to buffer pool
2018-04-28 23:41:39 +00:00
spilling-no-debug-action.test
IMPALA-7367: Pack StringValue and CollectionValue slots
2018-11-19 17:27:13 +00:00
spilling-query-options.test
IMPALA-5830: SET_DENY_RESERVATION_PROBABILITY test
2017-08-29 23:01:10 +00:00
spilling-regression-exhaustive-no-default-buffer-size.test
IMPALA-5847: Fix incorrect use of SET in .test files
2019-01-22 01:20:31 +00:00
spilling-regression-exhaustive.test
IMPALA-5847: Fix incorrect use of SET in .test files
2019-01-22 01:20:31 +00:00
spilling.test
IMPALA-7008: Rewrite query to make it not return 100M rows
2018-06-05 01:14:35 +00:00
stats-extrapolation.test
IMPALA-8498: Write column index for floating types when NaN is not present
2019-10-14 15:21:16 +00:00
strict-mode-abort.test
IMPALA-4810: add DECIMAL test case to strict_mode tests
2017-03-03 01:43:42 +00:00
strict-mode.test
IMPALA-4810: add DECIMAL test case to strict_mode tests
2017-03-03 01:43:42 +00:00
string-escaping-rcfile-bug.test
IMPALA-7586: fix predicate pushdown of escaped strings
2018-11-01 21:27:13 +00:00
string-escaping.test
IMPALA-7586: fix predicate pushdown of escaped strings
2018-11-01 21:27:13 +00:00
string-literals.test
IMPALA-7027: fix StringLiteral.localEquals()
2019-08-22 05:03:03 +00:00
subquery-in-constant-lhs.test
IMPALA-6273: fixes subquery tests for functional_hbase
2017-12-06 00:41:11 +00:00
subquery-single-node.test
IMPALA-5847: Fix incorrect use of SET in .test files
2019-01-22 01:20:31 +00:00
subquery.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
test-unmatched-schema.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
text-bzip-scan.test
IMPALA-1886/IMPALA-2154: Add support for multi-stream bz2/gzip compressed files.
2016-02-28 21:31:37 -08:00
thread-limits.test
IMPALA-8451,IMPALA-8905: enable admission control for dockerised tests
2019-09-27 01:54:39 +00:00
top-n.test
IMPALA-7777: Fix crash due to arithmetic overflows in Exchange Node
2018-11-05 21:58:45 +00:00
truncate-table.test
IMPALA-8566. Fix computation of num_nulls for incremental stats
2019-05-21 17:01:43 +00:00
uda-mem-limit.test
IMPALA-1430,IMPALA-4108: codegen all builtin aggregate functions
2016-11-09 03:27:12 +00:00
uda.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
udf-codegen-required.test
IMPALA-1430,IMPALA-4108: codegen all builtin aggregate functions
2016-11-09 03:27:12 +00:00
udf-errors.test
IMPALA-5903: Inconsistent specification of result set and result set metadata
2018-04-11 02:21:48 +00:00
udf-init-close-deterministic.test
IMPALA-4586: don't constant fold in backend
2016-12-08 04:53:53 +00:00
udf-init-close.test
IMPALA-4586: don't constant fold in backend
2016-12-08 04:53:53 +00:00
udf-mem-limit.test
IMPALA-1430,IMPALA-4108: codegen all builtin aggregate functions
2016-11-09 03:27:12 +00:00
udf-no-expr-rewrite.test
IMPALA-7829: Mark a fragment instance as done only after Close() is called
2018-11-20 23:49:11 +00:00
udf.test
IMPALA-4356,IMPALA-7331: codegen all ScalarExprs
2019-05-15 22:34:28 +00:00
union.test
IMPALA-7647: Add HS2/Impyla dimension to TestQueries
2018-10-09 00:45:10 +00:00
unsupported-compression-partitions.test
IMPALA-6941: load more text scanner compression plugins
2018-05-18 03:44:46 +00:00
unsupported-writers.test
IMPALA-7190: Remove unsupported format writer support
2018-07-03 20:34:27 +00:00
use.test
…
utc-timestamp-functions.test
IMPALA-5539: Fix Kudu timestamp with -use_local_tz_for_unix_ts
2017-07-19 22:17:13 +00:00
values.test
IMPALA-3916: Reserve SQL:2016 reserved words
2018-02-02 01:13:08 +00:00
views-compatibility-hive2-only.test
IMPALA-8524: part2: Avoid calling "hive" via command line in EE tests
2019-05-24 15:08:19 +00:00
views-compatibility-hive3-only.test
IMPALA-8524: part2: Avoid calling "hive" via command line in EE tests
2019-05-24 15:08:19 +00:00
views-compatibility.test
IMPALA-8524: part2: Avoid calling "hive" via command line in EE tests
2019-05-24 15:08:19 +00:00
views-ddl.test
IMPALA-7368: Add initial support for DATE type
2019-04-23 13:33:57 +00:00
views.test
Added order by query tests
2014-06-20 13:35:10 -07:00
wide-row.test
IMPALA-525: Adjust IO buffer size based on read length and other memory fixes
2014-01-08 10:54:01 -08:00
with-clause.test
IMPALA-2375: Disabling/moving tests that don't work with the old HJ
2015-10-07 14:47:40 -07:00