Vuk Ercegovac 21a96ed2e3 IMPALA-4985: use parquet stats of nested types for dynamic pruning ...

Currently, parquet row-groups can be pruned at run-time using
min/max stats when predicates (in, binary) are specified for
column scalar types. This patch extends pruning to nested types
for the same class of predicates. A nested value is an instance
of a nested type (struct, array, map). A nested value consists of
other nested and scalar values (as declared by its type).
Predicates that can be used for row-group pruning must be applied to
nested scalar values. In addition, the parent of the nested scalar
must also be required, that is, not empty. The latter requirement
is conservative: some filters that could be used for pruning are
not used for correctness reasons.

Testing:
- extended nested-types-parquet-stats e2e test cases.

Change-Id: I0c99e20cb080b504442cd5376ea3e046016158fe
Reviewed-on: http://gerrit.cloudera.org:8080/8480
Reviewed-by: Alex Behm <alex.behm@cloudera.com>
Tested-by: Impala Public Jenkins

2017-11-22 22:00:16 +00:00

..

queries/PlannerTest

IMPALA-4985: use parquet stats of nested types for dynamic pruning

2017-11-22 22:00:16 +00:00

functional-planner_core.csv

Update benchmark tests to run against generic workload, data loading with scale factor, +more

2014-01-08 10:44:22 -08:00

functional-planner_dimensions.csv

Update benchmark tests to run against generic workload, data loading with scale factor, +more

2014-01-08 10:44:22 -08:00

functional-planner_exhaustive.csv

Update benchmark tests to run against generic workload, data loading with scale factor, +more

2014-01-08 10:44:22 -08:00

functional-planner_pairwise.csv

Update benchmark tests to run against generic workload, data loading with scale factor, +more

2014-01-08 10:44:22 -08:00