From 593b0bfad3e04d83193f599bc274e873235cebeb Mon Sep 17 00:00:00 2001 From: Steve Carlin Date: Fri, 7 Nov 2025 15:56:29 -0800 Subject: [PATCH] IMPALA-13712: Calcite Planner - Enable constant folding Constant folding is enabled by this patch. Calcite does constant folding via the RexExecutor.reduce() method. However, we need to use Impala's constant folding algorithm to ensure that Impala expressions are folded. This is done through the derived class ImpalaRexExecutor and is called from the Simplify rules. The ImpalaRexExecutor calls an internal shuttle class which recursively walks through the RexNode which checks if portions of the expression can be constant folded. Some expressions are not folded due to various reasons: - We avoid folding 'cast(1.2 as double)' type expressions because folding this creates an inexact number, and this is problematic for partition pruning directory names on double columns which contain the exact number (1.2 in this case). - Interval expressions are skipped temporarily since the Expr class generated is not meant to be simplified. However, an Expr object that contains an IntervalExpr may be simplified. There is a special case that needed to be handled for a values query with different sized arguments across rows. In Calcite version 1.40 (not yet upgraded as of this commit), an extra cast is added around smaller strings to ensure the char(x) is the same size across all rows. However, this adds extra spaces to the string which causes results different from the original Impala planner. This must be caught before Calcite converts the abstract syntax tree into a RelNode logical tree. A special RexExecutor has been created to handle this which looks for char casts around a char literal and removes it. This is fine because the literal will be changed into a string in the "coercenodes" module. Change-Id: I98c21ef75b2f5f8e3390ff5de5fdf45d9645b326 Reviewed-on: http://gerrit.cloudera.org:8080/23723 Reviewed-by: Michael Smith Reviewed-by: Joe McDonnell Tested-by: Impala Public Jenkins --- .../calcite/functions/RexCallConverter.java | 13 + .../rel/util/ExprConjunctsConverter.java | 21 +- .../rules/ImpalaFilterSimplifyRule.java | 8 + .../rules/ImpalaProjectSimplifyRule.java | 11 +- .../calcite/rules/ImpalaRexExecutor.java | 298 +++ .../RemoveUnraggedCharCastRexExecutor.java | 104 + .../calcite/service/CalciteJniFrontend.java | 2 +- .../calcite/service/CalciteOptimizer.java | 18 +- .../service/CalciteRelNodeConverter.java | 4 + .../impala/planner/TestReduceExprShuttle.java | 412 +++ .../PlannerTest/calcite_tpcds/tpcds-q02.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q03.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q04.test | 66 +- .../PlannerTest/calcite_tpcds/tpcds-q05.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q06.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q07.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q08.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q10a.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q11.test | 48 +- .../PlannerTest/calcite_tpcds/tpcds-q12.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q13.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q14a.test | 420 +-- .../PlannerTest/calcite_tpcds/tpcds-q14b.test | 270 +- .../PlannerTest/calcite_tpcds/tpcds-q16.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q17.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q19.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q20.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q21.test | 46 +- .../PlannerTest/calcite_tpcds/tpcds-q22.test | 24 +- .../PlannerTest/calcite_tpcds/tpcds-q23a.test | 410 +-- .../PlannerTest/calcite_tpcds/tpcds-q23b.test | 410 +-- .../PlannerTest/calcite_tpcds/tpcds-q25.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q27.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q28.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q29.test | 167 +- .../PlannerTest/calcite_tpcds/tpcds-q31.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q32.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q33.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q34.test | 177 +- .../PlannerTest/calcite_tpcds/tpcds-q35a.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q36.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q37.test | 42 +- .../PlannerTest/calcite_tpcds/tpcds-q38.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q39a.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q39b.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q40.test | 34 +- .../PlannerTest/calcite_tpcds/tpcds-q41.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q42.test | 6 +- .../calcite_tpcds/tpcds-q43-verbose.test | 2 +- .../PlannerTest/calcite_tpcds/tpcds-q43.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q46.test | 164 +- .../PlannerTest/calcite_tpcds/tpcds-q47.test | 491 ++-- .../PlannerTest/calcite_tpcds/tpcds-q48.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q49.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q50.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q51.test | 42 +- .../PlannerTest/calcite_tpcds/tpcds-q52.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q53.test | 95 +- .../PlannerTest/calcite_tpcds/tpcds-q54.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q55.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q56.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q57.test | 431 +-- .../PlannerTest/calcite_tpcds/tpcds-q58.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q59.test | 48 +- .../PlannerTest/calcite_tpcds/tpcds-q60.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q61.test | 12 +- .../PlannerTest/calcite_tpcds/tpcds-q62.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q63.test | 87 +- .../PlannerTest/calcite_tpcds/tpcds-q64.test | 2098 +++++++-------- .../PlannerTest/calcite_tpcds/tpcds-q65.test | 48 +- .../PlannerTest/calcite_tpcds/tpcds-q66.test | 42 +- .../PlannerTest/calcite_tpcds/tpcds-q67.test | 24 +- .../PlannerTest/calcite_tpcds/tpcds-q68.test | 164 +- .../PlannerTest/calcite_tpcds/tpcds-q69.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q70.test | 48 +- .../PlannerTest/calcite_tpcds/tpcds-q71.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q72.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q73.test | 172 +- .../PlannerTest/calcite_tpcds/tpcds-q74.test | 2315 ++++++++--------- .../PlannerTest/calcite_tpcds/tpcds-q75.test | 72 +- .../PlannerTest/calcite_tpcds/tpcds-q76.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q77.test | 114 +- .../PlannerTest/calcite_tpcds/tpcds-q78.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q79.test | 124 +- .../PlannerTest/calcite_tpcds/tpcds-q80.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q82.test | 42 +- .../PlannerTest/calcite_tpcds/tpcds-q84.test | 12 +- .../PlannerTest/calcite_tpcds/tpcds-q86.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q87.test | 60 +- .../PlannerTest/calcite_tpcds/tpcds-q88.test | 144 +- .../PlannerTest/calcite_tpcds/tpcds-q89.test | 6 +- .../PlannerTest/calcite_tpcds/tpcds-q90.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q92.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q94.test | 36 +- .../PlannerTest/calcite_tpcds/tpcds-q95.test | 18 +- .../PlannerTest/calcite_tpcds/tpcds-q97.test | 42 +- .../PlannerTest/calcite_tpcds/tpcds-q98.test | 24 +- .../PlannerTest/calcite_tpcds/tpcds-q99.test | 18 +- .../queries/QueryTest/calcite.test | 12 + 99 files changed, 5911 insertions(+), 4959 deletions(-) create mode 100644 java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java create mode 100644 java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/RemoveUnraggedCharCastRexExecutor.java create mode 100644 java/calcite-planner/src/test/java/org/apache/impala/planner/TestReduceExprShuttle.java diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexCallConverter.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexCallConverter.java index da5513fa0..60c39018b 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexCallConverter.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexCallConverter.java @@ -23,6 +23,7 @@ import com.google.common.collect.Lists; import org.apache.calcite.rel.type.RelDataType; import org.apache.calcite.rex.RexBuilder; import org.apache.calcite.rex.RexCall; +import org.apache.calcite.rex.RexLiteral; import org.apache.calcite.rex.RexNode; import org.apache.calcite.sql.SqlKind; import org.apache.calcite.sql.fun.SqlPosixRegexOperator; @@ -36,8 +37,10 @@ import org.apache.impala.analysis.CompoundPredicate; import org.apache.impala.analysis.Expr; import org.apache.impala.analysis.FunctionCallExpr; import org.apache.impala.analysis.IsNullPredicate; +import org.apache.impala.analysis.NumericLiteral; import org.apache.impala.analysis.TimestampArithmeticExpr; import org.apache.impala.calcite.operators.ImpalaInOperator; +import org.apache.impala.calcite.rules.ImpalaRexExecutor; import org.apache.impala.calcite.type.ImpalaTypeConverter; import org.apache.impala.catalog.Function; import org.apache.impala.catalog.Type; @@ -45,6 +48,7 @@ import org.apache.impala.common.ImpalaException; import org.slf4j.Logger; import org.slf4j.LoggerFactory; +import java.math.BigDecimal; import java.util.ArrayList; import java.util.List; import java.util.Map; @@ -196,6 +200,15 @@ public class RexCallConverter { return params.get(0); } + // Hack logic: Partition pruning needs the exact number when the column + // is decimal. We need to keep the cast( as double) so the + // partition pruner can keep the right value. + if (ImpalaRexExecutor.isImplicitCastDecimalToInexact(call)) { + RexLiteral literal = (RexLiteral) call.getOperands().get(0); + BigDecimal value = (BigDecimal) RexLiteral.value(literal); + return new NumericLiteral(value, impalaRetType); + } + // Small hack: Most cast expressions have "isImplicit" set to true. If this // is the case, then it blocks "analyze" from working through the cast. We // need to analyze the expression before creating the cast around it. diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/ExprConjunctsConverter.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/ExprConjunctsConverter.java index 7df849326..1947a369a 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/ExprConjunctsConverter.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/ExprConjunctsConverter.java @@ -55,16 +55,29 @@ public class ExprConjunctsConverter { public ExprConjunctsConverter(RexNode conjunct, List inputExprs, RexBuilder rexBuilder, Analyzer analyzer) throws ImpalaException { + this(conjunct, inputExprs, rexBuilder, analyzer, true); + } + + public ExprConjunctsConverter(RexNode conjunct, List inputExprs, + RexBuilder rexBuilder, Analyzer analyzer, boolean splitAndConjuncts) + throws ImpalaException { ImmutableList.Builder builder = new ImmutableList.Builder(); if (conjunct != null) { CreateExprVisitor visitor = new CreateExprVisitor(rexBuilder, inputExprs, analyzer); RexNode expandedConjunct = ImpalaRexUtil.expandSearch(rexBuilder, conjunct); - - List andOperands = getAndConjuncts(expandedConjunct); - for (RexNode andOperand : andOperands) { - Expr convertedExpr = CreateExprVisitor.getExpr(visitor, andOperand); + // if splitAndConjuncts is false, there will be only one operand containing + // all the 'and' conjuncts. If it is true, each top level 'and' will be + // a member in the list. Separating out the 'and' clauses is needed for partition + // pruning, because if the 'and' conjunct meets pruning conditions, the + // clause is used to remove directories and not needed when checking + // on each individual row. + List operands = splitAndConjuncts + ? getAndConjuncts(expandedConjunct) + : Lists.newArrayList(expandedConjunct); + for (RexNode operand : operands) { + Expr convertedExpr = CreateExprVisitor.getExpr(visitor, operand); builder.add(convertedExpr); } } diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaFilterSimplifyRule.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaFilterSimplifyRule.java index 2063af509..5ad9dbd22 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaFilterSimplifyRule.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaFilterSimplifyRule.java @@ -21,9 +21,11 @@ import org.apache.calcite.plan.RelOptRule; import org.apache.calcite.plan.RelOptRuleCall; import org.apache.calcite.rel.core.Filter; import org.apache.calcite.rex.RexBuilder; +import org.apache.calcite.rex.RexExecutor; import org.apache.calcite.rex.RexNode; import org.apache.impala.calcite.operators.ImpalaRexSimplify; import org.apache.impala.calcite.operators.ImpalaRexUtil; +import com.google.common.base.Preconditions; import com.google.common.collect.ImmutableList; import java.util.ArrayList; @@ -32,6 +34,7 @@ import java.util.List; /** * ImpalaFilterSimplifyRule calls the given ImpalaRexSimplify.simplify() * method (derived from Calcite's RexSimplify) for the filter condition. + * It also calls ImpalaRexExecutor.reduce() which does constant folding. */ public class ImpalaFilterSimplifyRule extends RelOptRule { @@ -48,8 +51,13 @@ public class ImpalaFilterSimplifyRule extends RelOptRule { RelOptCluster cluster = filter.getCluster(); RexBuilder rexBuilder = cluster.getRexBuilder(); RexNode condition = filter.getCondition(); + RexExecutor executor = simplifier_.getRexExecutor(); RexNode newCondition = simplifier_.simplify(condition); + List reducedExprs = new ArrayList<>(); + executor.reduce(rexBuilder, ImmutableList.of(newCondition), reducedExprs); + Preconditions.checkState(reducedExprs.size() == 1); + newCondition = reducedExprs.get(0); if (newCondition.equals(condition)) { return; diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaProjectSimplifyRule.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaProjectSimplifyRule.java index b6d8d2adb..71eb8006a 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaProjectSimplifyRule.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaProjectSimplifyRule.java @@ -21,6 +21,7 @@ import org.apache.calcite.plan.RelOptRule; import org.apache.calcite.plan.RelOptRuleCall; import org.apache.calcite.rel.core.Project; import org.apache.calcite.rex.RexBuilder; +import org.apache.calcite.rex.RexExecutor; import org.apache.calcite.rex.RexNode; import org.apache.calcite.rex.RexUtil; import org.apache.impala.calcite.operators.ImpalaRexSimplify; @@ -33,6 +34,7 @@ import java.util.List; * ImpalaProjectSimplifyRule calls the given ImpalaRexSimplify.simplify() * method (derived from Calcite's RexSimplify) for all the columns in the * Project RelNode. + * It also calls ImpalaRexExecutor.reduce() which does constant folding. */ public class ImpalaProjectSimplifyRule extends RelOptRule { @@ -48,6 +50,7 @@ public class ImpalaProjectSimplifyRule extends RelOptRule { Project projectRel = call.rel(0); RelOptCluster cluster = projectRel.getCluster(); RexBuilder rexBuilder = cluster.getRexBuilder(); + RexExecutor executor = simplifier_.getRexExecutor(); List newProjects = new ArrayList<>(); boolean projectChanged = false; @@ -66,13 +69,17 @@ public class ImpalaProjectSimplifyRule extends RelOptRule { newProjects.add(newProject); } - if (!projectChanged) { + List reducedExprs = new ArrayList<>(); + executor.reduce(rexBuilder, newProjects, reducedExprs); + + if (!projectChanged && + RexUtil.strings(projectRel.getProjects()).equals(RexUtil.strings(reducedExprs))) { return; } // only create the new project if any projects changed. Project newProjectRel = projectRel.copy(projectRel.getTraitSet(), - projectRel.getInput(0), newProjects, projectRel.getRowType()); + projectRel.getInput(0), reducedExprs, projectRel.getRowType()); call.transformTo(newProjectRel); } } diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java new file mode 100644 index 000000000..0482e1432 --- /dev/null +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java @@ -0,0 +1,298 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License. + +package org.apache.impala.calcite.rules; + +import com.google.common.base.Preconditions; +import org.apache.calcite.rel.RelNode; +import org.apache.calcite.rel.RelShuttleImpl; +import org.apache.calcite.rel.logical.LogicalFilter; +import org.apache.calcite.rel.logical.LogicalProject; +import org.apache.calcite.rel.type.RelDataType; +import org.apache.calcite.rex.RexBuilder; +import org.apache.calcite.rex.RexCall; +import org.apache.calcite.rex.RexExecutor; +import org.apache.calcite.rex.RexLiteral; +import org.apache.calcite.rex.RexNode; +import org.apache.calcite.rex.RexShuttle; +import org.apache.calcite.rex.RexUtil; +import org.apache.calcite.sql.SqlKind; +import org.apache.calcite.sql.type.SqlTypeName; +import org.apache.calcite.sql.type.SqlTypeUtil; +import org.apache.calcite.util.TimestampString; +import org.apache.impala.analysis.Analyzer; +import org.apache.impala.analysis.Expr; +import org.apache.impala.analysis.FunctionCallExpr; +import org.apache.impala.analysis.LiteralExpr; +import org.apache.impala.calcite.rel.util.ExprConjunctsConverter; +import org.apache.impala.common.AnalysisException; +import org.apache.impala.common.ImpalaException; +import org.apache.impala.service.FeSupport; +import org.apache.impala.thrift.TColumnValue; +import org.apache.impala.thrift.TQueryCtx; + +import java.io.UnsupportedEncodingException; +import java.math.BigDecimal; +import java.util.ArrayList; +import java.util.List; +import org.apache.commons.lang3.exception.ExceptionUtils; + +import org.slf4j.Logger; +import org.slf4j.LoggerFactory; + +/** + * ImpalaRexExecutor does the constant folding of Impala RexNode objects. + */ +public class ImpalaRexExecutor implements RexExecutor { + protected static final Logger LOG = + LoggerFactory.getLogger(ImpalaRexExecutor.class.getName()); + + private final Analyzer analyzer_; + private final TQueryCtx queryCtx_; + + // Reducer class used for testing purposes for injection. + private final Reducer reducer_; + + public ImpalaRexExecutor(Analyzer analyzer, TQueryCtx queryCtx, + Reducer reducer) { + analyzer_ = analyzer; + queryCtx_ = queryCtx; + reducer_ = reducer; + } + + /** + * The main routine that gets called when doing the constant folding. The + * constExps contains the RexNodes that will be constant folded and the + * reducedValues contain the RexNodes after constant folding. The size of these + * two arrays must match at the end of this method. + */ + @Override + public void reduce(RexBuilder rexBuilder, List constExps, + List reducedValues) { + ReduceRexNodeShuttle shuttle = + new ReduceRexNodeShuttle(analyzer_, queryCtx_, rexBuilder, reducer_); + for (RexNode rexNode : constExps) { + RexNode newProject = rexNode.accept(shuttle); + if (rexNode.getType() != newProject.getType()) { + newProject = rexBuilder.makeCast(rexNode.getType(), newProject, + rexNode.getType().isNullable()); + } + reducedValues.add(newProject); + } + Preconditions.checkState(reducedValues.size() == constExps.size()); + } + + private static boolean isReducible(RexNode rexNode) { + // may already be reduced to a literal + if (!(rexNode instanceof RexCall)) { + return false; + } + + RexCall call = (RexCall) rexNode; + + // cannot reduce interval operation by itself. An example of This will look like + // *(14 INT : 86400000 INTERVAL) with a return type of INTERVAL. This rexCall + // can be a parameter of some date time expression (e.g. time_add(time, interval)) + // which can be folded if the time portion is constant. + if (SqlTypeUtil.isInterval(call.getType())) { + return false; + } + + // operands should all be literals or an implicit cast of a literal + for (RexNode operand : call.getOperands()) { + if (!isLiteralOrCastOfLiteral(operand) && !isIntervalConst(operand)) { + return false; + } + } + + // special cast to ignore: An implicit cast from a decimal to a double + // needs to be kept as/is. If there is a partition on the double column, + // the exact value is needed. Converting to a double causes an inexact + // value to be created and interferes with the partitioned directory name. + if (isImplicitCastDecimalToInexact(call)) { + return false; + } + + return true; + } + + public static boolean isImplicitCastDecimalToInexact(RexCall call) { + if (call.getKind() != SqlKind.CAST) { + return false; + } + SqlTypeName sqlTypeName = call.getType().getSqlTypeName(); + if (sqlTypeName != SqlTypeName.DOUBLE && sqlTypeName != SqlTypeName.FLOAT) { + return false; + } + RexNode operand = call.getOperands().get(0); + if (!(operand instanceof RexLiteral)) { + return false; + } + if (operand.getType().getSqlTypeName() != SqlTypeName.DECIMAL) { + return false; + } + return true; + } + + private static boolean isLiteralOrCastOfLiteral(RexNode operand) { + while ((operand instanceof RexCall) && + ((RexCall) operand).getKind() == SqlKind.CAST) { + operand = ((RexCall) operand).getOperands().get(0); + } + return (operand instanceof RexLiteral); + } + + private static boolean isIntervalConst(RexNode operand) { + if (!(operand instanceof RexCall)) { + return false; + } + RexCall call = (RexCall) operand; + if (!call.getKind().equals(SqlKind.TIMES)) { + return false; + } + if (!SqlTypeUtil.isInterval(call.getType())) { + return false; + } + if (!(call.getOperands().get(0) instanceof RexLiteral) && + !(call.getOperands().get(1) instanceof RexLiteral)) { + return false; + } + return true; + } + + private static RexNode getRexNodeFromColumnValue(RexBuilder builder, RexNode constExp, + TColumnValue colVal) { + RelDataType returnType = constExp.getType(); + if (colVal.isSetBool_val()) { + return builder.makeLiteral(colVal.bool_val, returnType); + } else if (colVal.isSetByte_val()) { + return builder.makeLiteral(colVal.byte_val, returnType); + } else if (colVal.isSetShort_val()) { + return builder.makeLiteral(colVal.short_val, returnType); + } else if (colVal.isSetInt_val()) { + return builder.makeLiteral(colVal.int_val, returnType); + } else if (colVal.isSetLong_val()) { + return builder.makeLiteral(colVal.long_val, returnType); + } else if (colVal.isSetDouble_val()) { + return builder.makeLiteral(colVal.double_val, returnType); + } else if (colVal.isSetString_val()) { + if (returnType.getSqlTypeName() == SqlTypeName.TIMESTAMP) { + RexNode timestamp = builder.makeTimestampLiteral( + new TimestampString(colVal.string_val), + constExp.getType().getPrecision()); + RelDataType type = builder.getTypeFactory().createTypeWithNullability( + timestamp.getType(), constExp.getType().isNullable()); + return builder.makeCast(type, timestamp, true); + } + // decimal is in string val, strings are in binaryVal + return builder.makeLiteral(new BigDecimal(colVal.string_val), returnType, true); + } else if (colVal.isSetBinary_val()) { + byte[] bytes = new byte[colVal.binary_val.remaining()]; + colVal.binary_val.get(bytes); + + // Converting strings between the BE/FE does not work properly for the + // extended ASCII characters above 127. Bail in such cases to avoid + // producing incorrect results. + for (byte b: bytes) { + if (b < 0) { + return constExp; + } + } + try { + String newString = new String(bytes, "US-ASCII"); + return builder.makeLiteral(newString, returnType, true); + } catch (UnsupportedEncodingException e) { + LOG.debug("Could not interpret return value for " + colVal); + return constExp; + } + } + Preconditions.checkState(!colVal.isSetTimestamp_val(), + "Simplified into timestamp constant but this should not happen"); + Preconditions.checkState(!colVal.isSetDecimal_val(), + "Simplified into decimal constant but this should not happen"); + return builder.makeNullLiteral(returnType); + } + + /** + * The RexNode shuttle that walks through the expression. + */ + private static class ReduceRexNodeShuttle extends RexShuttle { + private final Analyzer analyzer_; + private final TQueryCtx queryCtx_; + private final RexBuilder rexBuilder_; + private final Reducer reducer_; + + private ReduceRexNodeShuttle(Analyzer analyzer, TQueryCtx queryCtx, + RexBuilder rexBuilder, Reducer reducer) { + this.analyzer_ = analyzer; + this.queryCtx_ = queryCtx; + this.rexBuilder_ = rexBuilder; + this.reducer_ = reducer; + } + + @Override + public RexNode visitCall(RexCall call) { + // recursively call children first. + RexNode reducedNode = super.visitCall(call); + if (!isReducible(reducedNode)) { + return reducedNode; + } + RexCall reducedCall = (RexCall) reducedNode; + + try { + // convert RexNode into Expr objects + ExprConjunctsConverter converter = new ExprConjunctsConverter( + reducedCall, null, rexBuilder_, analyzer_, false); + Preconditions.checkState(converter.getImpalaConjuncts().size() == 1); + Expr expr = converter.getImpalaConjuncts().get(0); + if (expr instanceof FunctionCallExpr) { + FunctionCallExpr funcCallExpr = (FunctionCallExpr) expr; + if (!funcCallExpr.isConstantImpl()) { + return reducedCall; + } + } + TColumnValue colValue = reducer_.reduce(expr, queryCtx_); + return getRexNodeFromColumnValue(rexBuilder_, reducedCall, colValue); + } catch (Exception e) { + LOG.debug("Exception thrown in constant folding, constant folding " + + "not done: " + e); + LOG.debug(ExceptionUtils.getStackTrace(e)); + return reducedCall; + } + } + } + + /** + * Interface which allows a hook for JUnit tests, avoiding the necessity of + * a call to the backend. + */ + public static interface Reducer { + public TColumnValue reduce(Expr expr, TQueryCtx queryCtx) throws ImpalaException; + } + + /** + * Implementation of the Reducer class which calls the backend via FeSupport. + */ + public static class ReducerImpl implements Reducer { + @Override + public TColumnValue reduce(Expr expr, TQueryCtx queryCtx) throws ImpalaException { + return FeSupport.EvalExprWithoutRowBounded(expr, queryCtx, + LiteralExpr.MAX_STRING_LITERAL_SIZE); + } + } + +} diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/RemoveUnraggedCharCastRexExecutor.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/RemoveUnraggedCharCastRexExecutor.java new file mode 100644 index 000000000..05f1d428e --- /dev/null +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/RemoveUnraggedCharCastRexExecutor.java @@ -0,0 +1,104 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License. + +package org.apache.impala.calcite.rules; + +import org.apache.calcite.DataContexts; +import org.apache.calcite.rex.RexBuilder; +import org.apache.calcite.rex.RexCall; +import org.apache.calcite.rex.RexExecutorImpl; +import org.apache.calcite.rex.RexLiteral; +import org.apache.calcite.rex.RexNode; +import org.apache.calcite.sql.SqlKind; +import org.apache.calcite.sql.type.SqlTypeName; + +import java.util.List; + +import org.slf4j.Logger; +import org.slf4j.LoggerFactory; + +/** + * RemoveUnraggedCharCastRexExecutor is a workaround needed until a + * solution is found for CALCITE-7244. Calcite always creates a string + * RexLiteral as type CHAR, whereas Impala needs the string literal as + * STRING (a "create table my_string_tbl as select 'hello'" will create a + * STRING type column). The conversion from CHAR to STRING is handled in + * the CoercedNodes part of the code which is run after the SqlNode abstract + * syntax tree has been converted into the Logical Node tree. + * + * However, there is a special case that causes problems that occurs before + * the RelNode tree creation, at SqlToRelNodeConverter time. In the case of + * the following query: "values(('big'), ('bigger'))", the SqlToRelNodeConverter + * needs to ensure that both rows are the same size. So a char cast of the bigger + * size is added around the first string. + * + * After Calcite creates this cast, the string changes when it is reduced. The + * 'big' string becomes a space padded 'big ' string. This Calcite reduction + * causes results inconsistent from what the original Impala planner produces. + * + * In order to avoid this, this executor removes the outer cast if the operand + * of a CHAR cast expression is a CHAR cast. + * + * Note that the only possible place this expression can happen is through this + * mechanism. The CAST operator is only used for implicit chars, that is, casts + * that are created internally. If the SQL actually contained a cast, the + * EXPLICIT_CAST operator would be used and the logic here would not affect + * that expression. + */ +public class RemoveUnraggedCharCastRexExecutor extends RexExecutorImpl { + protected static final Logger LOG = + LoggerFactory.getLogger(RemoveUnraggedCharCastRexExecutor.class.getName()); + + public RemoveUnraggedCharCastRexExecutor() { + super(DataContexts.EMPTY); + } + + @Override + public void reduce(RexBuilder rexBuilder, List constExps, + List reducedValues) { + + if (!rexNodeIsCharCastOfChar(constExps)) { + super.reduce(rexBuilder, constExps, reducedValues); + return; + } + reducedValues.add(((RexCall)constExps.get(0)).getOperands().get(0)); + } + + private boolean rexNodeIsCharCastOfChar(List rexNodes) { + if (rexNodes.size() > 1 || rexNodes.size() == 0) { + return false; + } + if (!(rexNodes.get(0) instanceof RexCall)) { + return false; + } + RexCall constExp = (RexCall) rexNodes.get(0); + if (!constExp.getKind().equals(SqlKind.CAST)) { + return false; + } + if (!constExp.getType().getSqlTypeName().equals(SqlTypeName.CHAR)) { + return false; + } + RexNode operand = constExp.getOperands().get(0); + if (!(operand instanceof RexLiteral)) { + return false; + } + if (!operand.getType().getSqlTypeName().equals(SqlTypeName.CHAR)) { + return false; + } + return true; + } +} diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java index bcba489c0..65bfe0b95 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java @@ -145,7 +145,7 @@ public class CalciteJniFrontend extends JniFrontend { // Optimize the query CalciteOptimizer optimizer = new CalciteOptimizer(validator, - queryCtx.getTimeline()); + mdHandler.getAnalyzer(), queryCtx.getTimeline(), queryCtx.getTQueryCtx()); ImpalaPlanRel optimizedPlan = optimizer.optimize(logicalPlan); markEvent(mdHandler, optimizedPlan, queryCtx, "Optimized logical plan"); diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java index f09376ebe..fd6305254 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java @@ -40,6 +40,7 @@ import org.apache.calcite.sql.SqlExplainLevel; import org.apache.calcite.sql.validate.SqlValidator; import org.apache.calcite.sql2rel.RelFieldTrimmer; import org.apache.calcite.tools.RelBuilder; +import org.apache.impala.analysis.Analyzer; import org.apache.impala.calcite.coercenodes.CoerceNodes; import org.apache.impala.calcite.operators.ImpalaRexSimplify; import org.apache.impala.calcite.rel.node.ConvertToImpalaRelRules; @@ -47,8 +48,10 @@ import org.apache.impala.calcite.rel.node.ImpalaPlanRel; import org.apache.impala.calcite.rules.ImpalaCoreRules; import org.apache.impala.calcite.rules.ImpalaFilterSimplifyRule; import org.apache.impala.calcite.rules.ImpalaProjectSimplifyRule; +import org.apache.impala.calcite.rules.ImpalaRexExecutor; import org.apache.impala.calcite.util.LogUtil; import org.apache.impala.common.ImpalaException; +import org.apache.impala.thrift.TQueryCtx; import org.apache.impala.util.EventSequence; import java.util.List; @@ -71,6 +74,10 @@ public class CalciteOptimizer implements CompilerStep { private final EventSequence timeline_; + private final Analyzer analyzer_; + + private final TQueryCtx queryCtx_; + JoinProjectTransposeRule.Config JOIN_PROJECT_LEFT = JoinProjectTransposeRule.Config.LEFT_OUTER .withOperandSupplier(b0 -> @@ -95,12 +102,17 @@ public class CalciteOptimizer implements CompilerStep { this.reader_ = analysisResult.getCatalogReader(); this.validator_ = analysisResult.getSqlValidator(); this.timeline_ = timeline; + this.analyzer_ = analysisResult.getAnalyzer(); + this.queryCtx_ = analyzer_.getQueryCtx(); } - public CalciteOptimizer(CalciteValidator validator, EventSequence timeline) { + public CalciteOptimizer(CalciteValidator validator, Analyzer analyzer, + EventSequence timeline, TQueryCtx queryCtx) { this.reader_ = validator.getCatalogReader(); this.validator_ = validator.getSqlValidator(); this.timeline_ = timeline; + this.queryCtx_ = queryCtx; + this.analyzer_ = analyzer; } public ImpalaPlanRel optimize(RelNode logPlan) throws ImpalaException { @@ -109,7 +121,9 @@ public class CalciteOptimizer implements CompilerStep { RexBuilder rexBuilder = logPlan.getCluster().getRexBuilder(); - ImpalaRexSimplify simplifier = new ImpalaRexSimplify(rexBuilder, RexUtil.EXECUTOR); + ImpalaRexExecutor rexExecutor = new ImpalaRexExecutor(analyzer_, queryCtx_, + new ImpalaRexExecutor.ReducerImpl()); + ImpalaRexSimplify simplifier = new ImpalaRexSimplify(rexBuilder, rexExecutor); // Run some essential rules needed to create working RelNodes before doing // optimization diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java index d932b821b..e82e3531f 100644 --- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java +++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java @@ -53,6 +53,8 @@ import org.apache.calcite.tools.Frameworks; import org.apache.calcite.tools.RelBuilder; import org.apache.impala.calcite.operators.ImpalaConvertletTable; import org.apache.impala.calcite.rules.ImpalaCoreRules; +import org.apache.impala.calcite.rules.ImpalaRexExecutor; +import org.apache.impala.calcite.rules.RemoveUnraggedCharCastRexExecutor; import org.apache.impala.calcite.schema.ImpalaRelMetadataProvider; import org.apache.impala.calcite.util.LogUtil; @@ -87,6 +89,7 @@ public class CalciteRelNodeConverter implements CompilerStep { this.sqlValidator_ = analysisResult.getSqlValidator(); this.planner_ = new VolcanoPlanner(); planner_.addRelTraitDef(ConventionTraitDef.INSTANCE); + planner_.setExecutor(new RemoveUnraggedCharCastRexExecutor()); cluster_ = RelOptCluster.create(planner_, new RexBuilder(typeFactory_)); viewExpander_ = createViewExpander( @@ -100,6 +103,7 @@ public class CalciteRelNodeConverter implements CompilerStep { this.sqlValidator_ = validator.getSqlValidator(); this.planner_ = new VolcanoPlanner(); planner_.addRelTraitDef(ConventionTraitDef.INSTANCE); + planner_.setExecutor(new RemoveUnraggedCharCastRexExecutor()); cluster_ = RelOptCluster.create(planner_, new RexBuilder(typeFactory_)); viewExpander_ = createViewExpander(validator.getCatalogReader() diff --git a/java/calcite-planner/src/test/java/org/apache/impala/planner/TestReduceExprShuttle.java b/java/calcite-planner/src/test/java/org/apache/impala/planner/TestReduceExprShuttle.java new file mode 100644 index 000000000..5b09a19c5 --- /dev/null +++ b/java/calcite-planner/src/test/java/org/apache/impala/planner/TestReduceExprShuttle.java @@ -0,0 +1,412 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License. + +package org.apache.impala.planner; + + +import org.apache.impala.common.ImpalaException; +import org.apache.impala.common.RuntimeEnv; +import org.apache.impala.thrift.TQueryOptions; +import org.apache.impala.thrift.TSessionState; +import org.junit.AfterClass; +import org.junit.BeforeClass; +import org.junit.Test; +import org.junit.rules.TemporaryFolder; + +import java.util.ArrayList; +import java.util.HashMap; +import java.util.List; +import java.util.Map; +import java.util.Set; + +import org.apache.calcite.jdbc.JavaTypeFactoryImpl; +import org.apache.calcite.rel.core.Project; +import org.apache.calcite.rel.RelNode; +import org.apache.calcite.rel.metadata.DefaultRelMetadataProvider; +import org.apache.calcite.rel.metadata.JaninoRelMetadataProvider; +import org.apache.calcite.rel.metadata.RelMetadataQuery; +import org.apache.calcite.rel.type.RelDataTypeFactory; +import org.apache.calcite.rex.RexBuilder; +import org.apache.calcite.rex.RexExecutor; +import org.apache.calcite.rex.RexNode; +import org.apache.calcite.sql.SqlNode; +import org.apache.impala.analysis.Analyzer; +import org.apache.impala.analysis.Expr; +import org.apache.impala.calcite.operators.ImpalaOperatorTable; +import org.apache.impala.calcite.rules.ImpalaRexExecutor; +import org.apache.impala.calcite.service.CalciteJniFrontend.QueryContext; +import org.apache.impala.calcite.service.CalciteMetadataHandler; +import org.apache.impala.calcite.service.CalciteQueryParser; +import org.apache.impala.calcite.service.CalciteRelNodeConverter; +import org.apache.impala.calcite.service.CalciteValidator; +import org.apache.impala.calcite.type.ImpalaTypeSystemImpl; +import org.apache.impala.catalog.BuiltinsDb; +import org.apache.impala.thrift.TColumnValue; +import org.apache.impala.thrift.TQueryCtx; +import com.google.common.base.Preconditions; +import com.google.common.collect.ImmutableMap; + +import static org.junit.Assert.*; + +public class TestReduceExprShuttle extends PlannerTestBase { + // Query option to run each planner test. + private static TQueryOptions options = + tpcdsParquetQueryOptions(); + + @BeforeClass + public static void setUpClass() throws Exception { + RuntimeEnv.INSTANCE.setTestEnv(true); + ImpalaOperatorTable.create(BuiltinsDb.getInstance()); + RelMetadataQuery.THREAD_PROVIDERS.set( + JaninoRelMetadataProvider.of(DefaultRelMetadataProvider.INSTANCE)); + } + + @AfterClass + public static void cleanUpClass() { + RuntimeEnv.INSTANCE.reset(); + } + + @Test + public void testFoldAddTinyInt() { + try { + ReduceShuttleObjects queryObj = new ReduceShuttleObjects("SELECT 1 + 1"); + TColumnValue reducedValue = new TColumnValue(); + reducedValue.setShort_val((short)2); + + TestReducerTmp testReducer = new TestReducerTmp("add(1, 1)", reducedValue); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("2:SMALLINT", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldAddSmallInt() { + try { + String expr = "CAST(1 AS SMALLINT) + CAST(2 AS SMALLINT)"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedCast1 = new TColumnValue(); + reducedCast1.setShort_val((short)1); + TColumnValue reducedCast2 = new TColumnValue(); + reducedCast2.setShort_val((short)2); + TColumnValue reducedAdd = new TColumnValue(); + reducedAdd.setInt_val((int)3); + + Map map = ImmutableMap.of + ("1", reducedCast1, + "2", reducedCast2, + "add(1, 2)", reducedAdd); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("CAST(3):INTEGER", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldAddInt() { + try { + String expr = "CAST(1 AS INT) + CAST(2 AS INT)"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedCast1 = new TColumnValue(); + reducedCast1.setInt_val(1); + TColumnValue reducedCast2 = new TColumnValue(); + reducedCast2.setInt_val(2); + TColumnValue reducedAdd = new TColumnValue(); + reducedAdd.setLong_val(3); + + Map map = ImmutableMap.of + ("1", reducedCast1, + "2", reducedCast2, + "add(1, 2)", reducedAdd); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("CAST(3:BIGINT):BIGINT", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldAddDecimal() { + try { + String expr = "1.1 + 2.2"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedCast1 = new TColumnValue(); + reducedCast1.setString_val("3.3"); + + Map map = ImmutableMap.of + ("add(1.1, 2.2)", reducedCast1); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("3.3:DECIMAL(3, 1)", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldConcatString() { + try { + String expr = "CONCAT(cast('a' as string), cast('b' as string))"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedCast1 = new TColumnValue(); + reducedCast1.setBinary_val("a".getBytes()); + TColumnValue reducedCast2 = new TColumnValue(); + reducedCast2.setBinary_val("b".getBytes()); + TColumnValue reducedAdd = new TColumnValue(); + reducedAdd.setBinary_val("ab".getBytes()); + + Map map = ImmutableMap.of + ("'a'", reducedCast1, + "'b'", reducedCast2, + "concat('a', 'b')", reducedAdd); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("CAST(_UTF-8'ab':VARCHAR(2147483647) CHARACTER SET \"UTF-8\"):" + + "VARCHAR(2147483647) CHARACTER SET \"UTF-8\"", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testBoolean() { + try { + String expr = "istrue(false)"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedValue = new TColumnValue(); + reducedValue.setBool_val(false); + + TestReducerTmp testReducer = new TestReducerTmp("istrue(FALSE)", reducedValue); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("CAST(false):BOOLEAN", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testPartialExpr() { + try { + ReduceShuttleObjects queryObj = new ReduceShuttleObjects( + "SELECT 1 + 1 + tinyint_col from functional.alltypestiny"); + TColumnValue reducedValue = new TColumnValue(); + reducedValue.setShort_val((short)2); + + TestReducerTmp testReducer = new TestReducerTmp("add(1, 1)", reducedValue); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("+(2:SMALLINT, $2)", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testNonDeterministic() { + try { + String expr = "rand()"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TestReducerTmp testReducer = new TestReducerTmp(); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size(), 1); + assertEquals("RAND()", reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldMultipleFields() { + try { + String expr = "1 + 2, 3 + 4"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedAdd1 = new TColumnValue(); + reducedAdd1.setShort_val((short)3); + TColumnValue reducedAdd2 = new TColumnValue(); + reducedAdd2.setShort_val((short)7); + + Map map = ImmutableMap.of + ("add(1, 2)", reducedAdd1, + "add(3, 4)", reducedAdd2); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(2, reducedExprs.size()); + assertEquals("3:SMALLINT", reducedExprs.get(0).toString()); + assertEquals("7:SMALLINT", reducedExprs.get(1).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + } + + @Test + public void testFoldTimestamp() { + try { + String expr = "add_months(cast('2012-07-01 00:00:00' as timestamp), " + + "cast(2 as integer))"; + ReduceShuttleObjects queryObj = + new ReduceShuttleObjects("SELECT " + expr); + TColumnValue reducedTime1 = new TColumnValue(); + reducedTime1.setString_val("2012-07-01 00:00:00"); + TColumnValue reducedTime2 = new TColumnValue(); + reducedTime2.setString_val("2012-09-01 00:00:00"); + TColumnValue reducedInt = new TColumnValue(); + reducedInt.setInt_val(2); + + Map map = ImmutableMap.of + ("'2012-07-01 00:00:00'", reducedTime1, + "add_months(casttotimestamp('2012-07-01 00:00:00'), 2)", reducedTime2, + "2", reducedInt); + + TestReducerTmp testReducer = new TestReducerTmp(map); + List reducedExprs = new ArrayList<>(); + RexExecutor executor = new ImpalaRexExecutor( + queryObj.analyzer_, queryObj.queryCtx_, testReducer); + executor.reduce(queryObj.rexBuilder_, queryObj.project_.getProjects(), + reducedExprs); + + assertEquals(1, reducedExprs.size()); + assertEquals("CAST(2012-09-01 00:00:00:TIMESTAMP(15)):TIMESTAMP(15)", + reducedExprs.get(0).toString()); + } catch (ImpalaException e) { + throw new RuntimeException(e); + } + + } + + private static class ReduceShuttleObjects { + public final Analyzer analyzer_; + public final TQueryCtx queryCtx_; + public final RexBuilder rexBuilder_; + public final Project project_; + + public ReduceShuttleObjects(String query) throws ImpalaException { + QueryContext queryCtx = new QueryContext(options, frontend_, query); + queryCtx_ = queryCtx.getTQueryCtx(); + + TSessionState session = new TSessionState(); + session.setConnected_user("dummy"); + queryCtx.getTQueryCtx().setSession(session); + CalciteQueryParser queryParser = new CalciteQueryParser(queryCtx); + SqlNode parsedSqlNode = queryParser.parse(); + + CalciteMetadataHandler mdHandler = + new CalciteMetadataHandler(parsedSqlNode, queryCtx); + analyzer_ = mdHandler.getAnalyzer(); + + CalciteValidator validator = new CalciteValidator(mdHandler, queryCtx); + SqlNode validatedNode = validator.validate(parsedSqlNode); + CalciteRelNodeConverter relNodeConverter = new CalciteRelNodeConverter(validator); + RelNode rootNode = relNodeConverter.convert(validatedNode); + Preconditions.checkState(rootNode instanceof Project); + project_ = (Project) rootNode; + + RelDataTypeFactory typeFactory = + new JavaTypeFactoryImpl(new ImpalaTypeSystemImpl()); + rexBuilder_ = new RexBuilder(typeFactory); + } + } + + private static class TestReducerTmp implements ImpalaRexExecutor.Reducer { + private Map valueMap_ = new HashMap<>(); + + public TestReducerTmp() { + } + + public TestReducerTmp(String expr, TColumnValue reducedValue) { + valueMap_.put(expr, reducedValue); + } + + public TestReducerTmp(Map valueMap) { + valueMap_.putAll(valueMap); + } + + @Override + public TColumnValue reduce(Expr expr, TQueryCtx queryCtx) throws ImpalaException { + assertTrue(valueMap_.containsKey(expr.toSql())); + return valueMap_.get(expr.toSql()); + } + } +} + diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test index ae28760d8..0533eaea2 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test @@ -173,14 +173,14 @@ PLAN-ROOT SINK | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF000[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, 53) | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=8 row-size=8B cardinality=373 cost=12520 | in pipelines: 06(GETNEXT) @@ -460,14 +460,14 @@ max-parallelism=10 segment-costs=[1760943, 26273] cpu-comparison-result=131 [max | max-parallelism=1 segment-costs=[12904] | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF000[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, 53) | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=8 row-size=8B cardinality=373 cost=12520 | in pipelines: 06(GETNEXT) @@ -781,14 +781,14 @@ max-parallelism=10 segment-costs=[1760943, 26273] cpu-comparison-result=131 [max | max-parallelism=1 segment-costs=[12904] | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF000[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, 53) | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=8 row-size=8B cardinality=373 cost=12520 | in pipelines: 06(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test index 4deb2be35..8b0052b5d 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test @@ -94,7 +94,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.59M(filtered from 8.25G) cost=1657367506 @@ -233,7 +233,7 @@ max-parallelism=330 segment-costs=[3208876607, 33276559] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.59M(filtered from 8.25G) cost=1657367506 @@ -372,7 +372,7 @@ max-parallelism=330 segment-costs=[3208876607, 33276559] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.59M(filtered from 8.25G) cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test index 73d7ebc9c..8dc841b1c 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test @@ -251,13 +251,13 @@ PLAN-ROOT SINK | | | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -271,7 +271,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 @@ -397,13 +397,13 @@ PLAN-ROOT SINK | | | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -470,13 +470,13 @@ PLAN-ROOT SINK | | | |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=373 cost=12520 | | in pipelines: 13(GETNEXT) @@ -555,7 +555,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 @@ -856,13 +856,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -876,7 +876,7 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 @@ -1152,13 +1152,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -1301,13 +1301,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=373 cost=12520 | | in pipelines: 13(GETNEXT) @@ -1453,7 +1453,7 @@ max-parallelism=373 segment-costs=[6315884965] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 @@ -1754,13 +1754,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -1774,7 +1774,7 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 @@ -2050,13 +2050,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -2199,13 +2199,13 @@ max-parallelism=260 segment-costs=[2591850306, 253] cpu-comparison-result=1440 [ | | max-parallelism=1 segment-costs=[12536] | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=373 cost=12520 | | in pipelines: 13(GETNEXT) @@ -2351,7 +2351,7 @@ max-parallelism=373 segment-costs=[6315884965] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q05.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q05.test index 54290be99..0d3e82d5d 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q05.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q05.test @@ -207,13 +207,13 @@ PLAN-ROOT SINK | | | |--23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=28 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 23(GETNEXT) @@ -315,13 +315,13 @@ PLAN-ROOT SINK | | | |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 13(GETNEXT) @@ -398,13 +398,13 @@ PLAN-ROOT SINK | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) @@ -438,7 +438,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 @@ -605,13 +605,13 @@ max-parallelism=120 segment-costs=[86121, 4572835, 4190, 509107, 1136665] cpu-co | | max-parallelism=1 segment-costs=[14888] | | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=28 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 23(GETNEXT) @@ -790,13 +790,13 @@ max-parallelism=120 segment-costs=[86121, 4572835, 4190, 509107, 1136665] cpu-co | | max-parallelism=1 segment-costs=[14888] | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 13(GETNEXT) @@ -923,13 +923,13 @@ max-parallelism=120 segment-costs=[15196746709, 523958] cpu-comparison-result=12 | max-parallelism=1 segment-costs=[14888] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) @@ -963,7 +963,7 @@ max-parallelism=120 segment-costs=[15196746709, 523958] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 @@ -1130,13 +1130,13 @@ max-parallelism=120 segment-costs=[86121, 4572835, 4190, 509107, 1136665] cpu-co | | max-parallelism=1 segment-costs=[14888] | | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=28 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 23(GETNEXT) @@ -1315,13 +1315,13 @@ max-parallelism=120 segment-costs=[86121, 4572835, 4190, 509107, 1136665] cpu-co | | max-parallelism=1 segment-costs=[14888] | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 13(GETNEXT) @@ -1448,13 +1448,13 @@ max-parallelism=120 segment-costs=[15196746709, 523958] cpu-comparison-result=12 | max-parallelism=1 segment-costs=[14888] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-08-19' AS DATE) + INTERVAL CAST(14 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-08-19' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-09-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-08-19', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) @@ -1488,7 +1488,7 @@ max-parallelism=120 segment-costs=[15196746709, 523958] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test index 31a980547..72d85357f 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test @@ -201,7 +201,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=30(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=30(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=129.58M(filtered from 7.88G) cost=31072113 @@ -570,7 +570,7 @@ max-parallelism=490 segment-costs=[4877793238] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1889184464 @@ -939,7 +939,7 @@ max-parallelism=490 segment-costs=[4877793238] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1889184464 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test index 6ef8ea27a..86161b731 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test @@ -134,7 +134,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=2 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 @@ -347,7 +347,7 @@ max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=2 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 @@ -560,7 +560,7 @@ max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=2 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q08.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q08.test index 0557514c1..34aaab618 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q08.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q08.test @@ -275,7 +275,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -613,7 +613,7 @@ max-parallelism=120 segment-costs=[1107304428, 3086] cpu-comparison-result=120 [ table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -951,7 +951,7 @@ max-parallelism=120 segment-costs=[1107304428, 3086] cpu-comparison-result=120 [ table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q10a.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q10a.test index d128923db..7367ded12 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q10a.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q10a.test @@ -155,13 +155,13 @@ PLAN-ROOT SINK | | | | | |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=4 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 02(GETNEXT) @@ -175,7 +175,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -209,13 +209,13 @@ PLAN-ROOT SINK | | | |--15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=17 row-size=12B cardinality=118 cost=20833 | | in pipelines: 15(GETNEXT) @@ -245,13 +245,13 @@ PLAN-ROOT SINK | |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=13 row-size=12B cardinality=118 cost=20833 | in pipelines: 12(GETNEXT) @@ -493,13 +493,13 @@ max-parallelism=20 segment-costs=[160849010, 566089] cpu-comparison-result=180 [ | | | max-parallelism=1 segment-costs=[20839] | | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=4 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 02(GETNEXT) @@ -513,7 +513,7 @@ max-parallelism=20 segment-costs=[160849010, 566089] cpu-comparison-result=180 [ | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -573,13 +573,13 @@ max-parallelism=60 segment-costs=[578378279] | | max-parallelism=1 segment-costs=[20839] | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=17 row-size=12B cardinality=118 cost=20833 | | in pipelines: 15(GETNEXT) @@ -626,13 +626,13 @@ max-parallelism=60 segment-costs=[578378279] | max-parallelism=1 segment-costs=[20839] | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=13 row-size=12B cardinality=118 cost=20833 | in pipelines: 12(GETNEXT) @@ -874,13 +874,13 @@ max-parallelism=20 segment-costs=[160849010, 566089] cpu-comparison-result=180 [ | | | max-parallelism=1 segment-costs=[20839] | | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=4 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 02(GETNEXT) @@ -894,7 +894,7 @@ max-parallelism=20 segment-costs=[160849010, 566089] cpu-comparison-result=180 [ | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -954,13 +954,13 @@ max-parallelism=60 segment-costs=[578378279] | | max-parallelism=1 segment-costs=[20839] | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=17 row-size=12B cardinality=118 cost=20833 | | in pipelines: 15(GETNEXT) @@ -1007,13 +1007,13 @@ max-parallelism=60 segment-costs=[578378279] | max-parallelism=1 segment-costs=[20839] | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=13 row-size=12B cardinality=118 cost=20833 | in pipelines: 12(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test index b26713542..71e75d0d4 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test @@ -215,13 +215,13 @@ PLAN-ROOT SINK | | | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -235,7 +235,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 @@ -287,13 +287,13 @@ PLAN-ROOT SINK | | | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -372,7 +372,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 @@ -673,13 +673,13 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | | max-parallelism=1 segment-costs=[12536] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -693,7 +693,7 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 @@ -821,13 +821,13 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | | max-parallelism=1 segment-costs=[12536] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -973,7 +973,7 @@ max-parallelism=373 segment-costs=[5291495835] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 @@ -1274,13 +1274,13 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | | max-parallelism=1 segment-costs=[12536] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=8B cardinality=373 cost=12520 | | in pipelines: 01(GETNEXT) @@ -1294,7 +1294,7 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 @@ -1422,13 +1422,13 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max | | max-parallelism=1 segment-costs=[12536] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 | | in pipelines: 07(GETNEXT) @@ -1574,7 +1574,7 @@ max-parallelism=373 segment-costs=[5291495835] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q12.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q12.test index 03f6b6520..513c1182d 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q12.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q12.test @@ -101,13 +101,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -262,13 +262,13 @@ max-parallelism=240 segment-costs=[2359954927, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -423,13 +423,13 @@ max-parallelism=240 segment-costs=[2359954927, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-03-28' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-03-28' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-04-27', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-03-28', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test index 62c4dc529..a22d934ce 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test @@ -182,7 +182,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -420,7 +420,7 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -658,7 +658,7 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14a.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14a.test index e48428dc5..a600677ff 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14a.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14a.test @@ -178,13 +178,13 @@ PLAN-ROOT SINK | | | | | | | |--130:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=146 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 130(GETNEXT) @@ -215,13 +215,13 @@ PLAN-ROOT SINK | | | | | | | |--127:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=141 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 127(GETNEXT) @@ -247,13 +247,13 @@ PLAN-ROOT SINK | | | | | |--124:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=137 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 124(GETNEXT) @@ -265,7 +265,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=135 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 123(GETNEXT) @@ -369,13 +369,13 @@ PLAN-ROOT SINK | | | | | | | | | |--105:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=118 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 105(GETNEXT) @@ -431,13 +431,13 @@ PLAN-ROOT SINK | | | | | | | |--99:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=111 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 99(GETNEXT) @@ -451,7 +451,7 @@ PLAN-ROOT SINK | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=109 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -493,13 +493,13 @@ PLAN-ROOT SINK | | | | | |--112:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=127 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 112(GETNEXT) @@ -550,13 +550,13 @@ PLAN-ROOT SINK | | | |--91:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=103 row-size=12B cardinality=108 cost=18780 | | in pipelines: 91(GETNEXT) @@ -609,13 +609,13 @@ PLAN-ROOT SINK | | | | | | | |--86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=95 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 86(GETNEXT) @@ -646,13 +646,13 @@ PLAN-ROOT SINK | | | | | | | |--83:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=90 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 83(GETNEXT) @@ -678,13 +678,13 @@ PLAN-ROOT SINK | | | | | |--80:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=86 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 80(GETNEXT) @@ -696,7 +696,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=84 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 79(GETNEXT) @@ -800,13 +800,13 @@ PLAN-ROOT SINK | | | | | | | | | |--61:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=67 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 61(GETNEXT) @@ -862,13 +862,13 @@ PLAN-ROOT SINK | | | | | | | |--55:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=60 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 55(GETNEXT) @@ -882,7 +882,7 @@ PLAN-ROOT SINK | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=58 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -924,13 +924,13 @@ PLAN-ROOT SINK | | | | | |--68:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=76 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 68(GETNEXT) @@ -981,13 +981,13 @@ PLAN-ROOT SINK | | | |--47:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=52 row-size=12B cardinality=108 cost=18780 | | in pipelines: 47(GETNEXT) @@ -1035,13 +1035,13 @@ PLAN-ROOT SINK | | | | | |--42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=45 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 42(GETNEXT) @@ -1072,13 +1072,13 @@ PLAN-ROOT SINK | | | | | |--39:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=40 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 39(GETNEXT) @@ -1104,13 +1104,13 @@ PLAN-ROOT SINK | | | |--36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 36(GETNEXT) @@ -1122,7 +1122,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=34 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 35(GETNEXT) @@ -1226,13 +1226,13 @@ PLAN-ROOT SINK | | | | | | | |--17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 17(GETNEXT) @@ -1288,13 +1288,13 @@ PLAN-ROOT SINK | | | | | |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=10 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 11(GETNEXT) @@ -1308,7 +1308,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=8 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -1350,13 +1350,13 @@ PLAN-ROOT SINK | | | |--24:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=26 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 24(GETNEXT) @@ -1407,13 +1407,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 03(GETNEXT) @@ -1427,7 +1427,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=488.47M(filtered from 8.25G) cost=126269468 @@ -1594,13 +1594,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 130:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=146 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 130(GETNEXT) @@ -1648,13 +1648,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 127:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=141 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 127(GETNEXT) @@ -1697,13 +1697,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 124:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=137 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 124(GETNEXT) @@ -1715,7 +1715,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=135 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 123(GETNEXT) @@ -1948,13 +1948,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 105:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=118 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 105(GETNEXT) @@ -2059,13 +2059,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 99:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=111 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 99(GETNEXT) @@ -2079,7 +2079,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=109 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -2170,13 +2170,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 112:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=127 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 112(GETNEXT) @@ -2261,13 +2261,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[18785] | | 91:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=103 row-size=12B cardinality=108 cost=18780 | | in pipelines: 91(GETNEXT) @@ -2367,13 +2367,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=95 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 86(GETNEXT) @@ -2421,13 +2421,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 83:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=90 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 83(GETNEXT) @@ -2470,13 +2470,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 80:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=86 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 80(GETNEXT) @@ -2488,7 +2488,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=84 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 79(GETNEXT) @@ -2721,13 +2721,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 61:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=67 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 61(GETNEXT) @@ -2832,13 +2832,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=60 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 55(GETNEXT) @@ -2852,7 +2852,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=58 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -2943,13 +2943,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=76 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 68(GETNEXT) @@ -3034,13 +3034,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[18785] | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=52 row-size=12B cardinality=108 cost=18780 | | in pipelines: 47(GETNEXT) @@ -3135,13 +3135,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=45 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 42(GETNEXT) @@ -3189,13 +3189,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=40 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 39(GETNEXT) @@ -3238,13 +3238,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[14888] | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 36(GETNEXT) @@ -3256,7 +3256,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=34 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 35(GETNEXT) @@ -3489,13 +3489,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | | | max-parallelism=1 segment-costs=[14888] | | | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 17(GETNEXT) @@ -3600,13 +3600,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | | max-parallelism=1 segment-costs=[14888] | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=10 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 11(GETNEXT) @@ -3620,7 +3620,7 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=8 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -3711,13 +3711,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | max-parallelism=1 segment-costs=[14888] | | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=26 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 24(GETNEXT) @@ -3802,13 +3802,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | max-parallelism=1 segment-costs=[18785] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 03(GETNEXT) @@ -3822,7 +3822,7 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=488.47M(filtered from 8.25G) cost=126269468 @@ -3989,13 +3989,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 130:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_19.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_19.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=146 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 130(GETNEXT) @@ -4043,13 +4043,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 127:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_18.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_18.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=141 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 127(GETNEXT) @@ -4092,13 +4092,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 124:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_17.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_17.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=137 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 124(GETNEXT) @@ -4110,7 +4110,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=135 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 123(GETNEXT) @@ -4343,13 +4343,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 105:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_15.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=118 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 105(GETNEXT) @@ -4454,13 +4454,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 99:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=111 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 99(GETNEXT) @@ -4474,7 +4474,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=109 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -4565,13 +4565,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 112:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_16.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=127 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 112(GETNEXT) @@ -4656,13 +4656,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[18785] | | 91:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=103 row-size=12B cardinality=108 cost=18780 | | in pipelines: 91(GETNEXT) @@ -4762,13 +4762,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=95 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 86(GETNEXT) @@ -4816,13 +4816,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 83:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_11.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=90 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 83(GETNEXT) @@ -4865,13 +4865,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 80:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_10.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=86 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 80(GETNEXT) @@ -4883,7 +4883,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=84 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 79(GETNEXT) @@ -5116,13 +5116,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 61:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=67 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 61(GETNEXT) @@ -5227,13 +5227,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | | max-parallelism=1 segment-costs=[14888] | | | | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=60 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 55(GETNEXT) @@ -5247,7 +5247,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=58 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -5338,13 +5338,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=76 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 68(GETNEXT) @@ -5429,13 +5429,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[18785] | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=52 row-size=12B cardinality=108 cost=18780 | | in pipelines: 47(GETNEXT) @@ -5530,13 +5530,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=45 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 42(GETNEXT) @@ -5584,13 +5584,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | | max-parallelism=1 segment-costs=[14888] | | | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=40 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 39(GETNEXT) @@ -5633,13 +5633,13 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | | max-parallelism=1 segment-costs=[14888] | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 36(GETNEXT) @@ -5651,7 +5651,7 @@ max-parallelism=108 segment-costs=[31467972, 31467972, 31442780, 1151027, 322888 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=34 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 35(GETNEXT) @@ -5884,13 +5884,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | | | max-parallelism=1 segment-costs=[14888] | | | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 17(GETNEXT) @@ -5995,13 +5995,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | | max-parallelism=1 segment-costs=[14888] | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=10 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 11(GETNEXT) @@ -6015,7 +6015,7 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=8 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -6106,13 +6106,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | | max-parallelism=1 segment-costs=[14888] | | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=26 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 24(GETNEXT) @@ -6197,13 +6197,13 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 | max-parallelism=1 segment-costs=[18785] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 03(GETNEXT) @@ -6217,7 +6217,7 @@ max-parallelism=108 segment-costs=[1549560555, 50705571] cpu-comparison-result=3 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=488.47M(filtered from 8.25G) cost=126269468 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14b.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14b.test index 68d9b27d9..e019c34a5 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14b.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q14b.test @@ -159,13 +159,13 @@ PLAN-ROOT SINK | | | | | | | |--92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=101 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 92(GETNEXT) @@ -196,13 +196,13 @@ PLAN-ROOT SINK | | | | | | | |--89:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=96 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 89(GETNEXT) @@ -228,13 +228,13 @@ PLAN-ROOT SINK | | | | | |--86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=92 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 86(GETNEXT) @@ -246,7 +246,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=90 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 85(GETNEXT) @@ -427,13 +427,13 @@ PLAN-ROOT SINK | | | | | | | | | |--59:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=66 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 59(GETNEXT) @@ -489,13 +489,13 @@ PLAN-ROOT SINK | | | | | | | |--53:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=59 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 53(GETNEXT) @@ -509,7 +509,7 @@ PLAN-ROOT SINK | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=57 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -551,13 +551,13 @@ PLAN-ROOT SINK | | | | | |--66:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=75 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 66(GETNEXT) @@ -586,7 +586,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=53 row-size=16B cardinality=31.50M(filtered from 8.25G) cost=8184132 @@ -620,13 +620,13 @@ PLAN-ROOT SINK | | | | | |--44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=48 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 44(GETNEXT) @@ -657,13 +657,13 @@ PLAN-ROOT SINK | | | | | |--41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=43 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 41(GETNEXT) @@ -689,13 +689,13 @@ PLAN-ROOT SINK | | | |--38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=39 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 38(GETNEXT) @@ -707,7 +707,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=37 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 37(GETNEXT) @@ -765,13 +765,13 @@ PLAN-ROOT SINK | | | | | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | limit: 2 | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=16B cardinality=29 cost=22988 @@ -889,13 +889,13 @@ PLAN-ROOT SINK | | | | | | | |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=13 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 11(GETNEXT) @@ -951,13 +951,13 @@ PLAN-ROOT SINK | | | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -971,7 +971,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -1013,13 +1013,13 @@ PLAN-ROOT SINK | | | |--18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=22 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 18(GETNEXT) @@ -1048,7 +1048,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=31.50M(filtered from 8.25G) cost=8184132 @@ -1171,13 +1171,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=101 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 92(GETNEXT) @@ -1225,13 +1225,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 89:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=96 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 89(GETNEXT) @@ -1274,13 +1274,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=92 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 86(GETNEXT) @@ -1292,7 +1292,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=90 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 85(GETNEXT) @@ -1677,13 +1677,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 59:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=66 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 59(GETNEXT) @@ -1788,13 +1788,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 53:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=59 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 53(GETNEXT) @@ -1808,7 +1808,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=57 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -1899,13 +1899,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 66:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=75 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 66(GETNEXT) @@ -1934,7 +1934,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=53 row-size=16B cardinality=31.66M(filtered from 8.25G) cost=8184132 @@ -2015,13 +2015,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=48 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 44(GETNEXT) @@ -2069,13 +2069,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=43 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 41(GETNEXT) @@ -2118,13 +2118,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | max-parallelism=1 segment-costs=[14888] | | 38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=39 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 38(GETNEXT) @@ -2136,7 +2136,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=37 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 37(GETNEXT) @@ -2271,13 +2271,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | max-parallelism=1 segment-costs=[22991] | | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | limit: 2 | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=16B cardinality=29 cost=22988 @@ -2522,13 +2522,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | | | max-parallelism=1 segment-costs=[14888] | | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=13 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 11(GETNEXT) @@ -2633,13 +2633,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -2653,7 +2653,7 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -2744,13 +2744,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | max-parallelism=1 segment-costs=[14888] | | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=22 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 18(GETNEXT) @@ -2779,7 +2779,7 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=31.66M(filtered from 8.25G) cost=8184132 @@ -2902,13 +2902,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_14.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=101 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 92(GETNEXT) @@ -2956,13 +2956,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 89:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_13.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=96 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 89(GETNEXT) @@ -3005,13 +3005,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 86:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_12.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=92 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 86(GETNEXT) @@ -3023,7 +3023,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=90 row-size=12B cardinality=8.25G cost=1425550548 | | in pipelines: 85(GETNEXT) @@ -3408,13 +3408,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | | max-parallelism=1 segment-costs=[14888] | | | | | 59:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | stored statistics: | | | | | table: rows=73.05K size=2.17MB | | | | | columns: all | | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) -| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL +| | | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT) +| | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_8.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk IS NOT NULL | | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | | tuple-ids=66 row-size=8B cardinality=7.30K cost=14573 | | | | | in pipelines: 59(GETNEXT) @@ -3519,13 +3519,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | | max-parallelism=1 segment-costs=[14888] | | | | 53:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_7.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=59 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 53(GETNEXT) @@ -3539,7 +3539,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=57 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -3630,13 +3630,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 66:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_9.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=75 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 66(GETNEXT) @@ -3665,7 +3665,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=53 row-size=16B cardinality=31.66M(filtered from 8.25G) cost=8184132 @@ -3746,13 +3746,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_6.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=48 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 44(GETNEXT) @@ -3800,13 +3800,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | | max-parallelism=1 segment-costs=[14888] | | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_5.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=43 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 41(GETNEXT) @@ -3849,13 +3849,13 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | | max-parallelism=1 segment-costs=[14888] | | 38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=39 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 38(GETNEXT) @@ -3867,7 +3867,7 @@ max-parallelism=10 segment-costs=[26123856, 73981498, 220] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=37 row-size=12B cardinality=8.25G cost=1425550548 | in pipelines: 37(GETNEXT) @@ -4002,13 +4002,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | max-parallelism=1 segment-costs=[22991] | | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_dom = CAST(20 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_moy = CAST(12 AS INT) | | limit: 2 | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=16B cardinality=29 cost=22988 @@ -4253,13 +4253,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | | | max-parallelism=1 segment-costs=[14888] | | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | | tuple-ids=13 row-size=8B cardinality=7.30K cost=14573 | | | | in pipelines: 11(GETNEXT) @@ -4364,13 +4364,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -4384,7 +4384,7 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=8B cardinality=8.21G(filtered from 8.25G) cost=1182183990 @@ -4475,13 +4475,13 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 | | max-parallelism=1 segment-costs=[14888] | | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year <= CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year >= CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=22 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 18(GETNEXT) @@ -4510,7 +4510,7 @@ max-parallelism=7 segment-costs=[1643336974, 41905543] cpu-comparison-result=399 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=7(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=7(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=31.66M(filtered from 8.25G) cost=8184132 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test index d59f5634e..1af6f1053 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test @@ -107,13 +107,13 @@ PLAN-ROOT SINK | | | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -205,13 +205,13 @@ PLAN-ROOT SINK | | | | | |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 13(GETNEXT) @@ -444,13 +444,13 @@ max-parallelism=100 segment-costs=[909313618, 76426709, 370814, 3] cpu-compariso | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -640,13 +640,13 @@ max-parallelism=100 segment-costs=[909313618, 76426709, 370814, 3] cpu-compariso | | | max-parallelism=1 segment-costs=[14888] | | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 13(GETNEXT) @@ -911,13 +911,13 @@ max-parallelism=100 segment-costs=[909313618, 76426709, 370814, 3] cpu-compariso | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -1107,13 +1107,13 @@ max-parallelism=100 segment-costs=[909313618, 76426709, 370814, 3] cpu-compariso | | | max-parallelism=1 segment-costs=[14888] | | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-2-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-2-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-04-02', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-02-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 13(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q17.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q17.test index 980bc364e..648bae256 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q17.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q17.test @@ -226,7 +226,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=91(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=91(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=384.11M(filtered from 7.70G) cost=212211224 @@ -577,7 +577,7 @@ max-parallelism=91 segment-costs=[6764181216] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=91(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=91(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=384.11M(filtered from 7.70G) cost=212211224 @@ -928,7 +928,7 @@ max-parallelism=91 segment-costs=[6764181216] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=91(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=91(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=384.11M(filtered from 7.70G) cost=212211224 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q19.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q19.test index 2e62c8a91..c46915407 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q19.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q19.test @@ -160,7 +160,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=83.07M(filtered from 7.70G) cost=181857343 @@ -413,7 +413,7 @@ max-parallelism=70 segment-costs=[630001505, 21578820] cpu-comparison-result=76 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=83.07M(filtered from 7.70G) cost=181857343 @@ -666,7 +666,7 @@ max-parallelism=70 segment-costs=[630001505, 21578820] cpu-comparison-result=76 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=83.07M(filtered from 7.70G) cost=181857343 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q20.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q20.test index 9069ec8d5..ea67983a1 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q20.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q20.test @@ -97,13 +97,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -258,13 +258,13 @@ max-parallelism=460 segment-costs=[4503992249, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -419,13 +419,13 @@ max-parallelism=460 segment-costs=[4503992249, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-05-08' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-05-08' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-06-07', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-05-08', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q21.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q21.test index e70c54551..864eeba3e 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q21.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q21.test @@ -36,7 +36,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=338.11MB mem-reservation=44.00MB thread-reservation=1 runtime-filters-memory=3.00MB | max-parallelism=1 segment-costs=[598909237, 4080496, 400] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 08:TOP-N [LIMIT=100] @@ -46,9 +46,9 @@ PLAN-ROOT SINK | in pipelines: 08(GETNEXT), 07(OPEN) | 07:AGGREGATE [FINALIZE] -| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) +| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) | group by: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id -| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(divide(CAST(3.0 AS DECIMAL(2,1)), CAST(2.0 AS DECIMAL(2,1))) AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(divide(CAST(2.0 AS DECIMAL(2,1)), CAST(3.0 AS DECIMAL(2,1))) AS DOUBLE) +| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(1.500000 AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(0.666667 AS DOUBLE) | mem-estimate=312.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=8 row-size=72B cardinality=389.70K cost=166829332 | in pipelines: 07(GETNEXT), 00(OPEN) @@ -83,13 +83,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -124,7 +124,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=103.30M(filtered from 1.03G) cost=296218296 @@ -136,7 +136,7 @@ F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.15MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[439] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 14:MERGING-EXCHANGE [UNPARTITIONED] @@ -156,9 +156,9 @@ max-parallelism=20 segment-costs=[192518093, 4080496, 220] cpu-comparison-result | in pipelines: 08(GETNEXT), 13(OPEN) | 13:AGGREGATE [FINALIZE] -| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) +| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id -| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(divide(CAST(3.0 AS DECIMAL(2,1)), CAST(2.0 AS DECIMAL(2,1))) AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(divide(CAST(2.0 AS DECIMAL(2,1)), CAST(3.0 AS DECIMAL(2,1))) AS DOUBLE) +| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(1.500000 AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(0.666667 AS DOUBLE) | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 | tuple-ids=8 row-size=72B cardinality=389.70K cost=151501037 | in pipelines: 13(GETNEXT), 00(OPEN) @@ -173,7 +173,7 @@ Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-res Per-Instance Resources: mem-estimate=78.40MB mem-reservation=34.25MB thread-reservation=1 max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result=110 [max(110 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] -| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) +| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) | group by: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=56.46MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=8 row-size=72B cardinality=92.69M cost=568928111 @@ -243,13 +243,13 @@ max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -301,7 +301,7 @@ max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result= table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=103.30M(filtered from 1.03G) cost=296218296 @@ -313,7 +313,7 @@ F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.15MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[439] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 14:MERGING-EXCHANGE [UNPARTITIONED] @@ -333,9 +333,9 @@ max-parallelism=20 segment-costs=[192518093, 4080496, 220] cpu-comparison-result | in pipelines: 08(GETNEXT), 13(OPEN) | 13:AGGREGATE [FINALIZE] -| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) +| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id -| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(divide(CAST(3.0 AS DECIMAL(2,1)), CAST(2.0 AS DECIMAL(2,1))) AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(divide(CAST(2.0 AS DECIMAL(2,1)), CAST(3.0 AS DECIMAL(2,1))) AS DOUBLE) +| having: CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END <= CAST(1.500000 AS DOUBLE), CASE WHEN sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN divide(CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE), CAST(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE 0 END) AS DOUBLE)) ELSE NULL END >= CAST(0.666667 AS DOUBLE) | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 | tuple-ids=8 row-size=72B cardinality=389.70K cost=151501037 | in pipelines: 13(GETNEXT), 00(OPEN) @@ -350,7 +350,7 @@ Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-res Per-Instance Resources: mem-estimate=78.40MB mem-reservation=34.25MB thread-reservation=1 max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result=110 [max(110 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] -| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) +| output: sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-05-22' THEN tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)) | group by: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_name, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=56.46MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=8 row-size=72B cardinality=92.69M cost=568928111 @@ -420,13 +420,13 @@ max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-05-22' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-05-22' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-06-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-04-22', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -478,7 +478,7 @@ max-parallelism=110 segment-costs=[1000795346, 477822738] cpu-comparison-result= table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=103.30M(filtered from 1.03G) cost=296218296 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q22.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q22.test index 16d235b9a..f36dbda09 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q22.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q22.test @@ -90,13 +90,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -110,7 +110,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=207642204 @@ -261,13 +261,13 @@ max-parallelism=261 segment-costs=[8992112621, 5356784990] cpu-comparison-result | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -281,7 +281,7 @@ max-parallelism=261 segment-costs=[8992112621, 5356784990] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=207642204 @@ -432,13 +432,13 @@ max-parallelism=261 segment-costs=[8992112621, 5356784990] cpu-comparison-result | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -452,7 +452,7 @@ max-parallelism=261 segment-costs=[8992112621, 5356784990] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=207642204 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23a.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23a.test index 923c3c72c..2a90a1078 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23a.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23a.test @@ -54,7 +54,7 @@ Max Per-Host Resource Reservation: Memory=289.56MB Threads=1 Per-Host Resource Estimates: Memory=53.71GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=53.71GB mem-reservation=289.56MB thread-reservation=1 runtime-filters-memory=70.00MB -| max-parallelism=1 segment-costs=[46279409790, 196503532, 7468853018, 9052642761, 2100000, 46279409790, 196503532, 7468853018, 9052642761, 2100000, 684259845, 1] +| max-parallelism=1 segment-costs=[46654894418, 198090266, 7468853018, 9125193214, 2100000, 46654894418, 198090266, 7468853018, 9125193214, 2100000, 684259845, 1] PLAN-ROOT SINK | output exprs: sum(SALES) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1 @@ -80,7 +80,7 @@ PLAN-ROOT SINK | | in pipelines: 37(GETNEXT), 28(OPEN) | | | |--36:NESTED LOOP JOIN [INNER JOIN] -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=16B mem-reservation=0B thread-reservation=0 | | | tuple-ids=29,37 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 28(GETNEXT), 35(OPEN) @@ -96,7 +96,7 @@ PLAN-ROOT SINK | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=1793515099 +| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=1807432333 | | | | in pipelines: 34(GETNEXT), 29(OPEN) | | | | | | | 33:HASH JOIN [INNER JOIN] @@ -104,7 +104,7 @@ PLAN-ROOT SINK | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF029[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=882.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.86G cost=2731200606 +| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.91G cost=2753117041 | | | | in pipelines: 29(GETNEXT), 32(OPEN) | | | | | | | |--32:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -124,19 +124,20 @@ PLAN-ROOT SINK | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=30,32 row-size=24B cardinality=6.39G cost=2796153316 +| | | | tuple-ids=30,32 row-size=24B cardinality=6.44G cost=2818840159 | | | | in pipelines: 29(GETNEXT), 30(OPEN) | | | | | | | |--30:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=32 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=32 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 30(GETNEXT) | | | | | | | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -148,10 +149,10 @@ PLAN-ROOT SINK | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=30 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=30 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 29(GETNEXT) | | | | | 28:AGGREGATE [FINALIZE] @@ -207,7 +208,7 @@ PLAN-ROOT SINK | |--46:AGGREGATE [FINALIZE] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 -| | | tuple-ids=49 row-size=4B cardinality=360.00K cost=196503532 +| | | tuple-ids=49 row-size=4B cardinality=360.00K cost=198090266 | | | in pipelines: 46(GETNEXT), 45(OPEN) | | | | | 45:AGGREGATE [FINALIZE] @@ -215,7 +216,7 @@ PLAN-ROOT SINK | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) | | | mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=668.60M cost=39464670748 +| | | tuple-ids=48 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 45(GETNEXT), 40(OPEN) | | | | | 44:HASH JOIN [INNER JOIN] @@ -223,7 +224,7 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=52.03MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=137B cardinality=6.69G cost=2927671308 +| | | tuple-ids=42,44,46 row-size=137B cardinality=6.74G cost=2951422313 | | | in pipelines: 40(GETNEXT), 43(OPEN) | | | | | |--43:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -243,19 +244,20 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44 row-size=20B cardinality=6.69G cost=2927918537 +| | | tuple-ids=42,44 row-size=20B cardinality=6.74G cost=2951674468 | | | in pipelines: 40(GETNEXT), 41(OPEN) | | | | | |--41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=44 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 41(GETNEXT) | | | | | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -267,10 +269,10 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=42 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=42 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 40(GETNEXT) | | | 39:HASH JOIN [INNER JOIN] @@ -318,7 +320,7 @@ PLAN-ROOT SINK | in pipelines: 13(GETNEXT), 04(OPEN) | |--12:NESTED LOOP JOIN [INNER JOIN] -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=16B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 04(GETNEXT), 11(OPEN) @@ -334,7 +336,7 @@ PLAN-ROOT SINK | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=1793515099 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=1807432333 | | | in pipelines: 10(GETNEXT), 05(OPEN) | | | | | 09:HASH JOIN [INNER JOIN] @@ -342,7 +344,7 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF013[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=882.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2731200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2753117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -362,19 +364,20 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796153316 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818840159 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -386,10 +389,10 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 04:AGGREGATE [FINALIZE] @@ -445,7 +448,7 @@ PLAN-ROOT SINK |--22:AGGREGATE [FINALIZE] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=360.00K cost=196503532 +| | tuple-ids=24 row-size=4B cardinality=360.00K cost=198090266 | | in pipelines: 22(GETNEXT), 21(OPEN) | | | 21:AGGREGATE [FINALIZE] @@ -453,7 +456,7 @@ PLAN-ROOT SINK | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) | | mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 21(GETNEXT), 16(OPEN) | | | 20:HASH JOIN [INNER JOIN] @@ -461,7 +464,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=52.03MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927671308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951422313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -481,19 +484,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927918537 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951674468 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -505,10 +509,10 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN] @@ -548,7 +552,7 @@ PLAN-ROOT SINK in pipelines: 13(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=7.34GB Threads=154 -Per-Host Resource Estimates: Memory=91.27GB +Per-Host Resource Estimates: Memory=91.45GB F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[30, 1] cpu-comparison-result=742 [max(1 (self) vs 742 (sum children))] @@ -610,7 +614,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | | 36:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | | join table id: 10 -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | | tuple-ids=29,37 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 79(GETNEXT), 85(OPEN) @@ -644,7 +648,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | | | | F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | | 35:AGGREGATE | | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price))) | | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -655,23 +659,23 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=924688337 +| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=927399987 | | | | in pipelines: 83(GETNEXT), 29(OPEN) | | | | | | | 82:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] | | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=2.89G cost=587755663 +| | | | tuple-ids=36 row-size=20B cardinality=2.90G cost=589638522 | | | | in pipelines: 29(GETNEXT) | | | | | | | F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | | 34:AGGREGATE [STREAMING] | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=2.89G cost=9260333893 +| | | | tuple-ids=36 row-size=20B cardinality=2.90G cost=9298421436 | | | | in pipelines: 29(GETNEXT) | | | | | | | 33:HASH JOIN [INNER JOIN, BROADCAST] @@ -679,7 +683,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.86G cost=2701200606 +| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.91G cost=2723117041 | | | | in pipelines: 29(GETNEXT), 32(OPEN) | | | | | | | |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -716,36 +720,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=30,32 row-size=24B cardinality=6.39G cost=2796151837 +| | | | tuple-ids=30,32 row-size=24B cardinality=6.44G cost=2818838668 | | | | in pipelines: 29(GETNEXT), 30(OPEN) | | | | | | | |--F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | | max-parallelism=10 segment-costs=[3439] +| | | | | max-parallelism=10 segment-costs=[3471] | | | | JOIN BUILD | | | | | join-table-id=12 plan-id=13 cohort-id=06 | | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | | | 80:EXCHANGE [BROADCAST] -| | | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=32 row-size=8B cardinality=1.48K cost=1960 +| | | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | | tuple-ids=32 row-size=8B cardinality=1.49K cost=1980 | | | | | in pipelines: 30(GETNEXT) | | | | | | | | | F26:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | | max-parallelism=1 segment-costs=[12583] +| | | | max-parallelism=1 segment-costs=[12584] | | | | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=32 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=32 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 30(GETNEXT) | | | | | | | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -757,10 +762,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=30 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=30 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 29(GETNEXT) | | | | | 79:AGGREGATE [FINALIZE] @@ -875,36 +880,36 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | in pipelines: 73(GETNEXT) | | | | | F20:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] hosts=10 instances=120 -| | Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| | max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| | Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| | max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | | 46:AGGREGATE [STREAMING] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=49 row-size=4B cardinality=43.20M cost=308195980 +| | | tuple-ids=49 row-size=4B cardinality=43.20M cost=309782714 | | | in pipelines: 73(GETNEXT) | | | | | 73:AGGREGATE [FINALIZE] | | | output: count:merge() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) -| | | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=668.60M cost=39464670748 +| | | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=48 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 73(GETNEXT), 40(OPEN) | | | | | 72:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] | | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=6.69G cost=1603966813 +| | | tuple-ids=48 row-size=28B cardinality=6.74G cost=1616980742 | | | in pipelines: 40(GETNEXT) | | | | | F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| | Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| | max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | | 45:AGGREGATE [STREAMING] | | | output: count() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date -| | | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=6.69G cost=39464670748 +| | | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=48 row-size=28B cardinality=6.74G cost=39784870914 | | | in pipelines: 40(GETNEXT) | | | | | 44:HASH JOIN [INNER JOIN, BROADCAST] @@ -912,7 +917,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=137B cardinality=6.69G cost=2927311308 +| | | tuple-ids=42,44,46 row-size=137B cardinality=6.74G cost=2951062313 | | | in pipelines: 40(GETNEXT), 43(OPEN) | | | | | |--F47:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -949,36 +954,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44 row-size=20B cardinality=6.69G cost=2927917058 +| | | tuple-ids=42,44 row-size=20B cardinality=6.74G cost=2951672977 | | | in pipelines: 40(GETNEXT), 41(OPEN) | | | | | |--F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=16 plan-id=17 cohort-id=07 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 70:EXCHANGE [BROADCAST] -| | | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=44 row-size=12B cardinality=1.48K cost=1960 +| | | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=44 row-size=12B cardinality=1.49K cost=1980 | | | | in pipelines: 41(GETNEXT) | | | | | | | F18:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[16807] +| | | max-parallelism=1 segment-costs=[16808] | | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=44 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 41(GETNEXT) | | | | | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -990,10 +996,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=42 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=42 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 40(GETNEXT) | | | 39:HASH JOIN [INNER JOIN, BROADCAST] @@ -1076,7 +1082,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | 12:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | join table id: 01 -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 60(GETNEXT), 66(OPEN) @@ -1110,7 +1116,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | 11:AGGREGATE | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price))) | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -1121,23 +1127,23 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=924688337 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=927399987 | | | in pipelines: 64(GETNEXT), 05(OPEN) | | | | | 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=587755663 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=589638522 | | | in pipelines: 05(GETNEXT) | | | | | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | 10:AGGREGATE [STREAMING] | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=9260333893 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=9298421436 | | | in pipelines: 05(GETNEXT) | | | | | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -1145,7 +1151,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2701200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2723117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1182,36 +1188,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796151837 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818838668 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--F35:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=03 plan-id=04 cohort-id=03 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 61:EXCHANGE [BROADCAST] -| | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=7 row-size=8B cardinality=1.48K cost=1960 +| | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=7 row-size=8B cardinality=1.49K cost=1980 | | | | in pipelines: 06(GETNEXT) | | | | | | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[12583] +| | | max-parallelism=1 segment-costs=[12584] | | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1223,10 +1230,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 60:AGGREGATE [FINALIZE] @@ -1341,36 +1348,36 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | in pipelines: 54(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | 22:AGGREGATE [STREAMING] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=43.20M cost=308195980 +| | tuple-ids=24 row-size=4B cardinality=43.20M cost=309782714 | | in pipelines: 54(GETNEXT) | | | 54:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) -| | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 54(GETNEXT), 16(OPEN) | | | 53:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=1603966813 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=1616980742 | | in pipelines: 16(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | 21:AGGREGATE [STREAMING] | | output: count() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date -| | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=39464670748 +| | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=39784870914 | | in pipelines: 16(GETNEXT) | | | 20:HASH JOIN [INNER JOIN, BROADCAST] @@ -1378,7 +1385,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927311308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951062313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1415,36 +1422,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927917058 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951672977 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[3439] +| | | max-parallelism=10 segment-costs=[3471] | | JOIN BUILD | | | join-table-id=07 plan-id=08 cohort-id=04 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | 51:EXCHANGE [BROADCAST] -| | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=19 row-size=12B cardinality=1.48K cost=1960 +| | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=19 row-size=12B cardinality=1.49K cost=1980 | | | in pipelines: 17(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=1 segment-costs=[16807] +| | max-parallelism=1 segment-costs=[16808] | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1456,10 +1464,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN, BROADCAST] @@ -1516,7 +1524,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max in pipelines: 13(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=7.34GB Threads=154 -Per-Host Resource Estimates: Memory=91.27GB +Per-Host Resource Estimates: Memory=91.45GB F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[30, 1] cpu-comparison-result=742 [max(1 (self) vs 742 (sum children))] @@ -1578,7 +1586,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | | 36:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | | join table id: 10 -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | | tuple-ids=29,37 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 79(GETNEXT), 85(OPEN) @@ -1612,7 +1620,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | | | | F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | | 35:AGGREGATE | | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price))) | | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -1623,23 +1631,23 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=924688337 +| | | | tuple-ids=36 row-size=20B cardinality=30.00M cost=927399987 | | | | in pipelines: 83(GETNEXT), 29(OPEN) | | | | | | | 82:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] | | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=2.89G cost=587755663 +| | | | tuple-ids=36 row-size=20B cardinality=2.90G cost=589638522 | | | | in pipelines: 29(GETNEXT) | | | | | | | F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | | 34:AGGREGATE [STREAMING] | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=36 row-size=20B cardinality=2.89G cost=9260333893 +| | | | tuple-ids=36 row-size=20B cardinality=2.90G cost=9298421436 | | | | in pipelines: 29(GETNEXT) | | | | | | | 33:HASH JOIN [INNER JOIN, BROADCAST] @@ -1647,7 +1655,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.86G cost=2701200606 +| | | | tuple-ids=30,32,34 row-size=28B cardinality=5.91G cost=2723117041 | | | | in pipelines: 29(GETNEXT), 32(OPEN) | | | | | | | |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1684,36 +1692,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=30,32 row-size=24B cardinality=6.39G cost=2796151837 +| | | | tuple-ids=30,32 row-size=24B cardinality=6.44G cost=2818838668 | | | | in pipelines: 29(GETNEXT), 30(OPEN) | | | | | | | |--F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | | max-parallelism=10 segment-costs=[3439] +| | | | | max-parallelism=10 segment-costs=[3471] | | | | JOIN BUILD | | | | | join-table-id=12 plan-id=13 cohort-id=06 | | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | | | 80:EXCHANGE [BROADCAST] -| | | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=32 row-size=8B cardinality=1.48K cost=1960 +| | | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | | tuple-ids=32 row-size=8B cardinality=1.49K cost=1980 | | | | | in pipelines: 30(GETNEXT) | | | | | | | | | F26:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | | max-parallelism=1 segment-costs=[12583] +| | | | max-parallelism=1 segment-costs=[12584] | | | | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=32 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=32 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 30(GETNEXT) | | | | | | | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1725,10 +1734,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=30 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=30 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 29(GETNEXT) | | | | | 79:AGGREGATE [FINALIZE] @@ -1843,36 +1852,36 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | in pipelines: 73(GETNEXT) | | | | | F20:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] hosts=10 instances=120 -| | Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| | max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| | Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| | max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | | 46:AGGREGATE [STREAMING] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=49 row-size=4B cardinality=43.20M cost=308195980 +| | | tuple-ids=49 row-size=4B cardinality=43.20M cost=309782714 | | | in pipelines: 73(GETNEXT) | | | | | 73:AGGREGATE [FINALIZE] | | | output: count:merge() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) -| | | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=668.60M cost=39464670748 +| | | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=48 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 73(GETNEXT), 40(OPEN) | | | | | 72:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] | | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=6.69G cost=1603966813 +| | | tuple-ids=48 row-size=28B cardinality=6.74G cost=1616980742 | | | in pipelines: 40(GETNEXT) | | | | | F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| | Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| | max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | | 45:AGGREGATE [STREAMING] | | | output: count() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date -| | | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=48 row-size=28B cardinality=6.69G cost=39464670748 +| | | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=48 row-size=28B cardinality=6.74G cost=39784870914 | | | in pipelines: 40(GETNEXT) | | | | | 44:HASH JOIN [INNER JOIN, BROADCAST] @@ -1880,7 +1889,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=137B cardinality=6.69G cost=2927311308 +| | | tuple-ids=42,44,46 row-size=137B cardinality=6.74G cost=2951062313 | | | in pipelines: 40(GETNEXT), 43(OPEN) | | | | | |--F47:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1917,36 +1926,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44 row-size=20B cardinality=6.69G cost=2927917058 +| | | tuple-ids=42,44 row-size=20B cardinality=6.74G cost=2951672977 | | | in pipelines: 40(GETNEXT), 41(OPEN) | | | | | |--F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=16 plan-id=17 cohort-id=07 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 70:EXCHANGE [BROADCAST] -| | | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=44 row-size=12B cardinality=1.48K cost=1960 +| | | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=44 row-size=12B cardinality=1.49K cost=1980 | | | | in pipelines: 41(GETNEXT) | | | | | | | F18:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[16807] +| | | max-parallelism=1 segment-costs=[16808] | | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=44 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 41(GETNEXT) | | | | | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1958,10 +1968,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=42 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=42 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 40(GETNEXT) | | | 39:HASH JOIN [INNER JOIN, BROADCAST] @@ -2044,7 +2054,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | 12:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | join table id: 01 -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 60(GETNEXT), 66(OPEN) @@ -2078,7 +2088,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | | | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | 11:AGGREGATE | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price))) | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -2089,23 +2099,23 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=924688337 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=927399987 | | | in pipelines: 64(GETNEXT), 05(OPEN) | | | | | 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=587755663 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=589638522 | | | in pipelines: 05(GETNEXT) | | | | | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | 10:AGGREGATE [STREAMING] | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=9260333893 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=9298421436 | | | in pipelines: 05(GETNEXT) | | | | | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -2113,7 +2123,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2701200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2723117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -2150,36 +2160,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796151837 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818838668 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--F35:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=03 plan-id=04 cohort-id=03 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 61:EXCHANGE [BROADCAST] -| | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=7 row-size=8B cardinality=1.48K cost=1960 +| | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=7 row-size=8B cardinality=1.49K cost=1980 | | | | in pipelines: 06(GETNEXT) | | | | | | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[12583] +| | | max-parallelism=1 segment-costs=[12584] | | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -2191,10 +2202,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 60:AGGREGATE [FINALIZE] @@ -2309,36 +2320,36 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | in pipelines: 54(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | 22:AGGREGATE [STREAMING] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=43.20M cost=308195980 +| | tuple-ids=24 row-size=4B cardinality=43.20M cost=309782714 | | in pipelines: 54(GETNEXT) | | | 54:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) -| | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 54(GETNEXT), 16(OPEN) | | | 53:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=1603966813 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=1616980742 | | in pipelines: 16(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | 21:AGGREGATE [STREAMING] | | output: count() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date -| | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=39464670748 +| | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=39784870914 | | in pipelines: 16(GETNEXT) | | | 20:HASH JOIN [INNER JOIN, BROADCAST] @@ -2346,7 +2357,7 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927311308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951062313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -2383,36 +2394,37 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927917058 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951672977 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[3439] +| | | max-parallelism=10 segment-costs=[3471] | | JOIN BUILD | | | join-table-id=07 plan-id=08 cohort-id=04 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | 51:EXCHANGE [BROADCAST] -| | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=19 row-size=12B cardinality=1.48K cost=1960 +| | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=19 row-size=12B cardinality=1.49K cost=1980 | | | in pipelines: 17(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=1 segment-costs=[16807] +| | max-parallelism=1 segment-costs=[16808] | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -2424,10 +2436,10 @@ max-parallelism=70 segment-costs=[676272669, 185] cpu-comparison-result=742 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN, BROADCAST] diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23b.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23b.test index 48a5b7e2e..00516a58c 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23b.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q23b.test @@ -61,7 +61,7 @@ Max Per-Host Resource Reservation: Memory=324.56MB Threads=1 Per-Host Resource Estimates: Memory=55.60GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=55.60GB mem-reservation=324.56MB thread-reservation=1 runtime-filters-memory=70.00MB -| max-parallelism=1 segment-costs=[46279409790, 196503532, 7468853018, 9052642761, 2100000, 998195348, 46279409790, 196503532, 7468853018, 9052642761, 2100000, 598354507, 721685539, 300] +| max-parallelism=1 segment-costs=[46654894418, 198090266, 7468853018, 9125193214, 2100000, 998195348, 46654894418, 198090266, 7468853018, 9125193214, 2100000, 598354507, 721685539, 300] PLAN-ROOT SINK | output exprs: C_LAST_NAME, C_FIRST_NAME, SALES | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 @@ -114,7 +114,7 @@ PLAN-ROOT SINK | | in pipelines: 41(GETNEXT), 32(OPEN) | | | |--40:NESTED LOOP JOIN [INNER JOIN] -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=16B mem-reservation=0B thread-reservation=0 | | | tuple-ids=34,42 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 32(GETNEXT), 39(OPEN) @@ -130,7 +130,7 @@ PLAN-ROOT SINK | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=1793515099 +| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=1807432333 | | | | in pipelines: 38(GETNEXT), 33(OPEN) | | | | | | | 37:HASH JOIN [INNER JOIN] @@ -138,7 +138,7 @@ PLAN-ROOT SINK | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk, RF033[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=882.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.86G cost=2731200606 +| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.91G cost=2753117041 | | | | in pipelines: 33(GETNEXT), 36(OPEN) | | | | | | | |--36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -158,19 +158,20 @@ PLAN-ROOT SINK | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | runtime filters: RF034[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=35,37 row-size=24B cardinality=6.39G cost=2796153316 +| | | | tuple-ids=35,37 row-size=24B cardinality=6.44G cost=2818840159 | | | | in pipelines: 33(GETNEXT), 34(OPEN) | | | | | | | |--34:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=37 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=37 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 34(GETNEXT) | | | | | | | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -182,10 +183,10 @@ PLAN-ROOT SINK | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=35 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=35 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 33(GETNEXT) | | | | | 32:AGGREGATE [FINALIZE] @@ -242,7 +243,7 @@ PLAN-ROOT SINK | |--50:AGGREGATE [FINALIZE] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=4B cardinality=360.00K cost=196503532 +| | | tuple-ids=54 row-size=4B cardinality=360.00K cost=198090266 | | | in pipelines: 50(GETNEXT), 49(OPEN) | | | | | 49:AGGREGATE [FINALIZE] @@ -250,7 +251,7 @@ PLAN-ROOT SINK | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) | | | mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=668.60M cost=39464670748 +| | | tuple-ids=53 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 49(GETNEXT), 44(OPEN) | | | | | 48:HASH JOIN [INNER JOIN] @@ -258,7 +259,7 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=52.03MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=47,49,51 row-size=137B cardinality=6.69G cost=2927671308 +| | | tuple-ids=47,49,51 row-size=137B cardinality=6.74G cost=2951422313 | | | in pipelines: 44(GETNEXT), 47(OPEN) | | | | | |--47:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -278,19 +279,20 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=47,49 row-size=20B cardinality=6.69G cost=2927918537 +| | | tuple-ids=47,49 row-size=20B cardinality=6.74G cost=2951674468 | | | in pipelines: 44(GETNEXT), 45(OPEN) | | | | | |--45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=49 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=49 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 45(GETNEXT) | | | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -302,10 +304,10 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=47 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=47 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 44(GETNEXT) | | | 43:HASH JOIN [INNER JOIN] @@ -380,7 +382,7 @@ PLAN-ROOT SINK | in pipelines: 13(GETNEXT), 04(OPEN) | |--12:NESTED LOOP JOIN [INNER JOIN] -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=16B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 04(GETNEXT), 11(OPEN) @@ -396,7 +398,7 @@ PLAN-ROOT SINK | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=1793515099 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=1807432333 | | | in pipelines: 10(GETNEXT), 05(OPEN) | | | | | 09:HASH JOIN [INNER JOIN] @@ -404,7 +406,7 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=882.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2731200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2753117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -424,19 +426,20 @@ PLAN-ROOT SINK | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796153316 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818840159 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -448,10 +451,10 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 04:AGGREGATE [FINALIZE] @@ -508,7 +511,7 @@ PLAN-ROOT SINK |--22:AGGREGATE [FINALIZE] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=360.00K cost=196503532 +| | tuple-ids=24 row-size=4B cardinality=360.00K cost=198090266 | | in pipelines: 22(GETNEXT), 21(OPEN) | | | 21:AGGREGATE [FINALIZE] @@ -516,7 +519,7 @@ PLAN-ROOT SINK | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) | | mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 21(GETNEXT), 16(OPEN) | | | 20:HASH JOIN [INNER JOIN] @@ -524,7 +527,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | runtime filters: RF009[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=52.03MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927671308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951422313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -544,19 +547,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927918537 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951674468 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -568,10 +572,10 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN] @@ -611,7 +615,7 @@ PLAN-ROOT SINK in pipelines: 13(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=9.18GB Threads=214 -Per-Host Resource Estimates: Memory=97.09GB +Per-Host Resource Estimates: Memory=97.26GB F37:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.38MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[333] cpu-comparison-result=932 [max(1 (self) vs 932 (sum children))] @@ -736,7 +740,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | | 40:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | | join table id: 12 -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | | tuple-ids=34,42 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 89(GETNEXT), 95(OPEN) @@ -770,7 +774,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | | | | F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | | 39:AGGREGATE | | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price))) | | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -781,23 +785,23 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=924688337 +| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=927399987 | | | | in pipelines: 93(GETNEXT), 33(OPEN) | | | | | | | 92:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)] | | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=2.89G cost=587755663 +| | | | tuple-ids=41 row-size=20B cardinality=2.90G cost=589638522 | | | | in pipelines: 33(GETNEXT) | | | | | | | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | | 38:AGGREGATE [STREAMING] | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=2.89G cost=9260333893 +| | | | tuple-ids=41 row-size=20B cardinality=2.90G cost=9298421436 | | | | in pipelines: 33(GETNEXT) | | | | | | | 37:HASH JOIN [INNER JOIN, BROADCAST] @@ -805,7 +809,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.86G cost=2701200606 +| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.91G cost=2723117041 | | | | in pipelines: 33(GETNEXT), 36(OPEN) | | | | | | | |--F51:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -842,36 +846,37 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=35,37 row-size=24B cardinality=6.39G cost=2796151837 +| | | | tuple-ids=35,37 row-size=24B cardinality=6.44G cost=2818838668 | | | | in pipelines: 33(GETNEXT), 34(OPEN) | | | | | | | |--F52:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | | max-parallelism=10 segment-costs=[3439] +| | | | | max-parallelism=10 segment-costs=[3471] | | | | JOIN BUILD | | | | | join-table-id=14 plan-id=15 cohort-id=07 | | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | | runtime filters: RF034[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | | | 90:EXCHANGE [BROADCAST] -| | | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=37 row-size=8B cardinality=1.48K cost=1960 +| | | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | | tuple-ids=37 row-size=8B cardinality=1.49K cost=1980 | | | | | in pipelines: 34(GETNEXT) | | | | | | | | | F29:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | | max-parallelism=1 segment-costs=[12583] +| | | | max-parallelism=1 segment-costs=[12584] | | | | 34:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=37 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=37 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 34(GETNEXT) | | | | | | | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -883,10 +888,10 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=35 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=35 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 33(GETNEXT) | | | | | 89:AGGREGATE [FINALIZE] @@ -1002,36 +1007,36 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | in pipelines: 83(GETNEXT) | | | | | F23:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] hosts=10 instances=120 -| | Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| | max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| | Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| | max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | | 50:AGGREGATE [STREAMING] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=4B cardinality=43.20M cost=308195980 +| | | tuple-ids=54 row-size=4B cardinality=43.20M cost=309782714 | | | in pipelines: 83(GETNEXT) | | | | | 83:AGGREGATE [FINALIZE] | | | output: count:merge() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) -| | | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=668.60M cost=39464670748 +| | | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=53 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 83(GETNEXT), 44(OPEN) | | | | | 82:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] | | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=6.69G cost=1603966813 +| | | tuple-ids=53 row-size=28B cardinality=6.74G cost=1616980742 | | | in pipelines: 44(GETNEXT) | | | | | F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| | Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| | max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | | 49:AGGREGATE [STREAMING] | | | output: count() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date -| | | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=6.69G cost=39464670748 +| | | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=53 row-size=28B cardinality=6.74G cost=39784870914 | | | in pipelines: 44(GETNEXT) | | | | | 48:HASH JOIN [INNER JOIN, BROADCAST] @@ -1039,7 +1044,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=47,49,51 row-size=137B cardinality=6.69G cost=2927311308 +| | | tuple-ids=47,49,51 row-size=137B cardinality=6.74G cost=2951062313 | | | in pipelines: 44(GETNEXT), 47(OPEN) | | | | | |--F55:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1076,36 +1081,37 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=47,49 row-size=20B cardinality=6.69G cost=2927917058 +| | | tuple-ids=47,49 row-size=20B cardinality=6.74G cost=2951672977 | | | in pipelines: 44(GETNEXT), 45(OPEN) | | | | | |--F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=18 plan-id=19 cohort-id=08 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 80:EXCHANGE [BROADCAST] -| | | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=49 row-size=12B cardinality=1.48K cost=1960 +| | | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=49 row-size=12B cardinality=1.49K cost=1980 | | | | in pipelines: 45(GETNEXT) | | | | | | | F21:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[16807] +| | | max-parallelism=1 segment-costs=[16808] | | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=49 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=49 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 45(GETNEXT) | | | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1117,10 +1123,10 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=47 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=47 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 44(GETNEXT) | | | 43:HASH JOIN [INNER JOIN, BROADCAST] @@ -1271,7 +1277,7 @@ max-parallelism=108 segment-costs=[2237189003] | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | 12:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | join table id: 02 -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 66(GETNEXT), 72(OPEN) @@ -1305,7 +1311,7 @@ max-parallelism=108 segment-costs=[2237189003] | | | | | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | 11:AGGREGATE | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price))) | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -1316,23 +1322,23 @@ max-parallelism=108 segment-costs=[2237189003] | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=924688337 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=927399987 | | | in pipelines: 70(GETNEXT), 05(OPEN) | | | | | 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=587755663 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=589638522 | | | in pipelines: 05(GETNEXT) | | | | | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | 10:AGGREGATE [STREAMING] | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=9260333893 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=9298421436 | | | in pipelines: 05(GETNEXT) | | | | | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -1340,7 +1346,7 @@ max-parallelism=108 segment-costs=[2237189003] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2701200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2723117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--F41:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1377,36 +1383,37 @@ max-parallelism=108 segment-costs=[2237189003] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796151837 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818838668 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--F42:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=04 plan-id=05 cohort-id=03 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 67:EXCHANGE [BROADCAST] -| | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=7 row-size=8B cardinality=1.48K cost=1960 +| | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=7 row-size=8B cardinality=1.49K cost=1980 | | | | in pipelines: 06(GETNEXT) | | | | | | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[12583] +| | | max-parallelism=1 segment-costs=[12584] | | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1418,10 +1425,10 @@ max-parallelism=108 segment-costs=[2237189003] | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 66:AGGREGATE [FINALIZE] @@ -1537,36 +1544,36 @@ max-parallelism=108 segment-costs=[2237189003] | | in pipelines: 60(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | 22:AGGREGATE [STREAMING] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=43.20M cost=308195980 +| | tuple-ids=24 row-size=4B cardinality=43.20M cost=309782714 | | in pipelines: 60(GETNEXT) | | | 60:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) -| | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 60(GETNEXT), 16(OPEN) | | | 59:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=1603966813 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=1616980742 | | in pipelines: 16(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | 21:AGGREGATE [STREAMING] | | output: count() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date -| | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=39464670748 +| | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=39784870914 | | in pipelines: 16(GETNEXT) | | | 20:HASH JOIN [INNER JOIN, BROADCAST] @@ -1574,7 +1581,7 @@ max-parallelism=108 segment-costs=[2237189003] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927311308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951062313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--F45:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1611,36 +1618,37 @@ max-parallelism=108 segment-costs=[2237189003] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927917058 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951672977 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[3439] +| | | max-parallelism=10 segment-costs=[3471] | | JOIN BUILD | | | join-table-id=08 plan-id=09 cohort-id=04 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | 57:EXCHANGE [BROADCAST] -| | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=19 row-size=12B cardinality=1.48K cost=1960 +| | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=19 row-size=12B cardinality=1.49K cost=1980 | | | in pipelines: 17(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=1 segment-costs=[16807] +| | max-parallelism=1 segment-costs=[16808] | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1652,10 +1660,10 @@ max-parallelism=108 segment-costs=[2237189003] | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN, BROADCAST] @@ -1712,7 +1720,7 @@ max-parallelism=108 segment-costs=[2237189003] in pipelines: 13(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=9.18GB Threads=214 -Per-Host Resource Estimates: Memory=97.09GB +Per-Host Resource Estimates: Memory=97.26GB F37:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.38MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[333] cpu-comparison-result=932 [max(1 (self) vs 932 (sum children))] @@ -1837,7 +1845,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | | 40:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | | join table id: 12 -| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) +| | | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_2.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)))) | | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | | tuple-ids=34,42 row-size=36B cardinality=3.00M cost=614700 | | | in pipelines: 89(GETNEXT), 95(OPEN) @@ -1871,7 +1879,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | | | | F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | | 39:AGGREGATE | | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price))) | | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -1882,23 +1890,23 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=924688337 +| | | | tuple-ids=41 row-size=20B cardinality=30.00M cost=927399987 | | | | in pipelines: 93(GETNEXT), 33(OPEN) | | | | | | | 92:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)] | | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=2.89G cost=587755663 +| | | | tuple-ids=41 row-size=20B cardinality=2.90G cost=589638522 | | | | in pipelines: 33(GETNEXT) | | | | | | | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | | 38:AGGREGATE [STREAMING] | | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_sales_price)) | | | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=41 row-size=20B cardinality=2.89G cost=9260333893 +| | | | tuple-ids=41 row-size=20B cardinality=2.90G cost=9298421436 | | | | in pipelines: 33(GETNEXT) | | | | | | | 37:HASH JOIN [INNER JOIN, BROADCAST] @@ -1906,7 +1914,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.86G cost=2701200606 +| | | | tuple-ids=35,37,39 row-size=28B cardinality=5.91G cost=2723117041 | | | | in pipelines: 33(GETNEXT), 36(OPEN) | | | | | | | |--F51:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -1943,36 +1951,37 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=35,37 row-size=24B cardinality=6.39G cost=2796151837 +| | | | tuple-ids=35,37 row-size=24B cardinality=6.44G cost=2818838668 | | | | in pipelines: 33(GETNEXT), 34(OPEN) | | | | | | | |--F52:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | | max-parallelism=10 segment-costs=[3439] +| | | | | max-parallelism=10 segment-costs=[3471] | | | | JOIN BUILD | | | | | join-table-id=14 plan-id=15 cohort-id=07 | | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | | | runtime filters: RF034[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | | | 90:EXCHANGE [BROADCAST] -| | | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=37 row-size=8B cardinality=1.48K cost=1960 +| | | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | | tuple-ids=37 row-size=8B cardinality=1.49K cost=1980 | | | | | in pipelines: 34(GETNEXT) | | | | | | | | | F29:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | | max-parallelism=1 segment-costs=[12583] +| | | | max-parallelism=1 segment-costs=[12584] | | | | 34:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | stored statistics: | | | | table: rows=73.05K size=2.17MB | | | | columns: all | | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | | tuple-ids=37 row-size=8B cardinality=1.48K cost=12520 +| | | | tuple-ids=37 row-size=8B cardinality=1.49K cost=12520 | | | | in pipelines: 34(GETNEXT) | | | | | | | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -1984,10 +1993,10 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | table: rows=8.64G size=389.90GB | | | partitions: 1823/1823 rows=8.25G | | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=35 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | | tuple-ids=35 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | | in pipelines: 33(GETNEXT) | | | | | 89:AGGREGATE [FINALIZE] @@ -2103,36 +2112,36 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | in pipelines: 83(GETNEXT) | | | | | F23:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] hosts=10 instances=120 -| | Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| | max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| | Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| | max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | | 50:AGGREGATE [STREAMING] | | | group by: tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=4B cardinality=43.20M cost=308195980 +| | | tuple-ids=54 row-size=4B cardinality=43.20M cost=309782714 | | | in pipelines: 83(GETNEXT) | | | | | 83:AGGREGATE [FINALIZE] | | | output: count:merge() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date | | | having: count() > CAST(4 AS BIGINT) -| | | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=668.60M cost=39464670748 +| | | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=53 row-size=28B cardinality=674.02M cost=39784870914 | | | in pipelines: 83(GETNEXT), 44(OPEN) | | | | | 82:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_4.d_date)] | | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=6.69G cost=1603966813 +| | | tuple-ids=53 row-size=28B cardinality=6.74G cost=1616980742 | | | in pipelines: 44(GETNEXT) | | | | | F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| | Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| | max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | | 49:AGGREGATE [STREAMING] | | | output: count() | | | group by: substr(tpcds_partitioned_parquet_snap.item_0.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_4.d_date -| | | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=53 row-size=28B cardinality=6.69G cost=39464670748 +| | | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=53 row-size=28B cardinality=6.74G cost=39784870914 | | | in pipelines: 44(GETNEXT) | | | | | 48:HASH JOIN [INNER JOIN, BROADCAST] @@ -2140,7 +2149,7 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=47,49,51 row-size=137B cardinality=6.69G cost=2927311308 +| | | tuple-ids=47,49,51 row-size=137B cardinality=6.74G cost=2951062313 | | | in pipelines: 44(GETNEXT), 47(OPEN) | | | | | |--F55:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -2177,36 +2186,37 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=47,49 row-size=20B cardinality=6.69G cost=2927917058 +| | | tuple-ids=47,49 row-size=20B cardinality=6.74G cost=2951672977 | | | in pipelines: 44(GETNEXT), 45(OPEN) | | | | | |--F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=18 plan-id=19 cohort-id=08 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 80:EXCHANGE [BROADCAST] -| | | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=49 row-size=12B cardinality=1.48K cost=1960 +| | | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=49 row-size=12B cardinality=1.49K cost=1980 | | | | in pipelines: 45(GETNEXT) | | | | | | | F21:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[16807] +| | | max-parallelism=1 segment-costs=[16808] | | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=49 row-size=12B cardinality=1.48K cost=16728 +| | | tuple-ids=49 row-size=12B cardinality=1.49K cost=16728 | | | in pipelines: 45(GETNEXT) | | | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -2218,10 +2228,10 @@ max-parallelism=90 segment-costs=[497435343, 328994030, 721685539, 136] cpu-comp | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=47 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| | tuple-ids=47 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | | in pipelines: 44(GETNEXT) | | | 43:HASH JOIN [INNER JOIN, BROADCAST] @@ -2372,7 +2382,7 @@ max-parallelism=108 segment-costs=[2237189003] | max-parallelism=170 segment-costs=[1644760041, 1035900] cpu-comparison-result=240 [max(40 (self) vs 240 (sum children))] | 12:NESTED LOOP JOIN [INNER JOIN, BROADCAST] | | join table id: 02 -| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(divide(CAST(95 AS DECIMAL(3,0)), CAST(100.0 AS DECIMAL(4,1))), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) +| | join predicates: sum(multiply(tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) > multiply(CAST(0.950000 AS DECIMAL(10,6)), max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)))) | | mem-estimate=0B mem-reservation=0B thread-reservation=0 | | tuple-ids=4,12 row-size=36B cardinality=3.00M cost=614700 | | in pipelines: 66(GETNEXT), 72(OPEN) @@ -2406,7 +2416,7 @@ max-parallelism=108 segment-costs=[2237189003] | | | | | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] hosts=10 instances=40 (adjusted from 120) | | Per-Instance Resources: mem-estimate=46.81MB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=160 segment-costs=[1512444000, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] +| | max-parallelism=160 segment-costs=[1517038509, 2100000, 185] cpu-comparison-result=120 [max(40 (self) vs 120 (sum children))] | | 11:AGGREGATE | | | output: max(sum(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price))) | | | mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 @@ -2417,23 +2427,23 @@ max-parallelism=108 segment-costs=[2237189003] | | | output: sum:merge(multiply(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity, tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=924688337 +| | | tuple-ids=11 row-size=20B cardinality=30.00M cost=927399987 | | | in pipelines: 70(GETNEXT), 05(OPEN) | | | | | 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] | | | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=587755663 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=589638522 | | | in pipelines: 05(GETNEXT) | | | | | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | | Per-Instance Resources: mem-estimate=935.28MB mem-reservation=34.50MB thread-reservation=1 -| | max-parallelism=1479 segment-costs=[16486876556, 5218321088] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| | max-parallelism=1491 segment-costs=[16583597306, 5235037833] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] | | 10:AGGREGATE [STREAMING] | | | output: sum(multiply(CAST(tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity AS DECIMAL(10,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price)) | | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=915.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=11 row-size=20B cardinality=2.89G cost=9260333893 +| | | tuple-ids=11 row-size=20B cardinality=2.90G cost=9298421436 | | | in pipelines: 05(GETNEXT) | | | | | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -2441,7 +2451,7 @@ max-parallelism=108 segment-costs=[2237189003] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=5,7,9 row-size=28B cardinality=5.86G cost=2701200606 +| | | tuple-ids=5,7,9 row-size=28B cardinality=5.91G cost=2723117041 | | | in pipelines: 05(GETNEXT), 08(OPEN) | | | | | |--F41:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -2478,36 +2488,37 @@ max-parallelism=108 segment-costs=[2237189003] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=5,7 row-size=24B cardinality=6.39G cost=2796151837 +| | | tuple-ids=5,7 row-size=24B cardinality=6.44G cost=2818838668 | | | in pipelines: 05(GETNEXT), 06(OPEN) | | | | | |--F42:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[3439] +| | | | max-parallelism=10 segment-costs=[3471] | | | JOIN BUILD | | | | join-table-id=04 plan-id=05 cohort-id=03 | | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | | | 67:EXCHANGE [BROADCAST] -| | | | mem-estimate=23.55KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=7 row-size=8B cardinality=1.48K cost=1960 +| | | | mem-estimate=23.65KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=7 row-size=8B cardinality=1.49K cost=1980 | | | | in pipelines: 06(GETNEXT) | | | | | | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[12583] +| | | max-parallelism=1 segment-costs=[12584] | | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=7 row-size=8B cardinality=1.48K cost=12520 +| | | tuple-ids=7 row-size=8B cardinality=1.49K cost=12520 | | | in pipelines: 06(GETNEXT) | | | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -2519,10 +2530,10 @@ max-parallelism=108 segment-costs=[2237189003] | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=5 row-size=16B cardinality=6.39G(filtered from 7.88G) cost=1729190220 +| | tuple-ids=5 row-size=16B cardinality=6.44G(filtered from 7.88G) cost=1743220161 | | in pipelines: 05(GETNEXT) | | | 66:AGGREGATE [FINALIZE] @@ -2638,36 +2649,36 @@ max-parallelism=108 segment-costs=[2237189003] | | in pipelines: 60(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=939.10MB mem-reservation=36.00MB thread-reservation=1 -| max-parallelism=4110 segment-costs=[41068637561, 308195980, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| Per-Instance Resources: mem-estimate=943.42MB mem-reservation=36.00MB thread-reservation=1 +| max-parallelism=4150 segment-costs=[41401851656, 309782714, 33384960] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] | 22:AGGREGATE [STREAMING] | | group by: tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=24 row-size=4B cardinality=43.20M cost=308195980 +| | tuple-ids=24 row-size=4B cardinality=43.20M cost=309782714 | | in pipelines: 60(GETNEXT) | | | 60:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date | | having: count() > CAST(4 AS BIGINT) -| | mem-estimate=915.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=668.60M cost=39464670748 +| | mem-estimate=919.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=674.02M cost=39784870914 | | in pipelines: 60(GETNEXT), 16(OPEN) | | | 59:EXCHANGE [HASH(substr(tpcds_partitioned_parquet_snap.item.i_item_desc, 1, 30),tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.date_dim_1.d_date)] | | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=1603966813 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=1616980742 | | in pipelines: 16(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| Per-Instance Resources: mem-estimate=813.52MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=1479 segment-costs=[46278479224, 15500778074] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] +| Per-Instance Resources: mem-estimate=816.75MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=1491 segment-costs=[46653963840, 15626545035] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))] | 21:AGGREGATE [STREAMING] | | output: count() | | group by: substr(tpcds_partitioned_parquet_snap.item.i_item_desc, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.date_dim_1.d_date -| | mem-estimate=782.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23 row-size=28B cardinality=6.69G cost=39464670748 +| | mem-estimate=785.75MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=23 row-size=28B cardinality=6.74G cost=39784870914 | | in pipelines: 16(GETNEXT) | | | 20:HASH JOIN [INNER JOIN, BROADCAST] @@ -2675,7 +2686,7 @@ max-parallelism=108 segment-costs=[2237189003] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=17,19,21 row-size=137B cardinality=6.69G cost=2927311308 +| | tuple-ids=17,19,21 row-size=137B cardinality=6.74G cost=2951062313 | | in pipelines: 16(GETNEXT), 19(OPEN) | | | |--F45:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -2712,36 +2723,37 @@ max-parallelism=108 segment-costs=[2237189003] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=17,19 row-size=20B cardinality=6.69G cost=2927917058 +| | tuple-ids=17,19 row-size=20B cardinality=6.74G cost=2951672977 | | in pipelines: 16(GETNEXT), 17(OPEN) | | | |--F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[3439] +| | | max-parallelism=10 segment-costs=[3471] | | JOIN BUILD | | | join-table-id=08 plan-id=09 cohort-id=04 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1479 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1491 | | | | | 57:EXCHANGE [BROADCAST] -| | | mem-estimate=33.33KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=19 row-size=12B cardinality=1.48K cost=1960 +| | | mem-estimate=33.47KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=19 row-size=12B cardinality=1.49K cost=1980 | | | in pipelines: 17(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=1 segment-costs=[16807] +| | max-parallelism=1 segment-costs=[16808] | | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2000 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT), CAST(2003 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=19 row-size=12B cardinality=1.48K cost=16728 +| | tuple-ids=19 row-size=12B cardinality=1.49K cost=16728 | | in pipelines: 17(GETNEXT) | | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -2753,10 +2765,10 @@ max-parallelism=108 segment-costs=[2237189003] | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=1479(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=1491(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=17 row-size=8B cardinality=6.69G(filtered from 8.25G) cost=958580110 +| tuple-ids=17 row-size=8B cardinality=6.74G(filtered from 8.25G) cost=966357636 | in pipelines: 16(GETNEXT) | 15:HASH JOIN [INNER JOIN, BROADCAST] diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q25.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q25.test index 2b8b9b749..ff3700e03 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q25.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q25.test @@ -229,7 +229,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=178.21M(filtered from 7.70G) cost=251855079 @@ -572,7 +572,7 @@ max-parallelism=80 segment-costs=[716882879, 85759688] cpu-comparison-result=166 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=178.21M(filtered from 7.70G) cost=251855079 @@ -915,7 +915,7 @@ max-parallelism=80 segment-costs=[716882879, 85759688] cpu-comparison-result=166 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=178.21M(filtered from 7.70G) cost=251855079 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q27.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q27.test index cec8fad4a..f4db12200 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q27.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q27.test @@ -151,7 +151,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 @@ -386,7 +386,7 @@ max-parallelism=140 segment-costs=[1396689803, 584148994] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 @@ -621,7 +621,7 @@ max-parallelism=140 segment-costs=[1396689803, 584148994] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=84.50M(filtered from 7.70G) cost=919600213 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q28.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q28.test index aff1e726f..ab28bdf72 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q28.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q28.test @@ -83,7 +83,7 @@ PLAN-ROOT SINK | | | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -115,7 +115,7 @@ PLAN-ROOT SINK | | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -147,7 +147,7 @@ PLAN-ROOT SINK | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -179,7 +179,7 @@ PLAN-ROOT SINK | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -211,7 +211,7 @@ PLAN-ROOT SINK | | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -238,7 +238,7 @@ PLAN-ROOT SINK | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] HDFS partitions=1824/1824 files=1824 size=389.90GB - predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) stored statistics: table: rows=8.64G size=389.90GB partitions: 1824/1824 rows=8.64G @@ -325,7 +325,7 @@ PLAN-ROOT SINK | | | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -402,7 +402,7 @@ PLAN-ROOT SINK | | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -479,7 +479,7 @@ PLAN-ROOT SINK | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -556,7 +556,7 @@ PLAN-ROOT SINK | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -633,7 +633,7 @@ PLAN-ROOT SINK | | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -689,7 +689,7 @@ max-parallelism=480 segment-costs=[4737996003, 4381776] | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] HDFS partitions=1824/1824 files=1824 size=389.90GB - predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) stored statistics: table: rows=8.64G size=389.90GB partitions: 1824/1824 rows=8.64G @@ -776,7 +776,7 @@ PLAN-ROOT SINK | | | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(add(CAST(71 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(add(CAST(14775 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(add(CAST(38 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity <= CAST(10 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_quantity >= CAST(6 AS INT), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price <= CAST(81 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt <= CAST(15775 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost <= CAST(58 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_4.ss_list_price >= CAST(71 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_coupon_amt >= CAST(14775 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_4.ss_wholesale_cost >= CAST(38 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -853,7 +853,7 @@ PLAN-ROOT SINK | | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(add(CAST(183 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(add(CAST(13456 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(add(CAST(31 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity <= CAST(15 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_quantity >= CAST(11 AS INT), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price <= CAST(193 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt <= CAST(14456 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost <= CAST(51 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_3.ss_list_price >= CAST(183 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_coupon_amt >= CAST(13456 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_3.ss_wholesale_cost >= CAST(31 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -930,7 +930,7 @@ PLAN-ROOT SINK | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(add(CAST(135 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(add(CAST(4905 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(add(CAST(27 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_quantity >= CAST(16 AS INT), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price <= CAST(145 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt <= CAST(5905 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost <= CAST(47 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_2.ss_list_price >= CAST(135 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_coupon_amt >= CAST(4905 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_2.ss_wholesale_cost >= CAST(27 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -1007,7 +1007,7 @@ PLAN-ROOT SINK | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(add(CAST(180 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(add(CAST(17430 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(add(CAST(57 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity <= CAST(25 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_quantity >= CAST(21 AS INT), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price <= CAST(190 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt <= CAST(18430 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost <= CAST(77 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_1.ss_list_price >= CAST(180 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_coupon_amt >= CAST(17430 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_1.ss_wholesale_cost >= CAST(57 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -1084,7 +1084,7 @@ PLAN-ROOT SINK | | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | HDFS partitions=1824/1824 files=1824 size=389.90GB -| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(add(CAST(49 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(add(CAST(2950 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(add(CAST(52 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity <= CAST(30 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_quantity >= CAST(26 AS INT), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price <= CAST(59 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt <= CAST(3950 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost <= CAST(72 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price >= CAST(49 AS DECIMAL(3,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt >= CAST(2950 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost >= CAST(52 AS DECIMAL(3,0)) | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1824/1824 rows=8.64G @@ -1140,7 +1140,7 @@ max-parallelism=480 segment-costs=[4737996003, 4381776] | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] HDFS partitions=1824/1824 files=1824 size=389.90GB - predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(add(CAST(189 AS INT), CAST(10 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(add(CAST(4483 AS INT), CAST(1000 AS INT)) AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(add(CAST(24 AS SMALLINT), CAST(20 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_quantity <= CAST(5 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_quantity >= CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price <= CAST(199 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt <= CAST(5483 AS DECIMAL(10,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost <= CAST(44 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_list_price >= CAST(189 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt >= CAST(4483 AS DECIMAL(5,0)) OR tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost >= CAST(24 AS DECIMAL(3,0)) stored statistics: table: rows=8.64G size=389.90GB partitions: 1824/1824 rows=8.64G diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q29.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q29.test index f7a97af53..152ec4315 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q29.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q29.test @@ -48,10 +48,10 @@ select # end query 29 in stream 0 using template query29.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=164.59MB Threads=1 -Per-Host Resource Estimates: Memory=14.25GB +Per-Host Resource Estimates: Memory=14.29GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=14.25GB mem-reservation=164.59MB thread-reservation=1 runtime-filters-memory=55.00MB -| max-parallelism=1 segment-costs=[4101858464, 754091308, 700] +| Per-Instance Resources: mem-estimate=14.29GB mem-reservation=164.59MB thread-reservation=1 runtime-filters-memory=55.00MB +| max-parallelism=1 segment-costs=[4118285000, 758389729, 700] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name, stddev_samp(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700 @@ -59,22 +59,22 @@ PLAN-ROOT SINK 16:TOP-N [LIMIT=100] | order by: tpcds_partitioned_parquet_snap.item.i_item_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_item_desc ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST | mem-estimate=20.37KB mem-reservation=0B thread-reservation=0 -| tuple-ids=18 row-size=209B cardinality=100 cost=754091308 +| tuple-ids=18 row-size=209B cardinality=100 cost=758389729 | in pipelines: 16(GETNEXT), 15(OPEN) | 15:AGGREGATE [FINALIZE] | output: stddev_samp(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | group by: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name | mem-estimate=1.78GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=17 row-size=209B cardinality=52.17M cost=315253173 +| tuple-ids=17 row-size=209B cardinality=52.45M cost=316954177 | in pipelines: 15(GETNEXT), 00(OPEN) | 14:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF001[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF002[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number -| mem-estimate=10.96GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.17M cost=268781876 +| mem-estimate=11.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.45M cost=269601530 | in pipelines: 00(GETNEXT), 07(OPEN) | |--13:HASH JOIN [INNER JOIN] @@ -82,7 +82,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF013[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF014[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | mem-estimate=3.09GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8,10,12,14 row-size=60B cardinality=142.46M cost=739465185 +| | tuple-ids=8,10,12,14 row-size=60B cardinality=143.22M cost=743199440 | | in pipelines: 07(GETNEXT), 10(OPEN) | | | |--12:HASH JOIN [INNER JOIN] @@ -95,13 +95,13 @@ PLAN-ROOT SINK | | | | | |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=14 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 11(GETNEXT) @@ -126,19 +126,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=8,10 row-size=24B cardinality=2.60G cost=1136944072 +| | tuple-ids=8,10 row-size=24B cardinality=2.61G cost=1143078663 | | in pipelines: 07(GETNEXT), 08(OPEN) | | | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=1.11K cost=12520 +| | tuple-ids=10 row-size=8B cardinality=1.12K cost=12520 | | in pipelines: 08(GETNEXT) | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales] @@ -150,10 +151,10 @@ PLAN-ROOT SINK | table: rows=4.32G size=280.96GB | partitions: 1830/1830 rows=4.30G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1112(filtered from 1830) +| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1118(filtered from 1830) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 -| tuple-ids=8 row-size=16B cardinality=2.60G(filtered from 4.28G) cost=748196538 +| tuple-ids=8 row-size=16B cardinality=2.61G(filtered from 4.28G) cost=752233570 | in pipelines: 07(GETNEXT) | 06:HASH JOIN [INNER JOIN] @@ -227,14 +228,14 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=455.87M(filtered from 7.70G) cost=251855079 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=1.28GB Threads=45 -Per-Host Resource Estimates: Memory=7.65GB +Per-Host Resource Estimates: Memory=7.66GB F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.02MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[766] cpu-comparison-result=176 [max(1 (self) vs 176 (sum children))] @@ -250,34 +251,34 @@ PLAN-ROOT SINK | in pipelines: 16(GETNEXT) | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_id,tpcds_partitioned_parquet_snap.item.i_item_desc,tpcds_partitioned_parquet_snap.store.s_store_id,tpcds_partitioned_parquet_snap.store.s_store_name)] hosts=10 instances=50 (adjusted from 120) -Per-Instance Resources: mem-estimate=233.61MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=80 segment-costs=[371096628, 754091308, 577] cpu-comparison-result=176 [max(50 (self) vs 176 (sum children))] +Per-Instance Resources: mem-estimate=234.79MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=80 segment-costs=[373098945, 758389729, 577] cpu-comparison-result=176 [max(50 (self) vs 176 (sum children))] 16:TOP-N [LIMIT=100] | order by: tpcds_partitioned_parquet_snap.item.i_item_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_item_desc ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST | mem-estimate=20.37KB mem-reservation=0B thread-reservation=0 -| tuple-ids=18 row-size=209B cardinality=100 cost=754091308 +| tuple-ids=18 row-size=209B cardinality=100 cost=758389729 | in pipelines: 16(GETNEXT), 26(OPEN) | 26:AGGREGATE [FINALIZE] | output: stddev_samp:merge(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp:merge(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | group by: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name -| mem-estimate=219.46MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=17 row-size=209B cardinality=52.17M cost=315253173 +| mem-estimate=220.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=17 row-size=209B cardinality=52.45M cost=316954177 | in pipelines: 26(GETNEXT), 00(OPEN) | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_item_id,tpcds_partitioned_parquet_snap.item.i_item_desc,tpcds_partitioned_parquet_snap.store.s_store_id,tpcds_partitioned_parquet_snap.store.s_store_name)] | mem-estimate=14.15MB mem-reservation=0B thread-reservation=0 -| tuple-ids=16 row-size=209B cardinality=52.17M cost=55843455 +| tuple-ids=16 row-size=209B cardinality=52.45M cost=56144768 | in pipelines: 00(GETNEXT) | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] hosts=10 instances=20 (adjusted from 120) -Per-Instance Resources: mem-estimate=489.21MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result=176 [max(128 (self) vs 176 (sum children))] +Per-Instance Resources: mem-estimate=491.43MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=110 segment-costs=[1031648411, 731464861] cpu-comparison-result=176 [max(128 (self) vs 176 (sum children))] 15:AGGREGATE [STREAMING] | output: stddev_samp(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | group by: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name -| mem-estimate=411.48MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=16 row-size=209B cardinality=52.17M cost=315253173 +| mem-estimate=413.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=16 row-size=209B cardinality=52.45M cost=316954177 | in pipelines: 00(GETNEXT) | 14:HASH JOIN [INNER JOIN, PARTITIONED] @@ -285,33 +286,33 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.17M cost=126326225 +| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.45M cost=126377233 | in pipelines: 00(GETNEXT), 07(OPEN) | |--F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] hosts=10 instances=20 (adjusted from 120) -| | Per-Instance Resources: mem-estimate=613.08MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB -| | max-parallelism=110 segment-costs=[213327337] cpu-comparison-result=140 [max(140 (self) vs 31 (sum children))] +| | Per-Instance Resources: mem-estimate=615.27MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB +| | max-parallelism=110 segment-costs=[214478384] cpu-comparison-result=140 [max(140 (self) vs 31 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF001[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF002[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number -| | mem-estimate=561.17MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=142455651 +| | mem-estimate=563.37MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=143224297 | | | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] | | mem-estimate=18.91MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8,10,12,14 row-size=60B cardinality=142.46M cost=70871686 +| | tuple-ids=8,10,12,14 row-size=60B cardinality=143.22M cost=71254087 | | in pipelines: 07(GETNEXT) | | | F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB | Per-Instance Resources: mem-estimate=21.94MB mem-reservation=256.00KB thread-reservation=1 -| max-parallelism=350 segment-costs=[3421242538] +| max-parallelism=350 segment-costs=[3439702483] | 13:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=01 | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8,10,12,14 row-size=60B cardinality=142.46M cost=692081799 +| | tuple-ids=8,10,12,14 row-size=60B cardinality=143.22M cost=695816054 | | in pipelines: 07(GETNEXT), 10(OPEN) | | | |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -359,13 +360,13 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | | max-parallelism=1 segment-costs=[20839] | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=14 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 11(GETNEXT) @@ -390,21 +391,21 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=8,10 row-size=24B cardinality=2.60G cost=1136942960 +| | tuple-ids=8,10 row-size=24B cardinality=2.61G cost=1143077545 | | in pipelines: 07(GETNEXT), 08(OPEN) | | | |--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[2582] +| | | max-parallelism=10 segment-costs=[2598] | | JOIN BUILD | | | join-table-id=03 plan-id=04 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1112 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1118 | | | | | 20:EXCHANGE [BROADCAST] -| | | mem-estimate=20.69KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=10 row-size=8B cardinality=1.11K cost=1470 +| | | mem-estimate=20.73KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=10 row-size=8B cardinality=1.12K cost=1480 | | | in pipelines: 08(GETNEXT) | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -412,14 +413,15 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | max-parallelism=1 segment-costs=[12568] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=1.11K cost=12520 +| | tuple-ids=10 row-size=8B cardinality=1.12K cost=12520 | | in pipelines: 08(GETNEXT) | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] @@ -431,10 +433,10 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | table: rows=4.32G size=280.96GB | partitions: 1830/1830 rows=4.30G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1112(filtered from 1830) +| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1118(filtered from 1830) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 -| tuple-ids=8 row-size=16B cardinality=2.60G(filtered from 4.28G) cost=748196538 +| tuple-ids=8 row-size=16B cardinality=2.61G(filtered from 4.28G) cost=752233570 | in pipelines: 07(GETNEXT) | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] @@ -569,14 +571,14 @@ max-parallelism=108 segment-costs=[8612796513] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=455.87M(filtered from 7.70G) cost=251855079 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=1.28GB Threads=45 -Per-Host Resource Estimates: Memory=7.65GB +Per-Host Resource Estimates: Memory=7.66GB F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.02MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[766] cpu-comparison-result=176 [max(1 (self) vs 176 (sum children))] @@ -592,34 +594,34 @@ PLAN-ROOT SINK | in pipelines: 16(GETNEXT) | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_id,tpcds_partitioned_parquet_snap.item.i_item_desc,tpcds_partitioned_parquet_snap.store.s_store_id,tpcds_partitioned_parquet_snap.store.s_store_name)] hosts=10 instances=50 (adjusted from 120) -Per-Instance Resources: mem-estimate=233.61MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=80 segment-costs=[371096628, 754091308, 577] cpu-comparison-result=176 [max(50 (self) vs 176 (sum children))] +Per-Instance Resources: mem-estimate=234.79MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=80 segment-costs=[373098945, 758389729, 577] cpu-comparison-result=176 [max(50 (self) vs 176 (sum children))] 16:TOP-N [LIMIT=100] | order by: tpcds_partitioned_parquet_snap.item.i_item_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_item_desc ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST | mem-estimate=20.37KB mem-reservation=0B thread-reservation=0 -| tuple-ids=18 row-size=209B cardinality=100 cost=754091308 +| tuple-ids=18 row-size=209B cardinality=100 cost=758389729 | in pipelines: 16(GETNEXT), 26(OPEN) | 26:AGGREGATE [FINALIZE] | output: stddev_samp:merge(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp:merge(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | group by: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name -| mem-estimate=219.46MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=17 row-size=209B cardinality=52.17M cost=315253173 +| mem-estimate=220.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=17 row-size=209B cardinality=52.45M cost=316954177 | in pipelines: 26(GETNEXT), 00(OPEN) | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_item_id,tpcds_partitioned_parquet_snap.item.i_item_desc,tpcds_partitioned_parquet_snap.store.s_store_id,tpcds_partitioned_parquet_snap.store.s_store_name)] | mem-estimate=14.15MB mem-reservation=0B thread-reservation=0 -| tuple-ids=16 row-size=209B cardinality=52.17M cost=55843455 +| tuple-ids=16 row-size=209B cardinality=52.45M cost=56144768 | in pipelines: 00(GETNEXT) | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] hosts=10 instances=20 (adjusted from 120) -Per-Instance Resources: mem-estimate=489.21MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result=176 [max(128 (self) vs 176 (sum children))] +Per-Instance Resources: mem-estimate=491.43MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=110 segment-costs=[1031648411, 731464861] cpu-comparison-result=176 [max(128 (self) vs 176 (sum children))] 15:AGGREGATE [STREAMING] | output: stddev_samp(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), stddev_samp(tpcds_partitioned_parquet_snap.store_returns.sr_return_quantity), stddev_samp(tpcds_partitioned_parquet_snap.catalog_sales.cs_quantity) | group by: tpcds_partitioned_parquet_snap.item.i_item_id, tpcds_partitioned_parquet_snap.item.i_item_desc, tpcds_partitioned_parquet_snap.store.s_store_id, tpcds_partitioned_parquet_snap.store.s_store_name -| mem-estimate=411.48MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=16 row-size=209B cardinality=52.17M cost=315253173 +| mem-estimate=413.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=16 row-size=209B cardinality=52.45M cost=316954177 | in pipelines: 00(GETNEXT) | 14:HASH JOIN [INNER JOIN, PARTITIONED] @@ -627,33 +629,33 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number = tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.17M cost=126326225 +| tuple-ids=0,2,4,6,8,10,12,14 row-size=293B cardinality=52.45M cost=126377233 | in pipelines: 00(GETNEXT), 07(OPEN) | |--F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] hosts=10 instances=20 (adjusted from 120) -| | Per-Instance Resources: mem-estimate=613.08MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB -| | max-parallelism=110 segment-costs=[213327337] cpu-comparison-result=140 [max(140 (self) vs 31 (sum children))] +| | Per-Instance Resources: mem-estimate=615.27MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB +| | max-parallelism=110 segment-costs=[214478384] cpu-comparison-result=140 [max(140 (self) vs 31 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF001[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF002[bloom] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number -| | mem-estimate=561.17MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=142455651 +| | mem-estimate=563.37MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=143224297 | | | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] | | mem-estimate=18.91MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8,10,12,14 row-size=60B cardinality=142.46M cost=70871686 +| | tuple-ids=8,10,12,14 row-size=60B cardinality=143.22M cost=71254087 | | in pipelines: 07(GETNEXT) | | | F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB | Per-Instance Resources: mem-estimate=21.94MB mem-reservation=256.00KB thread-reservation=1 -| max-parallelism=350 segment-costs=[3421242538] +| max-parallelism=350 segment-costs=[3439702483] | 13:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=01 | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.store_returns.sr_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8,10,12,14 row-size=60B cardinality=142.46M cost=692081799 +| | tuple-ids=8,10,12,14 row-size=60B cardinality=143.22M cost=695816054 | | in pipelines: 07(GETNEXT), 10(OPEN) | | | |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -701,13 +703,13 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | | max-parallelism=1 segment-costs=[20839] | | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(3 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(7 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=14 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 11(GETNEXT) @@ -732,21 +734,21 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=8,10 row-size=24B cardinality=2.60G cost=1136942960 +| | tuple-ids=8,10 row-size=24B cardinality=2.61G cost=1143077545 | | in pipelines: 07(GETNEXT), 08(OPEN) | | | |--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[2582] +| | | max-parallelism=10 segment-costs=[2598] | | JOIN BUILD | | | join-table-id=03 plan-id=04 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1112 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1118 | | | | | 20:EXCHANGE [BROADCAST] -| | | mem-estimate=20.69KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=10 row-size=8B cardinality=1.11K cost=1470 +| | | mem-estimate=20.73KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=10 row-size=8B cardinality=1.12K cost=1480 | | | in pipelines: 08(GETNEXT) | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -754,14 +756,15 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | | max-parallelism=1 segment-costs=[12568] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=1.11K cost=12520 +| | tuple-ids=10 row-size=8B cardinality=1.12K cost=12520 | | in pipelines: 08(GETNEXT) | | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] @@ -773,10 +776,10 @@ max-parallelism=110 segment-costs=[1029896399, 727539295] cpu-comparison-result= | table: rows=4.32G size=280.96GB | partitions: 1830/1830 rows=4.30G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1112(filtered from 1830) +| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=1118(filtered from 1830) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 -| tuple-ids=8 row-size=16B cardinality=2.60G(filtered from 4.28G) cost=748196538 +| tuple-ids=8 row-size=16B cardinality=2.61G(filtered from 4.28G) cost=752233570 | in pipelines: 07(GETNEXT) | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] @@ -911,7 +914,7 @@ max-parallelism=108 segment-costs=[8612796513] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=28B cardinality=455.87M(filtered from 7.70G) cost=251855079 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q31.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q31.test index f6ec5ea82..977fc86e2 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q31.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q31.test @@ -134,7 +134,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -208,7 +208,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=35 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -281,7 +281,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=7 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -648,7 +648,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -781,7 +781,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=35 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -913,7 +913,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=7 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -1472,7 +1472,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -1605,7 +1605,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=35 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 @@ -1737,7 +1737,7 @@ max-parallelism=10 segment-costs=[135417, 10854401, 5278957] cpu-comparison-resu | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=186(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=186(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=7 row-size=12B cardinality=803.40M(filtered from 7.88G) cost=169007870 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q32.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q32.test index 2ab039452..bf901a6f6 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q32.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q32.test @@ -91,13 +91,13 @@ PLAN-ROOT SINK | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -127,13 +127,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -298,13 +298,13 @@ max-parallelism=180 segment-costs=[1762790134, 185] cpu-comparison-result=145 [m | | max-parallelism=1 segment-costs=[14888] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -351,13 +351,13 @@ max-parallelism=180 segment-costs=[1762790134, 185] cpu-comparison-result=145 [m | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -522,13 +522,13 @@ max-parallelism=180 segment-costs=[1762790134, 185] cpu-comparison-result=145 [m | | max-parallelism=1 segment-costs=[14888] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -575,13 +575,13 @@ max-parallelism=180 segment-costs=[1762790134, 185] cpu-comparison-result=145 [m | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1998-02-03' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1998-02-03' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1998-05-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1998-02-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q33.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q33.test index f63f822e7..33b11573c 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q33.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q33.test @@ -415,7 +415,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1039,7 +1039,7 @@ max-parallelism=60 segment-costs=[562543053, 207079] cpu-comparison-result=60 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1663,7 +1663,7 @@ max-parallelism=60 segment-costs=[562543053, 207079] cpu-comparison-result=60 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q34.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q34.test index c05396d34..dc728e966 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q34.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q34.test @@ -32,34 +32,34 @@ select c_last_name # end query 34 in stream 0 using template query34.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=74.00MB Threads=1 -Per-Host Resource Estimates: Memory=969MB +Per-Host Resource Estimates: Memory=974MB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=969.12MB mem-reservation=74.00MB thread-reservation=1 runtime-filters-memory=5.00MB -| max-parallelism=1 segment-costs=[1019635384, 24380600, 16656162] +| Per-Instance Resources: mem-estimate=974.24MB mem-reservation=74.00MB thread-reservation=1 runtime-filters-memory=5.00MB +| max-parallelism=1 segment-costs=[1024859330, 24464731, 16750800] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16656162 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16750800 | 10:SORT | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, c_salutation ASC NULLS LAST, c_preferred_cust_flag DESC NULLS FIRST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST -| mem-estimate=212.35MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=2.78M cost=10815995 +| mem-estimate=213.56MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=2.79M cost=10877450 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| mem-estimate=100.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=2.78M cost=3991094 +| mem-estimate=101.25MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=0,10 row-size=88B cardinality=2.79M cost=4013770 | in pipelines: 00(GETNEXT), 08(OPEN) | |--08:AGGREGATE [FINALIZE] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(20 AS BIGINT), count() >= CAST(15 AS BIGINT) -| | mem-estimate=847.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=2.78M cost=163857763 +| | mem-estimate=851.99MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=2.79M cost=164788774 | | in pipelines: 08(GETNEXT), 01(OPEN) | | | 07:HASH JOIN [INNER JOIN] @@ -67,19 +67,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.76M cost=27065167 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.92M cost=27218946 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=8 row-size=12B cardinality=354 cost=20833 | | in pipelines: 06(GETNEXT) | | | 05:HASH JOIN [INNER JOIN] @@ -87,7 +88,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=85B cardinality=85.91M(filtered from 143.85M) cost=48100267 +| | tuple-ids=2,4,6 row-size=85B cardinality=86.39M(filtered from 143.85M) cost=48225464 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -108,7 +109,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165789 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290985 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] @@ -133,10 +134,10 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -149,32 +150,32 @@ PLAN-ROOT SINK extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=2.78M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=2.79M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=298.02MB Threads=22 -Per-Host Resource Estimates: Memory=810MB +Per-Host Resource Estimates: Memory=811MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=122.06MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[17803546] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] +| Per-Instance Resources: mem-estimate=122.18MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[17904704] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16656162 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16750800 | 17:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, c_salutation ASC NULLS LAST, c_preferred_cust_flag DESC NULLS FIRST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST -| mem-estimate=22.06MB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=2.78M cost=1147384 +| mem-estimate=22.18MB mem-reservation=0B thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=2.79M cost=1153904 | in pipelines: 10(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB -Per-Instance Resources: mem-estimate=37.23MB mem-reservation=13.00MB thread-reservation=1 -max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +Per-Instance Resources: mem-estimate=37.36MB mem-reservation=13.00MB thread-reservation=1 +max-parallelism=10 segment-costs=[21672931, 6744400] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] 10:SORT | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, c_salutation ASC NULLS LAST, c_preferred_cust_flag DESC NULLS FIRST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST -| mem-estimate=21.23MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=2.78M cost=10815995 +| mem-estimate=21.36MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=2.79M cost=10877450 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -182,48 +183,48 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=2.78M cost=1215067 +| tuple-ids=0,10 row-size=88B cardinality=2.79M cost=1221970 | in pipelines: 00(GETNEXT), 15(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=113.42MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB -| | max-parallelism=10 segment-costs=[6465357] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +| | Per-Instance Resources: mem-estimate=113.72MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB +| | max-parallelism=10 segment-costs=[6502100] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=100.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2776027 +| | mem-estimate=101.25MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2791800 | | | 16:EXCHANGE [BROADCAST] | | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=2.78M cost=3689330 +| | tuple-ids=10 row-size=20B cardinality=2.79M cost=3710300 | | in pipelines: 15(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=54.94MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[169495873, 209867] cpu-comparison-result=110 [max(20 (self) vs 110 (sum children))] +| Per-Instance Resources: mem-estimate=55.18MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[170458919, 211060] cpu-comparison-result=110 [max(20 (self) vs 110 (sum children))] | 15:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(20 AS BIGINT), count() >= CAST(15 AS BIGINT) -| | mem-estimate=42.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=2.78M cost=163857763 +| | mem-estimate=42.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=2.79M cost=164788774 | | in pipelines: 15(GETNEXT), 01(OPEN) | | | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=12.58MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=27.76M cost=5638110 +| | tuple-ids=10 row-size=20B cardinality=27.92M cost=5670145 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB | Per-Instance Resources: mem-estimate=27.88MB mem-reservation=9.50MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1019610311, 50057317] cpu-comparison-result=110 [max(110 (self) vs 33 (sum children))] +| max-parallelism=110 segment-costs=[1024834255, 50341733] cpu-comparison-result=110 [max(110 (self) vs 33 (sum children))] | 08:AGGREGATE [STREAMING] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=27.76M cost=163857763 +| | tuple-ids=10 row-size=20B cardinality=27.92M cost=164788774 | | in pipelines: 01(GETNEXT) | | | 07:HASH JOIN [INNER JOIN, BROADCAST] @@ -231,21 +232,21 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.76M cost=27064815 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.92M cost=27218592 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=01 plan-id=02 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 13:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=8 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=8 row-size=12B cardinality=354 cost=470 | | | in pipelines: 06(GETNEXT) | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -253,14 +254,15 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | max-parallelism=1 segment-costs=[20852] | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=8 row-size=12B cardinality=354 cost=20833 | | in pipelines: 06(GETNEXT) | | | 05:HASH JOIN [INNER JOIN, BROADCAST] @@ -268,7 +270,7 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=85B cardinality=85.91M(filtered from 143.85M) cost=48100032 +| | tuple-ids=2,4,6 row-size=85B cardinality=86.39M(filtered from 143.85M) cost=48225229 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -306,7 +308,7 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165391 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290587 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -348,10 +350,10 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] @@ -364,32 +366,32 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=2.78M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=2.79M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=298.02MB Threads=22 -Per-Host Resource Estimates: Memory=810MB +Per-Host Resource Estimates: Memory=811MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=122.06MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[17803546] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] +| Per-Instance Resources: mem-estimate=122.18MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[17904704] cpu-comparison-result=110 [max(1 (self) vs 110 (sum children))] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16656162 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=16750800 | 17:MERGING-EXCHANGE [UNPARTITIONED] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, c_salutation ASC NULLS LAST, c_preferred_cust_flag DESC NULLS FIRST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST -| mem-estimate=22.06MB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=2.78M cost=1147384 +| mem-estimate=22.18MB mem-reservation=0B thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=2.79M cost=1153904 | in pipelines: 10(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB -Per-Instance Resources: mem-estimate=37.23MB mem-reservation=13.00MB thread-reservation=1 -max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +Per-Instance Resources: mem-estimate=37.36MB mem-reservation=13.00MB thread-reservation=1 +max-parallelism=10 segment-costs=[21672931, 6744400] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] 10:SORT | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, c_salutation ASC NULLS LAST, c_preferred_cust_flag DESC NULLS FIRST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST -| mem-estimate=21.23MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=2.78M cost=10815995 +| mem-estimate=21.36MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=2.79M cost=10877450 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -397,48 +399,48 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=2.78M cost=1215067 +| tuple-ids=0,10 row-size=88B cardinality=2.79M cost=1221970 | in pipelines: 00(GETNEXT), 15(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=113.42MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB -| | max-parallelism=10 segment-costs=[6465357] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +| | Per-Instance Resources: mem-estimate=113.72MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB +| | max-parallelism=10 segment-costs=[6502100] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=100.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2776027 +| | mem-estimate=101.25MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2791800 | | | 16:EXCHANGE [BROADCAST] | | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=2.78M cost=3689330 +| | tuple-ids=10 row-size=20B cardinality=2.79M cost=3710300 | | in pipelines: 15(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=54.94MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[169495873, 209867] cpu-comparison-result=110 [max(20 (self) vs 110 (sum children))] +| Per-Instance Resources: mem-estimate=55.18MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[170458919, 211060] cpu-comparison-result=110 [max(20 (self) vs 110 (sum children))] | 15:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(20 AS BIGINT), count() >= CAST(15 AS BIGINT) -| | mem-estimate=42.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=2.78M cost=163857763 +| | mem-estimate=42.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=2.79M cost=164788774 | | in pipelines: 15(GETNEXT), 01(OPEN) | | | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=12.58MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=27.76M cost=5638110 +| | tuple-ids=10 row-size=20B cardinality=27.92M cost=5670145 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB | Per-Instance Resources: mem-estimate=27.88MB mem-reservation=9.50MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1019610311, 50057317] cpu-comparison-result=110 [max(110 (self) vs 33 (sum children))] +| max-parallelism=110 segment-costs=[1024834255, 50341733] cpu-comparison-result=110 [max(110 (self) vs 33 (sum children))] | 08:AGGREGATE [STREAMING] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=27.76M cost=163857763 +| | tuple-ids=10 row-size=20B cardinality=27.92M cost=164788774 | | in pipelines: 01(GETNEXT) | | | 07:HASH JOIN [INNER JOIN, BROADCAST] @@ -446,21 +448,21 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.76M cost=27064815 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=27.92M cost=27218592 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=01 plan-id=02 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 13:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=8 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=8 row-size=12B cardinality=354 cost=470 | | | in pipelines: 06(GETNEXT) | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -468,14 +470,15 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | max-parallelism=1 segment-costs=[20852] | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(25 AS INT) AND tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(28 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_dom IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=8 row-size=12B cardinality=354 cost=20833 | | in pipelines: 06(GETNEXT) | | | 05:HASH JOIN [INNER JOIN, BROADCAST] @@ -483,7 +486,7 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=85B cardinality=85.91M(filtered from 143.85M) cost=48100032 +| | tuple-ids=2,4,6 row-size=85B cardinality=86.39M(filtered from 143.85M) cost=48225229 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -521,7 +524,7 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165391 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290587 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -563,10 +566,10 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] @@ -579,6 +582,6 @@ max-parallelism=10 segment-costs=[21604573, 6706296] cpu-comparison-result=110 [ extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=2.78M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=2.79M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q35a.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q35a.test index 69ddb81af..54064b161 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q35a.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q35a.test @@ -251,7 +251,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -636,7 +636,7 @@ max-parallelism=10 segment-costs=[77146329] | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -1030,7 +1030,7 @@ max-parallelism=10 segment-costs=[77146329] | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q36.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q36.test index e54f3bb7f..82f70c9f8 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q36.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q36.test @@ -152,7 +152,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=1.61G(filtered from 7.88G) cost=580675827 @@ -372,7 +372,7 @@ max-parallelism=373 segment-costs=[6137610458, 1636865] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=1.61G(filtered from 7.88G) cost=580675827 @@ -592,7 +592,7 @@ max-parallelism=373 segment-costs=[6137610458, 1636865] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=1.61G(filtered from 7.88G) cost=580675827 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q37.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q37.test index 8e59ade2b..9ea1b428c 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q37.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q37.test @@ -56,13 +56,13 @@ PLAN-ROOT SINK | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.item] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -91,13 +91,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -111,7 +111,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 @@ -216,13 +216,13 @@ max-parallelism=40 segment-costs=[389806012, 385740738] cpu-comparison-result=10 | | max-parallelism=4 segment-costs=[707329] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -277,13 +277,13 @@ max-parallelism=60 segment-costs=[550587747] | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -297,7 +297,7 @@ max-parallelism=60 segment-costs=[550587747] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 @@ -402,13 +402,13 @@ max-parallelism=40 segment-costs=[389806012, 385740738] cpu-comparison-result=10 | | max-parallelism=4 segment-costs=[707329] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(35 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(715 AS INT), CAST(861 AS INT), CAST(928 AS INT), CAST(942 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(65 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(35 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -463,13 +463,13 @@ max-parallelism=60 segment-costs=[550587747] | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-01-20' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-01-20' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-03-21', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-01-20', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -483,7 +483,7 @@ max-parallelism=60 segment-costs=[550587747] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q38.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q38.test index b332133de..57d627ace 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q38.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q38.test @@ -103,13 +103,13 @@ PLAN-ROOT SINK | | | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | | in pipelines: 09(GETNEXT) @@ -165,13 +165,13 @@ PLAN-ROOT SINK | | | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 03(GETNEXT) @@ -185,7 +185,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 @@ -227,13 +227,13 @@ PLAN-ROOT SINK | |--16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 16(GETNEXT) @@ -426,13 +426,13 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | | | max-parallelism=1 segment-costs=[19174] | | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | | in pipelines: 09(GETNEXT) @@ -537,13 +537,13 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | | max-parallelism=1 segment-costs=[19174] | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 03(GETNEXT) @@ -557,7 +557,7 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 @@ -648,13 +648,13 @@ max-parallelism=1390 segment-costs=[13806614244, 6137059648] cpu-comparison-resu | max-parallelism=1 segment-costs=[19174] | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 16(GETNEXT) @@ -847,13 +847,13 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | | | max-parallelism=1 segment-costs=[19174] | | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | | in pipelines: 09(GETNEXT) @@ -958,13 +958,13 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | | max-parallelism=1 segment-costs=[19174] | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 03(GETNEXT) @@ -978,7 +978,7 @@ max-parallelism=120 segment-costs=[12312550098, 68951294500, 78867528967, 372479 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 @@ -1069,13 +1069,13 @@ max-parallelism=1390 segment-costs=[13806614244, 6137059648] cpu-comparison-resu | max-parallelism=1 segment-costs=[19174] | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1222 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1233 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 16(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39a.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39a.test index 13b57aa2f..a3a7211c2 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39a.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39a.test @@ -32,7 +32,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=7.07GB mem-reservation=131.12MB thread-reservation=1 runtime-filters-memory=8.00MB | max-parallelism=1 segment-costs=[2054921340, 2054921340, 65410329, 166320000] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 17:SORT @@ -107,13 +107,13 @@ PLAN-ROOT SINK | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=12 row-size=12B cardinality=108 cost=18780 | | in pipelines: 09(GETNEXT) @@ -127,7 +127,7 @@ PLAN-ROOT SINK | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -213,7 +213,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -225,7 +225,7 @@ F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=176.64MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[172122904] cpu-comparison-result=220 [max(1 (self) vs 220 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 30:MERGING-EXCHANGE [UNPARTITIONED] @@ -393,13 +393,13 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | | max-parallelism=1 segment-costs=[18785] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=12 row-size=12B cardinality=108 cost=18780 | | in pipelines: 09(GETNEXT) @@ -413,7 +413,7 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -576,7 +576,7 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -588,7 +588,7 @@ F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=176.64MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[172122904] cpu-comparison-result=220 [max(1 (self) vs 220 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 30:MERGING-EXCHANGE [UNPARTITIONED] @@ -756,13 +756,13 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | | max-parallelism=1 segment-costs=[18785] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=12 row-size=12B cardinality=108 cost=18780 | | in pipelines: 09(GETNEXT) @@ -776,7 +776,7 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -939,7 +939,7 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39b.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39b.test index a8a5efa87..ad917bb1a 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39b.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q39b.test @@ -34,7 +34,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=7.07GB mem-reservation=131.12MB thread-reservation=1 runtime-filters-memory=8.00MB | max-parallelism=1 segment-costs=[2054921340, 2054921340, 65410329, 166320000] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 17:SORT @@ -129,7 +129,7 @@ PLAN-ROOT SINK | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -195,13 +195,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 01(GETNEXT) @@ -215,7 +215,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -227,7 +227,7 @@ F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=176.64MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[172122904] cpu-comparison-result=220 [max(1 (self) vs 220 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 30:MERGING-EXCHANGE [UNPARTITIONED] @@ -415,7 +415,7 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -558,13 +558,13 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result | max-parallelism=1 segment-costs=[18785] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 01(GETNEXT) @@ -578,7 +578,7 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -590,7 +590,7 @@ F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=176.64MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[172122904] cpu-comparison-result=220 [max(1 (self) vs 220 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END +| output exprs: tpcds_partitioned_parquet_snap.warehouse_0.w_warehouse_sk, tpcds_partitioned_parquet_snap.item_0.i_item_sk, CAST(4 AS INT), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory_0.inv_quantity_on_hand)) END, tpcds_partitioned_parquet_snap.warehouse.w_warehouse_sk, tpcds_partitioned_parquet_snap.item.i_item_sk, CAST(5 AS INT), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), CASE WHEN avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand) = CAST(0 AS DOUBLE) THEN NULL ELSE divide(stddev_samp(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand), avg(tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand)) END | mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=166320000 | 30:MERGING-EXCHANGE [UNPARTITIONED] @@ -778,7 +778,7 @@ max-parallelism=10 segment-costs=[54608161, 26143840] cpu-comparison-result=220 | table: rows=1.03G size=5.10GB | partitions: 261/261 rows=1.03G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) +| extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory_0.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory_0.inv_warehouse_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 | tuple-ids=10 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 @@ -921,13 +921,13 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result | max-parallelism=1 segment-costs=[18785] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(add(CAST(4 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(5 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=108 cost=18780 | in pipelines: 01(GETNEXT) @@ -941,7 +941,7 @@ max-parallelism=108 segment-costs=[3216529925, 1635464315] cpu-comparison-result table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M est-scan-range=108(filtered from 261) + extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=108(filtered from 261) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=427.68M(filtered from 1.03G) cost=122573088 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q40.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q40.test index 34af39d06..8b564a027 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q40.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q40.test @@ -34,7 +34,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=18.66GB mem-reservation=78.00MB thread-reservation=1 runtime-filters-memory=3.00MB | max-parallelism=1 segment-costs=[4334294789, 28837420, 400] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 10:TOP-N [LIMIT=100] @@ -44,7 +44,7 @@ PLAN-ROOT SINK | in pipelines: 10(GETNEXT), 09(OPEN) | 09:AGGREGATE [FINALIZE] -| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) +| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=197.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=10 row-size=74B cardinality=2.41M cost=628267210 @@ -80,13 +80,13 @@ PLAN-ROOT SINK | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) @@ -152,7 +152,7 @@ F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.37MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[440] cpu-comparison-result=210 [max(1 (self) vs 210 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 18:MERGING-EXCHANGE [UNPARTITIONED] @@ -172,7 +172,7 @@ max-parallelism=50 segment-costs=[434353321, 28837420, 225] cpu-comparison-resul | in pipelines: 10(GETNEXT), 17(OPEN) | 17:AGGREGATE [FINALIZE] -| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) +| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 | tuple-ids=10 row-size=74B cardinality=2.41M cost=333499744 @@ -187,7 +187,7 @@ F02:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, Per-Instance Resources: mem-estimate=226.37MB mem-reservation=34.00MB thread-reservation=1 max-parallelism=320 segment-costs=[3171158934, 1179595953] cpu-comparison-result=210 [max(210 (self) vs 206 (sum children))] 09:AGGREGATE [STREAMING] -| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) +| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=197.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=10 row-size=74B cardinality=223.37M cost=1628893885 @@ -257,13 +257,13 @@ max-parallelism=320 segment-costs=[3171158934, 1179595953] cpu-comparison-result | max-parallelism=1 segment-costs=[14888] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) @@ -373,7 +373,7 @@ F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.37MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[440] cpu-comparison-result=210 [max(1 (self) vs 210 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) +| output exprs: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id, sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400 | 18:MERGING-EXCHANGE [UNPARTITIONED] @@ -393,7 +393,7 @@ max-parallelism=50 segment-costs=[434353321, 28837420, 225] cpu-comparison-resul | in pipelines: 10(GETNEXT), 17(OPEN) | 17:AGGREGATE [FINALIZE] -| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) +| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, 0)) ELSE 0 END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 | tuple-ids=10 row-size=74B cardinality=2.41M cost=333499744 @@ -408,7 +408,7 @@ F02:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, Per-Instance Resources: mem-estimate=226.37MB mem-reservation=34.00MB thread-reservation=1 max-parallelism=320 segment-costs=[3171158934, 1179595953] cpu-comparison-result=210 [max(210 (self) vs 206 (sum children))] 09:AGGREGATE [STREAMING] -| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) +| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date < DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-02-02' THEN CAST(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price, coalesce(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, CAST(0 AS DECIMAL(7,2)))) AS DECIMAL(12,2)) ELSE CAST(0 AS DECIMAL(12,2)) END) | group by: tpcds_partitioned_parquet_snap.warehouse.w_state, tpcds_partitioned_parquet_snap.item.i_item_id | mem-estimate=197.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=10 row-size=74B cardinality=223.37M cost=1628893885 @@ -478,13 +478,13 @@ max-parallelism=320 segment-costs=[3171158934, 1179595953] cpu-comparison-result | max-parallelism=1 segment-costs=[14888] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-02-02' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-02-02' AS DATE) - INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-03-04', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-01-03', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 05(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q41.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q41.test index aec73214b..d941fdfe8 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q41.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q41.test @@ -116,27 +116,27 @@ PLAN-ROOT SINK | | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item] | HDFS partitions=1/1 files=1 size=33.54MB -| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.item_1.i_manufact, RF000[bloom] -> tpcds_partitioned_parquet_snap.item_1.i_manufact | stored statistics: | table: rows=360.00K size=33.54MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=101.54K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=27B cardinality=35.95K cost=109623 | in pipelines: 02(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item] HDFS partitions=1/1 files=1 size=33.54MB - predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) stored statistics: table: rows=360.00K size=33.54MB columns: all extrapolated-rows=disabled max-scan-range-rows=101.54K - parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=62B cardinality=36.00K cost=217970 in pipelines: 00(GETNEXT) @@ -278,27 +278,27 @@ max-parallelism=4 segment-costs=[1336328, 993469] cpu-comparison-result=12 [max( | | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | HDFS partitions=1/1 files=1 size=33.54MB -| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.item_1.i_manufact, RF000[bloom] -> tpcds_partitioned_parquet_snap.item_1.i_manufact | stored statistics: | table: rows=360.00K size=33.54MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=101.54K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=27B cardinality=35.95K cost=109623 | in pipelines: 02(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] HDFS partitions=1/1 files=1 size=33.54MB - predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) stored statistics: table: rows=360.00K size=33.54MB columns: all extrapolated-rows=disabled max-scan-range-rows=101.54K - parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=62B cardinality=36.00K cost=217970 in pipelines: 00(GETNEXT) @@ -440,27 +440,27 @@ max-parallelism=4 segment-costs=[1336328, 993469] cpu-comparison-result=12 [max( | | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | HDFS partitions=1/1 files=1 size=33.54MB -| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.item_1.i_manufact, RF000[bloom] -> tpcds_partitioned_parquet_snap.item_1.i_manufact | stored statistics: | table: rows=360.00K size=33.54MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=101.54K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_1.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact_id >= CAST(732 AS INT), tpcds_partitioned_parquet_snap.item_1.i_manufact IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=27B cardinality=35.95K cost=109623 | in pipelines: 02(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] HDFS partitions=1/1 files=1 size=33.54MB - predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) stored statistics: table: rows=360.00K size=33.54MB columns: all extrapolated-rows=disabled max-scan-range-rows=101.54K - parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= add(CAST(732 AS INT), CAST(40 AS INT)), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id <= CAST(772 AS INT), tpcds_partitioned_parquet_snap.item.i_manufact_id >= CAST(732 AS INT) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=62B cardinality=36.00K cost=217970 in pipelines: 00(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q42.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q42.test index 7459745bc..b1bbf2370 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q42.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q42.test @@ -95,7 +95,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -234,7 +234,7 @@ max-parallelism=30 segment-costs=[236966146, 35475] cpu-comparison-result=30 [ma table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -373,7 +373,7 @@ max-parallelism=30 segment-costs=[236966146, 35475] cpu-comparison-result=30 [ma table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43-verbose.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43-verbose.test index 5ea276275..5b546b64b 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43-verbose.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43-verbose.test @@ -114,7 +114,7 @@ SumCost: cost-total=3058023158 max-instances=306 adj-instances=120 cost/inst=254 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL file formats: [PARQUET] mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43.test index d830f4304..9639b8415 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q43.test @@ -91,7 +91,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 @@ -229,7 +229,7 @@ max-parallelism=310 segment-costs=[3058023158, 1710341] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 @@ -367,7 +367,7 @@ max-parallelism=310 segment-costs=[3058023158, 1710341] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q46.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q46.test index 7ee5af921..117227d5e 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q46.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q46.test @@ -36,10 +36,10 @@ select c_last_name # end query 46 in stream 0 using template query46.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=194.44MB Threads=1 -Per-Host Resource Estimates: Memory=8.37GB +Per-Host Resource Estimates: Memory=8.40GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=8.37GB mem-reservation=194.44MB thread-reservation=1 runtime-filters-memory=51.00MB -| max-parallelism=1 segment-costs=[2554344403, 973791170, 700] +| Per-Instance Resources: mem-estimate=8.40GB mem-reservation=194.44MB thread-reservation=1 runtime-filters-memory=51.00MB +| max-parallelism=1 segment-costs=[2565877656, 978649566, 700] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700 @@ -47,7 +47,7 @@ PLAN-ROOT SINK 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=11.51KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=118B cardinality=100 cost=862089313 +| tuple-ids=15 row-size=118B cardinality=100 cost=866679475 | in pipelines: 14(GETNEXT), 09(OPEN) | 13:HASH JOIN [INNER JOIN] @@ -56,7 +56,7 @@ PLAN-ROOT SINK | other join predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_city != tpcds_partitioned_parquet_snap.customer_address.ca_city | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | mem-estimate=730.23MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10,11,13 row-size=138B cardinality=59.22M cost=40470714 +| tuple-ids=10,11,13 row-size=138B cardinality=59.52M cost=40601409 | in pipelines: 09(GETNEXT), 12(OPEN) | |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] @@ -76,7 +76,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=1.98GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10,11 row-size=113B cardinality=59.22M cost=57278490 +| tuple-ids=10,11 row-size=113B cardinality=59.52M cost=57416029 | in pipelines: 09(GETNEXT), 10(OPEN) | |--10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -95,8 +95,8 @@ PLAN-ROOT SINK 09:AGGREGATE [FINALIZE] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address.ca_city -| mem-estimate=4.86GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=385310755 +| mem-estimate=4.89GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=387253499 | in pipelines: 09(GETNEXT), 00(OPEN) | 08:HASH JOIN [INNER JOIN] @@ -104,7 +104,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | mem-estimate=730.23MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.51M cost=43871218 +| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.84M cost=44019058 | in pipelines: 00(GETNEXT), 07(OPEN) | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] @@ -124,20 +124,20 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=85B cardinality=68.74M cost=66507645 +| tuple-ids=0,2,4,6 row-size=85B cardinality=69.09M cost=66570450 | in pipelines: 00(GETNEXT), 05(OPEN) | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=595 cost=18780 +| tuple-ids=6 row-size=12B cardinality=598 cost=18780 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN] @@ -145,7 +145,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119580084 +| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119990477 | in pipelines: 00(GETNEXT), 03(OPEN) | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] @@ -165,7 +165,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=61B cardinality=317.33M(filtered from 863.51M) cost=237862736 +| tuple-ids=0,2 row-size=61B cardinality=318.93M(filtered from 863.51M) cost=238273129 | in pipelines: 00(GETNEXT), 01(OPEN) | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -190,10 +190,10 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=595(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=598(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=317.33M(filtered from 7.50G) cost=1697550487 + tuple-ids=0 row-size=36B cardinality=318.93M(filtered from 7.50G) cost=1706109565 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=1.04GB Threads=64 @@ -214,11 +214,11 @@ PLAN-ROOT SINK | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=100 (adjusted from 120) Per-Instance Resources: mem-estimate=17.10MB mem-reservation=0B thread-reservation=1 -max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [max(160 (self) vs 330 (sum children))] +max-parallelism=100 segment-costs=[932450753, 340] cpu-comparison-result=330 [max(160 (self) vs 330 (sum children))] 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=11.51KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=118B cardinality=100 cost=862089313 +| tuple-ids=15 row-size=118B cardinality=100 cost=866679475 | in pipelines: 14(GETNEXT), 21(OPEN) | 13:HASH JOIN [INNER JOIN, PARTITIONED] @@ -227,7 +227,7 @@ max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [ma | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | other join predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_city != tpcds_partitioned_parquet_snap.customer_address.ca_city | mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0 -| tuple-ids=10,11,13 row-size=138B cardinality=59.22M cost=25921136 +| tuple-ids=10,11,13 row-size=138B cardinality=59.52M cost=26051831 | in pipelines: 21(GETNEXT), 12(OPEN) | |--F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=100 (adjusted from 120) @@ -261,18 +261,18 @@ max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [ma | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] | mem-estimate=17.09MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10,11 row-size=113B cardinality=59.22M cost=39520185 +| tuple-ids=10,11 row-size=113B cardinality=59.52M cost=39719447 | in pipelines: 21(GETNEXT) | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=60 (adjusted from 120) Per-Instance Resources: mem-estimate=60.08MB mem-reservation=0B thread-reservation=1 -max-parallelism=60 segment-costs=[546588884] +max-parallelism=60 segment-costs=[549344799] 11:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=01 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10,11 row-size=113B cardinality=59.22M cost=27278490 +| tuple-ids=10,11 row-size=113B cardinality=59.52M cost=27416029 | in pipelines: 21(GETNEXT), 10(OPEN) | |--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=60 (adjusted from 120) @@ -308,32 +308,32 @@ max-parallelism=60 segment-costs=[546588884] | 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | mem-estimate=12.85MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=27629726 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=27769036 | in pipelines: 21(GETNEXT) | F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address.ca_city)] hosts=10 instances=40 (adjusted from 120) -Per-Instance Resources: mem-estimate=141.61MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=50 segment-costs=[412940481, 319709678] cpu-comparison-result=150 [max(40 (self) vs 150 (sum children))] +Per-Instance Resources: mem-estimate=142.24MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[415022535, 321321659] cpu-comparison-result=150 [max(40 (self) vs 150 (sum children))] 21:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address.ca_city -| mem-estimate=124.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=385310755 +| mem-estimate=125.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=387253499 | in pipelines: 21(GETNEXT), 00(OPEN) | 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address.ca_city)] | mem-estimate=12.14MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=27629726 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=27769036 | in pipelines: 00(GETNEXT) | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120) -Per-Instance Resources: mem-estimate=157.76MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=150 [max(150 (self) vs 73 (sum children))] +Per-Instance Resources: mem-estimate=158.39MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[459069495, 321321659] cpu-comparison-result=150 [max(150 (self) vs 73 (sum children))] 09:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address.ca_city -| mem-estimate=124.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=385310755 +| mem-estimate=125.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=387253499 | in pipelines: 00(GETNEXT) | 08:HASH JOIN [INNER JOIN, PARTITIONED] @@ -341,7 +341,7 @@ max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=15 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.51M cost=29321640 +| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.84M cost=29469480 | in pipelines: 00(GETNEXT), 07(OPEN) | |--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120) @@ -375,33 +375,33 @@ max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=15 | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] | mem-estimate=21.85MB mem-reservation=0B thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=85B cardinality=68.74M cost=42134075 +| tuple-ids=0,2,4,6 row-size=85B cardinality=69.09M cost=42346516 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB Per-Instance Resources: mem-estimate=27.85MB mem-reservation=512.00KB thread-reservation=1 -max-parallelism=270 segment-costs=[2639871937] +max-parallelism=270 segment-costs=[2651928247] 06:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=03 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=85B cardinality=68.74M cost=66507050 +| tuple-ids=0,2,4,6 row-size=85B cardinality=69.09M cost=66569852 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[1385] +| | max-parallelism=10 segment-costs=[1388] | JOIN BUILD | | join-table-id=03 plan-id=04 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=595 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=598 | | | 17:EXCHANGE [BROADCAST] -| | mem-estimate=16.27KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=595 cost=790 +| | mem-estimate=16.35KB mem-reservation=0B thread-reservation=0 +| | tuple-ids=6 row-size=12B cardinality=598 cost=790 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -409,15 +409,15 @@ max-parallelism=270 segment-costs=[2639871937] | max-parallelism=1 segment-costs=[18812] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=595 cost=18780 +| tuple-ids=6 row-size=12B cardinality=598 cost=18780 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -425,7 +425,7 @@ max-parallelism=270 segment-costs=[2639871937] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119578284 +| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119988677 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -462,7 +462,7 @@ max-parallelism=270 segment-costs=[2639871937] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=61B cardinality=317.33M(filtered from 863.51M) cost=237862659 +| tuple-ids=0,2 row-size=61B cardinality=318.93M(filtered from 863.51M) cost=238273052 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -504,10 +504,10 @@ max-parallelism=270 segment-costs=[2639871937] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=595(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=598(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=317.33M(filtered from 7.50G) cost=1697550487 + tuple-ids=0 row-size=36B cardinality=318.93M(filtered from 7.50G) cost=1706109565 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=1.04GB Threads=64 @@ -528,11 +528,11 @@ PLAN-ROOT SINK | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=100 (adjusted from 120) Per-Instance Resources: mem-estimate=17.10MB mem-reservation=0B thread-reservation=1 -max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [max(160 (self) vs 330 (sum children))] +max-parallelism=100 segment-costs=[932450753, 340] cpu-comparison-result=330 [max(160 (self) vs 330 (sum children))] 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_city ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=11.51KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=118B cardinality=100 cost=862089313 +| tuple-ids=15 row-size=118B cardinality=100 cost=866679475 | in pipelines: 14(GETNEXT), 21(OPEN) | 13:HASH JOIN [INNER JOIN, PARTITIONED] @@ -541,7 +541,7 @@ max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [ma | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | other join predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_city != tpcds_partitioned_parquet_snap.customer_address.ca_city | mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0 -| tuple-ids=10,11,13 row-size=138B cardinality=59.22M cost=25921136 +| tuple-ids=10,11,13 row-size=138B cardinality=59.52M cost=26051831 | in pipelines: 21(GETNEXT), 12(OPEN) | |--F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=100 (adjusted from 120) @@ -575,18 +575,18 @@ max-parallelism=100 segment-costs=[927530634, 340] cpu-comparison-result=330 [ma | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] | mem-estimate=17.09MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10,11 row-size=113B cardinality=59.22M cost=39520185 +| tuple-ids=10,11 row-size=113B cardinality=59.52M cost=39719447 | in pipelines: 21(GETNEXT) | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=60 (adjusted from 120) Per-Instance Resources: mem-estimate=60.08MB mem-reservation=0B thread-reservation=1 -max-parallelism=60 segment-costs=[546588884] +max-parallelism=60 segment-costs=[549344799] 11:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=01 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10,11 row-size=113B cardinality=59.22M cost=27278490 +| tuple-ids=10,11 row-size=113B cardinality=59.52M cost=27416029 | in pipelines: 21(GETNEXT), 10(OPEN) | |--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=60 (adjusted from 120) @@ -622,32 +622,32 @@ max-parallelism=60 segment-costs=[546588884] | 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | mem-estimate=12.85MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=27629726 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=27769036 | in pipelines: 21(GETNEXT) | F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address.ca_city)] hosts=10 instances=40 (adjusted from 120) -Per-Instance Resources: mem-estimate=141.61MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=50 segment-costs=[412940481, 319709678] cpu-comparison-result=150 [max(40 (self) vs 150 (sum children))] +Per-Instance Resources: mem-estimate=142.24MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[415022535, 321321659] cpu-comparison-result=150 [max(40 (self) vs 150 (sum children))] 21:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address.ca_city -| mem-estimate=124.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=385310755 +| mem-estimate=125.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=387253499 | in pipelines: 21(GETNEXT), 00(OPEN) | 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address.ca_city)] | mem-estimate=12.14MB mem-reservation=0B thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=27629726 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=27769036 | in pipelines: 00(GETNEXT) | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120) -Per-Instance Resources: mem-estimate=157.76MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=150 [max(150 (self) vs 73 (sum children))] +Per-Instance Resources: mem-estimate=158.39MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[459069495, 321321659] cpu-comparison-result=150 [max(150 (self) vs 73 (sum children))] 09:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address.ca_city -| mem-estimate=124.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=10 row-size=69B cardinality=64.51M cost=385310755 +| mem-estimate=125.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=10 row-size=69B cardinality=64.84M cost=387253499 | in pipelines: 00(GETNEXT) | 08:HASH JOIN [INNER JOIN, PARTITIONED] @@ -655,7 +655,7 @@ max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=15 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.51M cost=29321640 +| tuple-ids=0,2,4,6,8 row-size=110B cardinality=64.84M cost=29469480 | in pipelines: 00(GETNEXT), 07(OPEN) | |--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120) @@ -689,33 +689,33 @@ max-parallelism=50 segment-costs=[456766470, 319709678] cpu-comparison-result=15 | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] | mem-estimate=21.85MB mem-reservation=0B thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=85B cardinality=68.74M cost=42134075 +| tuple-ids=0,2,4,6 row-size=85B cardinality=69.09M cost=42346516 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB Per-Instance Resources: mem-estimate=27.85MB mem-reservation=512.00KB thread-reservation=1 -max-parallelism=270 segment-costs=[2639871937] +max-parallelism=270 segment-costs=[2651928247] 06:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=03 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=85B cardinality=68.74M cost=66507050 +| tuple-ids=0,2,4,6 row-size=85B cardinality=69.09M cost=66569852 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[1385] +| | max-parallelism=10 segment-costs=[1388] | JOIN BUILD | | join-table-id=03 plan-id=04 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=595 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=598 | | | 17:EXCHANGE [BROADCAST] -| | mem-estimate=16.27KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=595 cost=790 +| | mem-estimate=16.35KB mem-reservation=0B thread-reservation=0 +| | tuple-ids=6 row-size=12B cardinality=598 cost=790 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -723,15 +723,15 @@ max-parallelism=270 segment-costs=[2639871937] | max-parallelism=1 segment-costs=[18812] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow IN (CAST(0 AS INT), CAST(6 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=595 cost=18780 +| tuple-ids=6 row-size=12B cardinality=598 cost=18780 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -739,7 +739,7 @@ max-parallelism=270 segment-costs=[2639871937] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119578284 +| tuple-ids=0,2,4 row-size=73B cardinality=210.73M cost=119988677 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -776,7 +776,7 @@ max-parallelism=270 segment-costs=[2639871937] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=61B cardinality=317.33M(filtered from 863.51M) cost=237862659 +| tuple-ids=0,2 row-size=61B cardinality=318.93M(filtered from 863.51M) cost=238273052 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -818,9 +818,9 @@ max-parallelism=270 segment-costs=[2639871937] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=595(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=598(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=317.33M(filtered from 7.50G) cost=1697550487 + tuple-ids=0 row-size=36B cardinality=318.93M(filtered from 7.50G) cost=1706109565 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q47.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q47.test index 94e495985..e97c1b24f 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q47.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q47.test @@ -52,10 +52,10 @@ with v1 as( # end query 47 in stream 0 using template query47.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=242.12MB Threads=1 -Per-Host Resource Estimates: Memory=68.17GB +Per-Host Resource Estimates: Memory=3.87GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=68.17GB mem-reservation=242.12MB thread-reservation=1 runtime-filters-memory=9.00MB -| max-parallelism=1 segment-costs=[2013512693, 808510335, 2013512693, 808510335, 1027591587, 2013512693, 808510335, 3873619963801319, 700] +| Per-Instance Resources: mem-estimate=3.87GB mem-reservation=242.12MB thread-reservation=1 runtime-filters-memory=9.00MB +| max-parallelism=1 segment-costs=[1288791479, 12375158, 1288791479, 12375158, 15728442, 1288791479, 12375158, 12706053749, 700] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)), sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700 @@ -63,20 +63,20 @@ PLAN-ROOT SINK 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) ASC NULLS LAST | mem-estimate=8.89KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=91B cardinality=100 cost=3847329796939296 +| tuple-ids=49 row-size=91B cardinality=100 cost=12516167123 | in pipelines: 37(GETNEXT), 19(OPEN) | 36:HASH JOIN [INNER JOIN] | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.store_1.s_store_name = tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.store_1.s_company_name = tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none -| mem-estimate=2.33GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=145.06T cost=26285631925445 +| mem-estimate=35.55MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=752.84M cost=137200275 | in pipelines: 19(GETNEXT), 08(OPEN) | |--10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=16.25M cost=812616000 +| | tuple-ids=13,12 row-size=113B cardinality=248.76K cost=12438000 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -85,20 +85,20 @@ PLAN-ROOT SINK | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=13,12 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=15.89GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=249.11MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 08(GETNEXT), 07(OPEN) | | | 07:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=1.04GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=162.52M cost=1323281597 +| | tuple-ids=8 row-size=105B cardinality=2.49M cost=598560383 | | in pipelines: 07(GETNEXT), 00(OPEN) | | | 06:HASH JOIN [INNER JOIN] @@ -151,12 +151,13 @@ PLAN-ROOT SINK | | | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=99 cost=22886 | | in pipelines: 01(GETNEXT) @@ -170,7 +171,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 @@ -179,14 +180,14 @@ PLAN-ROOT SINK 35:HASH JOIN [INNER JOIN] | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.store_0.s_store_name = tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.store_0.s_company_name = tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=41.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=242B cardinality=6.17G cost=1121949378 +| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=242B cardinality=2.09M cost=446751 | in pipelines: 19(GETNEXT), 32(OPEN) | |--34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=262.22K cost=1300185600 +| | tuple-ids=47,42 row-size=129B cardinality=4.01K cost=19900800 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -194,13 +195,13 @@ PLAN-ROOT SINK | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=162.52M cost=162523200 +| | tuple-ids=47,42 row-size=129B cardinality=2.49M cost=2487600 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=17.10GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=113B cardinality=162.52M cost=865068387 +| | mem-estimate=268.08MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=113B cardinality=2.49M cost=13240842 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -209,20 +210,20 @@ PLAN-ROOT SINK | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=45,44 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=15.89GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=249.11MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 30(GETNEXT), 29(OPEN) | | | 29:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=1.04GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=162.52M cost=1323281597 +| | tuple-ids=38 row-size=105B cardinality=2.49M cost=598560383 | | in pipelines: 29(GETNEXT), 22(OPEN) | | | 28:HASH JOIN [INNER JOIN] @@ -275,12 +276,13 @@ PLAN-ROOT SINK | | | |--23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=12B cardinality=99 cost=22886 | | in pipelines: 23(GETNEXT) @@ -294,7 +296,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=30 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 @@ -303,7 +305,7 @@ PLAN-ROOT SINK 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=16.25M cost=812616000 +| tuple-ids=28,27 row-size=113B cardinality=248.76K cost=12438000 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -312,20 +314,20 @@ PLAN-ROOT SINK | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=162.52M cost=162523200 +| tuple-ids=28,27 row-size=113B cardinality=2.49M cost=2487600 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=15.89GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=105B cardinality=162.52M cost=808510335 +| mem-estimate=249.11MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=105B cardinality=2.49M cost=12375158 | in pipelines: 19(GETNEXT), 18(OPEN) | 18:AGGREGATE [FINALIZE] | output: sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_company_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=1.04GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=162.52M cost=1323281597 +| tuple-ids=23 row-size=105B cardinality=2.49M cost=598560383 | in pipelines: 18(GETNEXT), 11(OPEN) | 17:HASH JOIN [INNER JOIN] @@ -378,12 +380,13 @@ PLAN-ROOT SINK | |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=17 row-size=12B cardinality=99 cost=22886 | in pipelines: 12(GETNEXT) @@ -397,65 +400,65 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=15 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 in pipelines: 11(GETNEXT) ---- DISTRIBUTEDPLAN -Max Per-Host Resource Reservation: Memory=4.86GB Threads=121 -Per-Host Resource Estimates: Memory=30.78GB -F18:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 +Max Per-Host Resource Reservation: Memory=2.73GB Threads=92 +Per-Host Resource Estimates: Memory=19.10GB +F19:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.09MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[743] cpu-comparison-result=360 [max(1 (self) vs 360 (sum children))] +| max-parallelism=1 segment-costs=[743] cpu-comparison-result=318 [max(1 (self) vs 318 (sum children))] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)), sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700 | -58:MERGING-EXCHANGE [UNPARTITIONED] +59:MERGING-EXCHANGE [UNPARTITIONED] | order by: subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) ASC NULLS LAST | limit: 100 | mem-estimate=1.09MB mem-reservation=0B thread-reservation=0 | tuple-ids=49 row-size=91B cardinality=100 cost=43 | in pipelines: 37(GETNEXT) | -F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=162.40MB mem-reservation=16.00MB thread-reservation=1 -max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))] +F18:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=12.53MB mem-reservation=0B thread-reservation=1 +max-parallelism=1270 segment-costs=[12655909863, 269] cpu-comparison-result=318 [max(120 (self) vs 318 (sum children))] 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) ASC NULLS LAST | mem-estimate=8.89KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=91B cardinality=100 cost=3847329796939296 +| tuple-ids=49 row-size=91B cardinality=100 cost=12516167123 | in pipelines: 37(GETNEXT), 19(OPEN) | -36:HASH JOIN [INNER JOIN, BROADCAST] +36:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=00 | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.store_1.s_store_name = tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.store_1.s_company_name = tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=145.06T cost=26285615673125 +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=752.84M cost=136951515 | in pipelines: 19(GETNEXT), 08(OPEN) | -|--F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=2.35GB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[37851650] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +|--F20:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=5.80MB mem-reservation=1.94MB thread-reservation=1 +| | max-parallelism=1270 segment-costs=[414860] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: subtract(rank(), 1), tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.item.i_brand -| | mem-estimate=2.33GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=16252320 +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=248760 | | -| 57:EXCHANGE [BROADCAST] -| | mem-estimate=21.82MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=16.25M cost=21599330 +| 58:EXCHANGE [HASH(subtract(rank(), 1),tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.item.i_brand)] +| | mem-estimate=3.86MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=13,12 row-size=113B cardinality=248.76K cost=166100 | | in pipelines: 08(GETNEXT) | | -| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] hosts=10 instances=100 (adjusted from 120) -| Per-Instance Resources: mem-estimate=189.52MB mem-reservation=16.00MB thread-reservation=1 -| max-parallelism=100 segment-costs=[905067740, 980800022] cpu-comparison-result=120 [max(100 (self) vs 120 (sum children))] +| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=85.63MB mem-reservation=16.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[13853077, 16992249] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=16.25M cost=812616000 +| | tuple-ids=13,12 row-size=113B cardinality=248.76K cost=12438000 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -464,44 +467,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=13,12 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=162.75MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 08(GETNEXT), 55(OPEN) | | | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] -| | mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=162.52M cost=96557405 +| | mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=8 row-size=105B cardinality=2.49M cost=1477919 | | in pipelines: 55(GETNEXT) | | -| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=193.70MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 55:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy -| | mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=162.52M cost=1316893242 +| | mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=8 row-size=105B cardinality=2.49M cost=323464189 | | in pipelines: 55(GETNEXT), 00(OPEN) | | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=422.75M cost=251164608 +| | tuple-ids=8 row-size=105B cardinality=227.20M cost=134984381 | | in pipelines: 00(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 07:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=422.75M cost=2501738949 +| | tuple-ids=8 row-size=105B cardinality=227.20M cost=1616182260 | | in pipelines: 00(GETNEXT) | | | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -512,7 +515,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2,4,6 row-size=117B cardinality=427.40M cost=187074555 | | in pipelines: 00(GETNEXT), 05(OPEN) | | -| |--F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[3140] | | JOIN BUILD @@ -549,7 +552,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2,4 row-size=78B cardinality=427.40M cost=187129370 | | in pipelines: 00(GETNEXT), 03(OPEN) | | -| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -586,7 +589,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2 row-size=28B cardinality=427.62M cost=187168092 | | in pipelines: 00(GETNEXT), 01(OPEN) | | -| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -605,12 +608,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | max-parallelism=1 segment-costs=[22891] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=99 cost=22886 | | in pipelines: 01(GETNEXT) @@ -624,40 +628,48 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 | in pipelines: 00(GETNEXT) | +57:EXCHANGE [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] +| mem-estimate=12.52MB mem-reservation=0B thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=242B cardinality=2.09M cost=2791225 +| in pipelines: 19(GETNEXT) +| +F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 (adjusted from 120) +Per-Instance Resources: mem-estimate=149.85MB mem-reservation=16.00MB thread-reservation=1 +max-parallelism=10 segment-costs=[13853077, 52270199] cpu-comparison-result=198 [max(10 (self) vs 198 (sum children))] 35:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=04 | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.store_0.s_store_name = tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.store_0.s_company_name = tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=242B cardinality=6.17G cost=1121687162 +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=242B cardinality=2.09M cost=442737 | in pipelines: 19(GETNEXT), 32(OPEN) | -|--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=434.06MB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[610696] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +|--F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 +| | Per-Instance Resources: mem-estimate=3.77MB mem-reservation=1.94MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[9344] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=04 plan-id=05 cohort-id=01 | | build expressions: rank(), tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.item_1.i_brand -| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=262216 +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=4014 | | | 50:EXCHANGE [BROADCAST] -| | mem-estimate=26.06MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=262.22K cost=348480 +| | mem-estimate=1.83MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=47,42 row-size=129B cardinality=4.01K cost=5330 | | in pipelines: 32(GETNEXT) | | -| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=289.58MB mem-reservation=32.00MB thread-reservation=1 -| max-parallelism=150 segment-costs=[905067740, 1027591587, 1462811459] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=59.72MB mem-reservation=32.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[13853077, 15728442, 22389971] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=262.22K cost=1300185600 +| | tuple-ids=47,42 row-size=129B cardinality=4.01K cost=19900800 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -665,13 +677,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=162.52M cost=162523200 +| | tuple-ids=47,42 row-size=129B cardinality=2.49M cost=2487600 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=145.96MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=113B cardinality=162.52M cost=865068387 +| | mem-estimate=26.81MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=113B cardinality=2.49M cost=13240842 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -680,44 +692,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=45,44 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=135.62MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 30(GETNEXT), 48(OPEN) | | | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] -| | mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=162.52M cost=96557405 +| | mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=38 row-size=105B cardinality=2.49M cost=1477919 | | in pipelines: 48(GETNEXT) | | -| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=202.22MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 48:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy -| | mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=162.52M cost=1316893242 +| | mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=38 row-size=105B cardinality=2.49M cost=323464189 | | in pipelines: 48(GETNEXT), 22(OPEN) | | | 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] | | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=422.75M cost=251164608 +| | tuple-ids=38 row-size=105B cardinality=227.20M cost=134984381 | | in pipelines: 22(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 29:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=422.75M cost=2501738949 +| | tuple-ids=38 row-size=105B cardinality=227.20M cost=1616182260 | | in pipelines: 22(GETNEXT) | | | 28:HASH JOIN [INNER JOIN, BROADCAST] @@ -728,7 +740,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32,34,36 row-size=117B cardinality=427.40M cost=187074555 | | in pipelines: 22(GETNEXT), 27(OPEN) | | -| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[3140] | | JOIN BUILD @@ -765,7 +777,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32,34 row-size=78B cardinality=427.40M cost=187129370 | | in pipelines: 22(GETNEXT), 25(OPEN) | | -| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -802,7 +814,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32 row-size=28B cardinality=427.62M cost=187168092 | | in pipelines: 22(GETNEXT), 23(OPEN) | | -| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -821,12 +833,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | max-parallelism=1 segment-costs=[22891] | | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=12B cardinality=99 cost=22886 | | in pipelines: 23(GETNEXT) @@ -840,7 +853,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=30 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 @@ -849,7 +862,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=16.25M cost=812616000 +| tuple-ids=28,27 row-size=113B cardinality=248.76K cost=12438000 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -858,44 +871,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=162.52M cost=162523200 +| tuple-ids=28,27 row-size=113B cardinality=2.49M cost=2487600 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=135.62MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=105B cardinality=162.52M cost=808510335 +| mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=105B cardinality=2.49M cost=12375158 | in pipelines: 19(GETNEXT), 42(OPEN) | 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] -| mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=162.52M cost=96557405 +| mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| tuple-ids=23 row-size=105B cardinality=2.49M cost=1477919 | in pipelines: 42(GETNEXT) | -F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=202.22MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=50 (adjusted from 120) +Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] 42:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_company_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy -| mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=162.52M cost=1316893242 +| mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=23 row-size=105B cardinality=2.49M cost=323464189 | in pipelines: 42(GETNEXT), 11(OPEN) | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=422.75M cost=251164608 +| tuple-ids=23 row-size=105B cardinality=227.20M cost=134984381 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] 18:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_company_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=422.75M cost=2501738949 +| tuple-ids=23 row-size=105B cardinality=227.20M cost=1616182260 | in pipelines: 11(GETNEXT) | 17:HASH JOIN [INNER JOIN, BROADCAST] @@ -906,7 +919,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17,19,21 row-size=117B cardinality=427.40M cost=187074555 | in pipelines: 11(GETNEXT), 16(OPEN) | -|--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[3140] | JOIN BUILD @@ -943,7 +956,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17,19 row-size=78B cardinality=427.40M cost=187129370 | in pipelines: 11(GETNEXT), 14(OPEN) | -|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[838440] | JOIN BUILD @@ -980,7 +993,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17 row-size=28B cardinality=427.62M cost=187168092 | in pipelines: 11(GETNEXT), 12(OPEN) | -|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[229] | JOIN BUILD @@ -999,12 +1012,13 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | max-parallelism=1 segment-costs=[22891] | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=17 row-size=12B cardinality=99 cost=22886 | in pipelines: 12(GETNEXT) @@ -1018,65 +1032,65 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=15 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 in pipelines: 11(GETNEXT) ---- PARALLELPLANS -Max Per-Host Resource Reservation: Memory=4.86GB Threads=121 -Per-Host Resource Estimates: Memory=30.78GB -F18:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 +Max Per-Host Resource Reservation: Memory=2.73GB Threads=92 +Per-Host Resource Estimates: Memory=19.10GB +F19:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.09MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[743] cpu-comparison-result=360 [max(1 (self) vs 360 (sum children))] +| max-parallelism=1 segment-costs=[743] cpu-comparison-result=318 [max(1 (self) vs 318 (sum children))] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)), sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700 | -58:MERGING-EXCHANGE [UNPARTITIONED] +59:MERGING-EXCHANGE [UNPARTITIONED] | order by: subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) ASC NULLS LAST | limit: 100 | mem-estimate=1.09MB mem-reservation=0B thread-reservation=0 | tuple-ids=49 row-size=91B cardinality=100 cost=43 | in pipelines: 37(GETNEXT) | -F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=162.40MB mem-reservation=16.00MB thread-reservation=1 -max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))] +F18:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=12.53MB mem-reservation=0B thread-reservation=1 +max-parallelism=1270 segment-costs=[12655909863, 269] cpu-comparison-result=318 [max(120 (self) vs 318 (sum children))] 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) ASC NULLS LAST | mem-estimate=8.89KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=91B cardinality=100 cost=3847329796939296 +| tuple-ids=49 row-size=91B cardinality=100 cost=12516167123 | in pipelines: 37(GETNEXT), 19(OPEN) | -36:HASH JOIN [INNER JOIN, BROADCAST] +36:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=00 | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.store_1.s_store_name = tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.store_1.s_company_name = tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=145.06T cost=26285615673125 +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42,13,12 row-size=355B cardinality=752.84M cost=136951515 | in pipelines: 19(GETNEXT), 08(OPEN) | -|--F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=2.35GB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[37851650] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +|--F20:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=5.80MB mem-reservation=1.94MB thread-reservation=1 +| | max-parallelism=1270 segment-costs=[414860] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: subtract(rank(), 1), tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.item.i_brand -| | mem-estimate=2.33GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=16252320 +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=248760 | | -| 57:EXCHANGE [BROADCAST] -| | mem-estimate=21.82MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=16.25M cost=21599330 +| 58:EXCHANGE [HASH(subtract(rank(), 1),tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.item.i_brand)] +| | mem-estimate=3.86MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=13,12 row-size=113B cardinality=248.76K cost=166100 | | in pipelines: 08(GETNEXT) | | -| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] hosts=10 instances=100 (adjusted from 120) -| Per-Instance Resources: mem-estimate=189.52MB mem-reservation=16.00MB thread-reservation=1 -| max-parallelism=100 segment-costs=[905067740, 980800022] cpu-comparison-result=120 [max(100 (self) vs 120 (sum children))] +| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=85.63MB mem-reservation=16.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[13853077, 16992249] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=16.25M cost=812616000 +| | tuple-ids=13,12 row-size=113B cardinality=248.76K cost=12438000 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -1085,44 +1099,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=13,12 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=162.75MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 08(GETNEXT), 55(OPEN) | | | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name)] -| | mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=162.52M cost=96557405 +| | mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=8 row-size=105B cardinality=2.49M cost=1477919 | | in pipelines: 55(GETNEXT) | | -| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=193.70MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 55:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy -| | mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=162.52M cost=1316893242 +| | mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=8 row-size=105B cardinality=2.49M cost=323464189 | | in pipelines: 55(GETNEXT), 00(OPEN) | | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_company_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=422.75M cost=251164608 +| | tuple-ids=8 row-size=105B cardinality=227.20M cost=134984381 | | in pipelines: 00(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 07:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_company_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=105B cardinality=422.75M cost=2501738949 +| | tuple-ids=8 row-size=105B cardinality=227.20M cost=1616182260 | | in pipelines: 00(GETNEXT) | | | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -1133,7 +1147,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2,4,6 row-size=117B cardinality=427.40M cost=187074555 | | in pipelines: 00(GETNEXT), 05(OPEN) | | -| |--F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[3140] | | JOIN BUILD @@ -1170,7 +1184,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2,4 row-size=78B cardinality=427.40M cost=187129370 | | in pipelines: 00(GETNEXT), 03(OPEN) | | -| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -1207,7 +1221,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=0,2 row-size=28B cardinality=427.62M cost=187168092 | | in pipelines: 00(GETNEXT), 01(OPEN) | | -| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -1226,12 +1240,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | max-parallelism=1 segment-costs=[22891] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=99 cost=22886 | | in pipelines: 01(GETNEXT) @@ -1245,40 +1260,48 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=0 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 | in pipelines: 00(GETNEXT) | +57:EXCHANGE [HASH(rank(),tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] +| mem-estimate=12.52MB mem-reservation=0B thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=242B cardinality=2.09M cost=2791225 +| in pipelines: 19(GETNEXT) +| +F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 (adjusted from 120) +Per-Instance Resources: mem-estimate=149.85MB mem-reservation=16.00MB thread-reservation=1 +max-parallelism=10 segment-costs=[13853077, 52270199] cpu-comparison-result=198 [max(10 (self) vs 198 (sum children))] 35:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=04 | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.store_0.s_store_name = tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.store_0.s_company_name = tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=242B cardinality=6.17G cost=1121687162 +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=242B cardinality=2.09M cost=442737 | in pipelines: 19(GETNEXT), 32(OPEN) | -|--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=434.06MB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[610696] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +|--F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] hosts=10 instances=10 +| | Per-Instance Resources: mem-estimate=3.77MB mem-reservation=1.94MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[9344] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=04 plan-id=05 cohort-id=01 | | build expressions: rank(), tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.item_1.i_brand -| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=262216 +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=4014 | | | 50:EXCHANGE [BROADCAST] -| | mem-estimate=26.06MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=262.22K cost=348480 +| | mem-estimate=1.83MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=47,42 row-size=129B cardinality=4.01K cost=5330 | | in pipelines: 32(GETNEXT) | | -| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=289.58MB mem-reservation=32.00MB thread-reservation=1 -| max-parallelism=150 segment-costs=[905067740, 1027591587, 1462811459] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=59.72MB mem-reservation=32.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[13853077, 15728442, 22389971] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_1.s_store_name IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=262.22K cost=1300185600 +| | tuple-ids=47,42 row-size=129B cardinality=4.01K cost=19900800 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -1286,13 +1309,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=129B cardinality=162.52M cost=162523200 +| | tuple-ids=47,42 row-size=129B cardinality=2.49M cost=2487600 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=145.96MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=113B cardinality=162.52M cost=865068387 +| | mem-estimate=26.81MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=113B cardinality=2.49M cost=13240842 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -1301,44 +1324,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=113B cardinality=162.52M cost=162523200 +| | tuple-ids=45,44 row-size=113B cardinality=2.49M cost=2487600 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_1.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=135.62MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=105B cardinality=162.52M cost=808510335 +| | mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=105B cardinality=2.49M cost=12375158 | | in pipelines: 30(GETNEXT), 48(OPEN) | | | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name)] -| | mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=162.52M cost=96557405 +| | mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=38 row-size=105B cardinality=2.49M cost=1477919 | | in pipelines: 48(GETNEXT) | | -| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=202.22MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 48:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy -| | mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=162.52M cost=1316893242 +| | mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=38 row-size=105B cardinality=2.49M cost=323464189 | | in pipelines: 48(GETNEXT), 22(OPEN) | | | 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.store_1.s_store_name,tpcds_partitioned_parquet_snap.store_1.s_company_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] | | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=422.75M cost=251164608 +| | tuple-ids=38 row-size=105B cardinality=227.20M cost=134984381 | | in pipelines: 22(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -| max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 29:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales_1.ss_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.store_1.s_store_name, tpcds_partitioned_parquet_snap.store_1.s_company_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=105B cardinality=422.75M cost=2501738949 +| | tuple-ids=38 row-size=105B cardinality=227.20M cost=1616182260 | | in pipelines: 22(GETNEXT) | | | 28:HASH JOIN [INNER JOIN, BROADCAST] @@ -1349,7 +1372,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32,34,36 row-size=117B cardinality=427.40M cost=187074555 | | in pipelines: 22(GETNEXT), 27(OPEN) | | -| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[3140] | | JOIN BUILD @@ -1386,7 +1409,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32,34 row-size=78B cardinality=427.40M cost=187129370 | | in pipelines: 22(GETNEXT), 25(OPEN) | | -| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -1423,7 +1446,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | tuple-ids=30,32 row-size=28B cardinality=427.62M cost=187168092 | | in pipelines: 22(GETNEXT), 23(OPEN) | | -| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -1442,12 +1465,13 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | | max-parallelism=1 segment-costs=[22891] | | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=32 row-size=12B cardinality=99 cost=22886 | | in pipelines: 23(GETNEXT) @@ -1461,7 +1485,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_1.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=30 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 @@ -1470,7 +1494,7 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_company_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=16.25M cost=812616000 +| tuple-ids=28,27 row-size=113B cardinality=248.76K cost=12438000 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -1479,44 +1503,44 @@ max-parallelism=387361760 segment-costs=[905067740, 3873617509438783, 269] cpu-c | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=113B cardinality=162.52M cost=162523200 +| tuple-ids=28,27 row-size=113B cardinality=2.49M cost=2487600 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_store_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_0.s_company_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=135.62MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=105B cardinality=162.52M cost=808510335 +| mem-estimate=24.91MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=105B cardinality=2.49M cost=12375158 | in pipelines: 19(GETNEXT), 42(OPEN) | 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name)] -| mem-estimate=22.77MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=162.52M cost=96557405 +| mem-estimate=15.32MB mem-reservation=0B thread-reservation=0 +| tuple-ids=23 row-size=105B cardinality=2.49M cost=1477919 | in pipelines: 42(GETNEXT) | -F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=202.22MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=160 segment-costs=[1568057850, 1182747049] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] +F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=50 (adjusted from 120) +Per-Instance Resources: mem-estimate=383.23MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[458448570, 18103271] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] 42:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_company_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy -| mem-estimate=151.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=162.52M cost=1316893242 +| mem-estimate=362.70MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=23 row-size=105B cardinality=2.49M cost=323464189 | in pipelines: 42(GETNEXT), 11(OPEN) | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_company_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] | mem-estimate=20.54MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=422.75M cost=251164608 +| tuple-ids=23 row-size=105B cardinality=227.20M cost=134984381 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -Per-Instance Resources: mem-estimate=428.39MB mem-reservation=34.50MB thread-reservation=1 -max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +Per-Instance Resources: mem-estimate=398.58MB mem-reservation=34.50MB thread-reservation=1 +max-parallelism=99 segment-costs=[2305883460, 1653445199] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] 18:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_company_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=361.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=105B cardinality=422.75M cost=2501738949 +| tuple-ids=23 row-size=105B cardinality=227.20M cost=1616182260 | in pipelines: 11(GETNEXT) | 17:HASH JOIN [INNER JOIN, BROADCAST] @@ -1527,7 +1551,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17,19,21 row-size=117B cardinality=427.40M cost=187074555 | in pipelines: 11(GETNEXT), 16(OPEN) | -|--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.47MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[3140] | JOIN BUILD @@ -1564,7 +1588,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17,19 row-size=78B cardinality=427.40M cost=187129370 | in pipelines: 11(GETNEXT), 14(OPEN) | -|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[838440] | JOIN BUILD @@ -1601,7 +1625,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | tuple-ids=15,17 row-size=28B cardinality=427.62M cost=187168092 | in pipelines: 11(GETNEXT), 12(OPEN) | -|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[229] | JOIN BUILD @@ -1620,12 +1644,13 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= | max-parallelism=1 segment-costs=[22891] | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=17 row-size=12B cardinality=99 cost=22886 | in pipelines: 12(GETNEXT) @@ -1639,7 +1664,7 @@ max-parallelism=99 segment-costs=[3191440149, 3076555310] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=99(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=99(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=15 row-size=16B cardinality=427.62M(filtered from 7.88G) cost=128329183 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q48.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q48.test index 6d956fe36..a5b665eac 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q48.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q48.test @@ -176,7 +176,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -375,7 +375,7 @@ max-parallelism=130 segment-costs=[1297830471, 123] cpu-comparison-result=120 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -574,7 +574,7 @@ max-parallelism=130 segment-costs=[1297830471, 123] cpu-comparison-result=120 [m table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(25000 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(0 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q49.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q49.test index 97ddb8935..6cb4fa726 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q49.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q49.test @@ -249,7 +249,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -654,7 +654,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 @@ -1193,7 +1193,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_paid > CAST(0 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit > CAST(1 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.store_sales.ss_quantity > CAST(0 AS INT), tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q50.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q50.test index 0ef6e4403..04d3cfb65 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q50.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q50.test @@ -174,7 +174,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=24B cardinality=511.26M(filtered from 7.70G) cost=3778368929 @@ -390,7 +390,7 @@ max-parallelism=610 segment-costs=[6046483444, 2270017] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=24B cardinality=511.26M(filtered from 7.70G) cost=3778368929 @@ -606,7 +606,7 @@ max-parallelism=610 segment-costs=[6046483444, 2270017] cpu-comparison-result=12 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=24B cardinality=511.26M(filtered from 7.70G) cost=3778368929 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q51.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q51.test index d07ff1cf4..84fa35413 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q51.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q51.test @@ -120,13 +120,13 @@ PLAN-ROOT SINK | | | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 07(GETNEXT) @@ -178,13 +178,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 01(GETNEXT) @@ -198,7 +198,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1657367506 @@ -355,13 +355,13 @@ max-parallelism=41678410 segment-costs=[416784095283742] | | max-parallelism=1 segment-costs=[19174] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 07(GETNEXT) @@ -462,13 +462,13 @@ max-parallelism=1823 segment-costs=[53963028038, 17001010240] cpu-comparison-res | max-parallelism=1 segment-costs=[19174] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 01(GETNEXT) @@ -482,7 +482,7 @@ max-parallelism=1823 segment-costs=[53963028038, 17001010240] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1657367506 @@ -639,13 +639,13 @@ max-parallelism=41678410 segment-costs=[416784095283742] | | max-parallelism=1 segment-costs=[19174] | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 07(GETNEXT) @@ -746,13 +746,13 @@ max-parallelism=1823 segment-costs=[53963028038, 17001010240] cpu-comparison-res | max-parallelism=1 segment-costs=[19174] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1176 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1187 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1176 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 01(GETNEXT) @@ -766,7 +766,7 @@ max-parallelism=1823 segment-costs=[53963028038, 17001010240] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q52.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q52.test index ba8921669..86f83cb03 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q52.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q52.test @@ -95,7 +95,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -234,7 +234,7 @@ max-parallelism=30 segment-costs=[257966068, 16814826] cpu-comparison-result=30 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -373,7 +373,7 @@ max-parallelism=30 segment-costs=[257966068, 16814826] cpu-comparison-result=30 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q53.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q53.test index 91286e005..25c450c8b 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q53.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q53.test @@ -32,7 +32,7 @@ Max Per-Host Resource Reservation: Memory=15.25MB Threads=1 Per-Host Resource Estimates: Memory=77MB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=76.81MB mem-reservation=15.25MB thread-reservation=1 runtime-filters-memory=3.00MB -| max-parallelism=1 segment-costs=[1896962121, 5554, 9508, 300] +| max-parallelism=1 segment-costs=[1898260557, 5554, 9508, 300] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item.i_manufact_id, sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 @@ -67,7 +67,7 @@ PLAN-ROOT SINK | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manufact_id, tpcds_partitioned_parquet_snap.date_dim.d_qoy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=3.83K cost=475389 +| tuple-ids=8 row-size=24B cardinality=3.83K cost=476658 | in pipelines: 07(GETNEXT), 00(OPEN) | 06:HASH JOIN [INNER JOIN] @@ -75,19 +75,20 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=150296 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150712 | in pipelines: 00(GETNEXT), 05(OPEN) | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN] @@ -95,7 +96,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394802 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=395050 | in pipelines: 00(GETNEXT), 03(OPEN) | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -116,7 +117,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427679576 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427679824 | in pipelines: 00(GETNEXT), 01(OPEN) | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -140,10 +141,10 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=122.70MB Threads=21 @@ -197,29 +198,29 @@ max-parallelism=10 segment-costs=[6401, 9508, 125] cpu-comparison-result=120 [ma | in pipelines: 16(GETNEXT) | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_manufact_id,tpcds_partitioned_parquet_snap.date_dim.d_qoy)] hosts=10 instances=10 (adjusted from 120) -Per-Instance Resources: mem-estimate=13.82MB mem-reservation=1.94MB thread-reservation=1 -max-parallelism=10 segment-costs=[395683, 7888] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +Per-Instance Resources: mem-estimate=13.83MB mem-reservation=1.94MB thread-reservation=1 +max-parallelism=10 segment-costs=[396449, 7888] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] 16:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manufact_id, tpcds_partitioned_parquet_snap.date_dim.d_qoy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=3.83K cost=343161 +| tuple-ids=8 row-size=24B cardinality=3.83K cost=343821 | in pipelines: 16(GETNEXT), 00(OPEN) | 15:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_manufact_id,tpcds_partitioned_parquet_snap.date_dim.d_qoy)] -| mem-estimate=3.82MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=237.12K cost=52522 +| mem-estimate=3.83MB mem-reservation=0B thread-reservation=0 +| tuple-ids=8 row-size=24B cardinality=237.60K cost=52628 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB Per-Instance Resources: mem-estimate=27.09MB mem-reservation=2.50MB thread-reservation=1 -max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] +max-parallelism=190 segment-costs=[1899003175, 489646] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manufact_id, tpcds_partitioned_parquet_snap.date_dim.d_qoy | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=237.12K cost=1531852 +| tuple-ids=8 row-size=24B cardinality=237.60K cost=1535294 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -227,21 +228,21 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=149935 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150350 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[831] +| | max-parallelism=10 segment-costs=[842] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=361 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=362 | | | 14:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=361 cost=470 +| | tuple-ids=6 row-size=12B cardinality=362 cost=480 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -249,14 +250,15 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | max-parallelism=1 segment-costs=[16747] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -264,7 +266,7 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394725 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=394973 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -302,7 +304,7 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427678226 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427678474 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -343,10 +345,10 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=122.70MB Threads=21 @@ -400,29 +402,29 @@ max-parallelism=10 segment-costs=[6401, 9508, 125] cpu-comparison-result=120 [ma | in pipelines: 16(GETNEXT) | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_manufact_id,tpcds_partitioned_parquet_snap.date_dim.d_qoy)] hosts=10 instances=10 (adjusted from 120) -Per-Instance Resources: mem-estimate=13.82MB mem-reservation=1.94MB thread-reservation=1 -max-parallelism=10 segment-costs=[395683, 7888] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +Per-Instance Resources: mem-estimate=13.83MB mem-reservation=1.94MB thread-reservation=1 +max-parallelism=10 segment-costs=[396449, 7888] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] 16:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manufact_id, tpcds_partitioned_parquet_snap.date_dim.d_qoy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=3.83K cost=343161 +| tuple-ids=8 row-size=24B cardinality=3.83K cost=343821 | in pipelines: 16(GETNEXT), 00(OPEN) | 15:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_manufact_id,tpcds_partitioned_parquet_snap.date_dim.d_qoy)] -| mem-estimate=3.82MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=237.12K cost=52522 +| mem-estimate=3.83MB mem-reservation=0B thread-reservation=0 +| tuple-ids=8 row-size=24B cardinality=237.60K cost=52628 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB Per-Instance Resources: mem-estimate=27.09MB mem-reservation=2.50MB thread-reservation=1 -max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] +max-parallelism=190 segment-costs=[1899003175, 489646] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manufact_id, tpcds_partitioned_parquet_snap.date_dim.d_qoy | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=237.12K cost=1531852 +| tuple-ids=8 row-size=24B cardinality=237.60K cost=1535294 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -430,21 +432,21 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=149935 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150350 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[831] +| | max-parallelism=10 segment-costs=[842] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=361 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=362 | | | 14:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=361 cost=470 +| | tuple-ids=6 row-size=12B cardinality=362 cost=480 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -452,14 +454,15 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | max-parallelism=1 segment-costs=[16747] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1218 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1218 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -467,7 +470,7 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394725 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=394973 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -505,7 +508,7 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427678226 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427678474 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -546,9 +549,9 @@ max-parallelism=190 segment-costs=[1897702567, 488656] cpu-comparison-result=120 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q54.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q54.test index e40d2f9ec..65181e9fc 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q54.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q54.test @@ -331,7 +331,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1657367506 @@ -869,7 +869,7 @@ max-parallelism=1060 segment-costs=[10515440063, 340687519] cpu-comparison-resul table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1657367506 @@ -1407,7 +1407,7 @@ max-parallelism=1060 segment-costs=[10515440063, 340687519] cpu-comparison-resul table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q55.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q55.test index 7c29a24b2..fda91963a 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q55.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q55.test @@ -87,7 +87,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -226,7 +226,7 @@ max-parallelism=30 segment-costs=[257966068, 16814826] cpu-comparison-result=30 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 @@ -365,7 +365,7 @@ max-parallelism=30 segment-costs=[257966068, 16814826] cpu-comparison-result=30 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=83.07M(filtered from 8.25G) cost=98133602 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q56.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q56.test index bbfcd373c..b5c316462 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q56.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q56.test @@ -409,7 +409,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1035,7 +1035,7 @@ max-parallelism=60 segment-costs=[540745133, 13955253] cpu-comparison-result=60 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1661,7 +1661,7 @@ max-parallelism=60 segment-costs=[540745133, 13955253] cpu-comparison-result=60 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q57.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q57.test index 2aecb8f22..331694e07 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q57.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q57.test @@ -49,10 +49,10 @@ with v1 as( # end query 57 in stream 0 using template query57.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=241.38MB Threads=1 -Per-Host Resource Estimates: Memory=89.50GB +Per-Host Resource Estimates: Memory=7.31GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=89.50GB mem-reservation=241.38MB thread-reservation=1 runtime-filters-memory=9.00MB -| max-parallelism=1 segment-costs=[2468214794, 1057473926, 2468214794, 1057473926, 1369051625, 2468214794, 1057473926, 11501571650518743, 900] +| Per-Instance Resources: mem-estimate=7.31GB mem-reservation=241.38MB thread-reservation=1 runtime-filters-memory=9.00MB +| max-parallelism=1 segment-costs=[1447403535, 26175892, 1447403535, 26175892, 33888447, 1447403535, 26175892, 117427775370, 900] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)), sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900 @@ -60,20 +60,20 @@ PLAN-ROOT SINK 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) ASC NULLS LAST | mem-estimate=14.04KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=144B cardinality=100 cost=11425952643690532 +| tuple-ids=49 row-size=144B cardinality=100 cost=116173968123 | in pipelines: 37(GETNEXT), 19(OPEN) | 36:HASH JOIN [INNER JOIN] | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.call_center_1.cc_name = tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none -| mem-estimate=3.33GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=417.27T cost=75612579635678 +| mem-estimate=74.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=6.33G cost=1149279660 | in pipelines: 19(GETNEXT), 08(OPEN) | |--10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=23.11M cost=924563072 +| | tuple-ids=13,12 row-size=104B cardinality=572.15K cost=22885920 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -82,20 +82,20 @@ PLAN-ROOT SINK | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=13,12 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=20.63GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=522.80MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 08(GETNEXT), 07(OPEN) | | | 07:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=1.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=8 row-size=96B cardinality=5.72M cost=343520255 | | in pipelines: 07(GETNEXT), 00(OPEN) | | | 06:HASH JOIN [INNER JOIN] @@ -128,12 +128,13 @@ PLAN-ROOT SINK | | | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=12B cardinality=99 cost=22886 | | in pipelines: 03(GETNEXT) @@ -176,14 +177,14 @@ PLAN-ROOT SINK 35:HASH JOIN [INNER JOIN] | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.call_center_0.cc_name = tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=57.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=224B cardinality=12.47G cost=2266658677 +| mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=224B cardinality=7.64M cost=1540947 | in pipelines: 19(GETNEXT), 32(OPEN) | |--34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_1.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=372.92K cost=1617985408 +| | tuple-ids=47,42 row-size=120B cardinality=9.23K cost=40050360 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -191,13 +192,13 @@ PLAN-ROOT SINK | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=231.14M cost=231140768 +| | tuple-ids=47,42 row-size=120B cardinality=5.72M cost=5721480 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=22.35GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=104B cardinality=231.14M cost=1137910857 +| | mem-estimate=566.46MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=104B cardinality=5.72M cost=28166967 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -206,20 +207,20 @@ PLAN-ROOT SINK | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=45,44 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=20.63GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=522.80MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 30(GETNEXT), 29(OPEN) | | | 29:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=1.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=38 row-size=96B cardinality=5.72M cost=343520255 | | in pipelines: 29(GETNEXT), 22(OPEN) | | | 28:HASH JOIN [INNER JOIN] @@ -252,12 +253,13 @@ PLAN-ROOT SINK | | | |--25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=34 row-size=12B cardinality=99 cost=22886 | | in pipelines: 25(GETNEXT) @@ -300,7 +302,7 @@ PLAN-ROOT SINK 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_0.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=23.11M cost=924563072 +| tuple-ids=28,27 row-size=104B cardinality=572.15K cost=22885920 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -309,20 +311,20 @@ PLAN-ROOT SINK | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=231.14M cost=231140768 +| tuple-ids=28,27 row-size=104B cardinality=5.72M cost=5721480 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_0.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=20.63GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=96B cardinality=231.14M cost=1057473926 +| mem-estimate=522.80MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=96B cardinality=5.72M cost=26175892 | in pipelines: 19(GETNEXT), 18(OPEN) | 18:AGGREGATE [FINALIZE] | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.call_center_0.cc_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=1.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=1364331514 +| tuple-ids=23 row-size=96B cardinality=5.72M cost=343520255 | in pipelines: 18(GETNEXT), 11(OPEN) | 17:HASH JOIN [INNER JOIN] @@ -355,12 +357,13 @@ PLAN-ROOT SINK | |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=19 row-size=12B cardinality=99 cost=22886 | in pipelines: 14(GETNEXT) @@ -400,11 +403,11 @@ PLAN-ROOT SINK tuple-ids=15 row-size=16B cardinality=231.26M(filtered from 4.28G) cost=66611022 in pipelines: 11(GETNEXT) ---- DISTRIBUTEDPLAN -Max Per-Host Resource Reservation: Memory=4.73GB Threads=117 -Per-Host Resource Estimates: Memory=29.44GB +Max Per-Host Resource Reservation: Memory=3.30GB Threads=80 +Per-Host Resource Estimates: Memory=14.94GB F18:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.69MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[954] cpu-comparison-result=340 [max(1 (self) vs 340 (sum children))] +| max-parallelism=1 segment-costs=[954] cpu-comparison-result=297 [max(1 (self) vs 297 (sum children))] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)), sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900 @@ -417,12 +420,12 @@ PLAN-ROOT SINK | in pipelines: 37(GETNEXT) | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=200.73MB mem-reservation=16.00MB thread-reservation=1 -max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cpu-comparison-result=340 [max(120 (self) vs 340 (sum children))] +Per-Instance Resources: mem-estimate=30.87MB mem-reservation=16.00MB thread-reservation=1 +max-parallelism=11740 segment-costs=[29333266, 117352814751, 408] cpu-comparison-result=297 [max(120 (self) vs 297 (sum children))] 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) ASC NULLS LAST | mem-estimate=14.04KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=144B cardinality=100 cost=11425952643690532 +| tuple-ids=49 row-size=144B cardinality=100 cost=116173968123 | in pipelines: 37(GETNEXT), 19(OPEN) | 36:HASH JOIN [INNER JOIN, BROADCAST] @@ -430,29 +433,29 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.call_center_1.cc_name = tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=417.27T cost=75612556521601 +| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=6.33G cost=1148707512 | in pipelines: 19(GETNEXT), 08(OPEN) | |--F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=3.35GB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[53832677] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +| | Per-Instance Resources: mem-estimate=419.09MB mem-reservation=408.00MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[1332528] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: subtract(rank(), 1), tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.item.i_brand -| | mem-estimate=3.33GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=23114077 +| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=572148 | | | 57:EXCHANGE [BROADCAST] -| | mem-estimate=19.83MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=23.11M cost=30718600 +| | mem-estimate=11.09MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=13,12 row-size=104B cardinality=572.15K cost=760380 | | in pipelines: 08(GETNEXT) | | -| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] hosts=10 instances=90 (adjusted from 120) -| Per-Instance Resources: mem-estimate=259.40MB mem-reservation=16.00MB thread-reservation=1 -| max-parallelism=120 segment-costs=[1185027961, 1163181210] cpu-comparison-result=110 [max(90 (self) vs 110 (sum children))] +| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=71.15MB mem-reservation=16.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[29333266, 28792489] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=23.11M cost=924563072 +| | tuple-ids=13,12 row-size=104B cardinality=572.15K cost=22885920 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -461,44 +464,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=13,12 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=234.67MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=52.28MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 08(GETNEXT), 55(OPEN) | | | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] -| | mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=127554035 +| | mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=8 row-size=96B cardinality=5.72M cost=3157374 | | in pipelines: 55(GETNEXT) | | -| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=251.14MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=423.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 55:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy -| | mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=1364331514 +| | mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=8 row-size=96B cardinality=5.72M cost=295584487 | | in pipelines: 55(GETNEXT), 00(OPEN) | | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=127554035 +| | tuple-ids=8 row-size=96B cardinality=196.26M cost=108302782 | | in pipelines: 00(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -| max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 07:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=8 row-size=96B cardinality=196.26M cost=1206353836 | | in pipelines: 00(GETNEXT) | | | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -565,12 +568,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | max-parallelism=1 segment-costs=[22891] | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=12B cardinality=99 cost=22886 | | in pipelines: 03(GETNEXT) @@ -631,30 +635,30 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | hash-table-id=04 | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.call_center_0.cc_name = tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=224B cardinality=12.47G cost=2266285753 +| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=224B cardinality=7.64M cost=1531716 | in pipelines: 19(GETNEXT), 32(OPEN) | |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=432.98MB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[868534] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +| | Per-Instance Resources: mem-estimate=36.80MB mem-reservation=34.50MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[21491] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=04 plan-id=05 cohort-id=01 | | build expressions: rank(), tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.item_1.i_brand -| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=372924 +| | mem-estimate=34.50MB mem-reservation=34.50MB spill-buffer=128.00KB thread-reservation=0 cost=9231 | | | 50:EXCHANGE [BROADCAST] -| | mem-estimate=24.98MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=372.92K cost=495610 +| | mem-estimate=2.30MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=47,42 row-size=120B cardinality=9.23K cost=12260 | | in pipelines: 32(GETNEXT) | | -| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=374.71MB mem-reservation=32.00MB thread-reservation=1 -| max-parallelism=190 segment-costs=[1185027961, 1369051625, 1849262926] cpu-comparison-result=120 [max(120 (self) vs 110 (sum children))] +| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=116.93MB mem-reservation=32.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[29333266, 33888447, 45775224] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_1.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=372.92K cost=1617985408 +| | tuple-ids=47,42 row-size=120B cardinality=9.23K cost=40050360 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -662,13 +666,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=231.14M cost=231140768 +| | tuple-ids=47,42 row-size=120B cardinality=5.72M cost=5721480 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=190.70MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=104B cardinality=231.14M cost=1137910857 +| | mem-estimate=56.65MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=104B cardinality=5.72M cost=28166967 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -677,44 +681,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=45,44 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=176.01MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=52.28MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 30(GETNEXT), 48(OPEN) | | | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] -| | mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=127554035 +| | mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=38 row-size=96B cardinality=5.72M cost=3157374 | | in pipelines: 48(GETNEXT) | | -| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=262.84MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=423.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 48:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy -| | mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=1364331514 +| | mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=38 row-size=96B cardinality=5.72M cost=295584487 | | in pipelines: 48(GETNEXT), 22(OPEN) | | | 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] | | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=127554035 +| | tuple-ids=38 row-size=96B cardinality=196.26M cost=108302782 | | in pipelines: 22(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -| max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 29:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=38 row-size=96B cardinality=196.26M cost=1206353836 | | in pipelines: 22(GETNEXT) | | | 28:HASH JOIN [INNER JOIN, BROADCAST] @@ -781,12 +785,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | max-parallelism=1 segment-costs=[22891] | | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=34 row-size=12B cardinality=99 cost=22886 | | in pipelines: 25(GETNEXT) @@ -846,7 +851,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_0.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=23.11M cost=924563072 +| tuple-ids=28,27 row-size=104B cardinality=572.15K cost=22885920 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -855,44 +860,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=231.14M cost=231140768 +| tuple-ids=28,27 row-size=104B cardinality=5.72M cost=5721480 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_0.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=176.01MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=96B cardinality=231.14M cost=1057473926 +| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=96B cardinality=5.72M cost=26175892 | in pipelines: 19(GETNEXT), 42(OPEN) | 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] -| mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=127554035 +| mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| tuple-ids=23 row-size=96B cardinality=5.72M cost=3157374 | in pipelines: 42(GETNEXT) | -F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=110 (adjusted from 120) -Per-Instance Resources: mem-estimate=262.84MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=50 (adjusted from 120) +Per-Instance Resources: mem-estimate=450.37MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] 42:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.call_center_0.cc_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy -| mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=1364331514 +| mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=23 row-size=96B cardinality=5.72M cost=295584487 | in pipelines: 42(GETNEXT), 11(OPEN) | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=127554035 +| tuple-ids=23 row-size=96B cardinality=196.26M cost=108302782 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] 18:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.call_center_0.cc_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=1364331514 +| tuple-ids=23 row-size=96B cardinality=196.26M cost=1206353836 | in pipelines: 11(GETNEXT) | 17:HASH JOIN [INNER JOIN, BROADCAST] @@ -959,12 +964,13 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= | max-parallelism=1 segment-costs=[22891] | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=19 row-size=12B cardinality=99 cost=22886 | in pipelines: 14(GETNEXT) @@ -1021,59 +1027,59 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= tuple-ids=15 row-size=16B cardinality=231.26M(filtered from 4.28G) cost=66611022 in pipelines: 11(GETNEXT) ---- PARALLELPLANS -Max Per-Host Resource Reservation: Memory=4.73GB Threads=117 -Per-Host Resource Estimates: Memory=29.44GB -F18:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 +Max Per-Host Resource Reservation: Memory=2.74GB Threads=93 +Per-Host Resource Estimates: Memory=14.60GB +F19:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=5.69MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[954] cpu-comparison-result=340 [max(1 (self) vs 340 (sum children))] +| max-parallelism=1 segment-costs=[954] cpu-comparison-result=318 [max(1 (self) vs 318 (sum children))] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)), sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900 | -58:MERGING-EXCHANGE [UNPARTITIONED] +59:MERGING-EXCHANGE [UNPARTITIONED] | order by: subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) ASC NULLS LAST | limit: 100 | mem-estimate=1.69MB mem-reservation=0B thread-reservation=0 | tuple-ids=49 row-size=144B cardinality=100 cost=54 | in pipelines: 37(GETNEXT) | -F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=200.73MB mem-reservation=16.00MB thread-reservation=1 -max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cpu-comparison-result=340 [max(120 (self) vs 340 (sum children))] +F18:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=14.69MB mem-reservation=0B thread-reservation=1 +max-parallelism=11740 segment-costs=[117332231182, 408] cpu-comparison-result=318 [max(120 (self) vs 318 (sum children))] 37:TOP-N [LIMIT=100] | order by: subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ASC NULLS LAST, avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) ASC NULLS LAST | mem-estimate=14.04KB mem-reservation=0B thread-reservation=0 -| tuple-ids=49 row-size=144B cardinality=100 cost=11425952643690532 +| tuple-ids=49 row-size=144B cardinality=100 cost=116173968123 | in pipelines: 37(GETNEXT), 19(OPEN) | -36:HASH JOIN [INNER JOIN, BROADCAST] +36:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=00 | hash predicates: rank() = subtract(rank(), 1), tpcds_partitioned_parquet_snap.item_1.i_category = tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.call_center_1.cc_name = tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.item_1.i_brand = tpcds_partitioned_parquet_snap.item.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=417.27T cost=75612556521601 +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=28,27,47,42,13,12 row-size=327B cardinality=6.33G cost=1148707512 | in pipelines: 19(GETNEXT), 08(OPEN) | -|--F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=3.35GB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[53832677] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))] +|--F20:PLAN FRAGMENT [HASH(rank(),tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=8.69MB mem-reservation=1.94MB thread-reservation=1 +| | max-parallelism=11740 segment-costs=[929995] cpu-comparison-result=120 [max(120 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: subtract(rank(), 1), tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.item.i_brand -| | mem-estimate=3.33GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=23114077 +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=572148 | | -| 57:EXCHANGE [BROADCAST] -| | mem-estimate=19.83MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=23.11M cost=30718600 +| 58:EXCHANGE [HASH(subtract(rank(), 1),tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.item.i_brand)] +| | mem-estimate=6.76MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=13,12 row-size=104B cardinality=572.15K cost=357847 | | in pipelines: 08(GETNEXT) | | -| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] hosts=10 instances=90 (adjusted from 120) -| Per-Instance Resources: mem-estimate=259.40MB mem-reservation=16.00MB thread-reservation=1 -| max-parallelism=120 segment-costs=[1185027961, 1163181210] cpu-comparison-result=110 [max(90 (self) vs 110 (sum children))] +| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=108.69MB mem-reservation=16.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[29333266, 33022116] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 10:SELECT | | predicates: subtract(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=23.11M cost=924563072 +| | tuple-ids=13,12 row-size=104B cardinality=572.15K cost=22885920 | | in pipelines: 08(GETNEXT) | | | 09:ANALYTIC @@ -1082,44 +1088,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | order by: tpcds_partitioned_parquet_snap.date_dim.d_year ASC, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13,12 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=13,12 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 08(GETNEXT) | | | 08:SORT | | order by: tpcds_partitioned_parquet_snap.item.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim.d_moy ASC NULLS LAST -| | mem-estimate=234.67MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=52.28MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=13 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 08(GETNEXT), 55(OPEN) | | | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name)] -| | mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=127554035 +| | mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=8 row-size=96B cardinality=5.72M cost=3157374 | | in pipelines: 55(GETNEXT) | | -| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=251.14MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +| F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=423.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 55:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy -| | mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=1364331514 +| | mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=8 row-size=96B cardinality=5.72M cost=295584487 | | in pipelines: 55(GETNEXT), 00(OPEN) | | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_category,tpcds_partitioned_parquet_snap.item.i_brand,tpcds_partitioned_parquet_snap.call_center.cc_name,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=127554035 +| | tuple-ids=8 row-size=96B cardinality=196.26M cost=108302782 | | in pipelines: 00(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -| max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 07:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item.i_category, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.call_center.cc_name, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim.d_moy | | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=8 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=8 row-size=96B cardinality=196.26M cost=1206353836 | | in pipelines: 00(GETNEXT) | | | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -1130,7 +1136,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=0,2,4,6 row-size=108B cardinality=231.14M cost=101199959 | | in pipelines: 00(GETNEXT), 05(OPEN) | | -| |--F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -1167,7 +1173,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=0,2,4 row-size=58B cardinality=231.26M cost=101220900 | | in pipelines: 00(GETNEXT), 03(OPEN) | | -| |--F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -1186,12 +1192,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | max-parallelism=1 segment-costs=[22891] | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=4 row-size=12B cardinality=99 cost=22886 | | in pipelines: 03(GETNEXT) @@ -1204,7 +1211,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=0,2 row-size=46B cardinality=231.26M(filtered from 4.28G) cost=834323120 | | in pipelines: 00(GETNEXT), 01(OPEN) | | -| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[108] | | JOIN BUILD @@ -1248,34 +1255,42 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | tuple-ids=0 row-size=16B cardinality=231.26M(filtered from 4.28G) cost=66611022 | in pipelines: 00(GETNEXT) | +57:EXCHANGE [HASH(rank(),tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.item_1.i_brand)] +| mem-estimate=14.68MB mem-reservation=0B thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=224B cardinality=7.64M cost=9555547 +| in pipelines: 19(GETNEXT) +| +F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=20 (adjusted from 120) +Per-Instance Resources: mem-estimate=142.47MB mem-reservation=16.00MB thread-reservation=1 +max-parallelism=20 segment-costs=[29333266, 155966254] cpu-comparison-result=198 [max(20 (self) vs 198 (sum children))] 35:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=04 | hash predicates: add(rank(), 1) = rank(), tpcds_partitioned_parquet_snap.item_0.i_category = tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.call_center_0.cc_name = tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.item_0.i_brand = tpcds_partitioned_parquet_snap.item_1.i_brand | fk/pk conjuncts: none -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27,47,42 row-size=224B cardinality=12.47G cost=2266285753 +| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 +| tuple-ids=28,27,47,42 row-size=224B cardinality=7.64M cost=1531716 | in pipelines: 19(GETNEXT), 32(OPEN) | -|--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=432.98MB mem-reservation=408.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[868534] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +|--F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] hosts=10 instances=10 +| | Per-Instance Resources: mem-estimate=8.05MB mem-reservation=5.75MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[21491] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | JOIN BUILD | | join-table-id=04 plan-id=05 cohort-id=01 | | build expressions: rank(), tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.item_1.i_brand -| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=372924 +| | mem-estimate=5.75MB mem-reservation=5.75MB spill-buffer=128.00KB thread-reservation=0 cost=9231 | | | 50:EXCHANGE [BROADCAST] -| | mem-estimate=24.98MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=372.92K cost=495610 +| | mem-estimate=2.30MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=47,42 row-size=120B cardinality=9.23K cost=12260 | | in pipelines: 32(GETNEXT) | | -| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=374.71MB mem-reservation=32.00MB thread-reservation=1 -| max-parallelism=190 segment-costs=[1185027961, 1369051625, 1849262926] cpu-comparison-result=120 [max(120 (self) vs 110 (sum children))] +| F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] hosts=10 instances=10 (adjusted from 120) +| Per-Instance Resources: mem-estimate=116.93MB mem-reservation=32.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[29333266, 33888447, 45775224] cpu-comparison-result=99 [max(10 (self) vs 99 (sum children))] | 34:SELECT | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), CASE WHEN avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN divide(abs(subtract(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)))), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price))) ELSE NULL END > CAST(0.1 AS DECIMAL(2,1)), avg(sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price)) > CAST(0 AS DECIMAL(3,0)), rank() IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_1.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_1.i_category IS NOT NULL | | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=372.92K cost=1617985408 +| | tuple-ids=47,42 row-size=120B cardinality=9.23K cost=40050360 | | in pipelines: 32(GETNEXT) | | | 33:ANALYTIC @@ -1283,13 +1298,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | partition by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47,42 row-size=120B cardinality=231.14M cost=231140768 +| | tuple-ids=47,42 row-size=120B cardinality=5.72M cost=5721480 | | in pipelines: 32(GETNEXT) | | | 32:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST -| | mem-estimate=190.70MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=47 row-size=104B cardinality=231.14M cost=1137910857 +| | mem-estimate=56.65MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=47 row-size=104B cardinality=5.72M cost=28166967 | | in pipelines: 32(GETNEXT), 30(OPEN) | | | 31:ANALYTIC @@ -1298,44 +1313,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | order by: tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC | | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45,44 row-size=104B cardinality=231.14M cost=231140768 +| | tuple-ids=45,44 row-size=104B cardinality=5.72M cost=5721480 | | in pipelines: 30(GETNEXT) | | | 30:SORT | | order by: tpcds_partitioned_parquet_snap.item_1.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_1.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_1.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_1.d_moy ASC NULLS LAST -| | mem-estimate=176.01MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=45 row-size=96B cardinality=231.14M cost=1057473926 +| | mem-estimate=52.28MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=45 row-size=96B cardinality=5.72M cost=26175892 | | in pipelines: 30(GETNEXT), 48(OPEN) | | | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name)] -| | mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=127554035 +| | mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=38 row-size=96B cardinality=5.72M cost=3157374 | | in pipelines: 48(GETNEXT) | | -| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=262.84MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] hosts=10 instances=50 (adjusted from 120) +| Per-Instance Resources: mem-estimate=423.23MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] | 48:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy -| | mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=1364331514 +| | mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=38 row-size=96B cardinality=5.72M cost=295584487 | | in pipelines: 48(GETNEXT), 22(OPEN) | | | 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_1.i_category,tpcds_partitioned_parquet_snap.item_1.i_brand,tpcds_partitioned_parquet_snap.call_center_1.cc_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year,tpcds_partitioned_parquet_snap.date_dim_1.d_moy)] | | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=127554035 +| | tuple-ids=38 row-size=96B cardinality=196.26M cost=108302782 | | in pipelines: 22(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -| Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -| max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +| Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +| max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] | 29:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sales_price) | | group by: tpcds_partitioned_parquet_snap.item_1.i_category, tpcds_partitioned_parquet_snap.item_1.i_brand, tpcds_partitioned_parquet_snap.call_center_1.cc_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year, tpcds_partitioned_parquet_snap.date_dim_1.d_moy | | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=38 row-size=96B cardinality=231.14M cost=1364331514 +| | tuple-ids=38 row-size=96B cardinality=196.26M cost=1206353836 | | in pipelines: 22(GETNEXT) | | | 28:HASH JOIN [INNER JOIN, BROADCAST] @@ -1346,7 +1361,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=30,32,34,36 row-size=108B cardinality=231.14M cost=101199959 | | in pipelines: 22(GETNEXT), 27(OPEN) | | -| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[838440] | | JOIN BUILD @@ -1383,7 +1398,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=30,32,34 row-size=58B cardinality=231.26M cost=101220900 | | in pipelines: 22(GETNEXT), 25(OPEN) | | -| |--F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[229] | | JOIN BUILD @@ -1402,12 +1417,13 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | max-parallelism=1 segment-costs=[22891] | | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=34 row-size=12B cardinality=99 cost=22886 | | in pipelines: 25(GETNEXT) @@ -1420,7 +1436,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | | tuple-ids=30,32 row-size=46B cardinality=231.26M(filtered from 4.28G) cost=834323120 | | in pipelines: 22(GETNEXT), 23(OPEN) | | -| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[108] | | JOIN BUILD @@ -1467,7 +1483,7 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp 21:SELECT | predicates: add(rank(), CAST(1 AS BIGINT)) IS NOT NULL, tpcds_partitioned_parquet_snap.call_center_0.cc_name IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_brand IS NOT NULL, tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL | mem-estimate=0B mem-reservation=0B thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=23.11M cost=924563072 +| tuple-ids=28,27 row-size=104B cardinality=572.15K cost=22885920 | in pipelines: 19(GETNEXT) | 20:ANALYTIC @@ -1476,44 +1492,44 @@ max-parallelism=1150156870 segment-costs=[1185027961, 11501568622201726, 408] cp | order by: tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC | window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28,27 row-size=104B cardinality=231.14M cost=231140768 +| tuple-ids=28,27 row-size=104B cardinality=5.72M cost=5721480 | in pipelines: 19(GETNEXT) | 19:SORT | order by: tpcds_partitioned_parquet_snap.item_0.i_category ASC NULLS LAST, tpcds_partitioned_parquet_snap.item_0.i_brand ASC NULLS LAST, tpcds_partitioned_parquet_snap.call_center_0.cc_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_year ASC NULLS LAST, tpcds_partitioned_parquet_snap.date_dim_0.d_moy ASC NULLS LAST -| mem-estimate=176.01MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=28 row-size=96B cardinality=231.14M cost=1057473926 +| mem-estimate=26.14MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=28 row-size=96B cardinality=5.72M cost=26175892 | in pipelines: 19(GETNEXT), 42(OPEN) | 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name)] -| mem-estimate=20.72MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=127554035 +| mem-estimate=14.87MB mem-reservation=0B thread-reservation=0 +| tuple-ids=23 row-size=96B cardinality=5.72M cost=3157374 | in pipelines: 42(GETNEXT) | -F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=110 (adjusted from 120) -Per-Instance Resources: mem-estimate=262.84MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=160 segment-costs=[1491885549, 1545323864] cpu-comparison-result=110 [max(110 (self) vs 99 (sum children))] +F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] hosts=10 instances=50 (adjusted from 120) +Per-Instance Resources: mem-estimate=423.23MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=50 segment-costs=[403887269, 38251752] cpu-comparison-result=99 [max(50 (self) vs 99 (sum children))] 42:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.call_center_0.cc_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy -| mem-estimate=216.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=1364331514 +| mem-estimate=403.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=23 row-size=96B cardinality=5.72M cost=295584487 | in pipelines: 42(GETNEXT), 11(OPEN) | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category,tpcds_partitioned_parquet_snap.item_0.i_brand,tpcds_partitioned_parquet_snap.call_center_0.cc_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_moy)] | mem-estimate=19.65MB mem-reservation=0B thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=127554035 +| tuple-ids=23 row-size=96B cardinality=196.26M cost=108302782 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=99 (adjusted from 120) Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB -Per-Instance Resources: mem-estimate=238.93MB mem-reservation=34.25MB thread-reservation=1 -max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] +Per-Instance Resources: mem-estimate=215.54MB mem-reservation=34.25MB thread-reservation=1 +max-parallelism=99 segment-costs=[2309708837, 1312093920] cpu-comparison-result=99 [max(99 (self) vs 36 (sum children))] 18:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sales_price) | group by: tpcds_partitioned_parquet_snap.item_0.i_category, tpcds_partitioned_parquet_snap.item_0.i_brand, tpcds_partitioned_parquet_snap.call_center_0.cc_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_moy | mem-estimate=180.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=23 row-size=96B cardinality=231.14M cost=1364331514 +| tuple-ids=23 row-size=96B cardinality=196.26M cost=1206353836 | in pipelines: 11(GETNEXT) | 17:HASH JOIN [INNER JOIN, BROADCAST] @@ -1524,7 +1540,7 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= | tuple-ids=15,17,19,21 row-size=108B cardinality=231.14M cost=101199959 | in pipelines: 11(GETNEXT), 16(OPEN) | -|--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=351.21MB mem-reservation=341.00MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[838440] | JOIN BUILD @@ -1561,7 +1577,7 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= | tuple-ids=15,17,19 row-size=58B cardinality=231.26M cost=101220900 | in pipelines: 11(GETNEXT), 14(OPEN) | -|--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[229] | JOIN BUILD @@ -1580,12 +1596,13 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= | max-parallelism=1 segment-costs=[22891] | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2001 AS INT), CAST(2002 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(12 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_moy IN (CAST(1 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=19 row-size=12B cardinality=99 cost=22886 | in pipelines: 14(GETNEXT) @@ -1598,7 +1615,7 @@ max-parallelism=99 segment-costs=[2467686515, 1545323864] cpu-comparison-result= | tuple-ids=15,17 row-size=46B cardinality=231.26M(filtered from 4.28G) cost=834323120 | in pipelines: 11(GETNEXT), 12(OPEN) | -|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +|--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[108] | JOIN BUILD diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q58.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q58.test index fdaa7cf26..90b76610d 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q58.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q58.test @@ -315,7 +315,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=22 row-size=12B cardinality=8.25G(filtered from 8.25G) cost=1657367506 @@ -902,7 +902,7 @@ max-parallelism=10 segment-costs=[619079, 334246, 230] cpu-comparison-result=360 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=22 row-size=12B cardinality=8.25G(filtered from 8.25G) cost=1657367506 @@ -1585,7 +1585,7 @@ max-parallelism=10 segment-costs=[619079, 334246, 230] cpu-comparison-result=360 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=22 row-size=12B cardinality=8.25G(filtered from 8.25G) cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q59.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q59.test index f76cb8747..ca7b1f1f6 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q59.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q59.test @@ -77,13 +77,13 @@ PLAN-ROOT SINK | | | |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) @@ -125,7 +125,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=11 row-size=12B cardinality=7.88G cost=1657367506 @@ -183,14 +183,14 @@ PLAN-ROOT SINK | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF001[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 04(GETNEXT) @@ -232,7 +232,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.88G cost=1657367506 @@ -315,13 +315,13 @@ max-parallelism=33390 segment-costs=[333884764381, 743] cpu-comparison-result=27 | | max-parallelism=1 segment-costs=[14888] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) @@ -397,7 +397,7 @@ max-parallelism=33390 segment-costs=[333884764381, 743] cpu-comparison-result=27 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=11 row-size=12B cardinality=7.88G cost=1657367506 @@ -517,14 +517,14 @@ max-parallelism=210 segment-costs=[2080384558, 78443632] cpu-comparison-result=1 | max-parallelism=1 segment-costs=[14888] | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF001[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 04(GETNEXT) @@ -600,7 +600,7 @@ max-parallelism=1823 segment-costs=[23016709757, 6873521098] cpu-comparison-resu table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.88G cost=1657367506 @@ -683,13 +683,13 @@ max-parallelism=33390 segment-costs=[333884764381, 743] cpu-comparison-result=27 | | max-parallelism=1 segment-costs=[14888] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= add(CAST(1199 AS INT), CAST(23 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= add(CAST(1199 AS INT), CAST(12 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq <= CAST(1222 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_month_seq >= CAST(1211 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) @@ -765,7 +765,7 @@ max-parallelism=33390 segment-costs=[333884764381, 743] cpu-comparison-result=27 | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=11 row-size=12B cardinality=7.88G cost=1657367506 @@ -885,14 +885,14 @@ max-parallelism=210 segment-costs=[2080384558, 78443632] cpu-comparison-result=1 | max-parallelism=1 segment-costs=[14888] | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | runtime filters: RF001[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1199 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1210 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1199 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=5 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 04(GETNEXT) @@ -968,7 +968,7 @@ max-parallelism=1823 segment-costs=[23016709757, 6873521098] cpu-comparison-resu table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.88G cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q60.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q60.test index 3fb327e74..c9ba4e676 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q60.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q60.test @@ -418,7 +418,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1044,7 +1044,7 @@ max-parallelism=60 segment-costs=[561638319, 35010096] cpu-comparison-result=60 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -1670,7 +1670,7 @@ max-parallelism=60 segment-costs=[561638319, 35010096] cpu-comparison-result=60 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q61.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q61.test index 798c70e45..31a982adc 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q61.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q61.test @@ -182,7 +182,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=15 row-size=20B cardinality=455.87M(filtered from 7.70G) cost=181857343 @@ -326,7 +326,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=4 row-size=24B cardinality=448.93M(filtered from 7.58G) cost=223719213 @@ -603,7 +603,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=15 row-size=20B cardinality=455.87M(filtered from 7.70G) cost=181857343 @@ -873,7 +873,7 @@ max-parallelism=60 segment-costs=[590055067, 185] cpu-comparison-result=77 [max( table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=4 row-size=24B cardinality=448.93M(filtered from 7.58G) cost=223719213 @@ -1150,7 +1150,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=15 row-size=20B cardinality=455.87M(filtered from 7.70G) cost=181857343 @@ -1428,7 +1428,7 @@ max-parallelism=80 segment-costs=[794436452] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=4 row-size=24B cardinality=448.93M(filtered from 7.58G) cost=223719213 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q62.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q62.test index 7175baa00..b5e870347 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q62.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q62.test @@ -127,13 +127,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -338,13 +338,13 @@ max-parallelism=820 segment-costs=[8112942931, 1045327] cpu-comparison-result=12 | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -549,13 +549,13 @@ max-parallelism=820 segment-costs=[8112942931, 1045327] cpu-comparison-result=12 | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1194 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1205 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1194 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q63.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q63.test index 7053e6ff1..0c672e0eb 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q63.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q63.test @@ -33,7 +33,7 @@ Max Per-Host Resource Reservation: Memory=15.25MB Threads=1 Per-Host Resource Estimates: Memory=77MB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=76.81MB mem-reservation=15.25MB thread-reservation=1 runtime-filters-memory=3.00MB -| max-parallelism=1 segment-costs=[1896950166, 1723, 2838, 300] +| max-parallelism=1 segment-costs=[1898248602, 1723, 2838, 300] PLAN-ROOT SINK | output exprs: tpcds_partitioned_parquet_snap.item.i_manager_id, sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price), avg(sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 @@ -68,7 +68,7 @@ PLAN-ROOT SINK | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manager_id, tpcds_partitioned_parquet_snap.date_dim.d_moy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=1.19K cost=463434 +| tuple-ids=8 row-size=24B cardinality=1.19K cost=464703 | in pipelines: 07(GETNEXT), 00(OPEN) | 06:HASH JOIN [INNER JOIN] @@ -76,19 +76,20 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=150296 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150712 | in pipelines: 00(GETNEXT), 05(OPEN) | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN] @@ -96,7 +97,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394802 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=395050 | in pipelines: 00(GETNEXT), 03(OPEN) | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.item] @@ -117,7 +118,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427679576 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427679824 | in pipelines: 00(GETNEXT), 01(OPEN) | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -141,10 +142,10 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=122.70MB Threads=21 @@ -199,28 +200,28 @@ max-parallelism=10 segment-costs=[1986, 2838, 125] cpu-comparison-result=120 [ma | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_manager_id,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=10 (adjusted from 120) Per-Instance Resources: mem-estimate=13.58MB mem-reservation=1.94MB thread-reservation=1 -max-parallelism=10 segment-costs=[211019, 2448] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +max-parallelism=10 segment-costs=[211211, 2448] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] 16:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manager_id, tpcds_partitioned_parquet_snap.date_dim.d_moy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=1.19K cost=182473 +| tuple-ids=8 row-size=24B cardinality=1.19K cost=182638 | in pipelines: 16(GETNEXT), 00(OPEN) | 15:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_manager_id,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | mem-estimate=3.58MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=128.88K cost=28546 +| tuple-ids=8 row-size=24B cardinality=129.00K cost=28573 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB Per-Instance Resources: mem-estimate=27.09MB mem-reservation=2.50MB thread-reservation=1 -max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] +max-parallelism=190 segment-costs=[1898511380, 265843] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manager_id, tpcds_partitioned_parquet_snap.date_dim.d_moy | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=128.88K cost=1041687 +| tuple-ids=8 row-size=24B cardinality=129.00K cost=1043499 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -228,21 +229,21 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=149935 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150350 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[831] +| | max-parallelism=10 segment-costs=[842] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=361 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=362 | | | 14:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=361 cost=470 +| | tuple-ids=6 row-size=12B cardinality=362 cost=480 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -250,14 +251,15 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | max-parallelism=1 segment-costs=[16747] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -265,7 +267,7 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394725 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=394973 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -303,7 +305,7 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427678226 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427678474 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -344,10 +346,10 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=122.70MB Threads=21 @@ -402,28 +404,28 @@ max-parallelism=10 segment-costs=[1986, 2838, 125] cpu-comparison-result=120 [ma | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_manager_id,tpcds_partitioned_parquet_snap.date_dim.d_moy)] hosts=10 instances=10 (adjusted from 120) Per-Instance Resources: mem-estimate=13.58MB mem-reservation=1.94MB thread-reservation=1 -max-parallelism=10 segment-costs=[211019, 2448] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] +max-parallelism=10 segment-costs=[211211, 2448] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))] 16:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manager_id, tpcds_partitioned_parquet_snap.date_dim.d_moy | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=1.19K cost=182473 +| tuple-ids=8 row-size=24B cardinality=1.19K cost=182638 | in pipelines: 16(GETNEXT), 00(OPEN) | 15:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_manager_id,tpcds_partitioned_parquet_snap.date_dim.d_moy)] | mem-estimate=3.58MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=128.88K cost=28546 +| tuple-ids=8 row-size=24B cardinality=129.00K cost=28573 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB Per-Instance Resources: mem-estimate=27.09MB mem-reservation=2.50MB thread-reservation=1 -max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] +max-parallelism=190 segment-costs=[1898511380, 265843] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price) | group by: tpcds_partitioned_parquet_snap.item.i_manager_id, tpcds_partitioned_parquet_snap.date_dim.d_moy | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=8 row-size=24B cardinality=128.88K cost=1041687 +| tuple-ids=8 row-size=24B cardinality=129.00K cost=1043499 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -431,21 +433,21 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=106B cardinality=333.35K cost=149935 +| tuple-ids=0,2,4,6 row-size=106B cardinality=334.27K cost=150350 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[831] +| | max-parallelism=10 segment-costs=[842] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=361 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=362 | | | 14:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=361 cost=470 +| | tuple-ids=6 row-size=12B cardinality=362 cost=480 | | in pipelines: 05(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -453,14 +455,15 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | max-parallelism=1 segment-costs=[16747] | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = CAST(1205 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(4 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(5 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(6 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(7 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(8 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(9 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(10 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_month_seq = add(CAST(1205 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=12B cardinality=361 cost=16728 +| tuple-ids=6 row-size=12B cardinality=362 cost=16728 | in pipelines: 05(GETNEXT) | 04:HASH JOIN [INNER JOIN, BROADCAST] @@ -468,7 +471,7 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=94B cardinality=349.05K(filtered from 1.68M) cost=394725 +| tuple-ids=0,2,4 row-size=94B cardinality=350.02K(filtered from 1.68M) cost=394973 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -506,7 +509,7 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=20B cardinality=349.05K(filtered from 7.88G) cost=1427678226 +| tuple-ids=0,2 row-size=20B cardinality=350.02K(filtered from 7.88G) cost=1427678474 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -547,9 +550,9 @@ max-parallelism=190 segment-costs=[1897212402, 265595] cpu-comparison-result=120 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=361(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=362(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=16B cardinality=349.05K(filtered from 7.88G) cost=467947829 + tuple-ids=0 row-size=16B cardinality=350.02K(filtered from 7.88G) cost=469244084 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q64.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q64.test index 921fbb09a..829e66962 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q64.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q64.test @@ -125,15 +125,15 @@ Max Per-Host Resource Reservation: Memory=653.55MB Threads=1 Per-Host Resource Estimates: Memory=100.58GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=100.58GB mem-reservation=653.55MB thread-reservation=1 runtime-filters-memory=55.00MB -| max-parallelism=1 segment-costs=[4262538402, 10734293262, 4262538402, 10734293262, 13880148349, 18143864832] +| max-parallelism=1 segment-costs=[4262538402, 10667692027, 4262538402, 10667692027, 13710197824, 17921710080] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), add(CAST(2000 AS INT), CAST(1 AS INT)), count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=18143864832 +| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), CAST(2001 AS INT), count() +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=17921710080 | 79:SORT | order by: tpcds_partitioned_parquet_snap.item.i_product_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, count() ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost) ASC NULLS LAST | mem-estimate=50.00GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=80 row-size=327B cardinality=863.99M cost=12637984739 +| tuple-ids=80 row-size=327B cardinality=853.41M cost=12483243390 | in pipelines: 79(GETNEXT), 38(OPEN) | 78:HASH JOIN [INNER JOIN] @@ -142,54 +142,54 @@ PLAN-ROOT SINK | other join predicates: count() <= count() | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_store_name, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_zip | mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39,79 row-size=566B cardinality=863.99M cost=1242163610 +| tuple-ids=39,79 row-size=566B cardinality=853.41M cost=1226954434 | in pipelines: 38(GETNEXT), 77(OPEN) | |--77:AGGREGATE [FINALIZE] | | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt) | | group by: tpcds_partitioned_parquet_snap.item_0.i_product_name, tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_2.ca_city, tpcds_partitioned_parquet_snap.customer_address_2.ca_zip, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_1.ca_city, tpcds_partitioned_parquet_snap.customer_address_1.ca_zip, tpcds_partitioned_parquet_snap.date_dim_2.d_year, tpcds_partitioned_parquet_snap.date_dim_3.d_year -| | mem-estimate=541.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=5281247328 -| | in pipelines: 77(GETNEXT), 54(OPEN) +| | mem-estimate=541.24MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=5216583208 +| | in pipelines: 77(GETNEXT), 53(OPEN) | | | 76:HASH JOIN [INNER JOIN] -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk -| | fk/pk conjuncts: none -| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status -| | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status +| | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54,40 row-size=462B cardinality=863.99M cost=380090802 -| | in pipelines: 54(GETNEXT), 39(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52,77 row-size=462B cardinality=853.41M cost=378173919 +| | in pipelines: 53(GETNEXT), 75(OPEN) | | -| |--39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] +| |--75:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=40 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 39(GETNEXT) +| | tuple-ids=77 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 75(GETNEXT) | | -| 75:HASH JOIN [INNER JOIN] +| 74:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | fk/pk conjuncts: none | | runtime filters: RF049[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | mem-estimate=4.42GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54 row-size=445B cardinality=863.99M cost=405025345 -| | in pipelines: 54(GETNEXT), 40(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52 row-size=445B cardinality=863.99M cost=405025345 +| | in pipelines: 53(GETNEXT), 39(OPEN) | | -| |--52:HASH JOIN [INNER JOIN] +| |--51:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | runtime filters: RF075[min_max] <- tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52,54 row-size=147B cardinality=26.86M cost=26754583 -| | | in pipelines: 40(GETNEXT), 51(OPEN) +| | | tuple-ids=40,42,44,46,48,50,52 row-size=147B cardinality=26.86M cost=26754583 +| | | in pipelines: 39(GETNEXT), 50(OPEN) | | | -| | |--51:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] +| | |--50:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] | | | HDFS partitions=1/1 files=1 size=307.36MB | | | predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | stored statistics: @@ -198,26 +198,26 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 -| | | in pipelines: 51(GETNEXT) +| | | tuple-ids=52 row-size=78B cardinality=15.00M cost=6805716 +| | | in pipelines: 50(GETNEXT) | | | -| | 50:HASH JOIN [INNER JOIN] +| | 49:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | runtime filters: RF077[min_max] <- tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52 row-size=69B cardinality=26.86M cost=11930166 -| | | in pipelines: 40(GETNEXT), 47(OPEN) +| | | tuple-ids=40,42,44,46,48,50 row-size=69B cardinality=26.86M cost=11930166 +| | | in pipelines: 39(GETNEXT), 46(OPEN) | | | -| | |--49:HASH JOIN [INNER JOIN] +| | |--48:HASH JOIN [INNER JOIN] | | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | runtime filters: RF085[min_max] <- tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=50,52 row-size=12B cardinality=7.20K cost=3171 -| | | | in pipelines: 47(GETNEXT), 48(OPEN) +| | | | tuple-ids=48,50 row-size=12B cardinality=7.20K cost=3171 +| | | | in pipelines: 46(GETNEXT), 47(OPEN) | | | | -| | | |--48:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] +| | | |--47:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] | | | | HDFS partitions=1/1 files=1 size=1.22KB | | | | predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | stored statistics: @@ -226,10 +226,10 @@ PLAN-ROOT SINK | | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | | tuple-ids=52 row-size=4B cardinality=20 cost=1 -| | | | in pipelines: 48(GETNEXT) +| | | | tuple-ids=50 row-size=4B cardinality=20 cost=1 +| | | | in pipelines: 47(GETNEXT) | | | | -| | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] +| | | 46:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | | HDFS partitions=1/1 files=1 size=41.69KB | | | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | runtime filters: RF085[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk @@ -239,18 +239,18 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | | tuple-ids=50 row-size=8B cardinality=7.20K cost=1234 -| | | in pipelines: 47(GETNEXT) +| | | tuple-ids=48 row-size=8B cardinality=7.20K cost=1234 +| | | in pipelines: 46(GETNEXT) | | | -| | 46:HASH JOIN [INNER JOIN] +| | 45:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | runtime filters: RF079[min_max] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48 row-size=57B cardinality=27.51M cost=12114966 -| | | in pipelines: 40(GETNEXT), 45(OPEN) +| | | tuple-ids=40,42,44,46 row-size=57B cardinality=27.51M cost=12114966 +| | | in pipelines: 39(GETNEXT), 44(OPEN) | | | -| | |--45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| | |--44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: @@ -259,18 +259,18 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=48 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 45(GETNEXT) +| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 44(GETNEXT) | | | -| | 44:HASH JOIN [INNER JOIN] +| | 43:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | runtime filters: RF081[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=49B cardinality=27.51M cost=12114966 -| | | in pipelines: 40(GETNEXT), 43(OPEN) +| | | tuple-ids=40,42,44 row-size=49B cardinality=27.51M cost=12114966 +| | | in pipelines: 39(GETNEXT), 42(OPEN) | | | -| | |--43:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| | |--42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: @@ -279,30 +279,30 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 43(GETNEXT) +| | | tuple-ids=44 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 42(GETNEXT) | | | -| | 42:HASH JOIN [INNER JOIN] -| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | 41:HASH JOIN [INNER JOIN] +| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk | | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44 row-size=41B cardinality=27.51M cost=14050192 -| | | in pipelines: 40(GETNEXT), 41(OPEN) +| | | tuple-ids=40,42 row-size=41B cardinality=27.51M cost=14050192 +| | | in pipelines: 39(GETNEXT), 40(OPEN) | | | -| | |--41:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] +| | |--40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] | | | HDFS partitions=1/1 files=1 size=11.15MB -| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | stored statistics: | | | table: rows=1.92M size=11.15MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=17B cardinality=1.92M cost=246246 -| | | in pipelines: 41(GETNEXT) +| | | tuple-ids=42 row-size=17B cardinality=1.92M cost=246246 +| | | in pipelines: 40(GETNEXT) | | | -| | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +| | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | runtime filters: RF077[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk, RF083[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk, RF075[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk, RF079[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk, RF081[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk @@ -312,18 +312,18 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=42 row-size=24B cardinality=27.85M cost=15426000 -| | in pipelines: 40(GETNEXT) +| | tuple-ids=40 row-size=24B cardinality=27.85M cost=15426000 +| | in pipelines: 39(GETNEXT) | | -| 74:HASH JOIN [INNER JOIN] +| 73:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk | | fk/pk conjuncts: none | | runtime filters: RF051[min_max] <- tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk | | mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56 row-size=299B cardinality=863.99M cost=393170002 -| | in pipelines: 54(GETNEXT), 53(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54 row-size=299B cardinality=863.99M cost=393170002 +| | in pipelines: 53(GETNEXT), 52(OPEN) | | -| |--53:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] +| |--52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | stored statistics: @@ -332,18 +332,18 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=56 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 53(GETNEXT) +| | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 52(GETNEXT) | | -| 73:HASH JOIN [INNER JOIN] +| 72:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | runtime filters: RF053[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_store_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77 row-size=221B cardinality=863.99M cost=378171338 -| | in pipelines: 54(GETNEXT), 72(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75 row-size=221B cardinality=863.99M cost=378171338 +| | in pipelines: 53(GETNEXT), 71(OPEN) | | -| |--72:SCAN HDFS [tpcds_partitioned_parquet_snap.store] +| |--71:SCAN HDFS [tpcds_partitioned_parquet_snap.store] | | HDFS partitions=1/1 files=1 size=119.76KB | | predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | stored statistics: @@ -352,34 +352,34 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=1.35K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| | tuple-ids=77 row-size=37B cardinality=1.34K cost=365 -| | in pipelines: 72(GETNEXT) +| | tuple-ids=75 row-size=37B cardinality=1.34K cost=365 +| | in pipelines: 71(GETNEXT) | | -| 71:HASH JOIN [INNER JOIN] +| 70:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | fk/pk conjuncts: none | | runtime filters: RF055[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76 row-size=184B cardinality=863.99M cost=157369418 -| | in pipelines: 54(GETNEXT), 70(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74 row-size=184B cardinality=863.99M cost=157369418 +| | in pipelines: 53(GETNEXT), 69(OPEN) | | -| |--70:AGGREGATE [FINALIZE] +| |--69:AGGREGATE [FINALIZE] | | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit)) | | | group by: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit))) | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=36.02K cost=928618209 -| | | in pipelines: 70(GETNEXT), 67(OPEN) +| | | tuple-ids=74 row-size=36B cardinality=36.02K cost=928618209 +| | | in pipelines: 69(GETNEXT), 66(OPEN) | | | -| | 69:HASH JOIN [INNER JOIN] +| | 68:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | runtime filters: RF072[min_max] <- tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, RF073[min_max] <- tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | mem-estimate=21.66GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=72,74 row-size=40B cardinality=2.56G cost=1922201419 -| | | in pipelines: 67(GETNEXT), 68(OPEN) +| | | tuple-ids=70,72 row-size=40B cardinality=2.56G cost=1922201419 +| | | in pipelines: 66(GETNEXT), 67(OPEN) | | | -| | |--68:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns] +| | |--67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns] | | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | | predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | stored statistics: @@ -389,10 +389,10 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | | tuple-ids=74 row-size=24B cardinality=432.02M cost=173584426 -| | | in pipelines: 68(GETNEXT) +| | | tuple-ids=72 row-size=24B cardinality=432.02M cost=173584426 +| | | in pipelines: 67(GETNEXT) | | | -| | 67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales] +| | 66:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales] | | HDFS partitions=1831/1831 files=1831 size=280.96GB | | predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | runtime filters: RF072[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk, RF073[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number @@ -403,26 +403,26 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=21.52M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=72 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| | in pipelines: 67(GETNEXT) +| | tuple-ids=70 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| | in pipelines: 66(GETNEXT) | | -| 66:HASH JOIN [INNER JOIN] +| 65:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | runtime filters: RF057[min_max] <- tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70 row-size=148B cardinality=3.03M cost=1353403 -| | in pipelines: 54(GETNEXT), 63(OPEN) +| | tuple-ids=56,58,60,62,64,66,68 row-size=148B cardinality=3.03M cost=1353403 +| | in pipelines: 53(GETNEXT), 62(OPEN) | | -| |--65:HASH JOIN [INNER JOIN] +| |--64:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | runtime filters: RF069[min_max] <- tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=68,70 row-size=12B cardinality=7.20K cost=3171 -| | | in pipelines: 63(GETNEXT), 64(OPEN) +| | | tuple-ids=66,68 row-size=12B cardinality=7.20K cost=3171 +| | | in pipelines: 62(GETNEXT), 63(OPEN) | | | -| | |--64:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] +| | |--63:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -431,10 +431,10 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=70 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 64(GETNEXT) +| | | tuple-ids=68 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 63(GETNEXT) | | | -| | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] +| | 62:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | runtime filters: RF069[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk @@ -444,69 +444,69 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=68 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 63(GETNEXT) +| | tuple-ids=66 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 62(GETNEXT) | | -| 62:HASH JOIN [INNER JOIN] +| 61:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | runtime filters: RF058[bloom] <- tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, RF059[bloom] <- tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number, RF060[min_max] <- tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, RF061[min_max] <- tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | mem-estimate=4.34GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66 row-size=136B cardinality=3.11M cost=45791887 -| | in pipelines: 54(GETNEXT), 55(OPEN) +| | tuple-ids=56,58,60,62,64 row-size=136B cardinality=3.11M cost=45791887 +| | in pipelines: 53(GETNEXT), 54(OPEN) | | -| |--61:HASH JOIN [INNER JOIN] +| |--60:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | runtime filters: RF062[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk, RF063[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64,66 row-size=124B cardinality=31.06M cost=49251977 -| | | in pipelines: 55(GETNEXT), 60(OPEN) +| | | tuple-ids=58,60,62,64 row-size=124B cardinality=31.06M cost=49251977 +| | | in pipelines: 54(GETNEXT), 59(OPEN) | | | -| | |--60:SCAN HDFS [tpcds_partitioned_parquet_snap.item] +| | |--59:SCAN HDFS [tpcds_partitioned_parquet_snap.item] | | | HDFS partitions=1/1 files=1 size=33.54MB -| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | stored statistics: | | | table: rows=360.00K size=33.54MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=66 row-size=60B cardinality=7.42K cost=248525 -| | | in pipelines: 60(GETNEXT) +| | | tuple-ids=64 row-size=60B cardinality=7.42K cost=228293 +| | | in pipelines: 59(GETNEXT) | | | -| | 59:HASH JOIN [INNER JOIN] +| | 58:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | runtime filters: RF064[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694973 -| | | in pipelines: 55(GETNEXT), 58(OPEN) +| | | tuple-ids=58,60,62 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694973 +| | | in pipelines: 54(GETNEXT), 57(OPEN) | | | -| | |--58:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| | |--57:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=64 row-size=8B cardinality=373 cost=12520 -| | | in pipelines: 58(GETNEXT) +| | | tuple-ids=62 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 57(GETNEXT) | | | -| | 57:HASH JOIN [INNER JOIN] +| | 56:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | runtime filters: RF067[min_max] <- tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378994592 -| | | in pipelines: 55(GETNEXT), 56(OPEN) +| | | tuple-ids=58,60 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378994592 +| | | in pipelines: 54(GETNEXT), 55(OPEN) | | | -| | |--56:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion] +| | |--55:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion] | | | HDFS partitions=1/1 files=1 size=100.50KB | | | predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | stored statistics: @@ -515,10 +515,10 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | | tuple-ids=62 row-size=4B cardinality=1.80K cost=154 -| | | in pipelines: 56(GETNEXT) +| | | tuple-ids=60 row-size=4B cardinality=1.80K cost=154 +| | | in pipelines: 55(GETNEXT) | | | -| | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] +| | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | | partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL | | HDFS partitions=1823/1824 files=1823 size=389.69GB | | predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL @@ -527,13 +527,13 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=60 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| | in pipelines: 55(GETNEXT) +| | tuple-ids=58 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| | in pipelines: 54(GETNEXT) | | -| 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns] +| 53:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns] | HDFS partitions=2004/2004 files=2004 size=48.14GB | predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | runtime filters: RF060[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF061[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number, RF055[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF058[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF059[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number @@ -544,54 +544,54 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=30.09M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=58 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 -| in pipelines: 54(GETNEXT) +| tuple-ids=56 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 +| in pipelines: 53(GETNEXT) | 38:AGGREGATE [FINALIZE] | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt) | group by: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| mem-estimate=541.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=5281247328 -| in pipelines: 38(GETNEXT), 15(OPEN) +| mem-estimate=541.24MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=39 row-size=283B cardinality=853.41M cost=5216583208 +| in pipelines: 38(GETNEXT), 14(OPEN) | 37:HASH JOIN [INNER JOIN] -| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk -| fk/pk conjuncts: none -| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status -| runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status +| runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14,0 row-size=462B cardinality=863.99M cost=380090802 -| in pipelines: 15(GETNEXT), 00(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12,37 row-size=462B cardinality=853.41M cost=378173919 +| in pipelines: 14(GETNEXT), 36(OPEN) | -|--00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] +|--36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] | HDFS partitions=1/1 files=1 size=11.15MB -| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | stored statistics: | table: rows=1.92M size=11.15MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=197.97K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=17B cardinality=1.92M cost=246246 -| in pipelines: 00(GETNEXT) +| tuple-ids=37 row-size=17B cardinality=1.92M cost=246246 +| in pipelines: 36(GETNEXT) | -36:HASH JOIN [INNER JOIN] +35:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: none | runtime filters: RF009[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=4.42GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14 row-size=445B cardinality=863.99M cost=405025345 -| in pipelines: 15(GETNEXT), 01(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12 row-size=445B cardinality=863.99M cost=405025345 +| in pipelines: 14(GETNEXT), 00(OPEN) | -|--13:HASH JOIN [INNER JOIN] +|--12:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | runtime filters: RF035[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12,14 row-size=147B cardinality=26.86M cost=26754583 -| | in pipelines: 01(GETNEXT), 12(OPEN) +| | tuple-ids=0,2,4,6,8,10,12 row-size=147B cardinality=26.86M cost=26754583 +| | in pipelines: 00(GETNEXT), 11(OPEN) | | -| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] +| |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | stored statistics: @@ -600,26 +600,26 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 12(GETNEXT) +| | tuple-ids=12 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 11(GETNEXT) | | -| 11:HASH JOIN [INNER JOIN] +| 10:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | runtime filters: RF037[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12 row-size=69B cardinality=26.86M cost=11930166 -| | in pipelines: 01(GETNEXT), 08(OPEN) +| | tuple-ids=0,2,4,6,8,10 row-size=69B cardinality=26.86M cost=11930166 +| | in pipelines: 00(GETNEXT), 07(OPEN) | | -| |--10:HASH JOIN [INNER JOIN] +| |--09:HASH JOIN [INNER JOIN] | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | runtime filters: RF045[min_max] <- tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=10,12 row-size=12B cardinality=7.20K cost=3171 -| | | in pipelines: 08(GETNEXT), 09(OPEN) +| | | tuple-ids=8,10 row-size=12B cardinality=7.20K cost=3171 +| | | in pipelines: 07(GETNEXT), 08(OPEN) | | | -| | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] +| | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -628,10 +628,10 @@ PLAN-ROOT SINK | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=12 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 09(GETNEXT) +| | | tuple-ids=10 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 08(GETNEXT) | | | -| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] +| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | runtime filters: RF045[min_max] -> tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk @@ -641,18 +641,18 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 08(GETNEXT) +| | tuple-ids=8 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 07(GETNEXT) | | -| 07:HASH JOIN [INNER JOIN] +| 06:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | runtime filters: RF039[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=57B cardinality=27.51M cost=12114966 -| | in pipelines: 01(GETNEXT), 06(OPEN) +| | tuple-ids=0,2,4,6 row-size=57B cardinality=27.51M cost=12114966 +| | in pipelines: 00(GETNEXT), 05(OPEN) | | -| |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: @@ -661,18 +661,18 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 06(GETNEXT) +| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 05(GETNEXT) | | -| 05:HASH JOIN [INNER JOIN] +| 04:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF041[min_max] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=49B cardinality=27.51M cost=12114966 -| | in pipelines: 01(GETNEXT), 04(OPEN) +| | tuple-ids=0,2,4 row-size=49B cardinality=27.51M cost=12114966 +| | in pipelines: 00(GETNEXT), 03(OPEN) | | -| |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: @@ -681,30 +681,30 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 04(GETNEXT) +| | tuple-ids=4 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 03(GETNEXT) | | -| 03:HASH JOIN [INNER JOIN] -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| 02:HASH JOIN [INNER JOIN] +| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4 row-size=41B cardinality=27.51M cost=14050192 -| | in pipelines: 01(GETNEXT), 02(OPEN) +| | tuple-ids=0,2 row-size=41B cardinality=27.51M cost=14050192 +| | in pipelines: 00(GETNEXT), 01(OPEN) | | -| |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] +| |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=4 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 02(GETNEXT) +| | tuple-ids=2 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 01(GETNEXT) | | -| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] | HDFS partitions=1/1 files=1 size=1.55GB | predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | runtime filters: RF037[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk, RF043[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk, RF035[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF039[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk, RF041[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk @@ -714,18 +714,18 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=3.10M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=27.85M cost=15426000 -| in pipelines: 01(GETNEXT) +| tuple-ids=0 row-size=24B cardinality=27.85M cost=15426000 +| in pipelines: 00(GETNEXT) | -35:HASH JOIN [INNER JOIN] +34:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | fk/pk conjuncts: none | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16 row-size=299B cardinality=863.99M cost=393170002 -| in pipelines: 15(GETNEXT), 14(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14 row-size=299B cardinality=863.99M cost=393170002 +| in pipelines: 14(GETNEXT), 13(OPEN) | -|--14:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] +|--13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] | HDFS partitions=1/1 files=1 size=307.36MB | predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | stored statistics: @@ -734,18 +734,18 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=1.58M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=16 row-size=78B cardinality=15.00M cost=6805716 -| in pipelines: 14(GETNEXT) +| tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 +| in pipelines: 13(GETNEXT) | -34:HASH JOIN [INNER JOIN] +33:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | runtime filters: RF013[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37 row-size=221B cardinality=863.99M cost=378171338 -| in pipelines: 15(GETNEXT), 33(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35 row-size=221B cardinality=863.99M cost=378171338 +| in pipelines: 14(GETNEXT), 32(OPEN) | -|--33:SCAN HDFS [tpcds_partitioned_parquet_snap.store] +|--32:SCAN HDFS [tpcds_partitioned_parquet_snap.store] | HDFS partitions=1/1 files=1 size=119.76KB | predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | runtime filters: RF004[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_name, RF005[min_max] -> tpcds_partitioned_parquet_snap.store.s_zip @@ -755,34 +755,34 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=1.35K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| tuple-ids=37 row-size=37B cardinality=1.34K cost=365 -| in pipelines: 33(GETNEXT) +| tuple-ids=35 row-size=37B cardinality=1.34K cost=365 +| in pipelines: 32(GETNEXT) | -32:HASH JOIN [INNER JOIN] +31:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | fk/pk conjuncts: none | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36 row-size=184B cardinality=863.99M cost=157369418 -| in pipelines: 15(GETNEXT), 31(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34 row-size=184B cardinality=863.99M cost=157369418 +| in pipelines: 14(GETNEXT), 30(OPEN) | -|--31:AGGREGATE [FINALIZE] +|--30:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit)) | | group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit))) | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=36.02K cost=928618209 -| | in pipelines: 31(GETNEXT), 28(OPEN) +| | tuple-ids=34 row-size=36B cardinality=36.02K cost=928618209 +| | in pipelines: 30(GETNEXT), 27(OPEN) | | -| 30:HASH JOIN [INNER JOIN] +| 29:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, RF031[bloom] <- tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number, RF032[min_max] <- tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, RF033[min_max] <- tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | mem-estimate=21.66GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=32,34 row-size=40B cardinality=2.56G cost=1922201419 -| | in pipelines: 28(GETNEXT), 29(OPEN) +| | tuple-ids=30,32 row-size=40B cardinality=2.56G cost=1922201419 +| | in pipelines: 27(GETNEXT), 28(OPEN) | | -| |--29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns] +| |--28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns] | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk @@ -793,10 +793,10 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | tuple-ids=34 row-size=24B cardinality=432.02M cost=173584426 -| | in pipelines: 29(GETNEXT) +| | tuple-ids=32 row-size=24B cardinality=432.02M cost=173584426 +| | in pipelines: 28(GETNEXT) | | -| 28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales] +| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales] | HDFS partitions=1831/1831 files=1831 size=280.96GB | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | runtime filters: RF032[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF033[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF031[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number @@ -807,26 +807,26 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=21.52M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=32 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| in pipelines: 28(GETNEXT) +| tuple-ids=30 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| in pipelines: 27(GETNEXT) | -27:HASH JOIN [INNER JOIN] +26:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | runtime filters: RF017[min_max] <- tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30 row-size=148B cardinality=3.03M cost=1353403 -| in pipelines: 15(GETNEXT), 24(OPEN) +| tuple-ids=16,18,20,22,24,26,28 row-size=148B cardinality=3.03M cost=1353403 +| in pipelines: 14(GETNEXT), 23(OPEN) | -|--26:HASH JOIN [INNER JOIN] +|--25:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | runtime filters: RF029[min_max] <- tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=28,30 row-size=12B cardinality=7.20K cost=3171 -| | in pipelines: 24(GETNEXT), 25(OPEN) +| | tuple-ids=26,28 row-size=12B cardinality=7.20K cost=3171 +| | in pipelines: 23(GETNEXT), 24(OPEN) | | -| |--25:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] +| |--24:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] | | HDFS partitions=1/1 files=1 size=1.22KB | | predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | stored statistics: @@ -835,10 +835,10 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | tuple-ids=30 row-size=4B cardinality=20 cost=1 -| | in pipelines: 25(GETNEXT) +| | tuple-ids=28 row-size=4B cardinality=20 cost=1 +| | in pipelines: 24(GETNEXT) | | -| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] +| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | HDFS partitions=1/1 files=1 size=41.69KB | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | runtime filters: RF029[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk @@ -848,48 +848,48 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=7.20K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| tuple-ids=28 row-size=8B cardinality=7.20K cost=1234 -| in pipelines: 24(GETNEXT) +| tuple-ids=26 row-size=8B cardinality=7.20K cost=1234 +| in pipelines: 23(GETNEXT) | -23:HASH JOIN [INNER JOIN] +22:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF019[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, RF020[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF021[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | mem-estimate=4.34GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26 row-size=136B cardinality=3.11M cost=45791887 -| in pipelines: 15(GETNEXT), 16(OPEN) +| tuple-ids=16,18,20,22,24 row-size=136B cardinality=3.11M cost=45791887 +| in pipelines: 14(GETNEXT), 15(OPEN) | -|--22:HASH JOIN [INNER JOIN] +|--21:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | runtime filters: RF022[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF023[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24,26 row-size=124B cardinality=31.06M cost=49251977 -| | in pipelines: 16(GETNEXT), 21(OPEN) +| | tuple-ids=18,20,22,24 row-size=124B cardinality=31.06M cost=49251977 +| | in pipelines: 15(GETNEXT), 20(OPEN) | | -| |--21:SCAN HDFS [tpcds_partitioned_parquet_snap.item] +| |--20:SCAN HDFS [tpcds_partitioned_parquet_snap.item] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=26 row-size=60B cardinality=7.42K cost=248525 -| | in pipelines: 21(GETNEXT) +| | tuple-ids=24 row-size=60B cardinality=7.42K cost=228293 +| | in pipelines: 20(GETNEXT) | | -| 20:HASH JOIN [INNER JOIN] +| 19:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694973 -| | in pipelines: 16(GETNEXT), 19(OPEN) +| | tuple-ids=18,20,22 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694973 +| | in pipelines: 15(GETNEXT), 18(OPEN) | | -| |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| |--18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: @@ -899,18 +899,18 @@ PLAN-ROOT SINK | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=24 row-size=8B cardinality=373 cost=12520 -| | in pipelines: 19(GETNEXT) +| | tuple-ids=22 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 18(GETNEXT) | | -| 18:HASH JOIN [INNER JOIN] +| 17:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378994592 -| | in pipelines: 16(GETNEXT), 17(OPEN) +| | tuple-ids=18,20 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378994592 +| | in pipelines: 15(GETNEXT), 16(OPEN) | | -| |--17:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion] +| |--16:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion] | | HDFS partitions=1/1 files=1 size=100.50KB | | predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | stored statistics: @@ -919,25 +919,25 @@ PLAN-ROOT SINK | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | tuple-ids=22 row-size=4B cardinality=1.80K cost=154 -| | in pipelines: 17(GETNEXT) +| | tuple-ids=20 row-size=4B cardinality=1.80K cost=154 +| | in pipelines: 16(GETNEXT) | | -| 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] +| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] | partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL | HDFS partitions=1823/1824 files=1823 size=389.69GB | predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL -| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk +| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=20 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| in pipelines: 16(GETNEXT) +| tuple-ids=18 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| in pipelines: 15(GETNEXT) | -15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns] +14:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns] HDFS partitions=2004/2004 files=2004 size=48.14GB predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL runtime filters: RF020[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF021[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF019[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number @@ -948,31 +948,31 @@ PLAN-ROOT SINK extrapolated-rows=disabled max-scan-range-rows=30.09M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=18 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 - in pipelines: 15(GETNEXT) + tuple-ids=16 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 + in pipelines: 14(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=7.29GB Threads=285 -Per-Host Resource Estimates: Memory=108.50GB +Per-Host Resource Estimates: Memory=107.90GB F49:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=1.21GB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[18927253995] cpu-comparison-result=1230 [max(1 (self) vs 1230 (sum children))] +| max-parallelism=1 segment-costs=[18695507348] cpu-comparison-result=1230 [max(1 (self) vs 1230 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), add(CAST(2000 AS INT), CAST(1 AS INT)), count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=18143864832 +| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), CAST(2001 AS INT), count() +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=17921710080 | 132:MERGING-EXCHANGE [UNPARTITIONED] | order by: tpcds_partitioned_parquet_snap.item.i_product_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, count() ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost) ASC NULLS LAST | mem-estimate=1.11GB mem-reservation=0B thread-reservation=0 -| tuple-ids=80 row-size=327B cardinality=863.99M cost=783389163 +| tuple-ids=80 row-size=327B cardinality=853.41M cost=773797268 | in pipelines: 79(GETNEXT) | F48:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] hosts=10 instances=110 (adjusted from 10) -Per-Instance Resources: mem-estimate=2.43GB mem-reservation=12.00MB thread-reservation=1 -max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-result=1230 [max(110 (self) vs 1230 (sum children))] +Per-Instance Resources: mem-estimate=2.40GB mem-reservation=12.00MB thread-reservation=1 +max-parallelism=1410 segment-costs=[14062194210, 7577617839] cpu-comparison-result=1230 [max(110 (self) vs 1230 (sum children))] 79:SORT | order by: tpcds_partitioned_parquet_snap.item.i_product_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, count() ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost) ASC NULLS LAST -| mem-estimate=2.39GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=80 row-size=327B cardinality=863.99M cost=12637984739 +| mem-estimate=2.36GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=80 row-size=327B cardinality=853.41M cost=12483243390 | in pipelines: 79(GETNEXT), 104(OPEN) | 78:HASH JOIN [INNER JOIN, PARTITIONED] @@ -981,93 +981,93 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | fk/pk conjuncts: tpcds_partitioned_parquet_snap.item.i_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name = tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip = tpcds_partitioned_parquet_snap.store_0.s_zip | other join predicates: count() <= count() | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39,79 row-size=566B cardinality=863.99M cost=378170002 +| tuple-ids=39,79 row-size=566B cardinality=853.41M cost=373539650 | in pipelines: 104(GETNEXT), 129(OPEN) | |--F50:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] hosts=10 instances=110 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=2.33GB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=1430 segment-costs=[2084346906] cpu-comparison-result=615 [max(110 (self) vs 615 (sum children))] +| | Per-Instance Resources: mem-estimate=2.30GB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=1410 segment-costs=[2058825954] cpu-comparison-result=615 [max(110 (self) vs 615 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip | | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_store_name, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_zip -| | mem-estimate=2.29GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=863993608 +| | mem-estimate=2.26GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=853414784 | | | 131:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip)] | | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=1220353298 +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=1205411170 | | in pipelines: 129(GETNEXT) | | | F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_product_name,tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_2.ca_city,tpcds_partitioned_parquet_snap.customer_address_2.ca_zip,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_1.ca_city,tpcds_partitioned_parquet_snap.customer_address_1.ca_zip,tpcds_partitioned_parquet_snap.date_dim_2.d_year,tpcds_partitioned_parquet_snap.date_dim_3.d_year)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=635.46MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=1620 segment-costs=[6501600626, 16186220022] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] +| max-parallelism=1600 segment-costs=[6421994378, 15988034328] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] | 129:AGGREGATE [FINALIZE] | | output: count:merge(), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt) | | group by: tpcds_partitioned_parquet_snap.item_0.i_product_name, tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_2.ca_city, tpcds_partitioned_parquet_snap.customer_address_2.ca_zip, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_1.ca_city, tpcds_partitioned_parquet_snap.customer_address_1.ca_zip, tpcds_partitioned_parquet_snap.date_dim_2.d_year, tpcds_partitioned_parquet_snap.date_dim_3.d_year | | mem-estimate=512.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=5281247328 -| | in pipelines: 129(GETNEXT), 54(OPEN) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=5216583208 +| | in pipelines: 129(GETNEXT), 53(OPEN) | | | 128:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_product_name,tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_2.ca_city,tpcds_partitioned_parquet_snap.customer_address_2.ca_zip,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_1.ca_city,tpcds_partitioned_parquet_snap.customer_address_1.ca_zip,tpcds_partitioned_parquet_snap.date_dim_2.d_year,tpcds_partitioned_parquet_snap.date_dim_3.d_year)] | | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=1220353298 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=1205411170 +| | in pipelines: 53(GETNEXT) | | | F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=657.08MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] +| max-parallelism=1600 segment-costs=[6909938718, 15988034328] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] | 77:AGGREGATE [STREAMING] | | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt) | | group by: tpcds_partitioned_parquet_snap.item_0.i_product_name, tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_2.ca_city, tpcds_partitioned_parquet_snap.customer_address_2.ca_zip, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_1.ca_city, tpcds_partitioned_parquet_snap.customer_address_1.ca_zip, tpcds_partitioned_parquet_snap.date_dim_2.d_year, tpcds_partitioned_parquet_snap.date_dim_3.d_year | | mem-estimate=512.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=5281247328 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=5216583208 +| | in pipelines: 53(GETNEXT) | | | 76:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=01 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk -| | fk/pk conjuncts: none -| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54,40 row-size=462B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 39(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52,77 row-size=462B cardinality=853.41M cost=376253119 +| | in pipelines: 53(GETNEXT), 75(OPEN) | | | |--F51:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=418.21MB mem-reservation=408.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[4473540] | | JOIN BUILD | | | join-table-id=01 plan-id=02 cohort-id=02 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk -| | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | 127:EXCHANGE [BROADCAST] | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=40 row-size=17B cardinality=1.92M cost=2552740 -| | | in pipelines: 39(GETNEXT) +| | | tuple-ids=77 row-size=17B cardinality=1.92M cost=2552740 +| | | in pipelines: 75(GETNEXT) | | | | | F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[375900] -| | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | 75:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=40 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 39(GETNEXT) +| | tuple-ids=77 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 75(GETNEXT) | | -| 75:HASH JOIN [INNER JOIN, BROADCAST] +| 74:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54 row-size=445B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 40(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52 row-size=445B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 39(OPEN) | | | |--F52:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=4.43GB mem-reservation=408.00MB thread-reservation=1 @@ -1080,19 +1080,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 126:EXCHANGE [BROADCAST] | | | mem-estimate=11.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52,54 row-size=147B cardinality=26.86M cost=35690750 -| | | in pipelines: 40(GETNEXT) +| | | tuple-ids=40,42,44,46,48,50,52 row-size=147B cardinality=26.86M cost=35690750 +| | | in pipelines: 39(GETNEXT) | | | | | F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=11.59MB mem-reservation=0B thread-reservation=1 | | max-parallelism=10 segment-costs=[42890739] -| | 52:HASH JOIN [INNER JOIN, PARTITIONED] +| | 51:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash-table-id=03 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52,54 row-size=147B cardinality=26.86M cost=11754583 -| | | in pipelines: 40(GETNEXT), 51(OPEN) +| | | tuple-ids=40,42,44,46,48,50,52 row-size=147B cardinality=26.86M cost=11754583 +| | | in pipelines: 39(GETNEXT), 50(OPEN) | | | | | |--F53:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=160.14MB mem-reservation=34.00MB thread-reservation=1 @@ -1105,13 +1105,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 125:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk)] | | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=54 row-size=78B cardinality=15.00M cost=7017902 -| | | | in pipelines: 51(GETNEXT) +| | | | tuple-ids=52 row-size=78B cardinality=15.00M cost=7017902 +| | | | in pipelines: 50(GETNEXT) | | | | | | | F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=19.19MB mem-reservation=128.00KB thread-reservation=1 | | | max-parallelism=10 segment-costs=[89453349] -| | | 51:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | | 50:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | | HDFS partitions=1/1 files=1 size=307.36MB | | | predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | stored statistics: @@ -1120,24 +1120,24 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 -| | | in pipelines: 51(GETNEXT) +| | | tuple-ids=52 row-size=78B cardinality=15.00M cost=6805716 +| | | in pipelines: 50(GETNEXT) | | | | | 124:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] | | | mem-estimate=10.91MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52 row-size=69B cardinality=26.86M cost=16448897 -| | | in pipelines: 40(GETNEXT) +| | | tuple-ids=40,42,44,46,48,50 row-size=69B cardinality=26.86M cost=16448897 +| | | in pipelines: 39(GETNEXT) | | | | | F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=19.63MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[265911830] -| | 50:HASH JOIN [INNER JOIN, BROADCAST] +| | 49:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=04 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52 row-size=69B cardinality=26.86M cost=11922966 -| | | in pipelines: 40(GETNEXT), 47(OPEN) +| | | tuple-ids=40,42,44,46,48,50 row-size=69B cardinality=26.86M cost=11922966 +| | | in pipelines: 39(GETNEXT), 46(OPEN) | | | | | |--F54:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=2.04MB mem-reservation=1.94MB thread-reservation=1 @@ -1150,19 +1150,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 123:EXCHANGE [BROADCAST] | | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=50,52 row-size=12B cardinality=7.20K cost=9560 -| | | | in pipelines: 47(GETNEXT) +| | | | tuple-ids=48,50 row-size=12B cardinality=7.20K cost=9560 +| | | | in pipelines: 46(GETNEXT) | | | | | | | F42:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[4929] -| | | 49:HASH JOIN [INNER JOIN, BROADCAST] +| | | 48:HASH JOIN [INNER JOIN, BROADCAST] | | | | hash-table-id=05 | | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=50,52 row-size=12B cardinality=7.20K cost=3151 -| | | | in pipelines: 47(GETNEXT), 48(OPEN) +| | | | tuple-ids=48,50 row-size=12B cardinality=7.20K cost=3151 +| | | | in pipelines: 46(GETNEXT), 47(OPEN) | | | | | | | |--F55:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -1175,13 +1175,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | | | 122:EXCHANGE [BROADCAST] | | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=52 row-size=4B cardinality=20 cost=2 -| | | | | in pipelines: 48(GETNEXT) +| | | | | tuple-ids=50 row-size=4B cardinality=20 cost=2 +| | | | | in pipelines: 47(GETNEXT) | | | | | | | | | F43:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | | max-parallelism=1 segment-costs=[1] -| | | | 48:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | | HDFS partitions=1/1 files=1 size=1.22KB | | | | predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | stored statistics: @@ -1190,10 +1190,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | | tuple-ids=52 row-size=4B cardinality=20 cost=1 -| | | | in pipelines: 48(GETNEXT) +| | | | tuple-ids=50 row-size=4B cardinality=20 cost=1 +| | | | in pipelines: 47(GETNEXT) | | | | -| | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | | 46:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | | HDFS partitions=1/1 files=1 size=41.69KB | | | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | runtime filters: RF085[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk @@ -1203,16 +1203,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | | tuple-ids=50 row-size=8B cardinality=7.20K cost=1234 -| | | in pipelines: 47(GETNEXT) +| | | tuple-ids=48 row-size=8B cardinality=7.20K cost=1234 +| | | in pipelines: 46(GETNEXT) | | | -| | 46:HASH JOIN [INNER JOIN, BROADCAST] +| | 45:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=06 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48 row-size=57B cardinality=27.51M cost=12041917 -| | | in pipelines: 40(GETNEXT), 45(OPEN) +| | | tuple-ids=40,42,44,46 row-size=57B cardinality=27.51M cost=12041917 +| | | in pipelines: 39(GETNEXT), 44(OPEN) | | | | | |--F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -1225,13 +1225,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 121:EXCHANGE [BROADCAST] | | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=48 row-size=8B cardinality=73.05K cost=97080 -| | | | in pipelines: 45(GETNEXT) +| | | | tuple-ids=46 row-size=8B cardinality=73.05K cost=97080 +| | | | in pipelines: 44(GETNEXT) | | | | | | | F41:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[13622] -| | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: @@ -1240,16 +1240,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=48 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 45(GETNEXT) +| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 44(GETNEXT) | | | -| | 44:HASH JOIN [INNER JOIN, BROADCAST] +| | 43:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=07 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=49B cardinality=27.51M cost=12041917 -| | | in pipelines: 40(GETNEXT), 43(OPEN) +| | | tuple-ids=40,42,44 row-size=49B cardinality=27.51M cost=12041917 +| | | in pipelines: 39(GETNEXT), 42(OPEN) | | | | | |--F57:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -1262,13 +1262,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 120:EXCHANGE [BROADCAST] | | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=46 row-size=8B cardinality=73.05K cost=97080 -| | | | in pipelines: 43(GETNEXT) +| | | | tuple-ids=44 row-size=8B cardinality=73.05K cost=97080 +| | | | in pipelines: 42(GETNEXT) | | | | | | | F40:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[13622] -| | | 43:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: @@ -1277,47 +1277,47 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 43(GETNEXT) +| | | tuple-ids=44 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 42(GETNEXT) | | | -| | 42:HASH JOIN [INNER JOIN, BROADCAST] +| | 41:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=08 -| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44 row-size=41B cardinality=27.51M cost=12129392 -| | | in pipelines: 40(GETNEXT), 41(OPEN) +| | | tuple-ids=40,42 row-size=41B cardinality=27.51M cost=12129392 +| | | in pipelines: 39(GETNEXT), 40(OPEN) | | | | | |--F58:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=89.35MB mem-reservation=34.00MB thread-reservation=1 | | | | max-parallelism=10 segment-costs=[4473540] | | | JOIN BUILD | | | | join-table-id=08 plan-id=09 cohort-id=03 -| | | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk | | | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | | | 119:EXCHANGE [BROADCAST] | | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=44 row-size=17B cardinality=1.92M cost=2552740 -| | | | in pipelines: 41(GETNEXT) +| | | | tuple-ids=42 row-size=17B cardinality=1.92M cost=2552740 +| | | | in pipelines: 40(GETNEXT) | | | | | | | F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[375900] -| | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | | HDFS partitions=1/1 files=1 size=11.15MB -| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | stored statistics: | | | table: rows=1.92M size=11.15MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=17B cardinality=1.92M cost=246246 -| | | in pipelines: 41(GETNEXT) +| | | tuple-ids=42 row-size=17B cardinality=1.92M cost=246246 +| | | in pipelines: 40(GETNEXT) | | | -| | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | runtime filters: RF077[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk, RF083[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk, RF075[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk, RF079[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk, RF081[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk @@ -1327,16 +1327,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=42 row-size=24B cardinality=27.85M cost=15426000 -| | in pipelines: 40(GETNEXT) +| | tuple-ids=40 row-size=24B cardinality=27.85M cost=15426000 +| | in pipelines: 39(GETNEXT) | | -| 74:HASH JOIN [INNER JOIN, BROADCAST] +| 73:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=09 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56 row-size=299B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 53(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54 row-size=299B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 52(OPEN) | | | |--F59:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=1.47GB mem-reservation=408.00MB thread-reservation=1 @@ -1349,13 +1349,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 118:EXCHANGE [BROADCAST] | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=56 row-size=78B cardinality=15.00M cost=19934990 -| | | in pipelines: 53(GETNEXT) +| | | tuple-ids=54 row-size=78B cardinality=15.00M cost=19934990 +| | | in pipelines: 52(GETNEXT) | | | | | F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.32MB mem-reservation=128.00KB thread-reservation=1 | | max-parallelism=10 segment-costs=[10270756] -| | 53:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | 52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | stored statistics: @@ -1364,16 +1364,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=56 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 53(GETNEXT) +| | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 52(GETNEXT) | | -| 73:HASH JOIN [INNER JOIN, BROADCAST] +| 72:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=10 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77 row-size=221B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 72(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75 row-size=221B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 71(OPEN) | | | |--F60:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.34MB mem-reservation=23.25MB thread-reservation=1 @@ -1386,13 +1386,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 117:EXCHANGE [BROADCAST] | | | mem-estimate=89.13KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=77 row-size=37B cardinality=1.34K cost=1770 -| | | in pipelines: 72(GETNEXT) +| | | tuple-ids=75 row-size=37B cardinality=1.34K cost=1770 +| | | in pipelines: 71(GETNEXT) | | | | | F36:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[527] -| | 72:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] +| | 71:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] | | HDFS partitions=1/1 files=1 size=119.76KB | | predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | stored statistics: @@ -1401,16 +1401,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.35K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| | tuple-ids=77 row-size=37B cardinality=1.34K cost=365 -| | in pipelines: 72(GETNEXT) +| | tuple-ids=75 row-size=37B cardinality=1.34K cost=365 +| | in pipelines: 71(GETNEXT) | | -| 71:HASH JOIN [INNER JOIN, BROADCAST] +| 70:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=11 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76 row-size=184B cardinality=863.99M cost=157333400 -| | in pipelines: 54(GETNEXT), 115(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74 row-size=184B cardinality=863.99M cost=157333400 +| | in pipelines: 53(GETNEXT), 115(OPEN) | | | |--F61:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=36.13MB mem-reservation=34.50MB thread-reservation=1 @@ -1423,7 +1423,7 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 116:EXCHANGE [BROADCAST] | | | mem-estimate=1.63MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=36.02K cost=47860 +| | | tuple-ids=74 row-size=36B cardinality=36.02K cost=47860 | | | in pipelines: 115(GETNEXT) | | | | | F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk)] hosts=10 instances=10 (adjusted from 120) @@ -1434,31 +1434,31 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | group by: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit))) | | | mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=36.02K cost=16606891 -| | | in pipelines: 115(GETNEXT), 67(OPEN) +| | | tuple-ids=74 row-size=36B cardinality=36.02K cost=16606891 +| | | in pipelines: 115(GETNEXT), 66(OPEN) | | | | | 114:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk)] | | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=43.22M cost=11959416 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=74 row-size=36B cardinality=43.22M cost=11959416 +| | | in pipelines: 66(GETNEXT) | | | | | F34:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=23.91MB mem-reservation=2.00MB thread-reservation=1 | | max-parallelism=330 segment-costs=[3269691390, 122472725] cpu-comparison-result=240 [max(240 (self) vs 230 (sum children))] -| | 70:AGGREGATE [STREAMING] +| | 69:AGGREGATE [STREAMING] | | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit)) | | | group by: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=43.22M cost=1040366503 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=74 row-size=36B cardinality=43.22M cost=1040366503 +| | | in pipelines: 66(GETNEXT) | | | -| | 69:HASH JOIN [INNER JOIN, PARTITIONED] +| | 68:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash-table-id=12 | | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=72,74 row-size=40B cardinality=2.56G cost=1490184428 -| | | in pipelines: 67(GETNEXT), 68(OPEN) +| | | tuple-ids=70,72 row-size=40B cardinality=2.56G cost=1490184428 +| | | in pipelines: 66(GETNEXT), 67(OPEN) | | | | | |--F62:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] hosts=10 instances=120 | | | | Per-Instance Resources: mem-estimate=197.81MB mem-reservation=34.00MB thread-reservation=1 @@ -1471,13 +1471,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 113:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk,tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number)] | | | | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=74 row-size=24B cardinality=432.02M cost=95691763 -| | | | in pipelines: 68(GETNEXT) +| | | | tuple-ids=72 row-size=24B cardinality=432.02M cost=95691763 +| | | | in pipelines: 67(GETNEXT) | | | | | | | F33:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=40.00KB thread-reservation=1 | | | max-parallelism=110 segment-costs=[1063885041] -| | | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] +| | | 67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] | | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | | predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | stored statistics: @@ -1487,18 +1487,18 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | | tuple-ids=74 row-size=24B cardinality=432.02M cost=173584426 -| | | in pipelines: 68(GETNEXT) +| | | tuple-ids=72 row-size=24B cardinality=432.02M cost=173584426 +| | | in pipelines: 67(GETNEXT) | | | | | 112:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] | | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=72 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=70 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 +| | | in pipelines: 66(GETNEXT) | | | | | F32:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=25.38MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=750 segment-costs=[7423383372] -| | 67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] +| | 66:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] | | HDFS partitions=1831/1831 files=1831 size=280.96GB | | predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | runtime filters: RF072[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk, RF073[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number @@ -1509,16 +1509,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=21.52M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=72 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| | in pipelines: 67(GETNEXT) +| | tuple-ids=70 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| | in pipelines: 66(GETNEXT) | | -| 66:HASH JOIN [INNER JOIN, BROADCAST] +| 65:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=13 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70 row-size=148B cardinality=3.03M cost=1346203 -| | in pipelines: 54(GETNEXT), 63(OPEN) +| | tuple-ids=56,58,60,62,64,66,68 row-size=148B cardinality=3.03M cost=1346203 +| | in pipelines: 53(GETNEXT), 62(OPEN) | | | |--F63:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.35MB mem-reservation=23.25MB thread-reservation=1 @@ -1531,19 +1531,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 111:EXCHANGE [BROADCAST] | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=68,70 row-size=12B cardinality=7.20K cost=9560 -| | | in pipelines: 63(GETNEXT) +| | | tuple-ids=66,68 row-size=12B cardinality=7.20K cost=9560 +| | | in pipelines: 62(GETNEXT) | | | | | F30:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[4929] -| | 65:HASH JOIN [INNER JOIN, BROADCAST] +| | 64:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=14 | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=68,70 row-size=12B cardinality=7.20K cost=3151 -| | | in pipelines: 63(GETNEXT), 64(OPEN) +| | | tuple-ids=66,68 row-size=12B cardinality=7.20K cost=3151 +| | | in pipelines: 62(GETNEXT), 63(OPEN) | | | | | |--F64:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -1556,13 +1556,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 110:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=70 row-size=4B cardinality=20 cost=2 -| | | | in pipelines: 64(GETNEXT) +| | | | tuple-ids=68 row-size=4B cardinality=20 cost=2 +| | | | in pipelines: 63(GETNEXT) | | | | | | | F31:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[1] -| | | 64:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -1571,10 +1571,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=70 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 64(GETNEXT) +| | | tuple-ids=68 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 63(GETNEXT) | | | -| | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | 62:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | runtime filters: RF069[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk @@ -1584,20 +1584,20 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=68 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 63(GETNEXT) +| | tuple-ids=66 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 62(GETNEXT) | | -| 62:HASH JOIN [INNER JOIN, PARTITIONED] +| 61:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=15 | | hash predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66 row-size=136B cardinality=3.11M cost=14728555 -| | in pipelines: 54(GETNEXT), 55(OPEN) +| | tuple-ids=56,58,60,62,64 row-size=136B cardinality=3.11M cost=14728555 +| | in pipelines: 53(GETNEXT), 54(OPEN) | | | |--F65:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=80.50MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB -| | | max-parallelism=1620 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] +| | | max-parallelism=1600 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] | | JOIN BUILD | | | join-table-id=15 plan-id=16 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number @@ -1606,20 +1606,20 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 109:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number)] | | | mem-estimate=26.43MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=60,62,64,66 row-size=124B cardinality=31.06M cost=24632285 -| | | in pipelines: 55(GETNEXT) +| | | tuple-ids=58,60,62,64 row-size=124B cardinality=31.06M cost=24632285 +| | | in pipelines: 54(GETNEXT) | | | | | F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB | | Per-Instance Resources: mem-estimate=81.73MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=370 segment-costs=[3699964557] -| | 61:HASH JOIN [INNER JOIN, BROADCAST] +| | 60:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=16 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64,66 row-size=124B cardinality=31.06M cost=49244553 -| | | in pipelines: 55(GETNEXT), 60(OPEN) +| | | tuple-ids=58,60,62,64 row-size=124B cardinality=31.06M cost=49244553 +| | | in pipelines: 54(GETNEXT), 59(OPEN) | | | | | |--F66:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.93MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -1632,33 +1632,33 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 107:EXCHANGE [BROADCAST] | | | | mem-estimate=693.62KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=66 row-size=60B cardinality=7.42K cost=9860 -| | | | in pipelines: 60(GETNEXT) +| | | | tuple-ids=64 row-size=60B cardinality=7.42K cost=9860 +| | | | in pipelines: 59(GETNEXT) | | | | | | | F28:PLAN FRAGMENT [RANDOM] hosts=4 instances=4 | | | Per-Instance Resources: mem-estimate=16.25MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=4 segment-costs=[249892] -| | | 60:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] +| | | max-parallelism=4 segment-costs=[229660] +| | | 59:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | | HDFS partitions=1/1 files=1 size=33.54MB -| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | stored statistics: | | | table: rows=360.00K size=33.54MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=66 row-size=60B cardinality=7.42K cost=248525 -| | | in pipelines: 60(GETNEXT) +| | | tuple-ids=64 row-size=60B cardinality=7.42K cost=228293 +| | | in pipelines: 59(GETNEXT) | | | -| | 59:HASH JOIN [INNER JOIN, BROADCAST] +| | 58:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=17 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 -| | | in pipelines: 55(GETNEXT), 58(OPEN) +| | | tuple-ids=58,60,62 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 +| | | in pipelines: 54(GETNEXT), 57(OPEN) | | | | | |--F67:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -1671,32 +1671,32 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 106:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=64 row-size=8B cardinality=373 cost=490 -| | | | in pipelines: 58(GETNEXT) +| | | | tuple-ids=62 row-size=8B cardinality=373 cost=490 +| | | | in pipelines: 57(GETNEXT) | | | | | | | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[12536] -| | | 58:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 57:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=64 row-size=8B cardinality=373 cost=12520 -| | | in pipelines: 58(GETNEXT) +| | | tuple-ids=62 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 57(GETNEXT) | | | -| | 57:HASH JOIN [INNER JOIN, BROADCAST] +| | 56:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=18 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 -| | | in pipelines: 55(GETNEXT), 56(OPEN) +| | | tuple-ids=58,60 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 +| | | in pipelines: 54(GETNEXT), 55(OPEN) | | | | | |--F68:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1 @@ -1709,13 +1709,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 105:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=62 row-size=4B cardinality=1.80K cost=2390 -| | | | in pipelines: 56(GETNEXT) +| | | | tuple-ids=60 row-size=4B cardinality=1.80K cost=2390 +| | | | in pipelines: 55(GETNEXT) | | | | | | | F26:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=32.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[212] -| | | 56:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] +| | | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] | | | HDFS partitions=1/1 files=1 size=100.50KB | | | predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | stored statistics: @@ -1724,10 +1724,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | | tuple-ids=62 row-size=4B cardinality=1.80K cost=154 -| | | in pipelines: 56(GETNEXT) +| | | tuple-ids=60 row-size=4B cardinality=1.80K cost=154 +| | | in pipelines: 55(GETNEXT) | | | -| | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | | partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL | | HDFS partitions=1823/1824 files=1823 size=389.69GB | | predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL @@ -1736,22 +1736,22 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=60 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| | in pipelines: 55(GETNEXT) +| | tuple-ids=58 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| | in pipelines: 54(GETNEXT) | | | 108:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] | | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=58 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=56 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 +| | in pipelines: 53(GETNEXT) | | | F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=23.50MB mem-reservation=512.00KB thread-reservation=1 | max-parallelism=30 segment-costs=[268985600] -| 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] +| 53:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] | HDFS partitions=2004/2004 files=2004 size=48.14GB | predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | runtime filters: RF060[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF061[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number, RF055[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF058[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF059[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number @@ -1762,84 +1762,84 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=30.09M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=58 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 -| in pipelines: 54(GETNEXT) +| tuple-ids=56 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 +| in pipelines: 53(GETNEXT) | 130:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=1220353298 +| tuple-ids=39 row-size=283B cardinality=853.41M cost=1205411170 | in pipelines: 104(GETNEXT) | F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_product_name,tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_0.ca_city,tpcds_partitioned_parquet_snap.customer_address_0.ca_zip,tpcds_partitioned_parquet_snap.customer_address.ca_street_number,tpcds_partitioned_parquet_snap.customer_address.ca_street_name,tpcds_partitioned_parquet_snap.customer_address.ca_city,tpcds_partitioned_parquet_snap.customer_address.ca_zip,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] hosts=10 instances=120 Per-Instance Resources: mem-estimate=635.46MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1620 segment-costs=[6501600626, 16186220022] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] +max-parallelism=1600 segment-costs=[6421994378, 15988034328] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] 104:AGGREGATE [FINALIZE] | output: count:merge(), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt) | group by: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_year | mem-estimate=512.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=5281247328 -| in pipelines: 104(GETNEXT), 15(OPEN) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=5216583208 +| in pipelines: 104(GETNEXT), 14(OPEN) | 103:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_product_name,tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_0.ca_city,tpcds_partitioned_parquet_snap.customer_address_0.ca_zip,tpcds_partitioned_parquet_snap.customer_address.ca_street_number,tpcds_partitioned_parquet_snap.customer_address.ca_street_name,tpcds_partitioned_parquet_snap.customer_address.ca_city,tpcds_partitioned_parquet_snap.customer_address.ca_zip,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=1220353298 -| in pipelines: 15(GETNEXT) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=1205411170 +| in pipelines: 14(GETNEXT) | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=120 Per-Instance Resources: mem-estimate=657.08MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] +max-parallelism=1600 segment-costs=[6909938718, 15988034328] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] 38:AGGREGATE [STREAMING] | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt) | group by: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_year | mem-estimate=512.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=5281247328 -| in pipelines: 15(GETNEXT) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=5216583208 +| in pipelines: 14(GETNEXT) | 37:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=19 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk -| fk/pk conjuncts: none -| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14,0 row-size=462B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 00(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12,37 row-size=462B cardinality=853.41M cost=376253119 +| in pipelines: 14(GETNEXT), 36(OPEN) | |--F69:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=418.21MB mem-reservation=408.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[4473540] | JOIN BUILD | | join-table-id=19 plan-id=20 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk -| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | 102:EXCHANGE [BROADCAST] | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=0 row-size=17B cardinality=1.92M cost=2552740 -| | in pipelines: 00(GETNEXT) +| | tuple-ids=37 row-size=17B cardinality=1.92M cost=2552740 +| | in pipelines: 36(GETNEXT) | | | F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=10 segment-costs=[375900] -| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| 36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=11.15MB -| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | stored statistics: | table: rows=1.92M size=11.15MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=197.97K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=17B cardinality=1.92M cost=246246 -| in pipelines: 00(GETNEXT) +| tuple-ids=37 row-size=17B cardinality=1.92M cost=246246 +| in pipelines: 36(GETNEXT) | -36:HASH JOIN [INNER JOIN, BROADCAST] +35:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=20 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14 row-size=445B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 01(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12 row-size=445B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 00(OPEN) | |--F70:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=4.43GB mem-reservation=408.00MB thread-reservation=1 @@ -1852,19 +1852,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 101:EXCHANGE [BROADCAST] | | mem-estimate=11.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12,14 row-size=147B cardinality=26.86M cost=35690750 -| | in pipelines: 01(GETNEXT) +| | tuple-ids=0,2,4,6,8,10,12 row-size=147B cardinality=26.86M cost=35690750 +| | in pipelines: 00(GETNEXT) | | | F21:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=11.59MB mem-reservation=0B thread-reservation=1 | max-parallelism=10 segment-costs=[42890739] -| 13:HASH JOIN [INNER JOIN, PARTITIONED] +| 12:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=21 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12,14 row-size=147B cardinality=26.86M cost=11754583 -| | in pipelines: 01(GETNEXT), 12(OPEN) +| | tuple-ids=0,2,4,6,8,10,12 row-size=147B cardinality=26.86M cost=11754583 +| | in pipelines: 00(GETNEXT), 11(OPEN) | | | |--F71:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=160.14MB mem-reservation=34.00MB thread-reservation=1 @@ -1877,13 +1877,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 100:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=14 row-size=78B cardinality=15.00M cost=7017902 -| | | in pipelines: 12(GETNEXT) +| | | tuple-ids=12 row-size=78B cardinality=15.00M cost=7017902 +| | | in pipelines: 11(GETNEXT) | | | | | F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=19.19MB mem-reservation=128.00KB thread-reservation=1 | | max-parallelism=10 segment-costs=[89453349] -| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | stored statistics: @@ -1892,24 +1892,24 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 12(GETNEXT) +| | tuple-ids=12 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 11(GETNEXT) | | | 99:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] | | mem-estimate=10.91MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12 row-size=69B cardinality=26.86M cost=16448897 -| | in pipelines: 01(GETNEXT) +| | tuple-ids=0,2,4,6,8,10 row-size=69B cardinality=26.86M cost=16448897 +| | in pipelines: 00(GETNEXT) | | | F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=19.63MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=10 segment-costs=[265911830] -| 11:HASH JOIN [INNER JOIN, BROADCAST] +| 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=22 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12 row-size=69B cardinality=26.86M cost=11922966 -| | in pipelines: 01(GETNEXT), 08(OPEN) +| | tuple-ids=0,2,4,6,8,10 row-size=69B cardinality=26.86M cost=11922966 +| | in pipelines: 00(GETNEXT), 07(OPEN) | | | |--F72:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=2.04MB mem-reservation=1.94MB thread-reservation=1 @@ -1922,19 +1922,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 98:EXCHANGE [BROADCAST] | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=10,12 row-size=12B cardinality=7.20K cost=9560 -| | | in pipelines: 08(GETNEXT) +| | | tuple-ids=8,10 row-size=12B cardinality=7.20K cost=9560 +| | | in pipelines: 07(GETNEXT) | | | | | F18:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[4929] -| | 10:HASH JOIN [INNER JOIN, BROADCAST] +| | 09:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=23 | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=10,12 row-size=12B cardinality=7.20K cost=3151 -| | | in pipelines: 08(GETNEXT), 09(OPEN) +| | | tuple-ids=8,10 row-size=12B cardinality=7.20K cost=3151 +| | | in pipelines: 07(GETNEXT), 08(OPEN) | | | | | |--F73:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -1947,13 +1947,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | | | 97:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=12 row-size=4B cardinality=20 cost=2 -| | | | in pipelines: 09(GETNEXT) +| | | | tuple-ids=10 row-size=4B cardinality=20 cost=2 +| | | | in pipelines: 08(GETNEXT) | | | | | | | F19:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[1] -| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -1962,10 +1962,10 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=12 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 09(GETNEXT) +| | | tuple-ids=10 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 08(GETNEXT) | | | -| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | runtime filters: RF045[min_max] -> tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk @@ -1975,16 +1975,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 08(GETNEXT) +| | tuple-ids=8 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 07(GETNEXT) | | -| 07:HASH JOIN [INNER JOIN, BROADCAST] +| 06:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=24 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=57B cardinality=27.51M cost=12041917 -| | in pipelines: 01(GETNEXT), 06(OPEN) +| | tuple-ids=0,2,4,6 row-size=57B cardinality=27.51M cost=12041917 +| | in pipelines: 00(GETNEXT), 05(OPEN) | | | |--F74:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -1997,13 +1997,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 96:EXCHANGE [BROADCAST] | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=8 row-size=8B cardinality=73.05K cost=97080 -| | | in pipelines: 06(GETNEXT) +| | | tuple-ids=6 row-size=8B cardinality=73.05K cost=97080 +| | | in pipelines: 05(GETNEXT) | | | | | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[13622] -| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: @@ -2012,16 +2012,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 06(GETNEXT) +| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 05(GETNEXT) | | -| 05:HASH JOIN [INNER JOIN, BROADCAST] +| 04:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=25 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=49B cardinality=27.51M cost=12041917 -| | in pipelines: 01(GETNEXT), 04(OPEN) +| | tuple-ids=0,2,4 row-size=49B cardinality=27.51M cost=12041917 +| | in pipelines: 00(GETNEXT), 03(OPEN) | | | |--F75:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -2034,13 +2034,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 95:EXCHANGE [BROADCAST] | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=6 row-size=8B cardinality=73.05K cost=97080 -| | | in pipelines: 04(GETNEXT) +| | | tuple-ids=4 row-size=8B cardinality=73.05K cost=97080 +| | | in pipelines: 03(GETNEXT) | | | | | F16:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[13622] -| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: @@ -2049,47 +2049,47 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 04(GETNEXT) +| | tuple-ids=4 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 03(GETNEXT) | | -| 03:HASH JOIN [INNER JOIN, BROADCAST] +| 02:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=26 -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4 row-size=41B cardinality=27.51M cost=12129392 -| | in pipelines: 01(GETNEXT), 02(OPEN) +| | tuple-ids=0,2 row-size=41B cardinality=27.51M cost=12129392 +| | in pipelines: 00(GETNEXT), 01(OPEN) | | | |--F76:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=89.35MB mem-reservation=34.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[4473540] | | JOIN BUILD | | | join-table-id=26 plan-id=27 cohort-id=08 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk | | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | 94:EXCHANGE [BROADCAST] | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=4 row-size=17B cardinality=1.92M cost=2552740 -| | | in pipelines: 02(GETNEXT) +| | | tuple-ids=2 row-size=17B cardinality=1.92M cost=2552740 +| | | in pipelines: 01(GETNEXT) | | | | | F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[375900] -| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=4 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 02(GETNEXT) +| | tuple-ids=2 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 01(GETNEXT) | | -| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | HDFS partitions=1/1 files=1 size=1.55GB | predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | runtime filters: RF037[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk, RF043[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk, RF035[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF039[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk, RF041[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk @@ -2099,16 +2099,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=3.10M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=27.85M cost=15426000 -| in pipelines: 01(GETNEXT) +| tuple-ids=0 row-size=24B cardinality=27.85M cost=15426000 +| in pipelines: 00(GETNEXT) | -35:HASH JOIN [INNER JOIN, BROADCAST] +34:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=27 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16 row-size=299B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 14(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14 row-size=299B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 13(OPEN) | |--F77:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=1.47GB mem-reservation=408.00MB thread-reservation=1 @@ -2121,13 +2121,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 93:EXCHANGE [BROADCAST] | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=16 row-size=78B cardinality=15.00M cost=19934990 -| | in pipelines: 14(GETNEXT) +| | tuple-ids=14 row-size=78B cardinality=15.00M cost=19934990 +| | in pipelines: 13(GETNEXT) | | | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=16.32MB mem-reservation=128.00KB thread-reservation=1 | max-parallelism=10 segment-costs=[10270756] -| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | HDFS partitions=1/1 files=1 size=307.36MB | predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | stored statistics: @@ -2136,16 +2136,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=1.58M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=16 row-size=78B cardinality=15.00M cost=6805716 -| in pipelines: 14(GETNEXT) +| tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 +| in pipelines: 13(GETNEXT) | -34:HASH JOIN [INNER JOIN, BROADCAST] +33:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=28 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37 row-size=221B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 33(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35 row-size=221B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 32(OPEN) | |--F78:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=23.34MB mem-reservation=23.25MB thread-reservation=1 @@ -2158,13 +2158,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 92:EXCHANGE [BROADCAST] | | mem-estimate=89.13KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=37 row-size=37B cardinality=1.34K cost=1770 -| | in pipelines: 33(GETNEXT) +| | tuple-ids=35 row-size=37B cardinality=1.34K cost=1770 +| | in pipelines: 32(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1 | max-parallelism=1 segment-costs=[527] -| 33:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] +| 32:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] | HDFS partitions=1/1 files=1 size=119.76KB | predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | runtime filters: RF004[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_name, RF005[min_max] -> tpcds_partitioned_parquet_snap.store.s_zip @@ -2174,16 +2174,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=1.35K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| tuple-ids=37 row-size=37B cardinality=1.34K cost=365 -| in pipelines: 33(GETNEXT) +| tuple-ids=35 row-size=37B cardinality=1.34K cost=365 +| in pipelines: 32(GETNEXT) | -32:HASH JOIN [INNER JOIN, BROADCAST] +31:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=29 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36 row-size=184B cardinality=863.99M cost=157333400 -| in pipelines: 15(GETNEXT), 90(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34 row-size=184B cardinality=863.99M cost=157333400 +| in pipelines: 14(GETNEXT), 90(OPEN) | |--F79:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=36.13MB mem-reservation=34.50MB thread-reservation=1 @@ -2196,7 +2196,7 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 91:EXCHANGE [BROADCAST] | | mem-estimate=1.63MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=36.02K cost=47860 +| | tuple-ids=34 row-size=36B cardinality=36.02K cost=47860 | | in pipelines: 90(GETNEXT) | | | F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk)] hosts=10 instances=10 (adjusted from 120) @@ -2207,31 +2207,31 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit))) | | mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=36.02K cost=16606891 -| | in pipelines: 90(GETNEXT), 28(OPEN) +| | tuple-ids=34 row-size=36B cardinality=36.02K cost=16606891 +| | in pipelines: 90(GETNEXT), 27(OPEN) | | | 89:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk)] | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=43.22M cost=11959416 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=34 row-size=36B cardinality=43.22M cost=11959416 +| | in pipelines: 27(GETNEXT) | | | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=23.91MB mem-reservation=2.00MB thread-reservation=1 | max-parallelism=330 segment-costs=[3269691390, 122472725] cpu-comparison-result=240 [max(240 (self) vs 230 (sum children))] -| 31:AGGREGATE [STREAMING] +| 30:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit)) | | group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=43.22M cost=1040366503 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=34 row-size=36B cardinality=43.22M cost=1040366503 +| | in pipelines: 27(GETNEXT) | | -| 30:HASH JOIN [INNER JOIN, PARTITIONED] +| 29:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=30 | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=32,34 row-size=40B cardinality=2.56G cost=1490184428 -| | in pipelines: 28(GETNEXT), 29(OPEN) +| | tuple-ids=30,32 row-size=40B cardinality=2.56G cost=1490184428 +| | in pipelines: 27(GETNEXT), 28(OPEN) | | | |--F80:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=214.81MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB @@ -2244,13 +2244,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 88:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk,tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number)] | | | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=34 row-size=24B cardinality=432.02M cost=95691763 -| | | in pipelines: 29(GETNEXT) +| | | tuple-ids=32 row-size=24B cardinality=432.02M cost=95691763 +| | | in pipelines: 28(GETNEXT) | | | | | F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=40.00KB thread-reservation=1 | | max-parallelism=110 segment-costs=[1063885041] -| | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] +| | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk @@ -2261,19 +2261,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | tuple-ids=34 row-size=24B cardinality=432.02M cost=173584426 -| | in pipelines: 29(GETNEXT) +| | tuple-ids=32 row-size=24B cardinality=432.02M cost=173584426 +| | in pipelines: 28(GETNEXT) | | | 87:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=32 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=30 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 +| | in pipelines: 27(GETNEXT) | | | F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=25.38MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=750 segment-costs=[7423383372] -| 28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] +| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] | HDFS partitions=1831/1831 files=1831 size=280.96GB | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | runtime filters: RF032[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF033[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF031[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number @@ -2284,16 +2284,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=21.52M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=32 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| in pipelines: 28(GETNEXT) +| tuple-ids=30 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| in pipelines: 27(GETNEXT) | -27:HASH JOIN [INNER JOIN, BROADCAST] +26:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=31 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30 row-size=148B cardinality=3.03M cost=1346203 -| in pipelines: 15(GETNEXT), 24(OPEN) +| tuple-ids=16,18,20,22,24,26,28 row-size=148B cardinality=3.03M cost=1346203 +| in pipelines: 14(GETNEXT), 23(OPEN) | |--F81:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=23.35MB mem-reservation=23.25MB thread-reservation=1 @@ -2306,19 +2306,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 86:EXCHANGE [BROADCAST] | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=28,30 row-size=12B cardinality=7.20K cost=9560 -| | in pipelines: 24(GETNEXT) +| | tuple-ids=26,28 row-size=12B cardinality=7.20K cost=9560 +| | in pipelines: 23(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | max-parallelism=1 segment-costs=[4929] -| 26:HASH JOIN [INNER JOIN, BROADCAST] +| 25:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=32 | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=28,30 row-size=12B cardinality=7.20K cost=3151 -| | in pipelines: 24(GETNEXT), 25(OPEN) +| | tuple-ids=26,28 row-size=12B cardinality=7.20K cost=3151 +| | in pipelines: 23(GETNEXT), 24(OPEN) | | | |--F82:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -2331,13 +2331,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 85:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=30 row-size=4B cardinality=20 cost=2 -| | | in pipelines: 25(GETNEXT) +| | | tuple-ids=28 row-size=4B cardinality=20 cost=2 +| | | in pipelines: 24(GETNEXT) | | | | | F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[1] -| | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | HDFS partitions=1/1 files=1 size=1.22KB | | predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | stored statistics: @@ -2346,10 +2346,10 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | tuple-ids=30 row-size=4B cardinality=20 cost=1 -| | in pipelines: 25(GETNEXT) +| | tuple-ids=28 row-size=4B cardinality=20 cost=1 +| | in pipelines: 24(GETNEXT) | | -| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=41.69KB | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | runtime filters: RF029[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk @@ -2359,20 +2359,20 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=7.20K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| tuple-ids=28 row-size=8B cardinality=7.20K cost=1234 -| in pipelines: 24(GETNEXT) +| tuple-ids=26 row-size=8B cardinality=7.20K cost=1234 +| in pipelines: 23(GETNEXT) | -23:HASH JOIN [INNER JOIN, PARTITIONED] +22:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=33 | hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26 row-size=136B cardinality=3.11M cost=14728555 -| in pipelines: 15(GETNEXT), 16(OPEN) +| tuple-ids=16,18,20,22,24 row-size=136B cardinality=3.11M cost=14728555 +| in pipelines: 14(GETNEXT), 15(OPEN) | |--F83:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=80.50MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB -| | max-parallelism=1620 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] +| | max-parallelism=1600 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] | JOIN BUILD | | join-table-id=33 plan-id=34 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number @@ -2381,20 +2381,20 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 84:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] | | mem-estimate=26.43MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=20,22,24,26 row-size=124B cardinality=31.06M cost=24632285 -| | in pipelines: 16(GETNEXT) +| | tuple-ids=18,20,22,24 row-size=124B cardinality=31.06M cost=24632285 +| | in pipelines: 15(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB | Per-Instance Resources: mem-estimate=81.73MB mem-reservation=512.00KB thread-reservation=1 | max-parallelism=370 segment-costs=[3699964557] -| 22:HASH JOIN [INNER JOIN, BROADCAST] +| 21:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=34 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24,26 row-size=124B cardinality=31.06M cost=49244553 -| | in pipelines: 16(GETNEXT), 21(OPEN) +| | tuple-ids=18,20,22,24 row-size=124B cardinality=31.06M cost=49244553 +| | in pipelines: 15(GETNEXT), 20(OPEN) | | | |--F84:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.93MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -2407,33 +2407,33 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 82:EXCHANGE [BROADCAST] | | | mem-estimate=693.62KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=26 row-size=60B cardinality=7.42K cost=9860 -| | | in pipelines: 21(GETNEXT) +| | | tuple-ids=24 row-size=60B cardinality=7.42K cost=9860 +| | | in pipelines: 20(GETNEXT) | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4 | | Per-Instance Resources: mem-estimate=16.25MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=4 segment-costs=[249892] -| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] +| | max-parallelism=4 segment-costs=[229660] +| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=26 row-size=60B cardinality=7.42K cost=248525 -| | in pipelines: 21(GETNEXT) +| | tuple-ids=24 row-size=60B cardinality=7.42K cost=228293 +| | in pipelines: 20(GETNEXT) | | -| 20:HASH JOIN [INNER JOIN, BROADCAST] +| 19:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=35 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 -| | in pipelines: 16(GETNEXT), 19(OPEN) +| | tuple-ids=18,20,22 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 +| | in pipelines: 15(GETNEXT), 18(OPEN) | | | |--F85:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -2446,13 +2446,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 81:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=24 row-size=8B cardinality=373 cost=490 -| | | in pipelines: 19(GETNEXT) +| | | tuple-ids=22 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 18(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[12536] -| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: @@ -2462,16 +2462,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=24 row-size=8B cardinality=373 cost=12520 -| | in pipelines: 19(GETNEXT) +| | tuple-ids=22 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 18(GETNEXT) | | -| 18:HASH JOIN [INNER JOIN, BROADCAST] +| 17:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=36 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 -| | in pipelines: 16(GETNEXT), 17(OPEN) +| | tuple-ids=18,20 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 +| | in pipelines: 15(GETNEXT), 16(OPEN) | | | |--F86:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1 @@ -2484,13 +2484,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 80:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=22 row-size=4B cardinality=1.80K cost=2390 -| | | in pipelines: 17(GETNEXT) +| | | tuple-ids=20 row-size=4B cardinality=1.80K cost=2390 +| | | in pipelines: 16(GETNEXT) | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=32.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[212] -| | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] +| | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] | | HDFS partitions=1/1 files=1 size=100.50KB | | predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | stored statistics: @@ -2499,34 +2499,34 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | tuple-ids=22 row-size=4B cardinality=1.80K cost=154 -| | in pipelines: 17(GETNEXT) +| | tuple-ids=20 row-size=4B cardinality=1.80K cost=154 +| | in pipelines: 16(GETNEXT) | | -| 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL | HDFS partitions=1823/1824 files=1823 size=389.69GB | predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL -| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk +| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=20 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| in pipelines: 16(GETNEXT) +| tuple-ids=18 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| in pipelines: 15(GETNEXT) | 83:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| tuple-ids=18 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 -| in pipelines: 15(GETNEXT) +| tuple-ids=16 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 +| in pipelines: 14(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120) Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB Per-Instance Resources: mem-estimate=23.50MB mem-reservation=512.00KB thread-reservation=1 max-parallelism=30 segment-costs=[268985600] -15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] +14:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] HDFS partitions=2004/2004 files=2004 size=48.14GB predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL runtime filters: RF020[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF021[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF019[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number @@ -2537,31 +2537,31 @@ max-parallelism=30 segment-costs=[268985600] extrapolated-rows=disabled max-scan-range-rows=30.09M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=18 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 - in pipelines: 15(GETNEXT) + tuple-ids=16 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 + in pipelines: 14(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=7.29GB Threads=285 -Per-Host Resource Estimates: Memory=108.50GB +Per-Host Resource Estimates: Memory=107.90GB F49:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=1.21GB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[18927253995] cpu-comparison-result=1230 [max(1 (self) vs 1230 (sum children))] +| max-parallelism=1 segment-costs=[18695507348] cpu-comparison-result=1230 [max(1 (self) vs 1230 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), add(CAST(2000 AS INT), CAST(1 AS INT)), count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=18143864832 +| output exprs: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(2000 AS INT), count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt), CAST(2001 AS INT), count() +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=17921710080 | 132:MERGING-EXCHANGE [UNPARTITIONED] | order by: tpcds_partitioned_parquet_snap.item.i_product_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, count() ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost) ASC NULLS LAST | mem-estimate=1.11GB mem-reservation=0B thread-reservation=0 -| tuple-ids=80 row-size=327B cardinality=863.99M cost=783389163 +| tuple-ids=80 row-size=327B cardinality=853.41M cost=773797268 | in pipelines: 79(GETNEXT) | F48:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] hosts=10 instances=110 (adjusted from 10) -Per-Instance Resources: mem-estimate=2.43GB mem-reservation=12.00MB thread-reservation=1 -max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-result=1230 [max(110 (self) vs 1230 (sum children))] +Per-Instance Resources: mem-estimate=2.40GB mem-reservation=12.00MB thread-reservation=1 +max-parallelism=1410 segment-costs=[14062194210, 7577617839] cpu-comparison-result=1230 [max(110 (self) vs 1230 (sum children))] 79:SORT | order by: tpcds_partitioned_parquet_snap.item.i_product_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store.s_store_name ASC NULLS LAST, count() ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost) ASC NULLS LAST -| mem-estimate=2.39GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=80 row-size=327B cardinality=863.99M cost=12637984739 +| mem-estimate=2.36GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=80 row-size=327B cardinality=853.41M cost=12483243390 | in pipelines: 79(GETNEXT), 104(OPEN) | 78:HASH JOIN [INNER JOIN, PARTITIONED] @@ -2570,93 +2570,93 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | fk/pk conjuncts: tpcds_partitioned_parquet_snap.item.i_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name = tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip = tpcds_partitioned_parquet_snap.store_0.s_zip | other join predicates: count() <= count() | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39,79 row-size=566B cardinality=863.99M cost=378170002 +| tuple-ids=39,79 row-size=566B cardinality=853.41M cost=373539650 | in pipelines: 104(GETNEXT), 129(OPEN) | |--F50:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] hosts=10 instances=110 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=2.33GB mem-reservation=34.00MB thread-reservation=1 -| | max-parallelism=1430 segment-costs=[2084346906] cpu-comparison-result=615 [max(110 (self) vs 615 (sum children))] +| | Per-Instance Resources: mem-estimate=2.30GB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=1410 segment-costs=[2058825954] cpu-comparison-result=615 [max(110 (self) vs 615 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip | | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_item_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_store_name, RF005[min_max] <- tpcds_partitioned_parquet_snap.store_0.s_zip -| | mem-estimate=2.29GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=863993608 +| | mem-estimate=2.26GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=853414784 | | | 131:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip)] | | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=1220353298 +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=1205411170 | | in pipelines: 129(GETNEXT) | | | F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_product_name,tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_2.ca_city,tpcds_partitioned_parquet_snap.customer_address_2.ca_zip,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_1.ca_city,tpcds_partitioned_parquet_snap.customer_address_1.ca_zip,tpcds_partitioned_parquet_snap.date_dim_2.d_year,tpcds_partitioned_parquet_snap.date_dim_3.d_year)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=635.46MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=1620 segment-costs=[6501600626, 16186220022] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] +| max-parallelism=1600 segment-costs=[6421994378, 15988034328] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] | 129:AGGREGATE [FINALIZE] | | output: count:merge(), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt) | | group by: tpcds_partitioned_parquet_snap.item_0.i_product_name, tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_2.ca_city, tpcds_partitioned_parquet_snap.customer_address_2.ca_zip, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_1.ca_city, tpcds_partitioned_parquet_snap.customer_address_1.ca_zip, tpcds_partitioned_parquet_snap.date_dim_2.d_year, tpcds_partitioned_parquet_snap.date_dim_3.d_year | | mem-estimate=512.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=5281247328 -| | in pipelines: 129(GETNEXT), 54(OPEN) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=5216583208 +| | in pipelines: 129(GETNEXT), 53(OPEN) | | | 128:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_product_name,tpcds_partitioned_parquet_snap.item_0.i_item_sk,tpcds_partitioned_parquet_snap.store_0.s_store_name,tpcds_partitioned_parquet_snap.store_0.s_zip,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_2.ca_city,tpcds_partitioned_parquet_snap.customer_address_2.ca_zip,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_1.ca_city,tpcds_partitioned_parquet_snap.customer_address_1.ca_zip,tpcds_partitioned_parquet_snap.date_dim_2.d_year,tpcds_partitioned_parquet_snap.date_dim_3.d_year)] | | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=1220353298 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=1205411170 +| | in pipelines: 53(GETNEXT) | | | F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=657.08MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] +| max-parallelism=1600 segment-costs=[6909938718, 15988034328] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] | 77:AGGREGATE [STREAMING] | | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales_0.ss_coupon_amt) | | group by: tpcds_partitioned_parquet_snap.item_0.i_product_name, tpcds_partitioned_parquet_snap.item_0.i_item_sk, tpcds_partitioned_parquet_snap.store_0.s_store_name, tpcds_partitioned_parquet_snap.store_0.s_zip, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_2.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_2.ca_city, tpcds_partitioned_parquet_snap.customer_address_2.ca_zip, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_1.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_1.ca_city, tpcds_partitioned_parquet_snap.customer_address_1.ca_zip, tpcds_partitioned_parquet_snap.date_dim_2.d_year, tpcds_partitioned_parquet_snap.date_dim_3.d_year | | mem-estimate=512.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=79 row-size=283B cardinality=863.99M cost=5281247328 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=79 row-size=283B cardinality=853.41M cost=5216583208 +| | in pipelines: 53(GETNEXT) | | | 76:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=01 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk -| | fk/pk conjuncts: none -| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54,40 row-size=462B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 39(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52,77 row-size=462B cardinality=853.41M cost=376253119 +| | in pipelines: 53(GETNEXT), 75(OPEN) | | | |--F51:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=418.21MB mem-reservation=408.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[4473540] | | JOIN BUILD | | | join-table-id=01 plan-id=02 cohort-id=02 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk -| | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | 127:EXCHANGE [BROADCAST] | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=40 row-size=17B cardinality=1.92M cost=2552740 -| | | in pipelines: 39(GETNEXT) +| | | tuple-ids=77 row-size=17B cardinality=1.92M cost=2552740 +| | | in pipelines: 75(GETNEXT) | | | | | F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[375900] -| | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | 75:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=40 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 39(GETNEXT) +| | tuple-ids=77 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 75(GETNEXT) | | -| 75:HASH JOIN [INNER JOIN, BROADCAST] +| 74:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56,42,44,46,48,50,52,54 row-size=445B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 40(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54,40,42,44,46,48,50,52 row-size=445B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 39(OPEN) | | | |--F52:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=4.43GB mem-reservation=408.00MB thread-reservation=1 @@ -2669,19 +2669,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 126:EXCHANGE [BROADCAST] | | | mem-estimate=11.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52,54 row-size=147B cardinality=26.86M cost=35690750 -| | | in pipelines: 40(GETNEXT) +| | | tuple-ids=40,42,44,46,48,50,52 row-size=147B cardinality=26.86M cost=35690750 +| | | in pipelines: 39(GETNEXT) | | | | | F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=11.59MB mem-reservation=0B thread-reservation=1 | | max-parallelism=10 segment-costs=[42890739] -| | 52:HASH JOIN [INNER JOIN, PARTITIONED] +| | 51:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash-table-id=03 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52,54 row-size=147B cardinality=26.86M cost=11754583 -| | | in pipelines: 40(GETNEXT), 51(OPEN) +| | | tuple-ids=40,42,44,46,48,50,52 row-size=147B cardinality=26.86M cost=11754583 +| | | in pipelines: 39(GETNEXT), 50(OPEN) | | | | | |--F53:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=160.14MB mem-reservation=34.00MB thread-reservation=1 @@ -2694,13 +2694,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 125:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk)] | | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=54 row-size=78B cardinality=15.00M cost=7017902 -| | | | in pipelines: 51(GETNEXT) +| | | | tuple-ids=52 row-size=78B cardinality=15.00M cost=7017902 +| | | | in pipelines: 50(GETNEXT) | | | | | | | F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=19.19MB mem-reservation=128.00KB thread-reservation=1 | | | max-parallelism=10 segment-costs=[89453349] -| | | 51:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | | 50:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | | HDFS partitions=1/1 files=1 size=307.36MB | | | predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | stored statistics: @@ -2709,24 +2709,24 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_1.ca_address_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 -| | | in pipelines: 51(GETNEXT) +| | | tuple-ids=52 row-size=78B cardinality=15.00M cost=6805716 +| | | in pipelines: 50(GETNEXT) | | | | | 124:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk)] | | | mem-estimate=10.91MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52 row-size=69B cardinality=26.86M cost=16448897 -| | | in pipelines: 40(GETNEXT) +| | | tuple-ids=40,42,44,46,48,50 row-size=69B cardinality=26.86M cost=16448897 +| | | in pipelines: 39(GETNEXT) | | | | | F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=19.63MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[265911830] -| | 50:HASH JOIN [INNER JOIN, BROADCAST] +| | 49:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=04 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48,50,52 row-size=69B cardinality=26.86M cost=11922966 -| | | in pipelines: 40(GETNEXT), 47(OPEN) +| | | tuple-ids=40,42,44,46,48,50 row-size=69B cardinality=26.86M cost=11922966 +| | | in pipelines: 39(GETNEXT), 46(OPEN) | | | | | |--F54:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=2.04MB mem-reservation=1.94MB thread-reservation=1 @@ -2739,19 +2739,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 123:EXCHANGE [BROADCAST] | | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=50,52 row-size=12B cardinality=7.20K cost=9560 -| | | | in pipelines: 47(GETNEXT) +| | | | tuple-ids=48,50 row-size=12B cardinality=7.20K cost=9560 +| | | | in pipelines: 46(GETNEXT) | | | | | | | F42:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[4929] -| | | 49:HASH JOIN [INNER JOIN, BROADCAST] +| | | 48:HASH JOIN [INNER JOIN, BROADCAST] | | | | hash-table-id=05 | | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk | | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | | tuple-ids=50,52 row-size=12B cardinality=7.20K cost=3151 -| | | | in pipelines: 47(GETNEXT), 48(OPEN) +| | | | tuple-ids=48,50 row-size=12B cardinality=7.20K cost=3151 +| | | | in pipelines: 46(GETNEXT), 47(OPEN) | | | | | | | |--F55:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -2764,13 +2764,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | | | 122:EXCHANGE [BROADCAST] | | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | | tuple-ids=52 row-size=4B cardinality=20 cost=2 -| | | | | in pipelines: 48(GETNEXT) +| | | | | tuple-ids=50 row-size=4B cardinality=20 cost=2 +| | | | | in pipelines: 47(GETNEXT) | | | | | | | | | F43:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | | max-parallelism=1 segment-costs=[1] -| | | | 48:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | | HDFS partitions=1/1 files=1 size=1.22KB | | | | predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | stored statistics: @@ -2779,10 +2779,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_1.ib_income_band_sk IS NOT NULL | | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | | tuple-ids=52 row-size=4B cardinality=20 cost=1 -| | | | in pipelines: 48(GETNEXT) +| | | | tuple-ids=50 row-size=4B cardinality=20 cost=1 +| | | | in pipelines: 47(GETNEXT) | | | | -| | | 47:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | | 46:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | | HDFS partitions=1/1 files=1 size=41.69KB | | | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | runtime filters: RF085[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk @@ -2792,16 +2792,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | | tuple-ids=50 row-size=8B cardinality=7.20K cost=1234 -| | | in pipelines: 47(GETNEXT) +| | | tuple-ids=48 row-size=8B cardinality=7.20K cost=1234 +| | | in pipelines: 46(GETNEXT) | | | -| | 46:HASH JOIN [INNER JOIN, BROADCAST] +| | 45:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=06 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46,48 row-size=57B cardinality=27.51M cost=12041917 -| | | in pipelines: 40(GETNEXT), 45(OPEN) +| | | tuple-ids=40,42,44,46 row-size=57B cardinality=27.51M cost=12041917 +| | | in pipelines: 39(GETNEXT), 44(OPEN) | | | | | |--F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -2814,13 +2814,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 121:EXCHANGE [BROADCAST] | | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=48 row-size=8B cardinality=73.05K cost=97080 -| | | | in pipelines: 45(GETNEXT) +| | | | tuple-ids=46 row-size=8B cardinality=73.05K cost=97080 +| | | | in pipelines: 44(GETNEXT) | | | | | | | F41:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[13622] -| | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: @@ -2829,16 +2829,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=48 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 45(GETNEXT) +| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 44(GETNEXT) | | | -| | 44:HASH JOIN [INNER JOIN, BROADCAST] +| | 43:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=07 | | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | | tuple-ids=42,44,46 row-size=49B cardinality=27.51M cost=12041917 -| | | in pipelines: 40(GETNEXT), 43(OPEN) +| | | tuple-ids=40,42,44 row-size=49B cardinality=27.51M cost=12041917 +| | | in pipelines: 39(GETNEXT), 42(OPEN) | | | | | |--F57:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -2851,13 +2851,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 120:EXCHANGE [BROADCAST] | | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=46 row-size=8B cardinality=73.05K cost=97080 -| | | | in pipelines: 43(GETNEXT) +| | | | tuple-ids=44 row-size=8B cardinality=73.05K cost=97080 +| | | | in pipelines: 42(GETNEXT) | | | | | | | F40:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[13622] -| | | 43:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 42:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB | | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: @@ -2866,47 +2866,47 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=46 row-size=8B cardinality=73.05K cost=10467 -| | | in pipelines: 43(GETNEXT) +| | | tuple-ids=44 row-size=8B cardinality=73.05K cost=10467 +| | | in pipelines: 42(GETNEXT) | | | -| | 42:HASH JOIN [INNER JOIN, BROADCAST] +| | 41:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=08 -| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | hash predicates: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=42,44 row-size=41B cardinality=27.51M cost=12129392 -| | | in pipelines: 40(GETNEXT), 41(OPEN) +| | | tuple-ids=40,42 row-size=41B cardinality=27.51M cost=12129392 +| | | in pipelines: 39(GETNEXT), 40(OPEN) | | | | | |--F58:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=89.35MB mem-reservation=34.00MB thread-reservation=1 | | | | max-parallelism=10 segment-costs=[4473540] | | | JOIN BUILD | | | | join-table-id=08 plan-id=09 cohort-id=03 -| | | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk -| | | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk +| | | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk +| | | | runtime filters: RF083[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk | | | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | | | 119:EXCHANGE [BROADCAST] | | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=44 row-size=17B cardinality=1.92M cost=2552740 -| | | | in pipelines: 41(GETNEXT) +| | | | tuple-ids=42 row-size=17B cardinality=1.92M cost=2552740 +| | | | in pipelines: 40(GETNEXT) | | | | | | | F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[375900] -| | | 41:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | | HDFS partitions=1/1 files=1 size=11.15MB -| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | stored statistics: | | | table: rows=1.92M size=11.15MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_2.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_2.cd_marital_status IS NOT NULL +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_1.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_1.cd_marital_status IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | | tuple-ids=44 row-size=17B cardinality=1.92M cost=246246 -| | | in pipelines: 41(GETNEXT) +| | | tuple-ids=42 row-size=17B cardinality=1.92M cost=246246 +| | | in pipelines: 40(GETNEXT) | | | -| | 40:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | 39:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | runtime filters: RF077[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk, RF083[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk, RF075[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk, RF079[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk, RF081[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk @@ -2916,16 +2916,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=42 row-size=24B cardinality=27.85M cost=15426000 -| | in pipelines: 40(GETNEXT) +| | tuple-ids=40 row-size=24B cardinality=27.85M cost=15426000 +| | in pipelines: 39(GETNEXT) | | -| 74:HASH JOIN [INNER JOIN, BROADCAST] +| 73:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=09 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77,56 row-size=299B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 53(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75,54 row-size=299B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 52(OPEN) | | | |--F59:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=1.47GB mem-reservation=408.00MB thread-reservation=1 @@ -2938,13 +2938,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 118:EXCHANGE [BROADCAST] | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=56 row-size=78B cardinality=15.00M cost=19934990 -| | | in pipelines: 53(GETNEXT) +| | | tuple-ids=54 row-size=78B cardinality=15.00M cost=19934990 +| | | in pipelines: 52(GETNEXT) | | | | | F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.32MB mem-reservation=128.00KB thread-reservation=1 | | max-parallelism=10 segment-costs=[10270756] -| | 53:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | 52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | stored statistics: @@ -2953,16 +2953,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_2.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=56 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 53(GETNEXT) +| | tuple-ids=54 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 52(GETNEXT) | | -| 73:HASH JOIN [INNER JOIN, BROADCAST] +| 72:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=10 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk = tpcds_partitioned_parquet_snap.store_0.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76,77 row-size=221B cardinality=863.99M cost=378170002 -| | in pipelines: 54(GETNEXT), 72(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74,75 row-size=221B cardinality=863.99M cost=378170002 +| | in pipelines: 53(GETNEXT), 71(OPEN) | | | |--F60:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.34MB mem-reservation=23.25MB thread-reservation=1 @@ -2975,13 +2975,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 117:EXCHANGE [BROADCAST] | | | mem-estimate=89.13KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=77 row-size=37B cardinality=1.34K cost=1770 -| | | in pipelines: 72(GETNEXT) +| | | tuple-ids=75 row-size=37B cardinality=1.34K cost=1770 +| | | in pipelines: 71(GETNEXT) | | | | | F36:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[527] -| | 72:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] +| | 71:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] | | HDFS partitions=1/1 files=1 size=119.76KB | | predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | stored statistics: @@ -2990,16 +2990,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.35K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_0.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store_0.s_store_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| | tuple-ids=77 row-size=37B cardinality=1.34K cost=365 -| | in pipelines: 72(GETNEXT) +| | tuple-ids=75 row-size=37B cardinality=1.34K cost=365 +| | in pipelines: 71(GETNEXT) | | -| 71:HASH JOIN [INNER JOIN, BROADCAST] +| 70:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=11 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70,76 row-size=184B cardinality=863.99M cost=157333400 -| | in pipelines: 54(GETNEXT), 115(OPEN) +| | tuple-ids=56,58,60,62,64,66,68,74 row-size=184B cardinality=863.99M cost=157333400 +| | in pipelines: 53(GETNEXT), 115(OPEN) | | | |--F61:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=36.13MB mem-reservation=34.50MB thread-reservation=1 @@ -3012,7 +3012,7 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 116:EXCHANGE [BROADCAST] | | | mem-estimate=1.63MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=36.02K cost=47860 +| | | tuple-ids=74 row-size=36B cardinality=36.02K cost=47860 | | | in pipelines: 115(GETNEXT) | | | | | F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk)] hosts=10 instances=10 (adjusted from 120) @@ -3023,31 +3023,31 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | group by: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit))) | | | mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=36.02K cost=16606891 -| | | in pipelines: 115(GETNEXT), 67(OPEN) +| | | tuple-ids=74 row-size=36B cardinality=36.02K cost=16606891 +| | | in pipelines: 115(GETNEXT), 66(OPEN) | | | | | 114:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk)] | | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=43.22M cost=11959416 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=74 row-size=36B cardinality=43.22M cost=11959416 +| | | in pipelines: 66(GETNEXT) | | | | | F34:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=23.91MB mem-reservation=2.00MB thread-reservation=1 | | max-parallelism=330 segment-costs=[3269691390, 122472725] cpu-comparison-result=240 [max(240 (self) vs 230 (sum children))] -| | 70:AGGREGATE [STREAMING] +| | 69:AGGREGATE [STREAMING] | | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns_0.cr_store_credit)) | | | group by: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk | | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=76 row-size=36B cardinality=43.22M cost=1040366503 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=74 row-size=36B cardinality=43.22M cost=1040366503 +| | | in pipelines: 66(GETNEXT) | | | -| | 69:HASH JOIN [INNER JOIN, PARTITIONED] +| | 68:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash-table-id=12 | | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number | | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | | tuple-ids=72,74 row-size=40B cardinality=2.56G cost=1490184428 -| | | in pipelines: 67(GETNEXT), 68(OPEN) +| | | tuple-ids=70,72 row-size=40B cardinality=2.56G cost=1490184428 +| | | in pipelines: 66(GETNEXT), 67(OPEN) | | | | | |--F62:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] hosts=10 instances=120 | | | | Per-Instance Resources: mem-estimate=197.81MB mem-reservation=34.00MB thread-reservation=1 @@ -3060,13 +3060,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 113:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk,tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number)] | | | | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=74 row-size=24B cardinality=432.02M cost=95691763 -| | | | in pipelines: 68(GETNEXT) +| | | | tuple-ids=72 row-size=24B cardinality=432.02M cost=95691763 +| | | | in pipelines: 67(GETNEXT) | | | | | | | F33:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | | | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=40.00KB thread-reservation=1 | | | max-parallelism=110 segment-costs=[1063885041] -| | | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] +| | | 67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] | | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | | predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | stored statistics: @@ -3076,18 +3076,18 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns_0.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns_0.cr_order_number IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | | tuple-ids=74 row-size=24B cardinality=432.02M cost=173584426 -| | | in pipelines: 68(GETNEXT) +| | | tuple-ids=72 row-size=24B cardinality=432.02M cost=173584426 +| | | in pipelines: 67(GETNEXT) | | | | | 112:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number)] | | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=72 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 -| | | in pipelines: 67(GETNEXT) +| | | tuple-ids=70 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 +| | | in pipelines: 66(GETNEXT) | | | | | F32:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=25.38MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=750 segment-costs=[7423383372] -| | 67:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] +| | 66:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] | | HDFS partitions=1831/1831 files=1831 size=280.96GB | | predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | runtime filters: RF072[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk, RF073[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number @@ -3098,16 +3098,16 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=21.52M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=72 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| | in pipelines: 67(GETNEXT) +| | tuple-ids=70 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| | in pipelines: 66(GETNEXT) | | -| 66:HASH JOIN [INNER JOIN, BROADCAST] +| 65:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=13 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=58,60,62,64,66,68,70 row-size=148B cardinality=3.03M cost=1346203 -| | in pipelines: 54(GETNEXT), 63(OPEN) +| | tuple-ids=56,58,60,62,64,66,68 row-size=148B cardinality=3.03M cost=1346203 +| | in pipelines: 53(GETNEXT), 62(OPEN) | | | |--F63:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.35MB mem-reservation=23.25MB thread-reservation=1 @@ -3120,19 +3120,19 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 111:EXCHANGE [BROADCAST] | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=68,70 row-size=12B cardinality=7.20K cost=9560 -| | | in pipelines: 63(GETNEXT) +| | | tuple-ids=66,68 row-size=12B cardinality=7.20K cost=9560 +| | | in pipelines: 62(GETNEXT) | | | | | F30:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[4929] -| | 65:HASH JOIN [INNER JOIN, BROADCAST] +| | 64:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=14 | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=68,70 row-size=12B cardinality=7.20K cost=3151 -| | | in pipelines: 63(GETNEXT), 64(OPEN) +| | | tuple-ids=66,68 row-size=12B cardinality=7.20K cost=3151 +| | | in pipelines: 62(GETNEXT), 63(OPEN) | | | | | |--F64:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -3145,13 +3145,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 110:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=70 row-size=4B cardinality=20 cost=2 -| | | | in pipelines: 64(GETNEXT) +| | | | tuple-ids=68 row-size=4B cardinality=20 cost=2 +| | | | in pipelines: 63(GETNEXT) | | | | | | | F31:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[1] -| | | 64:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -3160,10 +3160,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_2.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=70 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 64(GETNEXT) +| | | tuple-ids=68 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 63(GETNEXT) | | | -| | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | 62:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | runtime filters: RF069[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk @@ -3173,20 +3173,20 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=68 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 63(GETNEXT) +| | tuple-ids=66 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 62(GETNEXT) | | -| 62:HASH JOIN [INNER JOIN, PARTITIONED] +| 61:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=15 | | hash predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=58,60,62,64,66 row-size=136B cardinality=3.11M cost=14728555 -| | in pipelines: 54(GETNEXT), 55(OPEN) +| | tuple-ids=56,58,60,62,64 row-size=136B cardinality=3.11M cost=14728555 +| | in pipelines: 53(GETNEXT), 54(OPEN) | | | |--F65:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=80.50MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB -| | | max-parallelism=1620 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] +| | | max-parallelism=1600 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] | | JOIN BUILD | | | join-table-id=15 plan-id=16 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number @@ -3195,20 +3195,20 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | 109:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number)] | | | mem-estimate=26.43MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=60,62,64,66 row-size=124B cardinality=31.06M cost=24632285 -| | | in pipelines: 55(GETNEXT) +| | | tuple-ids=58,60,62,64 row-size=124B cardinality=31.06M cost=24632285 +| | | in pipelines: 54(GETNEXT) | | | | | F25:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | | Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB | | Per-Instance Resources: mem-estimate=81.73MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=370 segment-costs=[3699964557] -| | 61:HASH JOIN [INNER JOIN, BROADCAST] +| | 60:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=16 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk = tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64,66 row-size=124B cardinality=31.06M cost=49244553 -| | | in pipelines: 55(GETNEXT), 60(OPEN) +| | | tuple-ids=58,60,62,64 row-size=124B cardinality=31.06M cost=49244553 +| | | in pipelines: 54(GETNEXT), 59(OPEN) | | | | | |--F66:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.93MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -3221,33 +3221,33 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 107:EXCHANGE [BROADCAST] | | | | mem-estimate=693.62KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=66 row-size=60B cardinality=7.42K cost=9860 -| | | | in pipelines: 60(GETNEXT) +| | | | tuple-ids=64 row-size=60B cardinality=7.42K cost=9860 +| | | | in pipelines: 59(GETNEXT) | | | | | | | F28:PLAN FRAGMENT [RANDOM] hosts=4 instances=4 | | | Per-Instance Resources: mem-estimate=16.25MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=4 segment-costs=[249892] -| | | 60:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] +| | | max-parallelism=4 segment-costs=[229660] +| | | 59:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | | HDFS partitions=1/1 files=1 size=33.54MB -| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.item_0.i_item_sk | | | stored statistics: | | | table: rows=360.00K size=33.54MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item_0.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item_0.i_item_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=66 row-size=60B cardinality=7.42K cost=248525 -| | | in pipelines: 60(GETNEXT) +| | | tuple-ids=64 row-size=60B cardinality=7.42K cost=228293 +| | | in pipelines: 59(GETNEXT) | | | -| | 59:HASH JOIN [INNER JOIN, BROADCAST] +| | 58:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=17 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62,64 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 -| | | in pipelines: 55(GETNEXT), 58(OPEN) +| | | tuple-ids=58,60,62 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 +| | | in pipelines: 54(GETNEXT), 57(OPEN) | | | | | |--F67:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -3260,32 +3260,32 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 106:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=64 row-size=8B cardinality=373 cost=490 -| | | | in pipelines: 58(GETNEXT) +| | | | tuple-ids=62 row-size=8B cardinality=373 cost=490 +| | | | in pipelines: 57(GETNEXT) | | | | | | | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[12536] -| | | 58:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | 57:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=64 row-size=8B cardinality=373 cost=12520 -| | | in pipelines: 58(GETNEXT) +| | | tuple-ids=62 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 57(GETNEXT) | | | -| | 57:HASH JOIN [INNER JOIN, BROADCAST] +| | 56:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=18 | | | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=60,62 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 -| | | in pipelines: 55(GETNEXT), 56(OPEN) +| | | tuple-ids=58,60 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 +| | | in pipelines: 54(GETNEXT), 55(OPEN) | | | | | |--F68:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1 @@ -3298,13 +3298,13 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | | | | | 105:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=62 row-size=4B cardinality=1.80K cost=2390 -| | | | in pipelines: 56(GETNEXT) +| | | | tuple-ids=60 row-size=4B cardinality=1.80K cost=2390 +| | | | in pipelines: 55(GETNEXT) | | | | | | | F26:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=32.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[212] -| | | 56:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] +| | | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] | | | HDFS partitions=1/1 files=1 size=100.50KB | | | predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | stored statistics: @@ -3313,10 +3313,10 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion_0.p_promo_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | | tuple-ids=62 row-size=4B cardinality=1.80K cost=154 -| | | in pipelines: 56(GETNEXT) +| | | tuple-ids=60 row-size=4B cardinality=1.80K cost=154 +| | | in pipelines: 55(GETNEXT) | | | -| | 55:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | | partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL | | HDFS partitions=1823/1824 files=1823 size=389.69GB | | predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL @@ -3325,22 +3325,22 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales_0.ss_ticket_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=60 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| | in pipelines: 55(GETNEXT) +| | tuple-ids=58 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| | in pipelines: 54(GETNEXT) | | | 108:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number)] | | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=58 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 -| | in pipelines: 54(GETNEXT) +| | tuple-ids=56 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 +| | in pipelines: 53(GETNEXT) | | | F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=23.50MB mem-reservation=512.00KB thread-reservation=1 | max-parallelism=30 segment-costs=[268985600] -| 54:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] +| 53:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] | HDFS partitions=2004/2004 files=2004 size=48.14GB | predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | runtime filters: RF060[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF061[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number, RF055[min_max] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF058[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk, RF059[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number @@ -3351,84 +3351,84 @@ max-parallelism=1430 segment-costs=[14236508039, 7671549052] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=30.09M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns_0.sr_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=58 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 -| in pipelines: 54(GETNEXT) +| tuple-ids=56 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 +| in pipelines: 53(GETNEXT) | 130:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip)] | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=1220353298 +| tuple-ids=39 row-size=283B cardinality=853.41M cost=1205411170 | in pipelines: 104(GETNEXT) | F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item.i_product_name,tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_0.ca_city,tpcds_partitioned_parquet_snap.customer_address_0.ca_zip,tpcds_partitioned_parquet_snap.customer_address.ca_street_number,tpcds_partitioned_parquet_snap.customer_address.ca_street_name,tpcds_partitioned_parquet_snap.customer_address.ca_city,tpcds_partitioned_parquet_snap.customer_address.ca_zip,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] hosts=10 instances=120 Per-Instance Resources: mem-estimate=635.46MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1620 segment-costs=[6501600626, 16186220022] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] +max-parallelism=1600 segment-costs=[6421994378, 15988034328] cpu-comparison-result=615 [max(120 (self) vs 615 (sum children))] 104:AGGREGATE [FINALIZE] | output: count:merge(), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt) | group by: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_year | mem-estimate=512.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=5281247328 -| in pipelines: 104(GETNEXT), 15(OPEN) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=5216583208 +| in pipelines: 104(GETNEXT), 14(OPEN) | 103:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item.i_product_name,tpcds_partitioned_parquet_snap.item.i_item_sk,tpcds_partitioned_parquet_snap.store.s_store_name,tpcds_partitioned_parquet_snap.store.s_zip,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number,tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name,tpcds_partitioned_parquet_snap.customer_address_0.ca_city,tpcds_partitioned_parquet_snap.customer_address_0.ca_zip,tpcds_partitioned_parquet_snap.customer_address.ca_street_number,tpcds_partitioned_parquet_snap.customer_address.ca_street_name,tpcds_partitioned_parquet_snap.customer_address.ca_city,tpcds_partitioned_parquet_snap.customer_address.ca_zip,tpcds_partitioned_parquet_snap.date_dim.d_year,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] | mem-estimate=43.62MB mem-reservation=0B thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=1220353298 -| in pipelines: 15(GETNEXT) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=1205411170 +| in pipelines: 14(GETNEXT) | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=120 Per-Instance Resources: mem-estimate=657.08MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] +max-parallelism=1600 segment-costs=[6909938718, 15988034328] cpu-comparison-result=615 [max(150 (self) vs 615 (sum children))] 38:AGGREGATE [STREAMING] | output: count(), sum(tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt) | group by: tpcds_partitioned_parquet_snap.item.i_product_name, tpcds_partitioned_parquet_snap.item.i_item_sk, tpcds_partitioned_parquet_snap.store.s_store_name, tpcds_partitioned_parquet_snap.store.s_zip, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_number, tpcds_partitioned_parquet_snap.customer_address_0.ca_street_name, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_zip, tpcds_partitioned_parquet_snap.customer_address.ca_street_number, tpcds_partitioned_parquet_snap.customer_address.ca_street_name, tpcds_partitioned_parquet_snap.customer_address.ca_city, tpcds_partitioned_parquet_snap.customer_address.ca_zip, tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.date_dim_0.d_year | mem-estimate=512.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=39 row-size=283B cardinality=863.99M cost=5281247328 -| in pipelines: 15(GETNEXT) +| tuple-ids=39 row-size=283B cardinality=853.41M cost=5216583208 +| in pipelines: 14(GETNEXT) | 37:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=19 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk -| fk/pk conjuncts: none -| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status != tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14,0 row-size=462B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 00(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12,37 row-size=462B cardinality=853.41M cost=376253119 +| in pipelines: 14(GETNEXT), 36(OPEN) | |--F69:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=418.21MB mem-reservation=408.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[4473540] | JOIN BUILD | | join-table-id=19 plan-id=20 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk -| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | 102:EXCHANGE [BROADCAST] | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=0 row-size=17B cardinality=1.92M cost=2552740 -| | in pipelines: 00(GETNEXT) +| | tuple-ids=37 row-size=17B cardinality=1.92M cost=2552740 +| | in pipelines: 36(GETNEXT) | | | F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=10 segment-costs=[375900] -| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| 36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=11.15MB -| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | stored statistics: | table: rows=1.92M size=11.15MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=197.97K -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=17B cardinality=1.92M cost=246246 -| in pipelines: 00(GETNEXT) +| tuple-ids=37 row-size=17B cardinality=1.92M cost=246246 +| in pipelines: 36(GETNEXT) | -36:HASH JOIN [INNER JOIN, BROADCAST] +35:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=20 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16,2,4,6,8,10,12,14 row-size=445B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 01(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14,0,2,4,6,8,10,12 row-size=445B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 00(OPEN) | |--F70:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=4.43GB mem-reservation=408.00MB thread-reservation=1 @@ -3441,19 +3441,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 101:EXCHANGE [BROADCAST] | | mem-estimate=11.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12,14 row-size=147B cardinality=26.86M cost=35690750 -| | in pipelines: 01(GETNEXT) +| | tuple-ids=0,2,4,6,8,10,12 row-size=147B cardinality=26.86M cost=35690750 +| | in pipelines: 00(GETNEXT) | | | F21:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=11.59MB mem-reservation=0B thread-reservation=1 | max-parallelism=10 segment-costs=[42890739] -| 13:HASH JOIN [INNER JOIN, PARTITIONED] +| 12:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=21 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12,14 row-size=147B cardinality=26.86M cost=11754583 -| | in pipelines: 01(GETNEXT), 12(OPEN) +| | tuple-ids=0,2,4,6,8,10,12 row-size=147B cardinality=26.86M cost=11754583 +| | in pipelines: 00(GETNEXT), 11(OPEN) | | | |--F71:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=160.14MB mem-reservation=34.00MB thread-reservation=1 @@ -3466,13 +3466,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 100:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] | | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=14 row-size=78B cardinality=15.00M cost=7017902 -| | | in pipelines: 12(GETNEXT) +| | | tuple-ids=12 row-size=78B cardinality=15.00M cost=7017902 +| | | in pipelines: 11(GETNEXT) | | | | | F20:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=19.19MB mem-reservation=128.00KB thread-reservation=1 | | max-parallelism=10 segment-costs=[89453349] -| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | | HDFS partitions=1/1 files=1 size=307.36MB | | predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | stored statistics: @@ -3481,24 +3481,24 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.58M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 -| | in pipelines: 12(GETNEXT) +| | tuple-ids=12 row-size=78B cardinality=15.00M cost=6805716 +| | in pipelines: 11(GETNEXT) | | | 99:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] | | mem-estimate=10.91MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12 row-size=69B cardinality=26.86M cost=16448897 -| | in pipelines: 01(GETNEXT) +| | tuple-ids=0,2,4,6,8,10 row-size=69B cardinality=26.86M cost=16448897 +| | in pipelines: 00(GETNEXT) | | | F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=19.63MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=10 segment-costs=[265911830] -| 11:HASH JOIN [INNER JOIN, BROADCAST] +| 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=22 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8,10,12 row-size=69B cardinality=26.86M cost=11922966 -| | in pipelines: 01(GETNEXT), 08(OPEN) +| | tuple-ids=0,2,4,6,8,10 row-size=69B cardinality=26.86M cost=11922966 +| | in pipelines: 00(GETNEXT), 07(OPEN) | | | |--F72:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=2.04MB mem-reservation=1.94MB thread-reservation=1 @@ -3511,19 +3511,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 98:EXCHANGE [BROADCAST] | | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=10,12 row-size=12B cardinality=7.20K cost=9560 -| | | in pipelines: 08(GETNEXT) +| | | tuple-ids=8,10 row-size=12B cardinality=7.20K cost=9560 +| | | in pipelines: 07(GETNEXT) | | | | | F18:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[4929] -| | 10:HASH JOIN [INNER JOIN, BROADCAST] +| | 09:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=23 | | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=10,12 row-size=12B cardinality=7.20K cost=3151 -| | | in pipelines: 08(GETNEXT), 09(OPEN) +| | | tuple-ids=8,10 row-size=12B cardinality=7.20K cost=3151 +| | | in pipelines: 07(GETNEXT), 08(OPEN) | | | | | |--F73:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -3536,13 +3536,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | | | 97:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=12 row-size=4B cardinality=20 cost=2 -| | | | in pipelines: 09(GETNEXT) +| | | | tuple-ids=10 row-size=4B cardinality=20 cost=2 +| | | | in pipelines: 08(GETNEXT) | | | | | | | F19:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | | max-parallelism=1 segment-costs=[1] -| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | | HDFS partitions=1/1 files=1 size=1.22KB | | | predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | stored statistics: @@ -3551,10 +3551,10 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | extrapolated-rows=disabled max-scan-range-rows=20 | | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | | tuple-ids=12 row-size=4B cardinality=20 cost=1 -| | | in pipelines: 09(GETNEXT) +| | | tuple-ids=10 row-size=4B cardinality=20 cost=1 +| | | in pipelines: 08(GETNEXT) | | | -| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB | | predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | runtime filters: RF045[min_max] -> tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk @@ -3564,16 +3564,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=7.20K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| | tuple-ids=10 row-size=8B cardinality=7.20K cost=1234 -| | in pipelines: 08(GETNEXT) +| | tuple-ids=8 row-size=8B cardinality=7.20K cost=1234 +| | in pipelines: 07(GETNEXT) | | -| 07:HASH JOIN [INNER JOIN, BROADCAST] +| 06:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=24 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=57B cardinality=27.51M cost=12041917 -| | in pipelines: 01(GETNEXT), 06(OPEN) +| | tuple-ids=0,2,4,6 row-size=57B cardinality=27.51M cost=12041917 +| | in pipelines: 00(GETNEXT), 05(OPEN) | | | |--F74:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -3586,13 +3586,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 96:EXCHANGE [BROADCAST] | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=8 row-size=8B cardinality=73.05K cost=97080 -| | | in pipelines: 06(GETNEXT) +| | | tuple-ids=6 row-size=8B cardinality=73.05K cost=97080 +| | | in pipelines: 05(GETNEXT) | | | | | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[13622] -| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: @@ -3601,16 +3601,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=8 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 06(GETNEXT) +| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 05(GETNEXT) | | -| 05:HASH JOIN [INNER JOIN, BROADCAST] +| 04:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=25 | | hash predicates: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=49B cardinality=27.51M cost=12041917 -| | in pipelines: 01(GETNEXT), 04(OPEN) +| | tuple-ids=0,2,4 row-size=49B cardinality=27.51M cost=12041917 +| | in pipelines: 00(GETNEXT), 03(OPEN) | | | |--F75:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=5.32MB mem-reservation=4.75MB thread-reservation=1 @@ -3623,13 +3623,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 95:EXCHANGE [BROADCAST] | | | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=6 row-size=8B cardinality=73.05K cost=97080 -| | | in pipelines: 04(GETNEXT) +| | | tuple-ids=4 row-size=8B cardinality=73.05K cost=97080 +| | | in pipelines: 03(GETNEXT) | | | | | F16:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[13622] -| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: @@ -3638,47 +3638,47 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=8B cardinality=73.05K cost=10467 -| | in pipelines: 04(GETNEXT) +| | tuple-ids=4 row-size=8B cardinality=73.05K cost=10467 +| | in pipelines: 03(GETNEXT) | | -| 03:HASH JOIN [INNER JOIN, BROADCAST] +| 02:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=26 -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=2,4 row-size=41B cardinality=27.51M cost=12129392 -| | in pipelines: 01(GETNEXT), 02(OPEN) +| | tuple-ids=0,2 row-size=41B cardinality=27.51M cost=12129392 +| | in pipelines: 00(GETNEXT), 01(OPEN) | | | |--F76:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=89.35MB mem-reservation=34.00MB thread-reservation=1 | | | max-parallelism=10 segment-costs=[4473540] | | JOIN BUILD | | | join-table-id=26 plan-id=27 cohort-id=08 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk -| | | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk +| | | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk +| | | runtime filters: RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk | | | mem-estimate=79.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1920800 | | | | | 94:EXCHANGE [BROADCAST] | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=4 row-size=17B cardinality=1.92M cost=2552740 -| | | in pipelines: 02(GETNEXT) +| | | tuple-ids=2 row-size=17B cardinality=1.92M cost=2552740 +| | | in pipelines: 01(GETNEXT) | | | | | F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[375900] -| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] +| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=11.15MB -| | predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | stored statistics: | | table: rows=1.92M size=11.15MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=197.97K -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics_0.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics_0.cd_marital_status IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=4 row-size=17B cardinality=1.92M cost=246246 -| | in pipelines: 02(GETNEXT) +| | tuple-ids=2 row-size=17B cardinality=1.92M cost=246246 +| | in pipelines: 01(GETNEXT) | | -| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | HDFS partitions=1/1 files=1 size=1.55GB | predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | runtime filters: RF037[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk, RF043[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk, RF035[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF039[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk, RF041[min_max] -> tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk @@ -3688,16 +3688,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=3.10M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_first_shipto_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_first_sales_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=27.85M cost=15426000 -| in pipelines: 01(GETNEXT) +| tuple-ids=0 row-size=24B cardinality=27.85M cost=15426000 +| in pipelines: 00(GETNEXT) | -35:HASH JOIN [INNER JOIN, BROADCAST] +34:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=27 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37,16 row-size=299B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 14(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35,14 row-size=299B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 13(OPEN) | |--F77:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=1.47GB mem-reservation=408.00MB thread-reservation=1 @@ -3710,13 +3710,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 93:EXCHANGE [BROADCAST] | | mem-estimate=10.80MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=16 row-size=78B cardinality=15.00M cost=19934990 -| | in pipelines: 14(GETNEXT) +| | tuple-ids=14 row-size=78B cardinality=15.00M cost=19934990 +| | in pipelines: 13(GETNEXT) | | | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Instance Resources: mem-estimate=16.32MB mem-reservation=128.00KB thread-reservation=1 | max-parallelism=10 segment-costs=[10270756] -| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] +| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM] | HDFS partitions=1/1 files=1 size=307.36MB | predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | stored statistics: @@ -3725,16 +3725,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=1.58M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=16 row-size=78B cardinality=15.00M cost=6805716 -| in pipelines: 14(GETNEXT) +| tuple-ids=14 row-size=78B cardinality=15.00M cost=6805716 +| in pipelines: 13(GETNEXT) | -34:HASH JOIN [INNER JOIN, BROADCAST] +33:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=28 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36,37 row-size=221B cardinality=863.99M cost=378170002 -| in pipelines: 15(GETNEXT), 33(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34,35 row-size=221B cardinality=863.99M cost=378170002 +| in pipelines: 14(GETNEXT), 32(OPEN) | |--F78:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=23.34MB mem-reservation=23.25MB thread-reservation=1 @@ -3747,13 +3747,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 92:EXCHANGE [BROADCAST] | | mem-estimate=89.13KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=37 row-size=37B cardinality=1.34K cost=1770 -| | in pipelines: 33(GETNEXT) +| | tuple-ids=35 row-size=37B cardinality=1.34K cost=1770 +| | in pipelines: 32(GETNEXT) | | | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1 | max-parallelism=1 segment-costs=[527] -| 33:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] +| 32:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM] | HDFS partitions=1/1 files=1 size=119.76KB | predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | runtime filters: RF004[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_name, RF005[min_max] -> tpcds_partitioned_parquet_snap.store.s_zip @@ -3763,16 +3763,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=1.35K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_zip IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_name IS NOT NULL, tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 -| tuple-ids=37 row-size=37B cardinality=1.34K cost=365 -| in pipelines: 33(GETNEXT) +| tuple-ids=35 row-size=37B cardinality=1.34K cost=365 +| in pipelines: 32(GETNEXT) | -32:HASH JOIN [INNER JOIN, BROADCAST] +31:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=29 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30,36 row-size=184B cardinality=863.99M cost=157333400 -| in pipelines: 15(GETNEXT), 90(OPEN) +| tuple-ids=16,18,20,22,24,26,28,34 row-size=184B cardinality=863.99M cost=157333400 +| in pipelines: 14(GETNEXT), 90(OPEN) | |--F79:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=36.13MB mem-reservation=34.50MB thread-reservation=1 @@ -3785,7 +3785,7 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 91:EXCHANGE [BROADCAST] | | mem-estimate=1.63MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=36.02K cost=47860 +| | tuple-ids=34 row-size=36B cardinality=36.02K cost=47860 | | in pipelines: 90(GETNEXT) | | | F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk)] hosts=10 instances=10 (adjusted from 120) @@ -3796,31 +3796,31 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | | having: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price) > multiply(CAST(2 AS DECIMAL(3,0)), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit))) | | mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=36.02K cost=16606891 -| | in pipelines: 90(GETNEXT), 28(OPEN) +| | tuple-ids=34 row-size=36B cardinality=36.02K cost=16606891 +| | in pipelines: 90(GETNEXT), 27(OPEN) | | | 89:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk)] | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=43.22M cost=11959416 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=34 row-size=36B cardinality=43.22M cost=11959416 +| | in pipelines: 27(GETNEXT) | | | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] hosts=10 instances=120 | Per-Instance Resources: mem-estimate=23.91MB mem-reservation=2.00MB thread-reservation=1 | max-parallelism=330 segment-costs=[3269691390, 122472725] cpu-comparison-result=240 [max(240 (self) vs 230 (sum children))] -| 31:AGGREGATE [STREAMING] +| 30:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price), sum(add(add(tpcds_partitioned_parquet_snap.catalog_returns.cr_refunded_cash, tpcds_partitioned_parquet_snap.catalog_returns.cr_reversed_charge), tpcds_partitioned_parquet_snap.catalog_returns.cr_store_credit)) | | group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=36 row-size=36B cardinality=43.22M cost=1040366503 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=34 row-size=36B cardinality=43.22M cost=1040366503 +| | in pipelines: 27(GETNEXT) | | -| 30:HASH JOIN [INNER JOIN, PARTITIONED] +| 29:HASH JOIN [INNER JOIN, PARTITIONED] | | hash-table-id=30 | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk = tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number = tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=32,34 row-size=40B cardinality=2.56G cost=1490184428 -| | in pipelines: 28(GETNEXT), 29(OPEN) +| | tuple-ids=30,32 row-size=40B cardinality=2.56G cost=1490184428 +| | in pipelines: 27(GETNEXT), 28(OPEN) | | | |--F80:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=214.81MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB @@ -3833,13 +3833,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 88:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk,tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number)] | | | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=34 row-size=24B cardinality=432.02M cost=95691763 -| | | in pipelines: 29(GETNEXT) +| | | tuple-ids=32 row-size=24B cardinality=432.02M cost=95691763 +| | | in pipelines: 28(GETNEXT) | | | | | F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120) | | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=40.00KB thread-reservation=1 | | max-parallelism=110 segment-costs=[1063885041] -| | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] +| | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM] | | HDFS partitions=2060/2060 files=2060 size=32.77GB | | predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk @@ -3850,19 +3850,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=416.82K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL | | mem-estimate=16.00MB mem-reservation=40.00KB thread-reservation=0 -| | tuple-ids=34 row-size=24B cardinality=432.02M cost=173584426 -| | in pipelines: 29(GETNEXT) +| | tuple-ids=32 row-size=24B cardinality=432.02M cost=173584426 +| | in pipelines: 28(GETNEXT) | | | 87:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk,tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number)] | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=32 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 -| | in pipelines: 28(GETNEXT) +| | tuple-ids=30 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=739140459 +| | in pipelines: 27(GETNEXT) | | | F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=25.38MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=750 segment-costs=[7423383372] -| 28:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] +| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM] | HDFS partitions=1831/1831 files=1831 size=280.96GB | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | runtime filters: RF032[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF033[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF031[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number @@ -3873,16 +3873,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=21.52M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=32 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 -| in pipelines: 28(GETNEXT) +| tuple-ids=30 row-size=16B cardinality=4.00G(filtered from 4.32G) cost=1238134348 +| in pipelines: 27(GETNEXT) | -27:HASH JOIN [INNER JOIN, BROADCAST] +26:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=31 | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=18,20,22,24,26,28,30 row-size=148B cardinality=3.03M cost=1346203 -| in pipelines: 15(GETNEXT), 24(OPEN) +| tuple-ids=16,18,20,22,24,26,28 row-size=148B cardinality=3.03M cost=1346203 +| in pipelines: 14(GETNEXT), 23(OPEN) | |--F81:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=23.35MB mem-reservation=23.25MB thread-reservation=1 @@ -3895,19 +3895,19 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 86:EXCHANGE [BROADCAST] | | mem-estimate=104.38KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=28,30 row-size=12B cardinality=7.20K cost=9560 -| | in pipelines: 24(GETNEXT) +| | tuple-ids=26,28 row-size=12B cardinality=7.20K cost=9560 +| | in pipelines: 23(GETNEXT) | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=16.08MB mem-reservation=64.00KB thread-reservation=1 | max-parallelism=1 segment-costs=[4929] -| 26:HASH JOIN [INNER JOIN, BROADCAST] +| 25:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=32 | | hash predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk = tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=28,30 row-size=12B cardinality=7.20K cost=3151 -| | in pipelines: 24(GETNEXT), 25(OPEN) +| | tuple-ids=26,28 row-size=12B cardinality=7.20K cost=3151 +| | in pipelines: 23(GETNEXT), 24(OPEN) | | | |--F82:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1 @@ -3920,13 +3920,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 85:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=30 row-size=4B cardinality=20 cost=2 -| | | in pipelines: 25(GETNEXT) +| | | tuple-ids=28 row-size=4B cardinality=20 cost=2 +| | | in pipelines: 24(GETNEXT) | | | | | F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=8.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[1] -| | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] +| | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | HDFS partitions=1/1 files=1 size=1.22KB | | predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | stored statistics: @@ -3935,10 +3935,10 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band_0.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 -| | tuple-ids=30 row-size=4B cardinality=20 cost=1 -| | in pipelines: 25(GETNEXT) +| | tuple-ids=28 row-size=4B cardinality=20 cost=1 +| | in pipelines: 24(GETNEXT) | | -| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] +| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=41.69KB | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | runtime filters: RF029[min_max] -> tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk @@ -3948,20 +3948,20 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | extrapolated-rows=disabled max-scan-range-rows=7.20K | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_income_band_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 -| tuple-ids=28 row-size=8B cardinality=7.20K cost=1234 -| in pipelines: 24(GETNEXT) +| tuple-ids=26 row-size=8B cardinality=7.20K cost=1234 +| in pipelines: 23(GETNEXT) | -23:HASH JOIN [INNER JOIN, PARTITIONED] +22:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=33 | hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk = tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number = tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=18,20,22,24,26 row-size=136B cardinality=3.11M cost=14728555 -| in pipelines: 15(GETNEXT), 16(OPEN) +| tuple-ids=16,18,20,22,24 row-size=136B cardinality=3.11M cost=14728555 +| in pipelines: 14(GETNEXT), 15(OPEN) | |--F83:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=80.50MB mem-reservation=51.00MB thread-reservation=1 runtime-filters-memory=17.00MB -| | max-parallelism=1620 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] +| | max-parallelism=1600 segment-costs=[55695617] cpu-comparison-result=240 [max(240 (self) vs 36 (sum children))] | JOIN BUILD | | join-table-id=33 plan-id=34 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number @@ -3970,20 +3970,20 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | 84:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_item_sk,tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number)] | | mem-estimate=26.43MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=20,22,24,26 row-size=124B cardinality=31.06M cost=24632285 -| | in pipelines: 16(GETNEXT) +| | tuple-ids=18,20,22,24 row-size=124B cardinality=31.06M cost=24632285 +| | in pipelines: 15(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB | Per-Instance Resources: mem-estimate=81.73MB mem-reservation=512.00KB thread-reservation=1 | max-parallelism=370 segment-costs=[3699964557] -| 22:HASH JOIN [INNER JOIN, BROADCAST] +| 21:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=34 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24,26 row-size=124B cardinality=31.06M cost=49244553 -| | in pipelines: 16(GETNEXT), 21(OPEN) +| | tuple-ids=18,20,22,24 row-size=124B cardinality=31.06M cost=49244553 +| | in pipelines: 15(GETNEXT), 20(OPEN) | | | |--F84:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.93MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -3996,33 +3996,33 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 82:EXCHANGE [BROADCAST] | | | mem-estimate=693.62KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=26 row-size=60B cardinality=7.42K cost=9860 -| | | in pipelines: 21(GETNEXT) +| | | tuple-ids=24 row-size=60B cardinality=7.42K cost=9860 +| | | in pipelines: 20(GETNEXT) | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4 | | Per-Instance Resources: mem-estimate=16.25MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=4 segment-costs=[249892] -| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] +| | max-parallelism=4 segment-costs=[229660] +| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.item.i_item_sk | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(10 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(75 AS SMALLINT), CAST(15 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(75 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(add(CAST(75 AS SMALLINT), CAST(1 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_color IN ('almond', 'chocolate', 'drab', 'misty', 'peach', 'saddle'), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(85 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(76 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=26 row-size=60B cardinality=7.42K cost=248525 -| | in pipelines: 21(GETNEXT) +| | tuple-ids=24 row-size=60B cardinality=7.42K cost=228293 +| | in pipelines: 20(GETNEXT) | | -| 20:HASH JOIN [INNER JOIN, BROADCAST] +| 19:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=35 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22,24 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 -| | in pipelines: 16(GETNEXT), 19(OPEN) +| | tuple-ids=18,20,22 row-size=64B cardinality=170.04M(filtered from 1.51G) cost=316694600 +| | in pipelines: 15(GETNEXT), 18(OPEN) | | | |--F85:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB @@ -4035,13 +4035,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 81:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=24 row-size=8B cardinality=373 cost=490 -| | | in pipelines: 19(GETNEXT) +| | | tuple-ids=22 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 18(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[12536] -| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: @@ -4051,16 +4051,16 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=24 row-size=8B cardinality=373 cost=12520 -| | in pipelines: 19(GETNEXT) +| | tuple-ids=22 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 18(GETNEXT) | | -| 18:HASH JOIN [INNER JOIN, BROADCAST] +| 17:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=36 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=20,22 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 -| | in pipelines: 16(GETNEXT), 17(OPEN) +| | tuple-ids=18,20 row-size=56B cardinality=170.04M(filtered from 7.37G) cost=1378992792 +| | in pipelines: 15(GETNEXT), 16(OPEN) | | | |--F86:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1 @@ -4073,13 +4073,13 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | | | | 80:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=22 row-size=4B cardinality=1.80K cost=2390 -| | | in pipelines: 17(GETNEXT) +| | | tuple-ids=20 row-size=4B cardinality=1.80K cost=2390 +| | | in pipelines: 16(GETNEXT) | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.03MB mem-reservation=32.00KB thread-reservation=1 | | max-parallelism=1 segment-costs=[212] -| | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] +| | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM] | | HDFS partitions=1/1 files=1 size=100.50KB | | predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | stored statistics: @@ -4088,34 +4088,34 @@ max-parallelism=1620 segment-costs=[6976519721, 16186220022] cpu-comparison-resu | | extrapolated-rows=disabled max-scan-range-rows=1.80K | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0 -| | tuple-ids=22 row-size=4B cardinality=1.80K cost=154 -| | in pipelines: 17(GETNEXT) +| | tuple-ids=20 row-size=4B cardinality=1.80K cost=154 +| | in pipelines: 16(GETNEXT) | | -| 16:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] | partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL | HDFS partitions=1823/1824 files=1823 size=389.69GB | predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL -| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk +| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF017[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF013[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk | stored statistics: | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=20 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 -| in pipelines: 16(GETNEXT) +| tuple-ids=18 row-size=52B cardinality=170.04M(filtered from 7.37G) cost=1642492694 +| in pipelines: 15(GETNEXT) | 83:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_item_sk,tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number)] | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0 -| tuple-ids=18 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 -| in pipelines: 15(GETNEXT) +| tuple-ids=16 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=9184227 +| in pipelines: 14(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120) Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB Per-Instance Resources: mem-estimate=23.50MB mem-reservation=512.00KB thread-reservation=1 max-parallelism=30 segment-costs=[268985600] -15:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] +14:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM] HDFS partitions=2004/2004 files=2004 size=48.14GB predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL runtime filters: RF020[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF021[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF015[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_item_sk, RF019[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number @@ -4126,6 +4126,6 @@ max-parallelism=30 segment-costs=[268985600] extrapolated-rows=disabled max-scan-range-rows=30.09M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_returns.sr_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_returns.sr_ticket_number IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=18 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 - in pipelines: 15(GETNEXT) + tuple-ids=16 row-size=12B cardinality=55.23M(filtered from 863.99M) cost=197853396 + in pipelines: 14(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q65.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q65.test index 88704caa9..19ebbca5a 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q65.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q65.test @@ -105,13 +105,13 @@ PLAN-ROOT SINK | | | | | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 06(GETNEXT) @@ -125,7 +125,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=16B cardinality=7.88G cost=2132551022 @@ -162,13 +162,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -182,7 +182,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2364367980 @@ -385,13 +385,13 @@ max-parallelism=17010 segment-costs=[12033974180, 170036470682, 504] cpu-compari | | max-parallelism=1 segment-costs=[14888] | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 06(GETNEXT) @@ -405,7 +405,7 @@ max-parallelism=17010 segment-costs=[12033974180, 170036470682, 504] cpu-compari | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=7 row-size=16B cardinality=7.88G cost=2132551022 @@ -462,13 +462,13 @@ max-parallelism=1823 segment-costs=[47769653573, 14166879089] cpu-comparison-res | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -482,7 +482,7 @@ max-parallelism=1823 segment-costs=[47769653573, 14166879089] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2364367980 @@ -685,13 +685,13 @@ max-parallelism=17010 segment-costs=[12033974180, 170036470682, 504] cpu-compari | | max-parallelism=1 segment-costs=[14888] | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 06(GETNEXT) @@ -705,7 +705,7 @@ max-parallelism=17010 segment-costs=[12033974180, 170036470682, 504] cpu-compari | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=7 row-size=16B cardinality=7.88G cost=2132551022 @@ -762,13 +762,13 @@ max-parallelism=1823 segment-costs=[47769653573, 14166879089] cpu-comparison-res | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1208 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1219 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -782,7 +782,7 @@ max-parallelism=1823 segment-costs=[47769653573, 14166879089] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2364367980 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q66.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q66.test index 0cf01bc24..f654e1661 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q66.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q66.test @@ -226,7 +226,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=655.54MB mem-reservation=84.00MB thread-reservation=1 runtime-filters-memory=8.00MB | max-parallelism=1 segment-costs=[302290304, 598660544, 367, 135, 1936] PLAN-ROOT SINK -| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, concat(concat('HARMSTORF', ','), 'USPS'), CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) +| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, 'HARMSTORF,USPS', CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1936 | 22:TOP-N [LIMIT=100] @@ -306,13 +306,13 @@ PLAN-ROOT SINK | | | |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 14(GETNEXT) @@ -411,13 +411,13 @@ PLAN-ROOT SINK | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 04(GETNEXT) @@ -464,7 +464,7 @@ F14:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.27MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[2003] cpu-comparison-result=104 [max(1 (self) vs 104 (sum children))] PLAN-ROOT SINK -| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, concat(concat('HARMSTORF', ','), 'USPS'), CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) +| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, 'HARMSTORF,USPS', CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1936 | 37:MERGING-EXCHANGE [UNPARTITIONED] @@ -636,13 +636,13 @@ max-parallelism=60 segment-costs=[14381, 14381, 367, 1836] cpu-comparison-result | | max-parallelism=1 segment-costs=[17609] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 14(GETNEXT) @@ -825,13 +825,13 @@ max-parallelism=40 segment-costs=[302259135, 86917] cpu-comparison-result=44 [ma | max-parallelism=1 segment-costs=[17609] | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 04(GETNEXT) @@ -895,7 +895,7 @@ F14:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.27MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[2003] cpu-comparison-result=104 [max(1 (self) vs 104 (sum children))] PLAN-ROOT SINK -| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, concat(concat('HARMSTORF', ','), 'USPS'), CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) +| output exprs: W_WAREHOUSE_NAME, W_WAREHOUSE_SQ_FT, W_CITY, W_COUNTY, W_STATE, W_COUNTRY, 'HARMSTORF,USPS', CAST(2002 AS INT), sum(JAN_SALES), sum(FEB_SALES), sum(MAR_SALES), sum(APR_SALES), sum(MAY_SALES), sum(JUN_SALES), sum(JUL_SALES), sum(AUG_SALES), sum(SEP_SALES), sum(OCT_SALES), sum(NOV_SALES), sum(DEC_SALES), sum(divide(JAN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(FEB_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(APR_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(MAY_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUN_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(JUL_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(AUG_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(SEP_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(OCT_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(NOV_SALES, W_WAREHOUSE_SQ_FT)), sum(divide(DEC_SALES, W_WAREHOUSE_SQ_FT)), sum(JAN_NET), sum(FEB_NET), sum(MAR_NET), sum(APR_NET), sum(MAY_NET), sum(JUN_NET), sum(JUL_NET), sum(AUG_NET), sum(SEP_NET), sum(OCT_NET), sum(NOV_NET), sum(DEC_NET) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1936 | 37:MERGING-EXCHANGE [UNPARTITIONED] @@ -1067,13 +1067,13 @@ max-parallelism=60 segment-costs=[14381, 14381, 367, 1836] cpu-comparison-result | | max-parallelism=1 segment-costs=[17609] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=15 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 14(GETNEXT) @@ -1256,13 +1256,13 @@ max-parallelism=40 segment-costs=[302259135, 86917] cpu-comparison-result=44 [ma | max-parallelism=1 segment-costs=[17609] | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= add(CAST(24285 AS INT), CAST(28800 AS INT)), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_time <= CAST(53085 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time >= CAST(24285 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 04(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q67.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q67.test index d1f05da3b..6744228d1 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q67.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q67.test @@ -151,13 +151,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=20B cardinality=7.30K cost=27196 | in pipelines: 03(GETNEXT) @@ -191,7 +191,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=7.88G cost=2839551496 @@ -404,13 +404,13 @@ max-parallelism=1823 segment-costs=[236970283374, 2144442934166] cpu-comparison- | max-parallelism=1 segment-costs=[27748] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=20B cardinality=7.30K cost=27196 | in pipelines: 03(GETNEXT) @@ -461,7 +461,7 @@ max-parallelism=1823 segment-costs=[236970283374, 2144442934166] cpu-comparison- table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=7.88G cost=2839551496 @@ -674,13 +674,13 @@ max-parallelism=1823 segment-costs=[236970283374, 2144442934166] cpu-comparison- | max-parallelism=1 segment-costs=[27748] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1196 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1207 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1196 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=4 row-size=20B cardinality=7.30K cost=27196 | in pipelines: 03(GETNEXT) @@ -731,7 +731,7 @@ max-parallelism=1823 segment-costs=[236970283374, 2144442934166] cpu-comparison- table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=20B cardinality=7.88G cost=2839551496 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q68.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q68.test index ae567c91e..50146efd1 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q68.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q68.test @@ -43,10 +43,10 @@ select c_last_name # end query 68 in stream 0 using template query68.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=160.44MB Threads=1 -Per-Host Resource Estimates: Memory=3.94GB +Per-Host Resource Estimates: Memory=3.96GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=3.94GB mem-reservation=160.44MB thread-reservation=1 runtime-filters-memory=51.00MB -| max-parallelism=1 segment-costs=[1359770940, 282886512, 800] +| Per-Instance Resources: mem-estimate=3.96GB mem-reservation=160.44MB thread-reservation=1 runtime-filters-memory=51.00MB +| max-parallelism=1 segment-costs=[1366948154, 284376870, 800] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, ca_city, tpcds_partitioned_parquet_snap.customer_address_0.ca_city, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800 @@ -54,7 +54,7 @@ PLAN-ROOT SINK 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=13.07KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=134B cardinality=100 cost=221210457 +| tuple-ids=15 row-size=134B cardinality=100 cost=222543214 | in pipelines: 14(GETNEXT), 00(OPEN) | 13:HASH JOIN [INNER JOIN] @@ -62,15 +62,15 @@ PLAN-ROOT SINK | fk/pk conjuncts: none | other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_city != tpcds_partitioned_parquet_snap.customer_address_0.ca_city | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,14 row-size=154B cardinality=16.37M cost=23538349 +| mem-estimate=1.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=0,2,14 row-size=154B cardinality=16.47M cost=23672089 | in pipelines: 00(GETNEXT), 12(OPEN) | |--12:AGGREGATE [FINALIZE] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax) | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address_0.ca_city -| | mem-estimate=1.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=98930812 +| | mem-estimate=1.49GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=99492919 | | in pipelines: 12(GETNEXT), 04(OPEN) | | | 11:HASH JOIN [INNER JOIN] @@ -78,7 +78,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: none | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | | mem-estimate=730.23MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.37M cost=21715701 +| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.47M cost=21756417 | | in pipelines: 04(GETNEXT), 03(OPEN) | | | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] @@ -98,20 +98,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.37M cost=22353195 +| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.47M cost=22480201 | | in pipelines: 04(GETNEXT), 09(OPEN) | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=12 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=12 row-size=12B cardinality=354 cost=20833 | | in pipelines: 09(GETNEXT) | | | 08:HASH JOIN [INNER JOIN] @@ -119,7 +119,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10 row-size=77B cardinality=75.58M(filtered from 84.84M) cost=34760622 +| | tuple-ids=6,8,10 row-size=77B cardinality=76.01M(filtered from 84.84M) cost=34870771 | | in pipelines: 04(GETNEXT), 07(OPEN) | | | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] @@ -139,7 +139,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8 row-size=65B cardinality=75.58M(filtered from 347.65M) cost=82379835 +| | tuple-ids=6,8 row-size=65B cardinality=76.01M(filtered from 347.65M) cost=82489984 | | in pipelines: 04(GETNEXT), 05(OPEN) | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -164,10 +164,10 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=40B cardinality=75.58M(filtered from 7.50G) cost=1095967244 +| tuple-ids=6 row-size=40B cardinality=76.01M(filtered from 7.50G) cost=1102194331 | in pipelines: 04(GETNEXT) | 02:HASH JOIN [INNER JOIN] @@ -175,7 +175,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk | mem-estimate=730.23MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2 row-size=69B cardinality=16.37M(filtered from 30.00M) cost=24185053 +| tuple-ids=0,2 row-size=69B cardinality=16.47M(filtered from 30.00M) cost=24208914 | in pipelines: 00(GETNEXT), 01(OPEN) | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address] @@ -200,7 +200,7 @@ PLAN-ROOT SINK extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=44B cardinality=16.37M(filtered from 30.00M) cost=10311933 + tuple-ids=0 row-size=44B cardinality=16.47M(filtered from 30.00M) cost=10311933 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=621.58MB Threads=38 @@ -221,11 +221,11 @@ PLAN-ROOT SINK | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=30 (adjusted from 10) Per-Instance Resources: mem-estimate=11.52MB mem-reservation=0B thread-reservation=1 -max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max(60 (self) vs 170 (sum children))] +max-parallelism=30 segment-costs=[247169655, 382] cpu-comparison-result=170 [max(60 (self) vs 170 (sum children))] 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=13.07KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=134B cardinality=100 cost=221210457 +| tuple-ids=15 row-size=134B cardinality=100 cost=222543214 | in pipelines: 14(GETNEXT), 00(OPEN) | 13:HASH JOIN [INNER JOIN, PARTITIONED] @@ -234,46 +234,46 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | fk/pk conjuncts: none | other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_city != tpcds_partitioned_parquet_snap.customer_address_0.ca_city | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,14 row-size=154B cardinality=16.37M cost=10661647 +| tuple-ids=0,2,14 row-size=154B cardinality=16.47M cost=10678503 | in pipelines: 00(GETNEXT), 23(OPEN) | |--F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=84.75MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[24589136] cpu-comparison-result=140 [max(30 (self) vs 140 (sum children))] +| | Per-Instance Resources: mem-estimate=85.00MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | max-parallelism=30 segment-costs=[24728847] cpu-comparison-result=140 [max(30 (self) vs 140 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=57.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16372226 +| | mem-estimate=57.27MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16465250 | | | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=11.74MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=8216910 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=8263597 | | in pipelines: 23(GETNEXT) | | | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address_0.ca_city)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=87.43MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[107147722, 98006356] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))] +| Per-Instance Resources: mem-estimate=87.86MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[107756516, 98563210] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))] | 23:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax) | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address_0.ca_city -| | mem-estimate=75.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=98930812 +| | mem-estimate=76.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=99492919 | | in pipelines: 23(GETNEXT), 04(OPEN) | | | 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address_0.ca_city)] | | mem-estimate=11.74MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=8216910 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=8263597 | | in pipelines: 04(GETNEXT) | | | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=86.03MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[116433478, 98006356] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))] +| Per-Instance Resources: mem-estimate=86.36MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[117095032, 98563210] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))] | 12:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax) | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address_0.ca_city -| | mem-estimate=56.77MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=98930812 +| | mem-estimate=57.09MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=99492919 | | in pipelines: 04(GETNEXT) | | | 11:HASH JOIN [INNER JOIN, PARTITIONED] @@ -281,7 +281,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.37M cost=7166123 +| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.47M cost=7206839 | | in pipelines: 04(GETNEXT), 03(OPEN) | | | |--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120) @@ -315,33 +315,33 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | | 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] | | mem-estimate=22.32MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.37M cost=10336543 +| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.47M cost=10395274 | | in pipelines: 04(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB | Per-Instance Resources: mem-estimate=24.21MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=140 segment-costs=[1363139937] +| max-parallelism=140 segment-costs=[1370439787] | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.37M cost=22352843 +| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.47M cost=22479847 | | in pipelines: 04(GETNEXT), 09(OPEN) | | | |--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=02 plan-id=03 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 19:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=12 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=12 row-size=12B cardinality=354 cost=470 | | | in pipelines: 09(GETNEXT) | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -349,15 +349,15 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | max-parallelism=1 segment-costs=[20852] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=12 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=12 row-size=12B cardinality=354 cost=20833 | | in pipelines: 09(GETNEXT) | | | 08:HASH JOIN [INNER JOIN, BROADCAST] @@ -365,7 +365,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10 row-size=77B cardinality=75.58M(filtered from 84.84M) cost=34758822 +| | tuple-ids=6,8,10 row-size=77B cardinality=76.01M(filtered from 84.84M) cost=34868971 | | in pipelines: 04(GETNEXT), 07(OPEN) | | | |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -402,7 +402,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8 row-size=65B cardinality=75.58M(filtered from 347.65M) cost=82379804 +| | tuple-ids=6,8 row-size=65B cardinality=76.01M(filtered from 347.65M) cost=82489953 | | in pipelines: 04(GETNEXT), 05(OPEN) | | | |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -444,10 +444,10 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=40B cardinality=75.58M(filtered from 7.50G) cost=1095967244 +| tuple-ids=6 row-size=40B cardinality=76.01M(filtered from 7.50G) cost=1102194331 | in pipelines: 04(GETNEXT) | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] @@ -535,11 +535,11 @@ PLAN-ROOT SINK | F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=30 (adjusted from 10) Per-Instance Resources: mem-estimate=11.52MB mem-reservation=0B thread-reservation=1 -max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max(60 (self) vs 170 (sum children))] +max-parallelism=30 segment-costs=[247169655, 382] cpu-comparison-result=170 [max(60 (self) vs 170 (sum children))] 14:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number ASC NULLS LAST | mem-estimate=13.07KB mem-reservation=0B thread-reservation=0 -| tuple-ids=15 row-size=134B cardinality=100 cost=221210457 +| tuple-ids=15 row-size=134B cardinality=100 cost=222543214 | in pipelines: 14(GETNEXT), 00(OPEN) | 13:HASH JOIN [INNER JOIN, PARTITIONED] @@ -548,46 +548,46 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | fk/pk conjuncts: none | other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_city != tpcds_partitioned_parquet_snap.customer_address_0.ca_city | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,2,14 row-size=154B cardinality=16.37M cost=10661647 +| tuple-ids=0,2,14 row-size=154B cardinality=16.47M cost=10678503 | in pipelines: 00(GETNEXT), 23(OPEN) | |--F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=84.75MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[24589136] cpu-comparison-result=140 [max(30 (self) vs 140 (sum children))] +| | Per-Instance Resources: mem-estimate=85.00MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | max-parallelism=30 segment-costs=[24728847] cpu-comparison-result=140 [max(30 (self) vs 140 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=57.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16372226 +| | mem-estimate=57.27MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16465250 | | | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=11.74MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=8216910 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=8263597 | | in pipelines: 23(GETNEXT) | | | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address_0.ca_city)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=87.43MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[107147722, 98006356] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))] +| Per-Instance Resources: mem-estimate=87.86MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[107756516, 98563210] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))] | 23:AGGREGATE [FINALIZE] | | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax) | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address_0.ca_city -| | mem-estimate=75.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=98930812 +| | mem-estimate=76.12MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=99492919 | | in pipelines: 23(GETNEXT), 04(OPEN) | | | 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.customer_address_0.ca_city)] | | mem-estimate=11.74MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=8216910 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=8263597 | | in pipelines: 04(GETNEXT) | | | F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120) -| Per-Instance Resources: mem-estimate=86.03MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=20 segment-costs=[116433478, 98006356] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))] +| Per-Instance Resources: mem-estimate=86.36MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=20 segment-costs=[117095032, 98563210] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))] | 12:AGGREGATE [STREAMING] | | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax) | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.customer_address_0.ca_city -| | mem-estimate=56.77MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=14 row-size=85B cardinality=16.37M cost=98930812 +| | mem-estimate=57.09MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14 row-size=85B cardinality=16.47M cost=99492919 | | in pipelines: 04(GETNEXT) | | | 11:HASH JOIN [INNER JOIN, PARTITIONED] @@ -595,7 +595,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address_0.ca_address_sk | | fk/pk conjuncts: none | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.37M cost=7166123 +| | tuple-ids=6,8,10,12,4 row-size=114B cardinality=16.47M cost=7206839 | | in pipelines: 04(GETNEXT), 03(OPEN) | | | |--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120) @@ -629,33 +629,33 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | | 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] | | mem-estimate=22.32MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.37M cost=10336543 +| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.47M cost=10395274 | | in pipelines: 04(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB | Per-Instance Resources: mem-estimate=24.21MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=140 segment-costs=[1363139937] +| max-parallelism=140 segment-costs=[1370439787] | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.37M cost=22352843 +| | tuple-ids=6,8,10,12 row-size=89B cardinality=16.47M cost=22479847 | | in pipelines: 04(GETNEXT), 09(OPEN) | | | |--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=02 plan-id=03 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 19:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=12 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=12 row-size=12B cardinality=354 cost=470 | | | in pipelines: 09(GETNEXT) | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -663,15 +663,15 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | max-parallelism=1 segment-costs=[20852] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1998 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1998 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=12 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=12 row-size=12B cardinality=354 cost=20833 | | in pipelines: 09(GETNEXT) | | | 08:HASH JOIN [INNER JOIN, BROADCAST] @@ -679,7 +679,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8,10 row-size=77B cardinality=75.58M(filtered from 84.84M) cost=34758822 +| | tuple-ids=6,8,10 row-size=77B cardinality=76.01M(filtered from 84.84M) cost=34868971 | | in pipelines: 04(GETNEXT), 07(OPEN) | | | |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -716,7 +716,7 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=6,8 row-size=65B cardinality=75.58M(filtered from 347.65M) cost=82379804 +| | tuple-ids=6,8 row-size=65B cardinality=76.01M(filtered from 347.65M) cost=82489953 | | in pipelines: 04(GETNEXT), 05(OPEN) | | | |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -758,10 +758,10 @@ max-parallelism=30 segment-costs=[245820042, 382] cpu-comparison-result=170 [max | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=6 row-size=40B cardinality=75.58M(filtered from 7.50G) cost=1095967244 +| tuple-ids=6 row-size=40B cardinality=76.01M(filtered from 7.50G) cost=1102194331 | in pipelines: 04(GETNEXT) | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q69.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q69.test index 3fd255924..15bf23093 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q69.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q69.test @@ -93,13 +93,13 @@ PLAN-ROOT SINK | | | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=118 cost=20833 | | in pipelines: 01(GETNEXT) @@ -194,13 +194,13 @@ PLAN-ROOT SINK | | | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=12 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 09(GETNEXT) @@ -214,7 +214,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=10 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -236,13 +236,13 @@ PLAN-ROOT SINK | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=12B cardinality=118 cost=20833 | | in pipelines: 05(GETNEXT) @@ -387,13 +387,13 @@ max-parallelism=10 segment-costs=[5147877, 312211] cpu-comparison-result=298 [ma | | max-parallelism=1 segment-costs=[20839] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=118 cost=20833 | | in pipelines: 01(GETNEXT) @@ -589,13 +589,13 @@ max-parallelism=10 segment-costs=[20285426] | | | max-parallelism=1 segment-costs=[20839] | | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=12 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 09(GETNEXT) @@ -609,7 +609,7 @@ max-parallelism=10 segment-costs=[20285426] | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=10 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -663,13 +663,13 @@ max-parallelism=10 segment-costs=[20285426] | | max-parallelism=1 segment-costs=[20839] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=12B cardinality=118 cost=20833 | | in pipelines: 05(GETNEXT) @@ -823,13 +823,13 @@ max-parallelism=10 segment-costs=[5147877, 312211] cpu-comparison-result=298 [ma | | max-parallelism=1 segment-costs=[20839] | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=2 row-size=12B cardinality=118 cost=20833 | | in pipelines: 01(GETNEXT) @@ -1025,13 +1025,13 @@ max-parallelism=10 segment-costs=[20285426] | | | max-parallelism=1 segment-costs=[20839] | | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=12 row-size=12B cardinality=118 cost=20833 | | | in pipelines: 09(GETNEXT) @@ -1045,7 +1045,7 @@ max-parallelism=10 segment-costs=[20285426] | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=118(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=118(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=10 row-size=8B cardinality=509.68M(filtered from 7.88G) cost=76479008 @@ -1099,13 +1099,13 @@ max-parallelism=10 segment-costs=[20285426] | | max-parallelism=1 segment-costs=[20839] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(add(CAST(4 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy <= CAST(6 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy >= CAST(4 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=12B cardinality=118 cost=20833 | | in pipelines: 05(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q70.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q70.test index 150f30cc3..557e6c7ae 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q70.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q70.test @@ -166,13 +166,13 @@ PLAN-ROOT SINK | | | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=8 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -186,7 +186,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M +| | extrapolated-rows=disabled max-scan-range-rows=12.24M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=12B cardinality=7.88G cost=1657367506 @@ -215,13 +215,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -235,7 +235,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=1.77G(filtered from 7.88G) cost=1657367506 @@ -513,13 +513,13 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | | max-parallelism=1 segment-costs=[14888] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=8 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 05(GETNEXT) @@ -533,7 +533,7 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=6 row-size=12B cardinality=7.88G cost=1657367506 @@ -566,13 +566,13 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -586,7 +586,7 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.88G cost=1657367506 @@ -864,13 +864,13 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | | max-parallelism=1 segment-costs=[14888] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=8 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 05(GETNEXT) @@ -884,7 +884,7 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M +| extrapolated-rows=disabled max-scan-range-rows=12.24M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=6 row-size=12B cardinality=7.88G cost=1657367506 @@ -917,13 +917,13 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1197 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1208 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1197 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -937,7 +937,7 @@ max-parallelism=1430 segment-costs=[14229575698, 1707075] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=7.88G cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q71.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q71.test index 6c26c9eee..1c0ff53a2 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q71.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q71.test @@ -140,7 +140,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=9 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -399,7 +399,7 @@ max-parallelism=108 segment-costs=[6386076481, 3474311433] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=9 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 @@ -692,7 +692,7 @@ max-parallelism=108 segment-costs=[6386076481, 3474311433] cpu-comparison-result | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=108(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=108(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=9 row-size=16B cardinality=466.49M(filtered from 7.88G) cost=139995472 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q72.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q72.test index cea328c5e..a5bfba04a 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q72.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q72.test @@ -264,7 +264,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=2 row-size=16B cardinality=981.88M cost=325261332 @@ -711,7 +711,7 @@ max-parallelism=261 segment-costs=[6246453059] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=2 row-size=16B cardinality=981.88M cost=325261332 @@ -1158,7 +1158,7 @@ max-parallelism=261 segment-costs=[6246453059] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL, tpcds_partitioned_parquet_snap.inventory.inv_warehouse_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 tuple-ids=2 row-size=16B cardinality=981.88M cost=325261332 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q73.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q73.test index 54821fcfa..830dce99f 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q73.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q73.test @@ -29,34 +29,34 @@ select c_last_name # end query 73 in stream 0 using template query73.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=73.00MB Threads=1 -Per-Host Resource Estimates: Memory=492MB +Per-Host Resource Estimates: Memory=495MB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=492.15MB mem-reservation=73.00MB thread-reservation=1 runtime-filters-memory=4.00MB -| max-parallelism=1 segment-costs=[921288813, 16945550, 8292642] +| Per-Instance Resources: mem-estimate=494.69MB mem-reservation=73.00MB thread-reservation=1 runtime-filters-memory=4.00MB +| max-parallelism=1 segment-costs=[926102072, 16987437, 8339760] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8292642 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8339760 | 10:SORT | order by: count() DESC NULLS FIRST, c_last_name ASC NULLS LAST -| mem-estimate=105.72MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=1.38M cost=5384984 +| mem-estimate=106.32MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=1.39M cost=5415581 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| mem-estimate=50.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=1.38M cost=1987055 +| mem-estimate=50.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=0,10 row-size=88B cardinality=1.39M cost=1998345 | in pipelines: 00(GETNEXT), 08(OPEN) | |--08:AGGREGATE [FINALIZE] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(5 AS BIGINT), count() >= CAST(1 AS BIGINT) -| | mem-estimate=421.79MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=1.38M cost=81580247 +| | mem-estimate=424.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=1.39M cost=82043773 | | in pipelines: 08(GETNEXT), 01(OPEN) | | | 07:HASH JOIN [INNER JOIN] @@ -64,7 +64,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.82M cost=22755441 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.90M cost=22884733 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -85,20 +85,20 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=68B cardinality=78.95M cost=36340938 +| | tuple-ids=2,4,6 row-size=68B cardinality=79.40M cost=36547420 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=6 row-size=12B cardinality=354 cost=20833 | | in pipelines: 04(GETNEXT) | | | 03:HASH JOIN [INNER JOIN] @@ -106,7 +106,7 @@ PLAN-ROOT SINK | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165789 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290985 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] @@ -131,10 +131,10 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -147,32 +147,32 @@ PLAN-ROOT SINK extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=1.38M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=1.39M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=206.70MB Threads=20 -Per-Host Resource Estimates: Memory=638MB +Per-Host Resource Estimates: Memory=639MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=111.39MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[8863893] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))] +| Per-Instance Resources: mem-estimate=111.45MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[8914256] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8292642 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8339760 | 17:MERGING-EXCHANGE [UNPARTITIONED] | order by: count() DESC NULLS FIRST, c_last_name ASC NULLS LAST -| mem-estimate=11.39MB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=1.38M cost=571251 +| mem-estimate=11.45MB mem-reservation=0B thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=1.39M cost=574496 | in pipelines: 10(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB Per-Instance Resources: mem-estimate=28.00MB mem-reservation=13.00MB thread-reservation=1 -max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +max-parallelism=10 segment-costs=[15597477, 3357850] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] 10:SORT | order by: count() DESC NULLS FIRST, c_last_name ASC NULLS LAST | mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=1.38M cost=5384984 +| tuple-ids=11 row-size=80B cardinality=1.39M cost=5415581 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -180,48 +180,48 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=1.38M cost=604948 +| tuple-ids=0,10 row-size=88B cardinality=1.39M cost=608385 | in pipelines: 00(GETNEXT), 15(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=61.60MB mem-reservation=35.00MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[3218927] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +| | Per-Instance Resources: mem-estimate=61.75MB mem-reservation=35.00MB thread-reservation=1 runtime-filters-memory=1.00MB +| | max-parallelism=10 segment-costs=[3237210] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=50.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1382107 +| | mem-estimate=50.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1389960 | | | 16:EXCHANGE [BROADCAST] | | mem-estimate=10.23MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=1.38M cost=1836820 +| | tuple-ids=10 row-size=20B cardinality=1.39M cost=1847250 | | in pipelines: 15(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=10 (adjusted from 120) -| Per-Instance Resources: mem-estimate=54.52MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=10 segment-costs=[84387306, 104487] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +| Per-Instance Resources: mem-estimate=54.76MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[84866781, 105080] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] | 15:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(5 AS BIGINT), count() >= CAST(1 AS BIGINT) -| | mem-estimate=42.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=1.38M cost=81580247 +| | mem-estimate=42.42MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=1.39M cost=82043773 | | in pipelines: 15(GETNEXT), 01(OPEN) | | | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=13.82M cost=2807059 +| | tuple-ids=10 row-size=20B cardinality=13.90M cost=2823008 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=100 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB | Per-Instance Resources: mem-estimate=26.94MB mem-reservation=5.50MB thread-reservation=1 -| max-parallelism=100 segment-costs=[921263858, 24922153] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))] +| max-parallelism=100 segment-costs=[926077115, 25063756] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))] | 08:AGGREGATE [STREAMING] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | mem-estimate=10.00MB mem-reservation=5.00MB spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=13.82M cost=81580247 +| | tuple-ids=10 row-size=20B cardinality=13.90M cost=82043773 | | in pipelines: 01(GETNEXT) | | | 07:HASH JOIN [INNER JOIN, BROADCAST] @@ -229,7 +229,7 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.82M cost=22755324 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.90M cost=22884616 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -267,21 +267,21 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=68B cardinality=78.95M cost=36340586 +| | tuple-ids=2,4,6 row-size=68B cardinality=79.40M cost=36547066 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=02 plan-id=03 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 12:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=6 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=6 row-size=12B cardinality=354 cost=470 | | | in pipelines: 04(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -289,15 +289,15 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | max-parallelism=1 segment-costs=[20852] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=6 row-size=12B cardinality=354 cost=20833 | | in pipelines: 04(GETNEXT) | | | 03:HASH JOIN [INNER JOIN, BROADCAST] @@ -305,7 +305,7 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165391 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290587 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -347,10 +347,10 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] @@ -363,32 +363,32 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=1.38M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=1.39M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=206.70MB Threads=20 -Per-Host Resource Estimates: Memory=638MB +Per-Host Resource Estimates: Memory=639MB F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=111.39MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[8863893] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))] +| Per-Instance Resources: mem-estimate=111.45MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[8914256] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, count() -| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8292642 +| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=8339760 | 17:MERGING-EXCHANGE [UNPARTITIONED] | order by: count() DESC NULLS FIRST, c_last_name ASC NULLS LAST -| mem-estimate=11.39MB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=1.38M cost=571251 +| mem-estimate=11.45MB mem-reservation=0B thread-reservation=0 +| tuple-ids=11 row-size=80B cardinality=1.39M cost=574496 | in pipelines: 10(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB Per-Instance Resources: mem-estimate=28.00MB mem-reservation=13.00MB thread-reservation=1 -max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +max-parallelism=10 segment-costs=[15597477, 3357850] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] 10:SORT | order by: count() DESC NULLS FIRST, c_last_name ASC NULLS LAST | mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=11 row-size=80B cardinality=1.38M cost=5384984 +| tuple-ids=11 row-size=80B cardinality=1.39M cost=5415581 | in pipelines: 10(GETNEXT), 00(OPEN) | 09:HASH JOIN [INNER JOIN, BROADCAST] @@ -396,48 +396,48 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | fk/pk conjuncts: none | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=0,10 row-size=88B cardinality=1.38M cost=604948 +| tuple-ids=0,10 row-size=88B cardinality=1.39M cost=608385 | in pipelines: 00(GETNEXT), 15(OPEN) | |--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=61.60MB mem-reservation=35.00MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[3218927] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +| | Per-Instance Resources: mem-estimate=61.75MB mem-reservation=35.00MB thread-reservation=1 runtime-filters-memory=1.00MB +| | max-parallelism=10 segment-costs=[3237210] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] | JOIN BUILD | | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| | mem-estimate=50.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1382107 +| | mem-estimate=50.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1389960 | | | 16:EXCHANGE [BROADCAST] | | mem-estimate=10.23MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=1.38M cost=1836820 +| | tuple-ids=10 row-size=20B cardinality=1.39M cost=1847250 | | in pipelines: 15(GETNEXT) | | | F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=10 (adjusted from 120) -| Per-Instance Resources: mem-estimate=54.52MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=10 segment-costs=[84387306, 104487] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] +| Per-Instance Resources: mem-estimate=54.76MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[84866781, 105080] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))] | 15:AGGREGATE [FINALIZE] | | output: count:merge() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | having: count() <= CAST(5 AS BIGINT), count() >= CAST(1 AS BIGINT) -| | mem-estimate=42.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=1.38M cost=81580247 +| | mem-estimate=42.42MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=10 row-size=20B cardinality=1.39M cost=82043773 | | in pipelines: 15(GETNEXT), 01(OPEN) | | | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=13.82M cost=2807059 +| | tuple-ids=10 row-size=20B cardinality=13.90M cost=2823008 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=100 (adjusted from 120) | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB | Per-Instance Resources: mem-estimate=26.94MB mem-reservation=5.50MB thread-reservation=1 -| max-parallelism=100 segment-costs=[921263858, 24922153] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))] +| max-parallelism=100 segment-costs=[926077115, 25063756] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))] | 08:AGGREGATE [STREAMING] | | output: count() | | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk | | mem-estimate=10.00MB mem-reservation=5.00MB spill-buffer=256.00KB thread-reservation=0 -| | tuple-ids=10 row-size=20B cardinality=13.82M cost=81580247 +| | tuple-ids=10 row-size=20B cardinality=13.90M cost=82043773 | | in pipelines: 01(GETNEXT) | | | 07:HASH JOIN [INNER JOIN, BROADCAST] @@ -445,7 +445,7 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.82M cost=22755324 +| | tuple-ids=2,4,6,8 row-size=97B cardinality=13.90M cost=22884616 | | in pipelines: 01(GETNEXT), 06(OPEN) | | | |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -483,21 +483,21 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4,6 row-size=68B cardinality=78.95M cost=36340586 +| | tuple-ids=2,4,6 row-size=68B cardinality=79.40M cost=36547066 | | in pipelines: 01(GETNEXT), 04(OPEN) | | | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[812] +| | | max-parallelism=10 segment-costs=[824] | | JOIN BUILD | | | join-table-id=02 plan-id=03 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=352 +| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=354 | | | | | 12:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=6 row-size=12B cardinality=352 cost=460 +| | | tuple-ids=6 row-size=12B cardinality=354 cost=470 | | | in pipelines: 04(GETNEXT) | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -505,15 +505,15 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | max-parallelism=1 segment-costs=[20852] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(1999 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dom <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_dom >= CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=6 row-size=12B cardinality=352 cost=20833 +| | tuple-ids=6 row-size=12B cardinality=354 cost=20833 | | in pipelines: 04(GETNEXT) | | | 03:HASH JOIN [INNER JOIN, BROADCAST] @@ -521,7 +521,7 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=2,4 row-size=56B cardinality=85.91M(filtered from 409.11M) cost=96165391 +| | tuple-ids=2,4 row-size=56B cardinality=86.39M(filtered from 409.11M) cost=96290587 | | in pipelines: 01(GETNEXT), 02(OPEN) | | | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -563,10 +563,10 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=352(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=354(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=24B cardinality=85.91M(filtered from 7.58G) cost=684422310 +| tuple-ids=2 row-size=24B cardinality=86.39M(filtered from 7.58G) cost=688311073 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] @@ -579,6 +579,6 @@ max-parallelism=10 segment-costs=[15563443, 3338879] cpu-comparison-result=100 [ extrapolated-rows=disabled max-scan-range-rows=3.10M parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 - tuple-ids=0 row-size=68B cardinality=1.38M(filtered from 30.00M) cost=9573511 + tuple-ids=0 row-size=68B cardinality=1.39M(filtered from 30.00M) cost=9573511 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q74.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q74.test index 6e256a07c..d18904810 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q74.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q74.test @@ -61,231 +61,84 @@ limit 100 # end query 74 in stream 0 using template query74.tpl ---- PLAN -Max Per-Host Resource Reservation: Memory=367.94MB Threads=1 -Per-Host Resource Estimates: Memory=42.20GB +Max Per-Host Resource Reservation: Memory=381.00MB Threads=1 +Per-Host Resource Estimates: Memory=89.29GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=42.20GB mem-reservation=367.94MB thread-reservation=1 runtime-filters-memory=88.00MB -| max-parallelism=1 segment-costs=[11304530520, 3126560517, 1192542035, 370532487, 213986431, 300] +| Per-Instance Resources: mem-estimate=89.29GB mem-reservation=381.00MB thread-reservation=1 runtime-filters-memory=100.00MB +| max-parallelism=1 segment-costs=[10500524870, 2912347032, 10500524870, 2912347032, 2559670833, 300] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 | 27:TOP-N [LIMIT=100] -| order by: tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST +| order by: tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST | mem-estimate=6.25KB mem-reservation=0B thread-reservation=0 -| tuple-ids=28 row-size=64B cardinality=100 cost=29454398 -| in pipelines: 27(GETNEXT), 17(OPEN) +| tuple-ids=28 row-size=64B cardinality=100 cost=2263026260 +| in pipelines: 27(GETNEXT), 05(OPEN) | 26:HASH JOIN [INNER JOIN] -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END -| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id -| mem-estimate=404.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27,13,6 row-size=288B cardinality=2.46M cost=9153555 -| in pipelines: 17(GETNEXT), 05(OPEN) -| -|--05:AGGREGATE [FINALIZE] -| | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.date_dim.d_year -| | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL -| | mem-estimate=2.49GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=4.50M cost=265476884 -| | in pipelines: 05(GETNEXT), 00(OPEN) -| | -| 04:HASH JOIN [INNER JOIN] -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | fk/pk conjuncts: none -| | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | mem-estimate=2.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=0,2,4 row-size=88B cardinality=44.98M cost=60820960 -| | in pipelines: 00(GETNEXT), 01(OPEN) -| | -| |--03:HASH JOIN [INNER JOIN] -| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=2,4 row-size=20B cardinality=44.98M cost=19686147 -| | | in pipelines: 01(GETNEXT), 02(OPEN) -| | | -| | |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] -| | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL -| | | stored statistics: -| | | table: rows=73.05K size=2.17MB -| | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL -| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=4 row-size=8B cardinality=38 cost=14573 -| | | in pipelines: 02(GETNEXT) -| | | -| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales] -| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL -| | HDFS partitions=1823/1824 files=1823 size=145.67GB -| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL -| | runtime filters: RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk -| | stored statistics: -| | table: rows=2.16G size=145.75GB -| | partitions: 1823/1823 rows=2.16G -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=38(filtered from 1823) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=2 row-size=12B cardinality=44.98M(filtered from 2.16G) cost=9037990 -| | in pipelines: 01(GETNEXT) -| | -| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] -| HDFS partitions=1/1 files=1 size=1.55GB -| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL -| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_sk -| stored statistics: -| table: rows=30.00M size=1.55GB -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.10M -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 00(GETNEXT) -| -25:HASH JOIN [INNER JOIN] -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| mem-estimate=1.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27,13 row-size=216B cardinality=16.41M cost=60712496 -| in pipelines: 17(GETNEXT), 11(OPEN) -| -|--11:AGGREGATE [FINALIZE] -| | output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| | having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL -| | mem-estimate=3.66GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=16.41M cost=968819744 -| | in pipelines: 11(GETNEXT), 07(OPEN) -| | -| 10:HASH JOIN [INNER JOIN] -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | fk/pk conjuncts: none -| | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | mem-estimate=2.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=9,11,7 row-size=88B cardinality=164.13M cost=101841629 -| | in pipelines: 07(GETNEXT), 06(OPEN) -| | -| |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] -| | HDFS partitions=1/1 files=1 size=1.55GB -| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | stored statistics: -| | table: rows=30.00M size=1.55GB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.10M -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=7 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 06(GETNEXT) -| | -| 09:HASH JOIN [INNER JOIN] -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=9,11 row-size=20B cardinality=164.13M cost=71841667 -| | in pipelines: 07(GETNEXT), 08(OPEN) -| | -| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] -| | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | stored statistics: -| | table: rows=73.05K size=2.17MB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=11 row-size=8B cardinality=38 cost=14573 -| | in pipelines: 08(GETNEXT) -| | -| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] -| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL -| HDFS partitions=1823/1824 files=1823 size=389.69GB -| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL -| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| stored statistics: -| table: rows=8.64G size=389.90GB -| partitions: 1823/1823 rows=8.25G -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=38(filtered from 1823) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=9 row-size=12B cardinality=164.13M(filtered from 7.88G) cost=34528489 -| in pipelines: 07(GETNEXT) -| -24:HASH JOIN [INNER JOIN] | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| mem-estimate=3.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27 row-size=144B cardinality=161.11M cost=114665982 -| in pipelines: 17(GETNEXT), 23(OPEN) +| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END +| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id +| mem-estimate=3.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6,20,13,27 row-size=272B cardinality=147.90M cost=105360551 +| in pipelines: 05(GETNEXT), 25(OPEN) | -|--23:AGGREGATE [FINALIZE] +|--25:AGGREGATE [FINALIZE] | | output: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.date_dim_2.d_year +| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name | | having: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) -| | mem-estimate=6.37GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=44.15M cost=2605865203 -| | in pipelines: 23(GETNEXT), 19(OPEN) +| | mem-estimate=9.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=40.63M cost=2398033848 +| | in pipelines: 25(GETNEXT), 20(OPEN) | | -| 22:HASH JOIN [INNER JOIN] +| 24:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk -| | fk/pk conjuncts: none -| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk +| | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | mem-estimate=2.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23,25,21 row-size=88B cardinality=441.48M cost=223234710 -| | in pipelines: 19(GETNEXT), 18(OPEN) +| | tuple-ids=21,23,25 row-size=88B cardinality=406.27M cost=216854633 +| | in pipelines: 20(GETNEXT), 23(OPEN) | | -| |--18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +| |--23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL -| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id | | stored statistics: | | table: rows=30.00M size=1.55GB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=21 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 18(GETNEXT) +| | tuple-ids=25 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 23(GETNEXT) | | -| 21:HASH JOIN [INNER JOIN] +| 22:HASH JOIN [INNER JOIN] | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk +| | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=23,25 row-size=20B cardinality=441.48M cost=193235083 -| | in pipelines: 19(GETNEXT), 20(OPEN) +| | tuple-ids=21,23 row-size=20B cardinality=441.48M cost=193235083 +| | in pipelines: 20(GETNEXT), 21(OPEN) | | -| |--20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| |--21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=25 row-size=8B cardinality=373 cost=14573 -| | in pipelines: 20(GETNEXT) +| | tuple-ids=23 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 21(GETNEXT) | | -| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales] +| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales] | partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL | HDFS partitions=1823/1824 files=1823 size=145.67GB | predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL -| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk +| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk | stored statistics: | table: rows=2.16G size=145.75GB | partitions: 1823/1823 rows=2.16G @@ -293,536 +146,383 @@ PLAN-ROOT SINK | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=23 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 -| in pipelines: 19(GETNEXT) +| tuple-ids=21 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| in pipelines: 20(GETNEXT) | -17:AGGREGATE [FINALIZE] -| output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) -| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year -| having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) -| mem-estimate=17.80GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=161.11M cost=9509730637 -| in pipelines: 17(GETNEXT), 13(OPEN) +19:HASH JOIN [INNER JOIN] +| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| mem-estimate=6.05GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6,20,13 row-size=204B cardinality=147.90M cost=105360551 +| in pipelines: 05(GETNEXT), 17(OPEN) | -16:HASH JOIN [INNER JOIN] -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| fk/pk conjuncts: none -| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +|--18:HASH JOIN [INNER JOIN] +| | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | mem-estimate=3.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20,13 row-size=136B cardinality=40.63M cost=85923471 +| | in pipelines: 17(GETNEXT), 11(OPEN) +| | +| |--11:AGGREGATE [FINALIZE] +| | | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) +| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| | | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL +| | | mem-estimate=9.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=40.63M cost=2398033848 +| | | in pipelines: 11(GETNEXT), 06(OPEN) +| | | +| | 10:HASH JOIN [INNER JOIN] +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | mem-estimate=2.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=7,9,11 row-size=88B cardinality=406.27M cost=216854633 +| | | in pipelines: 06(GETNEXT), 09(OPEN) +| | | +| | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +| | | HDFS partitions=1/1 files=1 size=1.55GB +| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | stored statistics: +| | | table: rows=30.00M size=1.55GB +| | | columns: all +| | | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | | tuple-ids=11 row-size=68B cardinality=30.00M cost=15495933 +| | | in pipelines: 09(GETNEXT) +| | | +| | 08:HASH JOIN [INNER JOIN] +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 +| | | tuple-ids=7,9 row-size=20B cardinality=441.48M cost=193235083 +| | | in pipelines: 06(GETNEXT), 07(OPEN) +| | | +| | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| | | HDFS partitions=1/1 files=1 size=2.17MB +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | stored statistics: +| | | table: rows=73.05K size=2.17MB +| | | columns: all +| | | extrapolated-rows=disabled max-scan-range-rows=73.05K +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 07(GETNEXT) +| | | +| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales] +| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL +| | HDFS partitions=1823/1824 files=1823 size=145.67GB +| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL +| | runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk +| | stored statistics: +| | table: rows=2.16G size=145.75GB +| | partitions: 1823/1823 rows=2.16G +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 +| | tuple-ids=7 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| | in pipelines: 06(GETNEXT) +| | +| 17:AGGREGATE [FINALIZE] +| | output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) +| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name +| | having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) +| | mem-estimate=29.21GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=147.90M cost=8729673496 +| | in pipelines: 17(GETNEXT), 12(OPEN) +| | +| 16:HASH JOIN [INNER JOIN] +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | mem-estimate=2.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14,16,18 row-size=88B cardinality=1.48G cost=711235853 +| | in pipelines: 12(GETNEXT), 15(OPEN) +| | +| |--15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +| | HDFS partitions=1/1 files=1 size=1.55GB +| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | stored statistics: +| | table: rows=30.00M size=1.55GB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | tuple-ids=18 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 15(GETNEXT) +| | +| 14:HASH JOIN [INNER JOIN] +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 +| | tuple-ids=14,16 row-size=20B cardinality=1.61G cost=705182682 +| | in pipelines: 12(GETNEXT), 13(OPEN) +| | +| |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +| | HDFS partitions=1/1 files=1 size=2.17MB +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | stored statistics: +| | table: rows=73.05K size=2.17MB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=73.05K +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| | tuple-ids=16 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 13(GETNEXT) +| | +| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] +| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL +| HDFS partitions=1823/1824 files=1823 size=389.69GB +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk +| stored statistics: +| table: rows=8.64G size=389.90GB +| partitions: 1823/1823 rows=8.25G +| columns: all +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| tuple-ids=14 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 +| in pipelines: 12(GETNEXT) +| +05:AGGREGATE [FINALIZE] +| output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) +| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL +| mem-estimate=29.21GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=147.90M cost=8729673496 +| in pipelines: 05(GETNEXT), 00(OPEN) +| +04:HASH JOIN [INNER JOIN] +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk +| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=2.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=16,18,14 row-size=88B cardinality=1.61G cost=735182309 -| in pipelines: 13(GETNEXT), 12(OPEN) +| tuple-ids=0,2,4 row-size=88B cardinality=1.48G cost=711235853 +| in pipelines: 00(GETNEXT), 03(OPEN) | -|--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] +|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] | HDFS partitions=1/1 files=1 size=1.55GB -| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL -| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL +| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id | stored statistics: | table: rows=30.00M size=1.55GB | columns: all | extrapolated-rows=disabled max-scan-range-rows=3.10M -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=14 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 12(GETNEXT) +| tuple-ids=4 row-size=68B cardinality=30.00M cost=15495933 +| in pipelines: 03(GETNEXT) | -15:HASH JOIN [INNER JOIN] -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +02:HASH JOIN [INNER JOIN] +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=16,18 row-size=20B cardinality=1.61G cost=705182682 -| in pipelines: 13(GETNEXT), 14(OPEN) +| tuple-ids=0,2 row-size=20B cardinality=1.61G cost=705182682 +| in pipelines: 00(GETNEXT), 01(OPEN) | -|--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] +|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=18 row-size=8B cardinality=373 cost=14573 -| in pipelines: 14(GETNEXT) +| tuple-ids=2 row-size=8B cardinality=373 cost=12520 +| in pipelines: 01(GETNEXT) | -13:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] - partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL +00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] + partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL HDFS partitions=1823/1824 files=1823 size=389.69GB - predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL - runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL + runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk stored statistics: table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=16 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 - in pipelines: 13(GETNEXT) + tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 + in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN -Max Per-Host Resource Reservation: Memory=4.47GB Threads=140 -Per-Host Resource Estimates: Memory=39.14GB -F20:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=4.20MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[338] cpu-comparison-result=528 [max(1 (self) vs 528 (sum children))] +Max Per-Host Resource Reservation: Memory=7.01GB Threads=207 +Per-Host Resource Estimates: Memory=63.51GB +F19:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 +| Per-Instance Resources: mem-estimate=4.78MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[338] cpu-comparison-result=720 [max(1 (self) vs 720 (sum children))] PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 | -51:MERGING-EXCHANGE [UNPARTITIONED] -| order by: tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST +50:MERGING-EXCHANGE [UNPARTITIONED] +| order by: tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST | limit: 100 -| mem-estimate=199.75KB mem-reservation=0B thread-reservation=0 +| mem-estimate=797.15KB mem-reservation=0B thread-reservation=0 | tuple-ids=28 row-size=64B cardinality=100 cost=38 | in pipelines: 27(GETNEXT) | -F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -Per-Instance Resources: mem-estimate=18.91MB mem-reservation=0B thread-reservation=1 -max-parallelism=30 segment-costs=[220162820, 199] cpu-comparison-result=528 [max(30 (self) vs 528 (sum children))] +F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=18.44MB mem-reservation=0B thread-reservation=1 +max-parallelism=250 segment-costs=[2455164590, 199] cpu-comparison-result=720 [max(120 (self) vs 720 (sum children))] 27:TOP-N [LIMIT=100] -| order by: tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST +| order by: tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST | mem-estimate=6.25KB mem-reservation=0B thread-reservation=0 -| tuple-ids=28 row-size=64B cardinality=100 cost=29454398 +| tuple-ids=28 row-size=64B cardinality=100 cost=2263026260 | in pipelines: 27(GETNEXT), 31(OPEN) | 26:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=00 -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END -| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0 -| tuple-ids=20,27,13,6 row-size=288B cardinality=2.46M cost=4655929 -| in pipelines: 31(GETNEXT), 49(OPEN) -| -|--F21:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=33.23MB mem-reservation=21.00MB thread-reservation=1 runtime-filters-memory=4.00MB -| | max-parallelism=30 segment-costs=[6486252] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| JOIN BUILD -| | join-table-id=00 plan-id=01 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id -| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id -| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=4497626 -| | -| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)] -| | mem-estimate=12.23MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=4.50M cost=1988626 -| | in pipelines: 49(GETNEXT) -| | -| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.date_dim.d_year)] hosts=10 instances=30 (adjusted from 10) -| Per-Instance Resources: mem-estimate=131.54MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=30 segment-costs=[285363147, 23162337] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| 49:AGGREGATE [FINALIZE] -| | output: max:merge(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.date_dim.d_year -| | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL -| | mem-estimate=120.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=4.50M cost=265476884 -| | in pipelines: 49(GETNEXT), 00(OPEN) -| | -| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.date_dim.d_year)] -| | mem-estimate=11.48MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=44.98M cost=19886263 -| | in pipelines: 00(GETNEXT) -| | -| F18:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=20 (adjusted from 10) -| Per-Instance Resources: mem-estimate=154.66MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=30 segment-costs=[294034088, 231623386] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| 05:AGGREGATE [STREAMING] -| | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.date_dim.d_year -| | mem-estimate=135.06MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=44.98M cost=265476884 -| | in pipelines: 00(GETNEXT) -| | -| 04:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=01 -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | fk/pk conjuncts: none -| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=0,2,4 row-size=88B cardinality=44.98M cost=15844698 -| | in pipelines: 00(GETNEXT), 01(OPEN) -| | -| |--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=20 (adjusted from 10) -| | | Per-Instance Resources: mem-estimate=139.68MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=30 segment-costs=[55766067] cpu-comparison-result=40 [max(40 (self) vs 11 (sum children))] -| | JOIN BUILD -| | | join-table-id=01 plan-id=02 cohort-id=02 -| | | build expressions: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | | mem-estimate=129.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44976262 -| | | -| | 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] -| | | mem-estimate=10.55MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=2,4 row-size=20B cardinality=44.98M cost=10789805 -| | | in pipelines: 01(GETNEXT) -| | | -| | F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120) -| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=18.19MB mem-reservation=128.00KB thread-reservation=1 -| | max-parallelism=20 segment-costs=[132997064] -| | 03:HASH JOIN [INNER JOIN, BROADCAST] -| | | hash-table-id=02 -| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=2,4 row-size=20B cardinality=44.98M cost=19686109 -| | | in pipelines: 01(GETNEXT), 02(OPEN) -| | | -| | |--F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | | | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[88] -| | | JOIN BUILD -| | | | join-table-id=02 plan-id=03 cohort-id=03 -| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=38 -| | | | -| | | 45:EXCHANGE [BROADCAST] -| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=4 row-size=8B cardinality=38 cost=50 -| | | | in pipelines: 02(GETNEXT) -| | | | -| | | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 -| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[14574] -| | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] -| | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL -| | | stored statistics: -| | | table: rows=73.05K size=2.17MB -| | | columns: all -| | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL -| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=4 row-size=8B cardinality=38 cost=14573 -| | | in pipelines: 02(GETNEXT) -| | | -| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] -| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL -| | HDFS partitions=1823/1824 files=1823 size=145.67GB -| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL -| | runtime filters: RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk -| | stored statistics: -| | table: rows=2.16G size=145.75GB -| | partitions: 1823/1823 rows=2.16G -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=38(filtered from 1823) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=2 row-size=12B cardinality=44.98M(filtered from 2.16G) cost=9037990 -| | in pipelines: 01(GETNEXT) -| | -| 46:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] -| | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=0 row-size=68B cardinality=30.00M cost=12712506 -| | in pipelines: 00(GETNEXT) -| | -| F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| Per-Instance Resources: mem-estimate=21.62MB mem-reservation=1.00MB thread-reservation=1 -| max-parallelism=10 segment-costs=[162265022] -| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] -| HDFS partitions=1/1 files=1 size=1.55GB -| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL -| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_sk -| stored statistics: -| table: rows=30.00M size=1.55GB -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.10M -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 00(GETNEXT) -| -25:HASH JOIN [INNER JOIN, PARTITIONED] -| hash-table-id=03 -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27,13 row-size=216B cardinality=16.41M cost=44299055 -| in pipelines: 31(GETNEXT), 43(OPEN) -| -|--F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=84.51MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[23670647] cpu-comparison-result=128 [max(30 (self) vs 128 (sum children))] -| JOIN BUILD -| | join-table-id=03 plan-id=04 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | mem-estimate=50.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16413441 -| | -| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)] -| | mem-estimate=18.16MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=16.41M cost=7257206 -| | in pipelines: 43(GETNEXT) -| | -| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=136.16MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1041391806, 84527628] cpu-comparison-result=128 [max(110 (self) vs 128 (sum children))] -| 43:AGGREGATE [FINALIZE] -| | output: max:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| | having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL -| | mem-estimate=119.49MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=16.41M cost=968819744 -| | in pipelines: 43(GETNEXT), 07(OPEN) -| | -| 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] -| | mem-estimate=16.68MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=164.13M cost=72572062 -| | in pipelines: 07(GETNEXT) -| | -| F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=90 (adjusted from 120) -| Per-Instance Resources: mem-estimate=153.21MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1080037216, 845276268] cpu-comparison-result=128 [max(128 (self) vs 111 (sum children))] -| 11:AGGREGATE [STREAMING] -| | output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| | mem-estimate=109.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=164.13M cost=968819744 -| | in pipelines: 07(GETNEXT) -| | -| 10:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=04 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | fk/pk conjuncts: none -| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=9,11,7 row-size=88B cardinality=164.13M cost=71841629 -| | in pipelines: 07(GETNEXT), 06(OPEN) -| | -| |--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=90 (adjusted from 120) -| | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | | max-parallelism=110 segment-costs=[42712506] -| | JOIN BUILD -| | | join-table-id=04 plan-id=05 cohort-id=04 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 -| | | -| | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] -| | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=7 row-size=68B cardinality=30.00M cost=12712506 -| | | in pipelines: 06(GETNEXT) -| | | -| | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB -| | Per-Instance Resources: mem-estimate=41.30MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[162265022] -| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] -| | HDFS partitions=1/1 files=1 size=1.55GB -| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | stored statistics: -| | table: rows=30.00M size=1.55GB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.10M -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=7 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 06(GETNEXT) -| | -| 40:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] -| | mem-estimate=11.04MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=9,11 row-size=20B cardinality=164.13M cost=39375843 -| | in pipelines: 07(GETNEXT) -| | -| F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=38 (adjusted from 120) -| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB -| Per-Instance Resources: mem-estimate=25.84MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=38 segment-costs=[486899324] -| 09:HASH JOIN [INNER JOIN, BROADCAST] -| | hash-table-id=05 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=9,11 row-size=20B cardinality=164.13M cost=71841629 -| | in pipelines: 07(GETNEXT), 08(OPEN) -| | -| |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[88] -| | JOIN BUILD -| | | join-table-id=05 plan-id=06 cohort-id=04 -| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=38 -| | | -| | 39:EXCHANGE [BROADCAST] -| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=8B cardinality=38 cost=50 -| | | in pipelines: 08(GETNEXT) -| | | -| | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 -| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=1 segment-costs=[14574] -| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] -| | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | stored statistics: -| | table: rows=73.05K size=2.17MB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=11 row-size=8B cardinality=38 cost=14573 -| | in pipelines: 08(GETNEXT) -| | -| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] -| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL -| HDFS partitions=1823/1824 files=1823 size=389.69GB -| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL -| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk -| stored statistics: -| table: rows=8.64G size=389.90GB -| partitions: 1823/1823 rows=8.25G -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=38(filtered from 1823) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=9 row-size=12B cardinality=164.13M(filtered from 7.88G) cost=34528489 -| in pipelines: 07(GETNEXT) -| -24:HASH JOIN [INNER JOIN, PARTITIONED] -| hash-table-id=06 | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id +| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27 row-size=144B cardinality=161.11M cost=70518230 -| in pipelines: 31(GETNEXT), 36(OPEN) +| tuple-ids=6,20,13,27 row-size=272B cardinality=147.90M cost=64733813 +| in pipelines: 31(GETNEXT), 48(OPEN) | -|--F27:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=168.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[63667689] cpu-comparison-result=240 [max(30 (self) vs 240 (sum children))] +|--F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=68.43MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | max-parallelism=250 segment-costs=[57842326] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] | JOIN BUILD -| | join-table-id=06 plan-id=07 cohort-id=01 +| | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| | mem-estimate=133.80MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752 +| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id +| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 | | -| 38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] -| | mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=44.15M cost=19519937 -| | in pipelines: 36(GETNEXT) +| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=40.63M cost=17215588 +| | in pipelines: 48(GETNEXT) | | -| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.date_dim_2.d_year)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=313.51MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=290 segment-costs=[2801064582, 227356640] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] -| 36:AGGREGATE [FINALIZE] +| F18:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=291.93MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=260 segment-costs=[2570189737, 198758311] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| 48:AGGREGATE [FINALIZE] | | output: max:merge(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.date_dim_2.d_year +| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name | | having: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) -| | mem-estimate=294.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=44.15M cost=2605865203 -| | in pipelines: 36(GETNEXT), 19(OPEN) +| | mem-estimate=258.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=40.63M cost=2398033848 +| | in pipelines: 48(GETNEXT), 20(OPEN) | | -| 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.date_dim_2.d_year)] -| | mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=441.48M cost=195199379 -| | in pipelines: 19(GETNEXT) +| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=406.27M cost=172155889 +| | in pipelines: 20(GETNEXT) | | -| F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=269.84MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=300 segment-costs=[2905010369, 2273566395] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] -| 23:AGGREGATE [STREAMING] +| F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=240.66MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=270 segment-costs=[2690798937, 1987583127] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +| 25:AGGREGATE [STREAMING] | | output: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.date_dim_2.d_year -| | mem-estimate=220.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=441.48M cost=2605865203 -| | in pipelines: 19(GETNEXT) +| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name +| | mem-estimate=193.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=406.27M cost=2398033848 +| | in pipelines: 20(GETNEXT) | | -| 22:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=07 +| 24:HASH JOIN [INNER JOIN, PARTITIONED] +| | hash-table-id=01 | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk -| | fk/pk conjuncts: none +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23,25,21 row-size=88B cardinality=441.48M cost=193234710 -| | in pipelines: 19(GETNEXT), 18(OPEN) +| | tuple-ids=21,23,25 row-size=88B cardinality=406.27M cost=186854633 +| | in pipelines: 20(GETNEXT), 23(OPEN) | | -| |--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 +| |--F21:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | | max-parallelism=300 segment-costs=[42712506] +| | | max-parallelism=270 segment-costs=[42712506] | | JOIN BUILD -| | | join-table-id=07 plan-id=08 cohort-id=05 +| | | join-table-id=01 plan-id=02 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk -| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk +| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 | | | -| | 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] +| | 46:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] | | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=21 row-size=68B cardinality=30.00M cost=12712506 -| | | in pipelines: 18(GETNEXT) +| | | tuple-ids=25 row-size=68B cardinality=30.00M cost=12712506 +| | | in pipelines: 23(GETNEXT) | | | -| | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Host Shared Resources: mem-estimate=20.00MB mem-reservation=20.00MB thread-reservation=0 runtime-filters-memory=20.00MB +| | F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[162265022] -| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL -| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id | | stored statistics: | | table: rows=30.00M size=1.55GB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=21 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 18(GETNEXT) +| | tuple-ids=25 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 23(GETNEXT) | | -| 33:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] +| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] | | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23,25 row-size=20B cardinality=441.48M cost=105910456 -| | in pipelines: 19(GETNEXT) +| | tuple-ids=21,23 row-size=20B cardinality=441.48M cost=105910456 +| | in pipelines: 20(GETNEXT) | | -| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=128.00KB thread-reservation=1 | max-parallelism=140 segment-costs=[1305471205] -| 21:HASH JOIN [INNER JOIN, BROADCAST] -| | hash-table-id=08 +| 22:HASH JOIN [INNER JOIN, BROADCAST] +| | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=23,25 row-size=20B cardinality=441.48M cost=193234710 -| | in pipelines: 19(GETNEXT), 20(OPEN) +| | tuple-ids=21,23 row-size=20B cardinality=441.48M cost=193234710 +| | in pipelines: 20(GETNEXT), 21(OPEN) | | -| |--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| |--F22:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[863] | | JOIN BUILD -| | | join-table-id=08 plan-id=09 cohort-id=05 +| | | join-table-id=02 plan-id=03 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk +| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 | | | -| | 32:EXCHANGE [BROADCAST] +| | 44:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=25 row-size=8B cardinality=373 cost=490 -| | | in pipelines: 20(GETNEXT) +| | | tuple-ids=23 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 21(GETNEXT) | | | -| | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| | F15:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=1 segment-costs=[14589] -| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | max-parallelism=1 segment-costs=[12536] +| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=25 row-size=8B cardinality=373 cost=14573 -| | in pipelines: 20(GETNEXT) +| | tuple-ids=23 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 21(GETNEXT) | | -| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] +| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] | partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL | HDFS partitions=1823/1824 files=1823 size=145.67GB | predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL -| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk +| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk | stored statistics: | table: rows=2.16G size=145.75GB | partitions: 1823/1823 rows=2.16G @@ -830,734 +530,1023 @@ max-parallelism=30 segment-costs=[220162820, 199] cpu-comparison-result=528 [max | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=23 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 -| in pipelines: 19(GETNEXT) +| tuple-ids=21 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| in pipelines: 20(GETNEXT) | -37:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] -| mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=161.11M cost=71235208 -| in pipelines: 31(GETNEXT) -| -F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=1.07GB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1030 segment-costs=[10222082724, 829705387] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] -31:AGGREGATE [FINALIZE] -| output: max:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) -| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year -| having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) -| mem-estimate=1.05GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=161.11M cost=9509730637 -| in pipelines: 31(GETNEXT), 13(OPEN) -| -30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year)] -| mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=1.61G cost=712352087 -| in pipelines: 13(GETNEXT) -| -F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 -Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB -Per-Instance Resources: mem-estimate=857.95MB mem-reservation=34.50MB thread-reservation=1 -max-parallelism=373 segment-costs=[11259019641, 8297053883] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] -17:AGGREGATE [STREAMING] -| output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) -| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year -| mem-estimate=806.34MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=1.61G cost=9509730637 -| in pipelines: 13(GETNEXT) -| -16:HASH JOIN [INNER JOIN, BROADCAST] -| hash-table-id=09 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| fk/pk conjuncts: none +19:HASH JOIN [INNER JOIN, PARTITIONED] +| hash-table-id=03 +| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=16,18,14 row-size=88B cardinality=1.61G cost=705182309 -| in pipelines: 13(GETNEXT), 12(OPEN) +| tuple-ids=6,20,13 row-size=204B cardinality=147.90M cost=64733813 +| in pipelines: 31(GETNEXT), 35(OPEN) | -|--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=2.68GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=10 segment-costs=[69869990] +|--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=70.07MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=250 segment-costs=[148594175] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))] | JOIN BUILD -| | join-table-id=09 plan-id=10 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| | mem-estimate=2.65GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 +| | join-table-id=03 plan-id=04 cohort-id=01 +| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | mem-estimate=51.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 | | -| 29:EXCHANGE [BROADCAST] -| | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=68B cardinality=30.00M cost=39869990 -| | in pipelines: 12(GETNEXT) -| | -| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| Per-Host Shared Resources: mem-estimate=36.00MB mem-reservation=36.00MB thread-reservation=0 runtime-filters-memory=36.00MB -| Per-Instance Resources: mem-estimate=16.28MB mem-reservation=1.00MB thread-reservation=1 -| max-parallelism=10 segment-costs=[21649295] -| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] -| HDFS partitions=1/1 files=1 size=1.55GB -| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL -| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id -| stored statistics: -| table: rows=30.00M size=1.55GB -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.10M -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=14 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 12(GETNEXT) -| -15:HASH JOIN [INNER JOIN, BROADCAST] -| hash-table-id=10 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=16,18 row-size=20B cardinality=1.61G cost=705182309 -| in pipelines: 13(GETNEXT), 14(OPEN) -| -|--F31:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[863] -| JOIN BUILD -| | join-table-id=10 plan-id=11 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 -| | -| 28:EXCHANGE [BROADCAST] -| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=18 row-size=8B cardinality=373 cost=490 -| | in pipelines: 14(GETNEXT) -| | -| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=1 segment-costs=[14589] -| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] -| HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| stored statistics: -| table: rows=73.05K size=2.17MB -| columns: all -| extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=18 row-size=8B cardinality=373 cost=14573 -| in pipelines: 14(GETNEXT) -| -13:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] - partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL - HDFS partitions=1823/1824 files=1823 size=389.69GB - predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL - runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk - stored statistics: - table: rows=8.64G size=389.90GB - partitions: 1823/1823 rows=8.25G - columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL - mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=16 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 - in pipelines: 13(GETNEXT) ----- PARALLELPLANS -Max Per-Host Resource Reservation: Memory=4.65GB Threads=163 -Per-Host Resource Estimates: Memory=37.51GB -F21:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=4.20MB mem-reservation=4.00MB thread-reservation=1 -| max-parallelism=1 segment-costs=[338] cpu-comparison-result=648 [max(1 (self) vs 648 (sum children))] -PLAN-ROOT SINK -| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name -| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 -| -52:MERGING-EXCHANGE [UNPARTITIONED] -| order by: tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST -| limit: 100 -| mem-estimate=199.75KB mem-reservation=0B thread-reservation=0 -| tuple-ids=28 row-size=64B cardinality=100 cost=38 -| in pipelines: 27(GETNEXT) -| -F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -Per-Instance Resources: mem-estimate=18.91MB mem-reservation=0B thread-reservation=1 -max-parallelism=30 segment-costs=[220162820, 199] cpu-comparison-result=648 [max(30 (self) vs 648 (sum children))] -27:TOP-N [LIMIT=100] -| order by: tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST -| mem-estimate=6.25KB mem-reservation=0B thread-reservation=0 -| tuple-ids=28 row-size=64B cardinality=100 cost=29454398 -| in pipelines: 27(GETNEXT), 32(OPEN) -| -26:HASH JOIN [INNER JOIN, PARTITIONED] -| hash-table-id=00 -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id -| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END -| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0 -| tuple-ids=20,27,13,6 row-size=288B cardinality=2.46M cost=4655929 -| in pipelines: 32(GETNEXT), 50(OPEN) -| -|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=33.23MB mem-reservation=21.00MB thread-reservation=1 runtime-filters-memory=4.00MB -| | max-parallelism=30 segment-costs=[6486252] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| JOIN BUILD -| | join-table-id=00 plan-id=01 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id -| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id -| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=4497626 -| | -| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)] -| | mem-estimate=12.23MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=4.50M cost=1988626 -| | in pipelines: 50(GETNEXT) -| | -| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.date_dim.d_year)] hosts=10 instances=30 (adjusted from 10) -| Per-Instance Resources: mem-estimate=131.54MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=30 segment-costs=[285363147, 23162337] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| 50:AGGREGATE [FINALIZE] -| | output: max:merge(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.date_dim.d_year -| | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL -| | mem-estimate=120.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=4.50M cost=265476884 -| | in pipelines: 50(GETNEXT), 00(OPEN) -| | -| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.date_dim.d_year)] -| | mem-estimate=11.48MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=44.98M cost=19886263 -| | in pipelines: 00(GETNEXT) -| | -| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=20 (adjusted from 10) -| Per-Instance Resources: mem-estimate=154.66MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=30 segment-costs=[294034088, 231623386] cpu-comparison-result=40 [max(30 (self) vs 40 (sum children))] -| 05:AGGREGATE [STREAMING] -| | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.date_dim.d_year -| | mem-estimate=135.06MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=6 row-size=72B cardinality=44.98M cost=265476884 -| | in pipelines: 00(GETNEXT) -| | -| 04:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=01 -| | hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_sk = tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | fk/pk conjuncts: none +| 18:HASH JOIN [INNER JOIN, PARTITIONED] +| | hash-table-id=04 +| | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=0,2,4 row-size=88B cardinality=44.98M cost=15844698 -| | in pipelines: 00(GETNEXT), 01(OPEN) +| | tuple-ids=20,13 row-size=136B cardinality=40.63M cost=45296733 +| | in pipelines: 35(GETNEXT), 40(OPEN) | | -| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] hosts=10 instances=20 (adjusted from 10) -| | | Per-Instance Resources: mem-estimate=139.68MB mem-reservation=34.00MB thread-reservation=1 -| | | max-parallelism=30 segment-costs=[55766067] cpu-comparison-result=40 [max(40 (self) vs 11 (sum children))] +| |--F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | | Per-Instance Resources: mem-estimate=68.43MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | max-parallelism=250 segment-costs=[57842326] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] | | JOIN BUILD -| | | join-table-id=01 plan-id=02 cohort-id=02 -| | | build expressions: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk -| | | mem-estimate=129.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44976262 +| | | join-table-id=04 plan-id=05 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 | | | -| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] -| | | mem-estimate=10.55MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=2,4 row-size=20B cardinality=44.98M cost=10789805 -| | | in pipelines: 01(GETNEXT) +| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)] +| | | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=40.63M cost=17215588 +| | | in pipelines: 40(GETNEXT) | | | -| | F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120) -| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB -| | Per-Instance Resources: mem-estimate=18.19MB mem-reservation=128.00KB thread-reservation=1 -| | max-parallelism=20 segment-costs=[132997064] -| | 03:HASH JOIN [INNER JOIN, BROADCAST] -| | | hash-table-id=02 -| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | | tuple-ids=2,4 row-size=20B cardinality=44.98M cost=19686109 -| | | in pipelines: 01(GETNEXT), 02(OPEN) +| | F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=291.93MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=260 segment-costs=[2570189737, 198758311] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| | 40:AGGREGATE [FINALIZE] +| | | output: max:merge(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) +| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| | | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL +| | | mem-estimate=258.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=40.63M cost=2398033848 +| | | in pipelines: 40(GETNEXT), 06(OPEN) | | | -| | |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | | | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | | max-parallelism=10 segment-costs=[88] +| | 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name)] +| | | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=406.27M cost=172155889 +| | | in pipelines: 06(GETNEXT) +| | | +| | F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=240.66MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=270 segment-costs=[2690798937, 1987583127] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +| | 11:AGGREGATE [STREAMING] +| | | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) +| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| | | mem-estimate=193.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=406.27M cost=2398033848 +| | | in pipelines: 06(GETNEXT) +| | | +| | 10:HASH JOIN [INNER JOIN, PARTITIONED] +| | | hash-table-id=05 +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=7,9,11 row-size=88B cardinality=406.27M cost=186854633 +| | | in pipelines: 06(GETNEXT), 09(OPEN) +| | | +| | |--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120 +| | | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | | max-parallelism=270 segment-costs=[42712506] | | | JOIN BUILD -| | | | join-table-id=02 plan-id=03 cohort-id=03 -| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | | | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=38 +| | | | join-table-id=05 plan-id=06 cohort-id=04 +| | | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 | | | | -| | | 46:EXCHANGE [BROADCAST] +| | | 38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] +| | | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=11 row-size=68B cardinality=30.00M cost=12712506 +| | | | in pipelines: 09(GETNEXT) +| | | | +| | | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB +| | | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 +| | | max-parallelism=10 segment-costs=[162265022] +| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | | HDFS partitions=1/1 files=1 size=1.55GB +| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | stored statistics: +| | | table: rows=30.00M size=1.55GB +| | | columns: all +| | | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | | tuple-ids=11 row-size=68B cardinality=30.00M cost=15495933 +| | | in pipelines: 09(GETNEXT) +| | | +| | 37:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] +| | | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=7,9 row-size=20B cardinality=441.48M cost=105910456 +| | | in pipelines: 06(GETNEXT) +| | | +| | F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB +| | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=128.00KB thread-reservation=1 +| | max-parallelism=140 segment-costs=[1305471205] +| | 08:HASH JOIN [INNER JOIN, BROADCAST] +| | | hash-table-id=06 +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| | | tuple-ids=7,9 row-size=20B cardinality=441.48M cost=193234710 +| | | in pipelines: 06(GETNEXT), 07(OPEN) +| | | +| | |--F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB +| | | | max-parallelism=10 segment-costs=[863] +| | | JOIN BUILD +| | | | join-table-id=06 plan-id=07 cohort-id=04 +| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 +| | | | +| | | 36:EXCHANGE [BROADCAST] | | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | | tuple-ids=4 row-size=8B cardinality=38 cost=50 -| | | | in pipelines: 02(GETNEXT) +| | | | tuple-ids=9 row-size=8B cardinality=373 cost=490 +| | | | in pipelines: 07(GETNEXT) | | | | -| | | F18:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| | | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | | max-parallelism=1 segment-costs=[14574] -| | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | max-parallelism=1 segment-costs=[12536] +| | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | | tuple-ids=4 row-size=8B cardinality=38 cost=14573 -| | | in pipelines: 02(GETNEXT) +| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 07(GETNEXT) | | | -| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] +| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] | | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL | | HDFS partitions=1823/1824 files=1823 size=145.67GB | | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL -| | runtime filters: RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk +| | runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk | | stored statistics: | | table: rows=2.16G size=145.75GB | | partitions: 1823/1823 rows=2.16G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=38(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| | tuple-ids=2 row-size=12B cardinality=44.98M(filtered from 2.16G) cost=9037990 -| | in pipelines: 01(GETNEXT) +| | tuple-ids=7 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| | in pipelines: 06(GETNEXT) | | -| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] +| 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=147.90M cost=62670704 +| | in pipelines: 35(GETNEXT) +| | +| F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=973.65MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=940 segment-costs=[9356380541, 723549078] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +| 35:AGGREGATE [FINALIZE] +| | output: max:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) +| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name +| | having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) +| | mem-estimate=939.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=147.90M cost=8729673496 +| | in pipelines: 35(GETNEXT), 12(OPEN) +| | +| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=1.48G cost=626707045 +| | in pipelines: 12(GETNEXT) +| | +| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB +| Per-Instance Resources: mem-estimate=754.67MB mem-reservation=34.50MB thread-reservation=1 +| max-parallelism=373 segment-costs=[10455016044, 7235490759] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +| 17:AGGREGATE [STREAMING] +| | output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) +| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name +| | mem-estimate=704.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=1.48G cost=8729673496 +| | in pipelines: 12(GETNEXT) +| | +| 16:HASH JOIN [INNER JOIN, BROADCAST] +| | hash-table-id=07 +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14,16,18 row-size=88B cardinality=1.48G cost=681235853 +| | in pipelines: 12(GETNEXT), 15(OPEN) +| | +| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | Per-Instance Resources: mem-estimate=2.68GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | max-parallelism=10 segment-costs=[69869990] +| | JOIN BUILD +| | | join-table-id=07 plan-id=08 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | | mem-estimate=2.65GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 +| | | +| | 33:EXCHANGE [BROADCAST] +| | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=18 row-size=68B cardinality=30.00M cost=39869990 +| | | in pipelines: 15(GETNEXT) +| | | +| | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB +| | Per-Instance Resources: mem-estimate=16.28MB mem-reservation=1.00MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[21649295] +| | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | HDFS partitions=1/1 files=1 size=1.55GB +| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | stored statistics: +| | table: rows=30.00M size=1.55GB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | tuple-ids=18 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 15(GETNEXT) +| | +| 14:HASH JOIN [INNER JOIN, BROADCAST] +| | hash-table-id=08 +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| | tuple-ids=14,16 row-size=20B cardinality=1.61G cost=705182309 +| | in pipelines: 12(GETNEXT), 13(OPEN) +| | +| |--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB +| | | max-parallelism=10 segment-costs=[863] +| | JOIN BUILD +| | | join-table-id=08 plan-id=09 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 +| | | +| | 32:EXCHANGE [BROADCAST] +| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=16 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 13(GETNEXT) +| | | +| | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 +| | max-parallelism=1 segment-costs=[12536] +| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | HDFS partitions=1/1 files=1 size=2.17MB +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | stored statistics: +| | table: rows=73.05K size=2.17MB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=73.05K +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| | tuple-ids=16 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 13(GETNEXT) +| | +| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL +| HDFS partitions=1823/1824 files=1823 size=389.69GB +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk +| stored statistics: +| table: rows=8.64G size=389.90GB +| partitions: 1823/1823 rows=8.25G +| columns: all +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| tuple-ids=14 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 +| in pipelines: 12(GETNEXT) +| +43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)] +| mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=147.90M cost=62670704 +| in pipelines: 31(GETNEXT) +| +F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=973.65MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=940 segment-costs=[9356380541, 723549078] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))] +31:AGGREGATE [FINALIZE] +| output: max:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) +| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL +| mem-estimate=939.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=147.90M cost=8729673496 +| in pipelines: 31(GETNEXT), 00(OPEN) +| +30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name)] +| mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=1.48G cost=626707045 +| in pipelines: 00(GETNEXT) +| +F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB +Per-Instance Resources: mem-estimate=754.67MB mem-reservation=34.50MB thread-reservation=1 +max-parallelism=373 segment-costs=[10455016044, 7235490759] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))] +05:AGGREGATE [STREAMING] +| output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) +| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| mem-estimate=704.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=1.48G cost=8729673496 +| in pipelines: 00(GETNEXT) +| +04:HASH JOIN [INNER JOIN, BROADCAST] +| hash-table-id=09 +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk +| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=0,2,4 row-size=88B cardinality=1.48G cost=681235853 +| in pipelines: 00(GETNEXT), 03(OPEN) +| +|--F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | Per-Instance Resources: mem-estimate=2.68GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | max-parallelism=10 segment-costs=[69869990] +| JOIN BUILD +| | join-table-id=09 plan-id=10 cohort-id=01 +| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk +| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk +| | mem-estimate=2.65GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 +| | +| 29:EXCHANGE [BROADCAST] | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=0 row-size=68B cardinality=30.00M cost=12712506 -| | in pipelines: 00(GETNEXT) +| | tuple-ids=4 row-size=68B cardinality=30.00M cost=39869990 +| | in pipelines: 03(GETNEXT) | | -| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| Per-Instance Resources: mem-estimate=21.62MB mem-reservation=1.00MB thread-reservation=1 -| max-parallelism=10 segment-costs=[162265022] -| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB +| Per-Instance Resources: mem-estimate=16.28MB mem-reservation=1.00MB thread-reservation=1 +| max-parallelism=10 segment-costs=[21649295] +| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | HDFS partitions=1/1 files=1 size=1.55GB | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL -| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_sk +| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id | stored statistics: | table: rows=30.00M size=1.55GB | columns: all | extrapolated-rows=disabled max-scan-range-rows=3.10M | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=0 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 00(GETNEXT) +| tuple-ids=4 row-size=68B cardinality=30.00M cost=15495933 +| in pipelines: 03(GETNEXT) | -25:HASH JOIN [INNER JOIN, PARTITIONED] -| hash-table-id=03 -| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27,13 row-size=216B cardinality=16.41M cost=44299055 -| in pipelines: 32(GETNEXT), 44(OPEN) +02:HASH JOIN [INNER JOIN, BROADCAST] +| hash-table-id=10 +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| tuple-ids=0,2 row-size=20B cardinality=1.61G cost=705182309 +| in pipelines: 00(GETNEXT), 01(OPEN) | -|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=84.51MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[23670647] cpu-comparison-result=128 [max(30 (self) vs 128 (sum children))] +|--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB +| | max-parallelism=10 segment-costs=[863] | JOIN BUILD -| | join-table-id=03 plan-id=04 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | mem-estimate=50.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=16413441 +| | join-table-id=10 plan-id=11 cohort-id=01 +| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 | | -| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)] -| | mem-estimate=18.16MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=16.41M cost=7257206 -| | in pipelines: 44(GETNEXT) +| 28:EXCHANGE [BROADCAST] +| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 +| | tuple-ids=2 row-size=8B cardinality=373 cost=490 +| | in pipelines: 01(GETNEXT) | | -| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] hosts=10 instances=110 (adjusted from 120) -| Per-Instance Resources: mem-estimate=136.16MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1041391806, 84527628] cpu-comparison-result=128 [max(110 (self) vs 128 (sum children))] -| 44:AGGREGATE [FINALIZE] -| | output: max:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| | having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL -| | mem-estimate=119.49MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=16.41M cost=968819744 -| | in pipelines: 44(GETNEXT), 07(OPEN) -| | -| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.date_dim_0.d_year)] -| | mem-estimate=16.68MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=164.13M cost=72572062 -| | in pipelines: 07(GETNEXT) -| | -| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=90 (adjusted from 120) -| Per-Instance Resources: mem-estimate=153.21MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=110 segment-costs=[1080037216, 845276268] cpu-comparison-result=128 [max(128 (self) vs 111 (sum children))] -| 11:AGGREGATE [STREAMING] -| | output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.date_dim_0.d_year -| | mem-estimate=109.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=13 row-size=72B cardinality=164.13M cost=968819744 -| | in pipelines: 07(GETNEXT) -| | -| 10:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=04 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | fk/pk conjuncts: none -| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=9,11,7 row-size=88B cardinality=164.13M cost=71841629 -| | in pipelines: 07(GETNEXT), 06(OPEN) -| | -| |--F26:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=90 (adjusted from 120) -| | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | | max-parallelism=110 segment-costs=[42712506] -| | JOIN BUILD -| | | join-table-id=04 plan-id=05 cohort-id=04 -| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk -| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 -| | | -| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] -| | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=7 row-size=68B cardinality=30.00M cost=12712506 -| | | in pipelines: 06(GETNEXT) -| | | -| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB -| | Per-Instance Resources: mem-estimate=41.30MB mem-reservation=1.00MB thread-reservation=1 -| | max-parallelism=10 segment-costs=[162265022] -| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] -| | HDFS partitions=1/1 files=1 size=1.55GB -| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id -| | stored statistics: -| | table: rows=30.00M size=1.55GB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=3.10M -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=7 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 06(GETNEXT) -| | -| 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] -| | mem-estimate=11.04MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=9,11 row-size=20B cardinality=164.13M cost=39375843 -| | in pipelines: 07(GETNEXT) -| | -| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=38 (adjusted from 120) -| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB -| Per-Instance Resources: mem-estimate=25.84MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=38 segment-costs=[486899324] -| 09:HASH JOIN [INNER JOIN, BROADCAST] -| | hash-table-id=05 -| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=9,11 row-size=20B cardinality=164.13M cost=71841629 -| | in pipelines: 07(GETNEXT), 08(OPEN) -| | -| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB -| | | max-parallelism=10 segment-costs=[88] -| | JOIN BUILD -| | | join-table-id=05 plan-id=06 cohort-id=04 -| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk -| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=38 -| | | -| | 40:EXCHANGE [BROADCAST] -| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=11 row-size=8B cardinality=38 cost=50 -| | | in pipelines: 08(GETNEXT) -| | | -| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 -| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=1 segment-costs=[14574] -| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] -| | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | stored statistics: -| | table: rows=73.05K size=2.17MB -| | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2001 AS INT) OR tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL -| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=11 row-size=8B cardinality=38 cost=14573 -| | in pipelines: 08(GETNEXT) -| | -| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] -| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL -| HDFS partitions=1823/1824 files=1823 size=389.69GB -| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL -| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk +| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 +| max-parallelism=1 segment-costs=[12536] +| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| HDFS partitions=1/1 files=1 size=2.17MB +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: -| table: rows=8.64G size=389.90GB -| partitions: 1823/1823 rows=8.25G +| table: rows=73.05K size=2.17MB | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=38(filtered from 1823) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL +| extrapolated-rows=disabled max-scan-range-rows=73.05K +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=9 row-size=12B cardinality=164.13M(filtered from 7.88G) cost=34528489 -| in pipelines: 07(GETNEXT) +| tuple-ids=2 row-size=8B cardinality=373 cost=12520 +| in pipelines: 01(GETNEXT) | -24:HASH JOIN [INNER JOIN, PARTITIONED] -| hash-table-id=06 +00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] + partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL + HDFS partitions=1823/1824 files=1823 size=389.69GB + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL + runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk + stored statistics: + table: rows=8.64G size=389.90GB + partitions: 1823/1823 rows=8.25G + columns: all + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL + mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 + tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 + in pipelines: 00(GETNEXT) +---- PARALLELPLANS +Max Per-Host Resource Reservation: Memory=7.35GB Threads=253 +Per-Host Resource Estimates: Memory=60.26GB +F21:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 +| Per-Instance Resources: mem-estimate=4.78MB mem-reservation=4.00MB thread-reservation=1 +| max-parallelism=1 segment-costs=[338] cpu-comparison-result=960 [max(1 (self) vs 960 (sum children))] +PLAN-ROOT SINK +| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300 +| +52:MERGING-EXCHANGE [UNPARTITIONED] +| order by: tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST +| limit: 100 +| mem-estimate=797.15KB mem-reservation=0B thread-reservation=0 +| tuple-ids=28 row-size=64B cardinality=100 cost=38 +| in pipelines: 27(GETNEXT) +| +F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=18.44MB mem-reservation=0B thread-reservation=1 +max-parallelism=250 segment-costs=[2455164590, 199] cpu-comparison-result=960 [max(120 (self) vs 960 (sum children))] +27:TOP-N [LIMIT=100] +| order by: tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST +| mem-estimate=6.25KB mem-reservation=0B thread-reservation=0 +| tuple-ids=28 row-size=64B cardinality=100 cost=2263026260 +| in pipelines: 27(GETNEXT), 32(OPEN) +| +26:HASH JOIN [INNER JOIN, PARTITIONED] +| hash-table-id=00 | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id +| other join predicates: CASE WHEN max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid), max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid)) ELSE NULL END > CASE WHEN max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) THEN divide(max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid), max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid)) ELSE NULL END | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20,27 row-size=144B cardinality=161.11M cost=70518230 -| in pipelines: 32(GETNEXT), 37(OPEN) +| tuple-ids=6,20,13,27 row-size=272B cardinality=147.90M cost=64733813 +| in pipelines: 32(GETNEXT), 50(OPEN) | -|--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=30 (adjusted from 10) -| | Per-Instance Resources: mem-estimate=168.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=30 segment-costs=[63667689] cpu-comparison-result=240 [max(30 (self) vs 240 (sum children))] +|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=68.43MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | max-parallelism=250 segment-costs=[57842326] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] | JOIN BUILD -| | join-table-id=06 plan-id=07 cohort-id=01 +| | join-table-id=00 plan-id=01 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id -| | mem-estimate=133.80MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752 +| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id +| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 | | -| 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] -| | mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=44.15M cost=19519937 -| | in pipelines: 37(GETNEXT) +| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=40.63M cost=17215588 +| | in pipelines: 50(GETNEXT) | | -| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.date_dim_2.d_year)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=313.51MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=290 segment-costs=[2801064582, 227356640] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] -| 37:AGGREGATE [FINALIZE] +| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=291.93MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=260 segment-costs=[2570189737, 198758311] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| 50:AGGREGATE [FINALIZE] | | output: max:merge(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.date_dim_2.d_year +| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name | | having: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) > CAST(0 AS DECIMAL(3,0)) -| | mem-estimate=294.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=44.15M cost=2605865203 -| | in pipelines: 37(GETNEXT), 19(OPEN) +| | mem-estimate=258.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=40.63M cost=2398033848 +| | in pipelines: 50(GETNEXT), 20(OPEN) | | -| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.date_dim_2.d_year)] -| | mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=441.48M cost=195199379 -| | in pipelines: 19(GETNEXT) +| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=406.27M cost=172155889 +| | in pipelines: 20(GETNEXT) | | -| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 -| Per-Instance Resources: mem-estimate=269.84MB mem-reservation=34.00MB thread-reservation=1 -| max-parallelism=300 segment-costs=[2905010369, 2273566395] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] -| 23:AGGREGATE [STREAMING] +| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=240.66MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=270 segment-costs=[2690798937, 1987583127] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +| 25:AGGREGATE [STREAMING] | | output: max(tpcds_partitioned_parquet_snap.web_sales_0.ws_net_paid) -| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.date_dim_2.d_year -| | mem-estimate=220.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=27 row-size=72B cardinality=441.48M cost=2605865203 -| | in pipelines: 19(GETNEXT) +| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name +| | mem-estimate=193.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=27 row-size=68B cardinality=406.27M cost=2398033848 +| | in pipelines: 20(GETNEXT) | | -| 22:HASH JOIN [INNER JOIN, PARTITIONED] -| | hash-table-id=07 +| 24:HASH JOIN [INNER JOIN, PARTITIONED] +| | hash-table-id=01 | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk -| | fk/pk conjuncts: none +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| | tuple-ids=23,25,21 row-size=88B cardinality=441.48M cost=193234710 -| | in pipelines: 19(GETNEXT), 18(OPEN) +| | tuple-ids=21,23,25 row-size=88B cardinality=406.27M cost=186854633 +| | in pipelines: 20(GETNEXT), 23(OPEN) | | -| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 +| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120 | | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | | max-parallelism=300 segment-costs=[42712506] +| | | max-parallelism=270 segment-costs=[42712506] | | JOIN BUILD -| | | join-table-id=07 plan-id=08 cohort-id=05 +| | | join-table-id=01 plan-id=02 cohort-id=02 | | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk -| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk +| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 | | | -| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] +| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)] | | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=21 row-size=68B cardinality=30.00M cost=12712506 -| | | in pipelines: 18(GETNEXT) +| | | tuple-ids=25 row-size=68B cardinality=30.00M cost=12712506 +| | | in pipelines: 23(GETNEXT) | | | -| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| | Per-Host Shared Resources: mem-estimate=20.00MB mem-reservation=20.00MB thread-reservation=0 runtime-filters-memory=20.00MB +| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 | | max-parallelism=10 segment-costs=[162265022] -| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | | HDFS partitions=1/1 files=1 size=1.55GB | | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL -| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id | | stored statistics: | | table: rows=30.00M size=1.55GB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=3.10M | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| | tuple-ids=21 row-size=68B cardinality=30.00M cost=15495933 -| | in pipelines: 18(GETNEXT) +| | tuple-ids=25 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 23(GETNEXT) | | -| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] +| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] | | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=23,25 row-size=20B cardinality=441.48M cost=105910456 -| | in pipelines: 19(GETNEXT) +| | tuple-ids=21,23 row-size=20B cardinality=441.48M cost=105910456 +| | in pipelines: 20(GETNEXT) | | -| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=128.00KB thread-reservation=1 | max-parallelism=140 segment-costs=[1305471205] -| 21:HASH JOIN [INNER JOIN, BROADCAST] -| | hash-table-id=08 +| 22:HASH JOIN [INNER JOIN, BROADCAST] +| | hash-table-id=02 | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| | tuple-ids=23,25 row-size=20B cardinality=441.48M cost=193234710 -| | in pipelines: 19(GETNEXT), 20(OPEN) +| | tuple-ids=21,23 row-size=20B cardinality=441.48M cost=193234710 +| | in pipelines: 20(GETNEXT), 21(OPEN) +| | +| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB +| | | max-parallelism=10 segment-costs=[863] +| | JOIN BUILD +| | | join-table-id=02 plan-id=03 cohort-id=02 +| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk +| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk +| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 +| | | +| | 46:EXCHANGE [BROADCAST] +| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=23 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 21(GETNEXT) +| | | +| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 +| | max-parallelism=1 segment-costs=[12536] +| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | HDFS partitions=1/1 files=1 size=2.17MB +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | stored statistics: +| | table: rows=73.05K size=2.17MB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=73.05K +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| | tuple-ids=23 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 21(GETNEXT) +| | +| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] +| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL +| HDFS partitions=1823/1824 files=1823 size=145.67GB +| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL +| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk +| stored statistics: +| table: rows=2.16G size=145.75GB +| partitions: 1823/1823 rows=2.16G +| columns: all +| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL +| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 +| tuple-ids=21 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| in pipelines: 20(GETNEXT) +| +19:HASH JOIN [INNER JOIN, PARTITIONED] +| hash-table-id=03 +| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6,20,13 row-size=204B cardinality=147.90M cost=64733813 +| in pipelines: 32(GETNEXT), 37(OPEN) +| +|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=70.07MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=250 segment-costs=[148594175] cpu-comparison-result=480 [max(120 (self) vs 480 (sum children))] +| JOIN BUILD +| | join-table-id=03 plan-id=04 cohort-id=01 +| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | mem-estimate=51.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 +| | +| 18:HASH JOIN [INNER JOIN, PARTITIONED] +| | hash-table-id=04 +| | hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20,13 row-size=136B cardinality=40.63M cost=45296733 +| | in pipelines: 37(GETNEXT), 42(OPEN) +| | +| |--F26:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=120 +| | | Per-Instance Resources: mem-estimate=68.43MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | max-parallelism=250 segment-costs=[57842326] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| | JOIN BUILD +| | | join-table-id=04 plan-id=05 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738 +| | | +| | 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)] +| | | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=40.63M cost=17215588 +| | | in pipelines: 42(GETNEXT) +| | | +| | F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=291.93MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=260 segment-costs=[2570189737, 198758311] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| | 42:AGGREGATE [FINALIZE] +| | | output: max:merge(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) +| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| | | having: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) IS NOT NULL +| | | mem-estimate=258.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=40.63M cost=2398033848 +| | | in pipelines: 42(GETNEXT), 06(OPEN) +| | | +| | 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name)] +| | | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=406.27M cost=172155889 +| | | in pipelines: 06(GETNEXT) +| | | +| | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120 +| | Per-Instance Resources: mem-estimate=240.66MB mem-reservation=34.00MB thread-reservation=1 +| | max-parallelism=270 segment-costs=[2690798937, 1987583127] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +| | 11:AGGREGATE [STREAMING] +| | | output: max(tpcds_partitioned_parquet_snap.web_sales.ws_net_paid) +| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name +| | | mem-estimate=193.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=13 row-size=68B cardinality=406.27M cost=2398033848 +| | | in pipelines: 06(GETNEXT) +| | | +| | 10:HASH JOIN [INNER JOIN, PARTITIONED] +| | | hash-table-id=05 +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| | | tuple-ids=7,9,11 row-size=88B cardinality=406.27M cost=186854633 +| | | in pipelines: 06(GETNEXT), 09(OPEN) +| | | +| | |--F27:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120 +| | | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | | max-parallelism=270 segment-costs=[42712506] +| | | JOIN BUILD +| | | | join-table-id=05 plan-id=06 cohort-id=04 +| | | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk +| | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 +| | | | +| | | 40:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)] +| | | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=11 row-size=68B cardinality=30.00M cost=12712506 +| | | | in pipelines: 09(GETNEXT) +| | | | +| | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB +| | | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 +| | | max-parallelism=10 segment-costs=[162265022] +| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | | HDFS partitions=1/1 files=1 size=1.55GB +| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id +| | | stored statistics: +| | | table: rows=30.00M size=1.55GB +| | | columns: all +| | | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL +| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | | tuple-ids=11 row-size=68B cardinality=30.00M cost=15495933 +| | | in pipelines: 09(GETNEXT) +| | | +| | 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] +| | | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=7,9 row-size=20B cardinality=441.48M cost=105910456 +| | | in pipelines: 06(GETNEXT) +| | | +| | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB +| | Per-Instance Resources: mem-estimate=29.12MB mem-reservation=128.00KB thread-reservation=1 +| | max-parallelism=140 segment-costs=[1305471205] +| | 08:HASH JOIN [INNER JOIN, BROADCAST] +| | | hash-table-id=06 +| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| | | tuple-ids=7,9 row-size=20B cardinality=441.48M cost=193234710 +| | | in pipelines: 06(GETNEXT), 07(OPEN) +| | | +| | |--F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB +| | | | max-parallelism=10 segment-costs=[863] +| | | JOIN BUILD +| | | | join-table-id=06 plan-id=07 cohort-id=04 +| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk +| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 +| | | | +| | | 38:EXCHANGE [BROADCAST] +| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 +| | | | tuple-ids=9 row-size=8B cardinality=373 cost=490 +| | | | in pipelines: 07(GETNEXT) +| | | | +| | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 +| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 +| | | max-parallelism=1 segment-costs=[12536] +| | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | | HDFS partitions=1/1 files=1 size=2.17MB +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | stored statistics: +| | | table: rows=73.05K size=2.17MB +| | | columns: all +| | | extrapolated-rows=disabled max-scan-range-rows=73.05K +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520 +| | | in pipelines: 07(GETNEXT) +| | | +| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] +| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL +| | HDFS partitions=1823/1824 files=1823 size=145.67GB +| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL +| | runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk +| | stored statistics: +| | table: rows=2.16G size=145.75GB +| | partitions: 1823/1823 rows=2.16G +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 +| | tuple-ids=7 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 +| | in pipelines: 06(GETNEXT) +| | +| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=147.90M cost=62670704 +| | in pipelines: 37(GETNEXT) +| | +| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=973.65MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=940 segment-costs=[9356380541, 723549078] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +| 37:AGGREGATE [FINALIZE] +| | output: max:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) +| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name +| | having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) +| | mem-estimate=939.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=147.90M cost=8729673496 +| | in pipelines: 37(GETNEXT), 12(OPEN) +| | +| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name)] +| | mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=1.48G cost=626707045 +| | in pipelines: 12(GETNEXT) +| | +| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120 +| Per-Instance Resources: mem-estimate=751.95MB mem-reservation=34.00MB thread-reservation=1 +| max-parallelism=980 segment-costs=[9797414343, 7235490759] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +| 17:AGGREGATE [STREAMING] +| | output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) +| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name +| | mem-estimate=704.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=20 row-size=68B cardinality=1.48G cost=8729673496 +| | in pipelines: 12(GETNEXT) +| | +| 16:HASH JOIN [INNER JOIN, PARTITIONED] +| | hash-table-id=07 +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 +| | tuple-ids=14,16,18 row-size=88B cardinality=1.48G cost=681235853 +| | in pipelines: 12(GETNEXT), 15(OPEN) +| | +| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120 +| | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB +| | | max-parallelism=980 segment-costs=[42712506] +| | JOIN BUILD +| | | join-table-id=07 plan-id=08 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 +| | | +| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)] +| | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 +| | | tuple-ids=18 row-size=68B cardinality=30.00M cost=12712506 +| | | in pipelines: 15(GETNEXT) +| | | +| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 +| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB +| | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 +| | max-parallelism=10 segment-costs=[162265022] +| | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| | HDFS partitions=1/1 files=1 size=1.55GB +| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| | stored statistics: +| | table: rows=30.00M size=1.55GB +| | columns: all +| | extrapolated-rows=disabled max-scan-range-rows=3.10M +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 +| | tuple-ids=18 row-size=68B cardinality=30.00M cost=15495933 +| | in pipelines: 15(GETNEXT) +| | +| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] +| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 +| | tuple-ids=14,16 row-size=20B cardinality=1.61G cost=386504994 +| | in pipelines: 12(GETNEXT) +| | +| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 +| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB +| Per-Instance Resources: mem-estimate=29.12MB mem-reservation=512.00KB thread-reservation=1 +| max-parallelism=373 segment-costs=[4779301272] +| 14:HASH JOIN [INNER JOIN, BROADCAST] +| | hash-table-id=08 +| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 +| | tuple-ids=14,16 row-size=20B cardinality=1.61G cost=705182309 +| | in pipelines: 12(GETNEXT), 13(OPEN) | | | |--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB | | | max-parallelism=10 segment-costs=[863] | | JOIN BUILD -| | | join-table-id=08 plan-id=09 cohort-id=05 -| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk -| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk +| | | join-table-id=08 plan-id=09 cohort-id=03 +| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 | | | | | 33:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | | tuple-ids=25 row-size=8B cardinality=373 cost=490 -| | | in pipelines: 20(GETNEXT) +| | | tuple-ids=16 row-size=8B cardinality=373 cost=490 +| | | in pipelines: 13(GETNEXT) | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| | max-parallelism=1 segment-costs=[14589] -| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| | max-parallelism=1 segment-costs=[12536] +| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_2.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| | tuple-ids=25 row-size=8B cardinality=373 cost=14573 -| | in pipelines: 20(GETNEXT) +| | tuple-ids=16 row-size=8B cardinality=373 cost=12520 +| | in pipelines: 13(GETNEXT) | | -| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM] -| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL -| HDFS partitions=1823/1824 files=1823 size=145.67GB -| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL -| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk +| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] +| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL +| HDFS partitions=1823/1824 files=1823 size=389.69GB +| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk | stored statistics: -| table: rows=2.16G size=145.75GB -| partitions: 1823/1823 rows=2.16G +| table: rows=8.64G size=389.90GB +| partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL -| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0 -| tuple-ids=23 row-size=12B cardinality=441.48M(filtered from 2.16G) cost=88715015 -| in pipelines: 19(GETNEXT) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL +| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 +| tuple-ids=14 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 +| in pipelines: 12(GETNEXT) | -38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] -| mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=161.11M cost=71235208 +45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)] +| mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=147.90M cost=62670704 | in pipelines: 32(GETNEXT) | -F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=1.07GB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1030 segment-costs=[10222082724, 829705387] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] +F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=973.65MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=940 segment-costs=[9356380541, 723549078] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))] 32:AGGREGATE [FINALIZE] -| output: max:merge(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) -| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year -| having: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) > CAST(0 AS DECIMAL(3,0)) -| mem-estimate=1.05GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=161.11M cost=9509730637 -| in pipelines: 32(GETNEXT), 13(OPEN) +| output: max:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) +| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| having: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) IS NOT NULL +| mem-estimate=939.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=147.90M cost=8729673496 +| in pipelines: 32(GETNEXT), 00(OPEN) | -31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.date_dim_1.d_year)] -| mem-estimate=18.90MB mem-reservation=0B thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=1.61G cost=712352087 -| in pipelines: 13(GETNEXT) +31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name)] +| mem-estimate=18.43MB mem-reservation=0B thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=1.48G cost=626707045 +| in pipelines: 00(GETNEXT) | -F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120 -Per-Instance Resources: mem-estimate=855.23MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=1070 segment-costs=[10601417940, 8297053883] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] -17:AGGREGATE [STREAMING] -| output: max(tpcds_partitioned_parquet_snap.store_sales_0.ss_net_paid) -| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.date_dim_1.d_year -| mem-estimate=806.34MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=20 row-size=72B cardinality=1.61G cost=9509730637 -| in pipelines: 13(GETNEXT) +F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120 +Per-Instance Resources: mem-estimate=751.95MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=980 segment-costs=[9797414343, 7235490759] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))] +05:AGGREGATE [STREAMING] +| output: max(tpcds_partitioned_parquet_snap.store_sales.ss_net_paid) +| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name +| mem-estimate=704.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=6 row-size=68B cardinality=1.48G cost=8729673496 +| in pipelines: 00(GETNEXT) | -16:HASH JOIN [INNER JOIN, PARTITIONED] +04:HASH JOIN [INNER JOIN, PARTITIONED] | hash-table-id=09 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| fk/pk conjuncts: none +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=16,18,14 row-size=88B cardinality=1.61G cost=705182309 -| in pipelines: 13(GETNEXT), 12(OPEN) +| tuple-ids=0,2,4 row-size=88B cardinality=1.48G cost=681235853 +| in pipelines: 00(GETNEXT), 03(OPEN) | -|--F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120 +|--F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120 | | Per-Instance Resources: mem-estimate=60.70MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB -| | max-parallelism=1070 segment-costs=[42712506] +| | max-parallelism=980 segment-costs=[42712506] | JOIN BUILD | | join-table-id=09 plan-id=10 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk -| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk +| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk +| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000 | | -| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)] +| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)] | | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0 -| | tuple-ids=14 row-size=68B cardinality=30.00M cost=12712506 -| | in pipelines: 12(GETNEXT) +| | tuple-ids=4 row-size=68B cardinality=30.00M cost=12712506 +| | in pipelines: 03(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 -| Per-Host Shared Resources: mem-estimate=36.00MB mem-reservation=36.00MB thread-reservation=0 runtime-filters-memory=36.00MB +| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB | Per-Instance Resources: mem-estimate=49.73MB mem-reservation=1.00MB thread-reservation=1 | max-parallelism=10 segment-costs=[162265022] -| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] +| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM] | HDFS partitions=1/1 files=1 size=1.55GB -| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL -| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id +| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL +| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id | stored statistics: | table: rows=30.00M size=1.55GB | columns: all | extrapolated-rows=disabled max-scan-range-rows=3.10M -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 -| tuple-ids=14 row-size=68B cardinality=30.00M cost=15495933 -| in pipelines: 12(GETNEXT) +| tuple-ids=4 row-size=68B cardinality=30.00M cost=15495933 +| in pipelines: 03(GETNEXT) | -29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] +29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0 -| tuple-ids=16,18 row-size=20B cardinality=1.61G cost=386504994 -| in pipelines: 13(GETNEXT) +| tuple-ids=0,2 row-size=20B cardinality=1.61G cost=386504994 +| in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB Per-Instance Resources: mem-estimate=29.12MB mem-reservation=512.00KB thread-reservation=1 max-parallelism=373 segment-costs=[4779301272] -15:HASH JOIN [INNER JOIN, BROADCAST] +02:HASH JOIN [INNER JOIN, BROADCAST] | hash-table-id=10 -| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=16,18 row-size=20B cardinality=1.61G cost=705182309 -| in pipelines: 13(GETNEXT), 14(OPEN) +| tuple-ids=0,2 row-size=20B cardinality=1.61G cost=705182309 +| in pipelines: 00(GETNEXT), 01(OPEN) | |--F32:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB | | max-parallelism=10 segment-costs=[863] | JOIN BUILD | | join-table-id=10 plan-id=11 cohort-id=01 -| | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk -| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk +| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk +| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373 | | | 28:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=18 row-size=8B cardinality=373 cost=490 -| | in pipelines: 14(GETNEXT) +| | tuple-ids=2 row-size=8B cardinality=373 cost=490 +| | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1 -| max-parallelism=1 segment-costs=[14589] -| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] +| max-parallelism=1 segment-costs=[12536] +| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim_1.d_year IS NOT NULL OR tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(2001 AS INT), CAST(1 AS INT)) +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=18 row-size=8B cardinality=373 cost=14573 -| in pipelines: 14(GETNEXT) +| tuple-ids=2 row-size=8B cardinality=373 cost=12520 +| in pipelines: 01(GETNEXT) | -13:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] - partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL +00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] + partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL HDFS partitions=1823/1824 files=1823 size=389.69GB - predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL - runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk + predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL + runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk stored statistics: table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) - parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) + parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=16 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 - in pipelines: 13(GETNEXT) + tuple-ids=0 row-size=12B cardinality=1.61G(filtered from 7.88G) cost=338924386 + in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q75.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q75.test index 058b0a9e8..b2b941864 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q75.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q75.test @@ -76,7 +76,7 @@ F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=80.83GB mem-reservation=231.38MB thread-reservation=1 runtime-filters-memory=10.00MB | max-parallelism=1 segment-costs=[6094643509, 3186119268, 1783434760, 6094643509, 3186119268, 1783434760, 5169031245, 1000] PLAN-ROOT SINK -| output exprs: subtract(CAST(2001 AS INT), CAST(1 AS INT)), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) +| output exprs: CAST(2000 AS INT), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000 | 53:TOP-N [LIMIT=100] @@ -162,13 +162,13 @@ PLAN-ROOT SINK | | | | | |--44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=49 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 44(GETNEXT) @@ -249,13 +249,13 @@ PLAN-ROOT SINK | | | | | |--36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=39 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 36(GETNEXT) @@ -269,7 +269,7 @@ PLAN-ROOT SINK | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=37 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 @@ -325,13 +325,13 @@ PLAN-ROOT SINK | | | |--29:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=31 row-size=8B cardinality=373 cost=12520 | | in pipelines: 29(GETNEXT) @@ -528,7 +528,7 @@ PLAN-ROOT SINK | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=8 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 @@ -617,7 +617,7 @@ F40:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.78MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[1038] cpu-comparison-result=1410 [max(1 (self) vs 1410 (sum children))] PLAN-ROOT SINK -| output exprs: subtract(CAST(2001 AS INT), CAST(1 AS INT)), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) +| output exprs: CAST(2000 AS INT), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000 | 90:MERGING-EXCHANGE [UNPARTITIONED] @@ -812,13 +812,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | | max-parallelism=1 segment-costs=[12536] | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=49 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 44(GETNEXT) @@ -974,13 +974,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | | max-parallelism=1 segment-costs=[12536] | | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=39 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 36(GETNEXT) @@ -994,7 +994,7 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=37 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 @@ -1111,13 +1111,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | max-parallelism=1 segment-costs=[12536] | | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=31 row-size=8B cardinality=373 cost=12520 | | in pipelines: 29(GETNEXT) @@ -1479,7 +1479,7 @@ max-parallelism=120 segment-costs=[3050996902, 590525346] cpu-comparison-result= | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=8 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 @@ -1629,7 +1629,7 @@ F40:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Instance Resources: mem-estimate=4.78MB mem-reservation=4.00MB thread-reservation=1 | max-parallelism=1 segment-costs=[1038] cpu-comparison-result=1410 [max(1 (self) vs 1410 (sum children))] PLAN-ROOT SINK -| output exprs: subtract(CAST(2001 AS INT), CAST(1 AS INT)), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) +| output exprs: CAST(2000 AS INT), CAST(2001 AS INT), I_BRAND_ID, I_CLASS_ID, I_CATEGORY_ID, I_MANUFACT_ID, sum(SALES_CNT), sum(SALES_CNT), subtract(sum(SALES_CNT), sum(SALES_CNT)), subtract(sum(SALES_AMT), sum(SALES_AMT)) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000 | 90:MERGING-EXCHANGE [UNPARTITIONED] @@ -1824,13 +1824,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | | max-parallelism=1 segment-costs=[12536] | | | 44:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=49 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 44(GETNEXT) @@ -1986,13 +1986,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | | max-parallelism=1 segment-costs=[12536] | | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT) +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | | tuple-ids=39 row-size=8B cardinality=373 cost=12520 | | | in pipelines: 36(GETNEXT) @@ -2006,7 +2006,7 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | table: rows=8.64G size=389.90GB | | partitions: 1823/1823 rows=8.25G | | columns: all -| | extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| | extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=37 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 @@ -2123,13 +2123,13 @@ max-parallelism=490 segment-costs=[1871552430, 4870428499, 199] cpu-comparison-r | | max-parallelism=1 segment-costs=[12536] | | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = subtract(CAST(2001 AS INT), CAST(1 AS INT)), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=31 row-size=8B cardinality=373 cost=12520 | | in pipelines: 29(GETNEXT) @@ -2491,7 +2491,7 @@ max-parallelism=120 segment-costs=[3050996902, 590525346] cpu-comparison-result= | table: rows=8.64G size=389.90GB | partitions: 1823/1823 rows=8.25G | columns: all -| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) +| extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) | parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=8 row-size=24B cardinality=819.96M(filtered from 8.25G) cost=630443220 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q76.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q76.test index d8dec3917..cd915998c 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q76.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q76.test @@ -216,7 +216,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=371.26M cost=2364367980 @@ -551,7 +551,7 @@ max-parallelism=120 segment-costs=[6358265897, 1923929310] cpu-comparison-result table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=371.26M cost=2364367980 @@ -894,7 +894,7 @@ max-parallelism=120 segment-costs=[6358103994, 1923929310] cpu-comparison-result table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=371.26M cost=2364367980 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q77.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q77.test index 4fd6ceeb5..4e9ca7fe3 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q77.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q77.test @@ -174,13 +174,13 @@ PLAN-ROOT SINK | | | | | |--33:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 33(GETNEXT) @@ -237,13 +237,13 @@ PLAN-ROOT SINK | | | |--27:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=29 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 27(GETNEXT) @@ -310,13 +310,13 @@ PLAN-ROOT SINK | | | | | |--20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=21 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 20(GETNEXT) @@ -351,13 +351,13 @@ PLAN-ROOT SINK | | | |--16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 16(GETNEXT) @@ -419,13 +419,13 @@ PLAN-ROOT SINK | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 09(GETNEXT) @@ -482,13 +482,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -502,7 +502,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 @@ -648,13 +648,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | | max-parallelism=1 segment-costs=[14888] | | | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 33(GETNEXT) @@ -761,13 +761,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=29 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 27(GETNEXT) @@ -900,13 +900,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | | max-parallelism=1 segment-costs=[14888] | | | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=21 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 20(GETNEXT) @@ -974,13 +974,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 16(GETNEXT) @@ -1101,13 +1101,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 09(GETNEXT) @@ -1214,13 +1214,13 @@ max-parallelism=1190 segment-costs=[11885789540, 448502] cpu-comparison-result=1 | max-parallelism=1 segment-costs=[14888] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -1234,7 +1234,7 @@ max-parallelism=1190 segment-costs=[11885789540, 448502] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 @@ -1380,13 +1380,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | | max-parallelism=1 segment-costs=[14888] | | | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_4.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_4.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=36 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 33(GETNEXT) @@ -1493,13 +1493,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_3.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_3.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=29 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 27(GETNEXT) @@ -1632,13 +1632,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | | max-parallelism=1 segment-costs=[14888] | | | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_2.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_2.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=21 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 20(GETNEXT) @@ -1706,13 +1706,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=16 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 16(GETNEXT) @@ -1833,13 +1833,13 @@ max-parallelism=120 segment-costs=[104611, 3806, 285519, 103043, 202618] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 09(GETNEXT) @@ -1946,13 +1946,13 @@ max-parallelism=1190 segment-costs=[11885789540, 448502] cpu-comparison-result=1 | max-parallelism=1 segment-costs=[14888] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-08-27' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-08-27' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-09-26', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-08-27', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 03(GETNEXT) @@ -1966,7 +1966,7 @@ max-parallelism=1190 segment-costs=[11885789540, 448502] cpu-comparison-result=1 table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=7.88G cost=2132551022 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q78.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q78.test index 4e71e8e0f..19065912b 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q78.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q78.test @@ -261,7 +261,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=1.69G(filtered from 8.25G) cost=777383559 in pipelines: 00(GETNEXT) @@ -671,7 +671,7 @@ max-parallelism=373 segment-costs=[13637417386, 6084106052] cpu-comparison-resul table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=1.69G(filtered from 8.25G) cost=777383559 in pipelines: 00(GETNEXT) @@ -1105,7 +1105,7 @@ max-parallelism=373 segment-costs=[5123173596] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=1.69G(filtered from 8.25G) cost=777383559 in pipelines: 00(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q79.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q79.test index 7a6f483b5..505ef3418 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q79.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q79.test @@ -24,10 +24,10 @@ limit 100 # end query 79 in stream 0 using template query79.tpl ---- PLAN Max Per-Host Resource Reservation: Memory=94.31MB Threads=1 -Per-Host Resource Estimates: Memory=4.52GB +Per-Host Resource Estimates: Memory=4.54GB F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 -| Per-Instance Resources: mem-estimate=4.52GB mem-reservation=94.31MB thread-reservation=1 runtime-filters-memory=19.00MB -| max-parallelism=1 segment-costs=[2160793389, 496143024, 600] +| Per-Instance Resources: mem-estimate=4.54GB mem-reservation=94.31MB thread-reservation=1 runtime-filters-memory=19.00MB +| max-parallelism=1 segment-costs=[2173276673, 499601580, 600] PLAN-ROOT SINK | output exprs: c_last_name, c_first_name, substr(tpcds_partitioned_parquet_snap.store.s_city, CAST(1 AS BIGINT), CAST(30 AS BIGINT)), tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600 @@ -35,7 +35,7 @@ PLAN-ROOT SINK 10:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, substr(tpcds_partitioned_parquet_snap.store.s_city, 1, 30) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) ASC NULLS LAST | mem-estimate=9.48KB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=97B cardinality=100 cost=443846889 +| tuple-ids=11 row-size=97B cardinality=100 cost=447201479 | in pipelines: 10(GETNEXT), 07(OPEN) | 09:HASH JOIN [INNER JOIN] @@ -43,7 +43,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=1.87GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8,9 row-size=109B cardinality=31.60M cost=44555202 +| tuple-ids=8,9 row-size=109B cardinality=31.82M cost=44659168 | in pipelines: 07(GETNEXT), 08(OPEN) | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer] @@ -61,8 +61,8 @@ PLAN-ROOT SINK 07:AGGREGATE [FINALIZE] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store.s_city -| mem-estimate=2.60GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=205593346 +| mem-estimate=2.62GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=207061871 | in pipelines: 07(GETNEXT), 00(OPEN) | 06:HASH JOIN [INNER JOIN] @@ -70,7 +70,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=89B cardinality=34.42M cost=49949608 +| tuple-ids=0,2,4,6 row-size=89B cardinality=34.67M cost=50306390 | in pipelines: 00(GETNEXT), 05(OPEN) | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.store] @@ -91,7 +91,7 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=60B cardinality=170.42M cost=237436370 +| tuple-ids=0,2,4 row-size=60B cardinality=171.63M cost=237656938 | in pipelines: 00(GETNEXT), 03(OPEN) | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] @@ -111,20 +111,20 @@ PLAN-ROOT SINK | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.75G) cost=522901164 +| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.76G) cost=525160772 | in pipelines: 00(GETNEXT), 01(OPEN) | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=12B cardinality=420 cost=18780 +| tuple-ids=2 row-size=12B cardinality=423 cost=18780 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales] @@ -136,10 +136,10 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=420(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=423(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1144892027 + tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1153069828 in pipelines: 00(GETNEXT) ---- DISTRIBUTEDPLAN Max Per-Host Resource Reservation: Memory=863.34MB Threads=33 @@ -160,11 +160,11 @@ PLAN-ROOT SINK | F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=50 (adjusted from 120) Per-Instance Resources: mem-estimate=12.15MB mem-reservation=0B thread-reservation=1 -max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max(50 (self) vs 180 (sum children))] +max-parallelism=50 segment-costs=[476731627, 285] cpu-comparison-result=180 [max(50 (self) vs 180 (sum children))] 10:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, substr(tpcds_partitioned_parquet_snap.store.s_city, 1, 30) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) ASC NULLS LAST | mem-estimate=9.48KB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=97B cardinality=100 cost=443846889 +| tuple-ids=11 row-size=97B cardinality=100 cost=447201479 | in pipelines: 10(GETNEXT), 15(OPEN) | 09:HASH JOIN [INNER JOIN, PARTITIONED] @@ -172,7 +172,7 @@ max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8,9 row-size=109B cardinality=31.60M cost=14555202 +| tuple-ids=8,9 row-size=109B cardinality=31.82M cost=14659168 | in pipelines: 15(GETNEXT), 08(OPEN) | |--F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=50 (adjusted from 120) @@ -206,33 +206,33 @@ max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max | 16:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | mem-estimate=12.14MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=14765512 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=14870980 | in pipelines: 15(GETNEXT) | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.store.s_city)] hosts=10 instances=30 (adjusted from 120) -Per-Instance Resources: mem-estimate=107.31MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=30 segment-costs=[220358858, 170910623] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))] +Per-Instance Resources: mem-estimate=107.94MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=30 segment-costs=[221932851, 172131414] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))] 15:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store.s_city -| mem-estimate=88.74MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=205593346 +| mem-estimate=89.38MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=207061871 | in pipelines: 15(GETNEXT), 00(OPEN) | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.store.s_city)] | mem-estimate=18.57MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=14765512 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=14870980 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB Per-Instance Resources: mem-estimate=58.57MB mem-reservation=34.50MB thread-reservation=1 -max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result=120 [max(120 (self) vs 33 (sum children))] +max-parallelism=220 segment-costs=[2173254521, 172131414] cpu-comparison-result=120 [max(120 (self) vs 33 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store.s_city | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=205593346 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=207061871 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -240,7 +240,7 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=89B cardinality=34.42M cost=49949473 +| tuple-ids=0,2,4,6 row-size=89B cardinality=34.67M cost=50306255 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -278,7 +278,7 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=60B cardinality=170.42M cost=237435650 +| tuple-ids=0,2,4 row-size=60B cardinality=171.63M cost=237656218 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -315,21 +315,21 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.75G) cost=522900744 +| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.76G) cost=525160349 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[970] +| | max-parallelism=10 segment-costs=[983] | JOIN BUILD | | join-table-id=03 plan-id=04 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=420 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=423 | | | 11:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2 row-size=12B cardinality=420 cost=550 +| | tuple-ids=2 row-size=12B cardinality=423 cost=560 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -337,15 +337,15 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | max-parallelism=1 segment-costs=[18802] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=12B cardinality=420 cost=18780 +| tuple-ids=2 row-size=12B cardinality=423 cost=18780 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -357,10 +357,10 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=420(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=423(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1144892027 + tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1153069828 in pipelines: 00(GETNEXT) ---- PARALLELPLANS Max Per-Host Resource Reservation: Memory=863.34MB Threads=33 @@ -381,11 +381,11 @@ PLAN-ROOT SINK | F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=50 (adjusted from 120) Per-Instance Resources: mem-estimate=12.15MB mem-reservation=0B thread-reservation=1 -max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max(50 (self) vs 180 (sum children))] +max-parallelism=50 segment-costs=[476731627, 285] cpu-comparison-result=180 [max(50 (self) vs 180 (sum children))] 10:TOP-N [LIMIT=100] | order by: c_last_name ASC NULLS LAST, c_first_name ASC NULLS LAST, substr(tpcds_partitioned_parquet_snap.store.s_city, 1, 30) ASC NULLS LAST, sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) ASC NULLS LAST | mem-estimate=9.48KB mem-reservation=0B thread-reservation=0 -| tuple-ids=11 row-size=97B cardinality=100 cost=443846889 +| tuple-ids=11 row-size=97B cardinality=100 cost=447201479 | in pipelines: 10(GETNEXT), 15(OPEN) | 09:HASH JOIN [INNER JOIN, PARTITIONED] @@ -393,7 +393,7 @@ max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8,9 row-size=109B cardinality=31.60M cost=14555202 +| tuple-ids=8,9 row-size=109B cardinality=31.82M cost=14659168 | in pipelines: 15(GETNEXT), 08(OPEN) | |--F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=50 (adjusted from 120) @@ -427,33 +427,33 @@ max-parallelism=50 segment-costs=[473167603, 285] cpu-comparison-result=180 [max | 16:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] | mem-estimate=12.14MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=14765512 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=14870980 | in pipelines: 15(GETNEXT) | F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.store.s_city)] hosts=10 instances=30 (adjusted from 120) -Per-Instance Resources: mem-estimate=107.31MB mem-reservation=34.00MB thread-reservation=1 -max-parallelism=30 segment-costs=[220358858, 170910623] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))] +Per-Instance Resources: mem-estimate=107.94MB mem-reservation=34.00MB thread-reservation=1 +max-parallelism=30 segment-costs=[221932851, 172131414] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))] 15:AGGREGATE [FINALIZE] | output: sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store.s_city -| mem-estimate=88.74MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=205593346 +| mem-estimate=89.38MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=207061871 | in pipelines: 15(GETNEXT), 00(OPEN) | 14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number,tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk,tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk,tpcds_partitioned_parquet_snap.store.s_city)] | mem-estimate=18.57MB mem-reservation=0B thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=14765512 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=14870980 | in pipelines: 00(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120 Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB Per-Instance Resources: mem-estimate=58.57MB mem-reservation=34.50MB thread-reservation=1 -max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result=120 [max(120 (self) vs 33 (sum children))] +max-parallelism=220 segment-costs=[2173254521, 172131414] cpu-comparison-result=120 [max(120 (self) vs 33 (sum children))] 07:AGGREGATE [STREAMING] | output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), sum(tpcds_partitioned_parquet_snap.store_sales.ss_net_profit) | group by: tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store.s_city | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 -| tuple-ids=8 row-size=69B cardinality=34.42M cost=205593346 +| tuple-ids=8 row-size=69B cardinality=34.67M cost=207061871 | in pipelines: 00(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] @@ -461,7 +461,7 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4,6 row-size=89B cardinality=34.42M cost=49949473 +| tuple-ids=0,2,4,6 row-size=89B cardinality=34.67M cost=50306255 | in pipelines: 00(GETNEXT), 05(OPEN) | |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -499,7 +499,7 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2,4 row-size=60B cardinality=170.42M cost=237435650 +| tuple-ids=0,2,4 row-size=60B cardinality=171.63M cost=237656218 | in pipelines: 00(GETNEXT), 03(OPEN) | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 @@ -536,21 +536,21 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 -| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.75G) cost=522900744 +| tuple-ids=0,2 row-size=48B cardinality=805.29M(filtered from 1.76G) cost=525160349 | in pipelines: 00(GETNEXT), 01(OPEN) | |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB -| | max-parallelism=10 segment-costs=[970] +| | max-parallelism=10 segment-costs=[983] | JOIN BUILD | | join-table-id=03 plan-id=04 cohort-id=01 | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk -| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=420 +| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=423 | | | 11:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 -| | tuple-ids=2 row-size=12B cardinality=420 cost=550 +| | tuple-ids=2 row-size=12B cardinality=423 cost=560 | | in pipelines: 01(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 @@ -558,15 +558,15 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= | max-parallelism=1 segment-costs=[18802] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.date_dim.d_year = add(CAST(2000 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year IN (CAST(2000 AS INT), CAST(2001 AS INT), CAST(2002 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_dow = CAST(1 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 -| tuple-ids=2 row-size=12B cardinality=420 cost=18780 +| tuple-ids=2 row-size=12B cardinality=423 cost=18780 | in pipelines: 01(GETNEXT) | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM] @@ -578,9 +578,9 @@ max-parallelism=220 segment-costs=[2160771240, 170910623] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=420(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=423(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 - tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1144892027 + tuple-ids=0 row-size=36B cardinality=805.29M(filtered from 7.58G) cost=1153069828 in pipelines: 00(GETNEXT) ==== diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q80.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q80.test index 4e604cd55..0fe41ecbb 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q80.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q80.test @@ -195,13 +195,13 @@ PLAN-ROOT SINK | | | |--31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=33 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 31(GETNEXT) @@ -323,13 +323,13 @@ PLAN-ROOT SINK | | | |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=19 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 19(GETNEXT) @@ -447,13 +447,13 @@ PLAN-ROOT SINK | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 07(GETNEXT) @@ -507,7 +507,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=824.56M(filtered from 7.70G) cost=4496919003 @@ -710,13 +710,13 @@ max-parallelism=80 segment-costs=[74437, 3952483, 3622, 509107, 1136665] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=33 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 31(GETNEXT) @@ -948,13 +948,13 @@ max-parallelism=80 segment-costs=[74437, 3952483, 3622, 509107, 1136665] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=19 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 19(GETNEXT) @@ -1182,13 +1182,13 @@ max-parallelism=360 segment-costs=[3504585168, 440125] cpu-comparison-result=247 | max-parallelism=1 segment-costs=[14888] | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 07(GETNEXT) @@ -1286,7 +1286,7 @@ max-parallelism=670 segment-costs=[6620983249] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=824.56M(filtered from 7.70G) cost=4496919003 @@ -1489,13 +1489,13 @@ max-parallelism=80 segment-costs=[74437, 3952483, 3622, 509107, 1136665] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_1.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_1.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=33 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 31(GETNEXT) @@ -1727,13 +1727,13 @@ max-parallelism=80 segment-costs=[74437, 3952483, 3622, 509107, 1136665] cpu-com | | max-parallelism=1 segment-costs=[14888] | | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=19 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 19(GETNEXT) @@ -1961,13 +1961,13 @@ max-parallelism=360 segment-costs=[3504585168, 440125] cpu-comparison-result=247 | max-parallelism=1 segment-costs=[14888] | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('1999-08-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('1999-08-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '1999-09-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '1999-08-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 07(GETNEXT) @@ -2065,7 +2065,7 @@ max-parallelism=670 segment-costs=[6620983249] table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=32B cardinality=824.56M(filtered from 7.70G) cost=4496919003 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q82.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q82.test index c750b6a6f..d4a49f402 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q82.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q82.test @@ -56,13 +56,13 @@ PLAN-ROOT SINK | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.item] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -91,13 +91,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -111,7 +111,7 @@ PLAN-ROOT SINK table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 @@ -216,13 +216,13 @@ max-parallelism=40 segment-costs=[389806012, 385740738] cpu-comparison-result=14 | | max-parallelism=4 segment-costs=[707329] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -277,13 +277,13 @@ max-parallelism=60 segment-costs=[550587747] | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -297,7 +297,7 @@ max-parallelism=60 segment-costs=[550587747] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 @@ -402,13 +402,13 @@ max-parallelism=40 segment-costs=[389806012, 385740738] cpu-comparison-result=14 | | max-parallelism=4 segment-costs=[707329] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM] | | HDFS partitions=1/1 files=1 size=33.54MB -| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | stored statistics: | | table: rows=360.00K size=33.54MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=101.54K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(add(CAST(82 AS SMALLINT), CAST(30 AS SMALLINT)) AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(3,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id IN (CAST(105 AS INT), CAST(693 AS INT), CAST(920 AS INT), CAST(941 AS INT)), tpcds_partitioned_parquet_snap.item.i_current_price <= CAST(112 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_current_price >= CAST(82 AS DECIMAL(5,0)), tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=6 row-size=153B cardinality=476 cost=707123 | | in pipelines: 04(GETNEXT) @@ -463,13 +463,13 @@ max-parallelism=60 segment-costs=[550587747] | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2002-03-10' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2002-03-10' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2002-05-09', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2002-03-10', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -483,7 +483,7 @@ max-parallelism=60 segment-costs=[550587747] table: rows=1.03G size=5.10GB partitions: 261/261 rows=1.03G columns: all - extrapolated-rows=disabled max-scan-range-rows=3.99M + extrapolated-rows=disabled max-scan-range-rows=3.98M parquet statistics predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT) parquet dictionary predicates: tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand <= CAST(500 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_quantity_on_hand >= CAST(100 AS INT), tpcds_partitioned_parquet_snap.inventory.inv_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q84.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q84.test index 6f7bf074c..3933f6b85 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q84.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q84.test @@ -54,13 +54,13 @@ PLAN-ROOT SINK | | | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band] | | HDFS partitions=1/1 files=1 size=1.22KB -| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | stored statistics: | | table: rows=20 size=1.22KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet statistics predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 | | tuple-ids=10 row-size=12B cardinality=2 cost=5 | | in pipelines: 08(GETNEXT) @@ -234,13 +234,13 @@ max-parallelism=30 segment-costs=[252437311, 199] cpu-comparison-result=51 [max( | | max-parallelism=1 segment-costs=[5] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | HDFS partitions=1/1 files=1 size=1.22KB -| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | stored statistics: | | table: rows=20 size=1.22KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet statistics predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 | | tuple-ids=10 row-size=12B cardinality=2 cost=5 | | in pipelines: 08(GETNEXT) @@ -467,13 +467,13 @@ max-parallelism=30 segment-costs=[252437311, 199] cpu-comparison-result=51 [max( | | max-parallelism=1 segment-costs=[5] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.income_band, RANDOM] | | HDFS partitions=1/1 files=1 size=1.22KB -| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | stored statistics: | | table: rows=20 size=1.22KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=20 | | parquet statistics predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= add(CAST(55019 AS BIGINT), CAST(50000 AS BIGINT)), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.income_band.ib_lower_bound >= CAST(55019 AS INT), CAST(tpcds_partitioned_parquet_snap.income_band.ib_upper_bound AS BIGINT) <= CAST(105019 AS BIGINT), tpcds_partitioned_parquet_snap.income_band.ib_income_band_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0 | | tuple-ids=10 row-size=12B cardinality=2 cost=5 | | in pipelines: 08(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q86.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q86.test index 673923b3d..7a7948a87 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q86.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q86.test @@ -109,13 +109,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -291,13 +291,13 @@ max-parallelism=1130 segment-costs=[11221205573, 1265550] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -473,13 +473,13 @@ max-parallelism=1130 segment-costs=[11221205573, 1265550] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1180 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1191 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1180 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q87.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q87.test index 8accd6435..2d6e20ade 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q87.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q87.test @@ -87,13 +87,13 @@ PLAN-ROOT SINK | | | |--16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 16(GETNEXT) @@ -162,13 +162,13 @@ PLAN-ROOT SINK | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 09(GETNEXT) @@ -224,13 +224,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 03(GETNEXT) @@ -244,7 +244,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 @@ -392,13 +392,13 @@ max-parallelism=120 segment-costs=[70143014962, 12312550098, 18895080464, 103897 | | max-parallelism=1 segment-costs=[19174] | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 16(GETNEXT) @@ -531,13 +531,13 @@ max-parallelism=120 segment-costs=[44821945517, 24332992738, 67957413025, 373673 | | max-parallelism=1 segment-costs=[19174] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 09(GETNEXT) @@ -642,13 +642,13 @@ max-parallelism=1823 segment-costs=[50493995561, 22341022045] cpu-comparison-res | max-parallelism=1 segment-costs=[19174] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 03(GETNEXT) @@ -662,7 +662,7 @@ max-parallelism=1823 segment-costs=[50493995561, 22341022045] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 @@ -810,13 +810,13 @@ max-parallelism=120 segment-costs=[70143014962, 12312550098, 18895080464, 103897 | | max-parallelism=1 segment-costs=[19174] | | 16:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=18 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 16(GETNEXT) @@ -949,13 +949,13 @@ max-parallelism=120 segment-costs=[44821945517, 24332992738, 67957413025, 373673 | | max-parallelism=1 segment-costs=[19174] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=12B cardinality=7.30K cost=18780 | | in pipelines: 09(GETNEXT) @@ -1060,13 +1060,13 @@ max-parallelism=1823 segment-costs=[50493995561, 22341022045] cpu-comparison-res | max-parallelism=1 segment-costs=[19174] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1204 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1215 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1204 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=7.30K cost=18780 | in pipelines: 03(GETNEXT) @@ -1080,7 +1080,7 @@ max-parallelism=1823 segment-costs=[50493995561, 22341022045] cpu-comparison-res table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=8B cardinality=7.57G(filtered from 7.88G) cost=1182183990 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q88.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q88.test index 272897f5e..097259315 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q88.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q88.test @@ -166,13 +166,13 @@ PLAN-ROOT SINK | | | |--63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=65 row-size=12B cardinality=394 cost=3065 | | in pipelines: 63(GETNEXT) @@ -254,13 +254,13 @@ PLAN-ROOT SINK | | | |--54:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=56 row-size=12B cardinality=394 cost=3065 | | in pipelines: 54(GETNEXT) @@ -342,13 +342,13 @@ PLAN-ROOT SINK | | | |--45:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=47 row-size=12B cardinality=394 cost=3065 | | in pipelines: 45(GETNEXT) @@ -430,13 +430,13 @@ PLAN-ROOT SINK | | | |--36:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=38 row-size=12B cardinality=394 cost=3065 | | in pipelines: 36(GETNEXT) @@ -518,13 +518,13 @@ PLAN-ROOT SINK | | | |--27:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=29 row-size=12B cardinality=394 cost=3065 | | in pipelines: 27(GETNEXT) @@ -606,13 +606,13 @@ PLAN-ROOT SINK | | | |--18:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=20 row-size=12B cardinality=394 cost=3065 | | in pipelines: 18(GETNEXT) @@ -694,13 +694,13 @@ PLAN-ROOT SINK | | | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=394 cost=3065 | | in pipelines: 09(GETNEXT) @@ -777,13 +777,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics] | HDFS partitions=1/1 files=1 size=41.69KB -| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL | stored statistics: | table: rows=7.20K size=41.69KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=7.20K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=394 cost=3065 | in pipelines: 01(GETNEXT) @@ -956,13 +956,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=65 row-size=12B cardinality=394 cost=3065 | | in pipelines: 63(GETNEXT) @@ -1126,13 +1126,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=56 row-size=12B cardinality=394 cost=3065 | | in pipelines: 54(GETNEXT) @@ -1296,13 +1296,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=47 row-size=12B cardinality=394 cost=3065 | | in pipelines: 45(GETNEXT) @@ -1466,13 +1466,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=38 row-size=12B cardinality=394 cost=3065 | | in pipelines: 36(GETNEXT) @@ -1636,13 +1636,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=29 row-size=12B cardinality=394 cost=3065 | | in pipelines: 27(GETNEXT) @@ -1806,13 +1806,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=20 row-size=12B cardinality=394 cost=3065 | | in pipelines: 18(GETNEXT) @@ -1976,13 +1976,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=394 cost=3065 | | in pipelines: 09(GETNEXT) @@ -2125,13 +2125,13 @@ max-parallelism=250 segment-costs=[2407759148, 123] cpu-comparison-result=120 [m | max-parallelism=1 segment-costs=[3086] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=41.69KB -| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL | stored statistics: | table: rows=7.20K size=41.69KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=7.20K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=394 cost=3065 | in pipelines: 01(GETNEXT) @@ -2304,13 +2304,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 63:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_6.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_6.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_6.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=65 row-size=12B cardinality=394 cost=3065 | | in pipelines: 63(GETNEXT) @@ -2474,13 +2474,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_5.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_5.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_5.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=56 row-size=12B cardinality=394 cost=3065 | | in pipelines: 54(GETNEXT) @@ -2644,13 +2644,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 45:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_4.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_4.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_4.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=47 row-size=12B cardinality=394 cost=3065 | | in pipelines: 45(GETNEXT) @@ -2814,13 +2814,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_3.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_3.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_3.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=38 row-size=12B cardinality=394 cost=3065 | | in pipelines: 36(GETNEXT) @@ -2984,13 +2984,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_2.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_2.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_2.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=29 row-size=12B cardinality=394 cost=3065 | | in pipelines: 27(GETNEXT) @@ -3154,13 +3154,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_1.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_1.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_1.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=20 row-size=12B cardinality=394 cost=3065 | | in pipelines: 18(GETNEXT) @@ -3324,13 +3324,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[3086] | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | | HDFS partitions=1/1 files=1 size=41.69KB -| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count IS NOT NULL | | stored statistics: | | table: rows=7.20K size=41.69KB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=7.20K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics_0.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics_0.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics_0.hd_demo_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | | tuple-ids=11 row-size=12B cardinality=394 cost=3065 | | in pipelines: 09(GETNEXT) @@ -3473,13 +3473,13 @@ max-parallelism=250 segment-costs=[2407759148, 123] cpu-comparison-result=120 [m | max-parallelism=1 segment-costs=[3086] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM] | HDFS partitions=1/1 files=1 size=41.69KB -| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(2 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(2 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(3 AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(0 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT)) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count IS NOT NULL | stored statistics: | table: rows=7.20K size=41.69KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=7.20K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(1 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(add(CAST(2 AS SMALLINT), CAST(2 AS SMALLINT)) AS INT) OR tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(2 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(0 AS INT), CAST(1 AS INT), CAST(2 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_vehicle_count <= CAST(4 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=394 cost=3065 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q89.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q89.test index bbfa3de44..f6ea6cc0a 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q89.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q89.test @@ -141,7 +141,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=170.71M(filtered from 7.88G) cost=483502882 @@ -345,7 +345,7 @@ max-parallelism=140 segment-costs=[1394743679, 264035694] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=170.71M(filtered from 7.88G) cost=483502882 @@ -549,7 +549,7 @@ max-parallelism=140 segment-costs=[1394743679, 264035694] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823) + extrapolated-rows=disabled max-scan-range-rows=12.24M est-scan-range=373(filtered from 1823) parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=16B cardinality=170.71M(filtered from 7.88G) cost=483502882 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q90.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q90.test index 11230361e..3cfccd1df 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q90.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q90.test @@ -79,13 +79,13 @@ PLAN-ROOT SINK | | | |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=13 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 11(GETNEXT) @@ -162,13 +162,13 @@ PLAN-ROOT SINK | |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 03(GETNEXT) @@ -330,13 +330,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[17609] | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=13 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 11(GETNEXT) @@ -479,13 +479,13 @@ max-parallelism=80 segment-costs=[711368690, 123] cpu-comparison-result=80 [max( | max-parallelism=1 segment-costs=[17609] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 03(GETNEXT) @@ -664,13 +664,13 @@ PLAN-ROOT SINK | | max-parallelism=1 segment-costs=[17609] | | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=1.31MB -| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | stored statistics: | | table: rows=86.40K size=1.31MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=86.40K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(add(CAST(19 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim_0.t_hour <= CAST(20 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_hour >= CAST(19 AS INT), tpcds_partitioned_parquet_snap.time_dim_0.t_time_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=13 row-size=8B cardinality=8.64K cost=17236 | | in pipelines: 11(GETNEXT) @@ -813,13 +813,13 @@ max-parallelism=80 segment-costs=[711368690, 123] cpu-comparison-result=80 [max( | max-parallelism=1 segment-costs=[17609] | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.time_dim, RANDOM] | HDFS partitions=1/1 files=1 size=1.31MB -| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | stored statistics: | table: rows=86.40K size=1.31MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=86.40K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(add(CAST(8 AS SMALLINT), CAST(1 AS SMALLINT)) AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.time_dim.t_hour <= CAST(9 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_hour >= CAST(8 AS INT), tpcds_partitioned_parquet_snap.time_dim.t_time_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=4 row-size=8B cardinality=8.64K cost=17236 | in pipelines: 03(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q92.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q92.test index 380c7806a..650900bd5 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q92.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q92.test @@ -98,13 +98,13 @@ PLAN-ROOT SINK | | | |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -134,13 +134,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -310,13 +310,13 @@ max-parallelism=90 segment-costs=[887406184, 185] cpu-comparison-result=145 [max | | max-parallelism=1 segment-costs=[14888] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -363,13 +363,13 @@ max-parallelism=90 segment-costs=[887406184, 185] cpu-comparison-result=145 [max | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -539,13 +539,13 @@ max-parallelism=90 segment-costs=[887406184, 185] cpu-comparison-result=145 [max | | max-parallelism=1 segment-costs=[14888] | | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=6 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 04(GETNEXT) @@ -592,13 +592,13 @@ max-parallelism=90 segment-costs=[887406184, 185] cpu-comparison-result=145 [max | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-03-13' AS DATE) + INTERVAL CAST(90 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-03-13' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-11', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-03-13', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q94.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q94.test index c1866ff29..919f37681 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q94.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q94.test @@ -104,13 +104,13 @@ PLAN-ROOT SINK | | | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -216,13 +216,13 @@ PLAN-ROOT SINK | | | |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) @@ -449,13 +449,13 @@ max-parallelism=10 segment-costs=[76597769, 34791944] cpu-comparison-result=360 | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -668,13 +668,13 @@ max-parallelism=80 segment-costs=[735435333] | | max-parallelism=1 segment-costs=[14888] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) @@ -918,13 +918,13 @@ max-parallelism=10 segment-costs=[76597769, 34791944] cpu-comparison-result=360 | | | max-parallelism=1 segment-costs=[14888] | | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | | HDFS partitions=1/1 files=1 size=2.17MB -| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | stored statistics: | | | table: rows=73.05K size=2.17MB | | | columns: all | | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE) -| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01' +| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | | in pipelines: 05(GETNEXT) @@ -1137,13 +1137,13 @@ max-parallelism=80 segment-costs=[735435333] | | max-parallelism=1 segment-costs=[14888] | | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= CAST('2001-5-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim_0.d_date >= CAST('2001-5-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_date <= DATE '2001-06-30', tpcds_partitioned_parquet_snap.date_dim_0.d_date >= DATE '2001-05-01', tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=17 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 14(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q95.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q95.test index d7e994f16..c816f79d9 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q95.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q95.test @@ -98,13 +98,13 @@ PLAN-ROOT SINK | | | |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 08(GETNEXT) @@ -376,13 +376,13 @@ max-parallelism=1660 segment-costs=[16505607197, 16780609, 3] cpu-comparison-res | | max-parallelism=1 segment-costs=[14888] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 08(GETNEXT) @@ -760,13 +760,13 @@ max-parallelism=1660 segment-costs=[16505607197, 16780609, 3] cpu-comparison-res | | max-parallelism=1 segment-costs=[14888] | | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2000-3-01' AS DATE) + INTERVAL CAST(60 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2000-3-01' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01' +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2000-04-30', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2000-03-01', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | | tuple-ids=9 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 08(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q97.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q97.test index 135942eb6..f4d8dda0b 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q97.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q97.test @@ -64,13 +64,13 @@ PLAN-ROOT SINK | | | |--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 05(GETNEXT) @@ -104,13 +104,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -123,7 +123,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1425550548 in pipelines: 00(GETNEXT) @@ -222,13 +222,13 @@ max-parallelism=5000 segment-costs=[49914893466, 7024936592, 247] cpu-comparison | | max-parallelism=1 segment-costs=[14888] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 05(GETNEXT) @@ -294,13 +294,13 @@ max-parallelism=1823 segment-costs=[53731211080, 8500505120] cpu-comparison-resu | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -313,7 +313,7 @@ max-parallelism=1823 segment-costs=[53731211080, 8500505120] cpu-comparison-resu table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1425550548 in pipelines: 00(GETNEXT) @@ -412,13 +412,13 @@ max-parallelism=5000 segment-costs=[49914893466, 7024936592, 247] cpu-comparison | | max-parallelism=1 segment-costs=[14888] | | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | | HDFS partitions=1/1 files=1 size=2.17MB -| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | stored statistics: | | table: rows=73.05K size=2.17MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=73.05K -| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) -| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL +| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT) +| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | | tuple-ids=7 row-size=8B cardinality=7.30K cost=14573 | | in pipelines: 05(GETNEXT) @@ -484,13 +484,13 @@ max-parallelism=1823 segment-costs=[53731211080, 8500505120] cpu-comparison-resu | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1209 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1220 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1209 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -503,7 +503,7 @@ max-parallelism=1823 segment-costs=[53731211080, 8500505120] cpu-comparison-resu table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=8.25G cost=1425550548 in pipelines: 00(GETNEXT) diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q98.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q98.test index 006d117b0..0c3ceb9fe 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q98.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q98.test @@ -100,13 +100,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -120,7 +120,7 @@ PLAN-ROOT SINK table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=2.47G(filtered from 8.25G) cost=1657367506 @@ -260,13 +260,13 @@ max-parallelism=850 segment-costs=[8464153624, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -280,7 +280,7 @@ max-parallelism=850 segment-costs=[8464153624, 573922566] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=2.47G(filtered from 8.25G) cost=1657367506 @@ -420,13 +420,13 @@ max-parallelism=850 segment-costs=[8464153624, 573922566] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= CAST('2001-04-12' AS DATE) + INTERVAL CAST(30 AS INT) DAY, tpcds_partitioned_parquet_snap.date_dim.d_date >= CAST('2001-04-12' AS DATE), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12' +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date <= DATE '2001-05-12', tpcds_partitioned_parquet_snap.date_dim.d_date >= DATE '2001-04-12', tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -440,7 +440,7 @@ max-parallelism=850 segment-costs=[8464153624, 573922566] cpu-comparison-result= table: rows=8.64G size=389.90GB partitions: 1823/1823 rows=8.25G columns: all - extrapolated-rows=disabled max-scan-range-rows=12.22M + extrapolated-rows=disabled max-scan-range-rows=12.24M parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 tuple-ids=0 row-size=12B cardinality=2.47G(filtered from 8.25G) cost=1657367506 diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q99.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q99.test index 271da543a..b87676218 100644 --- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q99.test +++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q99.test @@ -127,13 +127,13 @@ PLAN-ROOT SINK | |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -338,13 +338,13 @@ max-parallelism=1630 segment-costs=[16287961570, 2357152] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) @@ -549,13 +549,13 @@ max-parallelism=1630 segment-costs=[16287961570, 2357152] cpu-comparison-result= | max-parallelism=1 segment-costs=[14888] | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM] | HDFS partitions=1/1 files=1 size=2.17MB -| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | stored statistics: | table: rows=73.05K size=2.17MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K -| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) -| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= add(CAST(1203 AS INT), CAST(11 AS INT)), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL +| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT) +| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq <= CAST(1214 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_month_seq >= CAST(1203 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0 | tuple-ids=2 row-size=8B cardinality=7.30K cost=14573 | in pipelines: 01(GETNEXT) diff --git a/testdata/workloads/functional-query/queries/QueryTest/calcite.test b/testdata/workloads/functional-query/queries/QueryTest/calcite.test index 5c49f1bc5..0b68eab33 100644 --- a/testdata/workloads/functional-query/queries/QueryTest/calcite.test +++ b/testdata/workloads/functional-query/queries/QueryTest/calcite.test @@ -1212,3 +1212,15 @@ explain select min(month), max(year), ndv(day) from functional.alltypesagg; '01:AGGREGATE' '00:SCAN $FILESYSTEM_NAME [functional.alltypesagg]' ==== +---- QUERY +# values test with different sized columns. +# result should have no trailing spaces. +values ('abc'), ('defg') +---- RESULTS +'abc' +'defg' +---- TYPES +string +---- RUNTIME_PROFILE +row_regex: .*PlannerType: CalcitePlanner.* +====