mirror of
https://github.com/apache/impala.git
synced 2025-12-19 18:12:08 -05:00
IMPALA-13437 (part 2): Implement cost-based tuple cache placement
This changes the default behavior of the tuple cache to consider cost when placing the TupleCacheNodes. It tries to pick the best locations within a budget. First, it eliminates unprofitable locations via a threshold. Next, it ranks the remaining locations by their profitability. Finally, it picks the best locations in rank order until it reaches the budget. The threshold is based on the ratio of processing cost for regular execution versus the processing cost for reading from the cache. If the ratio is below the threshold, the location is eliminated. The threshold is specified by the tuple_cache_required_cost_reduction_factor query option. This defaults to 3.0, which means that the cost of reading from the cache must be less than 1/3 the cost of computing the value normally. A higher value makes this more restrictive about caching locations, which pushes in the direction of lower overhead. The ranking is based on the cost reduction per byte. This is given by the formula: (regular processing cost - cost to read from cache) / estimated serialized size This prefers locations with small results or high reduction in cost. The budget is based on the estimated serialized size per node. This limits the total caching that a query will do. A higher value allows more caching, which can increase the overhead on the first run of a query. A lower value is less aggressive and can limit the overhead at the expense of less caching. This uses a per-node limit as the limit should scale based on the size of the executor group as each executor brings extra capacity. The budget is specified by the tuple_cache_budget_bytes_per_executor. The old behavior to place the tuple cache at all eligible locations is still available via the tuple_cache_placement_policy query option. The default is the cost_based policy described above, but the old behavior is available via the all_eligible policy. This is useful for correctness testing (and the existing tuple cache test cases). This changes the explain plan output: - The hash trace is only enabled at VERBOSE level. This means that the regular profile will not contain the hash trace, as the regular profile uses EXTENDED. - This adds additional information at VERBOSE to display the cost information for each plan node. This can help trace why a particular location was not picked. Testing: - This adds a TPC-DS planner test with tuple caching enabled (based on the existing TpcdsCpuCostPlannerTest) - This modifies existing tests to adapt to changes in the explain plan output Change-Id: Ifc6e7b95621a7937d892511dc879bf7c8da07cdc Reviewed-on: http://gerrit.cloudera.org:8080/23219 Reviewed-by: Michael Smith <michael.smith@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
This commit is contained in:
Joe McDonnell
@@ -1405,6 +1405,26 @@ Status impala::SetQueryOption(TImpalaQueryOptions::type option, const string& va
|
||||
query_options->__set_broadcast_cost_scale_factor(double_val);
|
||||
break;
|
||||
}
|
||||
case TImpalaQueryOptions::TUPLE_CACHE_PLACEMENT_POLICY: {
|
||||
TTupleCachePlacementPolicy::type enum_type;
|
||||
RETURN_IF_ERROR(GetThriftEnum(value, "Tuple cache placement policy",
|
||||
_TTupleCachePlacementPolicy_VALUES_TO_NAMES, &enum_type));
|
||||
query_options->__set_tuple_cache_placement_policy(enum_type);
|
||||
break;
|
||||
}
|
||||
case TImpalaQueryOptions::TUPLE_CACHE_REQUIRED_COST_REDUCTION_FACTOR: {
|
||||
double double_val = 0.0f;
|
||||
RETURN_IF_ERROR(QueryOptionParser::ParseAndCheckInclusiveLowerBound<double>(
|
||||
option, value, 0.0, &double_val));
|
||||
query_options->__set_tuple_cache_required_cost_reduction_factor(double_val);
|
||||
break;
|
||||
}
|
||||
case TImpalaQueryOptions::TUPLE_CACHE_BUDGET_BYTES_PER_EXECUTOR: {
|
||||
MemSpec mem_spec_val{};
|
||||
RETURN_IF_ERROR(QueryOptionParser::Parse<MemSpec>(option, value, &mem_spec_val));
|
||||
query_options->__set_tuple_cache_budget_bytes_per_executor(mem_spec_val.value);
|
||||
break;
|
||||
}
|
||||
default:
|
||||
string key = to_string(option);
|
||||
if (IsRemovedQueryOption(key)) {
|
||||
|
||||
@@ -51,7 +51,7 @@ typedef std::unordered_map<string, beeswax::TQueryOptionLevel::type>
|
||||
// plus one. Thus, the second argument to the DCHECK has to be updated every
|
||||
// time we add or remove a query option to/from the enum TImpalaQueryOptions.
|
||||
constexpr unsigned NUM_QUERY_OPTIONS =
|
||||
TImpalaQueryOptions::BROADCAST_COST_SCALE_FACTOR + 1;
|
||||
TImpalaQueryOptions::TUPLE_CACHE_BUDGET_BYTES_PER_EXECUTOR + 1;
|
||||
#define QUERY_OPTS_TABLE \
|
||||
DCHECK_EQ(_TImpalaQueryOptions_VALUES_TO_NAMES.size(), NUM_QUERY_OPTIONS); \
|
||||
REMOVED_QUERY_OPT_FN(abort_on_default_limit_exceeded, ABORT_ON_DEFAULT_LIMIT_EXCEEDED) \
|
||||
@@ -380,6 +380,12 @@ constexpr unsigned NUM_QUERY_OPTIONS =
|
||||
QUERY_OPT_FN(hide_analyzed_query, HIDE_ANALYZED_QUERY, TQueryOptionLevel::ADVANCED) \
|
||||
QUERY_OPT_FN(broadcast_cost_scale_factor, BROADCAST_COST_SCALE_FACTOR, \
|
||||
TQueryOptionLevel::ADVANCED) \
|
||||
TUPLE_CACHE_EXEMPT_QUERY_OPT_FN(tuple_cache_placement_policy, \
|
||||
TUPLE_CACHE_PLACEMENT_POLICY, TQueryOptionLevel::ADVANCED) \
|
||||
TUPLE_CACHE_EXEMPT_QUERY_OPT_FN(tuple_cache_required_cost_reduction_factor, \
|
||||
TUPLE_CACHE_REQUIRED_COST_REDUCTION_FACTOR, TQueryOptionLevel::ADVANCED) \
|
||||
TUPLE_CACHE_EXEMPT_QUERY_OPT_FN(tuple_cache_budget_bytes_per_executor, \
|
||||
TUPLE_CACHE_BUDGET_BYTES_PER_EXECUTOR, TQueryOptionLevel::ADVANCED) \
|
||||
;
|
||||
|
||||
/// Enforce practical limits on some query options to avoid undesired query state.
|
||||
|
||||
@@ -301,6 +301,21 @@ DEFINE_int32(iceberg_catalog_num_threads, 16,
|
||||
"Maximum number of threads to use for Iceberg catalog operations. These threads are "
|
||||
"shared among concurrent Iceberg catalog operation (ie., ExpireSnapshot).");
|
||||
|
||||
// These coefficients have not been determined empirically. The write coefficient
|
||||
// matches the coefficient for a broadcast sender in DataStreamSink. The read
|
||||
// coefficient matches the coefficient for an exchange receiver in ExchandeNode.
|
||||
// This includes both a bytes coefficient and a rows coefficient to allow experimentation
|
||||
// and tuning.
|
||||
// TODO: Tune these empirically.
|
||||
DEFINE_double(tuple_cache_cost_coefficient_write_bytes, 0.0027,
|
||||
"Cost coefficient for writing a byte to the tuple cache.");
|
||||
DEFINE_double(tuple_cache_cost_coefficient_write_rows, 0.00,
|
||||
"Cost coefficient for writing a row to the tuple cache.");
|
||||
DEFINE_double(tuple_cache_cost_coefficient_read_bytes, 0.00,
|
||||
"Cost coefficient for reading a byte from the tuple cache.");
|
||||
DEFINE_double(tuple_cache_cost_coefficient_read_rows, 0.1329,
|
||||
"Cost coefficient for reading a row from the tuple cache.");
|
||||
|
||||
using strings::Substitute;
|
||||
|
||||
namespace impala {
|
||||
@@ -316,6 +331,15 @@ static bool ValidatePositiveDouble(const char* flagname, double value) {
|
||||
return false;
|
||||
}
|
||||
|
||||
static bool ValidateNonnegativeDouble(const char* flagname, double value) {
|
||||
if (0.0 <= value) {
|
||||
return true;
|
||||
}
|
||||
LOG(ERROR) << Substitute(
|
||||
"$0 must be greater than or equal to 0.0, value $1 is invalid", flagname, value);
|
||||
return false;
|
||||
}
|
||||
|
||||
static bool ValidatePositiveInt64(const char* flagname, int64_t value) {
|
||||
if (0 < value) {
|
||||
return true;
|
||||
@@ -333,6 +357,10 @@ DEFINE_validator(query_cpu_count_divisor, &ValidatePositiveDouble);
|
||||
DEFINE_validator(min_processing_per_thread, &ValidatePositiveInt64);
|
||||
DEFINE_validator(query_cpu_root_factor, &ValidatePositiveDouble);
|
||||
DEFINE_validator(iceberg_catalog_num_threads, &ValidatePositiveInt32);
|
||||
DEFINE_validator(tuple_cache_cost_coefficient_write_bytes, &ValidateNonnegativeDouble);
|
||||
DEFINE_validator(tuple_cache_cost_coefficient_write_rows, &ValidateNonnegativeDouble);
|
||||
DEFINE_validator(tuple_cache_cost_coefficient_read_bytes, &ValidateNonnegativeDouble);
|
||||
DEFINE_validator(tuple_cache_cost_coefficient_read_rows, &ValidateNonnegativeDouble);
|
||||
|
||||
Status GetConfigFromCommand(const string& flag_cmd, string& result) {
|
||||
result.clear();
|
||||
@@ -552,6 +580,14 @@ Status PopulateThriftBackendGflags(TBackendGflags& cfg) {
|
||||
cfg.__set_warmup_tables_config_file(FLAGS_warmup_tables_config_file);
|
||||
cfg.__set_keeps_warmup_tables_loaded(FLAGS_keeps_warmup_tables_loaded);
|
||||
cfg.__set_truncate_external_tables_with_hms(FLAGS_truncate_external_tables_with_hms);
|
||||
cfg.__set_tuple_cache_cost_coefficient_write_bytes(
|
||||
FLAGS_tuple_cache_cost_coefficient_write_bytes);
|
||||
cfg.__set_tuple_cache_cost_coefficient_write_rows(
|
||||
FLAGS_tuple_cache_cost_coefficient_write_rows);
|
||||
cfg.__set_tuple_cache_cost_coefficient_read_bytes(
|
||||
FLAGS_tuple_cache_cost_coefficient_read_bytes);
|
||||
cfg.__set_tuple_cache_cost_coefficient_read_rows(
|
||||
FLAGS_tuple_cache_cost_coefficient_read_rows);
|
||||
return Status::OK();
|
||||
}
|
||||
|
||||
|
||||
@@ -349,4 +349,12 @@ struct TBackendGflags {
|
||||
159: required bool keeps_warmup_tables_loaded
|
||||
|
||||
160: required bool truncate_external_tables_with_hms
|
||||
|
||||
161: required double tuple_cache_cost_coefficient_write_bytes
|
||||
|
||||
162: required double tuple_cache_cost_coefficient_write_rows
|
||||
|
||||
163: required double tuple_cache_cost_coefficient_read_bytes
|
||||
|
||||
164: required double tuple_cache_cost_coefficient_read_rows
|
||||
}
|
||||
|
||||
@@ -1044,6 +1044,31 @@ enum TImpalaQueryOptions {
|
||||
// while setting to a value less than 1.0 will favor broadcast joins more.
|
||||
// Default to 1.0, which means no adjustment is applied.
|
||||
BROADCAST_COST_SCALE_FACTOR = 194
|
||||
|
||||
// The tuple cache placement policy determines the overarching algorithm for placing
|
||||
// tuple cache locations. The two options are:
|
||||
// all_eligible: Pick all locations that are eligible. This is used for correctness
|
||||
// testing
|
||||
// cost_based: Pick locations that provide cost improvements while imposing a limit
|
||||
// on the total amount of caching to avoid excess overhead.
|
||||
// The default is cost_based.
|
||||
TUPLE_CACHE_PLACEMENT_POLICY = 195
|
||||
|
||||
// Minimum cost reduction necessary for tuple caching to consider a location
|
||||
// A location's cost reduction factor is given by the ratio:
|
||||
// cost of execution / cost of reading from the cache
|
||||
// A higher value for this setting is imposing a higher bar for picking locations,
|
||||
// which means it is caching less aggressively. For example, if this is set to 10,
|
||||
// the cost of reading from the cache needs to be 1/10th the cost of execution to
|
||||
// be considered. A value of zero disables the requirement, which is useful for
|
||||
// correctness checking.
|
||||
TUPLE_CACHE_REQUIRED_COST_REDUCTION_FACTOR = 196
|
||||
|
||||
// Maximum bytes per executor to cache for each query execution. This is using
|
||||
// the estimated serialized size to limit the total number of caching locations
|
||||
// for a given query execution. A higher value caches more aggressively. A lower
|
||||
// value reduces caching and thus overhead.
|
||||
TUPLE_CACHE_BUDGET_BYTES_PER_EXECUTOR = 197
|
||||
}
|
||||
|
||||
// The summary of a DML statement.
|
||||
|
||||
@@ -136,6 +136,16 @@ enum TSlotCountStrategy {
|
||||
PLANNER_CPU_ASK = 1
|
||||
}
|
||||
|
||||
// Set of options for the tuple_cache_placement_policy. See TupleCachePlanner and
|
||||
// associated classes for the specific policies for each option.
|
||||
enum TTupleCachePlacementPolicy {
|
||||
// Place tuple cache nodes at all eligible locations
|
||||
ALL_ELIGIBLE = 0,
|
||||
|
||||
// Place tuple cache nodes using costing policies
|
||||
COST_BASED = 1
|
||||
}
|
||||
|
||||
// constants for TQueryOptions.num_nodes
|
||||
const i32 NUM_NODES_ALL = 0
|
||||
const i32 NUM_NODES_ALL_RACKS = -1
|
||||
@@ -788,6 +798,16 @@ struct TQueryOptions {
|
||||
|
||||
// See comment in ImpalaService.thrift
|
||||
195: optional double broadcast_cost_scale_factor = 1.0
|
||||
|
||||
// See comment in ImpalaService.thrift
|
||||
196: optional TTupleCachePlacementPolicy tuple_cache_placement_policy =
|
||||
TTupleCachePlacementPolicy.COST_BASED;
|
||||
|
||||
// See comment in ImpalaService.thrift
|
||||
197: optional double tuple_cache_required_cost_reduction_factor = 3.0;
|
||||
|
||||
// See comment in ImpalaService.thrift (defaults to 100MB)
|
||||
198: optional i64 tuple_cache_budget_bytes_per_executor = 104857600;
|
||||
}
|
||||
|
||||
// Impala currently has three types of sessions: Beeswax, HiveServer2 and external
|
||||
|
||||
@@ -153,7 +153,7 @@ public abstract class TreeNode<NodeType extends TreeNode<NodeType>> {
|
||||
*/
|
||||
@SuppressWarnings("unchecked")
|
||||
public <C extends TreeNode<NodeType>, D extends C> void collectAll(
|
||||
Predicate<? super C> predicate, List<D> matches) {
|
||||
Predicate<? super C> predicate, Collection<D> matches) {
|
||||
if (predicate.apply((C) this)) matches.add((D) this);
|
||||
for (NodeType child: children_) child.collectAll(predicate, matches);
|
||||
}
|
||||
|
||||
@@ -449,35 +449,9 @@ abstract public class PlanNode extends TreeNode<PlanNode> {
|
||||
}
|
||||
}
|
||||
|
||||
if (detailLevel.ordinal() >= TExplainLevel.EXTENDED.ordinal()) {
|
||||
if (getTupleCacheInfo() != null && getTupleCacheInfo().isEligible()) {
|
||||
// This PlanNode is eligible for tuple caching, so there may be TupleCacheNodes
|
||||
// above this point. For debuggability, display this node's contribution to the
|
||||
// tuple cache key by printing its hash trace.
|
||||
//
|
||||
// Print trace in chunks to avoid excessive wrapping and padding in impala-shell.
|
||||
// There are other explain lines at VERBOSE level that are over 100 chars long so
|
||||
// we limit the key chunk length similarly here.
|
||||
expBuilder.append(detailPrefix + "tuple cache key: " +
|
||||
getTupleCacheInfo().getHashString() + "\n");
|
||||
expBuilder.append(detailPrefix + "tuple cache hash trace:\n");
|
||||
final int keyFormatWidth = 100;
|
||||
for (HashTraceElement elem : getTupleCacheInfo().getHashTraces()) {
|
||||
final String hashTrace = elem.getHashTrace();
|
||||
if (hashTrace.length() < keyFormatWidth) {
|
||||
expBuilder.append(String.format("%s %s: %s\n", detailPrefix,
|
||||
elem.getComment(), hashTrace));
|
||||
} else {
|
||||
expBuilder.append(String.format("%s %s:\n", detailPrefix,
|
||||
elem.getComment()));
|
||||
for (int idx = 0; idx < hashTrace.length(); idx += keyFormatWidth) {
|
||||
int stopIdx = Math.min(hashTrace.length(), idx + keyFormatWidth);
|
||||
expBuilder.append(String.format("%s [%s]\n", detailPrefix,
|
||||
hashTrace.substring(idx, stopIdx)));
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
// Print information about tuple caching if available
|
||||
if (getTupleCacheInfo() != null) {
|
||||
expBuilder.append(getTupleCacheInfo().getExplainString(detailPrefix, detailLevel));
|
||||
}
|
||||
|
||||
// Print the children. Do not traverse into the children of an Exchange node to
|
||||
|
||||
@@ -0,0 +1,31 @@
|
||||
// Licensed to the Apache Software Foundation (ASF) under one
|
||||
// or more contributor license agreements. See the NOTICE file
|
||||
// distributed with this work for additional information
|
||||
// regarding copyright ownership. The ASF licenses this file
|
||||
// to you under the Apache License, Version 2.0 (the
|
||||
// "License"); you may not use this file except in compliance
|
||||
// with the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing,
|
||||
// software distributed under the License is distributed on an
|
||||
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
// KIND, either express or implied. See the License for the
|
||||
// specific language governing permissions and limitations
|
||||
// under the License.
|
||||
|
||||
package org.apache.impala.planner;
|
||||
|
||||
import java.util.Set;
|
||||
|
||||
/**
|
||||
* The all_eligible tuple cache placement policy simply returns all the eligible
|
||||
* locations. This null policy is useful for correctness testing, because we want
|
||||
* to check correctness for all locations without regard for cost.
|
||||
*/
|
||||
public class TupleCacheAllEligiblePolicy implements TupleCachePlacementPolicy {
|
||||
public Set<PlanNode> getFinalCachingLocations(Set<PlanNode> eligibleLocations) {
|
||||
return eligibleLocations;
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,160 @@
|
||||
// Licensed to the Apache Software Foundation (ASF) under one
|
||||
// or more contributor license agreements. See the NOTICE file
|
||||
// distributed with this work for additional information
|
||||
// regarding copyright ownership. The ASF licenses this file
|
||||
// to you under the Apache License, Version 2.0 (the
|
||||
// "License"); you may not use this file except in compliance
|
||||
// with the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing,
|
||||
// software distributed under the License is distributed on an
|
||||
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
// KIND, either express or implied. See the License for the
|
||||
// specific language governing permissions and limitations
|
||||
// under the License.
|
||||
|
||||
package org.apache.impala.planner;
|
||||
|
||||
import java.util.Comparator;
|
||||
import java.util.HashSet;
|
||||
import java.util.PriorityQueue;
|
||||
import java.util.Set;
|
||||
|
||||
import com.google.common.base.Preconditions;
|
||||
import org.slf4j.Logger;
|
||||
import org.slf4j.LoggerFactory;
|
||||
|
||||
import org.apache.impala.thrift.TQueryOptions;
|
||||
|
||||
/**
|
||||
* The cost-based tuple cache placement policy uses the processing cost information
|
||||
* to try to pick the best locations. It has three parts:
|
||||
* 1. Threshold - Locations must meet a certain cost threshold to be considered. The
|
||||
* threshold is currently based on the ratio of the regular processing
|
||||
* cost versus the cost of reading from the cache. This ratio must exceed
|
||||
* the tuple_cache_required_cost_improvement_factor to be considered.
|
||||
* For example, if the tuple_cache_required_cost_improvement_factor is
|
||||
* 3.0, then the cost of reading from the cache must be 1/3rd the cost of
|
||||
* starting from scratch.
|
||||
* 2. Ranking - The locations that meet the threshold are ranked based on the
|
||||
* greatest cost improvement per byte.
|
||||
* 3. Budget - Locations are picked by the ranking order until the budget is reached.
|
||||
* Currently, the budget is based on the number of bytes per executor
|
||||
* set by the tuple_cache_budget_bytes_per_executor.
|
||||
*
|
||||
* The algorithm is fairly flexible, so the specific threshold, ranking, and budget
|
||||
* could be modified over time.
|
||||
*/
|
||||
public class TupleCacheCostBasedPolicy implements TupleCachePlacementPolicy {
|
||||
private final static Logger LOG =
|
||||
LoggerFactory.getLogger(TupleCacheCostBasedPolicy.class);
|
||||
|
||||
private class CostReductionPerByteComparator implements Comparator<PlanNode> {
|
||||
@Override
|
||||
public int compare(PlanNode n1, PlanNode n2) {
|
||||
Double n1_cost_density = computeCostReductionPerByte(n1);
|
||||
Double n2_cost_density = computeCostReductionPerByte(n2);
|
||||
// To order things such that the highest cost density comes first, we need to flip
|
||||
// the sign on the comparison.
|
||||
int result = -n1_cost_density.compareTo(n2_cost_density);
|
||||
if (result != 0) return result;
|
||||
// Two locations can have the same cost, so this uses the plan node id to break
|
||||
// ties to make it consistent.
|
||||
return n1.getId().asInt() - n2.getId().asInt();
|
||||
}
|
||||
}
|
||||
|
||||
private final Comparator<PlanNode> rankingComparator_;
|
||||
private final TQueryOptions queryOptions_;
|
||||
|
||||
public TupleCacheCostBasedPolicy(TQueryOptions queryOptions) {
|
||||
rankingComparator_ = new CostReductionPerByteComparator();
|
||||
queryOptions_ = queryOptions;
|
||||
}
|
||||
|
||||
private boolean meetsRequiredCostReductionFactor(PlanNode node) {
|
||||
long cumulativeProcessingCost =
|
||||
node.getTupleCacheInfo().getCumulativeProcessingCost();
|
||||
// To avoid division by zero and exotic floating point behavior, require the cache
|
||||
// read processing cost to be 1 or above.
|
||||
long cacheReadProcessingCost =
|
||||
Math.max(node.getTupleCacheInfo().getReadProcessingCost(), 1);
|
||||
double costReductionFactor =
|
||||
(double) cumulativeProcessingCost / cacheReadProcessingCost;
|
||||
double requiredCostReductionFactor =
|
||||
queryOptions_.tuple_cache_required_cost_reduction_factor;
|
||||
if (costReductionFactor < requiredCostReductionFactor) {
|
||||
LOG.trace(String.format("%s eliminated (cost reduction factor %f < threshold %f)",
|
||||
node.getDisplayLabel(), costReductionFactor, requiredCostReductionFactor));
|
||||
return false;
|
||||
}
|
||||
return true;
|
||||
}
|
||||
|
||||
private boolean meetsCostThresholds(PlanNode node) {
|
||||
// Filter out locations without statistics
|
||||
if (node.getTupleCacheInfo().getEstimatedSerializedSize() < 0) {
|
||||
LOG.trace(node.getDisplayLabel() + " eliminated due to missing statistics");
|
||||
return false;
|
||||
}
|
||||
// Filter out locations that exceed the budget. They can never be picked.
|
||||
long budget = queryOptions_.tuple_cache_budget_bytes_per_executor;
|
||||
long bytesPerExecutor = node.getTupleCacheInfo().getEstimatedSerializedSizePerNode();
|
||||
if (bytesPerExecutor > budget) {
|
||||
LOG.trace(String.format("%s eliminated (bytes per executor %d > budget %d)",
|
||||
node.getDisplayLabel(), bytesPerExecutor, budget));
|
||||
return false;
|
||||
}
|
||||
return meetsRequiredCostReductionFactor(node);
|
||||
}
|
||||
|
||||
private Double computeCostReductionPerByte(PlanNode node) {
|
||||
long cumulativeProcessingCost =
|
||||
node.getTupleCacheInfo().getCumulativeProcessingCost();
|
||||
long cacheReadProcessingCost = node.getTupleCacheInfo().getReadProcessingCost();
|
||||
long estimatedSerializedSize = node.getTupleCacheInfo().getEstimatedSerializedSize();
|
||||
long costReduction = cumulativeProcessingCost - cacheReadProcessingCost;
|
||||
// The estimated serialized size can be zero when the cardinality is zero. To keep
|
||||
// this from being infinite, increment the serialized size by one.
|
||||
return Double.valueOf((double) costReduction / (estimatedSerializedSize + 1));
|
||||
}
|
||||
|
||||
public Set<PlanNode> getFinalCachingLocations(Set<PlanNode> eligibleLocations) {
|
||||
Preconditions.checkState(eligibleLocations.size() > 0);
|
||||
PriorityQueue<PlanNode> sortedLocations =
|
||||
new PriorityQueue<PlanNode>(eligibleLocations.size(), rankingComparator_);
|
||||
for (PlanNode node : eligibleLocations) {
|
||||
if (meetsCostThresholds(node)) {
|
||||
sortedLocations.add(node);
|
||||
}
|
||||
}
|
||||
Set<PlanNode> finalLocations = new HashSet<PlanNode>();
|
||||
// We pick the best locations (by the sorting order) until we reach the budget. This
|
||||
// uses the bytes per executor as the units for the budget.
|
||||
long remainingBytesPerExecutorBudget =
|
||||
queryOptions_.tuple_cache_budget_bytes_per_executor;
|
||||
// This continues past a location that would exceed the budget. That allows
|
||||
// smaller locations later in the list to have a chance to fit in the
|
||||
// remaining budget. This also means that one large entry early in the list
|
||||
// won't block any other locations from being considered.
|
||||
while (sortedLocations.size() > 0) {
|
||||
PlanNode node = sortedLocations.poll();
|
||||
long curBytesPerExecutor =
|
||||
node.getTupleCacheInfo().getEstimatedSerializedSizePerNode();
|
||||
if (curBytesPerExecutor > remainingBytesPerExecutorBudget) {
|
||||
LOG.trace(String.format(
|
||||
"Skipped %s (bytes per executor: %d, remaining budget: %d)",
|
||||
node.getDisplayLabel(), curBytesPerExecutor,
|
||||
remainingBytesPerExecutorBudget));
|
||||
continue;
|
||||
}
|
||||
LOG.trace(String.format("Picked %s (bytes per executor: %d, remaining budget: %d)",
|
||||
node.getDisplayLabel(), curBytesPerExecutor, remainingBytesPerExecutorBudget));
|
||||
finalLocations.add(node);
|
||||
remainingBytesPerExecutorBudget -= curBytesPerExecutor;
|
||||
}
|
||||
return finalLocations;
|
||||
}
|
||||
}
|
||||
@@ -36,6 +36,7 @@ import org.apache.impala.catalog.FeView;
|
||||
import org.apache.impala.common.IdGenerator;
|
||||
import org.apache.impala.common.PrintUtils;
|
||||
import org.apache.impala.common.ThriftSerializationCtx;
|
||||
import org.apache.impala.service.BackendConfig;
|
||||
import org.apache.impala.thrift.TExplainLevel;
|
||||
import org.apache.impala.thrift.TFileSplitGeneratorSpec;
|
||||
import org.apache.impala.thrift.TScanRange;
|
||||
@@ -176,6 +177,16 @@ public class TupleCacheInfo {
|
||||
// the filtered cardinality.
|
||||
private long estimatedSerializedSize_ = -1;
|
||||
|
||||
// Estimated size divided by the expected number of nodes. This is used by the cost
|
||||
// based placement for the budget contribution.
|
||||
private long estimatedSerializedSizePerNode_ = -1;
|
||||
|
||||
// Processing cost for writing this location to the cache
|
||||
private long writeProcessingCost_ = -1;
|
||||
|
||||
// Processing cost for reading this location from the cache
|
||||
private long readProcessingCost_ = -1;
|
||||
|
||||
public TupleCacheInfo(DescriptorTable descTbl) {
|
||||
ineligibilityReasons_ = EnumSet.noneOf(IneligibilityReason.class);
|
||||
descriptorTable_ = descTbl;
|
||||
@@ -205,16 +216,12 @@ public class TupleCacheInfo {
|
||||
}
|
||||
|
||||
public String getHashString() {
|
||||
Preconditions.checkState(isEligible(),
|
||||
"TupleCacheInfo only has a hash if it is cache eligible");
|
||||
Preconditions.checkState(finalized_, "TupleCacheInfo not finalized");
|
||||
checkFinalizedAndEligible("a hash");
|
||||
return finalizedHashString_;
|
||||
}
|
||||
|
||||
public List<HashTraceElement> getHashTraces() {
|
||||
Preconditions.checkState(isEligible(),
|
||||
"TupleCacheInfo only has a hash trace if it is cache eligible");
|
||||
Preconditions.checkState(finalized_, "TupleCacheInfo not finalized");
|
||||
checkFinalizedAndEligible("a hash trace");
|
||||
return hashTraces_;
|
||||
}
|
||||
|
||||
@@ -232,19 +239,36 @@ public class TupleCacheInfo {
|
||||
}
|
||||
|
||||
public long getCumulativeProcessingCost() {
|
||||
Preconditions.checkState(isEligible(),
|
||||
"TupleCacheInfo only has cost information if it is cache eligible.");
|
||||
Preconditions.checkState(finalized_, "TupleCacheInfo not finalized");
|
||||
checkFinalizedAndEligible("cost information");
|
||||
return cumulativeProcessingCost_;
|
||||
}
|
||||
|
||||
public long getEstimatedSerializedSize() {
|
||||
Preconditions.checkState(isEligible(),
|
||||
"TupleCacheInfo only has cost information if it is cache eligible.");
|
||||
Preconditions.checkState(finalized_, "TupleCacheInfo not finalized");
|
||||
checkFinalizedAndEligible("cost information");
|
||||
return estimatedSerializedSize_;
|
||||
}
|
||||
|
||||
public long getEstimatedSerializedSizePerNode() {
|
||||
checkFinalizedAndEligible("cost information");
|
||||
return estimatedSerializedSizePerNode_;
|
||||
}
|
||||
|
||||
public long getWriteProcessingCost() {
|
||||
checkFinalizedAndEligible("cost information");
|
||||
return writeProcessingCost_;
|
||||
}
|
||||
|
||||
public long getReadProcessingCost() {
|
||||
checkFinalizedAndEligible("cost information");
|
||||
return readProcessingCost_;
|
||||
}
|
||||
|
||||
private void checkFinalizedAndEligible(String contextString) {
|
||||
Preconditions.checkState(isEligible(),
|
||||
"TupleCacheInfo only has %s if it is cache eligible.", contextString);
|
||||
Preconditions.checkState(finalized_, "TupleCacheInfo not finalized");
|
||||
}
|
||||
|
||||
/**
|
||||
* Calculate the tuple cache cost information for this plan node. This must be called
|
||||
* with the matching PlanNode for this TupleCacheInfo. This pulls in any information
|
||||
@@ -259,6 +283,8 @@ public class TupleCacheInfo {
|
||||
"TupleCacheInfo only calculates cost information if it is cache eligible.");
|
||||
Preconditions.checkState(thisPlanNode.getTupleCacheInfo() == this,
|
||||
"calculateCostInformation() must be called with its enclosing PlanNode");
|
||||
Preconditions.checkState(thisPlanNode.getNumNodes() > 0,
|
||||
"PlanNode fragment must have nodes");
|
||||
|
||||
// This was already called on our children, which are known to be eligible.
|
||||
// Pull in the information from our children.
|
||||
@@ -280,6 +306,23 @@ public class TupleCacheInfo {
|
||||
long cardinality = thisPlanNode.getFilteredCardinality();
|
||||
estimatedSerializedSize_ = (long) Math.round(
|
||||
ExchangeNode.getAvgSerializedRowSize(thisPlanNode) * cardinality);
|
||||
estimatedSerializedSizePerNode_ =
|
||||
(long) estimatedSerializedSize_ / thisPlanNode.getNumNodes();
|
||||
double costCoefficientWriteBytes =
|
||||
BackendConfig.INSTANCE.getTupleCacheCostCoefficientWriteBytes();
|
||||
double costCoefficientWriteRows =
|
||||
BackendConfig.INSTANCE.getTupleCacheCostCoefficientWriteRows();
|
||||
writeProcessingCost_ =
|
||||
(long) (estimatedSerializedSize_ * costCoefficientWriteBytes +
|
||||
cardinality * costCoefficientWriteRows);
|
||||
|
||||
double costCoefficientReadBytes =
|
||||
BackendConfig.INSTANCE.getTupleCacheCostCoefficientReadBytes();
|
||||
double costCoefficientReadRows =
|
||||
BackendConfig.INSTANCE.getTupleCacheCostCoefficientReadRows();
|
||||
readProcessingCost_ =
|
||||
(long) (estimatedSerializedSize_ * costCoefficientReadBytes +
|
||||
cardinality * costCoefficientReadRows);
|
||||
}
|
||||
}
|
||||
|
||||
@@ -561,6 +604,53 @@ public class TupleCacheInfo {
|
||||
return builder.toString();
|
||||
}
|
||||
|
||||
public String getExplainHashTrace(String detailPrefix) {
|
||||
StringBuilder output = new StringBuilder();
|
||||
final int keyFormatWidth = 100;
|
||||
for (HashTraceElement elem : getHashTraces()) {
|
||||
final String hashTrace = elem.getHashTrace();
|
||||
if (hashTrace.length() < keyFormatWidth) {
|
||||
output.append(String.format("%s %s: %s\n", detailPrefix, elem.getComment(),
|
||||
hashTrace));
|
||||
} else {
|
||||
output.append(String.format("%s %s:\n", detailPrefix, elem.getComment()));
|
||||
for (int idx = 0; idx < hashTrace.length(); idx += keyFormatWidth) {
|
||||
int stopIdx = Math.min(hashTrace.length(), idx + keyFormatWidth);
|
||||
output.append(String.format("%s [%s]\n", detailPrefix,
|
||||
hashTrace.substring(idx, stopIdx)));
|
||||
}
|
||||
}
|
||||
}
|
||||
return output.toString();
|
||||
}
|
||||
|
||||
public String getExplainString(String detailPrefix, TExplainLevel detailLevel) {
|
||||
if (detailLevel.ordinal() >= TExplainLevel.VERBOSE.ordinal()) {
|
||||
// At extended level, provide information about whether this location is
|
||||
// eligible. If it is, provide the cache key and cost information.
|
||||
StringBuilder output = new StringBuilder();
|
||||
if (isEligible()) {
|
||||
output.append(String.format("%stuple cache key: %s\n", detailPrefix,
|
||||
getHashString()));
|
||||
output.append(getCostExplainString(detailPrefix));
|
||||
// This PlanNode is eligible for tuple caching, so there may be TupleCacheNodes
|
||||
// above this point. For debuggability, display this node's contribution to the
|
||||
// tuple cache key by printing its hash trace.
|
||||
//
|
||||
// Print trace in chunks to avoid excessive wrapping and padding in impala-shell.
|
||||
// There are other explain lines at VERBOSE level that are over 100 chars long so
|
||||
// we limit the key chunk length similarly here.
|
||||
output.append(getExplainHashTrace(detailPrefix));
|
||||
} else {
|
||||
output.append(String.format("%stuple cache ineligibility reasons: %s\n",
|
||||
detailPrefix, getIneligibilityReasonsString()));
|
||||
}
|
||||
return output.toString();
|
||||
} else {
|
||||
return "";
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* Produce explain output describing the cost information for this tuple cache location
|
||||
*/
|
||||
@@ -573,9 +663,22 @@ public class TupleCacheInfo {
|
||||
output.append("unavailable");
|
||||
}
|
||||
output.append("\n");
|
||||
output.append(detailPrefix + "estimated serialized size per node: ");
|
||||
if (estimatedSerializedSizePerNode_ > -1) {
|
||||
output.append(PrintUtils.printBytes(estimatedSerializedSizePerNode_));
|
||||
} else {
|
||||
output.append("unavailable");
|
||||
}
|
||||
output.append("\n");
|
||||
output.append(detailPrefix + "cumulative processing cost: ");
|
||||
output.append(getCumulativeProcessingCost());
|
||||
output.append("\n");
|
||||
output.append(detailPrefix + "cache read processing cost: ");
|
||||
output.append(getReadProcessingCost());
|
||||
output.append("\n");
|
||||
output.append(detailPrefix + "cache write processing cost: ");
|
||||
output.append(getWriteProcessingCost());
|
||||
output.append("\n");
|
||||
return output.toString();
|
||||
}
|
||||
|
||||
|
||||
@@ -0,0 +1,32 @@
|
||||
// Licensed to the Apache Software Foundation (ASF) under one
|
||||
// or more contributor license agreements. See the NOTICE file
|
||||
// distributed with this work for additional information
|
||||
// regarding copyright ownership. The ASF licenses this file
|
||||
// to you under the Apache License, Version 2.0 (the
|
||||
// "License"); you may not use this file except in compliance
|
||||
// with the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing,
|
||||
// software distributed under the License is distributed on an
|
||||
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
// KIND, either express or implied. See the License for the
|
||||
// specific language governing permissions and limitations
|
||||
// under the License.
|
||||
|
||||
package org.apache.impala.planner;
|
||||
|
||||
import java.util.Set;
|
||||
|
||||
/**
|
||||
* Shared interface for all tuple cache placement policies.
|
||||
*/
|
||||
public interface TupleCachePlacementPolicy {
|
||||
|
||||
/**
|
||||
* Given a set of eligible locations, return a set of locations that should actually
|
||||
* be used. The return set must be a subset of the eligible locations passed in.
|
||||
*/
|
||||
public Set<PlanNode> getFinalCachingLocations(Set<PlanNode> eligibleLocations);
|
||||
}
|
||||
@@ -17,10 +17,13 @@
|
||||
|
||||
package org.apache.impala.planner;
|
||||
|
||||
import java.util.HashSet;
|
||||
import java.util.List;
|
||||
import java.util.Set;
|
||||
|
||||
import org.apache.impala.common.ImpalaException;
|
||||
import org.apache.impala.thrift.TQueryOptions;
|
||||
import org.apache.impala.thrift.TTupleCachePlacementPolicy;
|
||||
import org.slf4j.Logger;
|
||||
import org.slf4j.LoggerFactory;
|
||||
|
||||
@@ -32,16 +35,34 @@ import com.google.common.base.Preconditions;
|
||||
* the plan tree be in a stable form that won't later change. That means that this is
|
||||
* designed to run as the last step in planning.
|
||||
*
|
||||
* The current algorithm is to add a TupleCacheNode at every eligible location. This will
|
||||
* need to be refined with cost calculations later.
|
||||
* The cache placement algorithm is controlled by the 'tuple_cache_placement_policy' query
|
||||
* option. See descriptions of these policies at {@link TupleCacheAllEligiblePolicy} and
|
||||
* {@link TupleCacheCostBasedPolicy}.
|
||||
*/
|
||||
public class TupleCachePlanner {
|
||||
private final static Logger LOG = LoggerFactory.getLogger(TupleCachePlanner.class);
|
||||
|
||||
private final PlannerContext ctx_;
|
||||
private final TQueryOptions queryOptions_;
|
||||
private final TupleCachePlacementPolicy placementPolicy_;
|
||||
|
||||
public TupleCachePlanner(PlannerContext ctx) {
|
||||
ctx_ = ctx;
|
||||
queryOptions_ =
|
||||
ctx_.getRootAnalyzer().getQueryCtx().client_request.getQuery_options();
|
||||
TTupleCachePlacementPolicy policy = queryOptions_.getTuple_cache_placement_policy();
|
||||
LOG.info("Using tuple cache placement policy: " + policy);
|
||||
switch (policy) {
|
||||
case ALL_ELIGIBLE:
|
||||
placementPolicy_ = new TupleCacheAllEligiblePolicy();
|
||||
break;
|
||||
case COST_BASED:
|
||||
placementPolicy_ = new TupleCacheCostBasedPolicy(queryOptions_);
|
||||
break;
|
||||
default:
|
||||
Preconditions.checkState(false, "Unexpected placement policy: " + policy);
|
||||
placementPolicy_ = null;
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
@@ -56,8 +77,25 @@ public class TupleCachePlanner {
|
||||
root.computeTupleCacheInfo(ctx_.getRootAnalyzer().getDescTbl(),
|
||||
ctx_.getRootAnalyzer().getQueryCtx().query_options_result_hash);
|
||||
|
||||
// Step 2: Build up the new PlanNode tree with TupleCacheNodes added
|
||||
PlanNode newRoot = buildCachingPlan(root);
|
||||
// Step 2: Collect eligible locations
|
||||
Set<PlanNode> eligibleLocations = new HashSet<PlanNode>();
|
||||
root.collectAll(
|
||||
(node) -> {
|
||||
return node.getTupleCacheInfo().isEligible() && !node.omitTupleCache();
|
||||
}, eligibleLocations);
|
||||
|
||||
// If there are no eligible locations, we're done
|
||||
if (eligibleLocations.size() == 0) {
|
||||
return plan;
|
||||
}
|
||||
|
||||
// Step 3: Use the placement policy to compute the final locations
|
||||
Set<PlanNode> finalLocations =
|
||||
placementPolicy_.getFinalCachingLocations(eligibleLocations);
|
||||
|
||||
// Step 4: Build up the new PlanNode tree with TupleCacheNodes added in the specified
|
||||
// locations
|
||||
PlanNode newRoot = buildCachingPlan(root, finalLocations);
|
||||
// Since buildCachingPlan is modifying things in place, verify that the top-most plan
|
||||
// fragment's plan root matches with the newRoot returned.
|
||||
Preconditions.checkState(plan.get(0).getPlanRoot() == newRoot);
|
||||
@@ -71,35 +109,29 @@ public class TupleCachePlanner {
|
||||
/**
|
||||
* Add TupleCacheNodes at every eligible location via a bottom-up traversal of the tree.
|
||||
*/
|
||||
private PlanNode buildCachingPlan(PlanNode node) throws ImpalaException {
|
||||
private PlanNode buildCachingPlan(PlanNode node, Set<PlanNode> locations)
|
||||
throws ImpalaException {
|
||||
// Recurse through the children applying the caching policy
|
||||
for (int i = 0; i < node.getChildCount(); i++) {
|
||||
node.setChild(i, buildCachingPlan(node.getChild(i)));
|
||||
node.setChild(i, buildCachingPlan(node.getChild(i), locations));
|
||||
}
|
||||
|
||||
// If this node is not eligible, then we are done
|
||||
if (!node.getTupleCacheInfo().isEligible()) {
|
||||
// If this node is not in the list of caching locations, then we are done.
|
||||
if (!locations.contains(node)) {
|
||||
return node;
|
||||
}
|
||||
|
||||
// If node omits tuple cache placement - such as Exchange and Union nodes, where it
|
||||
// would not be beneficial - skip it.
|
||||
if (node.omitTupleCache()) {
|
||||
return node;
|
||||
}
|
||||
// Locations that are not eligible were already filtered out by the collection phase
|
||||
Preconditions.checkState(
|
||||
node.getTupleCacheInfo().isEligible() && !node.omitTupleCache(),
|
||||
"Final location must be eligible");
|
||||
|
||||
// Should we cache above this node?
|
||||
// Simplest policy: always cache if eligible
|
||||
// TODO: Make this more complicated (e.g. cost calculations)
|
||||
if (LOG.isTraceEnabled()) {
|
||||
LOG.trace("Adding TupleCacheNode above node " + node.getId().toString());
|
||||
}
|
||||
// Get current query options
|
||||
TQueryOptions queryOptions =
|
||||
ctx_.getRootAnalyzer().getQueryCtx().client_request.getQuery_options();
|
||||
// Allocate TupleCacheNode
|
||||
TupleCacheNode tupleCacheNode = new TupleCacheNode(ctx_.getNextNodeId(), node,
|
||||
queryOptions.isEnable_tuple_cache_verification());
|
||||
queryOptions_.isEnable_tuple_cache_verification());
|
||||
tupleCacheNode.init(ctx_.getRootAnalyzer());
|
||||
PlanFragment curFragment = node.getFragment();
|
||||
if (node == curFragment.getPlanRoot()) {
|
||||
|
||||
@@ -597,4 +597,20 @@ public class BackendConfig {
|
||||
public boolean truncateExternalTablesWithHms() {
|
||||
return backendCfg_.truncate_external_tables_with_hms;
|
||||
}
|
||||
|
||||
public double getTupleCacheCostCoefficientWriteBytes() {
|
||||
return backendCfg_.tuple_cache_cost_coefficient_write_bytes;
|
||||
}
|
||||
|
||||
public double getTupleCacheCostCoefficientWriteRows() {
|
||||
return backendCfg_.tuple_cache_cost_coefficient_write_rows;
|
||||
}
|
||||
|
||||
public double getTupleCacheCostCoefficientReadBytes() {
|
||||
return backendCfg_.tuple_cache_cost_coefficient_read_bytes;
|
||||
}
|
||||
|
||||
public double getTupleCacheCostCoefficientReadRows() {
|
||||
return backendCfg_.tuple_cache_cost_coefficient_read_rows;
|
||||
}
|
||||
}
|
||||
|
||||
@@ -0,0 +1,719 @@
|
||||
// Licensed to the Apache Software Foundation (ASF) under one
|
||||
// or more contributor license agreements. See the NOTICE file
|
||||
// distributed with this work for additional information
|
||||
// regarding copyright ownership. The ASF licenses this file
|
||||
// to you under the Apache License, Version 2.0 (the
|
||||
// "License"); you may not use this file except in compliance
|
||||
// with the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing,
|
||||
// software distributed under the License is distributed on an
|
||||
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
// KIND, either express or implied. See the License for the
|
||||
// specific language governing permissions and limitations
|
||||
// under the License.
|
||||
|
||||
package org.apache.impala.planner;
|
||||
|
||||
import com.google.common.collect.Sets;
|
||||
import com.google.common.io.Files;
|
||||
|
||||
import org.apache.impala.catalog.SideloadTableStats;
|
||||
import org.apache.impala.common.ByteUnits;
|
||||
import org.apache.impala.common.RuntimeEnv;
|
||||
import org.apache.impala.thrift.TExecutorGroupSet;
|
||||
import org.apache.impala.thrift.TQueryOptions;
|
||||
import org.apache.impala.thrift.TReplicaPreference;
|
||||
import org.apache.impala.thrift.TSlotCountStrategy;
|
||||
import org.apache.impala.thrift.TUpdateExecutorMembershipRequest;
|
||||
import org.apache.impala.util.ExecutorMembershipSnapshot;
|
||||
import org.apache.impala.util.RequestPoolService;
|
||||
import org.junit.AfterClass;
|
||||
import org.junit.BeforeClass;
|
||||
import org.junit.Test;
|
||||
import org.junit.rules.TemporaryFolder;
|
||||
|
||||
import java.io.File;
|
||||
import java.io.IOException;
|
||||
import java.net.URISyntaxException;
|
||||
import java.nio.file.Paths;
|
||||
import java.util.ArrayList;
|
||||
import java.util.HashMap;
|
||||
import java.util.Map;
|
||||
import java.util.Set;
|
||||
|
||||
/**
|
||||
* This tests cost-based tuple cache placement for TPC-DS using the same setup as
|
||||
* TpcdsCpuCostPlannerTest, with a simulated 1TB scale and COMPUTE_PROCESSING_COST
|
||||
* option enabled.
|
||||
*/
|
||||
public class TpcdsTupleCachePlannerTest extends PlannerTestBase {
|
||||
// Pool definitions and includes memory resource limits, copied to a temporary file
|
||||
private static final String ALLOCATION_FILE = "fair-scheduler-3-groups.xml";
|
||||
|
||||
// Contains per-pool configurations for maximum number of running queries and queued
|
||||
// requests.
|
||||
private static final String LLAMA_CONFIG_FILE = "llama-site-3-groups.xml";
|
||||
|
||||
// Planner test option to run each planner test.
|
||||
private static Set<PlannerTestOption> testOptions = tpcdsParquetTestOptions();
|
||||
|
||||
// Query option to run each planner test.
|
||||
private static TQueryOptions options =
|
||||
tpcdsParquetQueryOptions()
|
||||
.setCompute_processing_cost(true)
|
||||
.setMax_fragment_instances_per_node(12)
|
||||
.setReplica_preference(TReplicaPreference.REMOTE)
|
||||
.setSlot_count_strategy(TSlotCountStrategy.PLANNER_CPU_ASK)
|
||||
.setMem_estimate_scale_for_spilling_operator(1.0)
|
||||
.setPlanner_testcase_mode(true)
|
||||
// Required so that output doesn't vary by whether scanned tables have stats &
|
||||
// numRows property or not.
|
||||
.setDisable_hdfs_num_rows_estimate(true)
|
||||
.setEnable_tuple_cache(true);
|
||||
|
||||
// Database name to run this test.
|
||||
private static String testDb = "tpcds_partitioned_parquet_snap";
|
||||
|
||||
// Map of table stats that is obtained through loadStatsJson().
|
||||
private static Map<String, Map<String, SideloadTableStats>> sideloadStats;
|
||||
|
||||
// Granular scan limit that will injected into individual ScanNode of tables.
|
||||
private static Map<String, Long> scanRangeLimit = new HashMap<String, Long>() {
|
||||
{
|
||||
// split a 5752989 bytes file to 10 ranges.
|
||||
put("customer", 580 * ByteUnits.KILOBYTE);
|
||||
// split a 1218792 bytes file to 10 ranges.
|
||||
put("customer_address", 125 * ByteUnits.KILOBYTE);
|
||||
// split a 7848768 bytes file to 10 ranges.
|
||||
put("customer_demographics", 790 * ByteUnits.KILOBYTE);
|
||||
// split a 1815300 bytes file to 4 ranges.
|
||||
put("item", 500L * ByteUnits.KILOBYTE);
|
||||
}
|
||||
};
|
||||
|
||||
// Temporary folder to copy admission control files into.
|
||||
// Do not annotate with JUnit @Rule because we want to keep the tempFolder the same
|
||||
// for entire lifetime of test class.
|
||||
private static TemporaryFolder tempFolder;
|
||||
|
||||
/**
|
||||
* Returns a {@link File} for the file on the classpath.
|
||||
*/
|
||||
private static File getClasspathFile(String filename) throws URISyntaxException {
|
||||
return new File(
|
||||
TpcdsCpuCostPlannerTest.class.getClassLoader().getResource(filename).toURI());
|
||||
}
|
||||
|
||||
private static void setupAdmissionControl() throws IOException, URISyntaxException {
|
||||
// Start admission control with config file fair-scheduler-3-groups.xml
|
||||
// and llama-site-3-groups.xml
|
||||
tempFolder = new TemporaryFolder();
|
||||
tempFolder.create();
|
||||
File allocationConfFile = tempFolder.newFile(ALLOCATION_FILE);
|
||||
Files.copy(getClasspathFile(ALLOCATION_FILE), allocationConfFile);
|
||||
|
||||
File llamaConfFile = tempFolder.newFile(LLAMA_CONFIG_FILE);
|
||||
Files.copy(getClasspathFile(LLAMA_CONFIG_FILE), llamaConfFile);
|
||||
// Intentionally mark isTest = false to cache poolService as a singleton.
|
||||
RequestPoolService poolService =
|
||||
RequestPoolService.getInstance(allocationConfFile.getAbsolutePath(),
|
||||
llamaConfFile.getAbsolutePath(), /* isTest */ false);
|
||||
poolService.start();
|
||||
}
|
||||
|
||||
@BeforeClass
|
||||
public static void setUp() throws Exception {
|
||||
// Mimic the 10 node test mini-cluster with admission control enabled.
|
||||
setupAdmissionControl();
|
||||
// Add 10 node executor group set root.large. This group set also set with
|
||||
// impala.admission-control.max-query-mem-limit.root.large = 50GB.
|
||||
setUpTestCluster(10, 10, "root.large");
|
||||
setUpKuduClientAndLogDir();
|
||||
Paths.get(outDir_.toString(), "tpcds_tuple_cache").toFile().mkdirs();
|
||||
|
||||
// Sideload stats through RuntimeEnv.
|
||||
RuntimeEnv.INSTANCE.setTestEnv(true);
|
||||
sideloadStats = loadStatsJson("tpcds_cpu_cost/stats-3TB.json");
|
||||
RuntimeEnv.INSTANCE.setSideloadStats(sideloadStats);
|
||||
|
||||
// Artificially split single file table into mutiple scan ranges so that the scan
|
||||
// looks like a multi-files table.
|
||||
for (Map.Entry<String, Long> entry : scanRangeLimit.entrySet()) {
|
||||
RuntimeEnv.INSTANCE.addTableScanRangeLimit(
|
||||
testDb, entry.getKey(), entry.getValue());
|
||||
}
|
||||
invalidateTables();
|
||||
}
|
||||
|
||||
@AfterClass
|
||||
public static void unsetMetadataScaleAndStopPoolService() {
|
||||
RuntimeEnv.INSTANCE.dropSideloadStats();
|
||||
RuntimeEnv.INSTANCE.dropTableScanRangeLimit();
|
||||
invalidateTables();
|
||||
|
||||
RequestPoolService.getInstance().stop();
|
||||
tempFolder.delete();
|
||||
}
|
||||
|
||||
/**
|
||||
* Invalidate tables to reload them with new stats.
|
||||
*/
|
||||
private static void invalidateTables() {
|
||||
for (String db : sideloadStats.keySet()) {
|
||||
for (String table : sideloadStats.get(db).keySet()) {
|
||||
catalog_.getSrcCatalog().invalidateTableIfExists(testDb, table);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ1() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q01", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ2() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q02", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ3() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q03", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ4() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q04", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ5() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q05", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ6() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q06", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ7() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q07", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ8() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q08", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ9() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q09", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ10() {
|
||||
// This is an official variant of q10 that uses a rewrite for lack of support for
|
||||
// multiple subqueries in disjunctive predicates.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q10a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ11() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q11", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ12() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q12", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ13() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q13", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ14a() {
|
||||
// First of the two query statements from the official q14.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q14a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ14b() {
|
||||
// Second of the two query statements from the official q14.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q14b", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ15() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q15", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ16() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q16", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ17() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q17", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ18() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q18", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ19() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q19", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ20() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q20", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ21() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q21", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ22() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q22", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ23a() {
|
||||
// First of the two query statements from the official q23.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q23a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ23b() {
|
||||
// Second of the two query statements from the official q23.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q23b", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ24a() {
|
||||
// First of the two query statements from the official q24.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q24a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ24b() {
|
||||
// Second of the two query statements from the official q24.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q24b", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ25() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q25", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ26() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q26", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ27() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q27", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ28() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q28", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ29() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q29", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ30() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q30", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ31() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q31", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ32() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q32", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ33() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q33", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ34() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q34", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ35() {
|
||||
// This is an official variant of q35 that uses a rewrite for lack of support for
|
||||
// multiple subqueries in disjunctive predicates.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q35a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ36() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q36", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ37() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q37", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ38() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q38", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ39a() {
|
||||
// First of the two query statements from the official q39.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q39a", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ39b() {
|
||||
// Second of the two query statements from the official q39.
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q39b", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ40() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q40", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ41() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q41", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ42() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q42", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ43() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q43", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ44() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q44", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ45() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q45", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ46() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q46", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ47() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q47", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ48() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q48", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ49() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q49", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ50() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q50", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ51() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q51", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ52() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q52", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ53() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q53", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ54() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q54", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ55() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q55", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ56() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q56", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ57() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q57", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ58() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q58", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ59() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q59", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ60() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q60", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ61() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q61", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ62() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q62", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ63() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q63", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ64() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q64", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ65() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q65", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ66() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q66", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ67() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q67", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ68() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q68", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ69() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q69", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ70() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q70", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ71() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q71", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ72() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q72", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ73() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q73", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ74() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q74", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ75() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q75", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ76() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q76", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ77() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q77", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ78() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q78", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ79() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q79", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ80() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q80", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ81() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q81", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ82() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q82", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ83() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q83", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ84() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q84", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ85() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q85", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ86() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q86", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ87() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q87", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ88() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q88", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ89() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q89", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ90() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q90", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ91() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q91", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ92() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q92", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ93() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q93", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ94() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q94", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ95() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q95", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ96() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q96", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ97() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q97", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ98() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q98", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testQ99() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-q99", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testNonTpcdsDdl() {
|
||||
// This is a copy of PlannerTest.testDdl().
|
||||
// Not using tpcds_partitioned_parquet_snap db, but piggy-backed to test them
|
||||
// under costing setup.
|
||||
runPlannerTestFile("tpcds_tuple_cache/ddl", testDb, options, testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testTpcdsDdlParquet() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-ddl-parquet", testDb, options,
|
||||
testOptions);
|
||||
}
|
||||
|
||||
@Test
|
||||
public void testTpcdsDdlIceberg() {
|
||||
runPlannerTestFile("tpcds_tuple_cache/tpcds-ddl-iceberg", testDb, options,
|
||||
testOptions);
|
||||
}
|
||||
|
||||
}
|
||||
@@ -224,9 +224,14 @@ public class TestUtils {
|
||||
static IgnoreValueFilter SCAN_RANGE_ROW_COUNT_FILTER =
|
||||
new IgnoreValueFilter("max-scan-range-rows", PrintUtils.METRIC_REGEX);
|
||||
|
||||
// Ignore the tuple cache key, as it can vary across different dataloads
|
||||
static IgnoreValueFilter TUPLE_CACHE_KEY_FILTER =
|
||||
new IgnoreValueFilter("cache key", " \\S+", ':');
|
||||
|
||||
// Filters that are always applied
|
||||
private static final List<ResultFilter> DEFAULT_FILTERS = Arrays.<ResultFilter>asList(
|
||||
SCAN_RANGE_ROW_COUNT_FILTER, new PathFilter("hdfs:"), new PathFilter("file: "));
|
||||
SCAN_RANGE_ROW_COUNT_FILTER, TUPLE_CACHE_KEY_FILTER, new PathFilter("hdfs:"),
|
||||
new PathFilter("file: "));
|
||||
|
||||
// Filters that ignore the values of resource requirements that appear in
|
||||
// "EXTENDED" and above explain plans.
|
||||
|
||||
1161
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/ddl.test
vendored
Normal file
1161
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/ddl.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-ddl-iceberg.test
vendored
Normal file
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-ddl-iceberg.test
vendored
Normal file
@@ -0,0 +1,796 @@
|
||||
# Unpartitioned insert.
|
||||
create table store_sales_unpartitioned
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=96.00MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=193MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=8.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[108991552732]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned, OVERWRITE=false]
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=97047706322
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Unpartitioned insert with less than 256MB estimated data to write.
|
||||
create table store_sales_unpartitioned_small
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 2450816
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=176.00KB Threads=1
|
||||
Per-Host Resource Estimates: Memory=16MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=176.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[40845904]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_small, OVERWRITE=false]
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=36802982
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(2450816 AS INT)
|
||||
HDFS partitions=1/1824 files=1 size=218.89MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1/1 rows=2.92M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=8.64G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=2.92M cost=4042922
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Unpartitioned insert with writer & scan instances < maximum allowed (120).
|
||||
# Cost-wise, scanner only need 40 instances, but writer need 88 instances.
|
||||
create table store_sales_unpartitioned_medium
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450910
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.55MB Threads=9
|
||||
Per-Host Resource Estimates: Memory=145MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=88
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=176.00KB thread-reservation=1
|
||||
| max-parallelism=88 segment-costs=[3108264904]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_medium, OVERWRITE=false]
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=2768066475
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450910 AS INT)
|
||||
HDFS partitions=93/1824 files=93 size=19.88GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 93/93 rows=246.09M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=119.03M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=246.09M cost=340198429
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Same unpartitioned insert as before, but with low MAX_FS_WRITERS.
|
||||
create table store_sales_unpartitioned_medium
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450910
|
||||
---- QUERYOPTIONS
|
||||
MAX_FS_WRITERS=20
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.72MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=276MB
|
||||
F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20
|
||||
| Per-Instance Resources: mem-estimate=19.18MB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[2904081862]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_medium, OVERWRITE=false]
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=2768066475
|
||||
|
|
||||
01:EXCHANGE [RANDOM]
|
||||
| mem-estimate=19.08MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=246.09M cost=136015387
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=93
|
||||
Per-Instance Resources: mem-estimate=23.81MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=93 segment-costs=[1988428320]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450910 AS INT)
|
||||
HDFS partitions=93/1824 files=93 size=19.88GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 93/93 rows=246.09M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=119.03M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=246.09M cost=340198429
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, just like the original table.
|
||||
create table store_sales_duplicate partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=168.00MB Threads=24
|
||||
Per-Host Resource Estimates: Memory=50.99GB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=4.19GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[44372981821, 97047706322]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_duplicate, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=97047706322
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=4.17GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=8.64G cost=39597689640
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=21.72MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=8.64G cost=4775292181
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=62.88MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[69810676358]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but limit at 5 rows.
|
||||
create table store_sales_5_rows partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
limit 5
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=14.00MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=22MB
|
||||
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.02MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[24, 3954291]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_5_rows, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=480B mem-reservation=0B thread-reservation=0 cost=3954291
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=5 cost=22
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [UNPARTITIONED]
|
||||
| limit: 5
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=5 cost=2
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.39MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[39]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
limit: 5
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=5 cost=6
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but have only 1 row per partition.
|
||||
create table store_sales_1_row_per_part partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select count(*), ss_sold_date_sk
|
||||
from store_sales group by ss_sold_date_sk
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=14.06MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=47MB
|
||||
F01:PLAN FRAGMENT [HASH(ss_sold_date_sk)] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.00MB mem-reservation=7.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[5592, 1694, 3956795] cpu-comparison-result=10 [max(10 (self) vs 10 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_row_per_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: count(*), ss_sold_date_sk
|
||||
| mem-estimate=2.13KB mem-reservation=0B thread-reservation=0 cost=3956795
|
||||
|
|
||||
04:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.82K cost=1694
|
||||
| in pipelines: 04(GETNEXT), 03(OPEN)
|
||||
|
|
||||
03:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: ss_sold_date_sk
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=5289
|
||||
| in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:EXCHANGE [HASH(ss_sold_date_sk)]
|
||||
| mem-estimate=162.14KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=303
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=30.62MB mem-reservation=6.12MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[5604, 2349]
|
||||
05:TUPLE CACHE
|
||||
| cache key: 0f28ed31aa6856c81f1e044cb23ef2d3
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 28.50KB
|
||||
| estimated serialized size per node: 2.85KB
|
||||
| cumulative processing cost: 5604
|
||||
| cache read processing cost: 242
|
||||
| cache write processing cost: 78
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
01:AGGREGATE [STREAMING]
|
||||
| output: sum_init_zero(tpcds_partitioned_parquet_snap.store_sales.stats: num_rows)
|
||||
| group by: ss_sold_date_sk
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=5289
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=1.82K cost=315
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but have insert 5 partition and 1 row per partition.
|
||||
create table store_sales_5_part_1_row_per_part partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select count(*), ss_store_sk, ss_sold_date_sk
|
||||
from store_sales group by ss_store_sk, ss_sold_date_sk
|
||||
limit 5
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=470.62MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=701MB
|
||||
F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.02MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[5, 3954244] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_5_part_1_row_per_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: count(*), ss_store_sk, ss_sold_date_sk
|
||||
| mem-estimate=80B mem-reservation=0B thread-reservation=0 cost=3954244
|
||||
|
|
||||
05:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=16B cardinality=5 cost=5
|
||||
| in pipelines: 05(GETNEXT), 03(OPEN)
|
||||
|
|
||||
04:EXCHANGE [UNPARTITIONED]
|
||||
| limit: 5
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=5 cost=0
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
F01:PLAN FRAGMENT [HASH(ss_store_sk,ss_sold_date_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=22.34MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[228190932, 7] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))]
|
||||
03:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: ss_store_sk, ss_sold_date_sk
|
||||
| limit: 5
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=5 cost=201792013
|
||||
| in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:EXCHANGE [HASH(ss_store_sk,ss_sold_date_sk)]
|
||||
| mem-estimate=12.34MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=142.93M cost=26398919
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=52.34MB mem-reservation=38.00MB thread-reservation=1
|
||||
max-parallelism=1360 segment-costs=[13514707828, 220910505]
|
||||
01:AGGREGATE [STREAMING]
|
||||
| output: count(*)
|
||||
| group by: ss_store_sk, ss_sold_date_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=142.93M cost=12519387294
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=8B cardinality=8.64G cost=995320534
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Number of partition & scan instances < maximum allowed (120).
|
||||
create table store_sales_83_part partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450900
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=49.55MB Threads=17
|
||||
Per-Host Resource Estimates: Memory=2.56GB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=10 instances=78
|
||||
| Per-Instance Resources: mem-estimate=274.87MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=78 segment-costs=[1123464765, 2460972835]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_83_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=2460972835
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=256.76MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=218.75M cost=1002560725
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=18.11MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=218.75M cost=120904040
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=83
|
||||
Per-Instance Resources: mem-estimate=46.47MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=83 segment-costs=[1767513380]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450900 AS INT)
|
||||
HDFS partitions=83/1824 files=83 size=17.74GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 83/83 rows=218.75M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=133.91M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=218.75M cost=302402289
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Number of partition & scan instances < num executors.
|
||||
create table store_sales_4_part partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450820
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.17MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=287MB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=269.22MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[58077317, 130969386]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_4_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=130969386
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=258.83MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=11.31M cost=51827204
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=10.39MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=11.31M cost=6250113
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=17.56MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[91371298]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450820 AS INT)
|
||||
HDFS partitions=4/1824 files=4 size=875.57MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 4/4 rows=11.31M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=2.61G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=11.31M cost=15632634
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1.
|
||||
# There should be no shuffling.
|
||||
create table store_sales_1_part partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 2450816
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.17MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=284MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=283.75MB mem-reservation=6.17MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[17446509, 36802982]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=36802982
|
||||
|
|
||||
01:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=267.75MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=2.92M cost=13403587
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(2450816 AS INT)
|
||||
HDFS partitions=1/1824 files=1 size=218.89MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1/1 rows=2.92M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=8.64G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=2.92M cost=4042922
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1 with large number of rows.
|
||||
# NDV(ca_country) = 1
|
||||
# There should be no shuffling.
|
||||
create table customer_address_1_huge_part partitioned by (part_col)
|
||||
stored as iceberg as
|
||||
select a.*, a.ca_country as part_col
|
||||
from customer_address as a, customer_address as b
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=12.25MB Threads=3
|
||||
Per-Host Resource Estimates: Memory=50.03GB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=50.02GB mem-reservation=12.12MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2393532728547225, 2622165786501232] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.customer_address_1_huge_part, OVERWRITE=false, PARTITION-KEYS=(ca_country)]
|
||||
| output exprs: ca_address_sk, ca_address_id, ca_street_number, ca_street_name, ca_street_type, ca_suite_number, ca_city, ca_county, ca_state, ca_zip, ca_country, ca_gmt_offset, ca_location_type, ca_country
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=2622165786501232
|
||||
|
|
||||
04:SORT
|
||||
| order by: ca_country ASC NULLS LAST
|
||||
| mem-estimate=50.00GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=232B cardinality=225.00T cost=2358455207032019
|
||||
| in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=232B cardinality=225.00T cost=35077500000000
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=40.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[19934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=40.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[324000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address b, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=15.00M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address a, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=307.36MB
|
||||
stored statistics:
|
||||
table: rows=15.00M size=307.36MB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=232B cardinality=15.00M cost=21515206
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1 (constant expression) with large number of rows.
|
||||
# Since the partitioning col is a constant expression, it is recognized as
|
||||
# non-partitioned insert and maximum num writer is scheduled.
|
||||
# Along with maximum number of scan scheduled, shuffling in-between is eliminated.
|
||||
create table store_sales_1_huge_part partitioned by (part_col)
|
||||
stored as iceberg as
|
||||
select a.*, 100000 as part_col
|
||||
from store_sales a, store_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=96.25MB Threads=15
|
||||
Per-Host Resource Estimates: Memory=225MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=8.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[2517058240805469066] cpu-comparison-result=120 [max(120 (self) vs 30 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_huge_part, OVERWRITE=false, PARTITION-KEYS=(100000)]
|
||||
| output exprs: a.ss_sold_time_sk, a.ss_item_sk, a.ss_customer_sk, a.ss_cdemo_sk, a.ss_hdemo_sk, a.ss_addr_sk, a.ss_store_sk, a.ss_promo_sk, a.ss_ticket_number, a.ss_quantity, a.ss_wholesale_cost, a.ss_list_price, a.ss_sales_price, a.ss_ext_discount_amt, a.ss_ext_sales_price, a.ss_ext_wholesale_cost, a.ss_ext_list_price, a.ss_ext_tax, a.ss_coupon_amt, a.ss_net_paid, a.ss_net_paid_inc_tax, a.ss_net_profit, a.ss_sold_date_sk, CAST(100000 AS INT)
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=80.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[11482473870]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=80.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=8.64G cost=11482473870
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[186622600]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales b, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=8.64G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales a, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 4 with large number of rows.
|
||||
# Since the partitioning col is a arithmetic expression, it is recognized as
|
||||
# partitioned insert, but the expression is not evaluated further to lower partition
|
||||
# estimate down from 1824 to 4.
|
||||
# Shuffling in-between is kept because data partitioning between F02 and F00 is different.
|
||||
create table store_sales_4_huge_part partitioned by (part_col)
|
||||
stored as iceberg as
|
||||
select a.*, (a.ss_sold_date_sk % 4) as part_col
|
||||
from store_sales a, store_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=168.25MB Threads=27
|
||||
Per-Host Resource Estimates: Memory=51.05GB
|
||||
F02:PLAN FRAGMENT [HASH((a.ss_sold_date_sk % 4))] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=4.19GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[9223372036854775807, 1079134528315963008] cpu-comparison-result=240 [max(240 (self) vs 30 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_4_huge_part, OVERWRITE=false, PARTITION-KEYS=((ss_sold_date_sk % 4))]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk, (ss_sold_date_sk % CAST(4 AS INT))
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
05:SORT
|
||||
| order by: (ss_sold_date_sk % 4) ASC NULLS LAST
|
||||
| mem-estimate=4.17GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=96B cardinality=9223372.04T cost=9223372036854775807
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:EXCHANGE [HASH((a.ss_sold_date_sk % 4))]
|
||||
| mem-estimate=22.19MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=727724053707841792
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=64.75MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[2031908871662953610]
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=80.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[11482473870]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=80.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=8.64G cost=11482473870
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[186622600]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales b, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=8.64G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales a, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 20 with large number of rows.
|
||||
# NDV(cs_ship_mode_sk) = 20.
|
||||
# Shuffling in-between is kept because data partitioning between F02 and F00 is different.
|
||||
create table catalog_sales_20_huge_part partitioned by (part_col)
|
||||
stored as iceberg as
|
||||
select a.*, a.cs_ship_mode_sk as part_col
|
||||
from catalog_sales a, catalog_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=24.12MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=50.39GB
|
||||
F02:PLAN FRAGMENT [HASH(a.cs_ship_mode_sk)] hosts=10 instances=20
|
||||
| Per-Instance Resources: mem-estimate=25.03GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[9223372036854775807, 1079134528315963008] cpu-comparison-result=140 [max(140 (self) vs 20 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.catalog_sales_20_huge_part, OVERWRITE=false, PARTITION-KEYS=(cs_ship_mode_sk)]
|
||||
| output exprs: cs_sold_time_sk, cs_ship_date_sk, cs_bill_customer_sk, cs_bill_cdemo_sk, cs_bill_hdemo_sk, cs_bill_addr_sk, cs_ship_customer_sk, cs_ship_cdemo_sk, cs_ship_hdemo_sk, cs_ship_addr_sk, cs_call_center_sk, cs_catalog_page_sk, cs_ship_mode_sk, cs_warehouse_sk, cs_item_sk, cs_promo_sk, cs_order_number, cs_quantity, cs_wholesale_cost, cs_list_price, cs_sales_price, cs_ext_discount_amt, cs_ext_sales_price, cs_ext_wholesale_cost, cs_ext_list_price, cs_ext_tax, cs_coupon_amt, cs_ext_ship_cost, cs_net_paid, cs_net_paid_inc_tax, cs_net_paid_inc_ship, cs_net_paid_inc_ship_tax, cs_net_profit, cs_sold_date_sk, cs_ship_mode_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
05:SORT
|
||||
| order by: cs_ship_mode_sk ASC NULLS LAST
|
||||
| mem-estimate=25.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=140B cardinality=9223372.04T cost=9223372036854775807
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:EXCHANGE [HASH(a.cs_ship_mode_sk)]
|
||||
| mem-estimate=27.34MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=140B cardinality=9223372.04T cost=727724053707841792
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=27.56MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=1831 segment-costs=[2031908868428384405]
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=140B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=40.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[5741383630]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=40.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=4.32G cost=5741383630
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[93313684]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales b, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=4.32G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales a, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=140B cardinality=4.32G cost=8709277205
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition with cardinality = 0.
|
||||
create table store_sales_zero_cardinality partitioned by (ss_sold_date_sk)
|
||||
stored as iceberg as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 1
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=10MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.00MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 3954235]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_zero_cardinality, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=96B mem-reservation=0B thread-reservation=0 cost=3954235
|
||||
|
|
||||
01:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=96B cardinality=0 cost=0
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(1 AS INT)
|
||||
partitions=0/1824 files=0 size=0B
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 0/0 rows=unavailable
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=0
|
||||
mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=0 cost=0
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partitioned insert with unavailable stats.
|
||||
# tpcds_seq_snap does not have stats collected.
|
||||
# Exchange node must exist in query plan.
|
||||
create table store_sales_without_stats partitioned by (part_col)
|
||||
stored as iceberg as
|
||||
select *, ss_item_sk as part_col
|
||||
from tpcds_seq_snap.store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=102.00MB Threads=13
|
||||
Per-Host Resource Estimates: Memory=391MB
|
||||
F01:PLAN FRAGMENT [HASH(ss_item_sk)] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=150.19MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[0, 3954235]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_without_stats, OVERWRITE=false, PARTITION-KEYS=(ss_item_sk)]
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk, ss_item_sk
|
||||
| mem-estimate=100.00KB mem-reservation=0B thread-reservation=0 cost=3954235
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_item_sk ASC NULLS LAST
|
||||
| mem-estimate=128.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=100B cardinality=unavailable cost=0
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(ss_item_sk)]
|
||||
| mem-estimate=22.19MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=100B cardinality=unavailable cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=20.06MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1200000000]
|
||||
00:SCAN HDFS [tpcds_seq_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=215.99MB
|
||||
stored statistics:
|
||||
table: rows=unavailable size=unavailable
|
||||
partitions: 0/1824 rows=unavailable
|
||||
columns missing stats: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit
|
||||
extrapolated-rows=disabled max-scan-range-rows=unavailable
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=100B cardinality=unavailable cost=1200000000
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
813
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-ddl-parquet.test
vendored
Normal file
813
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-ddl-parquet.test
vendored
Normal file
@@ -0,0 +1,813 @@
|
||||
# Unpartitioned insert.
|
||||
create table store_sales_unpartitioned
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=96.00MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=12.19GB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=1.02GB mem-reservation=8.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[108991552732]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned, OVERWRITE=false]
|
||||
| partitions=1
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=97047706322
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Unpartitioned insert with less than 256MB estimated data to write.
|
||||
create table store_sales_unpartitioned_small
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 2450816
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=176.00KB Threads=1
|
||||
Per-Host Resource Estimates: Memory=284MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=283.75MB mem-reservation=176.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[40845904]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_small, OVERWRITE=false]
|
||||
| partitions=1
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=267.75MB mem-reservation=0B thread-reservation=0 cost=36802982
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(2450816 AS INT)
|
||||
HDFS partitions=1/1824 files=1 size=218.89MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1/1 rows=2.92M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=8.64G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=2.92M cost=4042922
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Unpartitioned insert with writer & scan instances < maximum allowed (120).
|
||||
# Cost-wise, scanner only need 40 instances, but writer need 88 instances.
|
||||
create table store_sales_unpartitioned_medium
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450910
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.55MB Threads=9
|
||||
Per-Host Resource Estimates: Memory=2.39GB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=88
|
||||
| Per-Instance Resources: mem-estimate=272.03MB mem-reservation=176.00KB thread-reservation=1
|
||||
| max-parallelism=88 segment-costs=[3108264904]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_medium, OVERWRITE=false]
|
||||
| partitions=1
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=256.03MB mem-reservation=0B thread-reservation=0 cost=2768066475
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450910 AS INT)
|
||||
HDFS partitions=93/1824 files=93 size=19.88GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 93/93 rows=246.09M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=119.03M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=246.09M cost=340198429
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Same unpartitioned insert as before, but with low MAX_FS_WRITERS.
|
||||
create table store_sales_unpartitioned_medium
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450910
|
||||
---- QUERYOPTIONS
|
||||
MAX_FS_WRITERS=20
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.72MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=2.27GB
|
||||
F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20
|
||||
| Per-Instance Resources: mem-estimate=1.02GB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[2904081862]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_unpartitioned_medium, OVERWRITE=false]
|
||||
| partitions=1
|
||||
| output exprs: tpcds_partitioned_parquet_snap.store_sales.ss_sold_time_sk, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, tpcds_partitioned_parquet_snap.store_sales.ss_ticket_number, tpcds_partitioned_parquet_snap.store_sales.ss_quantity, tpcds_partitioned_parquet_snap.store_sales.ss_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt, tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost, tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_tax, tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid, tpcds_partitioned_parquet_snap.store_sales.ss_net_paid_inc_tax, tpcds_partitioned_parquet_snap.store_sales.ss_net_profit, tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=2768066475
|
||||
|
|
||||
01:EXCHANGE [RANDOM]
|
||||
| mem-estimate=19.08MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=246.09M cost=136015387
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=93
|
||||
Per-Instance Resources: mem-estimate=23.81MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=93 segment-costs=[1988428320]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450910 AS INT)
|
||||
HDFS partitions=93/1824 files=93 size=19.88GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 93/93 rows=246.09M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=119.03M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=246.09M cost=340198429
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, just like the original table.
|
||||
create table store_sales_duplicate partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=168.00MB Threads=24
|
||||
Per-Host Resource Estimates: Memory=62.74GB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=5.17GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[44372981821, 97047706322]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_duplicate, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=97047706322
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=4.17GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=8.64G cost=39597689640
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=21.72MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=8.64G cost=4775292181
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=62.88MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[69810676358]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but limit at 5 rows.
|
||||
create table store_sales_5_rows partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
limit 5
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=14.00MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=22MB
|
||||
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.02MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[24, 3954291]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_5_rows, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=480B mem-reservation=0B thread-reservation=0 cost=3954291
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=5 cost=22
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [UNPARTITIONED]
|
||||
| limit: 5
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=5 cost=2
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.39MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[39]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
limit: 5
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=5 cost=6
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but have only 1 row per partition.
|
||||
create table store_sales_1_row_per_part partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select count(*), ss_sold_date_sk
|
||||
from store_sales group by ss_sold_date_sk
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=14.06MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=47MB
|
||||
F01:PLAN FRAGMENT [HASH(ss_sold_date_sk)] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.00MB mem-reservation=7.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[5592, 1694, 3956795] cpu-comparison-result=10 [max(10 (self) vs 10 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_row_per_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: count(*), ss_sold_date_sk
|
||||
| mem-estimate=2.13KB mem-reservation=0B thread-reservation=0 cost=3956795
|
||||
|
|
||||
04:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.82K cost=1694
|
||||
| in pipelines: 04(GETNEXT), 03(OPEN)
|
||||
|
|
||||
03:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: ss_sold_date_sk
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=5289
|
||||
| in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:EXCHANGE [HASH(ss_sold_date_sk)]
|
||||
| mem-estimate=162.14KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=303
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=30.62MB mem-reservation=6.12MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[5604, 2349]
|
||||
05:TUPLE CACHE
|
||||
| cache key: 0f28ed31aa6856c81f1e044cb23ef2d3
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 28.50KB
|
||||
| estimated serialized size per node: 2.85KB
|
||||
| cumulative processing cost: 5604
|
||||
| cache read processing cost: 242
|
||||
| cache write processing cost: 78
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
01:AGGREGATE [STREAMING]
|
||||
| output: sum_init_zero(tpcds_partitioned_parquet_snap.store_sales.stats: num_rows)
|
||||
| group by: ss_sold_date_sk
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=1.82K cost=5289
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=1.82K cost=315
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition by ss_sold_date_sk, but have insert 5 partition and 1 row per partition.
|
||||
create table store_sales_5_part_1_row_per_part partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select count(*), ss_store_sk, ss_sold_date_sk
|
||||
from store_sales group by ss_store_sk, ss_sold_date_sk
|
||||
limit 5
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=470.62MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=701MB
|
||||
F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.02MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[5, 3954244] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_5_part_1_row_per_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: count(*), ss_store_sk, ss_sold_date_sk
|
||||
| mem-estimate=80B mem-reservation=0B thread-reservation=0 cost=3954244
|
||||
|
|
||||
05:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=16B cardinality=5 cost=5
|
||||
| in pipelines: 05(GETNEXT), 03(OPEN)
|
||||
|
|
||||
04:EXCHANGE [UNPARTITIONED]
|
||||
| limit: 5
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=5 cost=0
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
F01:PLAN FRAGMENT [HASH(ss_store_sk,ss_sold_date_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=22.34MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[228190932, 7] cpu-comparison-result=120 [max(30 (self) vs 120 (sum children))]
|
||||
03:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: ss_store_sk, ss_sold_date_sk
|
||||
| limit: 5
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=5 cost=201792013
|
||||
| in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:EXCHANGE [HASH(ss_store_sk,ss_sold_date_sk)]
|
||||
| mem-estimate=12.34MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=142.93M cost=26398919
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=52.34MB mem-reservation=38.00MB thread-reservation=1
|
||||
max-parallelism=1360 segment-costs=[13514707828, 220910505]
|
||||
01:AGGREGATE [STREAMING]
|
||||
| output: count(*)
|
||||
| group by: ss_store_sk, ss_sold_date_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=142.93M cost=12519387294
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=8B cardinality=8.64G cost=995320534
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Number of partition & scan instances < maximum allowed (120).
|
||||
create table store_sales_83_part partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450900
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=49.55MB Threads=17
|
||||
Per-Host Resource Estimates: Memory=4.42GB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=10 instances=78
|
||||
| Per-Instance Resources: mem-estimate=513.52MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=78 segment-costs=[1123464765, 2460972835]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_83_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=256.76MB mem-reservation=0B thread-reservation=0 cost=2460972835
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=256.76MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=218.75M cost=1002560725
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=18.11MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=218.75M cost=120904040
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=83
|
||||
Per-Instance Resources: mem-estimate=46.47MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=83 segment-costs=[1767513380]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450900 AS INT)
|
||||
HDFS partitions=83/1824 files=83 size=17.74GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 83/83 rows=218.75M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=133.91M
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=218.75M cost=302402289
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Number of partition & scan instances < num executors.
|
||||
create table store_sales_4_part partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk < 2450820
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.17MB Threads=2
|
||||
Per-Host Resource Estimates: Memory=535MB
|
||||
F01:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=517.65MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[58077317, 130969386]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_4_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=258.83MB mem-reservation=0B thread-reservation=0 cost=130969386
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=258.83MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=11.31M cost=51827204
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk)]
|
||||
| mem-estimate=10.39MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=96B cardinality=11.31M cost=6250113
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=17.56MB mem-reservation=176.00KB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[91371298]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk < CAST(2450820 AS INT)
|
||||
HDFS partitions=4/1824 files=4 size=875.57MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 4/4 rows=11.31M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=2.61G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=11.31M cost=15632634
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1.
|
||||
# There should be no shuffling.
|
||||
create table store_sales_1_part partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 2450816
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.17MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=536MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=535.50MB mem-reservation=6.17MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[17446509, 36802982]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_part, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=267.75MB mem-reservation=0B thread-reservation=0 cost=36802982
|
||||
|
|
||||
01:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=267.75MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=96B cardinality=2.92M cost=13403587
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(2450816 AS INT)
|
||||
HDFS partitions=1/1824 files=1 size=218.89MB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1/1 rows=2.92M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=8.64G
|
||||
mem-estimate=16.00MB mem-reservation=176.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=2.92M cost=4042922
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1 with large number of rows.
|
||||
# NDV(ca_country) = 1
|
||||
# There should be no shuffling.
|
||||
create table customer_address_1_huge_part partitioned by (part_col)
|
||||
stored as parquet as
|
||||
select a.*, a.ca_country as part_col
|
||||
from customer_address as a, customer_address as b
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=12.25MB Threads=3
|
||||
Per-Host Resource Estimates: Memory=51.02GB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=51.00GB mem-reservation=12.12MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2393532728547225, 2622165786501232] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.customer_address_1_huge_part, OVERWRITE=false, PARTITION-KEYS=(ca_country)]
|
||||
| partitions=1
|
||||
| output exprs: ca_address_sk, ca_address_id, ca_street_number, ca_street_name, ca_street_type, ca_suite_number, ca_city, ca_county, ca_state, ca_zip, ca_country, ca_gmt_offset, ca_location_type, ca_country
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=2622165786501232
|
||||
|
|
||||
04:SORT
|
||||
| order by: ca_country ASC NULLS LAST
|
||||
| mem-estimate=50.00GB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=232B cardinality=225.00T cost=2358455207032019
|
||||
| in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=232B cardinality=225.00T cost=35077500000000
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=40.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[19934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=40.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[324000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address b, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=15.00M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address a, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=307.36MB
|
||||
stored statistics:
|
||||
table: rows=15.00M size=307.36MB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=232B cardinality=15.00M cost=21515206
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 1 (constant expression) with large number of rows.
|
||||
# Since the partitioning col is a constant expression, it is recognized as
|
||||
# non-partitioned insert and maximum num writer is scheduled.
|
||||
# Along with maximum number of scan scheduled, shuffling in-between is eliminated.
|
||||
create table store_sales_1_huge_part partitioned by (part_col)
|
||||
stored as parquet as
|
||||
select a.*, 100000 as part_col
|
||||
from store_sales a, store_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=96.25MB Threads=15
|
||||
Per-Host Resource Estimates: Memory=12.22GB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=1.02GB mem-reservation=8.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[2517058240805469066] cpu-comparison-result=120 [max(120 (self) vs 30 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_1_huge_part, OVERWRITE=false, PARTITION-KEYS=(100000)]
|
||||
| partitions=1
|
||||
| output exprs: a.ss_sold_time_sk, a.ss_item_sk, a.ss_customer_sk, a.ss_cdemo_sk, a.ss_hdemo_sk, a.ss_addr_sk, a.ss_store_sk, a.ss_promo_sk, a.ss_ticket_number, a.ss_quantity, a.ss_wholesale_cost, a.ss_list_price, a.ss_sales_price, a.ss_ext_discount_amt, a.ss_ext_sales_price, a.ss_ext_wholesale_cost, a.ss_ext_list_price, a.ss_ext_tax, a.ss_coupon_amt, a.ss_net_paid, a.ss_net_paid_inc_tax, a.ss_net_profit, a.ss_sold_date_sk, CAST(100000 AS INT)
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=80.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[11482473870]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=80.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=8.64G cost=11482473870
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[186622600]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales b, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=8.64G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales a, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 4 with large number of rows.
|
||||
# Since the partitioning col is a arithmetic expression, it is recognized as
|
||||
# partitioned insert, but the expression is not evaluated further to lower partition
|
||||
# estimate down from 1824 to 4.
|
||||
# Shuffling in-between is kept because data partitioning between F02 and F00 is different.
|
||||
create table store_sales_4_huge_part partitioned by (part_col)
|
||||
stored as parquet as
|
||||
select a.*, (a.ss_sold_date_sk % 4) as part_col
|
||||
from store_sales a, store_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=168.25MB Threads=27
|
||||
Per-Host Resource Estimates: Memory=62.79GB
|
||||
F02:PLAN FRAGMENT [HASH((a.ss_sold_date_sk % 4))] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=5.17GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=120 segment-costs=[9223372036854775807, 1079134528315963008] cpu-comparison-result=240 [max(240 (self) vs 30 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_4_huge_part, OVERWRITE=false, PARTITION-KEYS=((ss_sold_date_sk % 4))]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk, (ss_sold_date_sk % CAST(4 AS INT))
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
05:SORT
|
||||
| order by: (ss_sold_date_sk % 4) ASC NULLS LAST
|
||||
| mem-estimate=4.17GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=96B cardinality=9223372.04T cost=9223372036854775807
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:EXCHANGE [HASH((a.ss_sold_date_sk % 4))]
|
||||
| mem-estimate=22.19MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=727724053707841792
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=64.75MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[2031908871662953610]
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=96B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=80.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[11482473870]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=80.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=8.64G cost=11482473870
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[186622600]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales b, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=8.64G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales a, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=8.64G cost=11943846410
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition number is 20 with large number of rows.
|
||||
# NDV(cs_ship_mode_sk) = 20.
|
||||
# Shuffling in-between is kept because data partitioning between F02 and F00 is different.
|
||||
create table catalog_sales_20_huge_part partitioned by (part_col)
|
||||
stored as parquet as
|
||||
select a.*, a.cs_ship_mode_sk as part_col
|
||||
from catalog_sales a, catalog_sales b;
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=24.12MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=52.34GB
|
||||
F02:PLAN FRAGMENT [HASH(a.cs_ship_mode_sk)] hosts=10 instances=20
|
||||
| Per-Instance Resources: mem-estimate=26.00GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[9223372036854775807, 1079134528315963008] cpu-comparison-result=140 [max(140 (self) vs 20 (sum children))]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.catalog_sales_20_huge_part, OVERWRITE=false, PARTITION-KEYS=(cs_ship_mode_sk)]
|
||||
| partitions=20
|
||||
| output exprs: cs_sold_time_sk, cs_ship_date_sk, cs_bill_customer_sk, cs_bill_cdemo_sk, cs_bill_hdemo_sk, cs_bill_addr_sk, cs_ship_customer_sk, cs_ship_cdemo_sk, cs_ship_hdemo_sk, cs_ship_addr_sk, cs_call_center_sk, cs_catalog_page_sk, cs_ship_mode_sk, cs_warehouse_sk, cs_item_sk, cs_promo_sk, cs_order_number, cs_quantity, cs_wholesale_cost, cs_list_price, cs_sales_price, cs_ext_discount_amt, cs_ext_sales_price, cs_ext_wholesale_cost, cs_ext_list_price, cs_ext_tax, cs_coupon_amt, cs_ext_ship_cost, cs_net_paid, cs_net_paid_inc_tax, cs_net_paid_inc_ship, cs_net_paid_inc_ship_tax, cs_net_profit, cs_sold_date_sk, cs_ship_mode_sk
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=1079134528315963008
|
||||
|
|
||||
05:SORT
|
||||
| order by: cs_ship_mode_sk ASC NULLS LAST
|
||||
| mem-estimate=25.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=140B cardinality=9223372.04T cost=9223372036854775807
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:EXCHANGE [HASH(a.cs_ship_mode_sk)]
|
||||
| mem-estimate=27.34MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=140B cardinality=9223372.04T cost=727724053707841792
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=27.56MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=1831 segment-costs=[2031908868428384405]
|
||||
02:NESTED LOOP JOIN [CROSS JOIN, BROADCAST]
|
||||
| join table id: 00
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=140B cardinality=9223372.04T cost=1437923700545659648
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=40.00KB mem-reservation=0B thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[5741383630]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
| |
|
||||
| 03:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=40.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=0B cardinality=4.32G cost=5741383630
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=16.02MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[93313684]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales b, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=0B cardinality=4.32G cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales a, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=140B cardinality=4.32G cost=8709277205
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partition with cardinality = 0.
|
||||
create table store_sales_zero_cardinality partitioned by (ss_sold_date_sk)
|
||||
stored as parquet as
|
||||
select * from store_sales
|
||||
where ss_sold_date_sk = 1
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=6.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=10MB
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.00MB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 3954235]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_zero_cardinality, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk)]
|
||||
| partitions=1824
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk
|
||||
| mem-estimate=96B mem-reservation=0B thread-reservation=0 cost=3954235
|
||||
|
|
||||
01:SORT
|
||||
| order by: ss_sold_date_sk ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=96B cardinality=0 cost=0
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
partition predicates: ss_sold_date_sk = CAST(1 AS INT)
|
||||
partitions=0/1824 files=0 size=0B
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 0/0 rows=unavailable
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=0
|
||||
mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
tuple-ids=0 row-size=96B cardinality=0 cost=0
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
# Partitioned insert with unavailable stats.
|
||||
# tpcds_seq_snap does not have stats collected.
|
||||
# Exchange node must exist in query plan.
|
||||
create table store_sales_without_stats partitioned by (part_col)
|
||||
stored as parquet as
|
||||
select *, ss_item_sk as part_col
|
||||
from tpcds_seq_snap.store_sales
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=102.00MB Threads=13
|
||||
Per-Host Resource Estimates: Memory=1.36GB
|
||||
F01:PLAN FRAGMENT [HASH(ss_item_sk)] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=1.12GB mem-reservation=6.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[0, 3954235]
|
||||
WRITE TO HDFS [tpcds_partitioned_parquet_snap.store_sales_without_stats, OVERWRITE=false, PARTITION-KEYS=(ss_item_sk)]
|
||||
| partitions=unavailable
|
||||
| output exprs: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit, ss_sold_date_sk, ss_item_sk
|
||||
| mem-estimate=1.00GB mem-reservation=0B thread-reservation=0 cost=3954235
|
||||
|
|
||||
02:SORT
|
||||
| order by: ss_item_sk ASC NULLS LAST
|
||||
| mem-estimate=128.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=100B cardinality=unavailable cost=0
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
01:EXCHANGE [HASH(ss_item_sk)]
|
||||
| mem-estimate=22.19MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=100B cardinality=unavailable cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=20.06MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1200000000]
|
||||
00:SCAN HDFS [tpcds_seq_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=215.99MB
|
||||
stored statistics:
|
||||
table: rows=unavailable size=unavailable
|
||||
partitions: 0/1824 rows=unavailable
|
||||
columns missing stats: ss_sold_time_sk, ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, ss_addr_sk, ss_store_sk, ss_promo_sk, ss_ticket_number, ss_quantity, ss_wholesale_cost, ss_list_price, ss_sales_price, ss_ext_discount_amt, ss_ext_sales_price, ss_ext_wholesale_cost, ss_ext_list_price, ss_ext_tax, ss_coupon_amt, ss_net_paid, ss_net_paid_inc_tax, ss_net_profit
|
||||
extrapolated-rows=disabled max-scan-range-rows=unavailable
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=100B cardinality=unavailable cost=1200000000
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
902
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q01.test
vendored
Normal file
902
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q01.test
vendored
Normal file
@@ -0,0 +1,902 @@
|
||||
# TPCDS-Q01
|
||||
# start query 1 in stream 0 using template query1.tpl using seed 2031708268
|
||||
with customer_total_return as
|
||||
(select sr_customer_sk as ctr_customer_sk
|
||||
,sr_store_sk as ctr_store_sk
|
||||
,sum(SR_FEE) as ctr_total_return
|
||||
from store_returns
|
||||
,date_dim
|
||||
where sr_returned_date_sk = d_date_sk
|
||||
and d_year =2000
|
||||
group by sr_customer_sk
|
||||
,sr_store_sk)
|
||||
select c_customer_id
|
||||
from customer_total_return ctr1
|
||||
,store
|
||||
,customer
|
||||
where ctr1.ctr_total_return > (select avg(ctr_total_return)*1.2
|
||||
from customer_total_return ctr2
|
||||
where ctr1.ctr_store_sk = ctr2.ctr_store_sk)
|
||||
and s_store_sk = ctr1.ctr_store_sk
|
||||
and s_state = 'TN'
|
||||
and ctr1.ctr_customer_sk = c_customer_sk
|
||||
order by c_customer_id
|
||||
limit 100;
|
||||
|
||||
# end query 1 in stream 0 using template query1.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=127.38MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=7.16GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=7.16GB mem-reservation=127.38MB thread-reservation=1 runtime-filters-memory=12.00MB
|
||||
| max-parallelism=1 segment-costs=[1056659929, 1056659929, 47039287, 205425661, 100]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_customer_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_customer_id ASC
|
||||
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=28B cardinality=100 cost=133335611
|
||||
| in pipelines: 14(GETNEXT), 05(OPEN)
|
||||
|
|
||||
19:TUPLE CACHE
|
||||
| cache key: 3464f97232593cfa9f9632e1fa804f92
|
||||
| input scan node ids: 5,0,1,4,6,7
|
||||
| estimated serialized size: 833.30MB
|
||||
| estimated serialized size per node: 83.33MB
|
||||
| cumulative processing cost: 2232449195
|
||||
| cache read processing cost: 1350298
|
||||
| cache write processing cost: 2359211
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
13:HASH JOIN [LEFT SEMI JOIN]
|
||||
| hash predicates: sr_store_sk = ctr2.ctr_store_sk
|
||||
| other join predicates: sum(SR_FEE) > avg(ctr_total_return) * CAST(1.2 AS DECIMAL(2,1))
|
||||
| runtime filters: RF000[bloom] <- ctr2.ctr_store_sk, RF001[min_max] <- ctr2.ctr_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=4447797
|
||||
| in pipelines: 05(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--18:TUPLE CACHE
|
||||
| | cache key: d975df7358a9b9263f516754e811b766
|
||||
| | input scan node ids: 6,7
|
||||
| | estimated serialized size: 15.30KB
|
||||
| | estimated serialized size per node: 1.53KB
|
||||
| | cumulative processing cost: 1103699216
|
||||
| | cache read processing cost: 86
|
||||
| | cache write processing cost: 42
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=0
|
||||
| | in pipelines: 10(GETNEXT)
|
||||
| |
|
||||
| 10:AGGREGATE [FINALIZE]
|
||||
| | output: avg(sum(SR_FEE))
|
||||
| | group by: sr_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=47039287
|
||||
| | in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
| |
|
||||
| 09:AGGREGATE [FINALIZE]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=3.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 09(GETNEXT), 06(OPEN)
|
||||
| |
|
||||
| 08:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=24B cardinality=160.81M cost=70387897
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--17:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 7
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF008[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_customer_sk = sr_customer_sk
|
||||
| fk/pk conjuncts: c_customer_sk = sr_customer_sk
|
||||
| runtime filters: RF002[bloom] <- sr_customer_sk, RF003[min_max] <- sr_customer_sk
|
||||
| mem-estimate=635.33MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=15748162
|
||||
| in pipelines: 05(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--11:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: sr_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: sr_store_sk = s_store_sk
|
||||
| | runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,4 row-size=42B cardinality=11.07M cost=43253937
|
||||
| | in pipelines: 03(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--16:TUPLE CACHE
|
||||
| | | cache key: 9eb7b9bfb2906530a439edd9747618b1
|
||||
| | | input scan node ids: 4
|
||||
| | | estimated serialized size: 1012B
|
||||
| | | estimated serialized size per node: 1012B
|
||||
| | | cumulative processing cost: 154
|
||||
| | | cache read processing cost: 6
|
||||
| | | cache write processing cost: 2
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=18B cardinality=46 cost=0
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: s_state = 'TN'
|
||||
| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: s_state = 'TN'
|
||||
| | parquet dictionary predicates: s_state = 'TN'
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=18B cardinality=46 cost=154
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 03:AGGREGATE [FINALIZE]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=3.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=160.81M cost=70387897
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--15:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> c_customer_sk, RF002[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=32B cardinality=11.07M(filtered from 30.00M) cost=8640000
|
||||
in pipelines: 05(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.60GB Threads=56
|
||||
Per-Host Resource Estimates: Memory=3.12GB
|
||||
F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[130] cpu-comparison-result=231 [max(1 (self) vs 231 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_customer_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
27:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_customer_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=62.77KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=28B cardinality=100 cost=30
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=20 (adjusted from 10)
|
||||
Per-Instance Resources: mem-estimate=10.35MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[145321673, 104] cpu-comparison-result=231 [max(30 (self) vs 231 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_customer_id ASC
|
||||
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=28B cardinality=100 cost=133335611
|
||||
| in pipelines: 14(GETNEXT), 05(OPEN)
|
||||
|
|
||||
13:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: sr_store_sk = ctr2.ctr_store_sk
|
||||
| other join predicates: sum(SR_FEE) > avg(ctr_total_return) * CAST(1.2 AS DECIMAL(2,1))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=4447144
|
||||
| in pipelines: 05(GETNEXT), 25(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.04MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ctr2.ctr_store_sk
|
||||
| | runtime filters: RF000[bloom] <- ctr2.ctr_store_sk, RF001[min_max] <- ctr2.ctr_store_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=653
|
||||
| |
|
||||
| 26:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=165.80KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=860
|
||||
| | in pipelines: 25(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [HASH(ctr2.ctr_store_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=12.49MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))]
|
||||
| 25:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(ctr_total_return)
|
||||
| | group by: ctr2.ctr_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=24622
|
||||
| | in pipelines: 25(GETNEXT), 23(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(ctr2.ctr_store_sk)]
|
||||
| | mem-estimate=2.49MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=20B cardinality=78.36K cost=15914
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=78.22MB mem-reservation=36.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[984830336, 47241885, 141298] cpu-comparison-result=110 [max(100 (self) vs 110 (sum children))]
|
||||
| 10:AGGREGATE [STREAMING]
|
||||
| | output: avg(sum(SR_FEE))
|
||||
| | group by: sr_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=20B cardinality=78.36K cost=47241885
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| 23:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 23(GETNEXT), 06(OPEN)
|
||||
| |
|
||||
| 22:EXCHANGE [HASH(sr_customer_sk,sr_store_sk)]
|
||||
| | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=35619914
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=64.58MB mem-reservation=34.50MB thread-reservation=1
|
||||
| max-parallelism=110 segment-costs=[1056649089, 331401897] cpu-comparison-result=110 [max(110 (self) vs 11 (sum children))]
|
||||
| 09:AGGREGATE [STREAMING]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=37.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=24B cardinality=160.81M cost=70387524
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[863]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| | |
|
||||
| | 21:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=8B cardinality=373 cost=490
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[10483]
|
||||
| | 29:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 7
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF008[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: c_customer_sk = sr_customer_sk
|
||||
| fk/pk conjuncts: c_customer_sk = sr_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=4680017
|
||||
| in pipelines: 05(GETNEXT), 17(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=20 (adjusted from 10)
|
||||
| | Per-Instance Resources: mem-estimate=56.88MB mem-reservation=42.00MB thread-reservation=1 runtime-filters-memory=8.00MB
|
||||
| | max-parallelism=20 segment-costs=[14843489] cpu-comparison-result=121 [max(20 (self) vs 121 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: sr_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- sr_customer_sk, RF003[min_max] <- sr_customer_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=11068145
|
||||
| |
|
||||
| 20:EXCHANGE [HASH(sr_customer_sk)]
|
||||
| | mem-estimate=14.88MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2,4 row-size=42B cardinality=11.07M cost=3775344
|
||||
| | in pipelines: 17(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=68.22MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[984830336, 84595626] cpu-comparison-result=121 [max(100 (self) vs 121 (sum children))]
|
||||
| 11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: sr_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: sr_store_sk = s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,4 row-size=42B cardinality=11.07M cost=43253891
|
||||
| | in pipelines: 17(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--F14:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[106]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=03
|
||||
| | | build expressions: s_store_sk
|
||||
| | | runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=46
|
||||
| | |
|
||||
| | 18:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=18B cardinality=46 cost=60
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[157]
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | predicates: s_state = 'TN'
|
||||
| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: s_state = 'TN'
|
||||
| | parquet dictionary predicates: s_state = 'TN'
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=18B cardinality=46 cost=154
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 17:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 16:EXCHANGE [HASH(sr_customer_sk,sr_store_sk)]
|
||||
| | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=35619914
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=64.58MB mem-reservation=34.50MB thread-reservation=1
|
||||
| max-parallelism=110 segment-costs=[1056649089, 331401897] cpu-comparison-result=110 [max(110 (self) vs 11 (sum children))]
|
||||
| 03:AGGREGATE [STREAMING]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=37.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=04
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=160.81M cost=70387524
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[863]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=04 plan-id=05 cohort-id=03
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| | |
|
||||
| | 15:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=373 cost=490
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[10483]
|
||||
| | 28:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
19:EXCHANGE [HASH(c_customer_sk)]
|
||||
| mem-estimate=10.35MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=32B cardinality=11.07M(filtered from 30.00M) cost=2858901
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=8.00MB mem-reservation=8.00MB thread-reservation=0 runtime-filters-memory=8.00MB
|
||||
Per-Instance Resources: mem-estimate=18.81MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[37151541]
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF003[min_max] -> c_customer_sk, RF002[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=32B cardinality=11.07M(filtered from 30.00M) cost=8640000
|
||||
in pipelines: 05(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.60GB Threads=56
|
||||
Per-Host Resource Estimates: Memory=3.12GB
|
||||
F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[130] cpu-comparison-result=231 [max(1 (self) vs 231 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_customer_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
27:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_customer_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=62.77KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=28B cardinality=100 cost=30
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=20 (adjusted from 10)
|
||||
Per-Instance Resources: mem-estimate=10.35MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[145321673, 104] cpu-comparison-result=231 [max(30 (self) vs 231 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_customer_id ASC
|
||||
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=28B cardinality=100 cost=133335611
|
||||
| in pipelines: 14(GETNEXT), 05(OPEN)
|
||||
|
|
||||
13:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: sr_store_sk = ctr2.ctr_store_sk
|
||||
| other join predicates: sum(SR_FEE) > avg(ctr_total_return) * CAST(1.2 AS DECIMAL(2,1))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=4447144
|
||||
| in pipelines: 05(GETNEXT), 25(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.04MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ctr2.ctr_store_sk
|
||||
| | runtime filters: RF000[bloom] <- ctr2.ctr_store_sk, RF001[min_max] <- ctr2.ctr_store_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=653
|
||||
| |
|
||||
| 26:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=165.80KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=860
|
||||
| | in pipelines: 25(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [HASH(ctr2.ctr_store_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=12.49MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=110 [max(10 (self) vs 110 (sum children))]
|
||||
| 25:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(ctr_total_return)
|
||||
| | group by: ctr2.ctr_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=20B cardinality=653 cost=24622
|
||||
| | in pipelines: 25(GETNEXT), 23(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(ctr2.ctr_store_sk)]
|
||||
| | mem-estimate=2.49MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=20B cardinality=78.36K cost=15914
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=78.22MB mem-reservation=36.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[984830336, 47241885, 141298] cpu-comparison-result=110 [max(100 (self) vs 110 (sum children))]
|
||||
| 10:AGGREGATE [STREAMING]
|
||||
| | output: avg(sum(SR_FEE))
|
||||
| | group by: sr_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=20B cardinality=78.36K cost=47241885
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| 23:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 23(GETNEXT), 06(OPEN)
|
||||
| |
|
||||
| 22:EXCHANGE [HASH(sr_customer_sk,sr_store_sk)]
|
||||
| | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=35619914
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=64.58MB mem-reservation=34.50MB thread-reservation=1
|
||||
| max-parallelism=110 segment-costs=[1056649089, 331401897] cpu-comparison-result=110 [max(110 (self) vs 11 (sum children))]
|
||||
| 09:AGGREGATE [STREAMING]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=37.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=24B cardinality=160.81M cost=70387524
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[863]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| | |
|
||||
| | 21:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=8B cardinality=373 cost=490
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[10483]
|
||||
| | 29:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 7
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF008[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: c_customer_sk = sr_customer_sk
|
||||
| fk/pk conjuncts: c_customer_sk = sr_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,2,4 row-size=74B cardinality=10.16M cost=4680017
|
||||
| in pipelines: 05(GETNEXT), 17(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(c_customer_sk)] hosts=10 instances=20 (adjusted from 10)
|
||||
| | Per-Instance Resources: mem-estimate=56.88MB mem-reservation=42.00MB thread-reservation=1 runtime-filters-memory=8.00MB
|
||||
| | max-parallelism=20 segment-costs=[14843489] cpu-comparison-result=121 [max(20 (self) vs 121 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: sr_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- sr_customer_sk, RF003[min_max] <- sr_customer_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=11068145
|
||||
| |
|
||||
| 20:EXCHANGE [HASH(sr_customer_sk)]
|
||||
| | mem-estimate=14.88MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2,4 row-size=42B cardinality=11.07M cost=3775344
|
||||
| | in pipelines: 17(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=68.22MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[984830336, 84595626] cpu-comparison-result=121 [max(100 (self) vs 121 (sum children))]
|
||||
| 11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: sr_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: sr_store_sk = s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,4 row-size=42B cardinality=11.07M cost=43253891
|
||||
| | in pipelines: 17(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--F14:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[106]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=03
|
||||
| | | build expressions: s_store_sk
|
||||
| | | runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=46
|
||||
| | |
|
||||
| | 18:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=18B cardinality=46 cost=60
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[157]
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | predicates: s_state = 'TN'
|
||||
| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: s_state = 'TN'
|
||||
| | parquet dictionary predicates: s_state = 'TN'
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=18B cardinality=46 cost=154
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 17:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 16:EXCHANGE [HASH(sr_customer_sk,sr_store_sk)]
|
||||
| | mem-estimate=13.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=35619914
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=64.58MB mem-reservation=34.50MB thread-reservation=1
|
||||
| max-parallelism=110 segment-costs=[1056649089, 331401897] cpu-comparison-result=110 [max(110 (self) vs 11 (sum children))]
|
||||
| 03:AGGREGATE [STREAMING]
|
||||
| | output: sum(SR_FEE)
|
||||
| | group by: sr_customer_sk, sr_store_sk
|
||||
| | mem-estimate=37.64MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=160.81M cost=949210422
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=04
|
||||
| | hash predicates: sr_returned_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: sr_returned_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=160.81M cost=70387524
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=22.33MB mem-reservation=22.31MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[863]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=04 plan-id=05 cohort-id=03
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | | mem-estimate=21.31MB mem-reservation=21.31MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| | |
|
||||
| | 15:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=373 cost=490
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[10483]
|
||||
| | 28:TUPLE CACHE
|
||||
| | | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 4.37KB
|
||||
| | | estimated serialized size per node: 4.37KB
|
||||
| | | cumulative processing cost: 10467
|
||||
| | | cache read processing cost: 49
|
||||
| | | cache write processing cost: 12
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_year = CAST(2000 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| | parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=160.81M(filtered from 863.99M) cost=37051143
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
19:EXCHANGE [HASH(c_customer_sk)]
|
||||
| mem-estimate=10.35MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=32B cardinality=11.07M(filtered from 30.00M) cost=2858901
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=8.00MB mem-reservation=8.00MB thread-reservation=0 runtime-filters-memory=8.00MB
|
||||
Per-Instance Resources: mem-estimate=18.81MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[37151541]
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF003[min_max] -> c_customer_sk, RF002[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=32B cardinality=11.07M(filtered from 30.00M) cost=8640000
|
||||
in pipelines: 05(GETNEXT)
|
||||
====
|
||||
1000
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q02.test
vendored
Normal file
1000
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q02.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
524
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q03.test
vendored
Normal file
524
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q03.test
vendored
Normal file
@@ -0,0 +1,524 @@
|
||||
# TPCDS-Q3
|
||||
# start query 3 in stream 0 using template query3.tpl using seed 318176889
|
||||
select dt.d_year
|
||||
,item.i_brand_id brand_id
|
||||
,item.i_brand brand
|
||||
,sum(ss_sales_price) sum_agg
|
||||
from date_dim dt
|
||||
,store_sales
|
||||
,item
|
||||
where dt.d_date_sk = store_sales.ss_sold_date_sk
|
||||
and store_sales.ss_item_sk = item.i_item_sk
|
||||
and item.i_manufact_id = 816
|
||||
and dt.d_moy=11
|
||||
group by dt.d_year
|
||||
,item.i_brand
|
||||
,item.i_brand_id
|
||||
order by dt.d_year
|
||||
,sum_agg desc
|
||||
,brand_id
|
||||
limit 100;
|
||||
|
||||
# end query 3 in stream 0 using template query3.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=55.88MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=551MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=551.48MB mem-reservation=55.88MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[1554129087, 117158429, 400]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=117158429
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
10:TUPLE CACHE
|
||||
| cache key: 88603377fd0f8f620cbe05663eb72182
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 481.77MB
|
||||
| estimated serialized size per node: 48.18MB
|
||||
| cumulative processing cost: 1554129087
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 1363976
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=521.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=53096454
|
||||
| in pipelines: 05(GETNEXT), 01(OPEN)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=9.00M cost=3943388
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--09:TUPLE CACHE
|
||||
| | cache key: c4355c97cf54825ec0d5f5fe4a27616e
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 95.11KB
|
||||
| | estimated serialized size per node: 95.11KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 808
|
||||
| | cache write processing cost: 262
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=6.09K cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=6.09K cost=14675
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=9.00M cost=3937676
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: 9667419a8188dd9f26a93dc52053603b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 16.17KB
|
||||
| | estimated serialized size per node: 4.04KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 44
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=375 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| parquet dictionary predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=375 cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:TUPLE CACHE
|
||||
| cache key: 9f4049df551e75dbc62bb8c7c80de917
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 137.26MB
|
||||
| estimated serialized size per node: 13.73MB
|
||||
| cumulative processing cost: 1492980801
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 388602
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=383.50MB Threads=19
|
||||
Per-Host Resource Estimates: Memory=657MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.11MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: dt.d_year ASC, sum(ss_sales_price) DESC, item.i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=110.20KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=35
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_brand,item.i_brand_id)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=50.58MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[56254141, 117158429, 168] cpu-comparison-result=120 [max(20 (self) vs 120 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=117158429
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=53096454
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_brand,item.i_brand_id)]
|
||||
| mem-estimate=16.58MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=3157687
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=38.39MB mem-reservation=21.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1553951857, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
|
||||
15:TUPLE CACHE
|
||||
| cache key: 602237300412b0fe46a455a4c406b9f8
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 481.77MB
|
||||
| estimated serialized size per node: 48.18MB
|
||||
| cumulative processing cost: 1554138033
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 1363976
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=10.00MB mem-reservation=5.00MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=53096454
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=9.00M cost=3937301
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[14167]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=6087
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=87.33KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=6.09K cost=8080
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[15003]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: c4355c97cf54825ec0d5f5fe4a27616e
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 95.11KB
|
||||
| | estimated serialized size per node: 95.11KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 808
|
||||
| | cache write processing cost: 262
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=6.09K cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=6.09K cost=14675
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=9.00M cost=3937301
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[865]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=375
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=79.39KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=375 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156141]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 9667419a8188dd9f26a93dc52053603b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 16.17KB
|
||||
| | estimated serialized size per node: 4.04KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 44
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=375 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| parquet dictionary predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=375 cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 5031b6c7488d1b98c1a053d3f3594410
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 137.26MB
|
||||
| estimated serialized size per node: 13.73MB
|
||||
| cumulative processing cost: 1492980801
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 388602
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=383.50MB Threads=19
|
||||
Per-Host Resource Estimates: Memory=657MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.11MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: dt.d_year ASC, sum(ss_sales_price) DESC, item.i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=110.20KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=35
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_brand,item.i_brand_id)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=50.58MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[56254141, 117158429, 168] cpu-comparison-result=120 [max(20 (self) vs 120 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=117158429
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=53096454
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_brand,item.i_brand_id)]
|
||||
| mem-estimate=16.58MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=3157687
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=38.39MB mem-reservation=21.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1553951857, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
|
||||
15:TUPLE CACHE
|
||||
| cache key: 602237300412b0fe46a455a4c406b9f8
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 481.77MB
|
||||
| estimated serialized size per node: 48.18MB
|
||||
| cumulative processing cost: 1554138033
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 1363976
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=10.00MB mem-reservation=5.00MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=9.00M cost=53096454
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=9.00M cost=3937301
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[14167]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=6087
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=87.33KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=6.09K cost=8080
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[15003]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: c4355c97cf54825ec0d5f5fe4a27616e
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 95.11KB
|
||||
| | estimated serialized size per node: 95.11KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 808
|
||||
| | cache write processing cost: 262
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=6.09K cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=6.09K cost=14675
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=9.00M cost=3937301
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[865]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=375
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=79.39KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=375 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156141]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 9667419a8188dd9f26a93dc52053603b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 16.17KB
|
||||
| | estimated serialized size per node: 4.04KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 44
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=375 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| parquet dictionary predicates: item.i_manufact_id = CAST(816 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=375 cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 5031b6c7488d1b98c1a053d3f3594410
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 137.26MB
|
||||
| estimated serialized size per node: 13.73MB
|
||||
| cumulative processing cost: 1492980801
|
||||
| cache read processing cost: 1195493
|
||||
| cache write processing cost: 388602
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
2580
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q04.test
vendored
Normal file
2580
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q04.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1661
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q05.test
vendored
Normal file
1661
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q05.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
948
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q06.test
vendored
Normal file
948
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q06.test
vendored
Normal file
@@ -0,0 +1,948 @@
|
||||
# TPCDS-Q6
|
||||
# start query 6 in stream 0 using template query6.tpl using seed 1554441264
|
||||
select a.ca_state state, count(*) cnt
|
||||
from customer_address a
|
||||
,customer c
|
||||
,store_sales s
|
||||
,date_dim d
|
||||
,item i
|
||||
where a.ca_address_sk = c.c_current_addr_sk
|
||||
and c.c_customer_sk = s.ss_customer_sk
|
||||
and s.ss_sold_date_sk = d.d_date_sk
|
||||
and s.ss_item_sk = i.i_item_sk
|
||||
and d.d_month_seq =
|
||||
(select distinct (d_month_seq)
|
||||
from date_dim
|
||||
where d_year = 2002
|
||||
and d_moy = 3 )
|
||||
and i.i_current_price > 1.2 *
|
||||
(select avg(j.i_current_price)
|
||||
from item j
|
||||
where j.i_category = i.i_category)
|
||||
group by a.ca_state
|
||||
having count(*) >= 10
|
||||
order by cnt, a.ca_state
|
||||
limit 100;
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=166.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=1.81GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=1.81GB mem-reservation=166.94MB thread-reservation=1 runtime-filters-memory=36.00MB
|
||||
| max-parallelism=1 segment-costs=[16764, 0, 156673, 17461374025, 6, 10]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: a.ca_state, count(*)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
|
||||
|
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: count(*) ASC, a.ca_state ASC
|
||||
| mem-estimate=110B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=22B cardinality=5 cost=6
|
||||
| in pipelines: 17(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: count(*)
|
||||
| group by: a.ca_state
|
||||
| having: count(*) >= CAST(10 AS BIGINT)
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=5 cost=957887
|
||||
| in pipelines: 16(GETNEXT), 02(OPEN)
|
||||
|
|
||||
15:HASH JOIN [LEFT SEMI JOIN]
|
||||
| hash predicates: i.i_category = j.i_category
|
||||
| other join predicates: i.i_current_price > CAST(1.2 AS DECIMAL(2,1)) * avg(j.i_current_price)
|
||||
| runtime filters: RF000[bloom] <- j.i_category, RF001[min_max] <- j.i_category
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=1433203
|
||||
| in pipelines: 02(GETNEXT), 09(OPEN)
|
||||
|
|
||||
|--19:TUPLE CACHE
|
||||
| | cache key: 35ea5c27d174a3323186d4f97f64473d
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 299B
|
||||
| | estimated serialized size per node: 74B
|
||||
| | cumulative processing cost: 156673
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=0
|
||||
| | in pipelines: 09(GETNEXT)
|
||||
| |
|
||||
| 09:AGGREGATE [FINALIZE]
|
||||
| | output: avg(j.i_current_price)
|
||||
| | group by: j.i_category
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=105326
|
||||
| | in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item j]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
14:HASH JOIN [LEFT SEMI JOIN]
|
||||
| hash predicates: d.d_month_seq = (d_month_seq)
|
||||
| runtime filters: RF002[bloom] <- (d_month_seq), RF003[min_max] <- (d_month_seq)
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=2033935855
|
||||
| in pipelines: 02(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--07:CARDINALITY CHECK
|
||||
| | limit: 1
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=1 cost=0
|
||||
| | in pipelines: 07(GETNEXT), 06(OPEN)
|
||||
| |
|
||||
| 06:AGGREGATE [FINALIZE]
|
||||
| | group by: (d_month_seq)
|
||||
| | limit: 2
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=36
|
||||
| | in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: b7f0c2e1b260aacf5110294e452f5df4
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: s.ss_sold_date_sk = d.d_date_sk
|
||||
| fk/pk conjuncts: s.ss_sold_date_sk = d.d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d.d_date_sk
|
||||
| mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=7.93G cost=3469835344
|
||||
| in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| runtime filters: RF003[min_max] -> d.d_month_seq, RF002[bloom] -> d.d_month_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=73.05K cost=8415
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c.c_current_addr_sk = a.ca_address_sk
|
||||
| fk/pk conjuncts: c.c_current_addr_sk = a.ca_address_sk
|
||||
| runtime filters: RF006[bloom] <- a.ca_address_sk, RF007[min_max] <- a.ca_address_sk
|
||||
| mem-estimate=641.49MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0 row-size=64B cardinality=7.93G cost=3484762295
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address a]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=18B cardinality=15.00M cost=1296000
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: s.ss_item_sk = i.i_item_sk
|
||||
| fk/pk conjuncts: s.ss_item_sk = i.i_item_sk
|
||||
| runtime filters: RF008[bloom] <- i.i_item_sk, RF009[min_max] <- i.i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4 row-size=46B cardinality=7.93G cost=3471138966
|
||||
| in pipelines: 02(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.item i]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| runtime filters: RF001[min_max] -> i.i_category, RF000[bloom] -> i.i_category
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=26B cardinality=360.00K cost=72083
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: s.ss_customer_sk = c.c_customer_sk
|
||||
| fk/pk conjuncts: s.ss_customer_sk = c.c_customer_sk
|
||||
| runtime filters: RF010[bloom] <- c.c_customer_sk, RF011[min_max] <- c.c_customer_sk
|
||||
| mem-estimate=996.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1 row-size=20B cardinality=7.93G(filtered from 7.93G) cost=3501497176
|
||||
| in pipelines: 02(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer c]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF007[min_max] -> c.c_current_addr_sk, RF006[bloom] -> c.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales s]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> s.ss_customer_sk, RF009[min_max] -> s.ss_item_sk, RF010[bloom] -> s.ss_customer_sk, RF008[bloom] -> s.ss_item_sk, RF004[bloom] -> s.ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=2 row-size=12B cardinality=7.93G(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 02(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.51GB Threads=29
|
||||
Per-Host Resource Estimates: Memory=2.67GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[11] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: a.ca_state, count(*)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
|
||||
|
|
||||
31:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: count(*) ASC, a.ca_state ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=22B cardinality=5 cost=1
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(a.ca_state)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=13.06MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: count(*) ASC, a.ca_state ASC
|
||||
| mem-estimate=110B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=22B cardinality=5 cost=6
|
||||
| in pipelines: 17(GETNEXT), 30(OPEN)
|
||||
|
|
||||
30:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: a.ca_state
|
||||
| having: count(*) >= CAST(10 AS BIGINT)
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=5 cost=1923
|
||||
| in pipelines: 30(GETNEXT), 02(OPEN)
|
||||
|
|
||||
29:EXCHANGE [HASH(a.ca_state)]
|
||||
| mem-estimate=3.06MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=6.12K cost=1299
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
|
||||
Per-Instance Resources: mem-estimate=27.02MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=1750 segment-costs=[17411124290, 11823] cpu-comparison-result=120 [max(120 (self) vs 85 (sum children))]
|
||||
16:AGGREGATE [STREAMING]
|
||||
| output: count(*)
|
||||
| group by: a.ca_state
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=6.12K cost=973710
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
15:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i.i_category = j.i_category
|
||||
| other join predicates: i.i_current_price > CAST(1.2 AS DECIMAL(2,1)) * avg(j.i_current_price)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=1433193
|
||||
| in pipelines: 02(GETNEXT), 27(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[20] cpu-comparison-result=10 [max(10 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: j.i_category
|
||||
| | runtime filters: RF000[bloom] <- j.i_category, RF001[min_max] <- j.i_category
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=10
|
||||
| |
|
||||
| 28:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=10
|
||||
| | in pipelines: 27(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [HASH(j.i_category)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[46, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 27:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(j.i_current_price)
|
||||
| | group by: j.i_category
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=37
|
||||
| | in pipelines: 27(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 26:EXCHANGE [HASH(j.i_category)]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=9
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=30.47MB mem-reservation=6.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156751, 87]
|
||||
| 33:TUPLE CACHE
|
||||
| | cache key: a893e9c3cc5e4f57d93d1bcda5a2e5f6
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 1.17KB
|
||||
| | estimated serialized size per node: 299B
|
||||
| | cumulative processing cost: 156751
|
||||
| | cache read processing cost: 5
|
||||
| | cache write processing cost: 3
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=0
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 09:AGGREGATE [STREAMING]
|
||||
| | output: avg(j.i_current_price)
|
||||
| | group by: j.i_category
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=105404
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item j, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
14:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: d.d_month_seq = (d_month_seq)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=2033935854
|
||||
| in pipelines: 02(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1] cpu-comparison-result=10 [max(10 (self) vs 1 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: (d_month_seq)
|
||||
| | runtime filters: RF002[bloom] <- (d_month_seq), RF003[min_max] <- (d_month_seq)
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1
|
||||
| |
|
||||
| 25:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=1 cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 0] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
|
||||
| 07:CARDINALITY CHECK
|
||||
| | limit: 1
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=1 cost=0
|
||||
| | in pipelines: 07(GETNEXT), 23(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [UNPARTITIONED]
|
||||
| | limit: 2
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=0
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [HASH((d_month_seq))] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=10.03MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[5, 1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
|
||||
| 23:AGGREGATE [FINALIZE]
|
||||
| | group by: (d_month_seq)
|
||||
| | limit: 2
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=5
|
||||
| | in pipelines: 23(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 22:EXCHANGE [HASH((d_month_seq))]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=30.03MB mem-reservation=6.25MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16764, 1]
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | group by: (d_month_seq)
|
||||
| | limit: 2
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=36
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 32:TUPLE CACHE
|
||||
| | cache key: b7f0c2e1b260aacf5110294e452f5df4
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: s.ss_sold_date_sk = d.d_date_sk
|
||||
| fk/pk conjuncts: s.ss_sold_date_sk = d.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=7.93G cost=3469762295
|
||||
| in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=58.57MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d.d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 21:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[11570]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| runtime filters: RF003[min_max] -> d.d_month_seq, RF002[bloom] -> d.d_month_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=73.05K cost=8415
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: c.c_current_addr_sk = a.ca_address_sk
|
||||
| fk/pk conjuncts: c.c_current_addr_sk = a.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0 row-size=64B cardinality=7.93G cost=3469762295
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=667.71MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: a.ca_address_sk
|
||||
| | runtime filters: RF006[bloom] <- a.ca_address_sk, RF007[min_max] <- a.ca_address_sk
|
||||
| | mem-estimate=641.49MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 20:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=18B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2349000]
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address a, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=18B cardinality=15.00M cost=1296000
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: s.ss_item_sk = i.i_item_sk
|
||||
| fk/pk conjuncts: s.ss_item_sk = i.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4 row-size=46B cardinality=7.93G cost=3470778966
|
||||
| in pipelines: 02(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=418.01MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: i.i_item_sk
|
||||
| | runtime filters: RF008[bloom] <- i.i_item_sk, RF009[min_max] <- i.i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=9.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=26B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[105038]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item i, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| runtime filters: RF001[min_max] -> i.i_category, RF000[bloom] -> i.i_category
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=26B cardinality=360.00K cost=72083
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: s.ss_customer_sk = c.c_customer_sk
|
||||
| fk/pk conjuncts: s.ss_customer_sk = c.c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1 row-size=20B cardinality=7.93G(filtered from 7.93G) cost=3471497176
|
||||
| in pipelines: 02(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[69869990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: c.c_customer_sk
|
||||
| | runtime filters: RF010[bloom] <- c.c_customer_sk, RF011[min_max] <- c.c_customer_sk
|
||||
| | mem-estimate=996.88MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=39869990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4752000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer c, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF007[min_max] -> c.c_current_addr_sk, RF006[bloom] -> c.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales s, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> s.ss_customer_sk, RF009[min_max] -> s.ss_item_sk, RF010[bloom] -> s.ss_customer_sk, RF008[bloom] -> s.ss_item_sk, RF004[bloom] -> s.ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=2 row-size=12B cardinality=7.93G(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 02(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.51GB Threads=29
|
||||
Per-Host Resource Estimates: Memory=2.67GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[11] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: a.ca_state, count(*)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
|
||||
|
|
||||
31:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: count(*) ASC, a.ca_state ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=22B cardinality=5 cost=1
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(a.ca_state)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=13.06MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: count(*) ASC, a.ca_state ASC
|
||||
| mem-estimate=110B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=22B cardinality=5 cost=6
|
||||
| in pipelines: 17(GETNEXT), 30(OPEN)
|
||||
|
|
||||
30:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*)
|
||||
| group by: a.ca_state
|
||||
| having: count(*) >= CAST(10 AS BIGINT)
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=5 cost=1923
|
||||
| in pipelines: 30(GETNEXT), 02(OPEN)
|
||||
|
|
||||
29:EXCHANGE [HASH(a.ca_state)]
|
||||
| mem-estimate=3.06MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=6.12K cost=1299
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
|
||||
Per-Instance Resources: mem-estimate=27.02MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=1750 segment-costs=[17411124290, 11823] cpu-comparison-result=120 [max(120 (self) vs 85 (sum children))]
|
||||
16:AGGREGATE [STREAMING]
|
||||
| output: count(*)
|
||||
| group by: a.ca_state
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=12 row-size=22B cardinality=6.12K cost=973710
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
15:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i.i_category = j.i_category
|
||||
| other join predicates: i.i_current_price > CAST(1.2 AS DECIMAL(2,1)) * avg(j.i_current_price)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=1433193
|
||||
| in pipelines: 02(GETNEXT), 27(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[20] cpu-comparison-result=10 [max(10 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: j.i_category
|
||||
| | runtime filters: RF000[bloom] <- j.i_category, RF001[min_max] <- j.i_category
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=10
|
||||
| |
|
||||
| 28:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=10
|
||||
| | in pipelines: 27(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [HASH(j.i_category)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[46, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 27:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(j.i_current_price)
|
||||
| | group by: j.i_category
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=26B cardinality=10 cost=37
|
||||
| | in pipelines: 27(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 26:EXCHANGE [HASH(j.i_category)]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=9
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=30.47MB mem-reservation=6.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156751, 87]
|
||||
| 33:TUPLE CACHE
|
||||
| | cache key: a893e9c3cc5e4f57d93d1bcda5a2e5f6
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 1.17KB
|
||||
| | estimated serialized size per node: 299B
|
||||
| | cumulative processing cost: 156751
|
||||
| | cache read processing cost: 5
|
||||
| | cache write processing cost: 3
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=0
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 09:AGGREGATE [STREAMING]
|
||||
| | output: avg(j.i_current_price)
|
||||
| | group by: j.i_category
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=26B cardinality=40 cost=105404
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item j, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
14:HASH JOIN [LEFT SEMI JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: d.d_month_seq = (d_month_seq)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=3.27M cost=2033935854
|
||||
| in pipelines: 02(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1] cpu-comparison-result=10 [max(10 (self) vs 1 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: (d_month_seq)
|
||||
| | runtime filters: RF002[bloom] <- (d_month_seq), RF003[min_max] <- (d_month_seq)
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1
|
||||
| |
|
||||
| 25:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=1 cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 0] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
|
||||
| 07:CARDINALITY CHECK
|
||||
| | limit: 1
|
||||
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=1 cost=0
|
||||
| | in pipelines: 07(GETNEXT), 23(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [UNPARTITIONED]
|
||||
| | limit: 2
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=0
|
||||
| | in pipelines: 23(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [HASH((d_month_seq))] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=10.03MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[5, 1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
|
||||
| 23:AGGREGATE [FINALIZE]
|
||||
| | group by: (d_month_seq)
|
||||
| | limit: 2
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=5
|
||||
| | in pipelines: 23(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 22:EXCHANGE [HASH((d_month_seq))]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=30.03MB mem-reservation=6.25MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16764, 1]
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | group by: (d_month_seq)
|
||||
| | limit: 2
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=4B cardinality=2 cost=36
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 32:TUPLE CACHE
|
||||
| | cache key: b7f0c2e1b260aacf5110294e452f5df4
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT), d_moy = CAST(3 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: s.ss_sold_date_sk = d.d_date_sk
|
||||
| fk/pk conjuncts: s.ss_sold_date_sk = d.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0,3 row-size=72B cardinality=7.93G cost=3469762295
|
||||
| in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=58.57MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d.d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 21:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=582.70KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[11570]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| runtime filters: RF003[min_max] -> d.d_month_seq, RF002[bloom] -> d.d_month_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=73.05K cost=8415
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: c.c_current_addr_sk = a.ca_address_sk
|
||||
| fk/pk conjuncts: c.c_current_addr_sk = a.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4,0 row-size=64B cardinality=7.93G cost=3469762295
|
||||
| in pipelines: 02(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=667.71MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: a.ca_address_sk
|
||||
| | runtime filters: RF006[bloom] <- a.ca_address_sk, RF007[min_max] <- a.ca_address_sk
|
||||
| | mem-estimate=641.49MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 20:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=18B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2349000]
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address a, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=18B cardinality=15.00M cost=1296000
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: s.ss_item_sk = i.i_item_sk
|
||||
| fk/pk conjuncts: s.ss_item_sk = i.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1,4 row-size=46B cardinality=7.93G cost=3470778966
|
||||
| in pipelines: 02(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=418.01MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: i.i_item_sk
|
||||
| | runtime filters: RF008[bloom] <- i.i_item_sk, RF009[min_max] <- i.i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=9.01MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=26B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[105038]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item i, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| runtime filters: RF001[min_max] -> i.i_category, RF000[bloom] -> i.i_category
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=26B cardinality=360.00K cost=72083
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: s.ss_customer_sk = c.c_customer_sk
|
||||
| fk/pk conjuncts: s.ss_customer_sk = c.c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,1 row-size=20B cardinality=7.93G(filtered from 7.93G) cost=3471497176
|
||||
| in pipelines: 02(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[69869990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: c.c_customer_sk
|
||||
| | runtime filters: RF010[bloom] <- c.c_customer_sk, RF011[min_max] <- c.c_customer_sk
|
||||
| | mem-estimate=996.88MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=39869990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4752000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer c, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF007[min_max] -> c.c_current_addr_sk, RF006[bloom] -> c.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales s, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> s.ss_customer_sk, RF009[min_max] -> s.ss_item_sk, RF010[bloom] -> s.ss_customer_sk, RF008[bloom] -> s.ss_item_sk, RF004[bloom] -> s.ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=2 row-size=12B cardinality=7.93G(filtered from 8.64G) cost=1492980801
|
||||
in pipelines: 02(GETNEXT)
|
||||
====
|
||||
643
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q07.test
vendored
Normal file
643
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q07.test
vendored
Normal file
@@ -0,0 +1,643 @@
|
||||
# TPCDS-Q7
|
||||
# start query 7 in stream 0 using template query7.tpl using seed 1719819282
|
||||
select i_item_id,
|
||||
avg(ss_quantity) agg1,
|
||||
avg(ss_list_price) agg2,
|
||||
avg(ss_coupon_amt) agg3,
|
||||
avg(ss_sales_price) agg4
|
||||
from store_sales, customer_demographics, date_dim, item, promotion
|
||||
where ss_sold_date_sk = d_date_sk and
|
||||
ss_item_sk = i_item_sk and
|
||||
ss_cdemo_sk = cd_demo_sk and
|
||||
ss_promo_sk = p_promo_sk and
|
||||
cd_gender = 'F' and
|
||||
cd_marital_status = 'W' and
|
||||
cd_education_status = 'College' and
|
||||
(p_channel_email = 'N' or p_channel_event = 'N') and
|
||||
d_year = 2001
|
||||
group by i_item_id
|
||||
order by i_item_id
|
||||
limit 100;
|
||||
|
||||
# end query 7 in stream 0 using template query7.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=79.38MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=142MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=142.38MB mem-reservation=79.38MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[1077538507, 1831104, 500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 360a3f5638dd84790bfdfb11909fef7a
|
||||
| input scan node ids: 0,1,2,3,4
|
||||
| estimated serialized size: 11.33MB
|
||||
| estimated serialized size per node: 1.13MB
|
||||
| cumulative processing cost: 1077538507
|
||||
| cache read processing cost: 24662
|
||||
| cache write processing cost: 32066
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=44930103
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: ss_promo_sk = p_promo_sk
|
||||
| runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=88.45M cost=38716502
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=88.45M cost=39086045
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734432
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: d5b454a6c85f99a675fb9765602684e9
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101209716
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 1b6714cbb1e22152d31588d0facd2fa3
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| parquet dictionary predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_promo_sk, RF003[min_max] -> ss_item_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_promo_sk, RF002[bloom] -> ss_item_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=881.41MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=1.08GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[537] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=63.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=37
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=27.50MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[19920797, 1831104, 188] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=11463003
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_item_id)]
|
||||
| mem-estimate=17.50MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=21.85M cost=8457794
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=25.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1132853166, 95681666] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=21.85M cost=101411308
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: ss_promo_sk = p_promo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=88.45M cost=38714702
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: p_promo_sk
|
||||
| | runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[390]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=88.45M cost=38726045
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734059
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d5b454a6c85f99a675fb9765602684e9
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101112317
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 1b6714cbb1e22152d31588d0facd2fa3
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| parquet dictionary predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_promo_sk, RF003[min_max] -> ss_item_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_promo_sk, RF002[bloom] -> ss_item_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=881.41MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=1.08GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[537] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=63.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=37
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=27.50MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[19920797, 1831104, 188] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=11463003
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_item_id)]
|
||||
| mem-estimate=17.50MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=21.85M cost=8457794
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=25.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1132853166, 95681666] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=21.85M cost=101411308
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: ss_promo_sk = p_promo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=88.45M cost=38714702
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: p_promo_sk
|
||||
| | runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[390]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=88.45M cost=38726045
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734059
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d5b454a6c85f99a675fb9765602684e9
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101112317
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 1b6714cbb1e22152d31588d0facd2fa3
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| parquet dictionary predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'College'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_promo_sk, RF003[min_max] -> ss_item_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_promo_sk, RF002[bloom] -> ss_item_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
998
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q08.test
vendored
Normal file
998
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q08.test
vendored
Normal file
@@ -0,0 +1,998 @@
|
||||
# TPCDS-Q8
|
||||
# start query 8 in stream 0 using template query8.tpl using seed 835798745
|
||||
select s_store_name
|
||||
,sum(ss_net_profit)
|
||||
from store_sales
|
||||
,date_dim
|
||||
,store,
|
||||
(select ca_zip
|
||||
from (
|
||||
SELECT substr(ca_zip,1,5) ca_zip
|
||||
FROM customer_address
|
||||
WHERE substr(ca_zip,1,5) IN (
|
||||
'47602','16704','35863','28577','83910','36201',
|
||||
'58412','48162','28055','41419','80332',
|
||||
'38607','77817','24891','16226','18410',
|
||||
'21231','59345','13918','51089','20317',
|
||||
'17167','54585','67881','78366','47770',
|
||||
'18360','51717','73108','14440','21800',
|
||||
'89338','45859','65501','34948','25973',
|
||||
'73219','25333','17291','10374','18829',
|
||||
'60736','82620','41351','52094','19326',
|
||||
'25214','54207','40936','21814','79077',
|
||||
'25178','75742','77454','30621','89193',
|
||||
'27369','41232','48567','83041','71948',
|
||||
'37119','68341','14073','16891','62878',
|
||||
'49130','19833','24286','27700','40979',
|
||||
'50412','81504','94835','84844','71954',
|
||||
'39503','57649','18434','24987','12350',
|
||||
'86379','27413','44529','98569','16515',
|
||||
'27287','24255','21094','16005','56436',
|
||||
'91110','68293','56455','54558','10298',
|
||||
'83647','32754','27052','51766','19444',
|
||||
'13869','45645','94791','57631','20712',
|
||||
'37788','41807','46507','21727','71836',
|
||||
'81070','50632','88086','63991','20244',
|
||||
'31655','51782','29818','63792','68605',
|
||||
'94898','36430','57025','20601','82080',
|
||||
'33869','22728','35834','29086','92645',
|
||||
'98584','98072','11652','78093','57553',
|
||||
'43830','71144','53565','18700','90209',
|
||||
'71256','38353','54364','28571','96560',
|
||||
'57839','56355','50679','45266','84680',
|
||||
'34306','34972','48530','30106','15371',
|
||||
'92380','84247','92292','68852','13338',
|
||||
'34594','82602','70073','98069','85066',
|
||||
'47289','11686','98862','26217','47529',
|
||||
'63294','51793','35926','24227','14196',
|
||||
'24594','32489','99060','49472','43432',
|
||||
'49211','14312','88137','47369','56877',
|
||||
'20534','81755','15794','12318','21060',
|
||||
'73134','41255','63073','81003','73873',
|
||||
'66057','51184','51195','45676','92696',
|
||||
'70450','90669','98338','25264','38919',
|
||||
'59226','58581','60298','17895','19489',
|
||||
'52301','80846','95464','68770','51634',
|
||||
'19988','18367','18421','11618','67975',
|
||||
'25494','41352','95430','15734','62585',
|
||||
'97173','33773','10425','75675','53535',
|
||||
'17879','41967','12197','67998','79658',
|
||||
'59130','72592','14851','43933','68101',
|
||||
'50636','25717','71286','24660','58058',
|
||||
'72991','95042','15543','33122','69280',
|
||||
'11912','59386','27642','65177','17672',
|
||||
'33467','64592','36335','54010','18767',
|
||||
'63193','42361','49254','33113','33159',
|
||||
'36479','59080','11855','81963','31016',
|
||||
'49140','29392','41836','32958','53163',
|
||||
'13844','73146','23952','65148','93498',
|
||||
'14530','46131','58454','13376','13378',
|
||||
'83986','12320','17193','59852','46081',
|
||||
'98533','52389','13086','68843','31013',
|
||||
'13261','60560','13443','45533','83583',
|
||||
'11489','58218','19753','22911','25115',
|
||||
'86709','27156','32669','13123','51933',
|
||||
'39214','41331','66943','14155','69998',
|
||||
'49101','70070','35076','14242','73021',
|
||||
'59494','15782','29752','37914','74686',
|
||||
'83086','34473','15751','81084','49230',
|
||||
'91894','60624','17819','28810','63180',
|
||||
'56224','39459','55233','75752','43639',
|
||||
'55349','86057','62361','50788','31830',
|
||||
'58062','18218','85761','60083','45484',
|
||||
'21204','90229','70041','41162','35390',
|
||||
'16364','39500','68908','26689','52868',
|
||||
'81335','40146','11340','61527','61794',
|
||||
'71997','30415','59004','29450','58117',
|
||||
'69952','33562','83833','27385','61860',
|
||||
'96435','48333','23065','32961','84919',
|
||||
'61997','99132','22815','56600','68730',
|
||||
'48017','95694','32919','88217','27116',
|
||||
'28239','58032','18884','16791','21343',
|
||||
'97462','18569','75660','15475')
|
||||
intersect
|
||||
select ca_zip
|
||||
from (SELECT substr(ca_zip,1,5) ca_zip,count(*) cnt
|
||||
FROM customer_address, customer
|
||||
WHERE ca_address_sk = c_current_addr_sk and
|
||||
c_preferred_cust_flag='Y'
|
||||
group by ca_zip
|
||||
having count(*) > 10)A1)A2) V1
|
||||
where ss_store_sk = s_store_sk
|
||||
and ss_sold_date_sk = d_date_sk
|
||||
and d_qoy = 2 and d_year = 1998
|
||||
and (substr(s_zip,1,2) = substr(V1.ca_zip,1,2))
|
||||
group by s_store_name
|
||||
order by s_store_name
|
||||
limit 100;
|
||||
|
||||
# end query 8 in stream 0 using template query8.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=97.52MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=793MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=792.83MB mem-reservation=97.52MB thread-reservation=1 runtime-filters-memory=19.00MB
|
||||
| max-parallelism=1 segment-costs=[1966767, 30017347, 1566875613, 18, 20]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, sum(ss_net_profit)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20
|
||||
|
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC
|
||||
| mem-estimate=320B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=32B cardinality=10 cost=18
|
||||
| in pipelines: 14(GETNEXT), 13(OPEN)
|
||||
|
|
||||
21:TUPLE CACHE
|
||||
| cache key: 7f78511b7225f69a75ad26b7b1059f94
|
||||
| input scan node ids: 0,1,2,3,5,6
|
||||
| estimated serialized size: 359B
|
||||
| estimated serialized size per node: 35B
|
||||
| cumulative processing cost: 1598859727
|
||||
| cache read processing cost: 1
|
||||
| cache write processing cost: 0
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=10 cost=0
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
13:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_net_profit)
|
||||
| group by: s_store_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=10 cost=257705987
|
||||
| in pipelines: 13(GETNEXT), 00(OPEN)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: substr(s_zip, 1, 2) = substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| fk/pk conjuncts: assumed fk/pk
|
||||
| runtime filters: RF000[bloom] <- substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,4 row-size=73B cardinality=881.05M cost=385634861
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--20:TUPLE CACHE
|
||||
| | cache key: 52b0203907d722c54859fc7cb2062845
|
||||
| | input scan node ids: 3,5,6
|
||||
| | estimated serialized size: 15.89KB
|
||||
| | estimated serialized size per node: 1.59KB
|
||||
| | cumulative processing cost: 31987924
|
||||
| | cache read processing cost: 135
|
||||
| | cache write processing cost: 43
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 09:HASH JOIN [LEFT SEMI JOIN]
|
||||
| | hash predicates: substr(ca_zip, 1, 5) IS NOT DISTINCT FROM substr(ca_zip, 1, 5)
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=3810
|
||||
| | in pipelines: 04(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| |--19:TUPLE CACHE
|
||||
| | | cache key: afb30b4e5368f17b141fda9b49c49697
|
||||
| | | input scan node ids: 5,6
|
||||
| | | estimated serialized size: 23.84KB
|
||||
| | | estimated serialized size per node: 2.38KB
|
||||
| | | cumulative processing cost: 30017347
|
||||
| | | cache read processing cost: 135
|
||||
| | | cache write processing cost: 65
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=1.02K cost=0
|
||||
| | | in pipelines: 08(GETNEXT)
|
||||
| | |
|
||||
| | 08:AGGREGATE [FINALIZE]
|
||||
| | | output: count(*)
|
||||
| | | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | | having: count(*) > CAST(10 AS BIGINT)
|
||||
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=1.02K cost=4260317
|
||||
| | | in pipelines: 08(GETNEXT), 05(OPEN)
|
||||
| | |
|
||||
| | 18:TUPLE CACHE
|
||||
| | | cache key: 50696ae803aead47b64858a39985d598
|
||||
| | | input scan node ids: 5,6
|
||||
| | | estimated serialized size: 634.98MB
|
||||
| | | estimated serialized size per node: 63.50MB
|
||||
| | | cumulative processing cost: 25757030
|
||||
| | | cache read processing cost: 1923664
|
||||
| | | cache write processing cost: 1797736
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=6,7 row-size=38B cardinality=14.47M cost=0
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN]
|
||||
| | | hash predicates: ca_address_sk = c_current_addr_sk
|
||||
| | | fk/pk conjuncts: none
|
||||
| | | runtime filters: RF006[bloom] <- c_current_addr_sk, RF007[min_max] <- c_current_addr_sk
|
||||
| | | mem-estimate=635.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=6,7 row-size=38B cardinality=14.47M cost=20810030
|
||||
| | | in pipelines: 05(GETNEXT), 06(OPEN)
|
||||
| | |
|
||||
| | |--06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| | | HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=30.00M size=1.55GB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| | | parquet statistics predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | parquet dictionary predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=17B cardinality=14.47M cost=3003000
|
||||
| | | in pipelines: 06(GETNEXT)
|
||||
| | |
|
||||
| | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | runtime filters: RF007[min_max] -> ca_address_sk, RF006[bloom] -> ca_address_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=15.00M size=307.36MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=21B cardinality=14.47M(filtered from 15.00M) cost=1944000
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 17:TUPLE CACHE
|
||||
| | cache key: 3a61319f42951b9203a7c2bd35534b51
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 158.92KB
|
||||
| | estimated serialized size per node: 15.89KB
|
||||
| | cumulative processing cost: 1966767
|
||||
| | cache read processing cost: 1351
|
||||
| | cache write processing cost: 439
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=10.17K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:AGGREGATE [FINALIZE]
|
||||
| | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=10.17K cost=465267
|
||||
| | in pipelines: 04(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: 4f45ce8267a2591615d38fcb6be274f5
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 30.04MB
|
||||
| | estimated serialized size per node: 3.00MB
|
||||
| | cumulative processing cost: 1501500
|
||||
| | cache read processing cost: 199350
|
||||
| | cache write processing cost: 85050
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=17B cardinality=1.50M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| parquet dictionary predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=17B cardinality=1.50M cost=1501500
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=61B cardinality=881.05M cost=385635194
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF000[bloom] -> substr(s_zip, 1, 2)
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=37B cardinality=1.35K cost=251
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=24B cardinality=881.05M cost=385634030
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 20ceadaa7e4243f07503c78986816837
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=881.05M(filtered from 8.64G) cost=152244752
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=291.27MB Threads=26
|
||||
Per-Host Resource Estimates: Memory=677MB
|
||||
F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[23] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, sum(ss_net_profit)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=32B cardinality=10 cost=3
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F09:PLAN FRAGMENT [HASH(s_store_name)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=14.22MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[686, 18, 11] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC
|
||||
| mem-estimate=320B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=32B cardinality=10 cost=18
|
||||
| in pipelines: 14(GETNEXT), 25(OPEN)
|
||||
|
|
||||
25:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_net_profit)
|
||||
| group by: s_store_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=10 cost=377
|
||||
| in pipelines: 25(GETNEXT), 00(OPEN)
|
||||
|
|
||||
24:EXCHANGE [HASH(s_store_name)]
|
||||
| mem-estimate=4.22MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=1.20K cost=309
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=27.40MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1566855374, 3086] cpu-comparison-result=120 [max(120 (self) vs 52 (sum children))]
|
||||
13:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_net_profit)
|
||||
| group by: s_store_name
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=1.20K cost=257709090
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: substr(s_zip, 1, 2) = substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| fk/pk conjuncts: assumed fk/pk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,4 row-size=73B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 18(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[2367] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| | runtime filters: RF000[bloom] <- substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1017
|
||||
| |
|
||||
| 23:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=170.82KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=1350
|
||||
| | in pipelines: 18(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [HASH(substr(ca_zip, 1, 5))] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=10.27MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[73182, 2847] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
| 09:HASH JOIN [LEFT SEMI JOIN, PARTITIONED]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: substr(ca_zip, 1, 5) IS NOT DISTINCT FROM substr(ca_zip, 1, 5)
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=2793
|
||||
| | in pipelines: 18(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| |--F12:PLAN FRAGMENT [HASH(substr(ca_zip, 1, 5))] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=11.94MB mem-reservation=3.88MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[76925, 1017] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: substr(ca_zip, 1, 5)
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1017
|
||||
| | |
|
||||
| | 22:AGGREGATE [FINALIZE]
|
||||
| | | output: count:merge(*)
|
||||
| | | group by: substr(ca_zip, 1, 5)
|
||||
| | | having: count(*) > CAST(10 AS BIGINT)
|
||||
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=1.02K cost=56268
|
||||
| | | in pipelines: 22(GETNEXT), 05(OPEN)
|
||||
| | |
|
||||
| | 21:EXCHANGE [HASH(substr(ca_zip, 1, 5))]
|
||||
| | | mem-estimate=438.65KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=101.71K cost=20657
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | F07:PLAN FRAGMENT [HASH(ca_address_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=21.18MB mem-reservation=2.00MB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[13840838, 183403] cpu-comparison-result=20 [max(20 (self) vs 20 (sum children))]
|
||||
| | 08:AGGREGATE [STREAMING]
|
||||
| | | output: count(*)
|
||||
| | | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=101.71K cost=4498978
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| | | hash-table-id=02
|
||||
| | | hash predicates: ca_address_sk = c_current_addr_sk
|
||||
| | | fk/pk conjuncts: none
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=6,7 row-size=38B cardinality=14.47M cost=6335501
|
||||
| | | in pipelines: 05(GETNEXT), 06(OPEN)
|
||||
| | |
|
||||
| | |--F13:PLAN FRAGMENT [HASH(ca_address_sk)] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=89.80MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[17214557]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=02 plan-id=03 cohort-id=03
|
||||
| | | | build expressions: c_current_addr_sk
|
||||
| | | | runtime filters: RF006[bloom] <- c_current_addr_sk, RF007[min_max] <- c_current_addr_sk
|
||||
| | | | mem-estimate=63.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=14474529
|
||||
| | | |
|
||||
| | | 20:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=7 row-size=17B cardinality=14.47M cost=2740028
|
||||
| | | | in pipelines: 06(GETNEXT)
|
||||
| | | |
|
||||
| | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=16.82MB mem-reservation=1.00MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[26306991]
|
||||
| | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| | | predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=30.00M size=1.55GB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| | | parquet statistics predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | parquet dictionary predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=17B cardinality=14.47M cost=3003000
|
||||
| | | in pipelines: 06(GETNEXT)
|
||||
| | |
|
||||
| | 19:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=6 row-size=21B cardinality=14.47M(filtered from 15.00M) cost=3006359
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.98MB mem-reservation=128.00KB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[28976630]
|
||||
| | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | runtime filters: RF007[min_max] -> ca_address_sk, RF006[bloom] -> ca_address_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=15.00M size=307.36MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=21B cardinality=14.47M(filtered from 15.00M) cost=1944000
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 18:AGGREGATE [FINALIZE]
|
||||
| | group by: substr(ca_zip, 1, 5)
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=10.17K cost=56268
|
||||
| | in pipelines: 18(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 17:EXCHANGE [HASH(substr(ca_zip, 1, 5))]
|
||||
| | mem-estimate=279.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=16914
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=34.62MB mem-reservation=10.12MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2205428, 131002]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 4d24de797ac33df5c3a10bc7019e9bba
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 1.55MB
|
||||
| | estimated serialized size per node: 158.92KB
|
||||
| | cumulative processing cost: 2205428
|
||||
| | cache read processing cost: 13517
|
||||
| | cache write processing cost: 4393
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 04:AGGREGATE [STREAMING]
|
||||
| | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=703928
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: 4f45ce8267a2591615d38fcb6be274f5
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 30.04MB
|
||||
| | estimated serialized size per node: 3.00MB
|
||||
| | cumulative processing cost: 1501500
|
||||
| | cache read processing cost: 199350
|
||||
| | cache write processing cost: 85050
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=17B cardinality=1.50M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| parquet dictionary predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=17B cardinality=1.50M cost=1501500
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=61B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=89.64KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=37B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[414]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF000[bloom] -> substr(s_zip, 1, 2)
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=37B cardinality=1.35K cost=251
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=24B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 20ceadaa7e4243f07503c78986816837
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=881.05M(filtered from 8.64G) cost=152244752
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=291.27MB Threads=26
|
||||
Per-Host Resource Estimates: Memory=677MB
|
||||
F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[23] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, sum(ss_net_profit)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=32B cardinality=10 cost=3
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F09:PLAN FRAGMENT [HASH(s_store_name)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=14.22MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[686, 18, 11] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC
|
||||
| mem-estimate=320B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=32B cardinality=10 cost=18
|
||||
| in pipelines: 14(GETNEXT), 25(OPEN)
|
||||
|
|
||||
25:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_net_profit)
|
||||
| group by: s_store_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=10 cost=377
|
||||
| in pipelines: 25(GETNEXT), 00(OPEN)
|
||||
|
|
||||
24:EXCHANGE [HASH(s_store_name)]
|
||||
| mem-estimate=4.22MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=1.20K cost=309
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=27.40MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1566855374, 3086] cpu-comparison-result=120 [max(120 (self) vs 52 (sum children))]
|
||||
13:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_net_profit)
|
||||
| group by: s_store_name
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=32B cardinality=1.20K cost=257709090
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: substr(s_zip, 1, 2) = substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| fk/pk conjuncts: assumed fk/pk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,4 row-size=73B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 18(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[2367] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| | runtime filters: RF000[bloom] <- substr(substr(ca_zip, 1, 5), 1, 2)
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1017
|
||||
| |
|
||||
| 23:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=170.82KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=1350
|
||||
| | in pipelines: 18(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [HASH(substr(ca_zip, 1, 5))] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=10.27MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[73182, 2847] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
| 09:HASH JOIN [LEFT SEMI JOIN, PARTITIONED]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: substr(ca_zip, 1, 5) IS NOT DISTINCT FROM substr(ca_zip, 1, 5)
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=1.02K cost=2793
|
||||
| | in pipelines: 18(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| |--F12:PLAN FRAGMENT [HASH(substr(ca_zip, 1, 5))] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=11.94MB mem-reservation=3.88MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[76925, 1017] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: substr(ca_zip, 1, 5)
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1017
|
||||
| | |
|
||||
| | 22:AGGREGATE [FINALIZE]
|
||||
| | | output: count:merge(*)
|
||||
| | | group by: substr(ca_zip, 1, 5)
|
||||
| | | having: count(*) > CAST(10 AS BIGINT)
|
||||
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=1.02K cost=56268
|
||||
| | | in pipelines: 22(GETNEXT), 05(OPEN)
|
||||
| | |
|
||||
| | 21:EXCHANGE [HASH(substr(ca_zip, 1, 5))]
|
||||
| | | mem-estimate=438.65KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=101.71K cost=20657
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | F07:PLAN FRAGMENT [HASH(ca_address_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=21.18MB mem-reservation=2.00MB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[13840838, 183403] cpu-comparison-result=20 [max(20 (self) vs 20 (sum children))]
|
||||
| | 08:AGGREGATE [STREAMING]
|
||||
| | | output: count(*)
|
||||
| | | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=20B cardinality=101.71K cost=4498978
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| | | hash-table-id=02
|
||||
| | | hash predicates: ca_address_sk = c_current_addr_sk
|
||||
| | | fk/pk conjuncts: none
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=6,7 row-size=38B cardinality=14.47M cost=6335501
|
||||
| | | in pipelines: 05(GETNEXT), 06(OPEN)
|
||||
| | |
|
||||
| | |--F13:PLAN FRAGMENT [HASH(ca_address_sk)] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=89.80MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[17214557]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=02 plan-id=03 cohort-id=03
|
||||
| | | | build expressions: c_current_addr_sk
|
||||
| | | | runtime filters: RF006[bloom] <- c_current_addr_sk, RF007[min_max] <- c_current_addr_sk
|
||||
| | | | mem-estimate=63.60MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=14474529
|
||||
| | | |
|
||||
| | | 20:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| | | | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=7 row-size=17B cardinality=14.47M cost=2740028
|
||||
| | | | in pipelines: 06(GETNEXT)
|
||||
| | | |
|
||||
| | | F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=16.82MB mem-reservation=1.00MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[26306991]
|
||||
| | | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| | | predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=30.00M size=1.55GB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| | | parquet statistics predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | parquet dictionary predicates: c_preferred_cust_flag = 'Y'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=17B cardinality=14.47M cost=3003000
|
||||
| | | in pipelines: 06(GETNEXT)
|
||||
| | |
|
||||
| | 19:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=6 row-size=21B cardinality=14.47M(filtered from 15.00M) cost=3006359
|
||||
| | | in pipelines: 05(GETNEXT)
|
||||
| | |
|
||||
| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.98MB mem-reservation=128.00KB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[28976630]
|
||||
| | 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | runtime filters: RF007[min_max] -> ca_address_sk, RF006[bloom] -> ca_address_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=15.00M size=307.36MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=21B cardinality=14.47M(filtered from 15.00M) cost=1944000
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 18:AGGREGATE [FINALIZE]
|
||||
| | group by: substr(ca_zip, 1, 5)
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=10.17K cost=56268
|
||||
| | in pipelines: 18(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 17:EXCHANGE [HASH(substr(ca_zip, 1, 5))]
|
||||
| | mem-estimate=279.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=16914
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=34.62MB mem-reservation=10.12MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2205428, 131002]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 4d24de797ac33df5c3a10bc7019e9bba
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 1.55MB
|
||||
| | estimated serialized size per node: 158.92KB
|
||||
| | cumulative processing cost: 2205428
|
||||
| | cache read processing cost: 13517
|
||||
| | cache write processing cost: 4393
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 04:AGGREGATE [STREAMING]
|
||||
| | group by: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=101.71K cost=703928
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: 4f45ce8267a2591615d38fcb6be274f5
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 30.04MB
|
||||
| | estimated serialized size per node: 3.00MB
|
||||
| | cumulative processing cost: 1501500
|
||||
| | cache read processing cost: 199350
|
||||
| | cache write processing cost: 85050
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=17B cardinality=1.50M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| parquet dictionary predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('47602', '16704', '35863', '28577', '83910', '36201', '58412', '48162', '28055', '41419', '80332', '38607', '77817', '24891', '16226', '18410', '21231', '59345', '13918', '51089', '20317', '17167', '54585', '67881', '78366', '47770', '18360', '51717', '73108', '14440', '21800', '89338', '45859', '65501', '34948', '25973', '73219', '25333', '17291', '10374', '18829', '60736', '82620', '41351', '52094', '19326', '25214', '54207', '40936', '21814', '79077', '25178', '75742', '77454', '30621', '89193', '27369', '41232', '48567', '83041', '71948', '37119', '68341', '14073', '16891', '62878', '49130', '19833', '24286', '27700', '40979', '50412', '81504', '94835', '84844', '71954', '39503', '57649', '18434', '24987', '12350', '86379', '27413', '44529', '98569', '16515', '27287', '24255', '21094', '16005', '56436', '91110', '68293', '56455', '54558', '10298', '83647', '32754', '27052', '51766', '19444', '13869', '45645', '94791', '57631', '20712', '37788', '41807', '46507', '21727', '71836', '81070', '50632', '88086', '63991', '20244', '31655', '51782', '29818', '63792', '68605', '94898', '36430', '57025', '20601', '82080', '33869', '22728', '35834', '29086', '92645', '98584', '98072', '11652', '78093', '57553', '43830', '71144', '53565', '18700', '90209', '71256', '38353', '54364', '28571', '96560', '57839', '56355', '50679', '45266', '84680', '34306', '34972', '48530', '30106', '15371', '92380', '84247', '92292', '68852', '13338', '34594', '82602', '70073', '98069', '85066', '47289', '11686', '98862', '26217', '47529', '63294', '51793', '35926', '24227', '14196', '24594', '32489', '99060', '49472', '43432', '49211', '14312', '88137', '47369', '56877', '20534', '81755', '15794', '12318', '21060', '73134', '41255', '63073', '81003', '73873', '66057', '51184', '51195', '45676', '92696', '70450', '90669', '98338', '25264', '38919', '59226', '58581', '60298', '17895', '19489', '52301', '80846', '95464', '68770', '51634', '19988', '18367', '18421', '11618', '67975', '25494', '41352', '95430', '15734', '62585', '97173', '33773', '10425', '75675', '53535', '17879', '41967', '12197', '67998', '79658', '59130', '72592', '14851', '43933', '68101', '50636', '25717', '71286', '24660', '58058', '72991', '95042', '15543', '33122', '69280', '11912', '59386', '27642', '65177', '17672', '33467', '64592', '36335', '54010', '18767', '63193', '42361', '49254', '33113', '33159', '36479', '59080', '11855', '81963', '31016', '49140', '29392', '41836', '32958', '53163', '13844', '73146', '23952', '65148', '93498', '14530', '46131', '58454', '13376', '13378', '83986', '12320', '17193', '59852', '46081', '98533', '52389', '13086', '68843', '31013', '13261', '60560', '13443', '45533', '83583', '11489', '58218', '19753', '22911', '25115', '86709', '27156', '32669', '13123', '51933', '39214', '41331', '66943', '14155', '69998', '49101', '70070', '35076', '14242', '73021', '59494', '15782', '29752', '37914', '74686', '83086', '34473', '15751', '81084', '49230', '91894', '60624', '17819', '28810', '63180', '56224', '39459', '55233', '75752', '43639', '55349', '86057', '62361', '50788', '31830', '58062', '18218', '85761', '60083', '45484', '21204', '90229', '70041', '41162', '35390', '16364', '39500', '68908', '26689', '52868', '81335', '40146', '11340', '61527', '61794', '71997', '30415', '59004', '29450', '58117', '69952', '33562', '83833', '27385', '61860', '96435', '48333', '23065', '32961', '84919', '61997', '99132', '22815', '56600', '68730', '48017', '95694', '32919', '88217', '27116', '28239', '58032', '18884', '16791', '21343', '97462', '18569', '75660', '15475')
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=17B cardinality=1.50M cost=1501500
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=61B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=89.64KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=37B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.16MB mem-reservation=24.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[414]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF000[bloom] -> substr(s_zip, 1, 2)
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=37B cardinality=1.35K cost=251
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=24B cardinality=881.05M cost=385633844
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 20ceadaa7e4243f07503c78986816837
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1998 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=881.05M(filtered from 8.64G) cost=152244752
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
2948
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q09.test
vendored
Normal file
2948
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q09.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1376
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q10a.test
vendored
Normal file
1376
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q10a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1736
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q11.test
vendored
Normal file
1736
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q11.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
530
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q12.test
vendored
Normal file
530
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q12.test
vendored
Normal file
@@ -0,0 +1,530 @@
|
||||
# TPCDS-Q12
|
||||
# start query 12 in stream 0 using template query12.tpl using seed 1152269469
|
||||
select i_item_id
|
||||
,i_item_desc
|
||||
,i_category
|
||||
,i_class
|
||||
,i_current_price
|
||||
,sum(ws_ext_sales_price) as itemrevenue
|
||||
,sum(ws_ext_sales_price)*100/sum(sum(ws_ext_sales_price)) over
|
||||
(partition by i_class) as revenueratio
|
||||
from
|
||||
web_sales
|
||||
,item
|
||||
,date_dim
|
||||
where
|
||||
ws_item_sk = i_item_sk
|
||||
and i_category in ('Men', 'Books', 'Children')
|
||||
and ws_sold_date_sk = d_date_sk
|
||||
and d_date between cast('1998-03-28' as date)
|
||||
and (cast('1998-03-28' as date) + interval 30 days)
|
||||
group by
|
||||
i_item_id
|
||||
,i_item_desc
|
||||
,i_category
|
||||
,i_class
|
||||
,i_current_price
|
||||
order by
|
||||
i_category
|
||||
,i_class
|
||||
,i_item_id
|
||||
,i_item_desc
|
||||
,revenueratio
|
||||
limit 100;
|
||||
|
||||
# end query 12 in stream 0 using template query12.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=80.06MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=696MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=696.05MB mem-reservation=80.06MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[51425338, 3251818, 4106309, 700]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(ws_ext_sales_price), sum(ws_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(ws_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ws_ext_sales_price) * 100 / sum(sum(ws_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(ws_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=68.08MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: e9408c49bb88867efe6f31c51499463c
|
||||
| input scan node ids: 0,2,1
|
||||
| estimated serialized size: 69.45MB
|
||||
| estimated serialized size per node: 6.95MB
|
||||
| cumulative processing cost: 51425338
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 196628
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(ws_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=617.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=16755653
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=11.01M cost=11518667
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: 914e17729c5dd643d4537d04b07dfbc6
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| parquet dictionary predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=36.71M cost=16067990
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--09:TUPLE CACHE
|
||||
| | cache key: d5d9c1c0aa89918256df490f17086092
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ws_item_sk, RF000[bloom] -> ws_item_sk, RF002[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=32(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=36.71M(filtered from 2.16G) cost=6343484
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=207.62MB Threads=9
|
||||
Per-Host Resource Estimates: Memory=579MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[768] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(ws_ext_sales_price), sum(ws_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(ws_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ws_ext_sales_price) * 100 / sum(sum(ws_ext_sales_price)) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=215.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=68
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_class)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=24.78MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3620186, 4106309, 592] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ws_ext_sales_price) * 100 / sum(sum(ws_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(ws_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 12(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_class)]
|
||||
| mem-estimate=8.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=368368
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=208.83MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[24925558, 4782688] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ws_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=194.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=14982554
|
||||
| in pipelines: 12(GETNEXT), 00(OPEN)
|
||||
|
|
||||
11:EXCHANGE [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)]
|
||||
| mem-estimate=13.95MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=9.72M cost=9943004
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=106.69MB mem-reservation=34.12MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[92951481, 129094315] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ws_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=82.78MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=9.72M cost=59129371
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=11.01M cost=11410667
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=79.74MB mem-reservation=69.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[251530]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=68.00MB mem-reservation=68.00MB spill-buffer=2.00MB thread-reservation=0 cost=108000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.74MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=143530
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.74MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[783679]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: 914e17729c5dd643d4537d04b07dfbc6
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| parquet dictionary predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=36.71M cost=16067959
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12521]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: d5d9c1c0aa89918256df490f17086092
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
runtime filters: RF001[min_max] -> ws_item_sk, RF000[bloom] -> ws_item_sk, RF002[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=32(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=36.71M(filtered from 2.16G) cost=6343484
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=207.62MB Threads=9
|
||||
Per-Host Resource Estimates: Memory=579MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[768] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(ws_ext_sales_price), sum(ws_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(ws_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ws_ext_sales_price) * 100 / sum(sum(ws_ext_sales_price)) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=215.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=68
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_class)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=24.78MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3620186, 4106309, 592] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(ws_ext_sales_price) * 100 / sum(sum(ws_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(ws_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 12(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_class)]
|
||||
| mem-estimate=8.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=368368
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=208.83MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[24925558, 4782688] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ws_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=194.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=14982554
|
||||
| in pipelines: 12(GETNEXT), 00(OPEN)
|
||||
|
|
||||
11:EXCHANGE [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)]
|
||||
| mem-estimate=13.95MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=9.72M cost=9943004
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=106.69MB mem-reservation=34.12MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[92951481, 129094315] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ws_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=82.78MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=9.72M cost=59129371
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=11.01M cost=11410667
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=79.74MB mem-reservation=69.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[251530]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=68.00MB mem-reservation=68.00MB spill-buffer=2.00MB thread-reservation=0 cost=108000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.74MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=143530
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.74MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[783679]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: 914e17729c5dd643d4537d04b07dfbc6
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| parquet dictionary predicates: i_category IN ('Men', 'Books', 'Children')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=36.71M cost=16067959
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12521]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: d5d9c1c0aa89918256df490f17086092
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-04-27', d_date >= DATE '1998-03-28'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
runtime filters: RF001[min_max] -> ws_item_sk, RF000[bloom] -> ws_item_sk, RF002[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=32(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=36.71M(filtered from 2.16G) cost=6343484
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
954
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q13.test
vendored
Normal file
954
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q13.test
vendored
Normal file
File diff suppressed because one or more lines are too long
7277
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q14a.test
vendored
Normal file
7277
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q14a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
4989
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q14b.test
vendored
Normal file
4989
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q14b.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
532
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q15.test
vendored
Normal file
532
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q15.test
vendored
Normal file
@@ -0,0 +1,532 @@
|
||||
# TPCDS-Q15
|
||||
# start query 15 in stream 0 using template query15.tpl using seed 1723782992
|
||||
select ca_zip
|
||||
,sum(cs_sales_price)
|
||||
from catalog_sales
|
||||
,customer
|
||||
,customer_address
|
||||
,date_dim
|
||||
where cs_bill_customer_sk = c_customer_sk
|
||||
and c_current_addr_sk = ca_address_sk
|
||||
and ( substr(ca_zip,1,5) in ('85669', '86197','88274','83405','86475',
|
||||
'85392', '85460', '80348', '81792')
|
||||
or ca_state in ('CA','WA','GA')
|
||||
or cs_sales_price > 500)
|
||||
and cs_sold_date_sk = d_date_sk
|
||||
and d_qoy = 1 and d_year = 2000
|
||||
group by ca_zip
|
||||
order by ca_zip
|
||||
limit 100;
|
||||
|
||||
# end query 15 in stream 0 using template query15.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=113.56MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=1.94GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=1.94GB mem-reservation=113.56MB thread-reservation=1 runtime-filters-memory=33.00MB
|
||||
| max-parallelism=1 segment-costs=[798518145, 76337, 200]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, sum(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
|
||||
|
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC
|
||||
| mem-estimate=3.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=33B cardinality=100 cost=76337
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
10:TUPLE CACHE
|
||||
| cache key: 115753d264c56ec5ab4fe6daafeee106
|
||||
| input scan node ids: 0,3,1,2
|
||||
| estimated serialized size: 367.51KB
|
||||
| estimated serialized size per node: 36.75KB
|
||||
| cumulative processing cost: 798518145
|
||||
| cache read processing cost: 1351
|
||||
| cache write processing cost: 1016
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=10.17K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| output: sum(cs_sales_price)
|
||||
| group by: ca_zip
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=10.17K cost=117860849
|
||||
| in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR ca_state IN ('CA', 'WA', 'GA') OR cs_sales_price > CAST(500 AS DECIMAL(5,0)))
|
||||
| runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| mem-estimate=884.68MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=67B cardinality=402.85M cost=191328502
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=35B cardinality=15.00M cost=2376000
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: cs_bill_customer_sk = c_customer_sk
|
||||
| runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| mem-estimate=996.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=32B cardinality=402.85M cost=215561904
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=24B cardinality=438.85M cost=192084868
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--09:TUPLE CACHE
|
||||
| | cache key: eccc14a9d15ea20bf0a9d5d630df955b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> cs_bill_customer_sk, RF002[bloom] -> cs_bill_customer_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=187(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=438.85M(filtered from 4.32G) cost=75833294
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=693.06MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=2.25GB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[231] cpu-comparison-result=80 [max(1 (self) vs 80 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, sum(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: ca_zip ASC
|
||||
| limit: 100
|
||||
| mem-estimate=36.46KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=33B cardinality=100 cost=31
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(ca_zip)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.73MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[704393, 76337, 117] cpu-comparison-result=80 [max(10 (self) vs 80 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC
|
||||
| mem-estimate=3.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=33B cardinality=100 cost=76337
|
||||
| in pipelines: 08(GETNEXT), 13(OPEN)
|
||||
|
|
||||
13:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_sales_price)
|
||||
| group by: ca_zip
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=10.17K cost=383519
|
||||
| in pipelines: 13(GETNEXT), 00(OPEN)
|
||||
|
|
||||
12:EXCHANGE [HASH(ca_zip)]
|
||||
| mem-estimate=6.73MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=1.22M cost=320874
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=80 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
|
||||
Per-Instance Resources: mem-estimate=31.45MB mem-reservation=7.00MB thread-reservation=1
|
||||
max-parallelism=80 segment-costs=[750824853, 3222661] cpu-comparison-result=80 [max(80 (self) vs 51 (sum children))]
|
||||
16:TUPLE CACHE
|
||||
| cache key: 55ad2f25fd2162e01e208f13d1df7010
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 43.07MB
|
||||
| estimated serialized size per node: 4.31MB
|
||||
| cumulative processing cost: 864516497
|
||||
| cache read processing cost: 162207
|
||||
| cache write processing cost: 121929
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=1.22M cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(cs_sales_price)
|
||||
| group by: ca_zip
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=1.22M cost=121016471
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR ca_state IN ('CA', 'WA', 'GA') OR cs_sales_price > CAST(500 AS DECIMAL(5,0)))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=67B cardinality=402.85M cost=176328502
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=911.06MB mem-reservation=288.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| | mem-estimate=884.68MB mem-reservation=272.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.38MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=35B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.15MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4117500]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=35B cardinality=15.00M cost=2376000
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: cs_bill_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=32B cardinality=402.85M cost=185561904
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=288.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[69869990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=996.88MB mem-reservation=272.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=39869990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4752000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=24B cardinality=438.85M cost=192084682
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=16.52MB mem-reservation=16.50MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=15.50MB mem-reservation=15.50MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: eccc14a9d15ea20bf0a9d5d630df955b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> cs_bill_customer_sk, RF002[bloom] -> cs_bill_customer_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=187(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=438.85M(filtered from 4.32G) cost=75833294
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=764.81MB Threads=29
|
||||
Per-Host Resource Estimates: Memory=1.85GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[231] cpu-comparison-result=170 [max(1 (self) vs 170 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, sum(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
|
||||
|
|
||||
15:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: ca_zip ASC
|
||||
| limit: 100
|
||||
| mem-estimate=36.46KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=33B cardinality=100 cost=31
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(ca_zip)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=15.65MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[704393, 76337, 117] cpu-comparison-result=170 [max(10 (self) vs 170 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC
|
||||
| mem-estimate=3.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=33B cardinality=100 cost=76337
|
||||
| in pipelines: 08(GETNEXT), 14(OPEN)
|
||||
|
|
||||
14:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_sales_price)
|
||||
| group by: ca_zip
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=10.17K cost=383519
|
||||
| in pipelines: 14(GETNEXT), 00(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(ca_zip)]
|
||||
| mem-estimate=5.65MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=1.22M cost=320874
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=26.60MB mem-reservation=2.00MB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[431051689, 3222661] cpu-comparison-result=170 [max(170 (self) vs 91 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(cs_sales_price)
|
||||
| group by: ca_zip
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=33B cardinality=1.22M cost=121016471
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR ca_state IN ('CA', 'WA', 'GA') OR cs_sales_price > CAST(500 AS DECIMAL(5,0)))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=67B cardinality=402.85M cost=176328502
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=50 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=60.38MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=50 segment-costs=[19081500]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 12:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | mem-estimate=10.38MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=35B cardinality=15.00M cost=4081500
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=23.62MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[43914000]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=35B cardinality=15.00M cost=2376000
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
11:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| mem-estimate=15.16MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=32B cardinality=402.85M cost=133706716
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
|
||||
Per-Instance Resources: mem-estimate=24.59MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=187 segment-costs=[1906326833]
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: cs_bill_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=32B cardinality=402.85M cost=185561904
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[69869990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=996.88MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=39869990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4752000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=24B cardinality=438.85M cost=192084682
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: eccc14a9d15ea20bf0a9d5d630df955b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_qoy = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF003[min_max] -> cs_bill_customer_sk, RF002[bloom] -> cs_bill_customer_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=187(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=438.85M(filtered from 4.32G) cost=75833294
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
913
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q16.test
vendored
Normal file
913
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q16.test
vendored
Normal file
@@ -0,0 +1,913 @@
|
||||
# TPCDS-Q16
|
||||
# start query 16 in stream 0 using template query16.tpl using seed 1179008650
|
||||
select
|
||||
count(distinct cs_order_number) as "order count"
|
||||
,sum(cs_ext_ship_cost) as "total shipping cost"
|
||||
,sum(cs_net_profit) as "total net profit"
|
||||
from
|
||||
catalog_sales cs1
|
||||
,date_dim
|
||||
,customer_address
|
||||
,call_center
|
||||
where
|
||||
d_date between cast('2001-2-01' as date) and
|
||||
(cast('2001-2-01' as date) + interval 60 days)
|
||||
and cs1.cs_ship_date_sk = d_date_sk
|
||||
and cs1.cs_ship_addr_sk = ca_address_sk
|
||||
and ca_state = 'MS'
|
||||
and cs1.cs_call_center_sk = cc_call_center_sk
|
||||
and cc_county in ('Jackson County','Daviess County','Walker County','Dauphin County',
|
||||
'Mobile County'
|
||||
)
|
||||
and exists (select *
|
||||
from catalog_sales cs2
|
||||
where cs1.cs_order_number = cs2.cs_order_number
|
||||
and cs1.cs_warehouse_sk <> cs2.cs_warehouse_sk)
|
||||
and not exists(select *
|
||||
from catalog_returns cr1
|
||||
where cs1.cs_order_number = cr1.cr_order_number)
|
||||
order by count(distinct cs_order_number)
|
||||
limit 100;
|
||||
|
||||
# end query 16 in stream 0 using template query16.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=89.03MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=222MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=222.13MB mem-reservation=89.03MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[4068223067, 153674, 0, 0]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: count(cs_order_number), sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: count(cs_order_number) ASC
|
||||
| mem-estimate=40B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 13(GETNEXT), 12(OPEN)
|
||||
|
|
||||
22:TUPLE CACHE
|
||||
| cache key: 47cfbf1096ec3da1a05b56370af521f0
|
||||
| input scan node ids: 5,4,0,2,1,3
|
||||
| estimated serialized size: 44B
|
||||
| estimated serialized size per node: 4B
|
||||
| cumulative processing cost: 4068376741
|
||||
| cache read processing cost: 0
|
||||
| cache write processing cost: 0
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: count(cs_order_number), sum:merge(cs_ext_ship_cost), sum:merge(cs_net_profit)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=153674
|
||||
| in pipelines: 12(GETNEXT), 11(OPEN)
|
||||
|
|
||||
21:TUPLE CACHE
|
||||
| cache key: 9d765575b08ef88d65f61a24c986b316
|
||||
| input scan node ids: 5,4,0,2,1,3
|
||||
| estimated serialized size: 30.71MB
|
||||
| estimated serialized size per node: 3.07MB
|
||||
| cumulative processing cost: 4068223067
|
||||
| cache read processing cost: 97254
|
||||
| cache write processing cost: 86935
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=40B cardinality=731.78K cost=0
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
11:AGGREGATE
|
||||
| output: sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| group by: cs_order_number
|
||||
| mem-estimate=36.29MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=40B cardinality=731.78K cost=2173178
|
||||
| in pipelines: 11(GETNEXT), 05(OPEN)
|
||||
|
|
||||
20:TUPLE CACHE
|
||||
| cache key: 4d25ee68af4a1978b77ae15d4a36434a
|
||||
| input scan node ids: 5,4,0,2,1,3
|
||||
| estimated serialized size: 72.23MB
|
||||
| estimated serialized size per node: 7.22MB
|
||||
| cumulative processing cost: 4066049889
|
||||
| cache read processing cost: 97254
|
||||
| cache write processing cost: 204497
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [RIGHT ANTI JOIN]
|
||||
| hash predicates: cr1.cr_order_number = cs1.cs_order_number
|
||||
| mem-estimate=85.06MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=111676741
|
||||
| in pipelines: 05(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--19:TUPLE CACHE
|
||||
| | cache key: b76e047d65130278c0385d93f4fd1c27
|
||||
| | input scan node ids: 4,0,2,1,3
|
||||
| | estimated serialized size: 72.23MB
|
||||
| | estimated serialized size per node: 7.22MB
|
||||
| | cumulative processing cost: 3904604791
|
||||
| | cache read processing cost: 97254
|
||||
| | cache write processing cost: 204497
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 09:HASH JOIN [RIGHT SEMI JOIN]
|
||||
| | hash predicates: cs2.cs_order_number = cs1.cs_order_number
|
||||
| | other join predicates: cs1.cs_warehouse_sk != cs2.cs_warehouse_sk
|
||||
| | runtime filters: RF000[bloom] <- cs1.cs_order_number, RF001[min_max] <- cs1.cs_order_number
|
||||
| | mem-estimate=85.06MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=1108964384
|
||||
| | in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--18:TUPLE CACHE
|
||||
| | | cache key: 3dddd1af4baf4738fb583fb4c01c0478
|
||||
| | | input scan node ids: 0,2,1,3
|
||||
| | | estimated serialized size: 72.23MB
|
||||
| | | estimated serialized size per node: 7.22MB
|
||||
| | | cumulative processing cost: 2049130933
|
||||
| | | cache read processing cost: 97254
|
||||
| | | cache write processing cost: 204497
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 08:HASH JOIN [INNER JOIN]
|
||||
| | | hash predicates: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | runtime filters: RF002[bloom] <- cc_call_center_sk, RF003[min_max] <- cc_call_center_sk
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=776164
|
||||
| | | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| | |
|
||||
| | |--17:TUPLE CACHE
|
||||
| | | | cache key: 1d01b2ce80040f903f66273d3072038c
|
||||
| | | | input scan node ids: 3
|
||||
| | | | estimated serialized size: 469B
|
||||
| | | | estimated serialized size per node: 469B
|
||||
| | | | cumulative processing cost: 13
|
||||
| | | | cache read processing cost: 1
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=3 row-size=30B cardinality=14 cost=0
|
||||
| | | | in pipelines: 03(GETNEXT)
|
||||
| | | |
|
||||
| | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.call_center]
|
||||
| | | HDFS partitions=1/1 files=1 size=16.57KB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | stored statistics:
|
||||
| | | table: rows=48 size=16.57KB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=48
|
||||
| | | parquet statistics predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | parquet dictionary predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=30B cardinality=14 cost=13
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 16:TUPLE CACHE
|
||||
| | | cache key: ebf1d3281b48ba33f1521f1866870dcc
|
||||
| | | input scan node ids: 0,2,1
|
||||
| | | estimated serialized size: 167.49MB
|
||||
| | | estimated serialized size per node: 16.75MB
|
||||
| | | cumulative processing cost: 2048354756
|
||||
| | | cache read processing cost: 333442
|
||||
| | | cache write processing cost: 474195
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN]
|
||||
| | | hash predicates: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | runtime filters: RF004[bloom] <- d_date_sk, RF005[min_max] <- d_date_sk
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=20847880
|
||||
| | | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| | |
|
||||
| | |--15:TUPLE CACHE
|
||||
| | | | cache key: de03e34961398641174dfda6c6f28548
|
||||
| | | | input scan node ids: 1
|
||||
| | | | estimated serialized size: 732B
|
||||
| | | | estimated serialized size per node: 732B
|
||||
| | | | cumulative processing cost: 12520
|
||||
| | | | cache read processing cost: 8
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=1 row-size=8B cardinality=61 cost=0
|
||||
| | | | in pipelines: 01(GETNEXT)
|
||||
| | | |
|
||||
| | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=73.05K size=2.17MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | | parquet statistics predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | parquet dictionary predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=61 cost=12520
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 06:HASH JOIN [INNER JOIN]
|
||||
| | | hash predicates: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | runtime filters: RF006[bloom] <- ca_address_sk, RF007[min_max] <- ca_address_sk
|
||||
| | | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2 row-size=50B cardinality=79.51M cost=35084924
|
||||
| | | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| | |
|
||||
| | |--14:TUPLE CACHE
|
||||
| | | | cache key: f45b0b358ee48f9d78817ccbc0957aa8
|
||||
| | | | input scan node ids: 2
|
||||
| | | | estimated serialized size: 5.99MB
|
||||
| | | | estimated serialized size per node: 612.97KB
|
||||
| | | | cumulative processing cost: 1717500
|
||||
| | | | cache read processing cost: 37917
|
||||
| | | | cache write processing cost: 16947
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=2 row-size=18B cardinality=285.31K cost=0
|
||||
| | | | in pipelines: 02(GETNEXT)
|
||||
| | | |
|
||||
| | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| | | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: ca_state = 'MS'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=15.00M size=307.36MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | | parquet statistics predicates: ca_state = 'MS'
|
||||
| | | parquet dictionary predicates: ca_state = 'MS'
|
||||
| | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=18B cardinality=285.31K cost=1717500
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs1]
|
||||
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| | deterministic scan range assignment: true
|
||||
| | runtime filters: RF003[min_max] -> cs1.cs_call_center_sk, RF005[min_max] -> cs1.cs_ship_date_sk, RF007[min_max] -> cs1.cs_ship_addr_sk, RF002[bloom] -> cs1.cs_call_center_sk, RF004[bloom] -> cs1.cs_ship_date_sk, RF006[bloom] -> cs1.cs_ship_addr_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=4.32G size=280.96GB
|
||||
| | partitions: 1831/1831 rows=4.32G
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=32B cardinality=79.51M(filtered from 4.32G) cost=1990691932
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs2]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF001[min_max] -> cs2.cs_order_number, RF000[bloom] -> cs2.cs_order_number
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=4.32G cost=746509474
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns cr1]
|
||||
HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
deterministic scan range assignment: true
|
||||
stored statistics:
|
||||
table: rows=432.02M size=32.77GB
|
||||
partitions: 2060/2060 rows=432.02M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
tuple-ids=6 row-size=8B cardinality=432.02M cost=49768357
|
||||
in pipelines: 05(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=432.55MB Threads=42
|
||||
Per-Host Resource Estimates: Memory=1.11GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 0, 0] cpu-comparison-result=140 [max(1 (self) vs 140 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: count(cs_order_number), sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: count(cs_order_number) ASC
|
||||
| mem-estimate=40B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 13(GETNEXT), 21(OPEN)
|
||||
|
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(cs_order_number), sum:merge(cs_ext_ship_cost), sum:merge(cs_net_profit)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 21(GETNEXT), 12(OPEN)
|
||||
|
|
||||
20:EXCHANGE [UNPARTITIONED]
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=20.59MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[177013447, 153674, 3] cpu-comparison-result=140 [max(70 (self) vs 140 (sum children))]
|
||||
12:AGGREGATE
|
||||
| output: count(cs_order_number), sum:merge(cs_ext_ship_cost), sum:merge(cs_net_profit)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=153674
|
||||
| in pipelines: 12(GETNEXT), 11(OPEN)
|
||||
|
|
||||
11:AGGREGATE
|
||||
| output: sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| group by: cs_order_number
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=40B cardinality=731.78K cost=2173178
|
||||
| in pipelines: 11(GETNEXT), 05(OPEN)
|
||||
|
|
||||
10:HASH JOIN [RIGHT ANTI JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cr1.cr_order_number = cs1.cs_order_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=110944957
|
||||
| in pipelines: 05(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=20.38MB mem-reservation=8.50MB thread-reservation=1
|
||||
| | max-parallelism=20 segment-costs=[1827393351] cpu-comparison-result=140 [max(140 (self) vs 140 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: cs1.cs_order_number
|
||||
| | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=731784
|
||||
| |
|
||||
| 09:HASH JOIN [RIGHT SEMI JOIN, PARTITIONED]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: cs2.cs_order_number = cs1.cs_order_number
|
||||
| | other join predicates: cs1.cs_warehouse_sk != cs2.cs_warehouse_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=1108232600
|
||||
| | in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | | Per-Instance Resources: mem-estimate=27.74MB mem-reservation=9.50MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=20 segment-costs=[1188417] cpu-comparison-result=140 [max(140 (self) vs 42 (sum children))]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: cs1.cs_order_number
|
||||
| | | runtime filters: RF000[bloom] <- cs1.cs_order_number, RF001[min_max] <- cs1.cs_order_number
|
||||
| | | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=731784
|
||||
| | |
|
||||
| | 18:EXCHANGE [HASH(cs1.cs_order_number)]
|
||||
| | | mem-estimate=18.24MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=456633
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| | Per-Instance Resources: mem-estimate=32.09MB mem-reservation=9.00MB thread-reservation=1
|
||||
| | max-parallelism=210 segment-costs=[2052747176]
|
||||
| | 26:TUPLE CACHE
|
||||
| | | cache key: 292b6d47a7be445533bfca75798ad970
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 72.23MB
|
||||
| | | estimated serialized size per node: 7.22MB
|
||||
| | | cumulative processing cost: 2049530224
|
||||
| | | cache read processing cost: 97254
|
||||
| | | cache write processing cost: 204497
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=02
|
||||
| | | hash predicates: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=776150
|
||||
| | | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| | |
|
||||
| | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[24]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=02 plan-id=03 cohort-id=03
|
||||
| | | | build expressions: cc_call_center_sk
|
||||
| | | | runtime filters: RF002[bloom] <- cc_call_center_sk, RF003[min_max] <- cc_call_center_sk
|
||||
| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=14
|
||||
| | | |
|
||||
| | | 16:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=3 row-size=30B cardinality=14 cost=10
|
||||
| | | | in pipelines: 03(GETNEXT)
|
||||
| | | |
|
||||
| | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | | max-parallelism=1 segment-costs=[14]
|
||||
| | | 25:TUPLE CACHE
|
||||
| | | | cache key: 1d01b2ce80040f903f66273d3072038c
|
||||
| | | | input scan node ids: 3
|
||||
| | | | estimated serialized size: 469B
|
||||
| | | | estimated serialized size per node: 469B
|
||||
| | | | cumulative processing cost: 13
|
||||
| | | | cache read processing cost: 1
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=3 row-size=30B cardinality=14 cost=0
|
||||
| | | | in pipelines: 03(GETNEXT)
|
||||
| | | |
|
||||
| | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.call_center, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=16.57KB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | stored statistics:
|
||||
| | | table: rows=48 size=16.57KB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=48
|
||||
| | | parquet statistics predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | parquet dictionary predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=30B cardinality=14 cost=13
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 24:TUPLE CACHE
|
||||
| | | cache key: b805abc21b0239029544e664a2af0146
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 167.49MB
|
||||
| | | estimated serialized size per node: 16.75MB
|
||||
| | | cumulative processing cost: 2048754036
|
||||
| | | cache read processing cost: 333442
|
||||
| | | cache write processing cost: 474195
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=03
|
||||
| | | hash predicates: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=20847819
|
||||
| | | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| | |
|
||||
| | |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[141]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=03 plan-id=04 cohort-id=03
|
||||
| | | | build expressions: d_date_sk
|
||||
| | | | runtime filters: RF004[bloom] <- d_date_sk, RF005[min_max] <- d_date_sk
|
||||
| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| | | |
|
||||
| | | 15:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=1 row-size=8B cardinality=61 cost=80
|
||||
| | | | in pipelines: 01(GETNEXT)
|
||||
| | | |
|
||||
| | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | | max-parallelism=1 segment-costs=[12522]
|
||||
| | | 23:TUPLE CACHE
|
||||
| | | | cache key: de03e34961398641174dfda6c6f28548
|
||||
| | | | input scan node ids: 1
|
||||
| | | | estimated serialized size: 732B
|
||||
| | | | estimated serialized size per node: 732B
|
||||
| | | | cumulative processing cost: 12520
|
||||
| | | | cache read processing cost: 8
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=1 row-size=8B cardinality=61 cost=0
|
||||
| | | | in pipelines: 01(GETNEXT)
|
||||
| | | |
|
||||
| | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=73.05K size=2.17MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | | parquet statistics predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | parquet dictionary predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=61 cost=12520
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=04
|
||||
| | | hash predicates: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2 row-size=50B cardinality=79.51M cost=34799612
|
||||
| | | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| | |
|
||||
| | |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=210.11MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[664482]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=04 plan-id=05 cohort-id=03
|
||||
| | | | build expressions: ca_address_sk
|
||||
| | | | runtime filters: RF006[bloom] <- ca_address_sk, RF007[min_max] <- ca_address_sk
|
||||
| | | | mem-estimate=204.00MB mem-reservation=204.00MB spill-buffer=1.00MB thread-reservation=0 cost=285312
|
||||
| | | |
|
||||
| | | 14:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=5.11MB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=2 row-size=18B cardinality=285.31K cost=379170
|
||||
| | | | in pipelines: 02(GETNEXT)
|
||||
| | | |
|
||||
| | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.12MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[1737528]
|
||||
| | | 22:TUPLE CACHE
|
||||
| | | | cache key: f45b0b358ee48f9d78817ccbc0957aa8
|
||||
| | | | input scan node ids: 2
|
||||
| | | | estimated serialized size: 5.99MB
|
||||
| | | | estimated serialized size per node: 612.97KB
|
||||
| | | | cumulative processing cost: 1717500
|
||||
| | | | cache read processing cost: 37917
|
||||
| | | | cache write processing cost: 16947
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=2 row-size=18B cardinality=285.31K cost=0
|
||||
| | | | in pipelines: 02(GETNEXT)
|
||||
| | | |
|
||||
| | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: ca_state = 'MS'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=15.00M size=307.36MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | | parquet statistics predicates: ca_state = 'MS'
|
||||
| | | parquet dictionary predicates: ca_state = 'MS'
|
||||
| | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=18B cardinality=285.31K cost=1717500
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs1, RANDOM]
|
||||
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| | deterministic scan range assignment: true
|
||||
| | runtime filters: RF003[min_max] -> cs1.cs_call_center_sk, RF005[min_max] -> cs1.cs_ship_date_sk, RF007[min_max] -> cs1.cs_ship_addr_sk, RF002[bloom] -> cs1.cs_call_center_sk, RF004[bloom] -> cs1.cs_ship_date_sk, RF006[bloom] -> cs1.cs_ship_addr_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=4.32G size=280.96GB
|
||||
| | partitions: 1831/1831 rows=4.32G
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=32B cardinality=79.51M(filtered from 4.32G) cost=1990691932
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 17:EXCHANGE [HASH(cs2.cs_order_number)]
|
||||
| | mem-estimate=11.88MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=4.32G cost=718428967
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=17.25MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=640 segment-costs=[6310769910]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs2, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| runtime filters: RF001[min_max] -> cs2.cs_order_number, RF000[bloom] -> cs2.cs_order_number
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=4.32G cost=746509474
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
19:EXCHANGE [HASH(cr1.cr_order_number)]
|
||||
| mem-estimate=10.59MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=8B cardinality=432.02M cost=63895312
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.94MB mem-reservation=32.00KB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[494918664]
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns cr1, RANDOM]
|
||||
HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
stored statistics:
|
||||
table: rows=432.02M size=32.77GB
|
||||
partitions: 2060/2060 rows=432.02M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
tuple-ids=6 row-size=8B cardinality=432.02M cost=49768357
|
||||
in pipelines: 05(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=432.55MB Threads=42
|
||||
Per-Host Resource Estimates: Memory=1.11GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[0, 0, 0] cpu-comparison-result=140 [max(1 (self) vs 140 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: count(cs_order_number), sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: count(cs_order_number) ASC
|
||||
| mem-estimate=40B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 13(GETNEXT), 21(OPEN)
|
||||
|
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(cs_order_number), sum:merge(cs_ext_ship_cost), sum:merge(cs_net_profit)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 21(GETNEXT), 12(OPEN)
|
||||
|
|
||||
20:EXCHANGE [UNPARTITIONED]
|
||||
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=0
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=20.59MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[177013447, 153674, 3] cpu-comparison-result=140 [max(70 (self) vs 140 (sum children))]
|
||||
12:AGGREGATE
|
||||
| output: count(cs_order_number), sum:merge(cs_ext_ship_cost), sum:merge(cs_net_profit)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=9 row-size=40B cardinality=1 cost=153674
|
||||
| in pipelines: 12(GETNEXT), 11(OPEN)
|
||||
|
|
||||
11:AGGREGATE
|
||||
| output: sum(cs_ext_ship_cost), sum(cs_net_profit)
|
||||
| group by: cs_order_number
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=40B cardinality=731.78K cost=2173178
|
||||
| in pipelines: 11(GETNEXT), 05(OPEN)
|
||||
|
|
||||
10:HASH JOIN [RIGHT ANTI JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cr1.cr_order_number = cs1.cs_order_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=110944957
|
||||
| in pipelines: 05(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=20.38MB mem-reservation=8.50MB thread-reservation=1
|
||||
| | max-parallelism=20 segment-costs=[1827393351] cpu-comparison-result=140 [max(140 (self) vs 140 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: cs1.cs_order_number
|
||||
| | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=731784
|
||||
| |
|
||||
| 09:HASH JOIN [RIGHT SEMI JOIN, PARTITIONED]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: cs2.cs_order_number = cs1.cs_order_number
|
||||
| | other join predicates: cs1.cs_warehouse_sk != cs2.cs_warehouse_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=1108232600
|
||||
| | in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [HASH(cs1.cs_order_number)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | | Per-Instance Resources: mem-estimate=27.74MB mem-reservation=9.50MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=20 segment-costs=[1188417] cpu-comparison-result=140 [max(140 (self) vs 42 (sum children))]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: cs1.cs_order_number
|
||||
| | | runtime filters: RF000[bloom] <- cs1.cs_order_number, RF001[min_max] <- cs1.cs_order_number
|
||||
| | | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=731784
|
||||
| | |
|
||||
| | 18:EXCHANGE [HASH(cs1.cs_order_number)]
|
||||
| | | mem-estimate=18.24MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=456633
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| | Per-Instance Resources: mem-estimate=32.09MB mem-reservation=9.00MB thread-reservation=1
|
||||
| | max-parallelism=210 segment-costs=[2052747176]
|
||||
| | 26:TUPLE CACHE
|
||||
| | | cache key: 292b6d47a7be445533bfca75798ad970
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 72.23MB
|
||||
| | | estimated serialized size per node: 7.22MB
|
||||
| | | cumulative processing cost: 2049530224
|
||||
| | | cache read processing cost: 97254
|
||||
| | | cache write processing cost: 204497
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=02
|
||||
| | | hash predicates: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_call_center_sk = cc_call_center_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1,3 row-size=88B cardinality=731.78K cost=776150
|
||||
| | | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| | |
|
||||
| | |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[24]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=02 plan-id=03 cohort-id=03
|
||||
| | | | build expressions: cc_call_center_sk
|
||||
| | | | runtime filters: RF002[bloom] <- cc_call_center_sk, RF003[min_max] <- cc_call_center_sk
|
||||
| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=14
|
||||
| | | |
|
||||
| | | 16:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=3 row-size=30B cardinality=14 cost=10
|
||||
| | | | in pipelines: 03(GETNEXT)
|
||||
| | | |
|
||||
| | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | | max-parallelism=1 segment-costs=[14]
|
||||
| | | 25:TUPLE CACHE
|
||||
| | | | cache key: 1d01b2ce80040f903f66273d3072038c
|
||||
| | | | input scan node ids: 3
|
||||
| | | | estimated serialized size: 469B
|
||||
| | | | estimated serialized size per node: 469B
|
||||
| | | | cumulative processing cost: 13
|
||||
| | | | cache read processing cost: 1
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=3 row-size=30B cardinality=14 cost=0
|
||||
| | | | in pipelines: 03(GETNEXT)
|
||||
| | | |
|
||||
| | | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.call_center, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=16.57KB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | stored statistics:
|
||||
| | | table: rows=48 size=16.57KB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=48
|
||||
| | | parquet statistics predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | parquet dictionary predicates: cc_county IN ('Jackson County', 'Daviess County', 'Walker County', 'Dauphin County', 'Mobile County')
|
||||
| | | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=30B cardinality=14 cost=13
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 24:TUPLE CACHE
|
||||
| | | cache key: b805abc21b0239029544e664a2af0146
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 167.49MB
|
||||
| | | estimated serialized size per node: 16.75MB
|
||||
| | | cumulative processing cost: 2048754036
|
||||
| | | cache read processing cost: 333442
|
||||
| | | cache write processing cost: 474195
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=03
|
||||
| | | hash predicates: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_date_sk = d_date_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | | tuple-ids=0,2,1 row-size=58B cardinality=2.51M cost=20847819
|
||||
| | | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| | |
|
||||
| | |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[141]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=03 plan-id=04 cohort-id=03
|
||||
| | | | build expressions: d_date_sk
|
||||
| | | | runtime filters: RF004[bloom] <- d_date_sk, RF005[min_max] <- d_date_sk
|
||||
| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| | | |
|
||||
| | | 15:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=1 row-size=8B cardinality=61 cost=80
|
||||
| | | | in pipelines: 01(GETNEXT)
|
||||
| | | |
|
||||
| | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | | max-parallelism=1 segment-costs=[12522]
|
||||
| | | 23:TUPLE CACHE
|
||||
| | | | cache key: de03e34961398641174dfda6c6f28548
|
||||
| | | | input scan node ids: 1
|
||||
| | | | estimated serialized size: 732B
|
||||
| | | | estimated serialized size per node: 732B
|
||||
| | | | cumulative processing cost: 12520
|
||||
| | | | cache read processing cost: 8
|
||||
| | | | cache write processing cost: 1
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=1 row-size=8B cardinality=61 cost=0
|
||||
| | | | in pipelines: 01(GETNEXT)
|
||||
| | | |
|
||||
| | | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=73.05K size=2.17MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | | parquet statistics predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | parquet dictionary predicates: d_date <= DATE '2001-04-02', d_date >= DATE '2001-02-01'
|
||||
| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=8B cardinality=61 cost=12520
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | | hash-table-id=04
|
||||
| | | hash predicates: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | fk/pk conjuncts: cs1.cs_ship_addr_sk = ca_address_sk
|
||||
| | | mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| | | tuple-ids=0,2 row-size=50B cardinality=79.51M cost=34799612
|
||||
| | | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| | |
|
||||
| | |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | | Per-Instance Resources: mem-estimate=210.11MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | | max-parallelism=10 segment-costs=[664482]
|
||||
| | | JOIN BUILD
|
||||
| | | | join-table-id=04 plan-id=05 cohort-id=03
|
||||
| | | | build expressions: ca_address_sk
|
||||
| | | | runtime filters: RF006[bloom] <- ca_address_sk, RF007[min_max] <- ca_address_sk
|
||||
| | | | mem-estimate=204.00MB mem-reservation=204.00MB spill-buffer=1.00MB thread-reservation=0 cost=285312
|
||||
| | | |
|
||||
| | | 14:EXCHANGE [BROADCAST]
|
||||
| | | | mem-estimate=5.11MB mem-reservation=0B thread-reservation=0
|
||||
| | | | tuple-ids=2 row-size=18B cardinality=285.31K cost=379170
|
||||
| | | | in pipelines: 02(GETNEXT)
|
||||
| | | |
|
||||
| | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.12MB thread-reservation=1
|
||||
| | | max-parallelism=10 segment-costs=[1737528]
|
||||
| | | 22:TUPLE CACHE
|
||||
| | | | cache key: f45b0b358ee48f9d78817ccbc0957aa8
|
||||
| | | | input scan node ids: 2
|
||||
| | | | estimated serialized size: 5.99MB
|
||||
| | | | estimated serialized size per node: 612.97KB
|
||||
| | | | cumulative processing cost: 1717500
|
||||
| | | | cache read processing cost: 37917
|
||||
| | | | cache write processing cost: 16947
|
||||
| | | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | | tuple-ids=2 row-size=18B cardinality=285.31K cost=0
|
||||
| | | | in pipelines: 02(GETNEXT)
|
||||
| | | |
|
||||
| | | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| | | HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| | | deterministic scan range assignment: true
|
||||
| | | predicates: ca_state = 'MS'
|
||||
| | | stored statistics:
|
||||
| | | table: rows=15.00M size=307.36MB
|
||||
| | | columns: all
|
||||
| | | extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| | | parquet statistics predicates: ca_state = 'MS'
|
||||
| | | parquet dictionary predicates: ca_state = 'MS'
|
||||
| | | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=18B cardinality=285.31K cost=1717500
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs1, RANDOM]
|
||||
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| | deterministic scan range assignment: true
|
||||
| | runtime filters: RF003[min_max] -> cs1.cs_call_center_sk, RF005[min_max] -> cs1.cs_ship_date_sk, RF007[min_max] -> cs1.cs_ship_addr_sk, RF002[bloom] -> cs1.cs_call_center_sk, RF004[bloom] -> cs1.cs_ship_date_sk, RF006[bloom] -> cs1.cs_ship_addr_sk
|
||||
| | stored statistics:
|
||||
| | table: rows=4.32G size=280.96GB
|
||||
| | partitions: 1831/1831 rows=4.32G
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=32B cardinality=79.51M(filtered from 4.32G) cost=1990691932
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 17:EXCHANGE [HASH(cs2.cs_order_number)]
|
||||
| | mem-estimate=11.88MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=4.32G cost=718428967
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=17.25MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=640 segment-costs=[6310769910]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales cs2, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| runtime filters: RF001[min_max] -> cs2.cs_order_number, RF000[bloom] -> cs2.cs_order_number
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=4.32G cost=746509474
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
19:EXCHANGE [HASH(cr1.cr_order_number)]
|
||||
| mem-estimate=10.59MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=8B cardinality=432.02M cost=63895312
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.94MB mem-reservation=32.00KB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[494918664]
|
||||
05:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns cr1, RANDOM]
|
||||
HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
stored statistics:
|
||||
table: rows=432.02M size=32.77GB
|
||||
partitions: 2060/2060 rows=432.02M
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
tuple-ids=6 row-size=8B cardinality=432.02M cost=49768357
|
||||
in pipelines: 05(GETNEXT)
|
||||
====
|
||||
1048
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q17.test
vendored
Normal file
1048
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q17.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1020
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q18.test
vendored
Normal file
1020
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q18.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
847
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q19.test
vendored
Normal file
847
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q19.test
vendored
Normal file
@@ -0,0 +1,847 @@
|
||||
# TPCDS-Q19
|
||||
# start query 19 in stream 0 using template query19.tpl using seed 109722472
|
||||
select i_brand_id brand_id, i_brand brand, i_manufact_id, i_manufact,
|
||||
sum(ss_ext_sales_price) ext_price
|
||||
from date_dim, store_sales, item,customer,customer_address,store
|
||||
where d_date_sk = ss_sold_date_sk
|
||||
and ss_item_sk = i_item_sk
|
||||
and i_manager_id=26
|
||||
and d_moy=12
|
||||
and d_year=2000
|
||||
and ss_customer_sk = c_customer_sk
|
||||
and c_current_addr_sk = ca_address_sk
|
||||
and substr(ca_zip,1,5) <> substr(s_zip,1,5)
|
||||
and ss_store_sk = s_store_sk
|
||||
group by i_brand
|
||||
,i_brand_id
|
||||
,i_manufact_id
|
||||
,i_manufact
|
||||
order by ext_price desc
|
||||
,i_brand
|
||||
,i_brand_id
|
||||
,i_manufact_id
|
||||
,i_manufact
|
||||
limit 100 ;
|
||||
|
||||
# end query 19 in stream 0 using template query19.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=162.81MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=2.09GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=2.09GB mem-reservation=162.81MB thread-reservation=1 runtime-filters-memory=35.00MB
|
||||
| max-parallelism=1 segment-costs=[231778638, 3746309, 500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, i_manufact_id, i_manufact, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC
|
||||
| mem-estimate=7.37KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=75B cardinality=100 cost=3746309
|
||||
| in pipelines: 12(GETNEXT), 11(OPEN)
|
||||
|
|
||||
17:TUPLE CACHE
|
||||
| cache key: 9bed3a88b8c3cd558da9bdd017d4085a
|
||||
| input scan node ids: 1,2,0,3,4,5
|
||||
| estimated serialized size: 27.28MB
|
||||
| estimated serialized size per node: 2.73MB
|
||||
| cumulative processing cost: 231778638
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 77226
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=360.00K cost=0
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
11:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id, i_manufact_id, i_manufact
|
||||
| mem-estimate=394.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=360.00K cost=8128347
|
||||
| in pipelines: 11(GETNEXT), 01(OPEN)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| other predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) != substr(s_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4,5 row-size=149B cardinality=4.73M cost=2071223
|
||||
| in pipelines: 01(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=21B cardinality=1.35K cost=174
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| runtime filters: RF002[bloom] <- ca_address_sk, RF003[min_max] <- ca_address_sk
|
||||
| mem-estimate=684.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4 row-size=128B cardinality=4.73M cost=17069873
|
||||
| in pipelines: 01(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=21B cardinality=15.00M cost=1944000
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 208e4ee77926014a5a8a92716d46f4c7
|
||||
| input scan node ids: 1,2,0,3
|
||||
| estimated serialized size: 556.75MB
|
||||
| estimated serialized size per node: 55.68MB
|
||||
| cumulative processing cost: 202565021
|
||||
| cache read processing cost: 628481
|
||||
| cache write processing cost: 1576259
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| mem-estimate=996.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=32178261
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF003[min_max] -> c_current_addr_sk, RF002[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF006[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=99B cardinality=5.15M cost=2254938
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 9b08d692c695884c7b9e451d0962700c
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF008[bloom] <- i_item_sk, RF009[min_max] <- i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=87B cardinality=5.15M(filtered from 87.00M) cost=17090094
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--14:TUPLE CACHE
|
||||
| | cache key: cb18e8da87e3be3c40f26d338a4957f8
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 253.08KB
|
||||
| | estimated serialized size per node: 63.27KB
|
||||
| | cumulative processing cost: 235369
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 699
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=67B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(26 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(26 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(26 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=67B cardinality=3.63K cost=235369
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 7671075260edc453e332cc33b69dca06
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 117.91MB
|
||||
| estimated serialized size per node: 11.79MB
|
||||
| cumulative processing cost: 147333631
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 333820
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_customer_sk, RF009[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF004[bloom] -> ss_customer_sk, RF006[bloom] -> ss_sold_date_sk, RF008[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=147333631
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=281.70MB Threads=17
|
||||
Per-Host Resource Estimates: Memory=566MB
|
||||
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[540] cpu-comparison-result=76 [max(1 (self) vs 76 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, i_manufact_id, i_manufact, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
22:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC
|
||||
| limit: 100
|
||||
| mem-estimate=78.33KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=75B cardinality=100 cost=40
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F08:PLAN FRAGMENT [HASH(i_brand,i_brand_id,i_manufact_id,i_manufact)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=48.13MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[9837909, 3746309, 229] cpu-comparison-result=76 [max(10 (self) vs 76 (sum children))]
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC
|
||||
| mem-estimate=7.37KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=75B cardinality=100 cost=3746309
|
||||
| in pipelines: 12(GETNEXT), 21(OPEN)
|
||||
|
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id, i_manufact_id, i_manufact
|
||||
| mem-estimate=37.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=360.00K cost=7785513
|
||||
| in pipelines: 21(GETNEXT), 01(OPEN)
|
||||
|
|
||||
20:EXCHANGE [HASH(i_brand,i_brand_id,i_manufact_id,i_manufact)]
|
||||
| mem-estimate=10.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=4.48M cost=2052396
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=48.31MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[34308052, 24073993] cpu-comparison-result=76 [max(50 (self) vs 76 (sum children))]
|
||||
11:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id, i_manufact_id, i_manufact
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=4.48M cost=26783412
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| other predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) != substr(s_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4,5 row-size=149B cardinality=4.73M cost=2069873
|
||||
| in pipelines: 01(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.99MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=52.69KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=21B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[279]
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=21B cardinality=1.35K cost=174
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4 row-size=128B cardinality=4.73M cost=2069873
|
||||
| in pipelines: 01(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=94.68MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[18115500]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF002[bloom] <- ca_address_sk, RF003[min_max] <- ca_address_sk
|
||||
| | mem-estimate=68.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 18:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=21B cardinality=15.00M cost=3115500
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.98MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[29958000]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=21B cardinality=15.00M cost=1944000
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
17:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| mem-estimate=11.21MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=3384894
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=18.09MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[47955908]
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=2178261
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=125.81MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34437000]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| | mem-estimate=99.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 16:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=30.00M cost=4437000
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.47MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34368000]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF003[min_max] -> c_current_addr_sk, RF002[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
15:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=13.27MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=99B cardinality=5.15M cost=3308204
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB
|
||||
Per-Instance Resources: mem-estimate=28.35MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[207631160]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=99B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 26:TUPLE CACHE
|
||||
| | cache key: 9b08d692c695884c7b9e451d0962700c
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
25:TUPLE CACHE
|
||||
| cache key: 8fb4cb34677539f9ea47e581819d47ea
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 468.94MB
|
||||
| estimated serialized size per node: 46.89MB
|
||||
| cumulative processing cost: 164664652
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1327652
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=87B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=87B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=7.32MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF008[bloom] <- i_item_sk, RF009[min_max] <- i_item_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=524.72KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=67B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.28MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[236107]
|
||||
| 24:TUPLE CACHE
|
||||
| | cache key: cb18e8da87e3be3c40f26d338a4957f8
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 253.08KB
|
||||
| | estimated serialized size per node: 63.27KB
|
||||
| | cumulative processing cost: 235369
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 699
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=67B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(26 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(26 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(26 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=67B cardinality=3.63K cost=235369
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: 39ab86001e2530e4863b9c9e838f1fba
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 117.91MB
|
||||
| estimated serialized size per node: 11.79MB
|
||||
| cumulative processing cost: 147333631
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 333820
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_customer_sk, RF009[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF004[bloom] -> ss_customer_sk, RF006[bloom] -> ss_sold_date_sk, RF008[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=147333631
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=281.70MB Threads=17
|
||||
Per-Host Resource Estimates: Memory=566MB
|
||||
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[540] cpu-comparison-result=76 [max(1 (self) vs 76 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, i_manufact_id, i_manufact, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
22:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC
|
||||
| limit: 100
|
||||
| mem-estimate=78.33KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=75B cardinality=100 cost=40
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F08:PLAN FRAGMENT [HASH(i_brand,i_brand_id,i_manufact_id,i_manufact)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=48.13MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[9837909, 3746309, 229] cpu-comparison-result=76 [max(10 (self) vs 76 (sum children))]
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand ASC, i_brand_id ASC, i_manufact_id ASC, i_manufact ASC
|
||||
| mem-estimate=7.37KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=75B cardinality=100 cost=3746309
|
||||
| in pipelines: 12(GETNEXT), 21(OPEN)
|
||||
|
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id, i_manufact_id, i_manufact
|
||||
| mem-estimate=37.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=360.00K cost=7785513
|
||||
| in pipelines: 21(GETNEXT), 01(OPEN)
|
||||
|
|
||||
20:EXCHANGE [HASH(i_brand,i_brand_id,i_manufact_id,i_manufact)]
|
||||
| mem-estimate=10.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=4.48M cost=2052396
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=48.31MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[34308052, 24073993] cpu-comparison-result=76 [max(50 (self) vs 76 (sum children))]
|
||||
11:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id, i_manufact_id, i_manufact
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=75B cardinality=4.48M cost=26783412
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| other predicates: substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) != substr(s_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT))
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4,5 row-size=149B cardinality=4.73M cost=2069873
|
||||
| in pipelines: 01(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.99MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=52.69KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=21B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[279]
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=21B cardinality=1.35K cost=174
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3,4 row-size=128B cardinality=4.73M cost=2069873
|
||||
| in pipelines: 01(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=94.68MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[18115500]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF002[bloom] <- ca_address_sk, RF003[min_max] <- ca_address_sk
|
||||
| | mem-estimate=68.44MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 18:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=21B cardinality=15.00M cost=3115500
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.98MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[29958000]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=21B cardinality=15.00M cost=1944000
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
17:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| mem-estimate=11.21MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=3384894
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=18.09MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[47955908]
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0,3 row-size=107B cardinality=4.73M cost=2178261
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=125.81MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34437000]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| | mem-estimate=99.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 16:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=30.00M cost=4437000
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.47MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34368000]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF003[min_max] -> c_current_addr_sk, RF002[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
15:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=13.27MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=99B cardinality=5.15M cost=3308204
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB
|
||||
Per-Instance Resources: mem-estimate=28.35MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[207631160]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=99B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 26:TUPLE CACHE
|
||||
| | cache key: 9b08d692c695884c7b9e451d0962700c
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT), d_moy = CAST(12 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
25:TUPLE CACHE
|
||||
| cache key: 8fb4cb34677539f9ea47e581819d47ea
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 468.94MB
|
||||
| estimated serialized size per node: 46.89MB
|
||||
| cumulative processing cost: 164664652
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1327652
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=87B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=87B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=7.32MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF008[bloom] <- i_item_sk, RF009[min_max] <- i_item_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=524.72KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=67B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.28MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[236107]
|
||||
| 24:TUPLE CACHE
|
||||
| | cache key: cb18e8da87e3be3c40f26d338a4957f8
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 253.08KB
|
||||
| | estimated serialized size per node: 63.27KB
|
||||
| | cumulative processing cost: 235369
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 699
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=67B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(26 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(26 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(26 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=67B cardinality=3.63K cost=235369
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: 39ab86001e2530e4863b9c9e838f1fba
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 117.91MB
|
||||
| estimated serialized size per node: 11.79MB
|
||||
| cumulative processing cost: 147333631
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 333820
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_customer_sk, RF009[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF004[bloom] -> ss_customer_sk, RF006[bloom] -> ss_sold_date_sk, RF008[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=20B cardinality=5.15M(filtered from 8.64G) cost=147333631
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
526
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q20.test
vendored
Normal file
526
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q20.test
vendored
Normal file
@@ -0,0 +1,526 @@
|
||||
# TPCDS-Q20
|
||||
# start query 20 in stream 0 using template query20.tpl using seed 731363624
|
||||
select i_item_id
|
||||
,i_item_desc
|
||||
,i_category
|
||||
,i_class
|
||||
,i_current_price
|
||||
,sum(cs_ext_sales_price) as itemrevenue
|
||||
,sum(cs_ext_sales_price)*100/sum(sum(cs_ext_sales_price)) over
|
||||
(partition by i_class) as revenueratio
|
||||
from catalog_sales
|
||||
,item
|
||||
,date_dim
|
||||
where cs_item_sk = i_item_sk
|
||||
and i_category in ('Books', 'Home', 'Jewelry')
|
||||
and cs_sold_date_sk = d_date_sk
|
||||
and d_date between cast('1998-05-08' as date)
|
||||
and (cast('1998-05-08' as date) + interval 30 days)
|
||||
group by i_item_id
|
||||
,i_item_desc
|
||||
,i_category
|
||||
,i_class
|
||||
,i_current_price
|
||||
order by i_category
|
||||
,i_class
|
||||
,i_item_id
|
||||
,i_item_desc
|
||||
,revenueratio
|
||||
limit 100;
|
||||
|
||||
# end query 20 in stream 0 using template query20.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=80.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=833MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=832.98MB mem-reservation=80.94MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[100001793, 3251818, 4106309, 700]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(cs_ext_sales_price), sum(cs_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(cs_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(cs_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=68.08MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: adf324223579b7991e7d593ded41e73c
|
||||
| input scan node ids: 0,2,1
|
||||
| estimated serialized size: 69.45MB
|
||||
| estimated serialized size per node: 6.95MB
|
||||
| cumulative processing cost: 100001793
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 196628
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(cs_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=754.90MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=31766387
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=21.93M cost=22842836
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: 39981d71123ba1933de6a6cac811e5cd
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| parquet dictionary predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=73.14M cost=32014144
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--09:TUPLE CACHE
|
||||
| | cache key: ddcd0463ed8acb9dfd16a906a3d9a5cd
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> cs_item_sk, RF000[bloom] -> cs_item_sk, RF002[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=31(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=73.14M(filtered from 4.32G) cost=12638882
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=280.31MB Threads=10
|
||||
Per-Host Resource Estimates: Memory=955MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[768] cpu-comparison-result=30 [max(1 (self) vs 30 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(cs_ext_sales_price), sum(cs_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(cs_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=215.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=68
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_class)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=24.78MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3620186, 4106309, 592] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(cs_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 12(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_class)]
|
||||
| mem-estimate=8.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=368368
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=360.84MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[42860487, 4782688] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=344.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=25262416
|
||||
| in pipelines: 12(GETNEXT), 00(OPEN)
|
||||
|
|
||||
11:EXCHANGE [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)]
|
||||
| mem-estimate=15.93MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=17.20M cost=17598071
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=133.86MB mem-reservation=35.00MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[175406369, 228483356] cpu-comparison-result=30 [max(30 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(cs_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=109.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=17.20M cost=108018538
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=21.93M cost=22734836
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=113.74MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[251530]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=2.00MB thread-reservation=0 cost=108000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.74MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=143530
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.74MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[783679]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: 39981d71123ba1933de6a6cac811e5cd
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| parquet dictionary predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=73.14M cost=32014113
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12521]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: ddcd0463ed8acb9dfd16a906a3d9a5cd
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_item_sk, RF000[bloom] -> cs_item_sk, RF002[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=31(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=73.14M(filtered from 4.32G) cost=12638882
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=280.31MB Threads=10
|
||||
Per-Host Resource Estimates: Memory=955MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[768] cpu-comparison-result=30 [max(1 (self) vs 30 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(cs_ext_sales_price), sum(cs_ext_sales_price) * CAST(100 AS DECIMAL(3,0)) / sum(sum(cs_ext_sales_price))
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=215.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=68
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_class)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=24.78MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3620186, 4106309, 592] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_item_id ASC, i_item_desc ASC, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) ASC
|
||||
| mem-estimate=20.93KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=214B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 06(OPEN)
|
||||
|
|
||||
07:ANALYTIC
|
||||
| functions: sum(sum(cs_ext_sales_price))
|
||||
| partition by: i_class
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10,9 row-size=214B cardinality=360.00K cost=360000
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:SORT
|
||||
| order by: i_class ASC NULLS LAST
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=10 row-size=198B cardinality=360.00K cost=3251818
|
||||
| in pipelines: 06(GETNEXT), 12(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_class)]
|
||||
| mem-estimate=8.78MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=368368
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=360.84MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[42860487, 4782688] cpu-comparison-result=30 [max(10 (self) vs 30 (sum children))]
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=344.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=360.00K cost=25262416
|
||||
| in pipelines: 12(GETNEXT), 00(OPEN)
|
||||
|
|
||||
11:EXCHANGE [HASH(i_item_id,i_item_desc,i_category,i_class,i_current_price)]
|
||||
| mem-estimate=15.93MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=17.20M cost=17598071
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=133.86MB mem-reservation=35.00MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[175406369, 228483356] cpu-comparison-result=30 [max(30 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(cs_ext_sales_price)
|
||||
| group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
||||
| mem-estimate=109.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=198B cardinality=17.20M cost=108018538
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=206B cardinality=21.93M cost=22734836
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=113.74MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[251530]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=2.00MB thread-reservation=0 cost=108000
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.74MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=143530
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.74MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[783679]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: 39981d71123ba1933de6a6cac811e5cd
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 19.60MB
|
||||
| | estimated serialized size per node: 4.90MB
|
||||
| | cumulative processing cost: 727024
|
||||
| | cache read processing cost: 14353
|
||||
| | cache write processing cost: 55489
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=186B cardinality=108.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| parquet dictionary predicates: i_category IN ('Books', 'Home', 'Jewelry')
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=186B cardinality=108.00K cost=727024
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=20B cardinality=73.14M cost=32014113
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12521]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: ddcd0463ed8acb9dfd16a906a3d9a5cd
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 372B
|
||||
| | estimated serialized size per node: 372B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-06-07', d_date >= DATE '1998-05-08'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=31 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_item_sk, RF000[bloom] -> cs_item_sk, RF002[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=31(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=73.14M(filtered from 4.32G) cost=12638882
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
639
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q21.test
vendored
Normal file
639
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q21.test
vendored
Normal file
@@ -0,0 +1,639 @@
|
||||
# TPCDS-Q21
|
||||
# start query 21 in stream 0 using template query21.tpl using seed 921979785
|
||||
select *
|
||||
from(select w_warehouse_name
|
||||
,i_item_id
|
||||
,sum(case when d_date < cast ('2000-05-22' as date)
|
||||
then inv_quantity_on_hand
|
||||
else 0 end) as inv_before
|
||||
,sum(case when d_date >= cast ('2000-05-22' as date)
|
||||
then inv_quantity_on_hand
|
||||
else 0 end) as inv_after
|
||||
from inventory
|
||||
,warehouse
|
||||
,item
|
||||
,date_dim
|
||||
where i_current_price between 0.99 and 1.49
|
||||
and i_item_sk = inv_item_sk
|
||||
and inv_warehouse_sk = w_warehouse_sk
|
||||
and inv_date_sk = d_date_sk
|
||||
and d_date between (cast ('2000-05-22' as date) - interval 30 days)
|
||||
and (cast ('2000-05-22' as date) + interval 30 days)
|
||||
group by w_warehouse_name, i_item_id) x
|
||||
where (case when inv_before > 0
|
||||
then inv_after / inv_before
|
||||
else null
|
||||
end) between 2.0/3.0 and 3.0/2.0
|
||||
order by w_warehouse_name
|
||||
,i_item_id
|
||||
limit 100;
|
||||
|
||||
# end query 21 in stream 0 using template query21.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=52.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=346MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=346.11MB mem-reservation=52.00MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[154409711, 4080496, 400]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_warehouse_name, i_item_id, inv_before, inv_after
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: w_warehouse_name ASC, i_item_id ASC
|
||||
| mem-estimate=7.04KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=72B cardinality=100 cost=4080496
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: aaedc97b81968470e5e737959609eee9
|
||||
| input scan node ids: 0,2,3,1
|
||||
| estimated serialized size: 28.26MB
|
||||
| estimated serialized size per node: 2.83MB
|
||||
| cumulative processing cost: 154409711
|
||||
| cache read processing cost: 51790
|
||||
| cache write processing cost: 80016
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=389.70K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| output: sum(CAST(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT))
|
||||
| group by: w_warehouse_name, i_item_id
|
||||
| having: (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) <= CAST(1.5 AS DOUBLE), (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) >= CAST(0.66666700000000000958522150540375150740146636962890625 AS DOUBLE)
|
||||
| mem-estimate=312.36MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=389.70K cost=52513771
|
||||
| in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: inv_warehouse_sk = w_warehouse_sk
|
||||
| runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=92B cardinality=24.14M cost=10567819
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=60B cardinality=24.14M cost=10567858
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 529d511ea9c2fd1d5bc2588fdb56706f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| parquet dictionary predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=52B cardinality=24.14M(filtered from 103.30M) cost=24947665
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: 18e575645c7ef603f08e33024e6ccb6f
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 460.51MB
|
||||
| estimated serialized size per node: 46.05MB
|
||||
| cumulative processing cost: 55655424
|
||||
| cache read processing cost: 3208728
|
||||
| cache write processing cost: 1303772
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> inv_warehouse_sk, RF005[min_max] -> inv_item_sk, RF000[bloom] -> inv_warehouse_sk, RF002[bloom] -> inv_date_sk, RF004[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=61(filtered from 261)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=55655424
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=192.52MB Threads=11
|
||||
Per-Host Resource Estimates: Memory=352MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.07MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[439] cpu-comparison-result=36 [max(1 (self) vs 36 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_warehouse_name, i_item_id, inv_before, inv_after
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: w_warehouse_name ASC, i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=74.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=72B cardinality=100 cost=39
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(w_warehouse_name,i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=46.23MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[62042311, 4080496, 220] cpu-comparison-result=36 [max(10 (self) vs 36 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: w_warehouse_name ASC, i_item_id ASC
|
||||
| mem-estimate=7.04KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=72B cardinality=100 cost=4080496
|
||||
| in pipelines: 08(GETNEXT), 13(OPEN)
|
||||
|
|
||||
13:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END)
|
||||
| group by: w_warehouse_name, i_item_id
|
||||
| having: (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) <= CAST(1.5 AS DOUBLE), (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) >= CAST(0.66666700000000000958522150540375150740146636962890625 AS DOUBLE)
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=389.70K cost=51629218
|
||||
| in pipelines: 13(GETNEXT), 00(OPEN)
|
||||
|
|
||||
12:EXCHANGE [HASH(w_warehouse_name,i_item_id)]
|
||||
| mem-estimate=12.23MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=23.53M cost=10413093
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=71.35MB mem-reservation=38.25MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[243130875, 121305941] cpu-comparison-result=36 [max(30 (self) vs 36 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT))
|
||||
| group by: w_warehouse_name, i_item_id
|
||||
| mem-estimate=48.38MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=23.53M cost=141428192
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: inv_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=92B cardinality=24.14M cost=10567797
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=20
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[8]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=60B cardinality=24.14M cost=10567797
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 17:TUPLE CACHE
|
||||
| | cache key: 529d511ea9c2fd1d5bc2588fdb56706f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| parquet dictionary predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=52B cardinality=24.14M(filtered from 103.30M) cost=24911665
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=11.02MB mem-reservation=9.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[83840]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=8.62MB mem-reservation=8.62MB spill-buffer=128.00KB thread-reservation=0 cost=36000
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.39MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=36B cardinality=36.00K cost=47840
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.16MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[148924]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
15:TUPLE CACHE
|
||||
| cache key: 215cc8a0feeccc17372358d999a36a02
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 460.51MB
|
||||
| estimated serialized size per node: 46.05MB
|
||||
| cumulative processing cost: 55655424
|
||||
| cache read processing cost: 3208728
|
||||
| cache write processing cost: 1303772
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> inv_warehouse_sk, RF005[min_max] -> inv_item_sk, RF000[bloom] -> inv_warehouse_sk, RF002[bloom] -> inv_date_sk, RF004[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=61(filtered from 261)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=55655424
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=192.52MB Threads=11
|
||||
Per-Host Resource Estimates: Memory=352MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.07MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[439] cpu-comparison-result=36 [max(1 (self) vs 36 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_warehouse_name, i_item_id, inv_before, inv_after
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
14:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: w_warehouse_name ASC, i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=74.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=72B cardinality=100 cost=39
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(w_warehouse_name,i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=46.23MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[62042311, 4080496, 220] cpu-comparison-result=36 [max(10 (self) vs 36 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: w_warehouse_name ASC, i_item_id ASC
|
||||
| mem-estimate=7.04KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=72B cardinality=100 cost=4080496
|
||||
| in pipelines: 08(GETNEXT), 13(OPEN)
|
||||
|
|
||||
13:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END), sum:merge(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END)
|
||||
| group by: w_warehouse_name, i_item_id
|
||||
| having: (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) <= CAST(1.5 AS DOUBLE), (CASE WHEN sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) > CAST(0 AS BIGINT) THEN CAST(sum(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) / CAST(sum(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE 0 END) AS DOUBLE) ELSE NULL END) >= CAST(0.66666700000000000958522150540375150740146636962890625 AS DOUBLE)
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=389.70K cost=51629218
|
||||
| in pipelines: 13(GETNEXT), 00(OPEN)
|
||||
|
|
||||
12:EXCHANGE [HASH(w_warehouse_name,i_item_id)]
|
||||
| mem-estimate=12.23MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=23.53M cost=10413093
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=71.35MB mem-reservation=38.25MB thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[243130875, 121305941] cpu-comparison-result=36 [max(30 (self) vs 36 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN d_date < DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT)), sum(CAST(CASE WHEN d_date >= DATE '2000-05-22' THEN inv_quantity_on_hand ELSE CAST(0 AS INT) END AS BIGINT))
|
||||
| group by: w_warehouse_name, i_item_id
|
||||
| mem-estimate=48.38MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=72B cardinality=23.53M cost=141428192
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: inv_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=92B cardinality=24.14M cost=10567797
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=20
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[8]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=60B cardinality=24.14M cost=10567797
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=6.83MB mem-reservation=6.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=5.81MB mem-reservation=5.81MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 10:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 17:TUPLE CACHE
|
||||
| | cache key: 529d511ea9c2fd1d5bc2588fdb56706f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| parquet dictionary predicates: d_date <= DATE '2000-06-21', d_date >= DATE '2000-04-22'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=52B cardinality=24.14M(filtered from 103.30M) cost=24911665
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=11.02MB mem-reservation=9.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[83840]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=8.62MB mem-reservation=8.62MB spill-buffer=128.00KB thread-reservation=0 cost=36000
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.39MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=36B cardinality=36.00K cost=47840
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.16MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[148924]
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
15:TUPLE CACHE
|
||||
| cache key: 215cc8a0feeccc17372358d999a36a02
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 460.51MB
|
||||
| estimated serialized size per node: 46.05MB
|
||||
| cumulative processing cost: 55655424
|
||||
| cache read processing cost: 3208728
|
||||
| cache write processing cost: 1303772
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> inv_warehouse_sk, RF005[min_max] -> inv_item_sk, RF000[bloom] -> inv_warehouse_sk, RF002[bloom] -> inv_date_sk, RF004[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M est-scan-range=61(filtered from 261)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=24.14M(filtered from 1.03G) cost=55655424
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
548
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q22.test
vendored
Normal file
548
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q22.test
vendored
Normal file
@@ -0,0 +1,548 @@
|
||||
# TPCDS-Q22
|
||||
# start query 22 in stream 0 using template query22.tpl using seed 1619733390
|
||||
select i_product_name
|
||||
,i_brand
|
||||
,i_class
|
||||
,i_category
|
||||
,avg(inv_quantity_on_hand) qoh
|
||||
from inventory
|
||||
,date_dim
|
||||
,item
|
||||
where inv_date_sk=d_date_sk
|
||||
and inv_item_sk=i_item_sk
|
||||
and d_month_seq between 1199 and 1199 + 11
|
||||
group by rollup(i_product_name
|
||||
,i_brand
|
||||
,i_class
|
||||
,i_category)
|
||||
order by qoh, i_product_name, i_brand, i_class, i_category
|
||||
limit 100;
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=184.12MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=50.11GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=50.11GB mem-reservation=184.12MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[8187645470, 8499749, 16608995, 500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
07:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END) ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC
|
||||
| mem-estimate=5.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=56B cardinality=100 cost=16608995
|
||||
| in pipelines: 07(GETNEXT), 06(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: 5d88d9b98121f7eda90d7fcf22095e13
|
||||
| input scan node ids: 0,2,1
|
||||
| estimated serialized size: 87.89MB
|
||||
| estimated serialized size per node: 8.79MB
|
||||
| cumulative processing cost: 8196145219
|
||||
| cache read processing cost: 191376
|
||||
| cache write processing cost: 248832
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=60B cardinality=1.44M cost=0
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
06:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,6,8,10,12) IN (CAST(4 AS INT), CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT), CAST(12 AS INT)), CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(6 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(8 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(10 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(12 AS INT) THEN avg(inv_quantity_on_hand) END)
|
||||
| group by: CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(10 AS INT) THEN i_product_name WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=98.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=60B cardinality=1.44M cost=8499749
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
10:TUPLE CACHE
|
||||
| cache key: 8aeec4c7af677c52319b65ade4024cbf
|
||||
| input scan node ids: 0,2,1
|
||||
| estimated serialized size: 633.59MB
|
||||
| estimated serialized size per node: 63.36MB
|
||||
| cumulative processing cost: 8187645470
|
||||
| cache read processing cost: 191376
|
||||
| cache write processing cost: 1793787
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=1.44M cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, i_category
|
||||
| Class 1
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, NULL, NULL
|
||||
| Class 3
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: NULL, NULL, NULL, NULL
|
||||
| mem-estimate=50.00GB mem-reservation=137.94MB thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=1.44M cost=7104046265
|
||||
| in pipelines: 05(GETNEXT), 00(OPEN)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=125B cardinality=1.03G cost=452170435
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--09:TUPLE CACHE
|
||||
| | cache key: c86950a4c59688636cd63274a2bbe6ba
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=47.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=117B cardinality=1.03G cost=452523130
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: 9499e4d1103a0f773f871959aa31dbec
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=178599168
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=3.02GB Threads=24
|
||||
Per-Host Resource Estimates: Memory=52.50GB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[536] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
12:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END) ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC
|
||||
| limit: 100
|
||||
| mem-estimate=410.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=56B cardinality=100 cost=36
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(i_product_name) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END)] hosts=10 instances=70 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=1.01GB mem-reservation=140.81MB thread-reservation=1
|
||||
max-parallelism=70 segment-costs=[639432237, 8499749, 16608995, 178] cpu-comparison-result=120 [max(70 (self) vs 120 (sum children))]
|
||||
07:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END) ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC
|
||||
| mem-estimate=5.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=56B cardinality=100 cost=16608995
|
||||
| in pipelines: 07(GETNEXT), 06(OPEN)
|
||||
|
|
||||
06:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,6,8,10,12) IN (CAST(4 AS INT), CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT), CAST(12 AS INT)), CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(6 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(8 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(10 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(12 AS INT) THEN avg(inv_quantity_on_hand) END)
|
||||
| group by: CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(10 AS INT) THEN i_product_name WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=60B cardinality=1.44M cost=8499749
|
||||
| in pipelines: 06(GETNEXT), 11(OPEN)
|
||||
|
|
||||
11:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, i_class, i_category
|
||||
| Class 1
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, i_class, NULL
|
||||
| Class 2
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, NULL, NULL
|
||||
| Class 3
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: NULL, NULL, NULL, NULL
|
||||
| mem-estimate=966.14MB mem-reservation=137.94MB thread-reservation=0
|
||||
| tuple-ids=4N,6N,8N,10N,12N row-size=441B cardinality=1.44M cost=243965689
|
||||
| in pipelines: 11(GETNEXT), 00(OPEN)
|
||||
|
|
||||
10:EXCHANGE [HASH(CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(i_product_name) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=64.07MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=172.80M cost=395466548
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=3.75GB mem-reservation=138.25MB thread-reservation=1
|
||||
max-parallelism=261 segment-costs=[8962975991, 5356784990] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, i_category
|
||||
| Class 1
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, NULL, NULL
|
||||
| Class 3
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: NULL, NULL, NULL, NULL
|
||||
| mem-estimate=3.61GB mem-reservation=138.00MB thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=172.80M cost=7880050563
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=125B cardinality=1.03G cost=452163130
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: c86950a4c59688636cd63274a2bbe6ba
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=117B cardinality=1.03G cost=452163130
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.42MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.42MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=105B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.42MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[403500]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 9499e4d1103a0f773f871959aa31dbec
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=178599168
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=3.02GB Threads=24
|
||||
Per-Host Resource Estimates: Memory=52.50GB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[536] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END, aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
12:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END) ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC
|
||||
| limit: 100
|
||||
| mem-estimate=410.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=56B cardinality=100 cost=36
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(i_product_name) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END)] hosts=10 instances=70 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=1.01GB mem-reservation=140.81MB thread-reservation=1
|
||||
max-parallelism=70 segment-costs=[639432237, 8499749, 16608995, 178] cpu-comparison-result=120 [max(70 (self) vs 120 (sum children))]
|
||||
07:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,6,8,10,12) IN (4, 6, 8, 10, 12), CASE valid_tid(4,6,8,10,12) WHEN 4 THEN avg(inv_quantity_on_hand) WHEN 6 THEN avg(inv_quantity_on_hand) WHEN 8 THEN avg(inv_quantity_on_hand) WHEN 10 THEN avg(inv_quantity_on_hand) WHEN 12 THEN avg(inv_quantity_on_hand) END) ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_product_name WHEN 6 THEN i_product_name WHEN 8 THEN i_product_name WHEN 10 THEN i_product_name WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_brand WHEN 6 THEN i_brand WHEN 8 THEN i_brand WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_class WHEN 6 THEN i_class WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC, CASE valid_tid(4,6,8,10,12) WHEN 4 THEN i_category WHEN 6 THEN NULL WHEN 8 THEN NULL WHEN 10 THEN NULL WHEN 12 THEN NULL END ASC
|
||||
| mem-estimate=5.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=56B cardinality=100 cost=16608995
|
||||
| in pipelines: 07(GETNEXT), 06(OPEN)
|
||||
|
|
||||
06:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,6,8,10,12) IN (CAST(4 AS INT), CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT), CAST(12 AS INT)), CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(6 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(8 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(10 AS INT) THEN avg(inv_quantity_on_hand) WHEN CAST(12 AS INT) THEN avg(inv_quantity_on_hand) END)
|
||||
| group by: CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(10 AS INT) THEN i_product_name WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,6,8,10,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=13 row-size=60B cardinality=1.44M cost=8499749
|
||||
| in pipelines: 06(GETNEXT), 11(OPEN)
|
||||
|
|
||||
11:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, i_class, i_category
|
||||
| Class 1
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, i_class, NULL
|
||||
| Class 2
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, i_brand, NULL, NULL
|
||||
| Class 3
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: i_product_name, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: avg:merge(inv_quantity_on_hand)
|
||||
| group by: NULL, NULL, NULL, NULL
|
||||
| mem-estimate=966.14MB mem-reservation=137.94MB thread-reservation=0
|
||||
| tuple-ids=4N,6N,8N,10N,12N row-size=441B cardinality=1.44M cost=243965689
|
||||
| in pipelines: 11(GETNEXT), 00(OPEN)
|
||||
|
|
||||
10:EXCHANGE [HASH(CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(i_product_name) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END,CASE valid_tid(3,5,7,9,11) WHEN 3 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=64.07MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=172.80M cost=395466548
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=3.75GB mem-reservation=138.25MB thread-reservation=1
|
||||
max-parallelism=261 segment-costs=[8962975991, 5356784990] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
|
||||
05:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, i_category
|
||||
| Class 1
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, i_class, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, i_brand, NULL, NULL
|
||||
| Class 3
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: i_product_name, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: avg(CAST(inv_quantity_on_hand AS BIGINT))
|
||||
| group by: NULL, NULL, NULL, NULL
|
||||
| mem-estimate=3.61GB mem-reservation=138.00MB thread-reservation=0
|
||||
| tuple-ids=3N,5N,7N,9N,11N row-size=441B cardinality=172.80M cost=7880050563
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=125B cardinality=1.03G cost=452163130
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 09:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: c86950a4c59688636cd63274a2bbe6ba
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: inv_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=117B cardinality=1.03G cost=452163130
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.42MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.42MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=105B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.42MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[403500]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 9499e4d1103a0f773f871959aa31dbec
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=1.03G(filtered from 1.03G) cost=178599168
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
2751
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q23a.test
vendored
Normal file
2751
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q23a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
3034
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q23b.test
vendored
Normal file
3034
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q23b.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1624
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q24a.test
vendored
Normal file
1624
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q24a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1625
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q24b.test
vendored
Normal file
1625
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q24b.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1087
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q25.test
vendored
Normal file
1087
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q25.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
643
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q26.test
vendored
Normal file
643
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q26.test
vendored
Normal file
@@ -0,0 +1,643 @@
|
||||
# TPCDS-Q26
|
||||
# start query 26 in stream 0 using template query26.tpl using seed 279876894
|
||||
select i_item_id,
|
||||
avg(cs_quantity) agg1,
|
||||
avg(cs_list_price) agg2,
|
||||
avg(cs_coupon_amt) agg3,
|
||||
avg(cs_sales_price) agg4
|
||||
from catalog_sales, customer_demographics, date_dim, item, promotion
|
||||
where cs_sold_date_sk = d_date_sk and
|
||||
cs_item_sk = i_item_sk and
|
||||
cs_bill_cdemo_sk = cd_demo_sk and
|
||||
cs_promo_sk = p_promo_sk and
|
||||
cd_gender = 'F' and
|
||||
cd_marital_status = 'M' and
|
||||
cd_education_status = '2 yr Degree' and
|
||||
(p_channel_email = 'N' or p_channel_event = 'N') and
|
||||
d_year = 2002
|
||||
group by i_item_id
|
||||
order by i_item_id
|
||||
limit 100;
|
||||
|
||||
# end query 26 in stream 0 using template query26.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=72.38MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=142MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=142.38MB mem-reservation=72.38MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[537701435, 1831104, 500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(cs_quantity), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: e3efa378f7e637bd7739d708fa01e165
|
||||
| input scan node ids: 0,1,2,3,4
|
||||
| estimated serialized size: 11.33MB
|
||||
| estimated serialized size per node: 1.13MB
|
||||
| cumulative processing cost: 537701435
|
||||
| cache read processing cost: 24662
|
||||
| cache write processing cost: 32066
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: avg(CAST(cs_quantity AS BIGINT)), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=22622567
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: cs_promo_sk = p_promo_sk
|
||||
| runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=44.06M cost=19285639
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=44.06M cost=19649490
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=44.08M cost=19293854
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: 26312214ba556151268576fa3ab64edc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=44.08M(filtered from 216.38M) cost=50611458
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 938db260524329da2112b4bd950e9756
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> cs_promo_sk, RF003[min_max] -> cs_item_sk, RF007[min_max] -> cs_bill_cdemo_sk, RF000[bloom] -> cs_promo_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk, RF006[bloom] -> cs_bill_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=44.08M(filtered from 4.32G) cost=405531453
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=411.16MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=615MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[537] cpu-comparison-result=60 [max(1 (self) vs 60 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(cs_quantity), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=63.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=37
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=23.75MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[17554532, 1831104, 188] cpu-comparison-result=60 [max(10 (self) vs 60 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: avg:merge(cs_quantity), avg:merge(cs_list_price), avg:merge(cs_coupon_amt), avg:merge(cs_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=10126393
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_item_id)]
|
||||
| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=19.19M cost=7428139
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=60 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=18.00MB thread-reservation=1
|
||||
max-parallelism=60 segment-costs=[586081151, 84033344] cpu-comparison-result=60 [max(60 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: avg(CAST(cs_quantity AS BIGINT)), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=19.19M cost=72168829
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: cs_promo_sk = p_promo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=44.06M cost=19283839
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=12.71MB mem-reservation=12.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: p_promo_sk
|
||||
| | runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| | mem-estimate=11.62MB mem-reservation=11.62MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[390]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=44.06M cost=19289490
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=215.14MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=204.00MB mem-reservation=204.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=44.08M cost=19293481
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=12.64MB mem-reservation=12.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=11.62MB mem-reservation=11.62MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 26312214ba556151268576fa3ab64edc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=44.08M(filtered from 216.38M) cost=50514059
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=57.33MB mem-reservation=52.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=51.00MB mem-reservation=51.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 938db260524329da2112b4bd950e9756
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_promo_sk, RF003[min_max] -> cs_item_sk, RF007[min_max] -> cs_bill_cdemo_sk, RF000[bloom] -> cs_promo_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk, RF006[bloom] -> cs_bill_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=44.08M(filtered from 4.32G) cost=405531453
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=411.16MB Threads=16
|
||||
Per-Host Resource Estimates: Memory=615MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.06MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[537] cpu-comparison-result=60 [max(1 (self) vs 60 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, avg(cs_quantity), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=63.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=37
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=23.75MB mem-reservation=2.88MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[17554532, 1831104, 188] cpu-comparison-result=60 [max(10 (self) vs 60 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=5.86KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=60B cardinality=100 cost=1831104
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: avg:merge(cs_quantity), avg:merge(cs_list_price), avg:merge(cs_coupon_amt), avg:merge(cs_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=6 row-size=60B cardinality=185.57K cost=10126393
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_item_id)]
|
||||
| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=19.19M cost=7428139
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=60 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=18.00MB thread-reservation=1
|
||||
max-parallelism=60 segment-costs=[586081151, 84033344] cpu-comparison-result=60 [max(60 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: avg(CAST(cs_quantity AS BIGINT)), avg(cs_list_price), avg(cs_coupon_amt), avg(cs_sales_price)
|
||||
| group by: i_item_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=60B cardinality=19.19M cost=72168829
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_promo_sk = p_promo_sk
|
||||
| fk/pk conjuncts: cs_promo_sk = p_promo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=154B cardinality=44.06M cost=19283839
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=12.71MB mem-reservation=12.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: p_promo_sk
|
||||
| | runtime filters: RF000[bloom] <- p_promo_sk, RF001[min_max] <- p_promo_sk
|
||||
| | mem-estimate=11.62MB mem-reservation=11.62MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[390]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=100.50KB
|
||||
| predicates: (p_channel_email = 'N' OR p_channel_event = 'N')
|
||||
| stored statistics:
|
||||
| table: rows=1.80K size=100.50KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.80K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=30B cardinality=1.80K cost=206
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=124B cardinality=44.06M cost=19289490
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=215.14MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=204.00MB mem-reservation=204.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=44.08M cost=19293481
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=12.64MB mem-reservation=12.62MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=11.62MB mem-reservation=11.62MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 26312214ba556151268576fa3ab64edc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2002 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2002 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2002 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: cs_bill_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=44.08M(filtered from 216.38M) cost=50514059
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=57.33MB mem-reservation=52.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=51.00MB mem-reservation=51.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 938db260524329da2112b4bd950e9756
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'M', cd_gender = 'F', cd_education_status = '2 yr Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_promo_sk, RF003[min_max] -> cs_item_sk, RF007[min_max] -> cs_bill_cdemo_sk, RF000[bloom] -> cs_promo_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk, RF006[bloom] -> cs_bill_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=44.08M(filtered from 4.32G) cost=405531453
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
757
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q27.test
vendored
Normal file
757
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q27.test
vendored
Normal file
@@ -0,0 +1,757 @@
|
||||
# TPCDS-Q27
|
||||
# start query 27 in stream 0 using template query27.tpl using seed 1476888112
|
||||
select i_item_id,
|
||||
s_state, grouping(s_state) g_state,
|
||||
avg(ss_quantity) agg1,
|
||||
avg(ss_list_price) agg2,
|
||||
avg(ss_coupon_amt) agg3,
|
||||
avg(ss_sales_price) agg4
|
||||
from store_sales, customer_demographics, date_dim, store, item
|
||||
where ss_sold_date_sk = d_date_sk and
|
||||
ss_item_sk = i_item_sk and
|
||||
ss_store_sk = s_store_sk and
|
||||
ss_cdemo_sk = cd_demo_sk and
|
||||
cd_gender = 'F' and
|
||||
cd_marital_status = 'S' and
|
||||
cd_education_status = 'Advanced Degree' and
|
||||
d_year = 2000 and
|
||||
s_state in ('WA','LA', 'LA', 'TX', 'AL', 'PA')
|
||||
group by rollup (i_item_id, s_state)
|
||||
order by i_item_id
|
||||
,s_state
|
||||
limit 100;
|
||||
|
||||
# end query 27 in stream 0 using template query27.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=136.31MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=955MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=955.46MB mem-reservation=136.31MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[1182078377, 8031185, 14873781, 700]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END, aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN 0 WHEN 8 THEN 1 WHEN 10 THEN 1 END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_quantity) WHEN 8 THEN avg(ss_quantity) WHEN 10 THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_list_price) WHEN 8 THEN avg(ss_list_price) WHEN 10 THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_coupon_amt) WHEN 8 THEN avg(ss_coupon_amt) WHEN 10 THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_sales_price) WHEN 8 THEN avg(ss_sales_price) WHEN 10 THEN avg(ss_sales_price) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END ASC, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END ASC
|
||||
| mem-estimate=5.57KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=57B cardinality=100 cost=14873781
|
||||
| in pipelines: 11(GETNEXT), 10(OPEN)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 984d7f6f000c2ed13493efdddd8ba3fc
|
||||
| input scan node ids: 0,1,2,3,4
|
||||
| estimated serialized size: 80.52MB
|
||||
| estimated serialized size per node: 8.05MB
|
||||
| cumulative processing cost: 1190109562
|
||||
| cache read processing cost: 172636
|
||||
| cache write processing cost: 227974
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=61B cardinality=1.30M cost=0
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(8 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(10 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_quantity) WHEN CAST(8 AS INT) THEN avg(ss_quantity) WHEN CAST(10 AS INT) THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_list_price) WHEN CAST(8 AS INT) THEN avg(ss_list_price) WHEN CAST(10 AS INT) THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(8 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(10 AS INT) THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_sales_price) WHEN CAST(8 AS INT) THEN avg(ss_sales_price) WHEN CAST(10 AS INT) THEN avg(ss_sales_price) END)
|
||||
| group by: CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN i_item_id WHEN CAST(8 AS INT) THEN i_item_id WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN s_state WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) END
|
||||
| mem-estimate=90.43MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=61B cardinality=1.30M cost=8031185
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
15:TUPLE CACHE
|
||||
| cache key: ed55448cddef446641bf3afed65e0185
|
||||
| input scan node ids: 0,1,2,3,4
|
||||
| estimated serialized size: 265.11MB
|
||||
| estimated serialized size per node: 26.51MB
|
||||
| cumulative processing cost: 1182078377
|
||||
| cache read processing cost: 172636
|
||||
| cache write processing cost: 750561
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=1.30M cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, s_state
|
||||
| Class 1
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=853.02MB mem-reservation=69.94MB thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=1.30M cost=181353485
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=142B cardinality=36.92M cost=16526098
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=110B cardinality=36.94M cost=29392989
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--14:TUPLE CACHE
|
||||
| | cache key: 68215eec31ddda3008679886c8e7a2e0
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 5.99KB
|
||||
| | estimated serialized size per node: 5.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 37
|
||||
| | cache write processing cost: 16
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=279 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| parquet dictionary predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=279 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734432
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--13:TUPLE CACHE
|
||||
| | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101209716
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: 64777a5c0a1bc8df5b42b50d85e1f253
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.64GB Threads=23
|
||||
Per-Host Resource Estimates: Memory=2.95GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.12MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[736] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END, aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN 0 WHEN 8 THEN 1 WHEN 10 THEN 1 END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_quantity) WHEN 8 THEN avg(ss_quantity) WHEN 10 THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_list_price) WHEN 8 THEN avg(ss_list_price) WHEN 10 THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_coupon_amt) WHEN 8 THEN avg(ss_coupon_amt) WHEN 10 THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_sales_price) WHEN 8 THEN avg(ss_sales_price) WHEN 10 THEN avg(ss_sales_price) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END ASC, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END ASC
|
||||
| limit: 100
|
||||
| mem-estimate=119.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=57B cardinality=100 cost=36
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(i_item_id) WHEN 7 THEN murmur_hash(i_item_id) WHEN 9 THEN murmur_hash(NULL) END,CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(s_state) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) END)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=412.15MB mem-reservation=78.44MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[141557699, 8031185, 14873781, 180] cpu-comparison-result=120 [max(20 (self) vs 120 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END ASC, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END ASC
|
||||
| mem-estimate=5.57KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=57B cardinality=100 cost=14873781
|
||||
| in pipelines: 11(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(8 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(10 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_quantity) WHEN CAST(8 AS INT) THEN avg(ss_quantity) WHEN CAST(10 AS INT) THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_list_price) WHEN CAST(8 AS INT) THEN avg(ss_list_price) WHEN CAST(10 AS INT) THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(8 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(10 AS INT) THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_sales_price) WHEN CAST(8 AS INT) THEN avg(ss_sales_price) WHEN CAST(10 AS INT) THEN avg(ss_sales_price) END)
|
||||
| group by: CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN i_item_id WHEN CAST(8 AS INT) THEN i_item_id WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN s_state WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=61B cardinality=1.30M cost=8031185
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id, s_state
|
||||
| Class 1
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id, NULL
|
||||
| Class 2
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=377.07MB mem-reservation=69.94MB thread-reservation=0
|
||||
| tuple-ids=6N,8N,10N row-size=202B cardinality=1.30M cost=85542654
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(i_item_id) WHEN 7 THEN murmur_hash(i_item_id) WHEN 9 THEN murmur_hash(NULL) END,CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(s_state) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=35.08MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=50.29M cost=56015045
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=127.69MB mem-reservation=78.00MB thread-reservation=1
|
||||
max-parallelism=150 segment-costs=[1402757021, 731901770] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, s_state
|
||||
| Class 1
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=94.97MB mem-reservation=70.00MB thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=50.29M cost=403197102
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=142B cardinality=36.92M cost=16166098
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=110B cardinality=36.94M cost=29392710
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[649]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=279
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=279 cost=370
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[173]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 68215eec31ddda3008679886c8e7a2e0
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 5.99KB
|
||||
| | estimated serialized size per node: 5.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 37
|
||||
| | cache write processing cost: 16
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=279 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| parquet dictionary predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=279 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734059
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101112317
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 64777a5c0a1bc8df5b42b50d85e1f253
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.64GB Threads=23
|
||||
Per-Host Resource Estimates: Memory=2.95GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.12MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[736] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END, aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN 0 WHEN 8 THEN 1 WHEN 10 THEN 1 END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_quantity) WHEN 8 THEN avg(ss_quantity) WHEN 10 THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_list_price) WHEN 8 THEN avg(ss_list_price) WHEN 10 THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_coupon_amt) WHEN 8 THEN avg(ss_coupon_amt) WHEN 10 THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (6, 8, 10), CASE valid_tid(6,8,10) WHEN 6 THEN avg(ss_sales_price) WHEN 8 THEN avg(ss_sales_price) WHEN 10 THEN avg(ss_sales_price) END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END ASC, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END ASC
|
||||
| limit: 100
|
||||
| mem-estimate=119.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=57B cardinality=100 cost=36
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(i_item_id) WHEN 7 THEN murmur_hash(i_item_id) WHEN 9 THEN murmur_hash(NULL) END,CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(s_state) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) END)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=412.15MB mem-reservation=78.44MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[141557699, 8031185, 14873781, 180] cpu-comparison-result=120 [max(20 (self) vs 120 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: CASE valid_tid(6,8,10) WHEN 6 THEN i_item_id WHEN 8 THEN i_item_id WHEN 10 THEN NULL END ASC, CASE valid_tid(6,8,10) WHEN 6 THEN s_state WHEN 8 THEN NULL WHEN 10 THEN NULL END ASC
|
||||
| mem-estimate=5.57KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=57B cardinality=100 cost=14873781
|
||||
| in pipelines: 11(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(8 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(10 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_quantity) WHEN CAST(8 AS INT) THEN avg(ss_quantity) WHEN CAST(10 AS INT) THEN avg(ss_quantity) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_list_price) WHEN CAST(8 AS INT) THEN avg(ss_list_price) WHEN CAST(10 AS INT) THEN avg(ss_list_price) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(8 AS INT) THEN avg(ss_coupon_amt) WHEN CAST(10 AS INT) THEN avg(ss_coupon_amt) END), aggif(valid_tid(6,8,10) IN (CAST(6 AS INT), CAST(8 AS INT), CAST(10 AS INT)), CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN avg(ss_sales_price) WHEN CAST(8 AS INT) THEN avg(ss_sales_price) WHEN CAST(10 AS INT) THEN avg(ss_sales_price) END)
|
||||
| group by: CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN i_item_id WHEN CAST(8 AS INT) THEN i_item_id WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN s_state WHEN CAST(8 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL END, CASE valid_tid(6,8,10) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=61B cardinality=1.30M cost=8031185
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id, s_state
|
||||
| Class 1
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: i_item_id, NULL
|
||||
| Class 2
|
||||
| output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=377.07MB mem-reservation=69.94MB thread-reservation=0
|
||||
| tuple-ids=6N,8N,10N row-size=202B cardinality=1.30M cost=85542654
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(i_item_id) WHEN 7 THEN murmur_hash(i_item_id) WHEN 9 THEN murmur_hash(NULL) END,CASE valid_tid(5,7,9) WHEN 5 THEN murmur_hash(s_state) WHEN 7 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=35.08MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=50.29M cost=56015045
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=127.69MB mem-reservation=78.00MB thread-reservation=1
|
||||
max-parallelism=150 segment-costs=[1402757021, 731901770] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, s_state
|
||||
| Class 1
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: i_item_id, NULL
|
||||
| Class 2
|
||||
| output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=94.97MB mem-reservation=70.00MB thread-reservation=0
|
||||
| tuple-ids=5N,7N,9N row-size=202B cardinality=50.29M cost=403197102
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3,4 row-size=142B cardinality=36.92M cost=16166098
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2,3 row-size=110B cardinality=36.94M cost=29392710
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[649]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=279
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=279 cost=370
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[173]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 68215eec31ddda3008679886c8e7a2e0
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 5.99KB
|
||||
| | estimated serialized size per node: 5.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 37
|
||||
| | cache write processing cost: 16
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=279 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| parquet dictionary predicates: s_state IN ('WA', 'LA', 'LA', 'TX', 'AL', 'PA')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=279 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=92B cardinality=88.49M(filtered from 88.49M) cost=38734059
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 5536b7721c3902915addf658472e0caa
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2000 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2000 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2000 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_cdemo_sk = cd_demo_sk
|
||||
| fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=84B cardinality=88.49M(filtered from 432.75M) cost=101112317
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[226839]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- cd_demo_sk, RF007[min_max] <- cd_demo_sk
|
||||
| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=129440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[608286]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 64777a5c0a1bc8df5b42b50d85e1f253
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.16MB
|
||||
| | estimated serialized size per node: 528.57KB
|
||||
| | cumulative processing cost: 592621
|
||||
| | cache read processing cost: 12944
|
||||
| | cache write processing cost: 14614
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=52B cardinality=97.40K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=11.15MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| stored statistics:
|
||||
| table: rows=1.92M size=11.15MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=197.97K
|
||||
| parquet statistics predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| parquet dictionary predicates: cd_marital_status = 'S', cd_gender = 'F', cd_education_status = 'Advanced Degree'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=52B cardinality=97.40K cost=592621
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF007[min_max] -> ss_cdemo_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk, RF006[bloom] -> ss_cdemo_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=32B cardinality=88.49M(filtered from 8.64G) cost=814154735
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
1508
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q28.test
vendored
Normal file
1508
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q28.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1058
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q29.test
vendored
Normal file
1058
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q29.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1204
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q30.test
vendored
Normal file
1204
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q30.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
2466
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q31.test
vendored
Normal file
2466
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q31.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
766
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q32.test
vendored
Normal file
766
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q32.test
vendored
Normal file
@@ -0,0 +1,766 @@
|
||||
# TPCDS-Q32
|
||||
# start query 32 in stream 0 using template query32.tpl using seed 1546887947
|
||||
select sum(cs_ext_discount_amt) as "excess discount amount"
|
||||
from
|
||||
catalog_sales
|
||||
,item
|
||||
,date_dim
|
||||
where
|
||||
i_manufact_id = 948
|
||||
and i_item_sk = cs_item_sk
|
||||
and d_date between cast('1998-02-03' as date) and
|
||||
(cast('1998-02-03' as date) + interval 90 days)
|
||||
and d_date_sk = cs_sold_date_sk
|
||||
and cs_ext_discount_amt
|
||||
> (
|
||||
select
|
||||
1.3 * avg(cs_ext_discount_amt)
|
||||
from
|
||||
catalog_sales
|
||||
,date_dim
|
||||
where
|
||||
cs_item_sk = i_item_sk
|
||||
and d_date between cast('1998-02-03' as date) and
|
||||
(cast('1998-02-03' as date) + interval 90 days)
|
||||
and d_date_sk = cs_sold_date_sk
|
||||
)
|
||||
limit 100;
|
||||
|
||||
# end query 32 in stream 0 using template query32.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=89.38MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=135MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=134.88MB mem-reservation=89.38MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[194831391, 38609667, 0]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: sum(cs_ext_discount_amt)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum(cs_ext_discount_amt)
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=1 cost=15647
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
18:TUPLE CACHE
|
||||
| cache key: da6da09eacddf981d4240b4e33a4356f
|
||||
| input scan node ids: 0,1,2,3,4
|
||||
| estimated serialized size: 8.53MB
|
||||
| estimated serialized size per node: 873.21KB
|
||||
| cumulative processing cost: 233425411
|
||||
| cache read processing cost: 29708
|
||||
| cache write processing cost: 24142
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [LEFT SEMI JOIN]
|
||||
| hash predicates: i_item_sk = cs_item_sk
|
||||
| other join predicates: cs_ext_discount_amt > CAST(1.3 AS DECIMAL(2,1)) * avg(cs_ext_discount_amt)
|
||||
| runtime filters: RF000[bloom] <- cs_item_sk, RF001[min_max] <- cs_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=458023
|
||||
| in pipelines: 00(GETNEXT), 06(OPEN)
|
||||
|
|
||||
|--17:TUPLE CACHE
|
||||
| | cache key: 348dc72c31a29011b1fafed5eee095be
|
||||
| | input scan node ids: 3,4
|
||||
| | estimated serialized size: 5.50MB
|
||||
| | estimated serialized size per node: 562.78KB
|
||||
| | cumulative processing cost: 194831391
|
||||
| | cache read processing cost: 47867
|
||||
| | cache write processing cost: 15559
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=360.18K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [FINALIZE]
|
||||
| | output: avg(cs_ext_discount_amt)
|
||||
| | group by: cs_item_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=360.18K cost=63740631
|
||||
| | in pipelines: 06(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=20B cardinality=214.71M cost=93977005
|
||||
| | in pipelines: 03(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--16:TUPLE CACHE
|
||||
| | | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | | input scan node ids: 4
|
||||
| | | estimated serialized size: 1.07KB
|
||||
| | | estimated serialized size per node: 1.07KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 12
|
||||
| | | cache write processing cost: 2
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=8B cardinality=91 cost=0
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=91 cost=12520
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF006[bloom] -> cs_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=214.71M(filtered from 4.32G) cost=37101235
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
15:TUPLE CACHE
|
||||
| cache key: 818fd1b21c07afdec6ad20712a330664
|
||||
| input scan node ids: 0,1,2
|
||||
| estimated serialized size: 8.53MB
|
||||
| estimated serialized size per node: 873.21KB
|
||||
| cumulative processing cost: 38135997
|
||||
| cache read processing cost: 29708
|
||||
| cache write processing cost: 24142
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=97934
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--14:TUPLE CACHE
|
||||
| | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.07KB
|
||||
| | estimated serialized size per node: 1.07KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 12
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=91 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=91 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 16c28937a9f9fbede98af82a9236b7ef
|
||||
| input scan node ids: 0,1
|
||||
| estimated serialized size: 5.97MB
|
||||
| estimated serialized size per node: 611.24KB
|
||||
| cumulative processing cost: 38025543
|
||||
| cache read processing cost: 29708
|
||||
| cache write processing cost: 16899
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=20B cardinality=223.54K(filtered from 4.50M) cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=20B cardinality=223.54K(filtered from 4.50M) cost=872720
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: e263f9e3da19540cfcef2dc61a92bfc6
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 4.39KB
|
||||
| | estimated serialized size per node: 1.10KB
|
||||
| | cumulative processing cost: 51588
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=375 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| runtime filters: RF001[min_max] -> i_item_sk, RF000[bloom] -> i_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| parquet dictionary predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=375 cost=51588
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: 9c0116f07b54af07e4e60214e5fc9eff
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 3.41MB
|
||||
| estimated serialized size per node: 349.28KB
|
||||
| cumulative processing cost: 37101235
|
||||
| cache read processing cost: 29708
|
||||
| cache write processing cost: 9656
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=223.54K(filtered from 4.32G) cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF005[min_max] -> cs_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF002[bloom] -> cs_sold_date_sk, RF004[bloom] -> cs_item_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=223.54K(filtered from 4.32G) cost=37101235
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=124.94MB Threads=14
|
||||
Per-Host Resource Estimates: Memory=267MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=39.62KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[30, 0] cpu-comparison-result=65 [max(1 (self) vs 65 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: sum(cs_ext_discount_amt)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
18:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_ext_discount_amt)
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=1 cost=8
|
||||
| in pipelines: 18(GETNEXT), 10(OPEN)
|
||||
|
|
||||
17:EXCHANGE [UNPARTITIONED]
|
||||
| mem-estimate=23.62KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=120 cost=22
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(cs_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=1.00MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[183570, 185] cpu-comparison-result=65 [max(20 (self) vs 65 (sum children))]
|
||||
10:AGGREGATE
|
||||
| output: sum(cs_ext_discount_amt)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=120 cost=15647
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
09:HASH JOIN [LEFT SEMI JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i_item_sk = cs_item_sk
|
||||
| other join predicates: cs_ext_discount_amt > CAST(1.3 AS DECIMAL(2,1)) * avg(cs_ext_discount_amt)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=97843
|
||||
| in pipelines: 00(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [HASH(cs_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=21.62MB mem-reservation=5.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[20631160, 360180] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: cs_item_sk
|
||||
| | runtime filters: RF000[bloom] <- cs_item_sk, RF001[min_max] <- cs_item_sk
|
||||
| | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 cost=360180
|
||||
| |
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(cs_ext_discount_amt)
|
||||
| | group by: cs_item_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=360.18K cost=13493418
|
||||
| | in pipelines: 15(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(cs_item_sk)]
|
||||
| | mem-estimate=10.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=7137742
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=37.62MB mem-reservation=22.00MB thread-reservation=1
|
||||
| max-parallelism=40 segment-costs=[305783037, 55282093] cpu-comparison-result=40 [max(40 (self) vs 11 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: e8915ae650c0ff0fb75c84950dea39fb
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 654.92MB
|
||||
| | estimated serialized size per node: 65.49MB
|
||||
| | cumulative processing cost: 305795771
|
||||
| | cache read processing cost: 5704184
|
||||
| | cache write processing cost: 1854182
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | output: avg(cs_ext_discount_amt)
|
||||
| | group by: cs_item_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=174704888
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=20B cardinality=214.71M cost=93976914
|
||||
| | in pipelines: 03(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[211]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=91
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=8B cardinality=91 cost=120
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12523]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | | input scan node ids: 4
|
||||
| | | estimated serialized size: 1.07KB
|
||||
| | | estimated serialized size per node: 1.07KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 12
|
||||
| | | cache write processing cost: 2
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=8B cardinality=91 cost=0
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=91 cost=12520
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF006[bloom] -> cs_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=214.71M(filtered from 4.32G) cost=37101235
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
16:EXCHANGE [HASH(i_item_sk)]
|
||||
| mem-estimate=1011.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=70080
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=17.56MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[38820017]
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=97843
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[211]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=91
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=91 cost=120
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12523]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.07KB
|
||||
| | estimated serialized size per node: 1.07KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 12
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=91 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=91 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=20B cardinality=223.54K(filtered from 4.50M) cost=872345
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.96MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[865]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=375
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=20.51KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=375 cost=490
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[51604]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| runtime filters: RF001[min_max] -> i_item_sk, RF000[bloom] -> i_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| parquet dictionary predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=375 cost=51588
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF005[min_max] -> cs_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF002[bloom] -> cs_sold_date_sk, RF004[bloom] -> cs_item_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=223.54K(filtered from 4.32G) cost=37101235
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=124.94MB Threads=14
|
||||
Per-Host Resource Estimates: Memory=267MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=39.62KB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[30, 0] cpu-comparison-result=65 [max(1 (self) vs 65 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: sum(cs_ext_discount_amt)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
||||
|
|
||||
18:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(cs_ext_discount_amt)
|
||||
| limit: 100
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=1 cost=8
|
||||
| in pipelines: 18(GETNEXT), 10(OPEN)
|
||||
|
|
||||
17:EXCHANGE [UNPARTITIONED]
|
||||
| mem-estimate=23.62KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=120 cost=22
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(cs_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=1.00MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[183570, 185] cpu-comparison-result=65 [max(20 (self) vs 65 (sum children))]
|
||||
10:AGGREGATE
|
||||
| output: sum(cs_ext_discount_amt)
|
||||
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=16B cardinality=120 cost=15647
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
09:HASH JOIN [LEFT SEMI JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i_item_sk = cs_item_sk
|
||||
| other join predicates: cs_ext_discount_amt > CAST(1.3 AS DECIMAL(2,1)) * avg(cs_ext_discount_amt)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=97843
|
||||
| in pipelines: 00(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [HASH(cs_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=21.62MB mem-reservation=5.81MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[20631160, 360180] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: cs_item_sk
|
||||
| | runtime filters: RF000[bloom] <- cs_item_sk, RF001[min_max] <- cs_item_sk
|
||||
| | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 cost=360180
|
||||
| |
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(cs_ext_discount_amt)
|
||||
| | group by: cs_item_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=360.18K cost=13493418
|
||||
| | in pipelines: 15(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(cs_item_sk)]
|
||||
| | mem-estimate=10.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=7137742
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=37.62MB mem-reservation=22.00MB thread-reservation=1
|
||||
| max-parallelism=40 segment-costs=[305783037, 55282093] cpu-comparison-result=40 [max(40 (self) vs 11 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: e8915ae650c0ff0fb75c84950dea39fb
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 654.92MB
|
||||
| | estimated serialized size per node: 65.49MB
|
||||
| | cumulative processing cost: 305795771
|
||||
| | cache read processing cost: 5704184
|
||||
| | cache write processing cost: 1854182
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | output: avg(cs_ext_discount_amt)
|
||||
| | group by: cs_item_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=42.92M cost=174704888
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=20B cardinality=214.71M cost=93976914
|
||||
| | in pipelines: 03(GETNEXT), 04(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[211]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=91
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=8B cardinality=91 cost=120
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12523]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | | input scan node ids: 4
|
||||
| | | estimated serialized size: 1.07KB
|
||||
| | | estimated serialized size per node: 1.07KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 12
|
||||
| | | cache write processing cost: 2
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=8B cardinality=91 cost=0
|
||||
| | | in pipelines: 04(GETNEXT)
|
||||
| | |
|
||||
| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=91 cost=12520
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF006[bloom] -> cs_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=214.71M(filtered from 4.32G) cost=37101235
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
16:EXCHANGE [HASH(i_item_sk)]
|
||||
| mem-estimate=1011.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=70080
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=17.56MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[38820017]
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=28B cardinality=223.54K cost=97843
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[211]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=91
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=91 cost=120
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12523]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 4e060e28ce81e085cf308c3bb8747bb6
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 1.07KB
|
||||
| | estimated serialized size per node: 1.07KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 12
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=91 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1998-05-04', d_date >= DATE '1998-02-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=91 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=20B cardinality=223.54K(filtered from 4.50M) cost=872345
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.96MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[865]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=375
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=20.51KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=375 cost=490
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[51604]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| runtime filters: RF001[min_max] -> i_item_sk, RF000[bloom] -> i_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| parquet dictionary predicates: i_manufact_id = CAST(948 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=375 cost=51588
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF005[min_max] -> cs_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_item_sk, RF002[bloom] -> cs_sold_date_sk, RF004[bloom] -> cs_item_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=91(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=223.54K(filtered from 4.32G) cost=37101235
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
2241
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q33.test
vendored
Normal file
2241
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q33.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
753
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q34.test
vendored
Normal file
753
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q34.test
vendored
Normal file
@@ -0,0 +1,753 @@
|
||||
# TPCDS-Q34
|
||||
# start query 34 in stream 0 using template query34.tpl using seed 396807568
|
||||
select c_last_name
|
||||
,c_first_name
|
||||
,c_salutation
|
||||
,c_preferred_cust_flag
|
||||
,ss_ticket_number
|
||||
,cnt from
|
||||
(select ss_ticket_number
|
||||
,ss_customer_sk
|
||||
,count(*) cnt
|
||||
from store_sales,date_dim,store,household_demographics
|
||||
where store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
and store_sales.ss_store_sk = store.s_store_sk
|
||||
and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
and (date_dim.d_dom between 1 and 3 or date_dim.d_dom between 25 and 28)
|
||||
and (household_demographics.hd_buy_potential = '>10000' or
|
||||
household_demographics.hd_buy_potential = '5001-10000')
|
||||
and household_demographics.hd_vehicle_count > 0
|
||||
and (case when household_demographics.hd_vehicle_count > 0
|
||||
then household_demographics.hd_dep_count/ household_demographics.hd_vehicle_count
|
||||
else null
|
||||
end) > 1.2
|
||||
and date_dim.d_year in (1999,1999+1,1999+2)
|
||||
and store.s_county in ('Jefferson Davis Parish','Levy County','Coal County','Oglethorpe County',
|
||||
'Mobile County','Gage County','Richland County','Gogebic County')
|
||||
group by ss_ticket_number,ss_customer_sk) dn,customer
|
||||
where ss_customer_sk = c_customer_sk
|
||||
and cnt between 15 and 20
|
||||
order by c_last_name,c_first_name,c_salutation,c_preferred_cust_flag desc, ss_ticket_number;
|
||||
|
||||
# end query 34 in stream 0 using template query34.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=88.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=1.18GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=88.00MB thread-reservation=1 runtime-filters-memory=7.00MB
|
||||
| max-parallelism=1 segment-costs=[960041231, 26467220, 19951626]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=19951626
|
||||
|
|
||||
10:SORT
|
||||
| order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC, ss_ticket_number ASC
|
||||
| mem-estimate=254.36MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=3.33M cost=12955967
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 20fb3a9b13167c823af72417f51d2926
|
||||
| input scan node ids: 8,0,3,1,2
|
||||
| estimated serialized size: 305.10MB
|
||||
| estimated serialized size per node: 30.51MB
|
||||
| cumulative processing cost: 973552484
|
||||
| cache read processing cost: 441928
|
||||
| cache write processing cost: 863791
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=3.33M cost=0
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| mem-estimate=159.42MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=3.33M cost=4780742
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 8f2590e4575f4fbb0a758c0894ca050d
|
||||
| | input scan node ids: 0,3,1,2
|
||||
| | estimated serialized size: 76.11MB
|
||||
| | estimated serialized size per node: 7.61MB
|
||||
| | cumulative processing cost: 960041231
|
||||
| | cache read processing cost: 441928
|
||||
| | cache write processing cost: 215477
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [FINALIZE]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(20 AS BIGINT), count(*) >= CAST(15 AS BIGINT)
|
||||
| | mem-estimate=1014.79MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=196277451
|
||||
| | in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- store.s_store_sk, RF003[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1,2 row-size=97B cardinality=33.25M cost=30283275
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--14:TUPLE CACHE
|
||||
| | | cache key: a37ce8be009c53cd96de9abe430ab3c4
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 7.79KB
|
||||
| | | estimated serialized size per node: 7.79KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 31
|
||||
| | | cache write processing cost: 21
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=235 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=235 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1 row-size=68B cardinality=94.57M cost=41394400
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--13:TUPLE CACHE
|
||||
| | | cache key: fa7bc157f918eefe341d8445ad9c14b4
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112554079
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--12:TUPLE CACHE
|
||||
| | | cache key: b575b9ad85fb9ae7e818020b84fa91e0
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000'), (CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END) > CAST(1.2 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF003[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_store_sk, RF004[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: b3473c1ca4d6daac60589eb57c09c346
|
||||
| input scan node ids: 8
|
||||
| estimated serialized size: 228.99MB
|
||||
| estimated serialized size per node: 22.90MB
|
||||
| cumulative processing cost: 8730511
|
||||
| cache read processing cost: 441928
|
||||
| cache write processing cost: 648313
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=68B cardinality=3.33M(filtered from 30.00M) cost=0
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=3.33M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=447.70MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=937MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=126.26MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[21326023] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=19951626
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC, ss_ticket_number ASC
|
||||
| mem-estimate=26.26MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=3.33M cost=1374397
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=41.44MB mem-reservation=13.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[23141949, 8033154] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))]
|
||||
10:SORT
|
||||
| order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC, ss_ticket_number ASC
|
||||
| mem-estimate=25.44MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=3.33M cost=12955967
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=3.33M cost=1455471
|
||||
| in pipelines: 08(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=174.13MB mem-reservation=38.00MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| | max-parallelism=10 segment-costs=[7744551] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_customer_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| | mem-estimate=159.42MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=3325271
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=4419280
|
||||
| | in pipelines: 15(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=46.34MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=30 segment-costs=[203031076, 251390] cpu-comparison-result=100 [max(30 (self) vs 100 (sum children))]
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(20 AS BIGINT), count(*) >= CAST(15 AS BIGINT)
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=196277451
|
||||
| | in pipelines: 15(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)]
|
||||
| | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=6753625
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=32.81MB mem-reservation=21.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[960020484, 59961288] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 51dc38b94006b6c14f769ccbb1db73a2
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 761.09MB
|
||||
| | estimated serialized size per node: 76.11MB
|
||||
| | cumulative processing cost: 960042648
|
||||
| | cache read processing cost: 4419285
|
||||
| | cache write processing cost: 2154775
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=196277451
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1,2 row-size=97B cardinality=33.25M cost=30283040
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[545]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: store.s_store_sk
|
||||
| | | runtime filters: RF002[bloom] <- store.s_store_sk, RF003[min_max] <- store.s_store_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=235
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=235 cost=310
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[410]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: a37ce8be009c53cd96de9abe430ab3c4
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 7.79KB
|
||||
| | | estimated serialized size per node: 7.79KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 31
|
||||
| | | cache write processing cost: 21
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=235 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=235 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1 row-size=68B cardinality=94.57M cost=41394046
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[824]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: date_dim.d_date_sk
|
||||
| | | runtime filters: RF004[bloom] <- date_dim.d_date_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| | |
|
||||
| | 12:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[16747]
|
||||
| | 19:TUPLE CACHE
|
||||
| | | cache key: fa7bc157f918eefe341d8445ad9c14b4
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112553663
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.40MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[966]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: household_demographics.hd_demo_sk
|
||||
| | | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=416
|
||||
| | |
|
||||
| | 11:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=27.22KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=550
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.06MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[2672]
|
||||
| | 18:TUPLE CACHE
|
||||
| | | cache key: b575b9ad85fb9ae7e818020b84fa91e0
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000'), (CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END) > CAST(1.2 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF003[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_store_sk, RF004[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=3.33M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=447.70MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=937MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=126.26MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[21326023] cpu-comparison-result=100 [max(1 (self) vs 100 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=19951626
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC, ss_ticket_number ASC
|
||||
| mem-estimate=26.26MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=3.33M cost=1374397
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=41.44MB mem-reservation=13.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[23141949, 8033154] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))]
|
||||
10:SORT
|
||||
| order by: c_last_name ASC, c_first_name ASC, c_salutation ASC, c_preferred_cust_flag DESC, ss_ticket_number ASC
|
||||
| mem-estimate=25.44MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=3.33M cost=12955967
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=3.33M cost=1455471
|
||||
| in pipelines: 08(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=174.13MB mem-reservation=38.00MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| | max-parallelism=10 segment-costs=[7744551] cpu-comparison-result=100 [max(10 (self) vs 100 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_customer_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| | mem-estimate=159.42MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=3325271
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.70MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=4419280
|
||||
| | in pipelines: 15(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=46.34MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=30 segment-costs=[203031076, 251390] cpu-comparison-result=100 [max(30 (self) vs 100 (sum children))]
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(20 AS BIGINT), count(*) >= CAST(15 AS BIGINT)
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=3.33M cost=196277451
|
||||
| | in pipelines: 15(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)]
|
||||
| | mem-estimate=12.34MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=6753625
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=100 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=32.81MB mem-reservation=21.00MB thread-reservation=1
|
||||
| max-parallelism=100 segment-costs=[960020484, 59961288] cpu-comparison-result=100 [max(100 (self) vs 33 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 51dc38b94006b6c14f769ccbb1db73a2
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 761.09MB
|
||||
| | estimated serialized size per node: 76.11MB
|
||||
| | cumulative processing cost: 960042648
|
||||
| | cache read processing cost: 4419285
|
||||
| | cache write processing cost: 2154775
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=33.25M cost=196277451
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1,2 row-size=97B cardinality=33.25M cost=30283040
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[545]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: store.s_store_sk
|
||||
| | | runtime filters: RF002[bloom] <- store.s_store_sk, RF003[min_max] <- store.s_store_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=235
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=235 cost=310
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[410]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: a37ce8be009c53cd96de9abe430ab3c4
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 7.79KB
|
||||
| | | estimated serialized size per node: 7.79KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 31
|
||||
| | | cache write processing cost: 21
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=235 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Jefferson Davis Parish', 'Levy County', 'Coal County', 'Oglethorpe County', 'Mobile County', 'Gage County', 'Richland County', 'Gogebic County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=235 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,1 row-size=68B cardinality=94.57M cost=41394046
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.39MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[824]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: date_dim.d_date_sk
|
||||
| | | runtime filters: RF004[bloom] <- date_dim.d_date_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| | |
|
||||
| | 12:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[16747]
|
||||
| | 19:TUPLE CACHE
|
||||
| | | cache key: fa7bc157f918eefe341d8445ad9c14b4
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT)), (date_dim.d_dom >= CAST(1 AS INT) AND date_dim.d_dom <= CAST(3 AS INT) OR date_dim.d_dom >= CAST(25 AS INT) AND date_dim.d_dom <= CAST(28 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112553663
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=20.40MB mem-reservation=20.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[966]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: household_demographics.hd_demo_sk
|
||||
| | | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | | mem-estimate=19.38MB mem-reservation=19.38MB spill-buffer=64.00KB thread-reservation=0 cost=416
|
||||
| | |
|
||||
| | 11:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=27.22KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=550
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.06MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[2672]
|
||||
| | 18:TUPLE CACHE
|
||||
| | | cache key: b575b9ad85fb9ae7e818020b84fa91e0
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000'), (CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END) > CAST(1.2 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('>10000', '5001-10000')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF003[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_store_sk, RF004[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=3.33M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
====
|
||||
1185
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q35a.test
vendored
Normal file
1185
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q35a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
715
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q36.test
vendored
Normal file
715
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q36.test
vendored
Normal file
@@ -0,0 +1,715 @@
|
||||
# TPCDS-Q36
|
||||
# start query 36 in stream 0 using template query36.tpl using seed 538240790
|
||||
select
|
||||
sum(ss_net_profit)/sum(ss_ext_sales_price) as gross_margin
|
||||
,i_category
|
||||
,i_class
|
||||
,grouping(i_category)+grouping(i_class) as lochierarchy
|
||||
,rank() over (
|
||||
partition by grouping(i_category)+grouping(i_class),
|
||||
case when grouping(i_class) = 0 then i_category end
|
||||
order by sum(ss_net_profit)/sum(ss_ext_sales_price) asc) as rank_within_parent
|
||||
from
|
||||
store_sales
|
||||
,date_dim d1
|
||||
,item
|
||||
,store
|
||||
where
|
||||
d1.d_year = 1998
|
||||
and d1.d_date_sk = ss_sold_date_sk
|
||||
and i_item_sk = ss_item_sk
|
||||
and s_store_sk = ss_store_sk
|
||||
and s_state in ('OH','WV','PA','TN',
|
||||
'MN','MO','NM','MI')
|
||||
group by rollup(i_category,i_class)
|
||||
order by
|
||||
lochierarchy desc
|
||||
,case when grouping(i_category)+grouping(i_class) = 0 then i_category end
|
||||
,rank_within_parent
|
||||
limit 100;
|
||||
|
||||
# end query 36 in stream 0 using template query36.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=69.89MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=125MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=124.88MB mem-reservation=69.89MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[6602695576, 6118, 3107, 6626, 500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END), CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END, CASE valid_tid(4,5,6) WHEN 4 THEN i_class WHEN 5 THEN NULL WHEN 6 THEN NULL END, CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) AS SMALLINT) + CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) AS SMALLINT), rank()
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) DESC, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC, rank() ASC
|
||||
| mem-estimate=6.45KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=66B cardinality=100 cost=5625
|
||||
| in pipelines: 11(GETNEXT), 09(OPEN)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END), CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17,16 row-size=70B cardinality=1.00K cost=1001
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:SORT
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) ASC NULLS LAST, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC NULLS LAST, aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17 row-size=62B cardinality=1.00K cost=3107
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
15:TUPLE CACHE
|
||||
| cache key: 9245f5870256dd45d3d053bcc5d62b59
|
||||
| input scan node ids: 0,1,3,2
|
||||
| estimated serialized size: 64.52KB
|
||||
| estimated serialized size per node: 6.45KB
|
||||
| cumulative processing cost: 6602701694
|
||||
| cache read processing cost: 133
|
||||
| cache write processing cost: 178
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=0
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_net_profit) WHEN CAST(5 AS INT) THEN sum(ss_net_profit) WHEN CAST(6 AS INT) THEN sum(ss_net_profit) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(5 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(6 AS INT) THEN sum(ss_ext_sales_price) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END)
|
||||
| group by: CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=6118
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: aed49c538f1b3752f3088e68e74df254
|
||||
| input scan node ids: 0,1,3,2
|
||||
| estimated serialized size: 195.12KB
|
||||
| estimated serialized size per node: 19.51KB
|
||||
| cumulative processing cost: 6602695576
|
||||
| cache read processing cost: 133
|
||||
| cache write processing cost: 539
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=1.00K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, i_class
|
||||
| Class 1
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, NULL
|
||||
| Class 2
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=30.00MB mem-reservation=5.81MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=1.00K cost=4258308887
|
||||
| in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,3,2 row-size=88B cardinality=982.92M cost=430710147
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=42B cardinality=360.00K cost=91721
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,3 row-size=46B cardinality=983.41M cost=631386130
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--13:TUPLE CACHE
|
||||
| | cache key: 654589393dc19a5ad0edb5f3e768f50e
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 7.99KB
|
||||
| | estimated serialized size per node: 7.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 22
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=372 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| parquet dictionary predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=372 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d1.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=28B cardinality=1.77G cost=773341361
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: 01bd56fbeac3c4a0d81c21852cf58ce0
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| parquet dictionary predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=1.77G(filtered from 8.64G) cost=508846709
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=713.27MB Threads=21
|
||||
Per-Host Resource Estimates: Memory=1.27GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.07MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[538] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END), CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END, CASE valid_tid(4,5,6) WHEN 4 THEN i_class WHEN 5 THEN NULL WHEN 6 THEN NULL END, CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) AS SMALLINT) + CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) AS SMALLINT), rank()
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) DESC, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC, rank() ASC
|
||||
| limit: 100
|
||||
| mem-estimate=69.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=66B cardinality=100 cost=38
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END),CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.64MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3503, 6626, 204] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) DESC, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC, rank() ASC
|
||||
| mem-estimate=6.45KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=66B cardinality=100 cost=5625
|
||||
| in pipelines: 11(GETNEXT), 09(OPEN)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END), CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17,16 row-size=70B cardinality=1.00K cost=1001
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:SORT
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) ASC NULLS LAST, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC NULLS LAST, aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17 row-size=62B cardinality=1.00K cost=3107
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
17:EXCHANGE [HASH(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END),CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END)]
|
||||
| mem-estimate=651.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=396
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=55.54MB mem-reservation=7.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[303840, 6118, 4512] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_net_profit) WHEN CAST(5 AS INT) THEN sum(ss_net_profit) WHEN CAST(6 AS INT) THEN sum(ss_net_profit) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(5 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(6 AS INT) THEN sum(ss_ext_sales_price) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END)
|
||||
| group by: CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=6118
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: i_category, i_class
|
||||
| Class 1
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: i_category, NULL
|
||||
| Class 2
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=30.00MB mem-reservation=5.81MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=1.00K cost=177997
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=25.54MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=125843
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=57.80MB mem-reservation=18.00MB thread-reservation=1
|
||||
max-parallelism=374 segment-costs=[6602771919, 1636865] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))]
|
||||
21:TUPLE CACHE
|
||||
| cache key: 8e04f02e59f13b9e5b2b0b87fdfe5853
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 22.87MB
|
||||
| estimated serialized size per node: 2.29MB
|
||||
| cumulative processing cost: 6603762769
|
||||
| cache read processing cost: 15963
|
||||
| cache write processing cost: 64734
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, i_class
|
||||
| Class 1
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, NULL
|
||||
| Class 2
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=30.00MB mem-reservation=6.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=4258848317
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,3,2 row-size=88B cardinality=982.92M cost=430350147
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.18MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.18MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=42B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.18MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[140022]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=42B cardinality=360.00K cost=91721
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,3 row-size=46B cardinality=983.41M cost=631385758
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[862]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=372
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=372 cost=490
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[180]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 654589393dc19a5ad0edb5f3e768f50e
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 7.99KB
|
||||
| | estimated serialized size per node: 7.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 22
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=372 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| parquet dictionary predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=372 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=28B cardinality=1.77G cost=773340988
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d1.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d1.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 01bd56fbeac3c4a0d81c21852cf58ce0
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| parquet dictionary predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=1.77G(filtered from 8.64G) cost=508846709
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=713.27MB Threads=21
|
||||
Per-Host Resource Estimates: Memory=1.27GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.07MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[538] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END), CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END, CASE valid_tid(4,5,6) WHEN 4 THEN i_class WHEN 5 THEN NULL WHEN 6 THEN NULL END, CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) AS SMALLINT) + CAST(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) AS SMALLINT), rank()
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) DESC, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC, rank() ASC
|
||||
| limit: 100
|
||||
| mem-estimate=69.00KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=66B cardinality=100 cost=38
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END),CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=16.64MB mem-reservation=16.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[3503, 6626, 204] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) DESC, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC, rank() ASC
|
||||
| mem-estimate=6.45KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=10 row-size=66B cardinality=100 cost=5625
|
||||
| in pipelines: 11(GETNEXT), 09(OPEN)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END), CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17,16 row-size=70B cardinality=1.00K cost=1001
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:SORT
|
||||
| order by: aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) ASC NULLS LAST, CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END ASC NULLS LAST, aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_net_profit) WHEN 5 THEN sum(ss_net_profit) WHEN 6 THEN sum(ss_net_profit) END) / aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN sum(ss_ext_sales_price) WHEN 5 THEN sum(ss_ext_sales_price) WHEN 6 THEN sum(ss_ext_sales_price) END) ASC
|
||||
| mem-estimate=12.00MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=17 row-size=62B cardinality=1.00K cost=3107
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
17:EXCHANGE [HASH(aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 0 WHEN 6 THEN 1 END) + aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END),CASE WHEN aggif(valid_tid(4,5,6) IN (4, 5, 6), CASE valid_tid(4,5,6) WHEN 4 THEN 0 WHEN 5 THEN 1 WHEN 6 THEN 1 END) = 0 THEN CASE valid_tid(4,5,6) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN NULL END END)]
|
||||
| mem-estimate=651.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=396
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=55.54MB mem-reservation=7.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[303840, 6118, 4512] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_net_profit) WHEN CAST(5 AS INT) THEN sum(ss_net_profit) WHEN CAST(6 AS INT) THEN sum(ss_net_profit) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(5 AS INT) THEN sum(ss_ext_sales_price) WHEN CAST(6 AS INT) THEN sum(ss_ext_sales_price) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END), aggif(valid_tid(4,5,6) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT)), CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(0 AS TINYINT) WHEN CAST(5 AS INT) THEN CAST(1 AS TINYINT) WHEN CAST(6 AS INT) THEN CAST(1 AS TINYINT) END)
|
||||
| group by: CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL END, CASE valid_tid(4,5,6) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) END
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=7 row-size=62B cardinality=1.00K cost=6118
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: i_category, i_class
|
||||
| Class 1
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: i_category, NULL
|
||||
| Class 2
|
||||
| output: sum:merge(ss_net_profit), sum:merge(ss_ext_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=30.00MB mem-reservation=5.81MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=1.00K cost=177997
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=25.54MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=125843
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=57.80MB mem-reservation=18.00MB thread-reservation=1
|
||||
max-parallelism=374 segment-costs=[6602771919, 1636865] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))]
|
||||
21:TUPLE CACHE
|
||||
| cache key: 8e04f02e59f13b9e5b2b0b87fdfe5853
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 22.87MB
|
||||
| estimated serialized size per node: 2.29MB
|
||||
| cumulative processing cost: 6603762769
|
||||
| cache read processing cost: 15963
|
||||
| cache write processing cost: 64734
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, i_class
|
||||
| Class 1
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: i_category, NULL
|
||||
| Class 2
|
||||
| output: sum(ss_net_profit), sum(ss_ext_sales_price)
|
||||
| group by: NULL, NULL
|
||||
| mem-estimate=30.00MB mem-reservation=6.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N row-size=188B cardinality=120.12K cost=4258848317
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1,3,2 row-size=88B cardinality=982.92M cost=430350147
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.18MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF000[bloom] <- i_item_sk, RF001[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.18MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=42B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.18MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[140022]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=42B cardinality=360.00K cost=91721
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,3 row-size=46B cardinality=983.41M cost=631385758
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[862]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=372
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=372 cost=490
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[180]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 654589393dc19a5ad0edb5f3e768f50e
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 7.99KB
|
||||
| | estimated serialized size per node: 7.99KB
|
||||
| | cumulative processing cost: 154
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 22
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=18B cardinality=372 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| parquet dictionary predicates: s_state IN ('OH', 'WV', 'PA', 'TN', 'MN', 'MO', 'NM', 'MI')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=18B cardinality=372 cost=154
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=28B cardinality=1.77G cost=773340988
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d1.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d1.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=490
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10483]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 01bd56fbeac3c4a0d81c21852cf58ce0
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 4.37KB
|
||||
| | estimated serialized size per node: 4.37KB
|
||||
| | cumulative processing cost: 10467
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 12
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=373 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| parquet dictionary predicates: d1.d_year = CAST(1998 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=373 cost=10467
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_item_sk, RF003[min_max] -> ss_store_sk, RF000[bloom] -> ss_item_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=1.77G(filtered from 8.64G) cost=508846709
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
649
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q37.test
vendored
Normal file
649
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q37.test
vendored
Normal file
@@ -0,0 +1,649 @@
|
||||
# TPCDS-Q37
|
||||
# start query 37 in stream 0 using template query37.tpl using seed 2087949890
|
||||
select i_item_id
|
||||
,i_item_desc
|
||||
,i_current_price
|
||||
from item, inventory, date_dim, catalog_sales
|
||||
where i_current_price between 35 and 35 + 30
|
||||
and inv_item_sk = i_item_sk
|
||||
and d_date_sk=inv_date_sk
|
||||
and d_date between cast('2001-01-20' as date) and (cast('2001-01-20' as date) + interval 60 days)
|
||||
and i_manufact_id in (928,715,942,861)
|
||||
and inv_quantity_on_hand between 100 and 500
|
||||
and cs_item_sk = i_item_sk
|
||||
group by i_item_id,i_item_desc,i_current_price
|
||||
order by i_item_id
|
||||
limit 100;
|
||||
|
||||
# end query 37 in stream 0 using template query37.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=77.19MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=15.47GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=15.47GB mem-reservation=77.19MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[1835847060, 3746309, 300]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=14.12KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=145B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 5242cb0745236a20aa5f86d556db0b80
|
||||
| input scan node ids: 1,3,0,2
|
||||
| estimated serialized size: 51.02MB
|
||||
| estimated serialized size per node: 5.10MB
|
||||
| cumulative processing cost: 1835847060
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 144438
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=360.00K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| group by: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=14.34GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=360.00K cost=528035064
|
||||
| in pipelines: 07(GETNEXT), 01(OPEN)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,3,0,2 row-size=177B cardinality=383.09M cost=489851741
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: eef469f1e73bb52529a3769939213d5a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| parquet dictionary predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,3,0 row-size=169B cardinality=1.64G cost=329229583
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 59fd7406bb82183b074d0c0474ddf871
|
||||
| | input scan node ids: 3,0
|
||||
| | estimated serialized size: 896.21MB
|
||||
| | estimated serialized size per node: 89.62MB
|
||||
| | cumulative processing cost: 252032912
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 2537297
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=2499414
|
||||
| | in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--10:TUPLE CACHE
|
||||
| | | cache key: cd866dedfb0d266dd26c2a5f665fcf99
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 72.79KB
|
||||
| | | estimated serialized size per node: 18.20KB
|
||||
| | | cumulative processing cost: 697007
|
||||
| | | cache read processing cost: 63
|
||||
| | | cache write processing cost: 201
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0 row-size=153B cardinality=476 cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | parquet statistics predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | parquet dictionary predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=153B cardinality=476 cost=697007
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 09:TUPLE CACHE
|
||||
| | cache key: 285d8aa896323fa53f7206aef9cd36a1
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 43.56MB
|
||||
| | estimated serialized size per node: 4.36MB
|
||||
| | cumulative processing cost: 248836491
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 123319
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> cs_item_sk, RF004[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=248836491
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
deterministic scan range assignment: true
|
||||
predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
parquet statistics predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
parquet dictionary predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=103.36M cost=236685240
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=744.50MB Threads=38
|
||||
Per-Host Resource Estimates: Memory=5.91GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.14MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[354] cpu-comparison-result=171 [max(1 (self) vs 171 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
15:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=146.53KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=145B cardinality=100 cost=54
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=572.68MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[94512813, 3746309, 410] cpu-comparison-result=171 [max(10 (self) vs 171 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=14.12KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=145B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 14(OPEN)
|
||||
|
|
||||
14:AGGREGATE [FINALIZE]
|
||||
| group by: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=545.27MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=360.00K cost=60983135
|
||||
| in pipelines: 14(GETNEXT), 01(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_item_id,i_item_desc,i_current_price)]
|
||||
| mem-estimate=27.41MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=43.19M cost=33529678
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=374.01MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1552568949, 424485102] cpu-comparison-result=171 [max(160 (self) vs 171 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| group by: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=357.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=43.19M cost=722008833
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,3,0,2 row-size=177B cardinality=383.09M cost=489851680
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: eef469f1e73bb52529a3769939213d5a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| parquet dictionary predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=1,3,0 row-size=169B cardinality=1.64G cost=323520334
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=34.43MB mem-reservation=18.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=160 segment-costs=[10666348] cpu-comparison-result=160 [max(160 (self) vs 14 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=5709249
|
||||
| |
|
||||
| 11:EXCHANGE [HASH(i_item_sk)]
|
||||
| | mem-estimate=16.43MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=4957099
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=101.16MB mem-reservation=9.00MB thread-reservation=1
|
||||
| max-parallelism=40 segment-costs=[314796066]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: cf8857488ba434ddb20ae3042d35ee8f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 896.21MB
|
||||
| | estimated serialized size per node: 89.62MB
|
||||
| | cumulative processing cost: 252033748
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 2537297
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=2498938
|
||||
| | in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=9.10MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[1106]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=476
|
||||
| | |
|
||||
| | 09:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=362.12KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=0 row-size=153B cardinality=476 cost=630
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=20.61MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[697213]
|
||||
| | 17:TUPLE CACHE
|
||||
| | | cache key: cd866dedfb0d266dd26c2a5f665fcf99
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 72.79KB
|
||||
| | | estimated serialized size per node: 18.20KB
|
||||
| | | cumulative processing cost: 697007
|
||||
| | | cache read processing cost: 63
|
||||
| | | cache write processing cost: 201
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0 row-size=153B cardinality=476 cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | parquet statistics predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | parquet dictionary predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=153B cardinality=476 cost=697007
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: b4315fbb94bbd3f132294c3eb6ae7f12
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 43.56MB
|
||||
| | estimated serialized size per node: 4.36MB
|
||||
| | cumulative processing cost: 248836491
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 123319
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> cs_item_sk, RF004[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=248836491
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
10:EXCHANGE [HASH(inv_item_sk)]
|
||||
| mem-estimate=10.62MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=103.36M cost=17188102
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=23.50MB mem-reservation=256.00KB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[369807768]
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
parquet statistics predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
parquet dictionary predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=103.36M cost=236685240
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=744.50MB Threads=38
|
||||
Per-Host Resource Estimates: Memory=5.91GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.14MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[354] cpu-comparison-result=171 [max(1 (self) vs 171 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
15:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=146.53KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=145B cardinality=100 cost=54
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,i_current_price)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=572.68MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[94512813, 3746309, 410] cpu-comparison-result=171 [max(10 (self) vs 171 (sum children))]
|
||||
08:TOP-N [LIMIT=100]
|
||||
| order by: i_item_id ASC
|
||||
| mem-estimate=14.12KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=145B cardinality=100 cost=3746309
|
||||
| in pipelines: 08(GETNEXT), 14(OPEN)
|
||||
|
|
||||
14:AGGREGATE [FINALIZE]
|
||||
| group by: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=545.27MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=360.00K cost=60983135
|
||||
| in pipelines: 14(GETNEXT), 01(OPEN)
|
||||
|
|
||||
13:EXCHANGE [HASH(i_item_id,i_item_desc,i_current_price)]
|
||||
| mem-estimate=27.41MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=43.19M cost=33529678
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=374.01MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1552568949, 424485102] cpu-comparison-result=171 [max(160 (self) vs 171 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| group by: i_item_id, i_item_desc, i_current_price
|
||||
| mem-estimate=357.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=145B cardinality=43.19M cost=722008833
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: inv_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: inv_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,3,0,2 row-size=177B cardinality=383.09M cost=489851680
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: eef469f1e73bb52529a3769939213d5a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| parquet dictionary predicates: d_date <= DATE '2001-03-21', d_date >= DATE '2001-01-20'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: inv_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=1,3,0 row-size=169B cardinality=1.64G cost=323520334
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(inv_item_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=34.43MB mem-reservation=18.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=160 segment-costs=[10666348] cpu-comparison-result=160 [max(160 (self) vs 14 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=5709249
|
||||
| |
|
||||
| 11:EXCHANGE [HASH(i_item_sk)]
|
||||
| | mem-estimate=16.43MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=4957099
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=101.16MB mem-reservation=9.00MB thread-reservation=1
|
||||
| max-parallelism=40 segment-costs=[314796066]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: cf8857488ba434ddb20ae3042d35ee8f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 896.21MB
|
||||
| | estimated serialized size per node: 89.62MB
|
||||
| | cumulative processing cost: 252033748
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 2537297
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,0 row-size=157B cardinality=5.71M cost=2498938
|
||||
| | in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=9.10MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[1106]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=476
|
||||
| | |
|
||||
| | 09:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=362.12KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=0 row-size=153B cardinality=476 cost=630
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=20.61MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[697213]
|
||||
| | 17:TUPLE CACHE
|
||||
| | | cache key: cd866dedfb0d266dd26c2a5f665fcf99
|
||||
| | | input scan node ids: 0
|
||||
| | | estimated serialized size: 72.79KB
|
||||
| | | estimated serialized size per node: 18.20KB
|
||||
| | | cumulative processing cost: 697007
|
||||
| | | cache read processing cost: 63
|
||||
| | | cache write processing cost: 201
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=0 row-size=153B cardinality=476 cost=0
|
||||
| | | in pipelines: 00(GETNEXT)
|
||||
| | |
|
||||
| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | parquet statistics predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | parquet dictionary predicates: i_current_price <= CAST(65 AS DECIMAL(5,0)), i_current_price >= CAST(35 AS DECIMAL(3,0)), i_manufact_id IN (CAST(928 AS INT), CAST(715 AS INT), CAST(942 AS INT), CAST(861 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=153B cardinality=476 cost=697007
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 16:TUPLE CACHE
|
||||
| | cache key: b4315fbb94bbd3f132294c3eb6ae7f12
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 43.56MB
|
||||
| | estimated serialized size per node: 4.36MB
|
||||
| | cumulative processing cost: 248836491
|
||||
| | cache read processing cost: 758759
|
||||
| | cache write processing cost: 123319
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> cs_item_sk, RF004[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=5.71M(filtered from 4.32G) cost=248836491
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
10:EXCHANGE [HASH(inv_item_sk)]
|
||||
| mem-estimate=10.62MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=103.36M cost=17188102
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=23.50MB mem-reservation=256.00KB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[369807768]
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.inventory, RANDOM]
|
||||
HDFS partitions=261/261 files=261 size=5.10GB
|
||||
predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
runtime filters: RF003[min_max] -> inv_item_sk, RF000[bloom] -> inv_date_sk, RF002[bloom] -> inv_item_sk
|
||||
stored statistics:
|
||||
table: rows=1.03G size=5.10GB
|
||||
partitions: 261/261 rows=1.03G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.98M
|
||||
parquet statistics predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
parquet dictionary predicates: inv_quantity_on_hand <= CAST(500 AS INT), inv_quantity_on_hand >= CAST(100 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=103.36M cost=236685240
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
1127
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q38.test
vendored
Normal file
1127
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q38.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1035
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q39a.test
vendored
Normal file
1035
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q39a.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1037
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q39b.test
vendored
Normal file
1037
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q39b.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
668
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q40.test
vendored
Normal file
668
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q40.test
vendored
Normal file
@@ -0,0 +1,668 @@
|
||||
# TPCDS-Q40
|
||||
# start query 40 in stream 0 using template query40.tpl using seed 1611348482
|
||||
select
|
||||
w_state
|
||||
,i_item_id
|
||||
,sum(case when d_date < cast ('1999-02-02' as date)
|
||||
then cs_sales_price - coalesce(cr_refunded_cash,0) else 0 end) as sales_before
|
||||
,sum(case when d_date >= cast ('1999-02-02' as date)
|
||||
then cs_sales_price - coalesce(cr_refunded_cash,0) else 0 end) as sales_after
|
||||
from
|
||||
catalog_sales left outer join catalog_returns on
|
||||
(cs_order_number = cr_order_number
|
||||
and cs_item_sk = cr_item_sk)
|
||||
,warehouse
|
||||
,item
|
||||
,date_dim
|
||||
where
|
||||
i_current_price between 0.99 and 1.49
|
||||
and i_item_sk = cs_item_sk
|
||||
and cs_warehouse_sk = w_warehouse_sk
|
||||
and cs_sold_date_sk = d_date_sk
|
||||
and d_date between (cast ('1999-02-02' as date) - interval 30 days)
|
||||
and (cast ('1999-02-02' as date) + interval 30 days)
|
||||
group by
|
||||
w_state,i_item_id
|
||||
order by w_state,i_item_id
|
||||
limit 100;
|
||||
|
||||
# end query 40 in stream 0 using template query40.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=82.75MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=18.66GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=18.66GB mem-reservation=82.75MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[1541715036, 28837420, 400]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_state, i_item_id, sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: w_state ASC, i_item_id ASC
|
||||
| mem-estimate=7.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=74B cardinality=100 cost=28837420
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 77ca5df52de1bbd7e8c7c03c7cdbb0a5
|
||||
| input scan node ids: 0,1,4,3,2
|
||||
| estimated serialized size: 179.45MB
|
||||
| estimated serialized size per node: 17.95MB
|
||||
| cumulative processing cost: 1541715036
|
||||
| cache read processing cost: 320611
|
||||
| cache write processing cost: 508056
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=2.41M cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END)
|
||||
| group by: w_state, i_item_id
|
||||
| mem-estimate=197.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=2.41M cost=31698329
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: cs_warehouse_sk = w_warehouse_sk
|
||||
| runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3,2 row-size=102B cardinality=14.39M cost=6296425
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=18B cardinality=22 cost=1
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3 row-size=84B cardinality=14.39M cost=39559092
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4 row-size=48B cardinality=143.92M cost=62995575
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 783b8b7baaf3fc61ca5c0300af32ff68
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [LEFT OUTER JOIN]
|
||||
| hash predicates: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| fk/pk conjuncts: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| mem-estimate=18.44GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1N row-size=40B cardinality=143.92M(filtered from 4.32G) cost=1251731614
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns]
|
||||
| HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=432.02M size=32.77GB
|
||||
| partitions: 2060/2060 rows=432.02M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=432.02M cost=99536714
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> cs_warehouse_sk, RF003[min_max] -> cs_item_sk, RF000[bloom] -> cs_warehouse_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=62(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=143.92M(filtered from 4.32G) cost=49740118
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=133.52MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=2.27GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[440] cpu-comparison-result=126 [max(1 (self) vs 126 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_state, i_item_id, sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: w_state ASC, i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=76.89KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=74B cardinality=100 cost=40
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(w_state,i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=44.76MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[37527052, 28837420, 225] cpu-comparison-result=126 [max(10 (self) vs 126 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: w_state ASC, i_item_id ASC
|
||||
| mem-estimate=7.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=74B cardinality=100 cost=28837420
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END), sum:merge(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END)
|
||||
| group by: w_state, i_item_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=2.41M cost=31190810
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(w_state,i_item_id)]
|
||||
| mem-estimate=10.76MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=14.03M cost=6336242
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=102.63MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=110 segment-costs=[1044734340, 74109479] cpu-comparison-result=126 [max(50 (self) vs 126 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END)
|
||||
| group by: w_state, i_item_id
|
||||
| mem-estimate=88.49MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=14.03M cost=84325553
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: cs_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3,2 row-size=102B cardinality=14.39M cost=6296403
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=18B cardinality=22 cost=20
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[2]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=18B cardinality=22 cost=1
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3 row-size=84B cardinality=14.39M cost=39523092
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.27MB mem-reservation=3.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[83840]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 cost=36000
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.39MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=36B cardinality=36.00K cost=47840
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.16MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[148924]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4 row-size=48B cardinality=143.92M cost=62995514
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 783b8b7baaf3fc61ca5c0300af32ff68
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [LEFT OUTER JOIN, PARTITIONED]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| fk/pk conjuncts: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1N row-size=40B cardinality=143.92M(filtered from 4.32G) cost=819714623
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=1.86GB mem-reservation=34.00MB thread-reservation=1
|
||||
| | max-parallelism=110 segment-costs=[511810529]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cr_item_sk, cr_order_number
|
||||
| | mem-estimate=1.84GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=432016991
|
||||
| |
|
||||
| 12:EXCHANGE [HASH(cr_item_sk,cr_order_number)]
|
||||
| | mem-estimate=11.56MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=16B cardinality=432.02M cost=79793538
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=80 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.78MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=80 segment-costs=[767262175]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM]
|
||||
| HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=432.02M size=32.77GB
|
||||
| partitions: 2060/2060 rows=432.02M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=432.02M cost=99536714
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
11:EXCHANGE [HASH(cs_item_sk,cs_order_number)]
|
||||
| mem-estimate=11.09MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=143.92M(filtered from 4.32G) cost=31879155
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=17.09MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[346338600]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_warehouse_sk, RF003[min_max] -> cs_item_sk, RF000[bloom] -> cs_warehouse_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=62(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=143.92M(filtered from 4.32G) cost=49740118
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=133.52MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=2.27GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[440] cpu-comparison-result=126 [max(1 (self) vs 126 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: w_state, i_item_id, sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: w_state ASC, i_item_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=76.89KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=74B cardinality=100 cost=40
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(w_state,i_item_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=44.76MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[37527052, 28837420, 225] cpu-comparison-result=126 [max(10 (self) vs 126 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: w_state ASC, i_item_id ASC
|
||||
| mem-estimate=7.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=74B cardinality=100 cost=28837420
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END), sum:merge(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END)
|
||||
| group by: w_state, i_item_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=2.41M cost=31190810
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(w_state,i_item_id)]
|
||||
| mem-estimate=10.76MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=14.03M cost=6336242
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=102.63MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=110 segment-costs=[1044734340, 74109479] cpu-comparison-result=126 [max(50 (self) vs 126 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN d_date < DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END), sum(CASE WHEN d_date >= DATE '1999-02-02' THEN cs_sales_price - coalesce(cr_refunded_cash, CAST(0 AS DECIMAL(7,2))) ELSE CAST(0 AS DECIMAL(8,2)) END)
|
||||
| group by: w_state, i_item_id
|
||||
| mem-estimate=88.49MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=74B cardinality=14.03M cost=84325553
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: cs_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: cs_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3,2 row-size=102B cardinality=14.39M cost=6296403
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF000[bloom] <- w_warehouse_sk, RF001[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=18B cardinality=22 cost=20
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[2]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=18B cardinality=22 cost=1
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: cs_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4,3 row-size=84B cardinality=14.39M cost=39523092
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.27MB mem-reservation=3.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[83840]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 cost=36000
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.39MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=36B cardinality=36.00K cost=47840
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.16MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[148924]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: e16614d3b61fa01ae612c1645b02bfa1
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 1.37MB
|
||||
| | estimated serialized size per node: 351.56KB
|
||||
| | cumulative processing cost: 144648
|
||||
| | cache read processing cost: 4784
|
||||
| | cache write processing cost: 3888
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=36B cardinality=36.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| parquet dictionary predicates: i_current_price <= CAST(1.49 AS DECIMAL(3,2)), i_current_price >= CAST(0.99 AS DECIMAL(2,2))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=36B cardinality=36.00K cost=144648
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1N,4 row-size=48B cardinality=143.92M cost=62995514
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[141]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=61
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=61 cost=80
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12522]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 783b8b7baaf3fc61ca5c0300af32ff68
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 732B
|
||||
| | estimated serialized size per node: 732B
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 8
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=61 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| parquet dictionary predicates: d_date <= DATE '1999-03-04', d_date >= DATE '1999-01-03'
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=61 cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [LEFT OUTER JOIN, PARTITIONED]
|
||||
| hash-table-id=03
|
||||
| hash predicates: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| fk/pk conjuncts: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1N row-size=40B cardinality=143.92M(filtered from 4.32G) cost=819714623
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(cs_item_sk,cs_order_number)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=1.86GB mem-reservation=34.00MB thread-reservation=1
|
||||
| | max-parallelism=110 segment-costs=[511810529]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: cr_item_sk, cr_order_number
|
||||
| | mem-estimate=1.84GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=432016991
|
||||
| |
|
||||
| 12:EXCHANGE [HASH(cr_item_sk,cr_order_number)]
|
||||
| | mem-estimate=11.56MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=16B cardinality=432.02M cost=79793538
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=80 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.78MB mem-reservation=32.00KB thread-reservation=1
|
||||
| max-parallelism=80 segment-costs=[767262175]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns, RANDOM]
|
||||
| HDFS partitions=2060/2060 files=2060 size=32.77GB
|
||||
| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=432.02M size=32.77GB
|
||||
| partitions: 2060/2060 rows=432.02M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=416.82K
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=432.02M cost=99536714
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
11:EXCHANGE [HASH(cs_item_sk,cs_order_number)]
|
||||
| mem-estimate=11.09MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=143.92M(filtered from 4.32G) cost=31879155
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=17.09MB mem-reservation=1.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[346338600]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
runtime filters: RF001[min_max] -> cs_warehouse_sk, RF003[min_max] -> cs_item_sk, RF000[bloom] -> cs_warehouse_sk, RF002[bloom] -> cs_item_sk, RF004[bloom] -> cs_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=4.32G size=280.96GB
|
||||
partitions: 1831/1831 rows=4.32G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=62(filtered from 1831)
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=143.92M(filtered from 4.32G) cost=49740118
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
487
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q41.test
vendored
Normal file
487
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q41.test
vendored
Normal file
@@ -0,0 +1,487 @@
|
||||
# TPCDS-Q41
|
||||
# start query 41 in stream 0 using template query41.tpl using seed 1813495740
|
||||
select distinct(i_product_name)
|
||||
from item i1
|
||||
where i_manufact_id between 732 and 732+40
|
||||
and (select count(*) as item_cnt
|
||||
from item
|
||||
where (i_manufact = i1.i_manufact and
|
||||
((i_category = 'Women' and
|
||||
(i_color = 'beige' or i_color = 'spring') and
|
||||
(i_units = 'Tsp' or i_units = 'Ton') and
|
||||
(i_size = 'petite' or i_size = 'extra large')
|
||||
) or
|
||||
(i_category = 'Women' and
|
||||
(i_color = 'white' or i_color = 'pale') and
|
||||
(i_units = 'Box' or i_units = 'Dram') and
|
||||
(i_size = 'large' or i_size = 'economy')
|
||||
) or
|
||||
(i_category = 'Men' and
|
||||
(i_color = 'midnight' or i_color = 'frosted') and
|
||||
(i_units = 'Bunch' or i_units = 'Carton') and
|
||||
(i_size = 'small' or i_size = 'N/A')
|
||||
) or
|
||||
(i_category = 'Men' and
|
||||
(i_color = 'azure' or i_color = 'goldenrod') and
|
||||
(i_units = 'Pallet' or i_units = 'Gross') and
|
||||
(i_size = 'petite' or i_size = 'extra large')
|
||||
))) or
|
||||
(i_manufact = i1.i_manufact and
|
||||
((i_category = 'Women' and
|
||||
(i_color = 'brown' or i_color = 'hot') and
|
||||
(i_units = 'Tbl' or i_units = 'Cup') and
|
||||
(i_size = 'petite' or i_size = 'extra large')
|
||||
) or
|
||||
(i_category = 'Women' and
|
||||
(i_color = 'powder' or i_color = 'honeydew') and
|
||||
(i_units = 'Bundle' or i_units = 'Unknown') and
|
||||
(i_size = 'large' or i_size = 'economy')
|
||||
) or
|
||||
(i_category = 'Men' and
|
||||
(i_color = 'antique' or i_color = 'purple') and
|
||||
(i_units = 'N/A' or i_units = 'Dozen') and
|
||||
(i_size = 'small' or i_size = 'N/A')
|
||||
) or
|
||||
(i_category = 'Men' and
|
||||
(i_color = 'lavender' or i_color = 'tomato') and
|
||||
(i_units = 'Lb' or i_units = 'Oz') and
|
||||
(i_size = 'petite' or i_size = 'extra large')
|
||||
)))) > 0
|
||||
order by i_product_name
|
||||
limit 100;
|
||||
|
||||
# end query 41 in stream 0 using template query41.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=22.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=62MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=62.00MB mem-reservation=22.94MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[171856, 338134, 307206, 100]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: (i_product_name)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
05:TOP-N [LIMIT=100]
|
||||
| order by: (i_product_name) ASC
|
||||
| mem-estimate=3.40KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=35B cardinality=100 cost=307206
|
||||
| in pipelines: 05(GETNEXT), 04(OPEN)
|
||||
|
|
||||
10:TUPLE CACHE
|
||||
| cache key: 445e41f666748302a8ad177c4eaf171e
|
||||
| input scan node ids: 0,1
|
||||
| estimated serialized size: 1.33MB
|
||||
| estimated serialized size per node: 341.47KB
|
||||
| cumulative processing cost: 509990
|
||||
| cache read processing cost: 4784
|
||||
| cache write processing cost: 3776
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=0
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
04:AGGREGATE [FINALIZE]
|
||||
| group by: (i_product_name)
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=104389
|
||||
| in pipelines: 04(GETNEXT), 00(OPEN)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: 781203ab0f96883279a5f9452d5bbd10
|
||||
| input scan node ids: 0,1
|
||||
| estimated serialized size: 3.48MB
|
||||
| estimated serialized size per node: 891.53KB
|
||||
| cumulative processing cost: 405601
|
||||
| cache read processing cost: 4784
|
||||
| cache write processing cost: 9859
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2N row-size=93B cardinality=36.00K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [LEFT OUTER JOIN]
|
||||
| hash predicates: i1.i_manufact = i_manufact
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2N row-size=93B cardinality=36.00K cost=15775
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: 1879fbd1a29c01b4c8eabd644dd0de73
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 635B
|
||||
| | estimated serialized size per node: 158B
|
||||
| | cumulative processing cost: 171856
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 1
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:AGGREGATE [FINALIZE]
|
||||
| | output: count(*)
|
||||
| | group by: i_manufact
|
||||
| | having: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=516
|
||||
| | in pipelines: 02(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| 07:TUPLE CACHE
|
||||
| | cache key: 2dab0bb0b6ca0e5543f138e89eb0777d
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 16.53KB
|
||||
| | estimated serialized size per node: 4.13KB
|
||||
| | cumulative processing cost: 171340
|
||||
| | cache read processing cost: 23
|
||||
| | cache write processing cost: 45
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=91B cardinality=178 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category = 'Women' AND ((i_color IN ('beige', 'spring') AND i_units IN ('Tsp', 'Ton') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('white', 'pale') AND i_units IN ('Box', 'Dram') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('midnight', 'frosted') AND i_units IN ('Bunch', 'Carton') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('azure', 'goldenrod') AND i_units IN ('Pallet', 'Gross') AND i_size IN ('petite', 'extra large'))) OR (i_category = 'Women' AND ((i_color IN ('brown', 'hot') AND i_units IN ('Tbl', 'Cup') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('powder', 'honeydew') AND i_units IN ('Bundle', 'Unknown') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('antique', 'purple') AND i_units IN ('N/A', 'Dozen') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('lavender', 'tomato') AND i_units IN ('Lb', 'Oz') AND i_size IN ('petite', 'extra large'))))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=91B cardinality=178 cost=171340
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:TUPLE CACHE
|
||||
| cache key: bf508e3c04cd25f0ae90aa32d4d9ed06
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 2.27MB
|
||||
| estimated serialized size per node: 581.34KB
|
||||
| cumulative processing cost: 217970
|
||||
| cache read processing cost: 4784
|
||||
| cache write processing cost: 6429
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=62B cardinality=36.00K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.item i1]
|
||||
HDFS partitions=1/1 files=1 size=33.54MB
|
||||
deterministic scan range assignment: true
|
||||
predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
stored statistics:
|
||||
table: rows=360.00K size=33.54MB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
parquet statistics predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
parquet dictionary predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=62B cardinality=36.00K cost=217970
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=26.81MB Threads=6
|
||||
Per-Host Resource Estimates: Memory=92MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[132] cpu-comparison-result=4 [max(1 (self) vs 4 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: (i_product_name)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: (i_product_name) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.03KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=35B cardinality=100 cost=32
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH((i_product_name))] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=10.45MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[114160, 307206, 122] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
05:TOP-N [LIMIT=100]
|
||||
| order by: (i_product_name) ASC
|
||||
| mem-estimate=3.40KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=35B cardinality=100 cost=307206
|
||||
| in pipelines: 05(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| group by: (i_product_name)
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=104389
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH((i_product_name))]
|
||||
| mem-estimate=461.72KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=9771
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=30.61MB mem-reservation=6.50MB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[338116, 99346] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
04:AGGREGATE [STREAMING]
|
||||
| group by: (i_product_name)
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=104389
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i1.i_manufact = i_manufact
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2N row-size=93B cardinality=36.00K cost=15757
|
||||
| in pipelines: 00(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[26] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_manufact
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=18
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=8
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [HASH(i_manufact)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.14MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[561, 1] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 07:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: i_manufact
|
||||
| | having: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=516
|
||||
| | in pipelines: 07(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| 06:EXCHANGE [HASH(i_manufact)]
|
||||
| | mem-estimate=25.90KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=45
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=34.55MB mem-reservation=10.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[171856, 450]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: 0425085c43651a1fed2212a454bd4203
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 6.13KB
|
||||
| | estimated serialized size per node: 1.53KB
|
||||
| | cumulative processing cost: 171856
|
||||
| | cache read processing cost: 23
|
||||
| | cache write processing cost: 16
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 02:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: i_manufact
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=516
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 2dab0bb0b6ca0e5543f138e89eb0777d
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 16.53KB
|
||||
| | estimated serialized size per node: 4.13KB
|
||||
| | cumulative processing cost: 171340
|
||||
| | cache read processing cost: 23
|
||||
| | cache write processing cost: 45
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=91B cardinality=178 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category = 'Women' AND ((i_color IN ('beige', 'spring') AND i_units IN ('Tsp', 'Ton') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('white', 'pale') AND i_units IN ('Box', 'Dram') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('midnight', 'frosted') AND i_units IN ('Bunch', 'Carton') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('azure', 'goldenrod') AND i_units IN ('Pallet', 'Gross') AND i_size IN ('petite', 'extra large'))) OR (i_category = 'Women' AND ((i_color IN ('brown', 'hot') AND i_units IN ('Tbl', 'Cup') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('powder', 'honeydew') AND i_units IN ('Bundle', 'Unknown') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('antique', 'purple') AND i_units IN ('N/A', 'Dozen') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('lavender', 'tomato') AND i_units IN ('Lb', 'Oz') AND i_size IN ('petite', 'extra large'))))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=91B cardinality=178 cost=171340
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: bf508e3c04cd25f0ae90aa32d4d9ed06
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 2.27MB
|
||||
| estimated serialized size per node: 581.34KB
|
||||
| cumulative processing cost: 217970
|
||||
| cache read processing cost: 4784
|
||||
| cache write processing cost: 6429
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=62B cardinality=36.00K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.item i1, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=33.54MB
|
||||
deterministic scan range assignment: true
|
||||
predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
stored statistics:
|
||||
table: rows=360.00K size=33.54MB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
parquet statistics predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
parquet dictionary predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=62B cardinality=36.00K cost=217970
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=26.81MB Threads=6
|
||||
Per-Host Resource Estimates: Memory=92MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[132] cpu-comparison-result=4 [max(1 (self) vs 4 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: (i_product_name)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: (i_product_name) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=16.03KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=35B cardinality=100 cost=32
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH((i_product_name))] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=10.45MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[114160, 307206, 122] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
05:TOP-N [LIMIT=100]
|
||||
| order by: (i_product_name) ASC
|
||||
| mem-estimate=3.40KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=35B cardinality=100 cost=307206
|
||||
| in pipelines: 05(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| group by: (i_product_name)
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=104389
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH((i_product_name))]
|
||||
| mem-estimate=461.72KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=9771
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
Per-Instance Resources: mem-estimate=30.61MB mem-reservation=6.50MB thread-reservation=1
|
||||
max-parallelism=4 segment-costs=[338116, 99346] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
04:AGGREGATE [STREAMING]
|
||||
| group by: (i_product_name)
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=35B cardinality=36.00K cost=104389
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i1.i_manufact = i_manufact
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2N row-size=93B cardinality=36.00K cost=15757
|
||||
| in pipelines: 00(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=1.95MB mem-reservation=1.94MB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[26] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_manufact
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=18
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=8
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [HASH(i_manufact)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.14MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[561, 1] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 07:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: i_manufact
|
||||
| | having: zeroifnull(count(*)) > CAST(0 AS BIGINT)
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=18 cost=516
|
||||
| | in pipelines: 07(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| 06:EXCHANGE [HASH(i_manufact)]
|
||||
| | mem-estimate=25.90KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=45
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=34.55MB mem-reservation=10.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[171856, 450]
|
||||
| 14:TUPLE CACHE
|
||||
| | cache key: 0425085c43651a1fed2212a454bd4203
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 6.13KB
|
||||
| | estimated serialized size per node: 1.53KB
|
||||
| | cumulative processing cost: 171856
|
||||
| | cache read processing cost: 23
|
||||
| | cache write processing cost: 16
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 02:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: i_manufact
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=31B cardinality=178 cost=516
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 2dab0bb0b6ca0e5543f138e89eb0777d
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 16.53KB
|
||||
| | estimated serialized size per node: 4.13KB
|
||||
| | cumulative processing cost: 171340
|
||||
| | cache read processing cost: 23
|
||||
| | cache write processing cost: 45
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=91B cardinality=178 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category = 'Women' AND ((i_color IN ('beige', 'spring') AND i_units IN ('Tsp', 'Ton') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('white', 'pale') AND i_units IN ('Box', 'Dram') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('midnight', 'frosted') AND i_units IN ('Bunch', 'Carton') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('azure', 'goldenrod') AND i_units IN ('Pallet', 'Gross') AND i_size IN ('petite', 'extra large'))) OR (i_category = 'Women' AND ((i_color IN ('brown', 'hot') AND i_units IN ('Tbl', 'Cup') AND i_size IN ('petite', 'extra large')) OR (i_color IN ('powder', 'honeydew') AND i_units IN ('Bundle', 'Unknown') AND i_size IN ('large', 'economy'))) OR (i_category = 'Men' AND i_color IN ('antique', 'purple') AND i_units IN ('N/A', 'Dozen') AND i_size IN ('small', 'N/A')) OR (i_category = 'Men' AND i_color IN ('lavender', 'tomato') AND i_units IN ('Lb', 'Oz') AND i_size IN ('petite', 'extra large'))))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=91B cardinality=178 cost=171340
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: bf508e3c04cd25f0ae90aa32d4d9ed06
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 2.27MB
|
||||
| estimated serialized size per node: 581.34KB
|
||||
| cumulative processing cost: 217970
|
||||
| cache read processing cost: 4784
|
||||
| cache write processing cost: 6429
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=62B cardinality=36.00K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.item i1, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=33.54MB
|
||||
deterministic scan range assignment: true
|
||||
predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
stored statistics:
|
||||
table: rows=360.00K size=33.54MB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
parquet statistics predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
parquet dictionary predicates: i_manufact_id <= CAST(772 AS INT), i_manufact_id >= CAST(732 AS INT)
|
||||
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=62B cardinality=36.00K cost=217970
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
597
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q42.test
vendored
Normal file
597
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q42.test
vendored
Normal file
@@ -0,0 +1,597 @@
|
||||
# TPCDS-Q42
|
||||
# start query 42 in stream 0 using template query42.tpl using seed 959183214
|
||||
select dt.d_year
|
||||
,item.i_category_id
|
||||
,item.i_category
|
||||
,sum(ss_ext_sales_price)
|
||||
from date_dim dt
|
||||
,store_sales
|
||||
,item
|
||||
where dt.d_date_sk = store_sales.ss_sold_date_sk
|
||||
and store_sales.ss_item_sk = item.i_item_sk
|
||||
and item.i_manager_id = 1
|
||||
and dt.d_moy=11
|
||||
and dt.d_year=2002
|
||||
group by dt.d_year
|
||||
,item.i_category_id
|
||||
,item.i_category
|
||||
order by sum(ss_ext_sales_price) desc,dt.d_year
|
||||
,item.i_category_id
|
||||
,item.i_category
|
||||
limit 100 ;
|
||||
|
||||
# end query 42 in stream 0 using template query42.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=38.88MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=78MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=77.88MB mem-reservation=38.88MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[114944063, 374, 400]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_category_id, item.i_category, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, dt.d_year ASC, item.i_category_id ASC, item.i_category ASC
|
||||
| mem-estimate=4.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=42B cardinality=100 cost=374
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: c50a9a9f7d067eb625c6ebc77f049a66
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 4.48KB
|
||||
| estimated serialized size per node: 459B
|
||||
| cumulative processing cost: 114944063
|
||||
| cache read processing cost: 13
|
||||
| cache write processing cost: 12
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=100 cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_category_id, item.i_category
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=100 cost=7079189
|
||||
| in pipelines: 05(GETNEXT), 01(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: 5275b605d8f9adba77c1b5fc398fdb26
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 323.78MB
|
||||
| estimated serialized size per node: 32.38MB
|
||||
| cumulative processing cost: 107864874
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 916685
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=2254938
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: 148c0a3b02d4a2c630261bda4c7efc21
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: febd5a55275e0434aa248e6d791795af
|
||||
| input scan node ids: 1,2
|
||||
| estimated serialized size: 245.18MB
|
||||
| estimated serialized size per node: 24.52MB
|
||||
| cumulative processing cost: 105593208
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 694138
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=17090094
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: 196dc20aaaee440039d2a47077683a85
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 120.09KB
|
||||
| | estimated serialized size per node: 30.02KB
|
||||
| | cumulative processing cost: 102935
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 332
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=30B cardinality=3.63K cost=102935
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:TUPLE CACHE
|
||||
| cache key: 8e747e9ff9ce00538ffd175c827dd1c6
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=80.69MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=155MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[433] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_category_id, item.i_category, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, dt.d_year ASC, item.i_category_id ASC, item.i_category ASC
|
||||
| limit: 100
|
||||
| mem-estimate=45.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=42B cardinality=100 cost=33
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_category_id,item.i_category)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=10.94MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[20588, 374, 141] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, dt.d_year ASC, item.i_category_id ASC, item.i_category ASC
|
||||
| mem-estimate=4.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=42B cardinality=100 cost=374
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_category_id, item.i_category
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=100 cost=16942
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_category_id,item.i_category)]
|
||||
| mem-estimate=967.21KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=3646
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=43.79MB mem-reservation=27.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[114874554, 38566] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
17:TUPLE CACHE
|
||||
| cache key: 2133584e23f0fe5a696ff7bf1043f5b6
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 537.95KB
|
||||
| estimated serialized size per node: 53.79KB
|
||||
| cumulative processing cost: 115003288
|
||||
| cache read processing cost: 1594
|
||||
| cache write processing cost: 1487
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_category_id, item.i_category
|
||||
| mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=7133078
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: a14f9a6d094ab222dd5103aabbf298e9
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 323.78MB
|
||||
| estimated serialized size per node: 32.38MB
|
||||
| cumulative processing cost: 107870210
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 916685
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 148c0a3b02d4a2c630261bda4c7efc21
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 5be43f2bcac0495763b971b833d7c4fc
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 245.18MB
|
||||
| estimated serialized size per node: 24.52MB
|
||||
| cumulative processing cost: 105598399
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 694138
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.11MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=241.54KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[103306]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 196dc20aaaee440039d2a47077683a85
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 120.09KB
|
||||
| | estimated serialized size per node: 30.02KB
|
||||
| | cumulative processing cost: 102935
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 332
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=30B cardinality=3.63K cost=102935
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 5bc478b155f62ad73bf96000df27339e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=80.69MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=155MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[433] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_category_id, item.i_category, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, dt.d_year ASC, item.i_category_id ASC, item.i_category ASC
|
||||
| limit: 100
|
||||
| mem-estimate=45.24KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=42B cardinality=100 cost=33
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_category_id,item.i_category)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=10.94MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[20588, 374, 141] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, dt.d_year ASC, item.i_category_id ASC, item.i_category ASC
|
||||
| mem-estimate=4.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=42B cardinality=100 cost=374
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_category_id, item.i_category
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=100 cost=16942
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_category_id,item.i_category)]
|
||||
| mem-estimate=967.21KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=3646
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=43.79MB mem-reservation=27.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[114874554, 38566] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
17:TUPLE CACHE
|
||||
| cache key: 2133584e23f0fe5a696ff7bf1043f5b6
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 537.95KB
|
||||
| estimated serialized size per node: 53.79KB
|
||||
| cumulative processing cost: 115003288
|
||||
| cache read processing cost: 1594
|
||||
| cache write processing cost: 1487
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_category_id, item.i_category
|
||||
| mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=42B cardinality=12.00K cost=7133078
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: a14f9a6d094ab222dd5103aabbf298e9
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 323.78MB
|
||||
| estimated serialized size per node: 32.38MB
|
||||
| cumulative processing cost: 107870210
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 916685
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=54B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 148c0a3b02d4a2c630261bda4c7efc21
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2002 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 5be43f2bcac0495763b971b833d7c4fc
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 245.18MB
|
||||
| estimated serialized size per node: 24.52MB
|
||||
| cumulative processing cost: 105598399
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 694138
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=42B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.11MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=241.54KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[103306]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 196dc20aaaee440039d2a47077683a85
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 120.09KB
|
||||
| | estimated serialized size per node: 30.02KB
|
||||
| | cumulative processing cost: 102935
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 332
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=30B cardinality=3.63K cost=102935
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 5bc478b155f62ad73bf96000df27339e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
486
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q43.test
vendored
Normal file
486
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q43.test
vendored
Normal file
@@ -0,0 +1,486 @@
|
||||
# TPCDS-Q43
|
||||
# start query 43 in stream 0 using template query43.tpl using seed 845278100
|
||||
select s_store_name, s_store_id,
|
||||
sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,
|
||||
sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,
|
||||
sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales,
|
||||
sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,
|
||||
sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,
|
||||
sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,
|
||||
sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales
|
||||
from date_dim, store_sales, store
|
||||
where d_date_sk = ss_sold_date_sk and
|
||||
s_store_sk = ss_store_sk and
|
||||
s_gmt_offset = -6 and
|
||||
d_year = 1999
|
||||
group by s_store_name, s_store_id
|
||||
order by s_store_name, s_store_id,sun_sales,mon_sales,tue_sales,wed_sales,thu_sales,fri_sales,sat_sales
|
||||
limit 100;
|
||||
|
||||
# end query 43 in stream 0 using template query43.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=26.41MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=66MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=65.88MB mem-reservation=26.41MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[3286411638, 7914, 900]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_store_id, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900
|
||||
|
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_store_id ASC, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) ASC
|
||||
| mem-estimate=15.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=156B cardinality=100 cost=7914
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: bc58333f8d20b5dc8da06ea825f57010
|
||||
| input scan node ids: 1,0,2
|
||||
| estimated serialized size: 210.86KB
|
||||
| estimated serialized size per node: 21.08KB
|
||||
| cumulative processing cost: 3286411638
|
||||
| cache read processing cost: 179
|
||||
| cache write processing cost: 582
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=1.35K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: s_store_name, s_store_id
|
||||
| mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=1.35K cost=1593602192
|
||||
| in pipelines: 05(GETNEXT), 01(OPEN)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=91B cardinality=888.24M cost=614141498
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: 3698a1cf052d6b13deceda607a37da38
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 18.35KB
|
||||
| | estimated serialized size per node: 18.35KB
|
||||
| | cumulative processing cost: 581
|
||||
| | cache read processing cost: 44
|
||||
| | cache write processing cost: 50
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=52B cardinality=336 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| parquet dictionary predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=52B cardinality=336 cost=581
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=39B cardinality=1.77G cost=773341361
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--07:TUPLE CACHE
|
||||
| | cache key: 36097366b8f6eb71c982c7d0976461a6
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 11.34KB
|
||||
| | estimated serialized size per node: 11.34KB
|
||||
| | cumulative processing cost: 17981
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 31
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=27B cardinality=373 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=27B cardinality=373 cost=17981
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=1.77G(filtered from 8.64G) cost=305308025
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=244.97MB Threads=18
|
||||
Per-Host Resource Estimates: Memory=561MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.15MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[956] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_store_id, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, s_store_id ASC, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=157.71KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=156B cardinality=100 cost=56
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(s_store_name,s_store_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=31.15MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[430960, 7914, 439] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_store_id ASC, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) ASC
|
||||
| mem-estimate=15.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=156B cardinality=100 cost=7914
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: s_store_name, s_store_id
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=1.35K cost=296757
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(s_store_name,s_store_id)]
|
||||
| mem-estimate=21.15MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=134203
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=36.25MB mem-reservation=15.00MB thread-reservation=1
|
||||
max-parallelism=330 segment-costs=[3287119871, 1710341] cpu-comparison-result=120 [max(120 (self) vs 22 (sum children))]
|
||||
14:TUPLE CACHE
|
||||
| cache key: 42dfa7b519cd3304d62c1f04735a6cb1
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 24.71MB
|
||||
| estimated serialized size per node: 2.47MB
|
||||
| cumulative processing cost: 3287140161
|
||||
| cache read processing cost: 21529
|
||||
| cache write processing cost: 69957
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: s_store_name, s_store_id
|
||||
| mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=1594329696
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=91B cardinality=888.24M cost=614141162
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[776]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=336
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=35.40KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=52B cardinality=336 cost=440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=4.03MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[635]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 3698a1cf052d6b13deceda607a37da38
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 18.35KB
|
||||
| | estimated serialized size per node: 18.35KB
|
||||
| | cumulative processing cost: 581
|
||||
| | cache read processing cost: 44
|
||||
| | cache write processing cost: 50
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=52B cardinality=336 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| parquet dictionary predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=52B cardinality=336 cost=581
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=39B cardinality=1.77G cost=773340988
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=21.23KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=27B cardinality=373 cost=490
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.12MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[18016]
|
||||
| 12:TUPLE CACHE
|
||||
| | cache key: 36097366b8f6eb71c982c7d0976461a6
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 11.34KB
|
||||
| | estimated serialized size per node: 11.34KB
|
||||
| | cumulative processing cost: 17981
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 31
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=27B cardinality=373 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=27B cardinality=373 cost=17981
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=1.77G(filtered from 8.64G) cost=305308025
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=244.97MB Threads=18
|
||||
Per-Host Resource Estimates: Memory=561MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.15MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[956] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_store_id, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=900
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, s_store_id ASC, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) ASC
|
||||
| limit: 100
|
||||
| mem-estimate=157.71KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=156B cardinality=100 cost=56
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(s_store_name,s_store_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=31.15MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[430960, 7914, 439] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_store_id ASC, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) ASC, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) ASC
|
||||
| mem-estimate=15.23KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=156B cardinality=100 cost=7914
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: s_store_name, s_store_id
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=1.35K cost=296757
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(s_store_name,s_store_id)]
|
||||
| mem-estimate=21.15MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=134203
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=36.25MB mem-reservation=15.00MB thread-reservation=1
|
||||
max-parallelism=330 segment-costs=[3287119871, 1710341] cpu-comparison-result=120 [max(120 (self) vs 22 (sum children))]
|
||||
14:TUPLE CACHE
|
||||
| cache key: 42dfa7b519cd3304d62c1f04735a6cb1
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 24.71MB
|
||||
| estimated serialized size per node: 2.47MB
|
||||
| cumulative processing cost: 3287140161
|
||||
| cache read processing cost: 21529
|
||||
| cache write processing cost: 69957
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: s_store_name, s_store_id
|
||||
| mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=156B cardinality=162.00K cost=1594329696
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=91B cardinality=888.24M cost=614141162
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.28MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[776]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=336
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=35.40KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=52B cardinality=336 cost=440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.22MB mem-reservation=4.03MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[635]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: 3698a1cf052d6b13deceda607a37da38
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 18.35KB
|
||||
| | estimated serialized size per node: 18.35KB
|
||||
| | cumulative processing cost: 581
|
||||
| | cache read processing cost: 44
|
||||
| | cache write processing cost: 50
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=52B cardinality=336 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| parquet dictionary predicates: s_gmt_offset = CAST(-6 AS DECIMAL(3,0))
|
||||
| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=52B cardinality=336 cost=581
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=39B cardinality=1.77G cost=773340988
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[863]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=21.23KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=27B cardinality=373 cost=490
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.12MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[18016]
|
||||
| 12:TUPLE CACHE
|
||||
| | cache key: 36097366b8f6eb71c982c7d0976461a6
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 11.34KB
|
||||
| | estimated serialized size per node: 11.34KB
|
||||
| | cumulative processing cost: 17981
|
||||
| | cache read processing cost: 49
|
||||
| | cache write processing cost: 31
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=27B cardinality=373 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=27B cardinality=373 cost=17981
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=1.77G(filtered from 8.64G) cost=305308025
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
1369
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q44.test
vendored
Normal file
1369
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q44.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
831
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q45.test
vendored
Normal file
831
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q45.test
vendored
Normal file
@@ -0,0 +1,831 @@
|
||||
# TPCDS-Q45
|
||||
# start query 45 in stream 0 using template query45.tpl using seed 390857734
|
||||
select ca_zip, ca_county, sum(ws_sales_price)
|
||||
from web_sales, customer, customer_address, date_dim, item
|
||||
where ws_bill_customer_sk = c_customer_sk
|
||||
and c_current_addr_sk = ca_address_sk
|
||||
and ws_item_sk = i_item_sk
|
||||
and ( substr(ca_zip,1,5) in ('85669', '86197','88274','83405','86475', '85392', '85460', '80348', '81792')
|
||||
or
|
||||
i_item_id in (select i_item_id
|
||||
from item
|
||||
where i_item_sk in (2, 3, 5, 7, 11, 13, 17, 19, 23, 29)
|
||||
)
|
||||
)
|
||||
and ws_sold_date_sk = d_date_sk
|
||||
and d_qoy = 2 and d_year = 1999
|
||||
group by ca_zip, ca_county
|
||||
order by ca_zip, ca_county
|
||||
limit 100;
|
||||
|
||||
# end query 45 in stream 0 using template query45.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=178.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=2.96GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=2.96GB mem-reservation=178.00MB thread-reservation=1 runtime-filters-memory=34.00MB
|
||||
| max-parallelism=1 segment-costs=[113824, 906634485, 201601849, 300]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, ca_county, sum(ws_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC, ca_county ASC
|
||||
| mem-estimate=5.76KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=59B cardinality=100 cost=201601849
|
||||
| in pipelines: 13(GETNEXT), 12(OPEN)
|
||||
|
|
||||
17:TUPLE CACHE
|
||||
| cache key: c5fc187bb66530cd9603eef9cd948fea
|
||||
| input scan node ids: 0,3,1,4,2,5
|
||||
| estimated serialized size: 900.67MB
|
||||
| estimated serialized size per node: 90.07MB
|
||||
| cumulative processing cost: 906748309
|
||||
| cache read processing cost: 1993499
|
||||
| cache write processing cost: 2549936
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=15.00M cost=0
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
12:AGGREGATE [FINALIZE]
|
||||
| output: sum(ws_sales_price)
|
||||
| group by: ca_zip, ca_county
|
||||
| mem-estimate=884.09MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=15.00M cost=346308783
|
||||
| in pipelines: 12(GETNEXT), 00(OPEN)
|
||||
|
|
||||
11:HASH JOIN [LEFT OUTER JOIN]
|
||||
| hash predicates: i_item_id = i_item_id
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR i_item_id IS NOT NULL)
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2,6N row-size=143B cardinality=202.59M cost=88674406
|
||||
| in pipelines: 00(GETNEXT), 06(OPEN)
|
||||
|
|
||||
|--16:TUPLE CACHE
|
||||
| | cache key: f9bd9e69dfc9b03f9bd034993d8cf617
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 320B
|
||||
| | estimated serialized size per node: 80B
|
||||
| | cumulative processing cost: 113824
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [FINALIZE]
|
||||
| | group by: i_item_id
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=28
|
||||
| | in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: b2aefdb151c4c641939ec59e01fb2397
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 360B
|
||||
| | estimated serialized size per node: 90B
|
||||
| | cumulative processing cost: 113796
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=32B cardinality=10 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| parquet dictionary predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=32B cardinality=10 cost=113796
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| mem-estimate=1.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2 row-size=115B cardinality=202.59M cost=103674396
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=47B cardinality=15.00M cost=4959659
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4 row-size=68B cardinality=202.59M cost=89060378
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ws_bill_customer_sk = c_customer_sk
|
||||
| runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| mem-estimate=996.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=36B cardinality=202.69M cost=123224636
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF006[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=28B cardinality=220.26M cost=96407940
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--14:TUPLE CACHE
|
||||
| | cache key: 9e01e5f34f23aa4ad8d4573f29a0200a
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ws_item_sk, RF005[min_max] -> ws_bill_customer_sk, RF002[bloom] -> ws_item_sk, RF004[bloom] -> ws_bill_customer_sk, RF006[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=220.26M(filtered from 2.16G) cost=50747879
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.90GB Threads=29
|
||||
Per-Host Resource Estimates: Memory=4.25GB
|
||||
F08:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.30MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[337] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, ca_county, sum(ws_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
23:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: ca_zip ASC, ca_county ASC
|
||||
| limit: 100
|
||||
| mem-estimate=308.05KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=59B cardinality=100 cost=37
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
F07:PLAN FRAGMENT [HASH(ca_zip,ca_county)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=51.38MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[404470111, 201601849, 185] cpu-comparison-result=120 [max(50 (self) vs 120 (sum children))]
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC, ca_county ASC
|
||||
| mem-estimate=5.76KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=59B cardinality=100 cost=201601849
|
||||
| in pipelines: 13(GETNEXT), 22(OPEN)
|
||||
|
|
||||
22:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ws_sales_price)
|
||||
| group by: ca_zip, ca_county
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=15.00M cost=331214513
|
||||
| in pipelines: 22(GETNEXT), 00(OPEN)
|
||||
|
|
||||
21:EXCHANGE [HASH(ca_zip,ca_county)]
|
||||
| mem-estimate=17.38MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=191.61M cost=73255598
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
|
||||
Per-Instance Resources: mem-estimate=113.99MB mem-reservation=34.12MB thread-reservation=1
|
||||
max-parallelism=170 segment-costs=[1652502478, 826268909] cpu-comparison-result=120 [max(120 (self) vs 75 (sum children))]
|
||||
12:AGGREGATE [STREAMING]
|
||||
| output: sum(ws_sales_price)
|
||||
| group by: ca_zip, ca_county
|
||||
| mem-estimate=85.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=191.61M cost=1146073039
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i_item_id = i_item_id
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR i_item_id IS NOT NULL)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2,6N row-size=143B cardinality=202.59M cost=88674396
|
||||
| in pipelines: 00(GETNEXT), 19(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[20] cpu-comparison-result=10 [max(10 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_id
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=10
|
||||
| |
|
||||
| 20:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=10
|
||||
| | in pipelines: 19(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [HASH(i_item_id)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[30, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 19:AGGREGATE [FINALIZE]
|
||||
| | group by: i_item_id
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=28
|
||||
| | in pipelines: 19(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 18:EXCHANGE [HASH(i_item_id)]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=2
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=34.50MB mem-reservation=10.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[113824, 23]
|
||||
| 26:TUPLE CACHE
|
||||
| | cache key: e97a2e1e139795e7137fa32c43246862
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 320B
|
||||
| | estimated serialized size per node: 80B
|
||||
| | cumulative processing cost: 113824
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | group by: i_item_id
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=28
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 25:TUPLE CACHE
|
||||
| | cache key: b2aefdb151c4c641939ec59e01fb2397
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 360B
|
||||
| | estimated serialized size per node: 90B
|
||||
| | cumulative processing cost: 113796
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=32B cardinality=10 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| parquet dictionary predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=32B cardinality=10 cost=113796
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2 row-size=115B cardinality=202.59M cost=88674396
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1.06GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| | mem-estimate=1.03GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.50MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=47B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.20MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[7185595]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=47B cardinality=15.00M cost=4959659
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4 row-size=68B cardinality=202.59M cost=88700378
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ws_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ws_bill_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=36B cardinality=202.69M cost=93224636
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[69869990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| | mem-estimate=996.88MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=39869990
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4752000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=28B cardinality=220.26M cost=96407754
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 24:TUPLE CACHE
|
||||
| | cache key: 9e01e5f34f23aa4ad8d4573f29a0200a
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
runtime filters: RF003[min_max] -> ws_item_sk, RF005[min_max] -> ws_bill_customer_sk, RF002[bloom] -> ws_item_sk, RF004[bloom] -> ws_bill_customer_sk, RF006[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=220.26M(filtered from 2.16G) cost=50747879
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.83GB Threads=71
|
||||
Per-Host Resource Estimates: Memory=4.14GB
|
||||
F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.30MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[337] cpu-comparison-result=320 [max(1 (self) vs 320 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: ca_zip, ca_county, sum(ws_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
25:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: ca_zip ASC, ca_county ASC
|
||||
| limit: 100
|
||||
| mem-estimate=308.05KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=59B cardinality=100 cost=37
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
F09:PLAN FRAGMENT [HASH(ca_zip,ca_county)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=51.38MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[404470111, 201601849, 185] cpu-comparison-result=320 [max(50 (self) vs 320 (sum children))]
|
||||
13:TOP-N [LIMIT=100]
|
||||
| order by: ca_zip ASC, ca_county ASC
|
||||
| mem-estimate=5.76KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=59B cardinality=100 cost=201601849
|
||||
| in pipelines: 13(GETNEXT), 24(OPEN)
|
||||
|
|
||||
24:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ws_sales_price)
|
||||
| group by: ca_zip, ca_county
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=15.00M cost=331214513
|
||||
| in pipelines: 24(GETNEXT), 00(OPEN)
|
||||
|
|
||||
23:EXCHANGE [HASH(ca_zip,ca_county)]
|
||||
| mem-estimate=17.38MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=191.61M cost=73255598
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=117.83MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=150 segment-costs=[1431666587, 826268909] cpu-comparison-result=320 [max(320 (self) vs 295 (sum children))]
|
||||
12:AGGREGATE [STREAMING]
|
||||
| output: sum(ws_sales_price)
|
||||
| group by: ca_zip, ca_county
|
||||
| mem-estimate=85.69MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=8 row-size=59B cardinality=191.61M cost=1146073039
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: i_item_id = i_item_id
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: (substr(ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792') OR i_item_id IS NOT NULL)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2,6N row-size=143B cardinality=202.59M cost=88674396
|
||||
| in pipelines: 00(GETNEXT), 21(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=23.27MB mem-reservation=23.25MB thread-reservation=1
|
||||
| | max-parallelism=10 segment-costs=[20] cpu-comparison-result=10 [max(10 (self) vs 4 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: i_item_id
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=10
|
||||
| |
|
||||
| 22:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=10
|
||||
| | in pipelines: 21(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [HASH(i_item_id)] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[30, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
|
||||
| 21:AGGREGATE [FINALIZE]
|
||||
| | group by: i_item_id
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=28
|
||||
| | in pipelines: 21(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 20:EXCHANGE [HASH(i_item_id)]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=2
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=34.50MB mem-reservation=10.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[113824, 23]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: e97a2e1e139795e7137fa32c43246862
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 320B
|
||||
| | estimated serialized size per node: 80B
|
||||
| | cumulative processing cost: 113824
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | group by: i_item_id
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=28B cardinality=10 cost=28
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: b2aefdb151c4c641939ec59e01fb2397
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 360B
|
||||
| | estimated serialized size per node: 90B
|
||||
| | cumulative processing cost: 113796
|
||||
| | cache read processing cost: 1
|
||||
| | cache write processing cost: 0
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=32B cardinality=10 cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| parquet dictionary predicates: i_item_sk IN (CAST(2 AS INT), CAST(3 AS INT), CAST(5 AS INT), CAST(7 AS INT), CAST(11 AS INT), CAST(13 AS INT), CAST(17 AS INT), CAST(19 AS INT), CAST(23 AS INT), CAST(29 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=32B cardinality=10 cost=113796
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
10:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: c_current_addr_sk = ca_address_sk
|
||||
| fk/pk conjuncts: c_current_addr_sk = ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4,2 row-size=115B cardinality=202.59M cost=88674396
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(c_current_addr_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=43.50MB mem-reservation=33.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=150 segment-costs=[19906835]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- ca_address_sk, RF001[min_max] <- ca_address_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 19:EXCHANGE [HASH(ca_address_sk)]
|
||||
| | mem-estimate=10.50MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=47B cardinality=15.00M cost=4906835
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=39.89MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[58052359]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=47B cardinality=15.00M cost=4959659
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
18:EXCHANGE [HASH(c_current_addr_sk)]
|
||||
| mem-estimate=19.84MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,3,1,4 row-size=68B cardinality=202.59M cost=108244756
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(ws_bill_customer_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=52.19MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=160 segment-costs=[1547561609]
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ws_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1,4 row-size=68B cardinality=202.59M cost=88700378
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ws_bill_customer_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.14MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.14MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=32B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[142560]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=32B cardinality=360.00K cost=103680
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ws_bill_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ws_bill_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=36B cardinality=202.69M cost=93224636
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [HASH(ws_bill_customer_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=43.12MB mem-reservation=33.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=160 segment-costs=[34437000]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF004[bloom] <- c_customer_sk, RF005[min_max] <- c_customer_sk
|
||||
| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 16:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=8B cardinality=30.00M cost=4437000
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=21.62MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34368000]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> c_current_addr_sk, RF000[bloom] -> c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=8B cardinality=30.00M cost=3456000
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
15:EXCHANGE [HASH(ws_bill_customer_sk)]
|
||||
| mem-estimate=12.81MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=28B cardinality=220.26M cost=60945912
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=80 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
|
||||
Per-Instance Resources: mem-estimate=32.88MB mem-reservation=128.00KB thread-reservation=1
|
||||
max-parallelism=80 segment-costs=[771284062]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=28B cardinality=220.26M cost=96407754
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=16.52MB mem-reservation=16.50MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[426]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=15.50MB mem-reservation=15.50MB spill-buffer=64.00KB thread-reservation=0 cost=186
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=240
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16738]
|
||||
| 26:TUPLE CACHE
|
||||
| | cache key: 9e01e5f34f23aa4ad8d4573f29a0200a
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 2.91KB
|
||||
| | estimated serialized size per node: 2.91KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 24
|
||||
| | cache write processing cost: 8
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=186 cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(1999 AS INT), d_qoy = CAST(2 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=186 cost=16728
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
runtime filters: RF003[min_max] -> ws_item_sk, RF005[min_max] -> ws_bill_customer_sk, RF002[bloom] -> ws_item_sk, RF004[bloom] -> ws_bill_customer_sk, RF006[bloom] -> ws_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=187(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=220.26M(filtered from 2.16G) cost=50747879
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
897
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q46.test
vendored
Normal file
897
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q46.test
vendored
Normal file
@@ -0,0 +1,897 @@
|
||||
# TPCDS-Q46
|
||||
# start query 46 in stream 0 using template query46.tpl using seed 957555142
|
||||
select c_last_name
|
||||
,c_first_name
|
||||
,ca_city
|
||||
,bought_city
|
||||
,ss_ticket_number
|
||||
,amt,profit
|
||||
from
|
||||
(select ss_ticket_number
|
||||
,ss_customer_sk
|
||||
,ca_city bought_city
|
||||
,sum(ss_coupon_amt) amt
|
||||
,sum(ss_net_profit) profit
|
||||
from store_sales,date_dim,store,household_demographics,customer_address
|
||||
where store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
and store_sales.ss_store_sk = store.s_store_sk
|
||||
and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
and store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
and (household_demographics.hd_dep_count = 2 or
|
||||
household_demographics.hd_vehicle_count= 2)
|
||||
and date_dim.d_dow in (6,0)
|
||||
and date_dim.d_year in (1998,1998+1,1998+2)
|
||||
and store.s_city in ('Antioch','Mount Vernon','Jamestown','Wilson','Farmington')
|
||||
group by ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city) dn,customer,customer_address current_addr
|
||||
where ss_customer_sk = c_customer_sk
|
||||
and customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
and current_addr.ca_city <> bought_city
|
||||
order by c_last_name
|
||||
,c_first_name
|
||||
,ca_city
|
||||
,bought_city
|
||||
,ss_ticket_number
|
||||
limit 100;
|
||||
|
||||
# end query 46 in stream 0 using template query46.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=201.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=9.34GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=9.34GB mem-reservation=201.94MB thread-reservation=1 runtime-filters-memory=51.00MB
|
||||
| max-parallelism=1 segment-costs=[2453326157, 1159884131, 700]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, amt, profit
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC
|
||||
| mem-estimate=11.51KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=118B cardinality=100 cost=1039917818
|
||||
| in pipelines: 14(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| mem-estimate=740.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=138B cardinality=70.73M cost=45960705
|
||||
| in pipelines: 09(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| mem-estimate=1.98GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=113B cardinality=70.73M cost=62581955
|
||||
| in pipelines: 09(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_coupon_amt), sum(ss_net_profit)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=5.81GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=460222599
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| mem-estimate=740.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1,4 row-size=110B cardinality=77.06M cost=49389944
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| runtime filters: RF006[bloom] <- date_dim.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=85B cardinality=79.64M cost=76738394
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--17:TUPLE CACHE
|
||||
| | cache key: 4e4e7a760125f37c64dd0d18de0ca983
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 9.34KB
|
||||
| | estimated serialized size per node: 9.34KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 79
|
||||
| | cache write processing cost: 25
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=598 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=598 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| runtime filters: RF008[bloom] <- household_demographics.hd_demo_sk, RF009[min_max] <- household_demographics.hd_demo_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=73B cardinality=242.91M cost=129692158
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--16:TUPLE CACHE
|
||||
| | cache key: 37cbf666de643f6ab90851b03b6a523b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(2 AS INT) OR household_demographics.hd_vehicle_count = CAST(2 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=61B cardinality=334.01M(filtered from 995.40M) cost=266041680
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 177f9ac9d4e2ad8071eace25fb5cfb55
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 2.19KB
|
||||
| | estimated serialized size per node: 2.19KB
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 10
|
||||
| | cache write processing cost: 6
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=77 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| parquet dictionary predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=77 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF009[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_hdemo_sk, RF006[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=598(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=36B cardinality=334.01M(filtered from 8.64G) cost=1468425196
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=2.21GB Threads=53
|
||||
Per-Host Resource Estimates: Memory=4.16GB
|
||||
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=5.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[748] cpu-comparison-result=270 [max(1 (self) vs 270 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, amt, profit
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
24:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC
|
||||
| limit: 100
|
||||
| mem-estimate=1.40MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=118B cardinality=100 cost=48
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F07:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=13.57MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1136461956, 340] cpu-comparison-result=270 [max(120 (self) vs 270 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC
|
||||
| mem-estimate=11.51KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=118B cardinality=100 cost=1039917818
|
||||
| in pipelines: 14(GETNEXT), 20(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=138B cardinality=70.73M cost=30960705
|
||||
| in pipelines: 20(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=767.23MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: current_addr.ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| | mem-estimate=740.95MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 23:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=25B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.11MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4132292]
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=113B cardinality=70.73M cost=32581955
|
||||
| in pipelines: 20(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=60.47MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=120 segment-costs=[39400506]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 22:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=44B cardinality=30.00M cost=9400506
|
||||
| | in pipelines: 10(GETNEXT)
|
||||
| |
|
||||
| F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=38.48MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[109027022]
|
||||
| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
21:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=13.56MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=33001478
|
||||
| in pipelines: 20(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=153.17MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[493224077, 381867406] cpu-comparison-result=120 [max(50 (self) vs 120 (sum children))]
|
||||
20:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_coupon_amt), sum:merge(ss_net_profit)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=118.98MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=460222599
|
||||
| in pipelines: 20(GETNEXT), 00(OPEN)
|
||||
|
|
||||
19:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)]
|
||||
| mem-estimate=18.55MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=33001478
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=67.43MB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=250 segment-costs=[2435507496, 381867406] cpu-comparison-result=120 [max(120 (self) vs 53 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_coupon_amt), sum(ss_net_profit)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=37.18MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=460222599
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1,4 row-size=110B cardinality=77.06M cost=34389944
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=767.23MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=10 segment-costs=[34934990]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: customer_address.ca_address_sk
|
||||
| | runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| | mem-estimate=740.95MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=25B cardinality=15.00M cost=19934990
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=16.11MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[4132292]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=85B cardinality=79.64M cost=76737796
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1388]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: date_dim.d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=598
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.35KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=598 cost=790
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16760]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 4e4e7a760125f37c64dd0d18de0ca983
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 9.34KB
|
||||
| | estimated serialized size per node: 9.34KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 79
|
||||
| | cache write processing cost: 25
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=598 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=598 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=73B cardinality=242.91M cost=129690358
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF008[bloom] <- household_demographics.hd_demo_sk, RF009[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=37.09KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.06MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1543]
|
||||
| 26:TUPLE CACHE
|
||||
| | cache key: 37cbf666de643f6ab90851b03b6a523b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(2 AS INT) OR household_demographics.hd_vehicle_count = CAST(2 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=61B cardinality=334.01M(filtered from 995.40M) cost=266041603
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[177]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: store.s_store_sk
|
||||
| | runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=77
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=77 cost=100
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.11MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[298]
|
||||
| 25:TUPLE CACHE
|
||||
| | cache key: 177f9ac9d4e2ad8071eace25fb5cfb55
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 2.19KB
|
||||
| | estimated serialized size per node: 2.19KB
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 10
|
||||
| | cache write processing cost: 6
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=77 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| parquet dictionary predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=77 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF009[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_hdemo_sk, RF006[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=598(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=36B cardinality=334.01M(filtered from 8.64G) cost=1468425196
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.24GB Threads=70
|
||||
Per-Host Resource Estimates: Memory=3.47GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=5.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[748] cpu-comparison-result=360 [max(1 (self) vs 360 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, amt, profit
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC
|
||||
| limit: 100
|
||||
| mem-estimate=1.40MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=118B cardinality=100 cost=48
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=18.28MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[1118082195, 340] cpu-comparison-result=360 [max(190 (self) vs 360 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC
|
||||
| mem-estimate=11.51KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=118B cardinality=100 cost=1039917818
|
||||
| in pipelines: 14(GETNEXT), 21(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=138B cardinality=70.73M cost=30960705
|
||||
| in pipelines: 21(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=34.78MB mem-reservation=24.50MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=120 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: current_addr.ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 25:EXCHANGE [HASH(current_addr.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=29.57MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
24:EXCHANGE [HASH(customer.c_current_addr_sk)]
|
||||
| mem-estimate=18.27MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=113B cardinality=70.73M cost=47203672
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F08:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=70 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=69.53MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=70 segment-costs=[652856305]
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=113B cardinality=70.73M cost=32581955
|
||||
| in pipelines: 21(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=70 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=60.47MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=70 segment-costs=[39400506]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 23:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=44B cardinality=30.00M cost=9400506
|
||||
| | in pipelines: 10(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=29.12MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[109027022]
|
||||
| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
22:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=12.85MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=33001478
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=168.67MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=50 segment-costs=[493224077, 381867406] cpu-comparison-result=150 [max(40 (self) vs 150 (sum children))]
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_coupon_amt), sum:merge(ss_net_profit)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=148.72MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=460222599
|
||||
| in pipelines: 21(GETNEXT), 00(OPEN)
|
||||
|
|
||||
20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)]
|
||||
| mem-estimate=12.14MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=33001478
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=181.97MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=60 segment-costs=[543427107, 381867406] cpu-comparison-result=150 [max(150 (self) vs 73 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_coupon_amt), sum(ss_net_profit)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=148.72MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=69B cardinality=77.06M cost=460222599
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1,4 row-size=110B cardinality=77.06M cost=34389944
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=60.28MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=60 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: customer_address.ca_address_sk
|
||||
| | runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 19:EXCHANGE [HASH(customer_address.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=19.39MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
18:EXCHANGE [HASH(store_sales.ss_addr_sk)]
|
||||
| mem-estimate=21.85MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=85B cardinality=79.64M cost=48814564
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=27.85MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=260 segment-costs=[2541458132]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3,1 row-size=85B cardinality=79.64M cost=76737796
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1388]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: date_dim.d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=598
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.35KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=598 cost=790
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16760]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 4e4e7a760125f37c64dd0d18de0ca983
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 9.34KB
|
||||
| | estimated serialized size per node: 9.34KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 79
|
||||
| | cache write processing cost: 25
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=598 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dow IN (CAST(6 AS INT), CAST(0 AS INT)), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=598 cost=16728
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,3 row-size=73B cardinality=242.91M cost=129690358
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF008[bloom] <- household_demographics.hd_demo_sk, RF009[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=37.09KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.06MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1543]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: 37cbf666de643f6ab90851b03b6a523b
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(2 AS INT) OR household_demographics.hd_vehicle_count = CAST(2 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=61B cardinality=334.01M(filtered from 995.40M) cost=266041603
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[177]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: store.s_store_sk
|
||||
| | runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=77
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=77 cost=100
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.11MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[298]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 177f9ac9d4e2ad8071eace25fb5cfb55
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 2.19KB
|
||||
| | estimated serialized size per node: 2.19KB
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 10
|
||||
| | cache write processing cost: 6
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=77 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| parquet dictionary predicates: store.s_city IN ('Antioch', 'Mount Vernon', 'Jamestown', 'Wilson', 'Farmington')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=77 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF009[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_hdemo_sk, RF006[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=598(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=36B cardinality=334.01M(filtered from 8.64G) cost=1468425196
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
1605
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q47.test
vendored
Normal file
1605
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q47.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
794
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q48.test
vendored
Normal file
794
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q48.test
vendored
Normal file
File diff suppressed because one or more lines are too long
1717
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q49.test
vendored
Normal file
1717
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q49.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
693
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q50.test
vendored
Normal file
693
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q50.test
vendored
Normal file
@@ -0,0 +1,693 @@
|
||||
# TPCDS-Q50
|
||||
# start query 50 in stream 0 using template query50.tpl using seed 1521398881
|
||||
select
|
||||
s_store_name
|
||||
,s_company_id
|
||||
,s_street_number
|
||||
,s_street_name
|
||||
,s_street_type
|
||||
,s_suite_number
|
||||
,s_city
|
||||
,s_county
|
||||
,s_state
|
||||
,s_zip
|
||||
,sum(case when (sr_returned_date_sk - ss_sold_date_sk <= 30 ) then 1 else 0 end) as "30 days"
|
||||
,sum(case when (sr_returned_date_sk - ss_sold_date_sk > 30) and
|
||||
(sr_returned_date_sk - ss_sold_date_sk <= 60) then 1 else 0 end ) as "31-60 days"
|
||||
,sum(case when (sr_returned_date_sk - ss_sold_date_sk > 60) and
|
||||
(sr_returned_date_sk - ss_sold_date_sk <= 90) then 1 else 0 end) as "61-90 days"
|
||||
,sum(case when (sr_returned_date_sk - ss_sold_date_sk > 90) and
|
||||
(sr_returned_date_sk - ss_sold_date_sk <= 120) then 1 else 0 end) as "91-120 days"
|
||||
,sum(case when (sr_returned_date_sk - ss_sold_date_sk > 120) then 1 else 0 end) as ">120 days"
|
||||
from
|
||||
store_sales
|
||||
,store_returns
|
||||
,store
|
||||
,date_dim d1
|
||||
,date_dim d2
|
||||
where
|
||||
d2.d_year = 1999
|
||||
and d2.d_moy = 9
|
||||
and ss_ticket_number = sr_ticket_number
|
||||
and ss_item_sk = sr_item_sk
|
||||
and ss_sold_date_sk = d1.d_date_sk
|
||||
and sr_returned_date_sk = d2.d_date_sk
|
||||
and ss_customer_sk = sr_customer_sk
|
||||
and ss_store_sk = s_store_sk
|
||||
group by
|
||||
s_store_name
|
||||
,s_company_id
|
||||
,s_street_number
|
||||
,s_street_name
|
||||
,s_street_type
|
||||
,s_suite_number
|
||||
,s_city
|
||||
,s_county
|
||||
,s_state
|
||||
,s_zip
|
||||
order by s_store_name
|
||||
,s_company_id
|
||||
,s_street_number
|
||||
,s_street_name
|
||||
,s_street_type
|
||||
,s_suite_number
|
||||
,s_city
|
||||
,s_county
|
||||
,s_state
|
||||
,s_zip
|
||||
limit 100;
|
||||
|
||||
# end query 50 in stream 0 using template query50.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=122.75MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=40.78GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=40.78GB mem-reservation=122.75MB thread-reservation=1 runtime-filters-memory=36.00MB
|
||||
| max-parallelism=1 segment-costs=[9817718693, 7914, 1500]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip, sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1500
|
||||
|
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_company_id ASC, s_street_number ASC, s_street_name ASC, s_street_type ASC, s_suite_number ASC, s_city ASC, s_county ASC, s_state ASC, s_zip ASC
|
||||
| mem-estimate=20.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=210B cardinality=100 cost=7914
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 4e006e223e242d59f6d022cb0bc98963
|
||||
| input scan node ids: 0,1,4,2,3
|
||||
| estimated serialized size: 281.58KB
|
||||
| estimated serialized size per node: 28.16KB
|
||||
| cumulative processing cost: 9817718693
|
||||
| cache read processing cost: 179
|
||||
| cache write processing cost: 778
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=1.35K cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip
|
||||
| mem-estimate=644.46MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=1.35K cost=534861705
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d1.d_date_sk
|
||||
| mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2,3 row-size=234B cardinality=323.35M cost=141603967
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=73.05K cost=4207
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2 row-size=230B cardinality=323.35M cost=141532268
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: 1323aa5a12f8a6aa59c763a21ec6413b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 234.12KB
|
||||
| | estimated serialized size per node: 234.12KB
|
||||
| | cumulative processing cost: 1274
|
||||
| | cache read processing cost: 179
|
||||
| | cache write processing cost: 647
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=174B cardinality=1.35K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=88.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=174B cardinality=1.35K cost=1274
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: sr_returned_date_sk = d2.d_date_sk
|
||||
| fk/pk conjuncts: sr_returned_date_sk = d2.d_date_sk
|
||||
| runtime filters: RF004[bloom] <- d2.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4 row-size=56B cardinality=323.35M cost=1597582491
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: d11fd35c7b957f2a770b8c26800ce562
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d2]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| parquet dictionary predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| fk/pk conjuncts: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| runtime filters: RF006[bloom] <- sr_customer_sk, RF007[bloom] <- sr_item_sk, RF008[bloom] <- sr_ticket_number, RF009[min_max] <- sr_customer_sk, RF010[min_max] <- sr_item_sk, RF011[min_max] <- sr_ticket_number
|
||||
| mem-estimate=40.09GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=44B cardinality=6.00G cost=4167325725
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF004[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=863.99M cost=248828726
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF009[min_max] -> ss_customer_sk, RF010[min_max] -> ss_item_sk, RF011[min_max] -> ss_ticket_number, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_store_sk, RF006[bloom] -> ss_customer_sk, RF007[bloom] -> ss_item_sk, RF008[bloom] -> ss_ticket_number
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=8.64G cost=2985961602
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=697.59MB Threads=42
|
||||
Per-Host Resource Estimates: Memory=7.49GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1567] cpu-comparison-result=203 [max(1 (self) vs 203 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip, sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1500
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, s_company_id ASC, s_street_number ASC, s_street_name ASC, s_street_type ASC, s_suite_number ASC, s_city ASC, s_county ASC, s_state ASC, s_zip ASC
|
||||
| limit: 100
|
||||
| mem-estimate=210.63KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=210B cardinality=100 cost=67
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(s_store_name,s_company_id,s_street_number,s_street_name,s_street_type,s_suite_number,s_city,s_county,s_state,s_zip)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=23.67MB mem-reservation=4.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[448257, 7914, 580] cpu-comparison-result=203 [max(10 (self) vs 203 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_company_id ASC, s_street_number ASC, s_street_name ASC, s_street_type ASC, s_suite_number ASC, s_city ASC, s_county ASC, s_state ASC, s_zip ASC
|
||||
| mem-estimate=20.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=210B cardinality=100 cost=7914
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| group by: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip
|
||||
| mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=1.35K cost=274077
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(s_store_name,s_company_id,s_street_number,s_street_name,s_street_type,s_suite_number,s_city,s_county,s_state,s_zip)]
|
||||
| mem-estimate=13.67MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=162.00K cost=174180
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=534.63MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=770 segment-costs=[7633316166, 2270017] cpu-comparison-result=203 [max(170 (self) vs 203 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip
|
||||
| mem-estimate=513.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=162.00K cost=535589209
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2,3 row-size=234B cardinality=323.35M cost=141530918
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=15.66MB mem-reservation=15.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d1.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d1.d_date_sk
|
||||
| | mem-estimate=14.38MB mem-reservation=14.38MB spill-buffer=128.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=293.35KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[6573]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=73.05K cost=4207
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2 row-size=230B cardinality=323.35M cost=141530918
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=11.08MB mem-reservation=10.69MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=9.69MB mem-reservation=9.69MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=406.43KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=174B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.69MB mem-reservation=4.09MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1935]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 1323aa5a12f8a6aa59c763a21ec6413b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 234.12KB
|
||||
| | estimated serialized size per node: 234.12KB
|
||||
| | cumulative processing cost: 1274
|
||||
| | cache read processing cost: 179
|
||||
| | cache write processing cost: 647
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=174B cardinality=1.35K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=88.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=174B cardinality=1.35K cost=1274
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: sr_returned_date_sk = d2.d_date_sk
|
||||
| fk/pk conjuncts: sr_returned_date_sk = d2.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4 row-size=56B cardinality=323.35M cost=1597582383
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=10.70MB mem-reservation=10.69MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d2.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d2.d_date_sk
|
||||
| | mem-estimate=9.69MB mem-reservation=9.69MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d11fd35c7b957f2a770b8c26800ce562
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d2, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| parquet dictionary predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| fk/pk conjuncts: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=44B cardinality=6.00G cost=3303337093
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=50 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=866.92MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB
|
||||
| | max-parallelism=770 segment-costs=[1039464723]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: sr_customer_sk, sr_item_sk, sr_ticket_number
|
||||
| | runtime filters: RF006[bloom] <- sr_customer_sk, RF007[bloom] <- sr_item_sk, RF008[bloom] <- sr_ticket_number, RF009[min_max] <- sr_customer_sk, RF010[min_max] <- sr_item_sk, RF011[min_max] <- sr_ticket_number
|
||||
| | mem-estimate=821.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=863988632
|
||||
| |
|
||||
| 12:EXCHANGE [HASH(sr_customer_sk,sr_item_sk,sr_ticket_number)]
|
||||
| | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=863.99M cost=175476091
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=20.69MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=190 segment-costs=[1806773027]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF004[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=863.99M cost=248828726
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
11:EXCHANGE [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=8.64G cost=1913745645
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=21.47MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[20791140047]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF009[min_max] -> ss_customer_sk, RF010[min_max] -> ss_item_sk, RF011[min_max] -> ss_ticket_number, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_store_sk, RF006[bloom] -> ss_customer_sk, RF007[bloom] -> ss_item_sk, RF008[bloom] -> ss_ticket_number
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=8.64G cost=2985961602
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=697.59MB Threads=42
|
||||
Per-Host Resource Estimates: Memory=7.49GB
|
||||
F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.21MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1567] cpu-comparison-result=203 [max(1 (self) vs 203 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip, sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1500
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, s_company_id ASC, s_street_number ASC, s_street_name ASC, s_street_type ASC, s_suite_number ASC, s_city ASC, s_county ASC, s_state ASC, s_zip ASC
|
||||
| limit: 100
|
||||
| mem-estimate=210.63KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=210B cardinality=100 cost=67
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(s_store_name,s_company_id,s_street_number,s_street_name,s_street_type,s_suite_number,s_city,s_county,s_state,s_zip)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=23.67MB mem-reservation=4.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[448257, 7914, 580] cpu-comparison-result=203 [max(10 (self) vs 203 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, s_company_id ASC, s_street_number ASC, s_street_name ASC, s_street_type ASC, s_suite_number ASC, s_city ASC, s_county ASC, s_state ASC, s_zip ASC
|
||||
| mem-estimate=20.47KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=210B cardinality=100 cost=7914
|
||||
| in pipelines: 10(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| group by: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip
|
||||
| mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=1.35K cost=274077
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(s_store_name,s_company_id,s_street_number,s_street_name,s_street_type,s_suite_number,s_city,s_county,s_state,s_zip)]
|
||||
| mem-estimate=13.67MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=162.00K cost=174180
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=50 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=534.63MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=770 segment-costs=[7633316166, 2270017] cpu-comparison-result=203 [max(170 (self) vs 203 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(sr_returned_date_sk AS BIGINT) - CAST(ss_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip
|
||||
| mem-estimate=513.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=210B cardinality=162.00K cost=535589209
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d1.d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2,3 row-size=234B cardinality=323.35M cost=141530918
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=15.66MB mem-reservation=15.38MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d1.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d1.d_date_sk
|
||||
| | mem-estimate=14.38MB mem-reservation=14.38MB spill-buffer=128.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=293.35KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[6573]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d1, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=73.05K cost=4207
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4,2 row-size=230B cardinality=323.35M cost=141530918
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=11.08MB mem-reservation=10.69MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=9.69MB mem-reservation=9.69MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=406.43KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=174B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.69MB mem-reservation=4.09MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1935]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: 1323aa5a12f8a6aa59c763a21ec6413b
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 234.12KB
|
||||
| | estimated serialized size per node: 234.12KB
|
||||
| | cumulative processing cost: 1274
|
||||
| | cache read processing cost: 179
|
||||
| | cache write processing cost: 647
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=174B cardinality=1.35K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=88.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=174B cardinality=1.35K cost=1274
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: sr_returned_date_sk = d2.d_date_sk
|
||||
| fk/pk conjuncts: sr_returned_date_sk = d2.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,4 row-size=56B cardinality=323.35M cost=1597582383
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=10.70MB mem-reservation=10.69MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d2.d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d2.d_date_sk
|
||||
| | mem-estimate=9.69MB mem-reservation=9.69MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d11fd35c7b957f2a770b8c26800ce562
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d2, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| parquet dictionary predicates: d2.d_year = CAST(1999 AS INT), d2.d_moy = CAST(9 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| fk/pk conjuncts: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=44B cardinality=6.00G cost=3303337093
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=10 instances=50 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=866.92MB mem-reservation=67.00MB thread-reservation=1 runtime-filters-memory=33.00MB
|
||||
| | max-parallelism=770 segment-costs=[1039464723]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: sr_customer_sk, sr_item_sk, sr_ticket_number
|
||||
| | runtime filters: RF006[bloom] <- sr_customer_sk, RF007[bloom] <- sr_item_sk, RF008[bloom] <- sr_ticket_number, RF009[min_max] <- sr_customer_sk, RF010[min_max] <- sr_item_sk, RF011[min_max] <- sr_ticket_number
|
||||
| | mem-estimate=821.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=863988632
|
||||
| |
|
||||
| 12:EXCHANGE [HASH(sr_customer_sk,sr_item_sk,sr_ticket_number)]
|
||||
| | mem-estimate=12.81MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=863.99M cost=175476091
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=20.69MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=190 segment-costs=[1806773027]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
|
||||
| HDFS partitions=2004/2004 files=2004 size=48.14GB
|
||||
| runtime filters: RF004[bloom] -> sr_returned_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=863.99M size=48.14GB
|
||||
| partitions: 2004/2004 rows=863.99M
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=30.09M
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=863.99M cost=248828726
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
11:EXCHANGE [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=8.64G cost=1913745645
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=21.47MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[20791140047]
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF003[min_max] -> ss_store_sk, RF009[min_max] -> ss_customer_sk, RF010[min_max] -> ss_item_sk, RF011[min_max] -> ss_ticket_number, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_store_sk, RF006[bloom] -> ss_customer_sk, RF007[bloom] -> ss_item_sk, RF008[bloom] -> ss_ticket_number
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=24B cardinality=8.64G cost=2985961602
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
814
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q51.test
vendored
Normal file
814
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q51.test
vendored
Normal file
@@ -0,0 +1,814 @@
|
||||
# TPCDS-Q51
|
||||
# start query 51 in stream 0 using template query51.tpl using seed 63208138
|
||||
WITH web_v1 as (
|
||||
select
|
||||
ws_item_sk item_sk, d_date,
|
||||
sum(sum(ws_sales_price))
|
||||
over (partition by ws_item_sk order by d_date rows between unbounded preceding and current row) cume_sales
|
||||
from web_sales
|
||||
,date_dim
|
||||
where ws_sold_date_sk=d_date_sk
|
||||
and d_month_seq between 1176 and 1176+11
|
||||
and ws_item_sk is not NULL
|
||||
group by ws_item_sk, d_date),
|
||||
store_v1 as (
|
||||
select
|
||||
ss_item_sk item_sk, d_date,
|
||||
sum(sum(ss_sales_price))
|
||||
over (partition by ss_item_sk order by d_date rows between unbounded preceding and current row) cume_sales
|
||||
from store_sales
|
||||
,date_dim
|
||||
where ss_sold_date_sk=d_date_sk
|
||||
and d_month_seq between 1176 and 1176+11
|
||||
and ss_item_sk is not NULL
|
||||
group by ss_item_sk, d_date)
|
||||
select *
|
||||
from (select item_sk
|
||||
,d_date
|
||||
,web_sales
|
||||
,store_sales
|
||||
,max(web_sales)
|
||||
over (partition by item_sk order by d_date rows between unbounded preceding and current row) web_cumulative
|
||||
,max(store_sales)
|
||||
over (partition by item_sk order by d_date rows between unbounded preceding and current row) store_cumulative
|
||||
from (select case when web.item_sk is not null then web.item_sk else store.item_sk end item_sk
|
||||
,case when web.d_date is not null then web.d_date else store.d_date end d_date
|
||||
,web.cume_sales web_sales
|
||||
,store.cume_sales store_sales
|
||||
from web_v1 web full outer join store_v1 store on (web.item_sk = store.item_sk
|
||||
and web.d_date = store.d_date)
|
||||
)x )y
|
||||
where web_cumulative > store_cumulative
|
||||
order by item_sk
|
||||
,d_date
|
||||
limit 100;
|
||||
|
||||
# end query 51 in stream 0 using template query51.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=97.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=198.29GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=198.29GB mem-reservation=97.94MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[56515568116, 12537410622, 14128806498, 3134329462, 210805767343546, 278820518032917, 600]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: item_sk, d_date, web_sales, store_sales, web_cumulative, store_cumulative
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
16:TOP-N [LIMIT=100]
|
||||
| order by: item_sk ASC, d_date ASC
|
||||
| mem-estimate=7.03KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=72B cardinality=100 cost=123381692167701
|
||||
| in pipelines: 16(GETNEXT), 13(OPEN)
|
||||
|
|
||||
15:SELECT
|
||||
| predicates: max(web_sales) > max(store_sales)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=5.18T cost=51812941955072
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
14:ANALYTIC
|
||||
| functions: max(sum(sum(ws_sales_price))), max(sum(sum(ss_sales_price)))
|
||||
| partition by: item_sk
|
||||
| order by: CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=51.81T cost=103625883910144
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
13:SORT
|
||||
| order by: CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END ASC NULLS LAST, CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| mem-estimate=50.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25 row-size=80B cardinality=51.81T cost=201402086378006
|
||||
| in pipelines: 13(GETNEXT), 10(OPEN)
|
||||
|
|
||||
12:HASH JOIN [FULL OUTER JOIN]
|
||||
| hash predicates: d_date = d_date, ss_item_sk = ws_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22N,21N,17N,16N row-size=80B cardinality=51.81T cost=9392881062052
|
||||
| in pipelines: 10(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--05:ANALYTIC
|
||||
| | functions: sum(sum(ws_sales_price))
|
||||
| | partition by: ws_item_sk
|
||||
| | order by: d_date ASC
|
||||
| | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17,16 row-size=40B cardinality=2.16G cost=2159968000
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SORT
|
||||
| | order by: ws_item_sk ASC NULLS LAST, d_date ASC
|
||||
| | mem-estimate=48.28GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17 row-size=24B cardinality=2.16G cost=3134329462
|
||||
| | in pipelines: 04(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| 03:AGGREGATE [FINALIZE]
|
||||
| | output: sum(ws_sales_price)
|
||||
| | group by: ws_item_sk, d_date
|
||||
| | mem-estimate=36.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=12749426922
|
||||
| | in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=2.16G cost=945425284
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--18:TUPLE CACHE
|
||||
| | | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 114.14KB
|
||||
| | | estimated serialized size per node: 114.14KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 315
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=7.30K cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| predicates: ws_item_sk IS NOT NULL
|
||||
| runtime filters: RF002[bloom] -> ws_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| parquet dictionary predicates: ws_item_sk IS NOT NULL
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=2.16G cost=433937564
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:ANALYTIC
|
||||
| functions: sum(sum(ss_sales_price))
|
||||
| partition by: ss_item_sk
|
||||
| order by: d_date ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22,21 row-size=40B cardinality=8.64G cost=8639935488
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
10:SORT
|
||||
| order by: ss_item_sk ASC NULLS LAST, d_date ASC
|
||||
| mem-estimate=50.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22 row-size=24B cardinality=8.64G cost=12537410622
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_item_sk, d_date
|
||||
| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=50998081470
|
||||
| in pipelines: 09(GETNEXT), 06(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,6 row-size=24B cardinality=8.64G cost=3781706938
|
||||
| in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--17:TUPLE CACHE
|
||||
| | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | input scan node ids: 7
|
||||
| | estimated serialized size: 114.14KB
|
||||
| | estimated serialized size per node: 114.14KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 315
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=7.30K cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=12B cardinality=7.30K cost=16728
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
predicates: ss_item_sk IS NOT NULL
|
||||
runtime filters: RF000[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
parquet dictionary predicates: ss_item_sk IS NOT NULL
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=12B cardinality=8.64G cost=1735762980
|
||||
in pipelines: 06(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=2.48GB Threads=87
|
||||
Per-Host Resource Estimates: Memory=132.31GB
|
||||
F08:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.73MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[639] cpu-comparison-result=240 [max(1 (self) vs 240 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: item_sk, d_date, web_sales, store_sales, web_cumulative, store_cumulative
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: item_sk ASC, d_date ASC
|
||||
| limit: 100
|
||||
| mem-estimate=742.89KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=72B cardinality=100 cost=39
|
||||
| in pipelines: 16(GETNEXT)
|
||||
|
|
||||
F07:PLAN FRAGMENT [HASH(CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END)] hosts=10 instances=100 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=5.02GB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=27882060 segment-costs=[231945815232544, 278820518032917, 220] cpu-comparison-result=240 [max(220 (self) vs 240 (sum children))]
|
||||
16:TOP-N [LIMIT=100]
|
||||
| order by: item_sk ASC, d_date ASC
|
||||
| mem-estimate=7.03KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=72B cardinality=100 cost=123381692167701
|
||||
| in pipelines: 16(GETNEXT), 13(OPEN)
|
||||
|
|
||||
15:SELECT
|
||||
| predicates: max(web_sales) > max(store_sales)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=5.18T cost=51812941955072
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
14:ANALYTIC
|
||||
| functions: max(sum(sum(ws_sales_price))), max(sum(sum(ss_sales_price)))
|
||||
| partition by: item_sk
|
||||
| order by: CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=51.81T cost=103625883910144
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
13:SORT
|
||||
| order by: CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END ASC NULLS LAST, CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| mem-estimate=5.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25 row-size=80B cardinality=51.81T cost=201402086378006
|
||||
| in pipelines: 13(GETNEXT), 10(OPEN)
|
||||
|
|
||||
25:EXCHANGE [HASH(CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END)]
|
||||
| mem-estimate=21.25MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=22N,21N,17N,16N row-size=80B cardinality=51.81T cost=30543728854538
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=53.12MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=38311000 segment-costs=[383109971185632]
|
||||
12:HASH JOIN [FULL OUTER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: d_date = d_date, ss_item_sk = ws_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22N,21N,17N,16N row-size=80B cardinality=51.81T cost=9390721094085
|
||||
| in pipelines: 10(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=1.09GB mem-reservation=34.00MB thread-reservation=1
|
||||
| | max-parallelism=38311000 segment-costs=[2876861335] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date, ws_item_sk
|
||||
| | mem-estimate=1.07GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2159967967
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(d_date,ws_item_sk)]
|
||||
| | mem-estimate=15.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=17,16 row-size=40B cardinality=2.16G cost=716893368
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ws_item_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=980.97MB mem-reservation=44.00MB thread-reservation=1
|
||||
| max-parallelism=1330 segment-costs=[13227859826, 3134329462, 9949676476] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
| 05:ANALYTIC
|
||||
| | functions: sum(sum(ws_sales_price))
|
||||
| | partition by: ws_item_sk
|
||||
| | order by: d_date ASC
|
||||
| | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17,16 row-size=40B cardinality=2.16G cost=2159968000
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SORT
|
||||
| | order by: ws_item_sk ASC NULLS LAST, d_date ASC
|
||||
| | mem-estimate=411.98MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17 row-size=24B cardinality=2.16G cost=3134329462
|
||||
| | in pipelines: 04(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| 22:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(ws_sales_price)
|
||||
| | group by: ws_item_sk, d_date
|
||||
| | mem-estimate=564.99MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=12749426922
|
||||
| | in pipelines: 22(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 21:EXCHANGE [HASH(ws_item_sk)]
|
||||
| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=478432904
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=492.60MB mem-reservation=34.12MB thread-reservation=1
|
||||
| max-parallelism=1420 segment-costs=[14128782465, 4451261986] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 03:AGGREGATE [STREAMING]
|
||||
| | output: sum(ws_sales_price)
|
||||
| | group by: ws_item_sk, d_date
|
||||
| | mem-estimate=463.48MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=12749426922
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=2.16G cost=945417979
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.35MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 20:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=101.61KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[17122]
|
||||
| | 28:TUPLE CACHE
|
||||
| | | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 114.14KB
|
||||
| | | estimated serialized size per node: 114.14KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 315
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=7.30K cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| predicates: ws_item_sk IS NOT NULL
|
||||
| runtime filters: RF002[bloom] -> ws_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| parquet dictionary predicates: ws_item_sk IS NOT NULL
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=2.16G cost=433937564
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
23:EXCHANGE [HASH(d_date,ss_item_sk)]
|
||||
| mem-estimate=15.62MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=22,21 row-size=40B cardinality=8.64G cost=2867594490
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=3.07GB mem-reservation=44.00MB thread-reservation=1
|
||||
max-parallelism=5300 segment-costs=[52911827115, 12537410622, 39798997768] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
11:ANALYTIC
|
||||
| functions: sum(sum(ss_sales_price))
|
||||
| partition by: ss_item_sk
|
||||
| order by: d_date ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22,21 row-size=40B cardinality=8.64G cost=8639935488
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
10:SORT
|
||||
| order by: ss_item_sk ASC NULLS LAST, d_date ASC
|
||||
| mem-estimate=1.61GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22 row-size=24B cardinality=8.64G cost=12537410622
|
||||
| in pipelines: 10(GETNEXT), 19(OPEN)
|
||||
|
|
||||
19:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: ss_item_sk, d_date
|
||||
| mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=50998081470
|
||||
| in pipelines: 19(GETNEXT), 06(OPEN)
|
||||
|
|
||||
18:EXCHANGE [HASH(ss_item_sk)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=1913745645
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[56515544083, 17805178445] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_item_sk, d_date
|
||||
| mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=50998081470
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,6 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.35MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=101.61KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[17122]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | input scan node ids: 7
|
||||
| | estimated serialized size: 114.14KB
|
||||
| | estimated serialized size per node: 114.14KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 315
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=7.30K cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=12B cardinality=7.30K cost=16728
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
predicates: ss_item_sk IS NOT NULL
|
||||
runtime filters: RF000[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
parquet dictionary predicates: ss_item_sk IS NOT NULL
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=12B cardinality=8.64G cost=1735762980
|
||||
in pipelines: 06(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=2.48GB Threads=87
|
||||
Per-Host Resource Estimates: Memory=132.31GB
|
||||
F08:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.73MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[639] cpu-comparison-result=240 [max(1 (self) vs 240 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: item_sk, d_date, web_sales, store_sales, web_cumulative, store_cumulative
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: item_sk ASC, d_date ASC
|
||||
| limit: 100
|
||||
| mem-estimate=742.89KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=72B cardinality=100 cost=39
|
||||
| in pipelines: 16(GETNEXT)
|
||||
|
|
||||
F07:PLAN FRAGMENT [HASH(CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END)] hosts=10 instances=100 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=5.02GB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=27882060 segment-costs=[231945815232544, 278820518032917, 220] cpu-comparison-result=240 [max(220 (self) vs 240 (sum children))]
|
||||
16:TOP-N [LIMIT=100]
|
||||
| order by: item_sk ASC, d_date ASC
|
||||
| mem-estimate=7.03KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=72B cardinality=100 cost=123381692167701
|
||||
| in pipelines: 16(GETNEXT), 13(OPEN)
|
||||
|
|
||||
15:SELECT
|
||||
| predicates: max(web_sales) > max(store_sales)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=5.18T cost=51812941955072
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
14:ANALYTIC
|
||||
| functions: max(sum(sum(ws_sales_price))), max(sum(sum(ss_sales_price)))
|
||||
| partition by: item_sk
|
||||
| order by: CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=112B cardinality=51.81T cost=103625883910144
|
||||
| in pipelines: 13(GETNEXT)
|
||||
|
|
||||
13:SORT
|
||||
| order by: CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END ASC NULLS LAST, CASE WHEN d_date IS NOT NULL THEN d_date ELSE d_date END ASC
|
||||
| mem-estimate=5.00GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25 row-size=80B cardinality=51.81T cost=201402086378006
|
||||
| in pipelines: 13(GETNEXT), 10(OPEN)
|
||||
|
|
||||
25:EXCHANGE [HASH(CASE WHEN ws_item_sk IS NOT NULL THEN ws_item_sk ELSE ss_item_sk END)]
|
||||
| mem-estimate=21.25MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=22N,21N,17N,16N row-size=80B cardinality=51.81T cost=30543728854538
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=53.12MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=38311000 segment-costs=[383109971185632]
|
||||
12:HASH JOIN [FULL OUTER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: d_date = d_date, ss_item_sk = ws_item_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22N,21N,17N,16N row-size=80B cardinality=51.81T cost=9390721094085
|
||||
| in pipelines: 10(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=1.09GB mem-reservation=34.00MB thread-reservation=1
|
||||
| | max-parallelism=38311000 segment-costs=[2876861335] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date, ws_item_sk
|
||||
| | mem-estimate=1.07GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=2159967967
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(d_date,ws_item_sk)]
|
||||
| | mem-estimate=15.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=17,16 row-size=40B cardinality=2.16G cost=716893368
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ws_item_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=980.97MB mem-reservation=44.00MB thread-reservation=1
|
||||
| max-parallelism=1330 segment-costs=[13227859826, 3134329462, 9949676476] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
| 05:ANALYTIC
|
||||
| | functions: sum(sum(ws_sales_price))
|
||||
| | partition by: ws_item_sk
|
||||
| | order by: d_date ASC
|
||||
| | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17,16 row-size=40B cardinality=2.16G cost=2159968000
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SORT
|
||||
| | order by: ws_item_sk ASC NULLS LAST, d_date ASC
|
||||
| | mem-estimate=411.98MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=17 row-size=24B cardinality=2.16G cost=3134329462
|
||||
| | in pipelines: 04(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| 22:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(ws_sales_price)
|
||||
| | group by: ws_item_sk, d_date
|
||||
| | mem-estimate=564.99MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=12749426922
|
||||
| | in pipelines: 22(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 21:EXCHANGE [HASH(ws_item_sk)]
|
||||
| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=478432904
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=492.60MB mem-reservation=34.12MB thread-reservation=1
|
||||
| max-parallelism=1420 segment-costs=[14128782465, 4451261986] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 03:AGGREGATE [STREAMING]
|
||||
| | output: sum(ws_sales_price)
|
||||
| | group by: ws_item_sk, d_date
|
||||
| | mem-estimate=463.48MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=2.16G cost=12749426922
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,1 row-size=24B cardinality=2.16G cost=945417979
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.35MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 20:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=101.61KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=5.00MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[17122]
|
||||
| | 28:TUPLE CACHE
|
||||
| | | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 114.14KB
|
||||
| | | estimated serialized size per node: 114.14KB
|
||||
| | | cumulative processing cost: 16728
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 315
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=7.30K cost=16728
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| predicates: ws_item_sk IS NOT NULL
|
||||
| runtime filters: RF002[bloom] -> ws_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| parquet dictionary predicates: ws_item_sk IS NOT NULL
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=2.16G cost=433937564
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
23:EXCHANGE [HASH(d_date,ss_item_sk)]
|
||||
| mem-estimate=15.62MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=22,21 row-size=40B cardinality=8.64G cost=2867594490
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=3.07GB mem-reservation=44.00MB thread-reservation=1
|
||||
max-parallelism=5300 segment-costs=[52911827115, 12537410622, 39798997768] cpu-comparison-result=120 [max(120 (self) vs 120 (sum children))]
|
||||
11:ANALYTIC
|
||||
| functions: sum(sum(ss_sales_price))
|
||||
| partition by: ss_item_sk
|
||||
| order by: d_date ASC
|
||||
| window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22,21 row-size=40B cardinality=8.64G cost=8639935488
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
10:SORT
|
||||
| order by: ss_item_sk ASC NULLS LAST, d_date ASC
|
||||
| mem-estimate=1.61GB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=22 row-size=24B cardinality=8.64G cost=12537410622
|
||||
| in pipelines: 10(GETNEXT), 19(OPEN)
|
||||
|
|
||||
19:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: ss_item_sk, d_date
|
||||
| mem-estimate=1.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=50998081470
|
||||
| in pipelines: 19(GETNEXT), 06(OPEN)
|
||||
|
|
||||
18:EXCHANGE [HASH(ss_item_sk)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=1913745645
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[56515544083, 17805178445] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_item_sk, d_date
|
||||
| mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=24B cardinality=8.64G cost=50998081470
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5,6 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.35MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=101.61KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[17122]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: be3c32a328dea0fe268011e8f770083f
|
||||
| | input scan node ids: 7
|
||||
| | estimated serialized size: 114.14KB
|
||||
| | estimated serialized size per node: 114.14KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 315
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=12B cardinality=7.30K cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1187 AS INT), d_month_seq >= CAST(1176 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=12B cardinality=7.30K cost=16728
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
predicates: ss_item_sk IS NOT NULL
|
||||
runtime filters: RF000[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
parquet dictionary predicates: ss_item_sk IS NOT NULL
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=5 row-size=12B cardinality=8.64G cost=1735762980
|
||||
in pipelines: 06(GETNEXT)
|
||||
====
|
||||
573
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q52.test
vendored
Normal file
573
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q52.test
vendored
Normal file
@@ -0,0 +1,573 @@
|
||||
# TPCDS-Q52
|
||||
# start query 52 in stream 0 using template query52.tpl using seed 1428437436
|
||||
select dt.d_year
|
||||
,item.i_brand_id brand_id
|
||||
,item.i_brand brand
|
||||
,sum(ss_ext_sales_price) ext_price
|
||||
from date_dim dt
|
||||
,store_sales
|
||||
,item
|
||||
where dt.d_date_sk = store_sales.ss_sold_date_sk
|
||||
and store_sales.ss_item_sk = item.i_item_sk
|
||||
and item.i_manager_id = 1
|
||||
and dt.d_moy=11
|
||||
and dt.d_year=2001
|
||||
group by dt.d_year
|
||||
,item.i_brand
|
||||
,item.i_brand_id
|
||||
order by dt.d_year
|
||||
,ext_price desc
|
||||
,brand_id
|
||||
limit 100 ;
|
||||
|
||||
# end query 52 in stream 0 using template query52.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=63.88MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=353MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=353.08MB mem-reservation=63.88MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[116627028, 3746309, 400]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_ext_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 10c5ca8a38e47a53f7f3b16ab1e5f476
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 19.28MB
|
||||
| estimated serialized size per node: 1.93MB
|
||||
| cumulative processing cost: 116627028
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 54586
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=360.00K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=315.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=360.00K cost=8708996
|
||||
| in pipelines: 05(GETNEXT), 01(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: b96b81dcfa8f38083e6850760e93c7cc
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 374.16MB
|
||||
| estimated serialized size per node: 37.42MB
|
||||
| cumulative processing cost: 107918032
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1059310
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254938
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: 49aaa4185737ff03dfcfbb09e2a77552
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: 1d3411a481a36f3a8e1ef54656448804
|
||||
| input scan node ids: 1,2
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105646366
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17090094
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: ebb73c2092dbee24be2906ee3eb14b3a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:TUPLE CACHE
|
||||
| cache key: 3e031eb73831a1ef2a1dcd7a6a53a2ac
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=132.75MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=196MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.05MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: dt.d_year ASC, sum(ss_ext_sales_price) DESC, item.i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=55.35KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=35
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_brand,item.i_brand_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=45.10MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[10008192, 3746309, 168] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_ext_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=360.00K cost=8303439
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_brand,item.i_brand_id)]
|
||||
| mem-estimate=11.10MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=1704753
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=47.19MB mem-reservation=37.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[136812420, 18814915] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
16:TUPLE CACHE
|
||||
| cache key: 20cd33c9c0769f79dcd0a2812a2205b2
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 260.10MB
|
||||
| estimated serialized size per node: 26.01MB
|
||||
| cumulative processing cost: 136994412
|
||||
| cache read processing cost: 645415
|
||||
| cache write processing cost: 736374
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=29070944
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 49aaa4185737ff03dfcfbb09e2a77552
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 2dc817123628d9a67a335c66d5f6f7d6
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105651657
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.19MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=318.88KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156564]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: ebb73c2092dbee24be2906ee3eb14b3a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: b8856e5ac2a0d6a9eee21af1b5fa2353
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=132.75MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=196MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.05MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: dt.d_year, item.i_brand_id, item.i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: dt.d_year ASC, sum(ss_ext_sales_price) DESC, item.i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=55.35KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=35
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(dt.d_year,item.i_brand,item.i_brand_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=45.10MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[10008192, 3746309, 168] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: dt.d_year ASC, sum(ss_ext_sales_price) DESC, item.i_brand_id ASC
|
||||
| mem-estimate=5.09KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=52B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=360.00K cost=8303439
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(dt.d_year,item.i_brand,item.i_brand_id)]
|
||||
| mem-estimate=11.10MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=1704753
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=47.19MB mem-reservation=37.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[136812420, 18814915] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
16:TUPLE CACHE
|
||||
| cache key: 20cd33c9c0769f79dcd0a2812a2205b2
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 260.10MB
|
||||
| estimated serialized size per node: 26.01MB
|
||||
| cumulative processing cost: 136994412
|
||||
| cache read processing cost: 645415
|
||||
| cache write processing cost: 736374
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: dt.d_year, item.i_brand, item.i_brand_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=52B cardinality=4.86M cost=29070944
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = dt.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: dt.d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- dt.d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 49aaa4185737ff03dfcfbb09e2a77552
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim dt, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: dt.d_year = CAST(2001 AS INT), dt.d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 2dc817123628d9a67a335c66d5f6f7d6
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105651657
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: store_sales.ss_item_sk = item.i_item_sk
|
||||
| fk/pk conjuncts: store_sales.ss_item_sk = item.i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.19MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: item.i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- item.i_item_sk, RF003[min_max] <- item.i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=318.88KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156564]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: ebb73c2092dbee24be2906ee3eb14b3a
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| parquet dictionary predicates: item.i_manager_id = CAST(1 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: b8856e5ac2a0d6a9eee21af1b5fa2353
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> store_sales.ss_item_sk, RF000[bloom] -> store_sales.ss_sold_date_sk, RF002[bloom] -> store_sales.ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
779
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q53.test
vendored
Normal file
779
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q53.test
vendored
Normal file
@@ -0,0 +1,779 @@
|
||||
# TPCDS-Q53
|
||||
# start query 53 in stream 0 using template query53.tpl using seed 1028297039
|
||||
select * from
|
||||
(select i_manufact_id,
|
||||
sum(ss_sales_price) sum_sales,
|
||||
avg(sum(ss_sales_price)) over (partition by i_manufact_id) avg_quarterly_sales
|
||||
from item, store_sales, date_dim, store
|
||||
where ss_item_sk = i_item_sk and
|
||||
ss_sold_date_sk = d_date_sk and
|
||||
ss_store_sk = s_store_sk and
|
||||
d_month_seq in (1218,1218+1,1218+2,1218+3,1218+4,1218+5,1218+6,1218+7,1218+8,1218+9,1218+10,1218+11) and
|
||||
((i_category in ('Books','Children','Electronics') and
|
||||
i_class in ('personal','portable','reference','self-help') and
|
||||
i_brand in ('scholaramalgamalg #14','scholaramalgamalg #7',
|
||||
'exportiunivamalg #9','scholaramalgamalg #9'))
|
||||
or(i_category in ('Women','Music','Men') and
|
||||
i_class in ('accessories','classical','fragrances','pants') and
|
||||
i_brand in ('amalgimporto #1','edu packscholar #1','exportiimporto #1',
|
||||
'importoamalg #1')))
|
||||
group by i_manufact_id, d_qoy ) tmp1
|
||||
where case when avg_quarterly_sales > 0
|
||||
then abs (sum_sales - avg_quarterly_sales)/ avg_quarterly_sales
|
||||
else null end > 0.1
|
||||
order by avg_quarterly_sales,
|
||||
sum_sales,
|
||||
i_manufact_id
|
||||
limit 100;
|
||||
|
||||
# end query 53 in stream 0 using template query53.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=49.83MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=105MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=104.81MB mem-reservation=49.83MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[396142727, 5554, 9508, 300]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manufact_id, sum_sales, avg_quarterly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: avg_quarterly_sales ASC, sum_sales ASC, i_manufact_id ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=1852
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=383 cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manufact_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=3.83K cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manufact_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=3.83K cost=5554
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
18:TUPLE CACHE
|
||||
| cache key: 65544ff1fa016e9a338731eef5a06b03
|
||||
| input scan node ids: 1,0,2,3
|
||||
| estimated serialized size: 104.67KB
|
||||
| estimated serialized size per node: 10.47KB
|
||||
| cumulative processing cost: 396142727
|
||||
| cache read processing cost: 508
|
||||
| cache write processing cost: 289
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=3.83K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manufact_id, d_qoy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=3.83K cost=350965
|
||||
| in pipelines: 07(GETNEXT), 01(OPEN)
|
||||
|
|
||||
17:TUPLE CACHE
|
||||
| cache key: abe20f1a42a080eb4cbf6a4eb92efa47
|
||||
| input scan node ids: 1,0,2,3
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395791762
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=107623
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 4ea01b0fbf666baede836115d7037a03
|
||||
| input scan node ids: 1,0,2
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684062
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106635
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 25e00a07d681874e17f2745c9fc2cedc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 01bbf48fb46a3039a105a37a77aae4a6
|
||||
| input scan node ids: 1,0
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562752
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=284005
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--13:TUPLE CACHE
|
||||
| | cache key: 31104f063112b85e9a9528b64a7f1883
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 5a79279fcc146caff1ee06e84f2d1f9e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=174.20MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=298MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[332] cpu-comparison-result=40 [max(1 (self) vs 40 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manufact_id, sum_sales, avg_quarterly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: avg_quarterly_sales ASC, sum_sales ASC, i_manufact_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=39.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=32
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_manufact_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=20.00MB mem-reservation=11.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[318520, 5554, 9508, 125] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: avg_quarterly_sales ASC, sum_sales ASC, i_manufact_id ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=1852
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=383 cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manufact_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=3.83K cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manufact_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=3.83K cost=5554
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: i_manufact_id, d_qoy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=3.83K cost=276710
|
||||
| in pipelines: 16(GETNEXT), 01(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_manufact_id)]
|
||||
| mem-estimate=1.53MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=41810
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=47.09MB mem-reservation=30.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[396757334, 388996] cpu-comparison-result=40 [max(40 (self) vs 36 (sum children))]
|
||||
24:TUPLE CACHE
|
||||
| cache key: 9409d1dfcc6f32cd98dafa99a31c1597
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 5.04MB
|
||||
| estimated serialized size per node: 516.14KB
|
||||
| cumulative processing cost: 396982594
|
||||
| cache read processing cost: 25086
|
||||
| cache write processing cost: 14270
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manufact_id, d_qoy
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=1188429
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: ddb6f3c8db0725d5d328a51bdf5b6289
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395794165
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[120]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
22:TUPLE CACHE
|
||||
| cache key: c4ec22f471fe5f51267036be422e2e62
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684632
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[842]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=362
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=480
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14694]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 25e00a07d681874e17f2745c9fc2cedc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
20:TUPLE CACHE
|
||||
| cache key: f9e96b23e412de1ba34df8e7a04a4bb5
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562823
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=283954
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[111]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=51
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=19.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=60
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.30MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[206353]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 31104f063112b85e9a9528b64a7f1883
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
18:TUPLE CACHE
|
||||
| cache key: b84efdddac354c2ecf3ec258fa923a23
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=174.20MB Threads=12
|
||||
Per-Host Resource Estimates: Memory=298MB
|
||||
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[332] cpu-comparison-result=40 [max(1 (self) vs 40 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manufact_id, sum_sales, avg_quarterly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: avg_quarterly_sales ASC, sum_sales ASC, i_manufact_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=39.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=32
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_manufact_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=20.00MB mem-reservation=11.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[318520, 5554, 9508, 125] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: avg_quarterly_sales ASC, sum_sales ASC, i_manufact_id ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=1852
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=383 cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manufact_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=3.83K cost=3828
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manufact_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=3.83K cost=5554
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: i_manufact_id, d_qoy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=3.83K cost=276710
|
||||
| in pipelines: 16(GETNEXT), 01(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_manufact_id)]
|
||||
| mem-estimate=1.53MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=41810
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=47.09MB mem-reservation=30.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[396757334, 388996] cpu-comparison-result=40 [max(40 (self) vs 36 (sum children))]
|
||||
24:TUPLE CACHE
|
||||
| cache key: 9409d1dfcc6f32cd98dafa99a31c1597
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 5.04MB
|
||||
| estimated serialized size per node: 516.14KB
|
||||
| cumulative processing cost: 396982594
|
||||
| cache read processing cost: 25086
|
||||
| cache write processing cost: 14270
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manufact_id, d_qoy
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=188.76K cost=1188429
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: ddb6f3c8db0725d5d328a51bdf5b6289
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395794165
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[120]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
22:TUPLE CACHE
|
||||
| cache key: c4ec22f471fe5f51267036be422e2e62
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684632
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[842]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=362
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=480
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14694]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 25e00a07d681874e17f2745c9fc2cedc
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1218 AS INT), CAST(1219 AS INT), CAST(1220 AS INT), CAST(1221 AS INT), CAST(1222 AS INT), CAST(1223 AS INT), CAST(1224 AS INT), CAST(1225 AS INT), CAST(1226 AS INT), CAST(1227 AS INT), CAST(1228 AS INT), CAST(1229 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
20:TUPLE CACHE
|
||||
| cache key: f9e96b23e412de1ba34df8e7a04a4bb5
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562823
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=283954
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[111]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=51
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=19.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=60
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.30MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[206353]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 31104f063112b85e9a9528b64a7f1883
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
18:TUPLE CACHE
|
||||
| cache key: b84efdddac354c2ecf3ec258fa923a23
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
1712
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q54.test
vendored
Normal file
1712
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q54.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
589
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q55.test
vendored
Normal file
589
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q55.test
vendored
Normal file
@@ -0,0 +1,589 @@
|
||||
# TPCDS-Q55
|
||||
# start query 55 in stream 0 using template query55.tpl using seed 1190237383
|
||||
select i_brand_id brand_id, i_brand brand,
|
||||
sum(ss_ext_sales_price) ext_price
|
||||
from date_dim, store_sales, item
|
||||
where d_date_sk = ss_sold_date_sk
|
||||
and ss_item_sk = i_item_sk
|
||||
and i_manager_id=87
|
||||
and d_moy=11
|
||||
and d_year=2001
|
||||
group by i_brand, i_brand_id
|
||||
order by ext_price desc, i_brand_id
|
||||
limit 100 ;
|
||||
|
||||
# end query 55 in stream 0 using template query55.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=63.88MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=78MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=77.88MB mem-reservation=63.88MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| max-parallelism=1 segment-costs=[116627028, 3746309, 300]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand_id ASC
|
||||
| mem-estimate=4.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 1f3cae6ecdefec7b53a33124f924d488
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 17.91MB
|
||||
| estimated serialized size per node: 1.79MB
|
||||
| cumulative processing cost: 116627028
|
||||
| cache read processing cost: 47844
|
||||
| cache write processing cost: 50698
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=360.00K cost=0
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id
|
||||
| mem-estimate=36.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=360.00K cost=8708996
|
||||
| in pipelines: 05(GETNEXT), 01(OPEN)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: 610168ff63136604907d61b207e2d85e
|
||||
| input scan node ids: 1,2,0
|
||||
| estimated serialized size: 374.16MB
|
||||
| estimated serialized size per node: 37.42MB
|
||||
| cumulative processing cost: 107918032
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1059310
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254938
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--10:TUPLE CACHE
|
||||
| | cache key: 0cbe26945ee02340a1403ece8380f126
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:TUPLE CACHE
|
||||
| cache key: c70dfd6fb246e820f7e02b52c905e51d
|
||||
| input scan node ids: 1,2
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105646366
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17090094
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--08:TUPLE CACHE
|
||||
| | cache key: ef336887c2d5f190bde865b3097d2103
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(87 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(87 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(87 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
07:TUPLE CACHE
|
||||
| cache key: d129f74a8046665284242219322f4070
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=111.50MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=179MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.05MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[334] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=51.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=100 cost=34
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_brand,i_brand_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=21.02MB mem-reservation=4.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[9918834, 3746309, 157] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand_id ASC
|
||||
| mem-estimate=4.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id
|
||||
| mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=360.00K cost=8303439
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(i_brand,i_brand_id)]
|
||||
| mem-estimate=11.02MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=1615395
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=51.04MB mem-reservation=41.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[136812420, 17563907] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
17:TUPLE CACHE
|
||||
| cache key: 614ebd677cafdcff127d45cad13d9b58
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 241.57MB
|
||||
| estimated serialized size per node: 24.16MB
|
||||
| cumulative processing cost: 136994412
|
||||
| cache read processing cost: 645415
|
||||
| cache write processing cost: 683925
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=29070944
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 269db3d48419e1eca4c6d61caf2f09bd
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 374.16MB
|
||||
| estimated serialized size per node: 37.42MB
|
||||
| cumulative processing cost: 107923468
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1059310
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 0cbe26945ee02340a1403ece8380f126
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 70c7506672c52f5ad2823b49abcac1a3
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105651657
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.19MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=318.88KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156564]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: ef336887c2d5f190bde865b3097d2103
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(87 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(87 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(87 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 8360fac80370740bdf85d16e1c026062
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=111.50MB Threads=8
|
||||
Per-Host Resource Estimates: Memory=179MB
|
||||
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.05MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[334] cpu-comparison-result=25 [max(1 (self) vs 25 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_brand_id, i_brand, sum(ss_ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
11:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand_id ASC
|
||||
| limit: 100
|
||||
| mem-estimate=51.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=100 cost=34
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
F03:PLAN FRAGMENT [HASH(i_brand,i_brand_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=21.02MB mem-reservation=4.75MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[9918834, 3746309, 157] cpu-comparison-result=25 [max(10 (self) vs 25 (sum children))]
|
||||
06:TOP-N [LIMIT=100]
|
||||
| order by: sum(ss_ext_sales_price) DESC, i_brand_id ASC
|
||||
| mem-estimate=4.70KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=100 cost=3746309
|
||||
| in pipelines: 06(GETNEXT), 10(OPEN)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id
|
||||
| mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=360.00K cost=8303439
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
09:EXCHANGE [HASH(i_brand,i_brand_id)]
|
||||
| mem-estimate=11.02MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=1615395
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=51.04MB mem-reservation=41.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[136812420, 17563907] cpu-comparison-result=25 [max(20 (self) vs 25 (sum children))]
|
||||
17:TUPLE CACHE
|
||||
| cache key: 614ebd677cafdcff127d45cad13d9b58
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 241.57MB
|
||||
| estimated serialized size per node: 24.16MB
|
||||
| cumulative processing cost: 136994412
|
||||
| cache read processing cost: 645415
|
||||
| cache write processing cost: 683925
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price)
|
||||
| group by: i_brand, i_brand_id
|
||||
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
|
||||
| tuple-ids=3 row-size=48B cardinality=4.86M cost=29070944
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 269db3d48419e1eca4c6d61caf2f09bd
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 374.16MB
|
||||
| estimated serialized size per node: 37.42MB
|
||||
| cumulative processing cost: 107923468
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 1059310
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2,0 row-size=64B cardinality=5.15M cost=2254830
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[248]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=108
|
||||
| |
|
||||
| 08:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=140
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16733]
|
||||
| 15:TUPLE CACHE
|
||||
| | cache key: 0cbe26945ee02340a1403ece8380f126
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 1.69KB
|
||||
| | estimated serialized size per node: 1.69KB
|
||||
| | cumulative processing cost: 16728
|
||||
| | cache read processing cost: 14
|
||||
| | cache write processing cost: 4
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=12B cardinality=108 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| parquet dictionary predicates: d_year = CAST(2001 AS INT), d_moy = CAST(11 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=12B cardinality=108 cost=16728
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 70c7506672c52f5ad2823b49abcac1a3
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 295.56MB
|
||||
| estimated serialized size per node: 29.56MB
|
||||
| cumulative processing cost: 105651657
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 836764
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
03:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,2 row-size=52B cardinality=5.15M(filtered from 87.00M) cost=17086467
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=5.19MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[8447]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=3627
|
||||
| |
|
||||
| 07:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=318.88KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=4820
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.17MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[156564]
|
||||
| 13:TUPLE CACHE
|
||||
| | cache key: ef336887c2d5f190bde865b3097d2103
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 156.41KB
|
||||
| | estimated serialized size per node: 39.10KB
|
||||
| | cumulative processing cost: 156093
|
||||
| | cache read processing cost: 482
|
||||
| | cache write processing cost: 432
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=40B cardinality=3.63K cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: i_manager_id = CAST(87 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| parquet statistics predicates: i_manager_id = CAST(87 AS INT)
|
||||
| parquet dictionary predicates: i_manager_id = CAST(87 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=40B cardinality=3.63K cost=156093
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: 8360fac80370740bdf85d16e1c026062
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 78.61MB
|
||||
| estimated serialized size per node: 7.86MB
|
||||
| cumulative processing cost: 88400179
|
||||
| cache read processing cost: 684640
|
||||
| cache write processing cost: 222546
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=109(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=12B cardinality=5.15M(filtered from 8.64G) cost=88400179
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
2179
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q56.test
vendored
Normal file
2179
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q56.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1618
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q57.test
vendored
Normal file
1618
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q57.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1702
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q58.test
vendored
Normal file
1702
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q58.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
995
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q59.test
vendored
Normal file
995
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q59.test
vendored
Normal file
@@ -0,0 +1,995 @@
|
||||
# TPCDS-Q59
|
||||
# start query 59 in stream 0 using template query59.tpl using seed 307347183
|
||||
with wss as
|
||||
(select d_week_seq,
|
||||
ss_store_sk,
|
||||
sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,
|
||||
sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,
|
||||
sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales,
|
||||
sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,
|
||||
sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,
|
||||
sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,
|
||||
sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales
|
||||
from store_sales,date_dim
|
||||
where d_date_sk = ss_sold_date_sk
|
||||
group by d_week_seq,ss_store_sk
|
||||
)
|
||||
select s_store_name1,s_store_id1,d_week_seq1
|
||||
,sun_sales1/sun_sales2,mon_sales1/mon_sales2
|
||||
,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2
|
||||
,fri_sales1/fri_sales2,sat_sales1/sat_sales2
|
||||
from
|
||||
(select s_store_name s_store_name1,wss.d_week_seq d_week_seq1
|
||||
,s_store_id s_store_id1,sun_sales sun_sales1
|
||||
,mon_sales mon_sales1,tue_sales tue_sales1
|
||||
,wed_sales wed_sales1,thu_sales thu_sales1
|
||||
,fri_sales fri_sales1,sat_sales sat_sales1
|
||||
from wss,store,date_dim d
|
||||
where d.d_week_seq = wss.d_week_seq and
|
||||
ss_store_sk = s_store_sk and
|
||||
d_month_seq between 1199 and 1199 + 11) y,
|
||||
(select s_store_name s_store_name2,wss.d_week_seq d_week_seq2
|
||||
,s_store_id s_store_id2,sun_sales sun_sales2
|
||||
,mon_sales mon_sales2,tue_sales tue_sales2
|
||||
,wed_sales wed_sales2,thu_sales thu_sales2
|
||||
,fri_sales fri_sales2,sat_sales sat_sales2
|
||||
from wss,store,date_dim d
|
||||
where d.d_week_seq = wss.d_week_seq and
|
||||
ss_store_sk = s_store_sk and
|
||||
d_month_seq between 1199+ 12 and 1199 + 23) x
|
||||
where s_store_id1=s_store_id2
|
||||
and d_week_seq1=d_week_seq2-52
|
||||
order by s_store_name1,s_store_id1,d_week_seq1
|
||||
limit 100;
|
||||
|
||||
# end query 59 in stream 0 using template query59.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=139.02MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=2.23GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=2.23GB mem-reservation=139.02MB thread-reservation=1 runtime-filters-memory=8.00MB
|
||||
| max-parallelism=1 segment-costs=[20807146710, 20807146710, 667717443159, 1000]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name1, s_store_id1, d_week_seq1, sun_sales1 / sun_sales2, mon_sales1 / mon_sales2, tue_sales1 / tue_sales2, wed_sales1 / wed_sales2, thu_sales1 / thu_sales2, fri_sales1 / fri_sales2, sat_sales1 / sat_sales2
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC
|
||||
| mem-estimate=26.56KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=272B cardinality=100 cost=661620652546
|
||||
| in pipelines: 17(GETNEXT), 03(OPEN)
|
||||
|
|
||||
16:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: d_week_seq = d_week_seq - 52, s_store_id = s_store_id
|
||||
| fk/pk conjuncts: none
|
||||
| runtime filters: RF000[bloom] <- d_week_seq - 52, RF001[bloom] <- s_store_id, RF002[min_max] <- d_week_seq - 52, RF003[min_max] <- s_store_id
|
||||
| mem-estimate=823.87MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,5,4,9,12,11 row-size=336B cardinality=33.56G cost=6087277948
|
||||
| in pipelines: 03(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--15:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ss_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| | runtime filters: RF010[bloom] <- s_store_sk, RF011[min_max] <- s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12,11 row-size=160B cardinality=4.77M cost=2089251
|
||||
| | in pipelines: 11(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=32B cardinality=1.35K cost=388
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: d_week_seq = d.d_week_seq
|
||||
| | fk/pk conjuncts: none
|
||||
| | runtime filters: RF012[bloom] <- d.d_week_seq, RF013[min_max] <- d.d_week_seq
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12 row-size=128B cardinality=4.77M cost=2654135
|
||||
| | in pipelines: 11(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--20:TUPLE CACHE
|
||||
| | | cache key: 402442a03d759d1bd84365462b54686e
|
||||
| | | input scan node ids: 13
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=12 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=12 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 11:AGGREGATE [FINALIZE]
|
||||
| | output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| | group by: d_week_seq, ss_store_sk
|
||||
| | mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=6.95M cost=15532377299
|
||||
| | in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 10:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF014[bloom] <- d_date_sk
|
||||
| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=7,8 row-size=39B cardinality=8.64G cost=3781772682
|
||||
| | in pipelines: 08(GETNEXT), 09(OPEN)
|
||||
| |
|
||||
| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | runtime filters: RF013[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF012[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=27B cardinality=73.05K cost=15928
|
||||
| | in pipelines: 09(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF014[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=12B cardinality=8.64G cost=1492980801
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5,4 row-size=176B cardinality=4.77M cost=2089251
|
||||
| in pipelines: 03(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF003[min_max] -> s_store_id, RF001[bloom] -> s_store_id
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=1.35K cost=465
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
19:TUPLE CACHE
|
||||
| cache key: 83e869094a18f192eab72ff64c126024
|
||||
| input scan node ids: 0,1,5
|
||||
| estimated serialized size: 618.69MB
|
||||
| estimated serialized size per node: 61.87MB
|
||||
| cumulative processing cost: 20809813365
|
||||
| cache read processing cost: 633954
|
||||
| cache write processing cost: 1751604
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2,5 row-size=128B cardinality=4.77M cost=0
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: d_week_seq = d.d_week_seq
|
||||
| fk/pk conjuncts: none
|
||||
| runtime filters: RF006[bloom] <- d.d_week_seq, RF007[min_max] <- d.d_week_seq
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5 row-size=128B cardinality=4.77M cost=2654135
|
||||
| in pipelines: 03(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--18:TUPLE CACHE
|
||||
| | cache key: 50da4941871b4a379e5f6d8a59811a21
|
||||
| | input scan node ids: 5
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| runtime filters: RF002[min_max] -> d.d_week_seq, RF000[bloom] -> d.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
03:AGGREGATE [FINALIZE]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: d_week_seq, ss_store_sk
|
||||
| mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=6.95M cost=15532377299
|
||||
| in pipelines: 03(GETNEXT), 00(OPEN)
|
||||
|
|
||||
02:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF008[bloom] <- d_date_sk
|
||||
| mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=39B cardinality=8.64G cost=3781772682
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=27B cardinality=73.05K cost=15928
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF008[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=8.64G cost=1492980801
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.53GB Threads=85
|
||||
Per-Host Resource Estimates: Memory=21.38GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=7.16MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1079] cpu-comparison-result=284 [max(1 (self) vs 284 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name1, s_store_id1, d_week_seq1, sun_sales1 / sun_sales2, mon_sales1 / mon_sales2, tue_sales1 / tue_sales2, wed_sales1 / wed_sales2, thu_sales1 / thu_sales2, fri_sales1 / fri_sales2, sat_sales1 / sat_sales2
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
30:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC
|
||||
| limit: 100
|
||||
| mem-estimate=3.16MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=272B cardinality=100 cost=79
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(d_week_seq,s_store_id)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=32.05MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=66780 segment-costs=[667707901963, 743] cpu-comparison-result=284 [max(120 (self) vs 284 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC
|
||||
| mem-estimate=26.56KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=272B cardinality=100 cost=661620652546
|
||||
| in pipelines: 17(GETNEXT), 20(OPEN)
|
||||
|
|
||||
16:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: d_week_seq = d_week_seq - 52, s_store_id = s_store_id
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=2,5,4,9,12,11 row-size=336B cardinality=33.56G cost=6082507783
|
||||
| in pipelines: 20(GETNEXT), 25(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(d_week_seq,s_store_id)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=40.66MB mem-reservation=10.50MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| | max-parallelism=66780 segment-costs=[9162055] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_week_seq - 52, s_store_id
|
||||
| | runtime filters: RF000[bloom] <- d_week_seq - 52, RF001[bloom] <- s_store_id, RF002[min_max] <- d_week_seq - 52, RF003[min_max] <- s_store_id
|
||||
| | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=4770165
|
||||
| |
|
||||
| 29:EXCHANGE [HASH(d_week_seq - 52,s_store_id)]
|
||||
| | mem-estimate=30.16MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9,12,11 row-size=160B cardinality=4.77M cost=4391890
|
||||
| | in pipelines: 25(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=90.62MB mem-reservation=8.50MB thread-reservation=1
|
||||
| max-parallelism=210 segment-costs=[2080481569, 61259278] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
| 15:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ss_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12,11 row-size=160B cardinality=4.77M cost=2087901
|
||||
| | in pipelines: 25(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--F13:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[3140]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: s_store_sk
|
||||
| | | runtime filters: RF010[bloom] <- s_store_sk, RF011[min_max] <- s_store_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| | |
|
||||
| | 27:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=78.19KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=11 row-size=32B cardinality=1.35K cost=1790
|
||||
| | | in pipelines: 12(GETNEXT)
|
||||
| | |
|
||||
| | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=16.14MB mem-reservation=16.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[533]
|
||||
| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=32B cardinality=1.35K cost=388
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: d_week_seq = d.d_week_seq
|
||||
| | fk/pk conjuncts: none
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12 row-size=128B cardinality=4.77M cost=2646830
|
||||
| | in pipelines: 25(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--F14:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: d.d_week_seq
|
||||
| | | runtime filters: RF012[bloom] <- d.d_week_seq, RF013[min_max] <- d.d_week_seq
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 26:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=12 row-size=8B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12835]
|
||||
| | 31:TUPLE CACHE
|
||||
| | | cache key: 402442a03d759d1bd84365462b54686e
|
||||
| | | input scan node ids: 13
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=12 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=12 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 25:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| | group by: d_week_seq, ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=6.95M cost=1527535184
|
||||
| | in pipelines: 25(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(d_week_seq,ss_store_sk)]
|
||||
| | mem-estimate=24.53MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=833.88M cost=552946385
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=767.53MB mem-reservation=42.00MB thread-reservation=1
|
||||
| max-parallelism=1824 segment-costs=[24551817547, 6873846540] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 11:AGGREGATE [STREAMING]
|
||||
| | output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| | group by: d_week_seq, ss_store_sk
|
||||
| | mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=833.88M cost=19277137113
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=7,8 row-size=39B cardinality=8.64G cost=3781699633
|
||||
| | in pipelines: 08(GETNEXT), 09(OPEN)
|
||||
| |
|
||||
| |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=59.92MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[170129]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF014[bloom] <- d_date_sk
|
||||
| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 23:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=27B cardinality=73.05K cost=97080
|
||||
| | | in pipelines: 09(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[22859]
|
||||
| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | runtime filters: RF013[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF012[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=27B cardinality=73.05K cost=15928
|
||||
| | in pipelines: 09(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF014[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=12B cardinality=8.64G cost=1492980801
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
28:EXCHANGE [HASH(d_week_seq,s_store_id)]
|
||||
| mem-estimate=32.02MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=2,5,4 row-size=176B cardinality=4.77M cost=4741634
|
||||
| in pipelines: 20(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=98.10MB mem-reservation=8.50MB thread-reservation=1
|
||||
max-parallelism=210 segment-costs=[2080481569, 66155687] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5,4 row-size=176B cardinality=4.77M cost=2087901
|
||||
| in pipelines: 20(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.36MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 22:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=115.14KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=48B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.20MB mem-reservation=24.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[668]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF003[min_max] -> s_store_id, RF001[bloom] -> s_store_id
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=1.35K cost=465
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: d_week_seq = d.d_week_seq
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5 row-size=128B cardinality=4.77M cost=2646830
|
||||
| in pipelines: 20(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: d.d_week_seq
|
||||
| | runtime filters: RF006[bloom] <- d.d_week_seq, RF007[min_max] <- d.d_week_seq
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 21:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| runtime filters: RF002[min_max] -> d.d_week_seq, RF000[bloom] -> d.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
20:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: d_week_seq, ss_store_sk
|
||||
| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=6.95M cost=1527535184
|
||||
| in pipelines: 20(GETNEXT), 00(OPEN)
|
||||
|
|
||||
19:EXCHANGE [HASH(d_week_seq,ss_store_sk)]
|
||||
| mem-estimate=24.53MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=833.88M cost=552946385
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=767.53MB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[24551817547, 6873846540] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
03:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: d_week_seq, ss_store_sk
|
||||
| mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=833.88M cost=19277137113
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=06
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=39B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=59.92MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=06 plan-id=07 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=27B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[22859]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=27B cardinality=73.05K cost=15928
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF008[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=8.64G cost=1492980801
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.53GB Threads=85
|
||||
Per-Host Resource Estimates: Memory=21.38GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=7.16MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1079] cpu-comparison-result=284 [max(1 (self) vs 284 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name1, s_store_id1, d_week_seq1, sun_sales1 / sun_sales2, mon_sales1 / mon_sales2, tue_sales1 / tue_sales2, wed_sales1 / wed_sales2, thu_sales1 / thu_sales2, fri_sales1 / fri_sales2, sat_sales1 / sat_sales2
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
30:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC
|
||||
| limit: 100
|
||||
| mem-estimate=3.16MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=272B cardinality=100 cost=79
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(d_week_seq,s_store_id)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=32.05MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=66780 segment-costs=[667707901963, 743] cpu-comparison-result=284 [max(120 (self) vs 284 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC
|
||||
| mem-estimate=26.56KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=14 row-size=272B cardinality=100 cost=661620652546
|
||||
| in pipelines: 17(GETNEXT), 20(OPEN)
|
||||
|
|
||||
16:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: d_week_seq = d_week_seq - 52, s_store_id = s_store_id
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=2,5,4,9,12,11 row-size=336B cardinality=33.56G cost=6082507783
|
||||
| in pipelines: 20(GETNEXT), 25(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(d_week_seq,s_store_id)] hosts=10 instances=120
|
||||
| | Per-Instance Resources: mem-estimate=40.66MB mem-reservation=10.50MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| | max-parallelism=66780 segment-costs=[9162055] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_week_seq - 52, s_store_id
|
||||
| | runtime filters: RF000[bloom] <- d_week_seq - 52, RF001[bloom] <- s_store_id, RF002[min_max] <- d_week_seq - 52, RF003[min_max] <- s_store_id
|
||||
| | mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0 cost=4770165
|
||||
| |
|
||||
| 29:EXCHANGE [HASH(d_week_seq - 52,s_store_id)]
|
||||
| | mem-estimate=30.16MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9,12,11 row-size=160B cardinality=4.77M cost=4391890
|
||||
| | in pipelines: 25(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=120
|
||||
| Per-Instance Resources: mem-estimate=90.62MB mem-reservation=8.50MB thread-reservation=1
|
||||
| max-parallelism=210 segment-costs=[2080481569, 61259278] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
| 15:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ss_store_sk = s_store_sk
|
||||
| | fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12,11 row-size=160B cardinality=4.77M cost=2087901
|
||||
| | in pipelines: 25(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--F13:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[3140]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: s_store_sk
|
||||
| | | runtime filters: RF010[bloom] <- s_store_sk, RF011[min_max] <- s_store_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| | |
|
||||
| | 27:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=78.19KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=11 row-size=32B cardinality=1.35K cost=1790
|
||||
| | | in pipelines: 12(GETNEXT)
|
||||
| | |
|
||||
| | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=16.14MB mem-reservation=16.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[533]
|
||||
| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=11 row-size=32B cardinality=1.35K cost=388
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: d_week_seq = d.d_week_seq
|
||||
| | fk/pk conjuncts: none
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=9,12 row-size=128B cardinality=4.77M cost=2646830
|
||||
| | in pipelines: 25(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--F14:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: d.d_week_seq
|
||||
| | | runtime filters: RF012[bloom] <- d.d_week_seq, RF013[min_max] <- d.d_week_seq
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 26:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=12 row-size=8B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12835]
|
||||
| | 31:TUPLE CACHE
|
||||
| | | cache key: 402442a03d759d1bd84365462b54686e
|
||||
| | | input scan node ids: 13
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=12 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1222 AS INT), d_month_seq >= CAST(1211 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=12 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 25:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| | group by: d_week_seq, ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=6.95M cost=1527535184
|
||||
| | in pipelines: 25(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| 24:EXCHANGE [HASH(d_week_seq,ss_store_sk)]
|
||||
| | mem-estimate=24.53MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=833.88M cost=552946385
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=767.53MB mem-reservation=42.00MB thread-reservation=1
|
||||
| max-parallelism=1824 segment-costs=[24551817547, 6873846540] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 11:AGGREGATE [STREAMING]
|
||||
| | output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| | group by: d_week_seq, ss_store_sk
|
||||
| | mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=9 row-size=120B cardinality=833.88M cost=19277137113
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=7,8 row-size=39B cardinality=8.64G cost=3781699633
|
||||
| | in pipelines: 08(GETNEXT), 09(OPEN)
|
||||
| |
|
||||
| |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=59.92MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[170129]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF014[bloom] <- d_date_sk
|
||||
| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 23:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=27B cardinality=73.05K cost=97080
|
||||
| | | in pipelines: 09(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| | Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[22859]
|
||||
| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | runtime filters: RF013[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF012[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=27B cardinality=73.05K cost=15928
|
||||
| | in pipelines: 09(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF014[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=12B cardinality=8.64G cost=1492980801
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
28:EXCHANGE [HASH(d_week_seq,s_store_id)]
|
||||
| mem-estimate=32.02MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=2,5,4 row-size=176B cardinality=4.77M cost=4741634
|
||||
| in pipelines: 20(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=98.10MB mem-reservation=8.50MB thread-reservation=1
|
||||
max-parallelism=210 segment-costs=[2080481569, 66155687] cpu-comparison-result=142 [max(120 (self) vs 142 (sum children))]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5,4 row-size=176B cardinality=4.77M cost=2087901
|
||||
| in pipelines: 20(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.36MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF004[bloom] <- s_store_sk, RF005[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 22:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=115.14KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=48B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.20MB mem-reservation=24.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[668]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF003[min_max] -> s_store_id, RF001[bloom] -> s_store_id
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=24.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=48B cardinality=1.35K cost=465
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: d_week_seq = d.d_week_seq
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=2,5 row-size=128B cardinality=4.77M cost=2646830
|
||||
| in pipelines: 20(GETNEXT), 05(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [HASH(d_week_seq,ss_store_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: d.d_week_seq
|
||||
| | runtime filters: RF006[bloom] <- d.d_week_seq, RF007[min_max] <- d.d_week_seq
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 21:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=5 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 05(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim d, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| runtime filters: RF002[min_max] -> d.d_week_seq, RF000[bloom] -> d.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1210 AS INT), d_month_seq >= CAST(1199 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 05(GETNEXT)
|
||||
|
|
||||
20:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: d_week_seq, ss_store_sk
|
||||
| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=6.95M cost=1527535184
|
||||
| in pipelines: 20(GETNEXT), 00(OPEN)
|
||||
|
|
||||
19:EXCHANGE [HASH(d_week_seq,ss_store_sk)]
|
||||
| mem-estimate=24.53MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=833.88M cost=552946385
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=767.53MB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[24551817547, 6873846540] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
03:AGGREGATE [STREAMING]
|
||||
| output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END)
|
||||
| group by: d_week_seq, ss_store_sk
|
||||
| mem-estimate=693.40MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=120B cardinality=833.88M cost=19277137113
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
02:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=06
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=39B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=59.92MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=06 plan-id=07 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=27B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[22859]
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=27B cardinality=73.05K cost=15928
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF008[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=12B cardinality=8.64G cost=1492980801
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
2014
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q60.test
vendored
Normal file
2014
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q60.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1768
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q61.test
vendored
Normal file
1768
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q61.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
671
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q62.test
vendored
Normal file
671
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q62.test
vendored
Normal file
@@ -0,0 +1,671 @@
|
||||
# TPCDS-Q62
|
||||
# start query 62 in stream 0 using template query62.tpl using seed 1623299017
|
||||
select
|
||||
substr(w_warehouse_name,1,20)
|
||||
,sm_type
|
||||
,web_name
|
||||
,sum(case when (ws_ship_date_sk - ws_sold_date_sk <= 30 ) then 1 else 0 end) as "30 days"
|
||||
,sum(case when (ws_ship_date_sk - ws_sold_date_sk > 30) and
|
||||
(ws_ship_date_sk - ws_sold_date_sk <= 60) then 1 else 0 end ) as "31-60 days"
|
||||
,sum(case when (ws_ship_date_sk - ws_sold_date_sk > 60) and
|
||||
(ws_ship_date_sk - ws_sold_date_sk <= 90) then 1 else 0 end) as "61-90 days"
|
||||
,sum(case when (ws_ship_date_sk - ws_sold_date_sk > 90) and
|
||||
(ws_ship_date_sk - ws_sold_date_sk <= 120) then 1 else 0 end) as "91-120 days"
|
||||
,sum(case when (ws_ship_date_sk - ws_sold_date_sk > 120) then 1 else 0 end) as ">120 days"
|
||||
from
|
||||
web_sales
|
||||
,warehouse
|
||||
,ship_mode
|
||||
,web_site
|
||||
,date_dim
|
||||
where
|
||||
d_month_seq between 1194 and 1194 + 11
|
||||
and ws_ship_date_sk = d_date_sk
|
||||
and ws_warehouse_sk = w_warehouse_sk
|
||||
and ws_ship_mode_sk = sm_ship_mode_sk
|
||||
and ws_web_site_sk = web_site_sk
|
||||
group by
|
||||
substr(w_warehouse_name,1,20)
|
||||
,sm_type
|
||||
,web_name
|
||||
order by substr(w_warehouse_name,1,20)
|
||||
,sm_type
|
||||
,web_name
|
||||
limit 100;
|
||||
|
||||
# end query 62 in stream 0 using template query62.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=24.42MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=104MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=103.75MB mem-reservation=24.42MB thread-reservation=1 runtime-filters-memory=4.00MB
|
||||
| max-parallelism=1 segment-costs=[7866803651, 8155, 800]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: substr(w_warehouse_name, 1, 20), sm_type, web_name, sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: substr(w_warehouse_name, 1, 20) ASC, sm_type ASC, web_name ASC
|
||||
| mem-estimate=8.75KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=90B cardinality=100 cost=8155
|
||||
| in pipelines: 10(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:TUPLE CACHE
|
||||
| cache key: 830a796e0f95714aac61c583f30c1082
|
||||
| input scan node ids: 0,3,1,2,4
|
||||
| estimated serialized size: 126.68KB
|
||||
| estimated serialized size per node: 12.67KB
|
||||
| cumulative processing cost: 7866803651
|
||||
| cache read processing cost: 184
|
||||
| cache write processing cost: 350
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=1.39K cost=0
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: substr(w_warehouse_name, CAST(1 AS BIGINT), CAST(20 AS BIGINT)), sm_type, web_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=1.39K cost=3519483874
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_ship_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_ship_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk, RF001[min_max] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2,4 row-size=106B cardinality=2.13G cost=931314568
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--12:TUPLE CACHE
|
||||
| | cache key: d189b6a68bf948cd8ad84c48e878f232
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| fk/pk conjuncts: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| runtime filters: RF002[bloom] <- sm_ship_mode_sk, RF003[min_max] <- sm_ship_mode_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=98B cardinality=2.13G cost=931307283
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.ship_mode]
|
||||
| HDFS partitions=1/1 files=1 size=2.68KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=20 size=2.68KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=20
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=24B cardinality=20 cost=3
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: ws_warehouse_sk = w_warehouse_sk
|
||||
| runtime filters: RF004[bloom] <- w_warehouse_sk, RF005[min_max] <- w_warehouse_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=74B cardinality=2.13G cost=931307285
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--11:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ws_web_site_sk = web_site_sk
|
||||
| fk/pk conjuncts: ws_web_site_sk = web_site_sk
|
||||
| runtime filters: RF006[bloom] <- web_site_sk, RF007[min_max] <- web_site_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=42B cardinality=2.13G cost=931307329
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.web_site]
|
||||
| HDFS partitions=1/1 files=1 size=17.88KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=66 size=17.88KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=66
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=22B cardinality=66 cost=9
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ws_ship_date_sk, RF003[min_max] -> ws_ship_mode_sk, RF005[min_max] -> ws_warehouse_sk, RF007[min_max] -> ws_web_site_sk, RF000[bloom] -> ws_ship_date_sk, RF002[bloom] -> ws_ship_mode_sk, RF004[bloom] -> ws_warehouse_sk, RF006[bloom] -> ws_web_site_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=2.13G(filtered from 2.16G) cost=622070774
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=188.98MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=604MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.09MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[843] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: substr(w_warehouse_name, 1, 20), sm_type, web_name, sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: substr(w_warehouse_name, 1, 20) ASC, sm_type ASC, web_name ASC
|
||||
| limit: 100
|
||||
| mem-estimate=92.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=90B cardinality=100 cost=43
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(substr(w_warehouse_name, 1, 20),sm_type,web_name)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=22.39MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[368409, 8155, 266] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: substr(w_warehouse_name, 1, 20) ASC, sm_type ASC, web_name ASC
|
||||
| mem-estimate=8.75KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=90B cardinality=100 cost=8155
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| group by: substr(w_warehouse_name, 1, 20), sm_type, web_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=1.39K cost=281386
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(substr(w_warehouse_name, 1, 20),sm_type,web_name)]
|
||||
| mem-estimate=12.39MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=87023
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=33.66MB mem-reservation=6.12MB thread-reservation=1
|
||||
max-parallelism=790 segment-costs=[7867530603, 1045327] cpu-comparison-result=120 [max(120 (self) vs 44 (sum children))]
|
||||
20:TUPLE CACHE
|
||||
| cache key: 19f4cce49e7b9ad69afdcda04edbd238
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 14.85MB
|
||||
| estimated serialized size per node: 1.48MB
|
||||
| cumulative processing cost: 7867560697
|
||||
| cache read processing cost: 22103
|
||||
| cache write processing cost: 42029
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: substr(w_warehouse_name, CAST(1 AS BIGINT), CAST(20 AS BIGINT)), sm_type, web_name
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=3520230777
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ws_ship_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_ship_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2,4 row-size=106B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk, RF001[min_max] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d189b6a68bf948cd8ad84c48e878f232
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| fk/pk conjuncts: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=98B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[40]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: sm_ship_mode_sk
|
||||
| | runtime filters: RF002[bloom] <- sm_ship_mode_sk, RF003[min_max] <- sm_ship_mode_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=20
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=20 cost=20
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.11MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[4]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.ship_mode, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.68KB
|
||||
| stored statistics:
|
||||
| table: rows=20 size=2.68KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=20
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=24B cardinality=20 cost=3
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ws_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: ws_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=74B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF004[bloom] <- w_warehouse_sk, RF005[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=20
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[8]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ws_web_site_sk = web_site_sk
|
||||
| fk/pk conjuncts: ws_web_site_sk = web_site_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=42B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[146]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: web_site_sk
|
||||
| | runtime filters: RF006[bloom] <- web_site_sk, RF007[min_max] <- web_site_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=66
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=22B cardinality=66 cost=80
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.web_site, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=17.88KB
|
||||
| stored statistics:
|
||||
| table: rows=66 size=17.88KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=66
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=22B cardinality=66 cost=9
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ws_ship_date_sk, RF003[min_max] -> ws_ship_mode_sk, RF005[min_max] -> ws_warehouse_sk, RF007[min_max] -> ws_web_site_sk, RF000[bloom] -> ws_ship_date_sk, RF002[bloom] -> ws_ship_mode_sk, RF004[bloom] -> ws_warehouse_sk, RF006[bloom] -> ws_web_site_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=2.13G(filtered from 2.16G) cost=622070774
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=188.98MB Threads=22
|
||||
Per-Host Resource Estimates: Memory=604MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.09MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[843] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: substr(w_warehouse_name, 1, 20), sm_type, web_name, sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: substr(w_warehouse_name, 1, 20) ASC, sm_type ASC, web_name ASC
|
||||
| limit: 100
|
||||
| mem-estimate=92.28KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=90B cardinality=100 cost=43
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(substr(w_warehouse_name, 1, 20),sm_type,web_name)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=22.39MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[368409, 8155, 266] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
10:TOP-N [LIMIT=100]
|
||||
| order by: substr(w_warehouse_name, 1, 20) ASC, sm_type ASC, web_name ASC
|
||||
| mem-estimate=8.75KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=6 row-size=90B cardinality=100 cost=8155
|
||||
| in pipelines: 10(GETNEXT), 16(OPEN)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END), sum:merge(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END)
|
||||
| group by: substr(w_warehouse_name, 1, 20), sm_type, web_name
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=1.39K cost=281386
|
||||
| in pipelines: 16(GETNEXT), 00(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(substr(w_warehouse_name, 1, 20),sm_type,web_name)]
|
||||
| mem-estimate=12.39MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=87023
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=33.66MB mem-reservation=6.12MB thread-reservation=1
|
||||
max-parallelism=790 segment-costs=[7867530603, 1045327] cpu-comparison-result=120 [max(120 (self) vs 44 (sum children))]
|
||||
20:TUPLE CACHE
|
||||
| cache key: 19f4cce49e7b9ad69afdcda04edbd238
|
||||
| input scan node ids: 0
|
||||
| estimated serialized size: 14.85MB
|
||||
| estimated serialized size per node: 1.48MB
|
||||
| cumulative processing cost: 7867560697
|
||||
| cache read processing cost: 22103
|
||||
| cache write processing cost: 42029
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=0
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(30 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(30 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(60 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(60 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(90 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(90 AS BIGINT)) AND (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) <= CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT)), sum(CAST(CASE WHEN (CAST(ws_ship_date_sk AS BIGINT) - CAST(ws_sold_date_sk AS BIGINT) > CAST(120 AS BIGINT)) THEN CAST(1 AS TINYINT) ELSE CAST(0 AS TINYINT) END AS BIGINT))
|
||||
| group by: substr(w_warehouse_name, CAST(1 AS BIGINT), CAST(20 AS BIGINT)), sm_type, web_name
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=5 row-size=90B cardinality=166.32K cost=3520230777
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ws_ship_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ws_ship_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2,4 row-size=106B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk, RF001[min_max] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: d189b6a68bf948cd8ad84c48e878f232
|
||||
| | input scan node ids: 4
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1205 AS INT), d_month_seq >= CAST(1194 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| fk/pk conjuncts: ws_ship_mode_sk = sm_ship_mode_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=98B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[40]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: sm_ship_mode_sk
|
||||
| | runtime filters: RF002[bloom] <- sm_ship_mode_sk, RF003[min_max] <- sm_ship_mode_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=20
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=24B cardinality=20 cost=20
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.11MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[4]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.ship_mode, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.68KB
|
||||
| stored statistics:
|
||||
| table: rows=20 size=2.68KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=20
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=24B cardinality=20 cost=3
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ws_warehouse_sk = w_warehouse_sk
|
||||
| fk/pk conjuncts: ws_warehouse_sk = w_warehouse_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=74B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[42]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: w_warehouse_sk
|
||||
| | runtime filters: RF004[bloom] <- w_warehouse_sk, RF005[min_max] <- w_warehouse_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=22
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=20
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[8]
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 6ffdb1b4bffa14530778a288224883b2
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 793B
|
||||
| | estimated serialized size per node: 793B
|
||||
| | cumulative processing cost: 6
|
||||
| | cache read processing cost: 2
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=32B cardinality=22 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.warehouse, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=5.99KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=22 size=5.99KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=22
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=32B cardinality=22 cost=6
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ws_web_site_sk = web_site_sk
|
||||
| fk/pk conjuncts: ws_web_site_sk = web_site_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=42B cardinality=2.13G cost=931307263
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[146]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: web_site_sk
|
||||
| | runtime filters: RF006[bloom] <- web_site_sk, RF007[min_max] <- web_site_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=66
|
||||
| |
|
||||
| 11:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=22B cardinality=66 cost=80
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.web_site, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=17.88KB
|
||||
| stored statistics:
|
||||
| table: rows=66 size=17.88KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=66
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=22B cardinality=66 cost=9
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ws_ship_date_sk, RF003[min_max] -> ws_ship_mode_sk, RF005[min_max] -> ws_warehouse_sk, RF007[min_max] -> ws_web_site_sk, RF000[bloom] -> ws_ship_date_sk, RF002[bloom] -> ws_ship_mode_sk, RF004[bloom] -> ws_warehouse_sk, RF006[bloom] -> ws_web_site_sk
|
||||
stored statistics:
|
||||
table: rows=2.16G size=145.75GB
|
||||
partitions: 1824/1824 rows=2.16G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=2.13G(filtered from 2.16G) cost=622070774
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q63.test
vendored
Normal file
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q63.test
vendored
Normal file
@@ -0,0 +1,796 @@
|
||||
# TPCDS-Q63
|
||||
# start query 63 in stream 0 using template query63.tpl using seed 1154327231
|
||||
select *
|
||||
from (select i_manager_id
|
||||
,sum(ss_sales_price) sum_sales
|
||||
,avg(sum(ss_sales_price)) over (partition by i_manager_id) avg_monthly_sales
|
||||
from item
|
||||
,store_sales
|
||||
,date_dim
|
||||
,store
|
||||
where ss_item_sk = i_item_sk
|
||||
and ss_sold_date_sk = d_date_sk
|
||||
and ss_store_sk = s_store_sk
|
||||
and d_month_seq in (1205,1205+1,1205+2,1205+3,1205+4,1205+5,1205+6,1205+7,1205+8,1205+9,1205+10,1205+11)
|
||||
and (( i_category in ('Books','Children','Electronics')
|
||||
and i_class in ('personal','portable','reference','self-help')
|
||||
and i_brand in ('scholaramalgamalg #14','scholaramalgamalg #7',
|
||||
'exportiunivamalg #9','scholaramalgamalg #9'))
|
||||
or( i_category in ('Women','Music','Men')
|
||||
and i_class in ('accessories','classical','fragrances','pants')
|
||||
and i_brand in ('amalgimporto #1','edu packscholar #1','exportiimporto #1',
|
||||
'importoamalg #1')))
|
||||
group by i_manager_id, d_moy) tmp1
|
||||
where case when avg_monthly_sales > 0 then abs (sum_sales - avg_monthly_sales) / avg_monthly_sales else null end > 0.1
|
||||
order by i_manager_id
|
||||
,avg_monthly_sales
|
||||
,sum_sales
|
||||
limit 100;
|
||||
|
||||
# end query 63 in stream 0 using template query63.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=49.83MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=105MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=104.81MB mem-reservation=49.83MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[396130771, 1723, 2838, 300]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manager_id, sum_sales, avg_monthly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: i_manager_id ASC, avg_monthly_sales ASC, sum_sales ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=462
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=119 cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manager_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=1.19K cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manager_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=1.19K cost=1723
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
18:TUPLE CACHE
|
||||
| cache key: 27efba97a1a89616cd14a7b553c7ed62
|
||||
| input scan node ids: 1,0,2,3
|
||||
| estimated serialized size: 32.48KB
|
||||
| estimated serialized size per node: 3.25KB
|
||||
| cumulative processing cost: 396130771
|
||||
| cache read processing cost: 157
|
||||
| cache write processing cost: 89
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=0
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manager_id, d_moy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=339009
|
||||
| in pipelines: 07(GETNEXT), 01(OPEN)
|
||||
|
|
||||
17:TUPLE CACHE
|
||||
| cache key: 1e126bff1afdabbf53ba72089127d1da
|
||||
| input scan node ids: 1,0,2,3
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395791762
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=107623
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: 8ef086ac14380adcb996a3eed9408718
|
||||
| input scan node ids: 1,0,2
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684062
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106635
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 17effbbfb22cb7245767b15c4d289a13
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
14:TUPLE CACHE
|
||||
| cache key: 075d999db1bac1eea7da19c8f585ba6b
|
||||
| input scan node ids: 1,0
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562752
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=284005
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--13:TUPLE CACHE
|
||||
| | cache key: a92e78c5cb9c81d0d5712693b69bbbba
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
12:TUPLE CACHE
|
||||
| cache key: a79fa1620a736e603f3e52a2291c8e4e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=174.20MB Threads=13
|
||||
Per-Host Resource Estimates: Memory=300MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[332] cpu-comparison-result=40 [max(1 (self) vs 40 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manager_id, sum_sales, avg_monthly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_manager_id ASC, avg_monthly_sales ASC, sum_sales ASC
|
||||
| limit: 100
|
||||
| mem-estimate=39.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=32
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_manager_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=10.28MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[1986, 2838, 125] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: i_manager_id ASC, avg_monthly_sales ASC, sum_sales ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=462
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=119 cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manager_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=1.19K cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manager_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=1.19K cost=1723
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
17:EXCHANGE [HASH(i_manager_id)]
|
||||
| mem-estimate=282.78KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=263
|
||||
| in pipelines: 16(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_manager_id,d_moy)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=11.36MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[191489, 2448] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: i_manager_id, d_moy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=165654
|
||||
| in pipelines: 16(GETNEXT), 01(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_manager_id,d_moy)]
|
||||
| mem-estimate=1.36MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=25835
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=47.09MB mem-reservation=30.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[396430739, 240371] cpu-comparison-result=40 [max(40 (self) vs 36 (sum children))]
|
||||
25:TUPLE CACHE
|
||||
| cache key: ce7b316baafbe6451212122ea741dfe9
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 3.11MB
|
||||
| estimated serialized size per node: 318.94KB
|
||||
| cumulative processing cost: 396655999
|
||||
| cache read processing cost: 15501
|
||||
| cache write processing cost: 8817
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manager_id, d_moy
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=861834
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
24:TUPLE CACHE
|
||||
| cache key: 094cf65f35e1d607c43c8167e4365243
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395794165
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[120]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: cb64318b7f7be1e49e94ac9ea1f29d9e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684632
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[842]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=362
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=480
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14694]
|
||||
| 22:TUPLE CACHE
|
||||
| | cache key: 17effbbfb22cb7245767b15c4d289a13
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
21:TUPLE CACHE
|
||||
| cache key: 245baf2d8ce8e71ef36a7d2417ab9232
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562823
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=283954
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[111]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=51
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=19.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=60
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.30MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[206353]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: a92e78c5cb9c81d0d5712693b69bbbba
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
19:TUPLE CACHE
|
||||
| cache key: 18ed330f0d49985410b4491dbb2cef3f
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=174.20MB Threads=13
|
||||
Per-Host Resource Estimates: Memory=300MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[332] cpu-comparison-result=40 [max(1 (self) vs 40 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_manager_id, sum_sales, avg_monthly_sales
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=300
|
||||
|
|
||||
18:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_manager_id ASC, avg_monthly_sales ASC, sum_sales ASC
|
||||
| limit: 100
|
||||
| mem-estimate=39.41KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=32
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(i_manager_id)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=10.28MB mem-reservation=10.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[1986, 2838, 125] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
11:TOP-N [LIMIT=100]
|
||||
| order by: i_manager_id ASC, avg_monthly_sales ASC, sum_sales ASC
|
||||
| mem-estimate=3.52KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=8 row-size=36B cardinality=100 cost=462
|
||||
| in pipelines: 11(GETNEXT), 08(OPEN)
|
||||
|
|
||||
10:SELECT
|
||||
| predicates: CASE WHEN avg(sum(ss_sales_price)) > CAST(0 AS DECIMAL(3,0)) THEN abs(sum(ss_sales_price) - avg(sum(ss_sales_price))) / avg(sum(ss_sales_price)) ELSE NULL END > CAST(0.1 AS DECIMAL(1,1))
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=119 cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:ANALYTIC
|
||||
| functions: avg(sum(ss_sales_price))
|
||||
| partition by: i_manager_id
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15,14 row-size=40B cardinality=1.19K cost=1188
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SORT
|
||||
| order by: i_manager_id ASC NULLS LAST
|
||||
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=15 row-size=24B cardinality=1.19K cost=1723
|
||||
| in pipelines: 08(GETNEXT), 16(OPEN)
|
||||
|
|
||||
17:EXCHANGE [HASH(i_manager_id)]
|
||||
| mem-estimate=282.78KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=263
|
||||
| in pipelines: 16(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(i_manager_id,d_moy)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=11.36MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[191489, 2448] cpu-comparison-result=40 [max(10 (self) vs 40 (sum children))]
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: i_manager_id, d_moy
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=1.19K cost=165654
|
||||
| in pipelines: 16(GETNEXT), 01(OPEN)
|
||||
|
|
||||
15:EXCHANGE [HASH(i_manager_id,d_moy)]
|
||||
| mem-estimate=1.36MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=25835
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=40 (adjusted from 120)
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=47.09MB mem-reservation=30.00MB thread-reservation=1
|
||||
max-parallelism=40 segment-costs=[396430739, 240371] cpu-comparison-result=40 [max(40 (self) vs 36 (sum children))]
|
||||
25:TUPLE CACHE
|
||||
| cache key: ce7b316baafbe6451212122ea741dfe9
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 3.11MB
|
||||
| estimated serialized size per node: 318.94KB
|
||||
| cumulative processing cost: 396655999
|
||||
| cache read processing cost: 15501
|
||||
| cache write processing cost: 8817
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
07:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: i_manager_id, d_moy
|
||||
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=24B cardinality=116.64K cost=861834
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
24:TUPLE CACHE
|
||||
| cache key: 094cf65f35e1d607c43c8167e4365243
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 28.22MB
|
||||
| estimated serialized size per node: 2.82MB
|
||||
| cumulative processing cost: 395794165
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 79881
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2,3 row-size=106B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=4B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[120]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=4B cardinality=1.35K cost=77
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
23:TUPLE CACHE
|
||||
| cache key: cb64318b7f7be1e49e94ac9ea1f29d9e
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 26.36MB
|
||||
| estimated serialized size per node: 2.64MB
|
||||
| cumulative processing cost: 395684632
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 74636
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0,2 row-size=102B cardinality=242.80K cost=106273
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[842]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=362
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=480
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[14694]
|
||||
| 22:TUPLE CACHE
|
||||
| | cache key: 17effbbfb22cb7245767b15c4d289a13
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 5.66KB
|
||||
| | estimated serialized size per node: 5.66KB
|
||||
| | cumulative processing cost: 14675
|
||||
| | cache read processing cost: 48
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=362 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| parquet dictionary predicates: d_month_seq IN (CAST(1205 AS INT), CAST(1206 AS INT), CAST(1207 AS INT), CAST(1208 AS INT), CAST(1209 AS INT), CAST(1210 AS INT), CAST(1211 AS INT), CAST(1212 AS INT), CAST(1213 AS INT), CAST(1214 AS INT), CAST(1215 AS INT), CAST(1216 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=362 cost=14675
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
21:TUPLE CACHE
|
||||
| cache key: 245baf2d8ce8e71ef36a7d2417ab9232
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 22.66MB
|
||||
| estimated serialized size per node: 2.27MB
|
||||
| cumulative processing cost: 395562823
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 64147
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=1,0 row-size=90B cardinality=242.80K(filtered from 1.22M) cost=283954
|
||||
| in pipelines: 01(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=8.77MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[111]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 cost=51
|
||||
| |
|
||||
| 12:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=19.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=60
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.30MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[206353]
|
||||
| 20:TUPLE CACHE
|
||||
| | cache key: a92e78c5cb9c81d0d5712693b69bbbba
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 3.88KB
|
||||
| | estimated serialized size per node: 992B
|
||||
| | cumulative processing cost: 206342
|
||||
| | cache read processing cost: 6
|
||||
| | cache write processing cost: 10
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=0 row-size=74B cardinality=51 cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ((i_category IN ('Books', 'Children', 'Electronics') AND i_class IN ('personal', 'portable', 'reference', 'self-help') AND i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) OR (i_category IN ('Women', 'Music', 'Men') AND i_class IN ('accessories', 'classical', 'fragrances', 'pants') AND i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=74B cardinality=51 cost=206342
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
19:TUPLE CACHE
|
||||
| cache key: 18ed330f0d49985410b4491dbb2cef3f
|
||||
| input scan node ids: 1
|
||||
| estimated serialized size: 4.63MB
|
||||
| estimated serialized size per node: 474.22KB
|
||||
| cumulative processing cost: 395072405
|
||||
| cache read processing cost: 32267
|
||||
| cache write processing cost: 13111
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=0
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=362(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=1 row-size=16B cardinality=242.80K(filtered from 8.64G) cost=395072405
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
4130
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q64.test
vendored
Normal file
4130
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q64.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
891
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q65.test
vendored
Normal file
891
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q65.test
vendored
Normal file
@@ -0,0 +1,891 @@
|
||||
# TPCDS-Q65
|
||||
# start query 65 in stream 0 using template query65.tpl using seed 1990419624
|
||||
select
|
||||
s_store_name,
|
||||
i_item_desc,
|
||||
sc.revenue,
|
||||
i_current_price,
|
||||
i_wholesale_cost,
|
||||
i_brand
|
||||
from store, item,
|
||||
(select ss_store_sk, avg(revenue) as ave
|
||||
from
|
||||
(select ss_store_sk, ss_item_sk,
|
||||
sum(ss_sales_price) as revenue
|
||||
from store_sales, date_dim
|
||||
where ss_sold_date_sk = d_date_sk and d_month_seq between 1208 and 1208+11
|
||||
group by ss_store_sk, ss_item_sk) sa
|
||||
group by ss_store_sk) sb,
|
||||
(select ss_store_sk, ss_item_sk, sum(ss_sales_price) as revenue
|
||||
from store_sales, date_dim
|
||||
where ss_sold_date_sk = d_date_sk and d_month_seq between 1208 and 1208+11
|
||||
group by ss_store_sk, ss_item_sk) sc
|
||||
where sb.ss_store_sk = sc.ss_store_sk and
|
||||
sc.revenue <= 0.1 * sb.ave and
|
||||
s_store_sk = sc.ss_store_sk and
|
||||
i_item_sk = sc.ss_item_sk
|
||||
order by s_store_name, i_item_desc
|
||||
limit 100;
|
||||
|
||||
# end query 65 in stream 0 using template query65.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=137.33MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=8.53GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=8.53GB mem-reservation=137.33MB thread-reservation=1 runtime-filters-memory=5.00MB
|
||||
| max-parallelism=1 segment-costs=[18709587534, 18709587534, 68796982, 162622958947, 600]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, i_item_desc, revenue, i_current_price, i_wholesale_cost, i_brand
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, i_item_desc ASC
|
||||
| mem-estimate=17.65KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=181B cardinality=100 cost=160790255687
|
||||
| in pipelines: 14(GETNEXT), 10(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = ss_store_sk
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: sum(ss_sales_price) <= CAST(0.1 AS DECIMAL(1,1)) * avg(revenue)
|
||||
| runtime filters: RF000[bloom] <- ss_store_sk, RF001[min_max] <- ss_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0,7 row-size=217B cardinality=8.64G cost=1625855090
|
||||
| in pipelines: 10(GETNEXT), 06(OPEN)
|
||||
|
|
||||
|--18:TUPLE CACHE
|
||||
| | cache key: c0669fbd40ed1f7956fa77633337c08b
|
||||
| | input scan node ids: 2,3
|
||||
| | estimated serialized size: 15.30KB
|
||||
| | estimated serialized size per node: 1.53KB
|
||||
| | cumulative processing cost: 18778384516
|
||||
| | cache read processing cost: 86
|
||||
| | cache write processing cost: 42
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:AGGREGATE [FINALIZE]
|
||||
| | output: avg(sum(ss_sales_price))
|
||||
| | group by: ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=68796982
|
||||
| | in pipelines: 06(GETNEXT), 05(OPEN)
|
||||
| |
|
||||
| 05:AGGREGATE [FINALIZE]
|
||||
| | output: sum(ss_sales_price)
|
||||
| | group by: ss_store_sk, ss_item_sk
|
||||
| | mem-estimate=4.19GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=235.20M cost=12937227008
|
||||
| | in pipelines: 05(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,3 row-size=24B cardinality=8.64G cost=3781706938
|
||||
| | in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--17:TUPLE CACHE
|
||||
| | | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF008[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=16B cardinality=8.64G cost=1990641068
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0 row-size=197B cardinality=235.08M cost=102895866
|
||||
| in pipelines: 10(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--00:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=20B cardinality=1.35K cost=154
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=64.45MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11,1 row-size=177B cardinality=235.08M cost=103284665
|
||||
| in pipelines: 10(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--16:TUPLE CACHE
|
||||
| | cache key: e2eef23c62b713cd1ca846c0e4e5dbca
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 53.82MB
|
||||
| | estimated serialized size per node: 13.45MB
|
||||
| | cumulative processing cost: 667485
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 152369
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=153B cardinality=360.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=153B cardinality=360.00K cost=667485
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
10:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_store_sk, ss_item_sk
|
||||
| mem-estimate=4.19GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=235.20M cost=12937227008
|
||||
| in pipelines: 10(GETNEXT), 07(OPEN)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF006[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=9,10 row-size=24B cardinality=8.64G cost=3781706938
|
||||
| in pipelines: 07(GETNEXT), 08(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=10 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF006[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=9 row-size=16B cardinality=8.64G cost=1990641068
|
||||
in pipelines: 07(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=2.29GB Threads=58
|
||||
Per-Host Resource Estimates: Memory=30.98GB
|
||||
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.12MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[661] cpu-comparison-result=265 [max(1 (self) vs 265 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, i_item_desc, revenue, i_current_price, i_wholesale_cost, i_brand
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, i_item_desc ASC
|
||||
| limit: 100
|
||||
| mem-estimate=2.12MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=181B cardinality=100 cost=61
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=80.57MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=16270 segment-costs=[12940680071, 162621929305, 504] cpu-comparison-result=265 [max(120 (self) vs 265 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, i_item_desc ASC
|
||||
| mem-estimate=17.65KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=181B cardinality=100 cost=160790255687
|
||||
| in pipelines: 14(GETNEXT), 17(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = ss_store_sk
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: sum(ss_sales_price) <= CAST(0.1 AS DECIMAL(1,1)) * avg(revenue)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0,7 row-size=217B cardinality=8.64G cost=1625854437
|
||||
| in pipelines: 17(GETNEXT), 24(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_store_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_store_sk, RF001[min_max] <- ss_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=653
|
||||
| |
|
||||
| 25:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=165.80KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=860
|
||||
| | in pipelines: 24(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [HASH(ss_store_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=12.73MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
| 24:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(revenue)
|
||||
| | group by: ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=24622
|
||||
| | in pipelines: 24(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| 23:EXCHANGE [HASH(ss_store_sk)]
|
||||
| | mem-estimate=2.73MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=20B cardinality=78.36K cost=15914
|
||||
| | in pipelines: 22(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=96.69MB mem-reservation=36.00MB thread-reservation=1
|
||||
| max-parallelism=1300 segment-costs=[12940680071, 68999580, 141298] cpu-comparison-result=120 [max(110 (self) vs 120 (sum children))]
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | output: avg(sum(ss_sales_price))
|
||||
| | group by: ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=20B cardinality=78.36K cost=68999580
|
||||
| | in pipelines: 22(GETNEXT)
|
||||
| |
|
||||
| 22:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(ss_sales_price)
|
||||
| | group by: ss_store_sk, ss_item_sk
|
||||
| | mem-estimate=73.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=235.20M cost=11292119815
|
||||
| | in pipelines: 22(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| 21:EXCHANGE [HASH(ss_store_sk,ss_item_sk)]
|
||||
| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=7.44G cost=1648560256
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
| max-parallelism=1824 segment-costs=[51348787703, 15337936685] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 05:AGGREGATE [STREAMING]
|
||||
| | output: sum(ss_sales_price)
|
||||
| | group by: ss_store_sk, ss_item_sk
|
||||
| | mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=7.44G cost=45576447002
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,3 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| | in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 20:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=8B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12835]
|
||||
| | 29:TUPLE CACHE
|
||||
| | | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| runtime filters: RF008[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=16B cardinality=8.64G cost=1990641068
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0 row-size=197B cardinality=235.08M cost=102894516
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.30MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=50.23KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=20B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[255]
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=20B cardinality=1.35K cost=154
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11,1 row-size=177B cardinality=235.08M cost=102924665
|
||||
| in pipelines: 17(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.61MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.61MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=153B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.61MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[823742]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: e2eef23c62b713cd1ca846c0e4e5dbca
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 53.82MB
|
||||
| | estimated serialized size per node: 13.45MB
|
||||
| | cumulative processing cost: 667485
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 152369
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=153B cardinality=360.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=153B cardinality=360.00K cost=667485
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: ss_store_sk, ss_item_sk
|
||||
| mem-estimate=67.29MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=235.20M cost=11292119815
|
||||
| in pipelines: 17(GETNEXT), 07(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(ss_store_sk,ss_item_sk)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=7.44G cost=1648560256
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[51348787703, 15337936685] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
10:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_store_sk, ss_item_sk
|
||||
| mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=7.44G cost=45576447002
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=9,10 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 07(GETNEXT), 08(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=10 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF006[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=9 row-size=16B cardinality=8.64G cost=1990641068
|
||||
in pipelines: 07(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=2.29GB Threads=58
|
||||
Per-Host Resource Estimates: Memory=30.98GB
|
||||
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=6.12MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[661] cpu-comparison-result=265 [max(1 (self) vs 265 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: s_store_name, i_item_desc, revenue, i_current_price, i_wholesale_cost, i_brand
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=600
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: s_store_name ASC, i_item_desc ASC
|
||||
| limit: 100
|
||||
| mem-estimate=2.12MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=181B cardinality=100 cost=61
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F02:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=120
|
||||
Per-Instance Resources: mem-estimate=80.57MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=16270 segment-costs=[12940680071, 162621929305, 504] cpu-comparison-result=265 [max(120 (self) vs 265 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: s_store_name ASC, i_item_desc ASC
|
||||
| mem-estimate=17.65KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=13 row-size=181B cardinality=100 cost=160790255687
|
||||
| in pipelines: 14(GETNEXT), 17(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = ss_store_sk
|
||||
| fk/pk conjuncts: none
|
||||
| other predicates: sum(ss_sales_price) <= CAST(0.1 AS DECIMAL(1,1)) * avg(revenue)
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0,7 row-size=217B cardinality=8.64G cost=1625854437
|
||||
| in pipelines: 17(GETNEXT), 24(OPEN)
|
||||
|
|
||||
|--F10:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_store_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_store_sk, RF001[min_max] <- ss_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=653
|
||||
| |
|
||||
| 25:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=165.80KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=860
|
||||
| | in pipelines: 24(GETNEXT)
|
||||
| |
|
||||
| F08:PLAN FRAGMENT [HASH(ss_store_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=12.73MB mem-reservation=1.94MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
| 24:AGGREGATE [FINALIZE]
|
||||
| | output: avg:merge(revenue)
|
||||
| | group by: ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=20B cardinality=653 cost=24622
|
||||
| | in pipelines: 24(GETNEXT), 22(OPEN)
|
||||
| |
|
||||
| 23:EXCHANGE [HASH(ss_store_sk)]
|
||||
| | mem-estimate=2.73MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=6 row-size=20B cardinality=78.36K cost=15914
|
||||
| | in pipelines: 22(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=110 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=96.69MB mem-reservation=36.00MB thread-reservation=1
|
||||
| max-parallelism=1300 segment-costs=[12940680071, 68999580, 141298] cpu-comparison-result=120 [max(110 (self) vs 120 (sum children))]
|
||||
| 06:AGGREGATE [STREAMING]
|
||||
| | output: avg(sum(ss_sales_price))
|
||||
| | group by: ss_store_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=20B cardinality=78.36K cost=68999580
|
||||
| | in pipelines: 22(GETNEXT)
|
||||
| |
|
||||
| 22:AGGREGATE [FINALIZE]
|
||||
| | output: sum:merge(ss_sales_price)
|
||||
| | group by: ss_store_sk, ss_item_sk
|
||||
| | mem-estimate=73.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=235.20M cost=11292119815
|
||||
| | in pipelines: 22(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| 21:EXCHANGE [HASH(ss_store_sk,ss_item_sk)]
|
||||
| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=7.44G cost=1648560256
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
| max-parallelism=1824 segment-costs=[51348787703, 15337936685] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
| 05:AGGREGATE [STREAMING]
|
||||
| | output: sum(ss_sales_price)
|
||||
| | group by: ss_store_sk, ss_item_sk
|
||||
| | mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=24B cardinality=7.44G cost=45576447002
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=2,3 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| | in pipelines: 02(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[17005]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| | |
|
||||
| | 20:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=8B cardinality=7.30K cost=9700
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[12835]
|
||||
| | 29:TUPLE CACHE
|
||||
| | | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 85.61KB
|
||||
| | | estimated serialized size per node: 85.61KB
|
||||
| | | cumulative processing cost: 12520
|
||||
| | | cache read processing cost: 970
|
||||
| | | cache write processing cost: 236
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=8B cardinality=7.30K cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=8B cardinality=7.30K cost=12520
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| runtime filters: RF008[bloom] -> ss_sold_date_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=2 row-size=16B cardinality=8.64G cost=1990641068
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11,1,0 row-size=197B cardinality=235.08M cost=102894516
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.30MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF002[bloom] <- s_store_sk, RF003[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=50.23KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=0 row-size=20B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
|
||||
| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[255]
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store.s_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store.s_store_sk
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=0 row-size=20B cardinality=1.35K cost=154
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11,1 row-size=177B cardinality=235.08M cost=102924665
|
||||
| in pipelines: 17(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ss_store_sk,ss_item_sk)] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.61MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.61MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=153B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.61MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[823742]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: e2eef23c62b713cd1ca846c0e4e5dbca
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 53.82MB
|
||||
| | estimated serialized size per node: 13.45MB
|
||||
| | cumulative processing cost: 667485
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 152369
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=153B cardinality=360.00K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=153B cardinality=360.00K cost=667485
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_sales_price)
|
||||
| group by: ss_store_sk, ss_item_sk
|
||||
| mem-estimate=67.29MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=235.20M cost=11292119815
|
||||
| in pipelines: 17(GETNEXT), 07(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(ss_store_sk,ss_item_sk)]
|
||||
| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=7.44G cost=1648560256
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=1.18GB mem-reservation=42.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[51348787703, 15337936685] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
|
||||
10:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_sales_price)
|
||||
| group by: ss_store_sk, ss_item_sk
|
||||
| mem-estimate=1.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=24B cardinality=7.44G cost=45576447002
|
||||
| in pipelines: 07(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=9,10 row-size=24B cardinality=8.64G cost=3781699633
|
||||
| in pipelines: 07(GETNEXT), 08(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.32MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF006[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=69.07KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=10 row-size=8B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.05MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[12835]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: c658998d76a692ced9a4d9f667f1c50c
|
||||
| | input scan node ids: 8
|
||||
| | estimated serialized size: 85.61KB
|
||||
| | estimated serialized size per node: 85.61KB
|
||||
| | cumulative processing cost: 12520
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 236
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=10 row-size=8B cardinality=7.30K cost=0
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1219 AS INT), d_month_seq >= CAST(1208 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=10 row-size=8B cardinality=7.30K cost=12520
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF006[bloom] -> ss_sold_date_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=9 row-size=16B cardinality=8.64G cost=1990641068
|
||||
in pipelines: 07(GETNEXT)
|
||||
====
|
||||
1727
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q66.test
vendored
Normal file
1727
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q66.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q67.test
vendored
Normal file
796
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q67.test
vendored
Normal file
@@ -0,0 +1,796 @@
|
||||
# TPCDS-Q67
|
||||
# start query 67 in stream 0 using template query67.tpl using seed 607441995
|
||||
select *
|
||||
from (select i_category
|
||||
,i_class
|
||||
,i_brand
|
||||
,i_product_name
|
||||
,d_year
|
||||
,d_qoy
|
||||
,d_moy
|
||||
,s_store_id
|
||||
,sumsales
|
||||
,rank() over (partition by i_category order by sumsales desc) rk
|
||||
from (select i_category
|
||||
,i_class
|
||||
,i_brand
|
||||
,i_product_name
|
||||
,d_year
|
||||
,d_qoy
|
||||
,d_moy
|
||||
,s_store_id
|
||||
,sum(coalesce(ss_sales_price*ss_quantity,0)) sumsales
|
||||
from store_sales
|
||||
,date_dim
|
||||
,store
|
||||
,item
|
||||
where ss_sold_date_sk=d_date_sk
|
||||
and ss_item_sk=i_item_sk
|
||||
and ss_store_sk = s_store_sk
|
||||
and d_month_seq between 1196 and 1196+11
|
||||
group by rollup(i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy,s_store_id))dw1) dw2
|
||||
where rk <= 100
|
||||
order by i_category
|
||||
,i_class
|
||||
,i_brand
|
||||
,i_product_name
|
||||
,d_year
|
||||
,d_qoy
|
||||
,d_moy
|
||||
,s_store_id
|
||||
,sumsales
|
||||
,rk
|
||||
limit 100;
|
||||
|
||||
# end query 67 in stream 0 using template query67.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=263.62MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=55.19GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=55.19GB mem-reservation=263.62MB thread-reservation=1 runtime-filters-memory=3.00MB
|
||||
| max-parallelism=1 segment-costs=[176669034554, 73050686125, 233936768446, 1261, 1000]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sumsales, rk
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_brand ASC, i_product_name ASC, d_year ASC, d_qoy ASC, d_moy ASC, s_store_id ASC, sumsales ASC, rk ASC
|
||||
| mem-estimate=9.38KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=18 row-size=96B cardinality=100 cost=861
|
||||
| in pipelines: 12(GETNEXT), 09(OPEN)
|
||||
|
|
||||
11:SELECT
|
||||
| predicates: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: i_category
|
||||
| order by: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
09:TOP-N
|
||||
| order by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END ASC NULLS LAST, aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| limit with ties: 200
|
||||
| source expr: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=17.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=233936768446
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT), CAST(7 AS INT), CAST(8 AS INT), CAST(9 AS INT), CAST(10 AS INT), CAST(11 AS INT), CAST(12 AS INT)), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(5 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(6 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(7 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(8 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(9 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(10 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(11 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(12 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END)
|
||||
| group by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN i_category WHEN CAST(7 AS INT) THEN i_category WHEN CAST(8 AS INT) THEN i_category WHEN CAST(9 AS INT) THEN i_category WHEN CAST(10 AS INT) THEN i_category WHEN CAST(11 AS INT) THEN i_category WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(7 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN i_class WHEN CAST(9 AS INT) THEN i_class WHEN CAST(10 AS INT) THEN i_class WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(5 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(7 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(9 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(5 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(7 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_year WHEN CAST(5 AS INT) THEN d_year WHEN CAST(6 AS INT) THEN d_year WHEN CAST(7 AS INT) THEN d_year WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_qoy WHEN CAST(5 AS INT) THEN d_qoy WHEN CAST(6 AS INT) THEN d_qoy WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_moy WHEN CAST(5 AS INT) THEN d_moy WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN s_store_id WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(7 AS INT) THEN CAST(7 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(9 AS INT) THEN CAST(9 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(11 AS INT) THEN CAST(11 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=5.18GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=92B cardinality=12.38G cost=73050686125
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
07:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id
|
||||
| Class 1
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, NULL
|
||||
| Class 2
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, NULL, NULL
|
||||
| Class 3
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, NULL, NULL, NULL, NULL
|
||||
| Class 5
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 6
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 7
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 8
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| mem-estimate=50.00GB mem-reservation=210.75MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=12.38G cost=162840615894
|
||||
| in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=177B cardinality=8.64G cost=3779811079
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=32B cardinality=1.35K cost=388
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF002[bloom] <- d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=145B cardinality=8.64G cost=3779817034
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--14:TUPLE CACHE
|
||||
| | cache key: ea0d7f0c7b6c4b079628d53f69c3fe8b
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 171.21KB
|
||||
| | estimated serialized size per node: 171.21KB
|
||||
| | cumulative processing cost: 25143
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 473
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=7.30K cost=25143
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| mem-estimate=47.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=125B cardinality=8.64G cost=3780169729
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--13:TUPLE CACHE
|
||||
| | cache key: 32065b2a67aa85f1f02da78b4b550299
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=8.64G(filtered from 8.64G) cost=2488301335
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=4.71GB Threads=27
|
||||
Per-Host Resource Estimates: Memory=104.39GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.10MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1044] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sumsales, rk
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
20:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_brand ASC, i_product_name ASC, d_year ASC, d_qoy ASC, d_moy ASC, s_store_id ASC, sumsales ASC, rk ASC
|
||||
| limit: 100
|
||||
| mem-estimate=98.59KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=18 row-size=96B cardinality=100 cost=44
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=5.30MB mem-reservation=4.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[967, 1261, 282] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_brand ASC, i_product_name ASC, d_year ASC, d_qoy ASC, d_moy ASC, s_store_id ASC, sumsales ASC, rk ASC
|
||||
| mem-estimate=9.38KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=18 row-size=96B cardinality=100 cost=861
|
||||
| in pipelines: 12(GETNEXT), 19(OPEN)
|
||||
|
|
||||
11:SELECT
|
||||
| predicates: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 19(GETNEXT)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: i_category
|
||||
| order by: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 19(GETNEXT)
|
||||
|
|
||||
19:TOP-N
|
||||
| order by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END ASC NULLS LAST, aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| limit with ties: 200
|
||||
| mem-estimate=17.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=861
|
||||
| in pipelines: 19(GETNEXT), 09(OPEN)
|
||||
|
|
||||
18:EXCHANGE [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END)]
|
||||
| mem-estimate=1.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=106
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(i_category) WHEN 7 THEN murmur_hash(i_category) WHEN 8 THEN murmur_hash(i_category) WHEN 9 THEN murmur_hash(i_category) WHEN 10 THEN murmur_hash(i_category) WHEN 11 THEN murmur_hash(i_category) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 6 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(i_class) WHEN 8 THEN murmur_hash(i_class) WHEN 9 THEN murmur_hash(i_class) WHEN 10 THEN murmur_hash(i_class) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 6 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 8 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(i_brand) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 6 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 8 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_year) WHEN 5 THEN murmur_hash(d_year) WHEN 6 THEN murmur_hash(d_year) WHEN 7 THEN murmur_hash(d_year) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_qoy) WHEN 5 THEN murmur_hash(d_qoy) WHEN 6 THEN murmur_hash(d_qoy) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_moy) WHEN 5 THEN murmur_hash(d_moy) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(s_store_id) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END)] hosts=10 instances=70 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=7.14GB mem-reservation=244.75MB thread-reservation=1
|
||||
max-parallelism=26630 segment-costs=[266227423359, 73050686125, 233936768446, 1288] cpu-comparison-result=120 [max(70 (self) vs 120 (sum children))]
|
||||
09:TOP-N
|
||||
| order by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END ASC NULLS LAST, aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| limit with ties: 200
|
||||
| source expr: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=17.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=233936768446
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT), CAST(7 AS INT), CAST(8 AS INT), CAST(9 AS INT), CAST(10 AS INT), CAST(11 AS INT), CAST(12 AS INT)), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(5 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(6 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(7 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(8 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(9 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(10 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(11 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(12 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END)
|
||||
| group by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN i_category WHEN CAST(7 AS INT) THEN i_category WHEN CAST(8 AS INT) THEN i_category WHEN CAST(9 AS INT) THEN i_category WHEN CAST(10 AS INT) THEN i_category WHEN CAST(11 AS INT) THEN i_category WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(7 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN i_class WHEN CAST(9 AS INT) THEN i_class WHEN CAST(10 AS INT) THEN i_class WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(5 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(7 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(9 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(5 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(7 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_year WHEN CAST(5 AS INT) THEN d_year WHEN CAST(6 AS INT) THEN d_year WHEN CAST(7 AS INT) THEN d_year WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_qoy WHEN CAST(5 AS INT) THEN d_qoy WHEN CAST(6 AS INT) THEN d_qoy WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_moy WHEN CAST(5 AS INT) THEN d_moy WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN s_store_id WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(7 AS INT) THEN CAST(7 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(9 AS INT) THEN CAST(9 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(11 AS INT) THEN CAST(11 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=578.50MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=92B cardinality=12.38G cost=73050686125
|
||||
| in pipelines: 08(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id
|
||||
| Class 1
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, NULL
|
||||
| Class 2
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, NULL, NULL
|
||||
| Class 3
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, NULL, NULL, NULL, NULL
|
||||
| Class 5
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 6
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 7
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 8
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| mem-estimate=6.57GB mem-reservation=210.75MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=12.38G cost=97683994945
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(i_category) WHEN 7 THEN murmur_hash(i_category) WHEN 8 THEN murmur_hash(i_category) WHEN 9 THEN murmur_hash(i_category) WHEN 10 THEN murmur_hash(i_category) WHEN 11 THEN murmur_hash(i_category) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 6 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(i_class) WHEN 8 THEN murmur_hash(i_class) WHEN 9 THEN murmur_hash(i_class) WHEN 10 THEN murmur_hash(i_class) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 6 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 8 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(i_brand) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 6 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 8 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_year) WHEN 5 THEN murmur_hash(d_year) WHEN 6 THEN murmur_hash(d_year) WHEN 7 THEN murmur_hash(d_year) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_qoy) WHEN 5 THEN murmur_hash(d_qoy) WHEN 6 THEN murmur_hash(d_qoy) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_moy) WHEN 5 THEN murmur_hash(d_moy) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(s_store_id) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=145.58MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=30.30G cost=168543428414
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=4.49GB mem-reservation=219.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[257850166519, 2328086935759] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id
|
||||
| Class 1
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, NULL
|
||||
| Class 2
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, NULL, NULL
|
||||
| Class 3
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, NULL, NULL, NULL, NULL
|
||||
| Class 5
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 6
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 7
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 8
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| mem-estimate=4.17GB mem-reservation=211.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=30.30G cost=244022435997
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=177B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=78.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=32B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[533]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=32B cardinality=1.35K cost=388
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=145B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=166.68KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[25695]
|
||||
| 22:TUPLE CACHE
|
||||
| | cache key: ea0d7f0c7b6c4b079628d53f69c3fe8b
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 171.21KB
|
||||
| | estimated serialized size per node: 171.21KB
|
||||
| | cumulative processing cost: 25143
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 473
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=7.30K cost=25143
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=125B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.42MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.42MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=105B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.42MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[403500]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 32065b2a67aa85f1f02da78b4b550299
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=8.64G(filtered from 8.64G) cost=2488301335
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=4.71GB Threads=27
|
||||
Per-Host Resource Estimates: Memory=104.39GB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.10MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1044] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sumsales, rk
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=1000
|
||||
|
|
||||
20:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: i_category ASC, i_class ASC, i_brand ASC, i_product_name ASC, d_year ASC, d_qoy ASC, d_moy ASC, s_store_id ASC, sumsales ASC, rk ASC
|
||||
| limit: 100
|
||||
| mem-estimate=98.59KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=18 row-size=96B cardinality=100 cost=44
|
||||
| in pipelines: 12(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=5.30MB mem-reservation=4.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[967, 1261, 282] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
|
||||
12:TOP-N [LIMIT=100]
|
||||
| order by: i_category ASC, i_class ASC, i_brand ASC, i_product_name ASC, d_year ASC, d_qoy ASC, d_moy ASC, s_store_id ASC, sumsales ASC, rk ASC
|
||||
| mem-estimate=9.38KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=18 row-size=96B cardinality=100 cost=861
|
||||
| in pipelines: 12(GETNEXT), 19(OPEN)
|
||||
|
|
||||
11:SELECT
|
||||
| predicates: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 19(GETNEXT)
|
||||
|
|
||||
10:ANALYTIC
|
||||
| functions: rank()
|
||||
| partition by: i_category
|
||||
| order by: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=25,24 row-size=100B cardinality=200 cost=200
|
||||
| in pipelines: 19(GETNEXT)
|
||||
|
|
||||
19:TOP-N
|
||||
| order by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END ASC NULLS LAST, aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| limit with ties: 200
|
||||
| mem-estimate=17.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=861
|
||||
| in pipelines: 19(GETNEXT), 09(OPEN)
|
||||
|
|
||||
18:EXCHANGE [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END)]
|
||||
| mem-estimate=1.28MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=106
|
||||
| in pipelines: 09(GETNEXT)
|
||||
|
|
||||
F04:PLAN FRAGMENT [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(i_category) WHEN 7 THEN murmur_hash(i_category) WHEN 8 THEN murmur_hash(i_category) WHEN 9 THEN murmur_hash(i_category) WHEN 10 THEN murmur_hash(i_category) WHEN 11 THEN murmur_hash(i_category) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 6 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(i_class) WHEN 8 THEN murmur_hash(i_class) WHEN 9 THEN murmur_hash(i_class) WHEN 10 THEN murmur_hash(i_class) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 6 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 8 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(i_brand) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 6 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 8 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_year) WHEN 5 THEN murmur_hash(d_year) WHEN 6 THEN murmur_hash(d_year) WHEN 7 THEN murmur_hash(d_year) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_qoy) WHEN 5 THEN murmur_hash(d_qoy) WHEN 6 THEN murmur_hash(d_qoy) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_moy) WHEN 5 THEN murmur_hash(d_moy) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(s_store_id) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END)] hosts=10 instances=70 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=7.14GB mem-reservation=244.75MB thread-reservation=1
|
||||
max-parallelism=26630 segment-costs=[266227423359, 73050686125, 233936768446, 1288] cpu-comparison-result=120 [max(70 (self) vs 120 (sum children))]
|
||||
09:TOP-N
|
||||
| order by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN i_category WHEN 5 THEN i_category WHEN 6 THEN i_category WHEN 7 THEN i_category WHEN 8 THEN i_category WHEN 9 THEN i_category WHEN 10 THEN i_category WHEN 11 THEN i_category WHEN 12 THEN NULL END ASC NULLS LAST, aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (4, 5, 6, 7, 8, 9, 10, 11, 12), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 5 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 6 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 7 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 8 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 9 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 10 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 11 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN 12 THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END) DESC
|
||||
| limit with ties: 200
|
||||
| source expr: rank() <= CAST(100 AS BIGINT)
|
||||
| mem-estimate=17.97KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=25 row-size=92B cardinality=200 cost=233936768446
|
||||
| in pipelines: 09(GETNEXT), 08(OPEN)
|
||||
|
|
||||
08:AGGREGATE [FINALIZE]
|
||||
| output: aggif(valid_tid(4,5,6,7,8,9,10,11,12) IN (CAST(4 AS INT), CAST(5 AS INT), CAST(6 AS INT), CAST(7 AS INT), CAST(8 AS INT), CAST(9 AS INT), CAST(10 AS INT), CAST(11 AS INT), CAST(12 AS INT)), CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(5 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(6 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(7 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(8 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(9 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(10 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(11 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) WHEN CAST(12 AS INT) THEN sum(coalesce(ss_sales_price * ss_quantity, 0)) END)
|
||||
| group by: CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_category WHEN CAST(5 AS INT) THEN i_category WHEN CAST(6 AS INT) THEN i_category WHEN CAST(7 AS INT) THEN i_category WHEN CAST(8 AS INT) THEN i_category WHEN CAST(9 AS INT) THEN i_category WHEN CAST(10 AS INT) THEN i_category WHEN CAST(11 AS INT) THEN i_category WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_class WHEN CAST(5 AS INT) THEN i_class WHEN CAST(6 AS INT) THEN i_class WHEN CAST(7 AS INT) THEN i_class WHEN CAST(8 AS INT) THEN i_class WHEN CAST(9 AS INT) THEN i_class WHEN CAST(10 AS INT) THEN i_class WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_brand WHEN CAST(5 AS INT) THEN i_brand WHEN CAST(6 AS INT) THEN i_brand WHEN CAST(7 AS INT) THEN i_brand WHEN CAST(8 AS INT) THEN i_brand WHEN CAST(9 AS INT) THEN i_brand WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN i_product_name WHEN CAST(5 AS INT) THEN i_product_name WHEN CAST(6 AS INT) THEN i_product_name WHEN CAST(7 AS INT) THEN i_product_name WHEN CAST(8 AS INT) THEN i_product_name WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_year WHEN CAST(5 AS INT) THEN d_year WHEN CAST(6 AS INT) THEN d_year WHEN CAST(7 AS INT) THEN d_year WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_qoy WHEN CAST(5 AS INT) THEN d_qoy WHEN CAST(6 AS INT) THEN d_qoy WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN d_moy WHEN CAST(5 AS INT) THEN d_moy WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN s_store_id WHEN CAST(5 AS INT) THEN NULL WHEN CAST(6 AS INT) THEN NULL WHEN CAST(7 AS INT) THEN NULL WHEN CAST(8 AS INT) THEN NULL WHEN CAST(9 AS INT) THEN NULL WHEN CAST(10 AS INT) THEN NULL WHEN CAST(11 AS INT) THEN NULL WHEN CAST(12 AS INT) THEN NULL END, CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN CAST(4 AS INT) THEN CAST(4 AS INT) WHEN CAST(5 AS INT) THEN CAST(5 AS INT) WHEN CAST(6 AS INT) THEN CAST(6 AS INT) WHEN CAST(7 AS INT) THEN CAST(7 AS INT) WHEN CAST(8 AS INT) THEN CAST(8 AS INT) WHEN CAST(9 AS INT) THEN CAST(9 AS INT) WHEN CAST(10 AS INT) THEN CAST(10 AS INT) WHEN CAST(11 AS INT) THEN CAST(11 AS INT) WHEN CAST(12 AS INT) THEN CAST(12 AS INT) END
|
||||
| mem-estimate=578.50MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=13 row-size=92B cardinality=12.38G cost=73050686125
|
||||
| in pipelines: 08(GETNEXT), 17(OPEN)
|
||||
|
|
||||
17:AGGREGATE [FINALIZE]
|
||||
| Class 0
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id
|
||||
| Class 1
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, NULL
|
||||
| Class 2
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, NULL, NULL
|
||||
| Class 3
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, NULL, NULL, NULL, NULL
|
||||
| Class 5
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, i_brand, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 6
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, i_class, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 7
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: i_category, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 8
|
||||
| output: sum:merge(coalesce(ss_sales_price * ss_quantity, 0))
|
||||
| group by: NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| mem-estimate=6.57GB mem-reservation=210.75MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=12.38G cost=97683994945
|
||||
| in pipelines: 17(GETNEXT), 00(OPEN)
|
||||
|
|
||||
16:EXCHANGE [HASH(CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_category) WHEN 5 THEN murmur_hash(i_category) WHEN 6 THEN murmur_hash(i_category) WHEN 7 THEN murmur_hash(i_category) WHEN 8 THEN murmur_hash(i_category) WHEN 9 THEN murmur_hash(i_category) WHEN 10 THEN murmur_hash(i_category) WHEN 11 THEN murmur_hash(i_category) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_class) WHEN 5 THEN murmur_hash(i_class) WHEN 6 THEN murmur_hash(i_class) WHEN 7 THEN murmur_hash(i_class) WHEN 8 THEN murmur_hash(i_class) WHEN 9 THEN murmur_hash(i_class) WHEN 10 THEN murmur_hash(i_class) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_brand) WHEN 5 THEN murmur_hash(i_brand) WHEN 6 THEN murmur_hash(i_brand) WHEN 7 THEN murmur_hash(i_brand) WHEN 8 THEN murmur_hash(i_brand) WHEN 9 THEN murmur_hash(i_brand) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(i_product_name) WHEN 5 THEN murmur_hash(i_product_name) WHEN 6 THEN murmur_hash(i_product_name) WHEN 7 THEN murmur_hash(i_product_name) WHEN 8 THEN murmur_hash(i_product_name) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_year) WHEN 5 THEN murmur_hash(d_year) WHEN 6 THEN murmur_hash(d_year) WHEN 7 THEN murmur_hash(d_year) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_qoy) WHEN 5 THEN murmur_hash(d_qoy) WHEN 6 THEN murmur_hash(d_qoy) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(d_moy) WHEN 5 THEN murmur_hash(d_moy) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END,CASE valid_tid(4,5,6,7,8,9,10,11,12) WHEN 4 THEN murmur_hash(s_store_id) WHEN 5 THEN murmur_hash(NULL) WHEN 6 THEN murmur_hash(NULL) WHEN 7 THEN murmur_hash(NULL) WHEN 8 THEN murmur_hash(NULL) WHEN 9 THEN murmur_hash(NULL) WHEN 10 THEN murmur_hash(NULL) WHEN 11 THEN murmur_hash(NULL) WHEN 12 THEN murmur_hash(NULL) END)]
|
||||
| mem-estimate=145.58MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=30.30G cost=168543428414
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
Per-Instance Resources: mem-estimate=4.49GB mem-reservation=219.00MB thread-reservation=1
|
||||
max-parallelism=1824 segment-costs=[257850166519, 2328086935759] cpu-comparison-result=120 [max(120 (self) vs 36 (sum children))]
|
||||
07:AGGREGATE [STREAMING]
|
||||
| Class 0
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id
|
||||
| Class 1
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, NULL
|
||||
| Class 2
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, d_qoy, NULL, NULL
|
||||
| Class 3
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, d_year, NULL, NULL, NULL
|
||||
| Class 4
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, i_product_name, NULL, NULL, NULL, NULL
|
||||
| Class 5
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, i_brand, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 6
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, i_class, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 7
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: i_category, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| Class 8
|
||||
| output: sum(coalesce(ss_sales_price * CAST(ss_quantity AS DECIMAL(10,0)), CAST(0 AS DECIMAL(18,2))))
|
||||
| group by: NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL
|
||||
| mem-estimate=4.17GB mem-reservation=211.00MB thread-reservation=0
|
||||
| tuple-ids=4N,5N,6N,7N,8N,9N,10N,11N,12N row-size=1.09KB cardinality=30.30G cost=244022435997
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_store_sk = s_store_sk
|
||||
| fk/pk conjuncts: ss_store_sk = s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1,2 row-size=177B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[3140]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: s_store_sk
|
||||
| | runtime filters: RF000[bloom] <- s_store_sk, RF001[min_max] <- s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=78.19KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=32B cardinality=1.35K cost=1790
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=16.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[533]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=32B cardinality=1.35K cost=388
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,3,1 row-size=145B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[17005]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=7305
|
||||
| |
|
||||
| 14:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=166.68KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=7.30K cost=9700
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.09MB mem-reservation=5.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[25695]
|
||||
| 22:TUPLE CACHE
|
||||
| | cache key: ea0d7f0c7b6c4b079628d53f69c3fe8b
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 171.21KB
|
||||
| | estimated serialized size per node: 171.21KB
|
||||
| | cumulative processing cost: 25143
|
||||
| | cache read processing cost: 970
|
||||
| | cache write processing cost: 473
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=20B cardinality=7.30K cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| parquet dictionary predicates: d_month_seq <= CAST(1207 AS INT), d_month_seq >= CAST(1196 AS INT)
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=1 row-size=20B cardinality=7.30K cost=25143
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=02
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,3 row-size=125B cardinality=8.64G cost=3779809729
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=419.42MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF004[bloom] <- i_item_sk, RF005[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 13:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.42MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=105B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=20.42MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[403500]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 32065b2a67aa85f1f02da78b4b550299
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 37.32MB
|
||||
| | estimated serialized size per node: 9.33MB
|
||||
| | cumulative processing cost: 293952
|
||||
| | cache read processing cost: 47844
|
||||
| | cache write processing cost: 105660
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=105B cardinality=360.00K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=105B cardinality=360.00K cost=293952
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF001[min_max] -> ss_store_sk, RF005[min_max] -> ss_item_sk, RF000[bloom] -> ss_store_sk, RF002[bloom] -> ss_sold_date_sk, RF004[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=20B cardinality=8.64G(filtered from 8.64G) cost=2488301335
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
920
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q68.test
vendored
Normal file
920
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q68.test
vendored
Normal file
@@ -0,0 +1,920 @@
|
||||
# TPCDS-Q68
|
||||
# start query 68 in stream 0 using template query68.tpl using seed 1161799381
|
||||
select c_last_name
|
||||
,c_first_name
|
||||
,ca_city
|
||||
,bought_city
|
||||
,ss_ticket_number
|
||||
,extended_price
|
||||
,extended_tax
|
||||
,list_price
|
||||
from (select ss_ticket_number
|
||||
,ss_customer_sk
|
||||
,ca_city bought_city
|
||||
,sum(ss_ext_sales_price) extended_price
|
||||
,sum(ss_ext_list_price) list_price
|
||||
,sum(ss_ext_tax) extended_tax
|
||||
from store_sales
|
||||
,date_dim
|
||||
,store
|
||||
,household_demographics
|
||||
,customer_address
|
||||
where store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
and store_sales.ss_store_sk = store.s_store_sk
|
||||
and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
and store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
and date_dim.d_dom between 1 and 2
|
||||
and (household_demographics.hd_dep_count = 1 or
|
||||
household_demographics.hd_vehicle_count= -1)
|
||||
and date_dim.d_year in (1998,1998+1,1998+2)
|
||||
and store.s_city in ('Bethel','Summit')
|
||||
group by ss_ticket_number
|
||||
,ss_customer_sk
|
||||
,ss_addr_sk,ca_city) dn
|
||||
,customer
|
||||
,customer_address current_addr
|
||||
where ss_customer_sk = c_customer_sk
|
||||
and customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
and current_addr.ca_city <> bought_city
|
||||
order by c_last_name
|
||||
,ss_ticket_number
|
||||
limit 100;
|
||||
|
||||
# end query 68 in stream 0 using template query68.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=201.94MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=5.19GB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=5.19GB mem-reservation=201.94MB thread-reservation=1 runtime-filters-memory=51.00MB
|
||||
| max-parallelism=1 segment-costs=[1253773609, 299743160, 800]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, ss_ticket_number ASC
|
||||
| mem-estimate=13.07KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=134B cardinality=100 cost=228175582
|
||||
| in pipelines: 14(GETNEXT), 09(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| mem-estimate=740.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=154B cardinality=16.86M cost=22378769
|
||||
| in pipelines: 09(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
12:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| mem-estimate=1.98GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=129B cardinality=16.86M cost=37765156
|
||||
| in pipelines: 09(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
09:AGGREGATE [FINALIZE]
|
||||
| output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=1.66GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=110968940
|
||||
| in pipelines: 09(GETNEXT), 00(OPEN)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| mem-estimate=740.95MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3,4 row-size=114B cardinality=18.36M cost=23196049
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
07:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=89B cardinality=18.98M cost=23390681
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--17:TUPLE CACHE
|
||||
| | cache key: 4135367fab9a91974527d5fce1d73f2f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(1 AS INT) OR household_demographics.hd_vehicle_count = CAST(-1 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| runtime filters: RF008[bloom] <- date_dim.d_date_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=77B cardinality=77.78M cost=34512003
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--16:TUPLE CACHE
|
||||
| | cache key: c23dc6b7dcdc9f2ffdc7a2af607a8a23
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.53KB
|
||||
| | estimated serialized size per node: 5.53KB
|
||||
| | cumulative processing cost: 18780
|
||||
| | cache read processing cost: 47
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=65B cardinality=79.60M(filtered from 400.75M) cost=93033890
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: 98117506cd8bec2a6fe7ee9749e0ae05
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 902B
|
||||
| | estimated serialized size per node: 902B
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| parquet dictionary predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=31 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=40B cardinality=79.60M(filtered from 8.64G) cost=965853808
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=723.58MB Threads=38
|
||||
Per-Host Resource Estimates: Memory=1.54GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[852] cpu-comparison-result=210 [max(1 (self) vs 210 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, ss_ticket_number ASC
|
||||
| limit: 100
|
||||
| mem-estimate=405.25KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=134B cardinality=100 cost=52
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=12.69MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[248045009, 382] cpu-comparison-result=210 [max(50 (self) vs 210 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, ss_ticket_number ASC
|
||||
| mem-estimate=13.07KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=134B cardinality=100 cost=228175582
|
||||
| in pipelines: 14(GETNEXT), 21(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=154B cardinality=16.86M cost=7378769
|
||||
| in pipelines: 21(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=60.28MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=30 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: current_addr.ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 25:EXCHANGE [HASH(current_addr.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=19.39MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
24:EXCHANGE [HASH(customer.c_current_addr_sk)]
|
||||
| mem-estimate=12.67MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=129B cardinality=16.86M cost=12490658
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F08:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=27.78MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[174315387]
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=129B cardinality=16.86M cost=7765156
|
||||
| in pipelines: 21(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=127.76MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=20 segment-costs=[39400506]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=101.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 23:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=44B cardinality=30.00M cost=9400506
|
||||
| | in pipelines: 10(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=19.75MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[109027022]
|
||||
| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
22:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=11.74MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=9216762
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=96.64MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[120185702, 109931994] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))]
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price), sum:merge(ss_ext_list_price), sum:merge(ss_ext_tax)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=84.90MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=110968940
|
||||
| in pipelines: 21(GETNEXT), 00(OPEN)
|
||||
|
|
||||
20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)]
|
||||
| mem-estimate=11.74MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=9216762
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=92.94MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[131148047, 109931994] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=63.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=110968940
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3,4 row-size=114B cardinality=18.36M cost=8196049
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=63.33MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=20 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: customer_address.ca_address_sk
|
||||
| | runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| | mem-estimate=37.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 19:EXCHANGE [HASH(customer_address.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=18.26MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
18:EXCHANGE [HASH(store_sales.ss_addr_sk)]
|
||||
| mem-estimate=22.32MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=89B cardinality=18.98M cost=11983058
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=24.21MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=130 segment-costs=[1264807850]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=89B cardinality=18.98M cost=23388881
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=37.09KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.06MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1543]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 4135367fab9a91974527d5fce1d73f2f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(1 AS INT) OR household_demographics.hd_vehicle_count = CAST(-1 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=77B cardinality=77.78M cost=34511649
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[824]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: date_dim.d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[18799]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: c23dc6b7dcdc9f2ffdc7a2af607a8a23
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.53KB
|
||||
| | estimated serialized size per node: 5.53KB
|
||||
| | cumulative processing cost: 18780
|
||||
| | cache read processing cost: 47
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=65B cardinality=79.60M(filtered from 400.75M) cost=93033859
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: store.s_store_sk
|
||||
| | runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.11MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[294]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 98117506cd8bec2a6fe7ee9749e0ae05
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 902B
|
||||
| | estimated serialized size per node: 902B
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| parquet dictionary predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=31 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=40B cardinality=79.60M(filtered from 8.64G) cost=965853808
|
||||
in pipelines: 00(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=723.58MB Threads=38
|
||||
Per-Host Resource Estimates: Memory=1.54GB
|
||||
F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[852] cpu-comparison-result=210 [max(1 (self) vs 210 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=800
|
||||
|
|
||||
26:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: c_last_name ASC, ss_ticket_number ASC
|
||||
| limit: 100
|
||||
| mem-estimate=405.25KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=134B cardinality=100 cost=52
|
||||
| in pipelines: 14(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=12.69MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=30 segment-costs=[248045009, 382] cpu-comparison-result=210 [max(50 (self) vs 210 (sum children))]
|
||||
14:TOP-N [LIMIT=100]
|
||||
| order by: c_last_name ASC, ss_ticket_number ASC
|
||||
| mem-estimate=13.07KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=134B cardinality=100 cost=228175582
|
||||
| in pipelines: 14(GETNEXT), 21(OPEN)
|
||||
|
|
||||
13:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=00
|
||||
| hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| fk/pk conjuncts: customer.c_current_addr_sk = current_addr.ca_address_sk
|
||||
| other predicates: current_addr.ca_city != ca_city
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7,8 row-size=154B cardinality=16.86M cost=7378769
|
||||
| in pipelines: 21(GETNEXT), 11(OPEN)
|
||||
|
|
||||
|--F12:PLAN FRAGMENT [HASH(customer.c_current_addr_sk)] hosts=10 instances=30 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=60.28MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=30 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: current_addr.ca_address_sk
|
||||
| | runtime filters: RF000[bloom] <- current_addr.ca_address_sk, RF001[min_max] <- current_addr.ca_address_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 25:EXCHANGE [HASH(current_addr.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=8 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=19.39MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address current_addr, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=8 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
24:EXCHANGE [HASH(customer.c_current_addr_sk)]
|
||||
| mem-estimate=12.67MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=129B cardinality=16.86M cost=12490658
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F08:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=27.78MB mem-reservation=0B thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[174315387]
|
||||
12:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_customer_sk = c_customer_sk
|
||||
| fk/pk conjuncts: ss_customer_sk = c_customer_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5,7 row-size=129B cardinality=16.86M cost=7765156
|
||||
| in pipelines: 21(GETNEXT), 10(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [HASH(ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=127.76MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=20 segment-costs=[39400506]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: c_customer_sk
|
||||
| | runtime filters: RF002[bloom] <- c_customer_sk, RF003[min_max] <- c_customer_sk
|
||||
| | mem-estimate=101.30MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
|
||||
| |
|
||||
| 23:EXCHANGE [HASH(c_customer_sk)]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=7 row-size=44B cardinality=30.00M cost=9400506
|
||||
| | in pipelines: 10(GETNEXT)
|
||||
| |
|
||||
| F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
|
||||
| Per-Instance Resources: mem-estimate=19.75MB mem-reservation=1.00MB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[109027022]
|
||||
| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=1.55GB
|
||||
| runtime filters: RF001[min_max] -> customer.c_current_addr_sk, RF000[bloom] -> customer.c_current_addr_sk
|
||||
| stored statistics:
|
||||
| table: rows=30.00M size=1.55GB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=44B cardinality=30.00M cost=8625933
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
22:EXCHANGE [HASH(ss_customer_sk)]
|
||||
| mem-estimate=11.74MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=9216762
|
||||
| in pipelines: 21(GETNEXT)
|
||||
|
|
||||
F06:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=96.64MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[120185702, 109931994] cpu-comparison-result=140 [max(20 (self) vs 140 (sum children))]
|
||||
21:AGGREGATE [FINALIZE]
|
||||
| output: sum:merge(ss_ext_sales_price), sum:merge(ss_ext_list_price), sum:merge(ss_ext_tax)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=84.90MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=110968940
|
||||
| in pipelines: 21(GETNEXT), 00(OPEN)
|
||||
|
|
||||
20:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)]
|
||||
| mem-estimate=11.74MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=9216762
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F05:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=92.94MB mem-reservation=34.00MB thread-reservation=1
|
||||
max-parallelism=20 segment-costs=[131148047, 109931994] cpu-comparison-result=140 [max(140 (self) vs 63 (sum children))]
|
||||
09:AGGREGATE [STREAMING]
|
||||
| output: sum(ss_ext_sales_price), sum(ss_ext_list_price), sum(ss_ext_tax)
|
||||
| group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city
|
||||
| mem-estimate=63.67MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=5 row-size=85B cardinality=18.36M cost=110968940
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| hash-table-id=02
|
||||
| hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| fk/pk conjuncts: store_sales.ss_addr_sk = customer_address.ca_address_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3,4 row-size=114B cardinality=18.36M cost=8196049
|
||||
| in pipelines: 00(GETNEXT), 04(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [HASH(store_sales.ss_addr_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| | Per-Instance Resources: mem-estimate=63.33MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
|
||||
| | max-parallelism=20 segment-costs=[18388216]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | build expressions: customer_address.ca_address_sk
|
||||
| | runtime filters: RF004[bloom] <- customer_address.ca_address_sk, RF005[min_max] <- customer_address.ca_address_sk
|
||||
| | mem-estimate=37.05MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
|
||||
| |
|
||||
| 19:EXCHANGE [HASH(customer_address.ca_address_sk)]
|
||||
| | mem-estimate=10.28MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=25B cardinality=15.00M cost=3388216
|
||||
| | in pipelines: 04(GETNEXT)
|
||||
| |
|
||||
| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| Per-Instance Resources: mem-estimate=18.26MB mem-reservation=128.00KB thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[34629749]
|
||||
| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=307.36MB
|
||||
| stored statistics:
|
||||
| table: rows=15.00M size=307.36MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.58M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=4 row-size=25B cardinality=15.00M cost=2797720
|
||||
| in pipelines: 04(GETNEXT)
|
||||
|
|
||||
18:EXCHANGE [HASH(store_sales.ss_addr_sk)]
|
||||
| mem-estimate=22.32MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=89B cardinality=18.98M cost=11983058
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=35.00MB mem-reservation=35.00MB thread-reservation=0 runtime-filters-memory=35.00MB
|
||||
Per-Instance Resources: mem-estimate=24.21MB mem-reservation=8.00MB thread-reservation=1
|
||||
max-parallelism=130 segment-costs=[1264807850]
|
||||
07:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=03
|
||||
| hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1,3 row-size=89B cardinality=18.98M cost=23388881
|
||||
| in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[4190]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | build expressions: household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
|
||||
| |
|
||||
| 17:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=37.09KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=2390
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.06MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[1543]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 4135367fab9a91974527d5fce1d73f2f
|
||||
| | input scan node ids: 3
|
||||
| | estimated serialized size: 28.12KB
|
||||
| | estimated serialized size per node: 28.12KB
|
||||
| | cumulative processing cost: 1446
|
||||
| | cache read processing cost: 239
|
||||
| | cache write processing cost: 77
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=12B cardinality=1.80K cost=0
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: (household_demographics.hd_dep_count = CAST(1 AS INT) OR household_demographics.hd_vehicle_count = CAST(-1 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=7.20K size=41.69KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=12B cardinality=1.80K cost=1446
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=04
|
||||
| hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2,1 row-size=77B cardinality=77.78M cost=34511649
|
||||
| in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
|
|
||||
|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[824]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | build expressions: date_dim.d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[18799]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: c23dc6b7dcdc9f2ffdc7a2af607a8a23
|
||||
| | input scan node ids: 1
|
||||
| | estimated serialized size: 5.53KB
|
||||
| | estimated serialized size per node: 5.53KB
|
||||
| | cumulative processing cost: 18780
|
||||
| | cache read processing cost: 47
|
||||
| | cache write processing cost: 15
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1998 AS INT), CAST(1999 AS INT), CAST(2000 AS INT))
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| in pipelines: 01(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=05
|
||||
| hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=0,2 row-size=65B cardinality=79.60M(filtered from 400.75M) cost=93033859
|
||||
| in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[71]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | build expressions: store.s_store_sk
|
||||
| | runtime filters: RF010[bloom] <- store.s_store_sk, RF011[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=31
|
||||
| |
|
||||
| 15:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=31 cost=40
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=20.11MB mem-reservation=4.02MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[294]
|
||||
| 27:TUPLE CACHE
|
||||
| | cache key: 98117506cd8bec2a6fe7ee9749e0ae05
|
||||
| | input scan node ids: 2
|
||||
| | estimated serialized size: 902B
|
||||
| | estimated serialized size per node: 902B
|
||||
| | cumulative processing cost: 292
|
||||
| | cache read processing cost: 4
|
||||
| | cache write processing cost: 2
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=25B cardinality=31 cost=0
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| stored statistics:
|
||||
| table: rows=1.35K size=119.76KB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| parquet statistics predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| parquet dictionary predicates: store.s_city IN ('Bethel', 'Summit')
|
||||
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=25B cardinality=31 cost=292
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
runtime filters: RF011[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> store_sales.ss_addr_sk, RF010[bloom] -> store_sales.ss_store_sk, RF008[bloom] -> store_sales.ss_sold_date_sk, RF006[bloom] -> store_sales.ss_hdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> store_sales.ss_addr_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=40B cardinality=79.60M(filtered from 8.64G) cost=965853808
|
||||
in pipelines: 00(GETNEXT)
|
||||
====
|
||||
1341
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q69.test
vendored
Normal file
1341
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q69.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1020
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q70.test
vendored
Normal file
1020
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q70.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1078
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q71.test
vendored
Normal file
1078
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q71.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
1329
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q72.test
vendored
Normal file
1329
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q72.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
750
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q73.test
vendored
Normal file
750
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q73.test
vendored
Normal file
@@ -0,0 +1,750 @@
|
||||
# TPCDS-Q73
|
||||
# start query 73 in stream 0 using template query73.tpl using seed 98663642
|
||||
select c_last_name
|
||||
,c_first_name
|
||||
,c_salutation
|
||||
,c_preferred_cust_flag
|
||||
,ss_ticket_number
|
||||
,cnt from
|
||||
(select ss_ticket_number
|
||||
,ss_customer_sk
|
||||
,count(*) cnt
|
||||
from store_sales,date_dim,store,household_demographics
|
||||
where store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
and store_sales.ss_store_sk = store.s_store_sk
|
||||
and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
and date_dim.d_dom between 1 and 2
|
||||
and (household_demographics.hd_buy_potential = '501-1000' or
|
||||
household_demographics.hd_buy_potential = 'Unknown')
|
||||
and household_demographics.hd_vehicle_count > 0
|
||||
and case when household_demographics.hd_vehicle_count > 0 then
|
||||
household_demographics.hd_dep_count/ household_demographics.hd_vehicle_count else null end > 1
|
||||
and date_dim.d_year in (1999,1999+1,1999+2)
|
||||
and store.s_county in ('Franklin Parish','Ziebach County','Luce County','Williamson County')
|
||||
group by ss_ticket_number,ss_customer_sk) dj,customer
|
||||
where ss_customer_sk = c_customer_sk
|
||||
and cnt between 1 and 5
|
||||
order by cnt desc, c_last_name asc;
|
||||
|
||||
# end query 73 in stream 0 using template query73.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=86.00MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=618MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=617.81MB mem-reservation=86.00MB thread-reservation=1 runtime-filters-memory=5.00MB
|
||||
| max-parallelism=1 segment-costs=[854404587, 17561131, 9933366]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=9933366
|
||||
|
|
||||
10:SORT
|
||||
| order by: cnt DESC, c_last_name ASC
|
||||
| mem-estimate=126.64MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=1.66M cost=6450420
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
16:TUPLE CACHE
|
||||
| cache key: de65317f6ac3a11e3b6495111635fe53
|
||||
| input scan node ids: 8,0,3,2,1
|
||||
| estimated serialized size: 151.90MB
|
||||
| estimated serialized size per node: 15.19MB
|
||||
| cumulative processing cost: 865515298
|
||||
| cache read processing cost: 220024
|
||||
| cache write processing cost: 430057
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=1.66M cost=0
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| mem-estimate=79.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=1.66M cost=2380200
|
||||
| in pipelines: 08(GETNEXT), 07(OPEN)
|
||||
|
|
||||
|--15:TUPLE CACHE
|
||||
| | cache key: bcafe6367470d77e571c6f1b9e86a04c
|
||||
| | input scan node ids: 0,3,2,1
|
||||
| | estimated serialized size: 37.89MB
|
||||
| | estimated serialized size per node: 3.79MB
|
||||
| | cumulative processing cost: 854404587
|
||||
| | cache read processing cost: 220024
|
||||
| | cache write processing cost: 107280
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=0
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [FINALIZE]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(5 AS BIGINT), count(*) >= CAST(1 AS BIGINT)
|
||||
| | mem-estimate=505.24MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=97721114
|
||||
| | in pipelines: 07(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | runtime filters: RF002[bloom] <- date_dim.d_date_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2,1 row-size=97B cardinality=16.56M cost=24880565
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--14:TUPLE CACHE
|
||||
| | | cache key: 71a7fabb7ea4a9d8e77608a97512d658
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 18780
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | runtime filters: RF004[bloom] <- store.s_store_sk, RF005[min_max] <- store.s_store_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2 row-size=85B cardinality=85.30M cost=39714751
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--13:TUPLE CACHE
|
||||
| | | cache key: f1248a101046ff46f4fe085d6cb5fa6d
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 3.88KB
|
||||
| | | estimated serialized size per node: 3.88KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 15
|
||||
| | | cache write processing cost: 10
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=117 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=117 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112554079
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--12:TUPLE CACHE
|
||||
| | | cache key: 8b5b1ca81da9b5af5737d49694a9f612
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown'), CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END > CAST(1 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_sold_date_sk, RF004[bloom] -> store_sales.ss_store_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
11:TUPLE CACHE
|
||||
| cache key: c293b599cd0ff0dcacdaafc61a26e9cd
|
||||
| input scan node ids: 8
|
||||
| estimated serialized size: 114.01MB
|
||||
| estimated serialized size per node: 11.40MB
|
||||
| cumulative processing cost: 8730511
|
||||
| cache read processing cost: 220024
|
||||
| cache write processing cost: 322777
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=68B cardinality=1.66M(filtered from 30.00M) cost=0
|
||||
| in pipelines: 08(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
deterministic scan range assignment: true
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=1.66M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=382.89MB Threads=20
|
||||
Per-Host Resource Estimates: Memory=734MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=113.49MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10617640] cpu-comparison-result=90 [max(1 (self) vs 90 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=9933366
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: cnt DESC, c_last_name ASC
|
||||
| mem-estimate=13.49MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=1.66M cost=684274
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=28.66MB mem-reservation=13.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[15905570, 3999486] cpu-comparison-result=90 [max(10 (self) vs 90 (sum children))]
|
||||
10:SORT
|
||||
| order by: cnt DESC, c_last_name ASC
|
||||
| mem-estimate=12.66MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=1.66M cost=6450420
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=1.66M cost=724639
|
||||
| in pipelines: 08(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=92.05MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| | max-parallelism=10 segment-costs=[3855801] cpu-comparison-result=90 [max(10 (self) vs 90 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_customer_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| | mem-estimate=79.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1655561
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=2200240
|
||||
| | in pipelines: 15(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=46.11MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[101083557, 125160] cpu-comparison-result=90 [max(20 (self) vs 90 (sum children))]
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(5 AS BIGINT), count(*) >= CAST(1 AS BIGINT)
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=97721114
|
||||
| | in pipelines: 15(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)]
|
||||
| | mem-estimate=12.11MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=3362443
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=90 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=31.88MB mem-reservation=21.00MB thread-reservation=1
|
||||
| max-parallelism=90 segment-costs=[854381906, 29853066] cpu-comparison-result=90 [max(90 (self) vs 33 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 66a2c86109ffcfe6ba03efd6a25fccc8
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 378.93MB
|
||||
| | estimated serialized size per node: 37.89MB
|
||||
| | cumulative processing cost: 854405831
|
||||
| | cache read processing cost: 2200239
|
||||
| | cache write processing cost: 1072803
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=97721114
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2,1 row-size=97B cardinality=16.56M cost=24880211
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.45MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[824]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: date_dim.d_date_sk
|
||||
| | | runtime filters: RF002[bloom] <- date_dim.d_date_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[18799]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: 71a7fabb7ea4a9d8e77608a97512d658
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 18780
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2 row-size=85B cardinality=85.30M cost=39714634
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.45MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[267]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: store.s_store_sk
|
||||
| | | runtime filters: RF004[bloom] <- store.s_store_sk, RF005[min_max] <- store.s_store_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=117
|
||||
| | |
|
||||
| | 12:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=117 cost=150
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[397]
|
||||
| | 19:TUPLE CACHE
|
||||
| | | cache key: f1248a101046ff46f4fe085d6cb5fa6d
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 3.88KB
|
||||
| | | estimated serialized size per node: 3.88KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 15
|
||||
| | | cache write processing cost: 10
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=117 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=117 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112553663
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.46MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[966]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: household_demographics.hd_demo_sk
|
||||
| | | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=416
|
||||
| | |
|
||||
| | 11:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=27.22KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=550
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.06MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[2672]
|
||||
| | 18:TUPLE CACHE
|
||||
| | | cache key: 8b5b1ca81da9b5af5737d49694a9f612
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown'), CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END > CAST(1 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_sold_date_sk, RF004[bloom] -> store_sales.ss_store_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=1.66M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=382.89MB Threads=20
|
||||
Per-Host Resource Estimates: Memory=734MB
|
||||
F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=113.49MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[10617640] cpu-comparison-result=90 [max(1 (self) vs 90 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt
|
||||
| mem-estimate=100.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=9933366
|
||||
|
|
||||
17:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: cnt DESC, c_last_name ASC
|
||||
| mem-estimate=13.49MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=1.66M cost=684274
|
||||
| in pipelines: 10(GETNEXT)
|
||||
|
|
||||
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
Per-Instance Resources: mem-estimate=28.66MB mem-reservation=13.00MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[15905570, 3999486] cpu-comparison-result=90 [max(10 (self) vs 90 (sum children))]
|
||||
10:SORT
|
||||
| order by: cnt DESC, c_last_name ASC
|
||||
| mem-estimate=12.66MB mem-reservation=12.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=7 row-size=80B cardinality=1.66M cost=6450420
|
||||
| in pipelines: 10(GETNEXT), 08(OPEN)
|
||||
|
|
||||
09:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: c_customer_sk = ss_customer_sk
|
||||
| fk/pk conjuncts: none
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=6,4 row-size=88B cardinality=1.66M cost=724639
|
||||
| in pipelines: 08(GETNEXT), 15(OPEN)
|
||||
|
|
||||
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=92.05MB mem-reservation=36.00MB thread-reservation=1 runtime-filters-memory=2.00MB
|
||||
| | max-parallelism=10 segment-costs=[3855801] cpu-comparison-result=90 [max(10 (self) vs 90 (sum children))]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: ss_customer_sk
|
||||
| | runtime filters: RF000[bloom] <- ss_customer_sk, RF001[min_max] <- ss_customer_sk
|
||||
| | mem-estimate=79.58MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1655561
|
||||
| |
|
||||
| 16:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=10.47MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=2200240
|
||||
| | in pipelines: 15(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=46.11MB mem-reservation=34.00MB thread-reservation=1
|
||||
| max-parallelism=20 segment-costs=[101083557, 125160] cpu-comparison-result=90 [max(20 (self) vs 90 (sum children))]
|
||||
| 15:AGGREGATE [FINALIZE]
|
||||
| | output: count:merge(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | having: count(*) <= CAST(5 AS BIGINT), count(*) >= CAST(1 AS BIGINT)
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=1.66M cost=97721114
|
||||
| | in pipelines: 15(GETNEXT), 00(OPEN)
|
||||
| |
|
||||
| 14:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk)]
|
||||
| | mem-estimate=12.11MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=3362443
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=90 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=3.00MB mem-reservation=3.00MB thread-reservation=0 runtime-filters-memory=3.00MB
|
||||
| Per-Instance Resources: mem-estimate=31.88MB mem-reservation=21.00MB thread-reservation=1
|
||||
| max-parallelism=90 segment-costs=[854381906, 29853066] cpu-comparison-result=90 [max(90 (self) vs 33 (sum children))]
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 66a2c86109ffcfe6ba03efd6a25fccc8
|
||||
| | input scan node ids: 0
|
||||
| | estimated serialized size: 378.93MB
|
||||
| | estimated serialized size per node: 37.89MB
|
||||
| | cumulative processing cost: 854405831
|
||||
| | cache read processing cost: 2200239
|
||||
| | cache write processing cost: 1072803
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=0
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 07:AGGREGATE [STREAMING]
|
||||
| | output: count(*)
|
||||
| | group by: ss_ticket_number, ss_customer_sk
|
||||
| | mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=20B cardinality=16.56M cost=97721114
|
||||
| | in pipelines: 00(GETNEXT)
|
||||
| |
|
||||
| 06:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=01
|
||||
| | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_sold_date_sk = date_dim.d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2,1 row-size=97B cardinality=16.56M cost=24880211
|
||||
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
||||
| |
|
||||
| |--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.45MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[824]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=01 plan-id=02 cohort-id=02
|
||||
| | | build expressions: date_dim.d_date_sk
|
||||
| | | runtime filters: RF002[bloom] <- date_dim.d_date_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=354
|
||||
| | |
|
||||
| | 13:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=470
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.06MB mem-reservation=4.50MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[18799]
|
||||
| | 20:TUPLE CACHE
|
||||
| | | cache key: 71a7fabb7ea4a9d8e77608a97512d658
|
||||
| | | input scan node ids: 1
|
||||
| | | estimated serialized size: 5.53KB
|
||||
| | | estimated serialized size per node: 5.53KB
|
||||
| | | cumulative processing cost: 18780
|
||||
| | | cache read processing cost: 47
|
||||
| | | cache write processing cost: 15
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=1 row-size=12B cardinality=354 cost=0
|
||||
| | | in pipelines: 01(GETNEXT)
|
||||
| | |
|
||||
| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | parquet statistics predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | parquet dictionary predicates: date_dim.d_dom <= CAST(2 AS INT), date_dim.d_dom >= CAST(1 AS INT), date_dim.d_year IN (CAST(1999 AS INT), CAST(2000 AS INT), CAST(2001 AS INT))
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=1 row-size=12B cardinality=354 cost=18780
|
||||
| | in pipelines: 01(GETNEXT)
|
||||
| |
|
||||
| 05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_store_sk = store.s_store_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3,2 row-size=85B cardinality=85.30M cost=39714634
|
||||
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
||||
| |
|
||||
| |--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.45MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[267]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=02
|
||||
| | | build expressions: store.s_store_sk
|
||||
| | | runtime filters: RF004[bloom] <- store.s_store_sk, RF005[min_max] <- store.s_store_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=117
|
||||
| | |
|
||||
| | 12:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=117 cost=150
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.13MB mem-reservation=4.02MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[397]
|
||||
| | 19:TUPLE CACHE
|
||||
| | | cache key: f1248a101046ff46f4fe085d6cb5fa6d
|
||||
| | | input scan node ids: 2
|
||||
| | | estimated serialized size: 3.88KB
|
||||
| | | estimated serialized size per node: 3.88KB
|
||||
| | | cumulative processing cost: 386
|
||||
| | | cache read processing cost: 15
|
||||
| | | cache write processing cost: 10
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=2 row-size=30B cardinality=117 cost=0
|
||||
| | | in pipelines: 02(GETNEXT)
|
||||
| | |
|
||||
| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=119.76KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | stored statistics:
|
||||
| | table: rows=1.35K size=119.76KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=1.35K
|
||||
| | parquet statistics predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | parquet dictionary predicates: store.s_county IN ('Franklin Parish', 'Ziebach County', 'Luce County', 'Williamson County')
|
||||
| | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
|
||||
| | tuple-ids=2 row-size=30B cardinality=117 cost=386
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | fk/pk conjuncts: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=0,3 row-size=56B cardinality=94.57M(filtered from 487.28M) cost=112553663
|
||||
| | in pipelines: 00(GETNEXT), 03(OPEN)
|
||||
| |
|
||||
| |--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=18.46MB mem-reservation=18.44MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[966]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=02
|
||||
| | | build expressions: household_demographics.hd_demo_sk
|
||||
| | | runtime filters: RF006[bloom] <- household_demographics.hd_demo_sk, RF007[min_max] <- household_demographics.hd_demo_sk
|
||||
| | | mem-estimate=17.44MB mem-reservation=17.44MB spill-buffer=64.00KB thread-reservation=0 cost=416
|
||||
| | |
|
||||
| | 11:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=27.22KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=550
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=20.14MB mem-reservation=4.06MB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[2672]
|
||||
| | 18:TUPLE CACHE
|
||||
| | | cache key: 8b5b1ca81da9b5af5737d49694a9f612
|
||||
| | | input scan node ids: 3
|
||||
| | | estimated serialized size: 14.42KB
|
||||
| | | estimated serialized size per node: 14.42KB
|
||||
| | | cumulative processing cost: 2628
|
||||
| | | cache read processing cost: 55
|
||||
| | | cache write processing cost: 39
|
||||
| | | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | | tuple-ids=3 row-size=32B cardinality=416 cost=0
|
||||
| | | in pipelines: 03(GETNEXT)
|
||||
| | |
|
||||
| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=41.69KB
|
||||
| | deterministic scan range assignment: true
|
||||
| | predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown'), CASE WHEN household_demographics.hd_vehicle_count > CAST(0 AS INT) THEN CAST(household_demographics.hd_dep_count AS DOUBLE) / CAST(household_demographics.hd_vehicle_count AS DOUBLE) ELSE NULL END > CAST(1 AS DOUBLE)
|
||||
| | stored statistics:
|
||||
| | table: rows=7.20K size=41.69KB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=7.20K
|
||||
| | parquet statistics predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | parquet dictionary predicates: household_demographics.hd_vehicle_count > CAST(0 AS INT), household_demographics.hd_buy_potential IN ('501-1000', 'Unknown')
|
||||
| | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=32B cardinality=416 cost=2628
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
| deterministic scan range assignment: true
|
||||
| runtime filters: RF005[min_max] -> store_sales.ss_store_sk, RF007[min_max] -> store_sales.ss_hdemo_sk, RF002[bloom] -> store_sales.ss_sold_date_sk, RF004[bloom] -> store_sales.ss_store_sk, RF006[bloom] -> store_sales.ss_hdemo_sk
|
||||
| stored statistics:
|
||||
| table: rows=8.64G size=389.90GB
|
||||
| partitions: 1824/1824 rows=8.64G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=354(filtered from 1824)
|
||||
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
| tuple-ids=0 row-size=24B cardinality=94.57M(filtered from 8.64G) cost=579512284
|
||||
| in pipelines: 00(GETNEXT)
|
||||
|
|
||||
08:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
|
||||
HDFS partitions=1/1 files=1 size=1.55GB
|
||||
runtime filters: RF001[min_max] -> c_customer_sk, RF000[bloom] -> c_customer_sk
|
||||
stored statistics:
|
||||
table: rows=30.00M size=1.55GB
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=3.10M
|
||||
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
tuple-ids=6 row-size=68B cardinality=1.66M(filtered from 30.00M) cost=8730511
|
||||
in pipelines: 08(GETNEXT)
|
||||
====
|
||||
1700
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q74.test
vendored
Normal file
1700
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q74.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
2917
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q75.test
vendored
Normal file
2917
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q75.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
951
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q76.test
vendored
Normal file
951
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q76.test
vendored
Normal file
@@ -0,0 +1,951 @@
|
||||
# TPCDS-Q76
|
||||
# start query 76 in stream 0 using template query76.tpl using seed 569188543
|
||||
select channel, col_name, d_year, d_qoy, i_category, COUNT(*) sales_cnt, SUM(ext_sales_price) sales_amt FROM (
|
||||
SELECT 'store' as channel, 'ss_cdemo_sk' col_name, d_year, d_qoy, i_category, ss_ext_sales_price ext_sales_price
|
||||
FROM store_sales, item, date_dim
|
||||
WHERE ss_cdemo_sk IS NULL
|
||||
AND ss_sold_date_sk=d_date_sk
|
||||
AND ss_item_sk=i_item_sk
|
||||
UNION ALL
|
||||
SELECT 'web' as channel, 'ws_ship_hdemo_sk' col_name, d_year, d_qoy, i_category, ws_ext_sales_price ext_sales_price
|
||||
FROM web_sales, item, date_dim
|
||||
WHERE ws_ship_hdemo_sk IS NULL
|
||||
AND ws_sold_date_sk=d_date_sk
|
||||
AND ws_item_sk=i_item_sk
|
||||
UNION ALL
|
||||
SELECT 'catalog' as channel, 'cs_ship_customer_sk' col_name, d_year, d_qoy, i_category, cs_ext_sales_price ext_sales_price
|
||||
FROM catalog_sales, item, date_dim
|
||||
WHERE cs_ship_customer_sk IS NULL
|
||||
AND cs_sold_date_sk=d_date_sk
|
||||
AND cs_item_sk=i_item_sk) foo
|
||||
GROUP BY channel, col_name, d_year, d_qoy, i_category
|
||||
ORDER BY channel, col_name, d_year, d_qoy, i_category
|
||||
limit 100;
|
||||
|
||||
# end query 76 in stream 0 using template query76.tpl
|
||||
---- PLAN
|
||||
Max Per-Host Resource Reservation: Memory=70.38MB Threads=1
|
||||
Per-Host Resource Estimates: Memory=119MB
|
||||
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=118.75MB mem-reservation=70.38MB thread-reservation=1 runtime-filters-memory=6.00MB
|
||||
| max-parallelism=1 segment-costs=[4943851787, 640746, 700]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: channel, col_name, d_year, d_qoy, i_category, count(*), sum(ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: channel ASC, col_name ASC, d_year ASC, d_qoy ASC, i_category ASC
|
||||
| mem-estimate=7.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=74B cardinality=100 cost=640746
|
||||
| in pipelines: 17(GETNEXT), 16(OPEN)
|
||||
|
|
||||
22:TUPLE CACHE
|
||||
| cache key: c8e3a2d2a35f5b74ebe1de80d036300e
|
||||
| input scan node ids: 1,2,3,6,7,8,11,12,13
|
||||
| estimated serialized size: 5.24MB
|
||||
| estimated serialized size per node: 536.81KB
|
||||
| cumulative processing cost: 4943851787
|
||||
| cache read processing cost: 9377
|
||||
| cache write processing cost: 14841
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=70.56K cost=0
|
||||
| in pipelines: 16(GETNEXT)
|
||||
|
|
||||
16:AGGREGATE [FINALIZE]
|
||||
| output: count(*), sum(ext_sales_price)
|
||||
| group by: channel, col_name, d_year, d_qoy, i_category
|
||||
| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=70.56K cost=593480104
|
||||
| in pipelines: 16(GETNEXT), 01(OPEN), 06(OPEN), 11(OPEN)
|
||||
|
|
||||
00:UNION
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=54B cardinality=410.75M cost=80744403
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
|--15:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7,8 row-size=50B cardinality=21.59M cost=9521576
|
||||
| | in pipelines: 11(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | runtime filters: RF010[bloom] <- i_item_sk, RF011[min_max] <- i_item_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=38B cardinality=21.59M cost=9811295
|
||||
| | in pipelines: 11(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 21:TUPLE CACHE
|
||||
| | cache key: 19c7bde767ea32ad57bb3b64385f8181
|
||||
| | input scan node ids: 11
|
||||
| | estimated serialized size: 411.94MB
|
||||
| | estimated serialized size per node: 41.19MB
|
||||
| | cumulative processing cost: 1116740157
|
||||
| | cache read processing cost: 2870315
|
||||
| | cache write processing cost: 1166268
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=16B cardinality=21.60M cost=0
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cs_ship_customer_sk IS NULL
|
||||
| runtime filters: RF011[min_max] -> cs_item_sk, RF008[bloom] -> cs_sold_date_sk, RF010[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=21.60M cost=1116740157
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
|--20:TUPLE CACHE
|
||||
| | cache key: f5f5b75870671514c35af03d7079f8bb
|
||||
| | input scan node ids: 6,7,8
|
||||
| | estimated serialized size: 31.83MB
|
||||
| | estimated serialized size per node: 3.18MB
|
||||
| | cumulative processing cost: 559320804
|
||||
| | cache read processing cost: 71657
|
||||
| | cache write processing cost: 90120
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,4,5 row-size=50B cardinality=539.18K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 10:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4,5 row-size=50B cardinality=539.18K cost=309048
|
||||
| | in pipelines: 06(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 19:TUPLE CACHE
|
||||
| | cache key: 0c0ef15669884da97a76f09b860434c6
|
||||
| | input scan node ids: 6,7
|
||||
| | estimated serialized size: 23.60MB
|
||||
| | estimated serialized size per node: 2.36MB
|
||||
| | cumulative processing cost: 558999134
|
||||
| | cache read processing cost: 71657
|
||||
| | cache write processing cost: 66827
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=38B cardinality=539.18K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 09:HASH JOIN [INNER JOIN]
|
||||
| | hash predicates: ws_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| | runtime filters: RF006[bloom] <- i_item_sk, RF007[min_max] <- i_item_sk
|
||||
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=38B cardinality=539.18K cost=596068
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | deterministic scan range assignment: true
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 18:TUPLE CACHE
|
||||
| | cache key: 3161661b0407c3bfeef91b011b1f379e
|
||||
| | input scan node ids: 6
|
||||
| | estimated serialized size: 10.29MB
|
||||
| | estimated serialized size per node: 1.03MB
|
||||
| | cumulative processing cost: 558351719
|
||||
| | cache read processing cost: 71692
|
||||
| | cache write processing cost: 29130
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=16B cardinality=539.45K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ws_ship_hdemo_sk IS NULL
|
||||
| runtime filters: RF007[min_max] -> ws_item_sk, RF004[bloom] -> ws_sold_date_sk, RF006[bloom] -> ws_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=16B cardinality=539.45K cost=558351719
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| runtime filters: RF000[bloom] <- d_date_sk
|
||||
| mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=50B cardinality=388.62M cost=170172736
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=73.05K cost=12622
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN]
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=38B cardinality=388.62M cost=170509527
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| deterministic scan range assignment: true
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
deterministic scan range assignment: true
|
||||
predicates: ss_cdemo_sk IS NULL
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=388.82M cost=2233423247
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- DISTRIBUTEDPLAN
|
||||
Max Per-Host Resource Reservation: Memory=1.24GB Threads=43
|
||||
Per-Host Resource Estimates: Memory=1.75GB
|
||||
F12:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[740] cpu-comparison-result=185 [max(1 (self) vs 185 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: channel, col_name, d_year, d_qoy, i_category, count(*), sum(ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
27:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: channel ASC, col_name ASC, d_year ASC, d_qoy ASC, i_category ASC
|
||||
| limit: 100
|
||||
| mem-estimate=76.81KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=74B cardinality=100 cost=40
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F11:PLAN FRAGMENT [HASH(channel,col_name,d_year,d_qoy,i_category)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=29.13MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[16366258, 640746, 225] cpu-comparison-result=185 [max(10 (self) vs 185 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: channel ASC, col_name ASC, d_year ASC, d_qoy ASC, i_category ASC
|
||||
| mem-estimate=7.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=74B cardinality=100 cost=640746
|
||||
| in pipelines: 17(GETNEXT), 26(OPEN)
|
||||
|
|
||||
26:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*), sum:merge(ext_sales_price)
|
||||
| group by: channel, col_name, d_year, d_qoy, i_category
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=70.56K cost=12547014
|
||||
| in pipelines: 26(GETNEXT), 01(OPEN), 06(OPEN), 11(OPEN)
|
||||
|
|
||||
25:EXCHANGE [HASH(channel,col_name,d_year,d_qoy,i_category)]
|
||||
| mem-estimate=19.13MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=8.47M cost=3819244
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=33.04MB mem-reservation=17.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[4422132834, 44661836] cpu-comparison-result=185 [max(180 (self) vs 185 (sum children))]
|
||||
16:AGGREGATE [STREAMING]
|
||||
| output: count(*), sum(ext_sales_price)
|
||||
| group by: channel, col_name, d_year, d_qoy, i_category
|
||||
| mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=8.47M cost=631504288
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
00:UNION
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=54B cardinality=410.75M cost=80744403
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
|--15:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=04
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7,8 row-size=50B cardinality=21.59M cost=9448527
|
||||
| | in pipelines: 11(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=58.85MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[170129]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 24:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=12B cardinality=73.05K cost=97080
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[16566]
|
||||
| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=05
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=38B cardinality=21.59M cost=9451295
|
||||
| | in pipelines: 11(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=416.62MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[838440]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF010[bloom] <- i_item_sk, RF011[min_max] <- i_item_sk
|
||||
| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| | |
|
||||
| | 23:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=7.62MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=22B cardinality=360.00K cost=478440
|
||||
| | | in pipelines: 12(GETNEXT)
|
||||
| | |
|
||||
| | F08:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=16.10MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[80414]
|
||||
| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 37a660abf9cc0548494f068c76e0533c
|
||||
| | input scan node ids: 11
|
||||
| | estimated serialized size: 411.94MB
|
||||
| | estimated serialized size per node: 41.19MB
|
||||
| | cumulative processing cost: 1116740157
|
||||
| | cache read processing cost: 2870315
|
||||
| | cache write processing cost: 1166268
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=16B cardinality=21.60M cost=0
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cs_ship_customer_sk IS NULL
|
||||
| runtime filters: RF011[min_max] -> cs_item_sk, RF008[bloom] -> cs_sold_date_sk, RF010[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=21.60M cost=1116740157
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
|--10:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4,5 row-size=50B cardinality=539.18K cost=235999
|
||||
| | in pipelines: 06(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| |--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=58.85MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[170129]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 22:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=5 row-size=12B cardinality=73.05K cost=97080
|
||||
| | | in pipelines: 08(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[16566]
|
||||
| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 09:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: ws_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=38B cardinality=539.18K cost=236068
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | | Per-Instance Resources: mem-estimate=4.92MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=120 segment-costs=[436270]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF006[bloom] <- i_item_sk, RF007[min_max] <- i_item_sk
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=360000
|
||||
| | |
|
||||
| | 21:EXCHANGE [HASH(i_item_sk)]
|
||||
| | | mem-estimate=1.98MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=22B cardinality=360.00K cost=76270
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=28.14MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[744666]
|
||||
| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 20:EXCHANGE [HASH(ws_item_sk)]
|
||||
| | mem-estimate=2.00MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=16B cardinality=539.45K cost=99636
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=60 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=29.38MB mem-reservation=4.12MB thread-reservation=1
|
||||
| max-parallelism=60 segment-costs=[559185491]
|
||||
| 28:TUPLE CACHE
|
||||
| | cache key: c50c0355a125cf43c9ba9354dd62016b
|
||||
| | input scan node ids: 6
|
||||
| | estimated serialized size: 10.29MB
|
||||
| | estimated serialized size per node: 1.03MB
|
||||
| | cumulative processing cost: 558351719
|
||||
| | cache read processing cost: 71692
|
||||
| | cache write processing cost: 29130
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=16B cardinality=539.45K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ws_ship_hdemo_sk IS NULL
|
||||
| runtime filters: RF007[min_max] -> ws_item_sk, RF004[bloom] -> ws_sold_date_sk, RF006[bloom] -> ws_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=16B cardinality=539.45K cost=558351719
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=50B cardinality=388.62M cost=170099687
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=58.85MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16566]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=73.05K cost=12622
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=38B cardinality=388.62M cost=170149527
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=416.62MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=7.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=22B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[80414]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
predicates: ss_cdemo_sk IS NULL
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=388.82M cost=2233423247
|
||||
in pipelines: 01(GETNEXT)
|
||||
---- PARALLELPLANS
|
||||
Max Per-Host Resource Reservation: Memory=1.19GB Threads=44
|
||||
Per-Host Resource Estimates: Memory=1.65GB
|
||||
F13:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=4.08MB mem-reservation=4.00MB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[740] cpu-comparison-result=190 [max(1 (self) vs 190 (sum children))]
|
||||
PLAN-ROOT SINK
|
||||
| output exprs: channel, col_name, d_year, d_qoy, i_category, count(*), sum(ext_sales_price)
|
||||
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=700
|
||||
|
|
||||
28:MERGING-EXCHANGE [UNPARTITIONED]
|
||||
| order by: channel ASC, col_name ASC, d_year ASC, d_qoy ASC, i_category ASC
|
||||
| limit: 100
|
||||
| mem-estimate=76.81KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=74B cardinality=100 cost=40
|
||||
| in pipelines: 17(GETNEXT)
|
||||
|
|
||||
F12:PLAN FRAGMENT [HASH(channel,col_name,d_year,d_qoy,i_category)] hosts=10 instances=10 (adjusted from 120)
|
||||
Per-Instance Resources: mem-estimate=29.13MB mem-reservation=1.94MB thread-reservation=1
|
||||
max-parallelism=10 segment-costs=[16366258, 640746, 225] cpu-comparison-result=190 [max(10 (self) vs 190 (sum children))]
|
||||
17:TOP-N [LIMIT=100]
|
||||
| order by: channel ASC, col_name ASC, d_year ASC, d_qoy ASC, i_category ASC
|
||||
| mem-estimate=7.22KB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=12 row-size=74B cardinality=100 cost=640746
|
||||
| in pipelines: 17(GETNEXT), 27(OPEN)
|
||||
|
|
||||
27:AGGREGATE [FINALIZE]
|
||||
| output: count:merge(*), sum:merge(ext_sales_price)
|
||||
| group by: channel, col_name, d_year, d_qoy, i_category
|
||||
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=70.56K cost=12547014
|
||||
| in pipelines: 27(GETNEXT), 01(OPEN), 06(OPEN), 11(OPEN)
|
||||
|
|
||||
26:EXCHANGE [HASH(channel,col_name,d_year,d_qoy,i_category)]
|
||||
| mem-estimate=19.13MB mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=8.47M cost=3819244
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
|
||||
Per-Instance Resources: mem-estimate=33.04MB mem-reservation=17.00MB thread-reservation=1
|
||||
max-parallelism=120 segment-costs=[4421970887, 44661836] cpu-comparison-result=190 [max(190 (self) vs 185 (sum children))]
|
||||
16:AGGREGATE [STREAMING]
|
||||
| output: count(*), sum(ext_sales_price)
|
||||
| group by: channel, col_name, d_year, d_qoy, i_category
|
||||
| mem-estimate=10.00MB mem-reservation=9.00MB spill-buffer=512.00KB thread-reservation=0
|
||||
| tuple-ids=11 row-size=74B cardinality=8.47M cost=631504288
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
00:UNION
|
||||
| mem-estimate=0B mem-reservation=0B thread-reservation=0
|
||||
| tuple-ids=9 row-size=54B cardinality=410.75M cost=80744403
|
||||
| in pipelines: 01(GETNEXT), 06(GETNEXT), 11(GETNEXT)
|
||||
|
|
||||
|--15:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=03
|
||||
| | hash predicates: cs_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: cs_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| | tuple-ids=6,7,8 row-size=50B cardinality=21.59M cost=9448527
|
||||
| | in pipelines: 11(GETNEXT), 13(OPEN)
|
||||
| |
|
||||
| |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=58.85MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[170129]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=03 plan-id=04 cohort-id=01
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF008[bloom] <- d_date_sk
|
||||
| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 25:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=8 row-size=12B cardinality=73.05K cost=97080
|
||||
| | | in pipelines: 13(GETNEXT)
|
||||
| | |
|
||||
| | F10:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[16566]
|
||||
| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=8 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 13(GETNEXT)
|
||||
| |
|
||||
| 14:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| | hash-table-id=04
|
||||
| | hash predicates: cs_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: cs_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6,7 row-size=38B cardinality=21.59M cost=9451295
|
||||
| | in pipelines: 11(GETNEXT), 12(OPEN)
|
||||
| |
|
||||
| |--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | | Per-Instance Resources: mem-estimate=416.62MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[838440]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=04 plan-id=05 cohort-id=01
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF010[bloom] <- i_item_sk, RF011[min_max] <- i_item_sk
|
||||
| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| | |
|
||||
| | 24:EXCHANGE [BROADCAST]
|
||||
| | | mem-estimate=7.62MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=7 row-size=22B cardinality=360.00K cost=478440
|
||||
| | | in pipelines: 12(GETNEXT)
|
||||
| | |
|
||||
| | F09:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=16.10MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[80414]
|
||||
| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=7 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 12(GETNEXT)
|
||||
| |
|
||||
| 30:TUPLE CACHE
|
||||
| | cache key: 37a660abf9cc0548494f068c76e0533c
|
||||
| | input scan node ids: 11
|
||||
| | estimated serialized size: 411.94MB
|
||||
| | estimated serialized size per node: 41.19MB
|
||||
| | cumulative processing cost: 1116740157
|
||||
| | cache read processing cost: 2870315
|
||||
| | cache write processing cost: 1166268
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=6 row-size=16B cardinality=21.60M cost=0
|
||||
| | in pipelines: 11(GETNEXT)
|
||||
| |
|
||||
| 11:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
|
||||
| HDFS partitions=1831/1831 files=1831 size=280.96GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: cs_ship_customer_sk IS NULL
|
||||
| runtime filters: RF011[min_max] -> cs_item_sk, RF008[bloom] -> cs_sold_date_sk, RF010[bloom] -> cs_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=4.32G size=280.96GB
|
||||
| partitions: 1831/1831 rows=4.32G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=21.52M
|
||||
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
|
||||
| tuple-ids=6 row-size=16B cardinality=21.60M cost=1116740157
|
||||
| in pipelines: 11(GETNEXT)
|
||||
|
|
||||
|--10:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| | hash-table-id=02
|
||||
| | hash predicates: ws_sold_date_sk = d_date_sk
|
||||
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4,5 row-size=50B cardinality=539.18K cost=235999
|
||||
| | in pipelines: 06(GETNEXT), 08(OPEN)
|
||||
| |
|
||||
| |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
|
||||
| | | Per-Instance Resources: mem-estimate=3.79MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=120 segment-costs=[85197]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=02 plan-id=03 cohort-id=01
|
||||
| | | build expressions: d_date_sk
|
||||
| | | runtime filters: RF004[bloom] <- d_date_sk
|
||||
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=73049
|
||||
| | |
|
||||
| | 23:EXCHANGE [HASH(d_date_sk)]
|
||||
| | | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=5 row-size=12B cardinality=73.05K cost=12148
|
||||
| | | in pipelines: 08(GETNEXT)
|
||||
| | |
|
||||
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| | Per-Instance Resources: mem-estimate=23.50MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=1 segment-costs=[106709]
|
||||
| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| | stored statistics:
|
||||
| | table: rows=73.05K size=2.17MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=5 row-size=12B cardinality=73.05K cost=12622
|
||||
| | in pipelines: 08(GETNEXT)
|
||||
| |
|
||||
| 22:EXCHANGE [HASH(ws_sold_date_sk)]
|
||||
| | mem-estimate=2.40MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=38B cardinality=539.18K cost=173757
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| F05:PLAN FRAGMENT [HASH(ws_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| Per-Instance Resources: mem-estimate=23.51MB mem-reservation=0B thread-reservation=1
|
||||
| max-parallelism=10 segment-costs=[2207460]
|
||||
| 09:HASH JOIN [INNER JOIN, PARTITIONED]
|
||||
| | hash-table-id=05
|
||||
| | hash predicates: ws_item_sk = i_item_sk
|
||||
| | fk/pk conjuncts: ws_item_sk = i_item_sk
|
||||
| | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
|
||||
| | tuple-ids=3,4 row-size=38B cardinality=539.18K cost=236068
|
||||
| | in pipelines: 06(GETNEXT), 07(OPEN)
|
||||
| |
|
||||
| |--F19:PLAN FRAGMENT [HASH(ws_item_sk)] hosts=10 instances=10 (adjusted from 120)
|
||||
| | | Per-Instance Resources: mem-estimate=5.86MB mem-reservation=3.88MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | | max-parallelism=10 segment-costs=[436270]
|
||||
| | JOIN BUILD
|
||||
| | | join-table-id=05 plan-id=06 cohort-id=01
|
||||
| | | build expressions: i_item_sk
|
||||
| | | runtime filters: RF006[bloom] <- i_item_sk, RF007[min_max] <- i_item_sk
|
||||
| | | mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0 cost=360000
|
||||
| | |
|
||||
| | 21:EXCHANGE [HASH(i_item_sk)]
|
||||
| | | mem-estimate=1.98MB mem-reservation=0B thread-reservation=0
|
||||
| | | tuple-ids=4 row-size=22B cardinality=360.00K cost=76270
|
||||
| | | in pipelines: 07(GETNEXT)
|
||||
| | |
|
||||
| | F04:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| | Per-Instance Resources: mem-estimate=17.01MB mem-reservation=512.00KB thread-reservation=1
|
||||
| | max-parallelism=4 segment-costs=[744666]
|
||||
| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| | HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| | stored statistics:
|
||||
| | table: rows=360.00K size=33.54MB
|
||||
| | columns: all
|
||||
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| | tuple-ids=4 row-size=22B cardinality=360.00K cost=51347
|
||||
| | in pipelines: 07(GETNEXT)
|
||||
| |
|
||||
| 20:EXCHANGE [HASH(ws_item_sk)]
|
||||
| | mem-estimate=2.00MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=3 row-size=16B cardinality=539.45K cost=99636
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=60 (adjusted from 120)
|
||||
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
|
||||
| Per-Instance Resources: mem-estimate=20.78MB mem-reservation=4.12MB thread-reservation=1
|
||||
| max-parallelism=60 segment-costs=[559185491]
|
||||
| 29:TUPLE CACHE
|
||||
| | cache key: 726ef5d5c966f57394517b296338852d
|
||||
| | input scan node ids: 6
|
||||
| | estimated serialized size: 10.29MB
|
||||
| | estimated serialized size per node: 1.03MB
|
||||
| | cumulative processing cost: 558351719
|
||||
| | cache read processing cost: 71692
|
||||
| | cache write processing cost: 29130
|
||||
| | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0
|
||||
| | tuple-ids=3 row-size=16B cardinality=539.45K cost=0
|
||||
| | in pipelines: 06(GETNEXT)
|
||||
| |
|
||||
| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
|
||||
| HDFS partitions=1824/1824 files=1824 size=145.75GB
|
||||
| deterministic scan range assignment: true
|
||||
| predicates: ws_ship_hdemo_sk IS NULL
|
||||
| runtime filters: RF007[min_max] -> ws_item_sk, RF004[bloom] -> ws_sold_date_sk, RF006[bloom] -> ws_item_sk
|
||||
| stored statistics:
|
||||
| table: rows=2.16G size=145.75GB
|
||||
| partitions: 1824/1824 rows=2.16G
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=3.37M
|
||||
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
|
||||
| tuple-ids=3 row-size=16B cardinality=539.45K cost=558351719
|
||||
| in pipelines: 06(GETNEXT)
|
||||
|
|
||||
05:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=00
|
||||
| hash predicates: ss_sold_date_sk = d_date_sk
|
||||
| fk/pk conjuncts: ss_sold_date_sk = d_date_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
|
||||
| tuple-ids=0,1,2 row-size=50B cardinality=388.62M cost=170099687
|
||||
| in pipelines: 01(GETNEXT), 03(OPEN)
|
||||
|
|
||||
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=58.85MB mem-reservation=58.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[170129]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=00 plan-id=01 cohort-id=01
|
||||
| | build expressions: d_date_sk
|
||||
| | runtime filters: RF000[bloom] <- d_date_sk
|
||||
| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
|
||||
| |
|
||||
| 19:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=872.04KB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=2 row-size=12B cardinality=73.05K cost=97080
|
||||
| | in pipelines: 03(GETNEXT)
|
||||
| |
|
||||
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
|
||||
| Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=1 segment-costs=[16566]
|
||||
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=2.17MB
|
||||
| stored statistics:
|
||||
| table: rows=73.05K size=2.17MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=73.05K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=2 row-size=12B cardinality=73.05K cost=12622
|
||||
| in pipelines: 03(GETNEXT)
|
||||
|
|
||||
04:HASH JOIN [INNER JOIN, BROADCAST]
|
||||
| hash-table-id=01
|
||||
| hash predicates: ss_item_sk = i_item_sk
|
||||
| fk/pk conjuncts: ss_item_sk = i_item_sk
|
||||
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
|
||||
| tuple-ids=0,1 row-size=38B cardinality=388.62M cost=170149527
|
||||
| in pipelines: 01(GETNEXT), 02(OPEN)
|
||||
|
|
||||
|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
|
||||
| | Per-Instance Resources: mem-estimate=416.62MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
|
||||
| | max-parallelism=10 segment-costs=[838440]
|
||||
| JOIN BUILD
|
||||
| | join-table-id=01 plan-id=02 cohort-id=01
|
||||
| | build expressions: i_item_sk
|
||||
| | runtime filters: RF002[bloom] <- i_item_sk, RF003[min_max] <- i_item_sk
|
||||
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
|
||||
| |
|
||||
| 18:EXCHANGE [BROADCAST]
|
||||
| | mem-estimate=7.62MB mem-reservation=0B thread-reservation=0
|
||||
| | tuple-ids=1 row-size=22B cardinality=360.00K cost=478440
|
||||
| | in pipelines: 02(GETNEXT)
|
||||
| |
|
||||
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
|
||||
| Per-Instance Resources: mem-estimate=16.10MB mem-reservation=512.00KB thread-reservation=1
|
||||
| max-parallelism=4 segment-costs=[80414]
|
||||
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
|
||||
| HDFS partitions=1/1 files=1 size=33.54MB
|
||||
| stored statistics:
|
||||
| table: rows=360.00K size=33.54MB
|
||||
| columns: all
|
||||
| extrapolated-rows=disabled max-scan-range-rows=101.54K
|
||||
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
|
||||
| tuple-ids=1 row-size=22B cardinality=360.00K cost=51347
|
||||
| in pipelines: 02(GETNEXT)
|
||||
|
|
||||
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
|
||||
HDFS partitions=1824/1824 files=1824 size=389.90GB
|
||||
predicates: ss_cdemo_sk IS NULL
|
||||
runtime filters: RF003[min_max] -> ss_item_sk, RF000[bloom] -> ss_sold_date_sk, RF002[bloom] -> ss_item_sk
|
||||
stored statistics:
|
||||
table: rows=8.64G size=389.90GB
|
||||
partitions: 1824/1824 rows=8.64G
|
||||
columns: all
|
||||
extrapolated-rows=disabled max-scan-range-rows=390.22M
|
||||
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
|
||||
tuple-ids=0 row-size=16B cardinality=388.82M cost=2233423247
|
||||
in pipelines: 01(GETNEXT)
|
||||
====
|
||||
2566
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q77.test
vendored
Normal file
2566
testdata/workloads/functional-planner/queries/PlannerTest/tpcds_tuple_cache/tpcds-q77.test
vendored
Normal file
File diff suppressed because it is too large
Load Diff
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user