Noemi Pap-Takacs 88e0e4e8ba IMPALA-13334: Fix test_sort.py DCHECK hit when max_sort_run_size>0 ...

test_sort.py declared 'max_sort_run_size' query option, but it
silently did not exercise it. Fixing the query option declaration
in IMPALA-13349 using helper function add_exec_option_dimension()
revealed a DCHECK failure in sorter.cc. In some cases the length
of an in-memory run could exceed 'max_sort_run_size' by 1 page.

This patch fixed the DCHECK failure by strictly enforcing the
'max_sort_run_size' limit.
Memory limits were also adjusted in test_sort.py according to
the memory usage of the different sort run sizes.

Additionally, the 'MAX_SORT_RUN_SIZE' query option's valid range was
relaxed. Instead of throwing an error, negative values also disable
the run size limitation, just as the default: '0'.

Testing:
- E2E tests in sort.py
- set test

Change-Id: I943d8edcc87df168448a174d6c9c6b46fe960eae
Reviewed-on: http://gerrit.cloudera.org:8080/21777
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>

2024-11-05 15:06:52 +00:00

..

fbs

IMPALA-12861: Fix mixed file format listing for Iceberg tables

2024-10-18 13:24:42 +00:00

function-registry

IMPALA-7086: Cache timezone in *_utc_timestamp()

2024-09-06 18:08:26 +00:00

protobuf

IMPALA-13083: Clarify REASON_MEM_LIMIT_TOO_LOW_FOR_RESERVATION

2024-05-23 03:54:00 +00:00

thrift

IMPALA-13334: Fix test_sort.py DCHECK hit when max_sort_run_size>0

2024-11-05 15:06:52 +00:00

.gitignore

Implmented opcode registry. Added substr() and pi() functions. Added backend testing to buildall.sh

2011-11-20 13:44:41 -08:00