IMPALA-13706: Calcite planner: add new column for planner report

Adding a new column "Different error message" for the report that
shows the differences on e2e tests between the Calcite planner and
the current Impala planner. This new column will measure the test
cases that fail under both planners but have different error messages.

Change-Id: I897ed4c454d3c0f0873942ceec4edce719d63ac9
Reviewed-on: http://gerrit.cloudera.org:8080/22410
Reviewed-by: Joe McDonnell <joemcdonnell@cloudera.com>
Tested-by: Joe McDonnell <joemcdonnell@cloudera.com>
This commit is contained in:
Steve Carlin
2025-01-28 10:46:01 -08:00
committed by Joe McDonnell
parent a159eb52f8
commit 7dc3fccee0

View File

@@ -62,7 +62,7 @@ FOOTER = """
RESULT_CATEGORIES = ["Success", "Parse Failure", "Analysis Failure",
"Unsupported Feature", "Result Difference",
"Profile Difference", "Other"]
"Profile Difference", "Different Error Msg", "Other"]
RESULT_CATEGORY_STYLE_MAP = {
"Success": "success",
@@ -71,6 +71,7 @@ RESULT_CATEGORY_STYLE_MAP = {
"Unsupported Feature": "expected_fail",
"Result Difference": "fail",
"Profile Difference": "fail",
"Different Error Msg": "expected_fail",
"Other": "fail"
}
@@ -101,6 +102,9 @@ def categorize_error_string(error_string):
return "Success"
elif "ParseException" in error_string:
return "Parse Failure"
elif "Unexpected exception string" in error_string and \
"Not found in actual" in error_string:
return "Different Error Msg"
elif "AnalysisException" in error_string:
return "Analysis Failure"
elif "UnsupportedFeatureException" in error_string: