IMPALA-14257: Support set USE_APACHE_* when USE_APACHE_COMPONENTS=false

Before this patch, USE_APACHE_COMPONENTS overwrite all USE_APACHE_*
variables, but we should support using specific apache components.

After this patch, if USE_APACHE_COMPONENTS is not false, USE_APACHE_
{HADOOP,HBASE,HIVE,TEZ,RANGER} variable will be set true. Otherwise,
we should use the value of USE_APACHE_{HADOOP,HBASE,HIVE,TEZ,RANGER}.

Test:
 - Built and ran a test cluster with setting USE_APACHE_HIVE=true
and USE_APACHE_COMPONENTS=false.

Change-Id: I33791465a3b238b56f82d749e3dbad8215f3b3bc
Reviewed-on: http://gerrit.cloudera.org:8080/23211
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
This commit is contained in:
zhangyifan27
2025-07-24 20:41:50 +08:00
committed by Impala Public Jenkins
parent 6b005a793a
commit f0757418c8
2 changed files with 8 additions and 8 deletions

View File

@@ -36,7 +36,7 @@ can do so through the environment variables and scripts listed below.
| JAVA | "${JAVA_HOME}/bin/java" | Java binary location. |
| CLASSPATH | | See bin/set-classpath.sh for details. |
| PYTHONPATH | | See bin/set-pythonpath.sh for details. |
| USE_APACHE_COMPONENTS | false | Use Apache components for Hadoop, HBase, Hive, Tez, Ranger. It will set USE_APACHE_{HADOOP,HBASE,HIVE,TEZ,RANGER} variable as true if not set. |
| USE_APACHE_COMPONENTS | false | Use Apache components for Hadoop, HBase, Hive, Tez, Ranger. It will set USE_APACHE_{HADOOP,HBASE,HIVE,TEZ,RANGER} variable as true if not set false. |
| USE_APACHE_HADOOP | false | Use Apache Hadoop |
| USE_APACHE_HBASE | false | Use Apache HBase |
| USE_APACHE_HIVE | false | Use Apache Hive |

View File

@@ -414,12 +414,12 @@ else
export IMPALA_RANGER_URL=${CDP_RANGER_URL-}
export IMPALA_TEZ_VERSION=${CDP_TEZ_VERSION}
export IMPALA_TEZ_URL=${CDP_TEZ_URL-}
export USE_APACHE_HADOOP=false
export USE_APACHE_HBASE=false
export USE_APACHE_HIVE=false
export USE_APACHE_TEZ=false
export USE_APACHE_RANGER=false
export USE_APACHE_OZONE=false
export USE_APACHE_HADOOP=${USE_APACHE_HADOOP:=false}
export USE_APACHE_HBASE=${USE_APACHE_HBASE:=false}
export USE_APACHE_HIVE=${USE_APACHE_HIVE:=false}
export USE_APACHE_TEZ=${USE_APACHE_TEZ:=false}
export USE_APACHE_RANGER=${USE_APACHE_RANGER:=false}
export USE_APACHE_OZONE=${USE_APACHE_OZONE:=false}
fi
export APACHE_COMPONENTS_HOME="$IMPALA_TOOLCHAIN/apache_components"
@@ -1063,7 +1063,7 @@ export RANGER_CONF_DIR="$IMPALA_HOME/fe/src/test/resources"
# -Dorg.apache.logging.log4j.simplelog.StatusLogger.level=TRACE
#
# We use a unique -Dhive.log.file to distinguish the HiveMetaStore and HiveServer2 logs.
export HIVE_CONF_DIR="$IMPALA_FE_DIR/./src/test/resources"
export HIVE_CONF_DIR="$IMPALA_FE_DIR/src/test/resources"
# Hive looks for jar files in a single directory from HIVE_AUX_JARS_PATH plus
# any jars in AUX_CLASSPATH. (Or a list of jars in HIVE_AUX_JARS_PATH.)