jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2025-12-25 02:03:09 -05:00
Code Issues Projects Releases Wiki Activity

IMPALA-3914: SKIP_TOOLCHAIN_BOOTSTRAP skips Python package downloads

Browse Source 
SKIP_TOOLCHAIN_BOOTSTRAP is meant to control download of third-party
components to speed up builds and allow builds to be less tied to
third-party infrastructure. It therefore makes sense that it should
apply to downloading of third-party Python packages.

Change-Id: Ibf68dbf5efb514511fc16e2956284ce508b997aa
Reviewed-on: http://gerrit.cloudera.org:8080/3773
Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
Tested-by: Internal Jenkins
This commit is contained in:
Tim Armstrong
2016-07-26 09:52:33 -07:00
committed by Internal Jenkins
parent f60b2beb8d
commit a7963e6b03
1 changed files with 11 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

21
buildall.sh
View File

@@ -239,16 +239,6 @@ if [[ -z $METASTORE_SNAPSHOT_FILE && "${TARGET_FILESYSTEM}" != "hdfs" &&
exit 1
fi
echo "Downloading Python dependencies"
# Download all the Python dependencies we need before doing anything
# of substance. Does not re-download anything that is already present.
if ! $IMPALA_HOME/infra/python/deps/download_requirements; then
echo "Warning: Unable to download Python requirements."
echo "Warning: bootstrap_virtualenv or other Python-based tooling may fail."
else
echo "Finished downloading Python dependencies"
fi
# option to clean everything first
if [ $CLEAN_ACTION -eq 1 ]; then
$IMPALA_HOME/bin/clean.sh
@@ -256,8 +246,19 @@ fi
# Populate necessary thirdparty components unless it's set to be skipped.
if [ "${SKIP_TOOLCHAIN_BOOTSTRAP}" = true ]; then
echo "SKIP_TOOLCHAIN_BOOTSTRAP is true, skipping download of Python dependencies."
echo "SKIP_TOOLCHAIN_BOOTSTRAP is true, skipping toolchain bootstrap."
else
echo "Downloading Python dependencies"
# Download all the Python dependencies we need before doing anything
# of substance. Does not re-download anything that is already present.
if ! $IMPALA_HOME/infra/python/deps/download_requirements; then
echo "Warning: Unable to download Python requirements."
echo "Warning: bootstrap_virtualenv or other Python-based tooling may fail."
else
echo "Finished downloading Python dependencies"
fi
echo "Downloading and extracting toolchain dependencies."
$IMPALA_HOME/bin/bootstrap_toolchain.py
echo "Toolchain bootstrap complete."