mirror of
https://github.com/apache/impala.git
synced 2026-01-08 21:03:01 -05:00
d3ae4a416e
infra/python/deps/pip_download.py use multiprocessing.pool.ThreadPool where each thread calls wget. It is also wrap the download_package function with retry wrapper. When there is a network issue happen, pressing Ctrl+C does not immediately terminate pip_download.py and all its children. Thus, the script appears to hang. This patch make pip_download.py to capture SIGINT and pass it as cancellation event to all threads. It is changed to run with python3. All flake8 issues are also fixed. Testing: - Manually run `buildall.sh -cmake_only` and interrupt it in the middle of pip_download.py execution. Verify that script terminate immediately. Change-Id: I6f293dd8f3fcf3cffa17a4a44627a41d67b7dc91 Reviewed-on: http://gerrit.cloudera.org:8080/22128 Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>