mirror of
https://github.com/apache/impala.git
synced 2025-12-19 09:58:28 -05:00
According to PEP-0503, pip repo server doesn't support unnormalized URL access, and some package name within 'infra/python/deps/*requirements.txt' are unnormalized, e.g. 'Cython', and pip_download.py will concat $PYPI_MIRROR and package name to get download URL directly, which maybe unnormalized. Fix this by normalize package name in download URL using the recommanded method in PEP-0503. Change-Id: I479df0ad7acf3c650b8f5317372261d5e2840864 Reviewed-on: http://gerrit.cloudera.org:8080/17987 Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
To install new packages: 1) Add your package to deps/requirements.txt, or deps/compiled-requirements.txt if the the package needs a C/C++ compiler to build . You should specify the version number using the "foo == x.y.z" notation so future upgrades can be done automatically. 2) Run deps/download_requirements, it will download the package to the deps dir. 3) Run the "impala-python" command, this should detect that requirements.txt changed and automatically rebuild the virtualenv. 4) Now in the python prompt, you should be able to import the new module. To upgrade a package: 1) Edit deps/requirement.txt to use the version you need. 2) Go to step 2 above.