Taras Bobrovytsky 4a79c9e7e3 IMPALA-5181: Extract PYPI metadata from a webpage ...

There were some build failures due to a failure to download a JSON file
containing package metadata from PYPI. We need to switch to downloading
this from a PYPI mirror. In order to be able to download the metadata
from a PYPI mirror, we need be able to extract the data from a web page,
because PYPI mirrors do not always have a JSON interface.

We implement a regex based html parser in this patch. Also, we increase
the number of download attempts and randomly vary the amount of time
between each attempt.

Testing:
- Tested locally against PYPI and a PYPI mirror.
- Ran a private build that passed (which used a PYPI mirror).

Change-Id: If3845a0d5f568d4352e3cc4883596736974fd7de
Reviewed-on: http://gerrit.cloudera.org:8080/6579
Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
Tested-by: Impala Public Jenkins

2017-04-08 00:19:08 +00:00

..

.gitignore

Update .gitignore files for ninja, coredumps and pypi packages

2016-07-29 21:42:07 +00:00

compiled-requirements.txt

IMPALA-4593,IMPALA-4635: fix some python build issues

2017-03-07 02:56:18 +00:00

download_requirements

IMPALA-4593,IMPALA-4635: fix some python build issues

2017-03-07 02:56:18 +00:00

find_py26.py

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kudu-requirements.txt

IMPALA-4593,IMPALA-4635: fix some python build issues

2017-03-07 02:56:18 +00:00

pip_download.py

IMPALA-5181: Extract PYPI metadata from a webpage

2017-04-08 00:19:08 +00:00

requirements.txt

IMPALA-5044: test infra: remove backports.tempfile

2017-03-09 01:57:37 +00:00