Joe McDonnell 147e962f2d IMPALA-7119: Restart whole minicluster when HDFS replication stalls ...

After loading data, we wait for HDFS to replicate
all of the blocks appropriately. If this takes too long,
we restart HDFS. However, HBase can fail if HDFS is
restarted and HBase is unable to write its logs.
In general, there is no real reason to keep HBase
and the other minicluster components running while
restarting HDFS.

This changes the HDFS health check to restart the
whole minicluster and Impala rather than just HDFS.

Testing:
 - Tested with a modified version that always does
   the restart in the HDFS health check and verified
   that the tests pass

Change-Id: I58ffe301708c78c26ee61aa754a06f46c224c6e2
Reviewed-on: http://gerrit.cloudera.org:8080/10665
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>

2018-06-18 21:46:11 +00:00

..

cache_tables.py

IMPALA-4110: Clean up issues found by Apache RAT.

2016-09-14 22:09:24 +00:00

check-hbase-nodes.py

IMPALA-4684: Handle Zookeeper ConnentionLoss exceptions

2016-12-22 01:18:56 +00:00

check-schema-diff.sh

IMPALA-4294: Make check-schema-diff.sh executable from anywhere.

2016-10-15 04:05:04 +00:00

compute-table-stats.sh

IMPALA-6679,IMPALA-6678: reduce scan reservation

2018-04-28 23:41:39 +00:00

copy-data-sources.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

copy-udfs-udas.sh

IMPALA-6899: Optimize the HDFS commands used in dataload

2018-04-23 21:29:59 +00:00

create-data-source-table.sql

IMPALA-3786: Replace "cloudera" with "apache" (part 2)

2016-09-29 21:14:13 +00:00

create-hbase.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

create-load-data.sh

IMPALA-7119: Restart whole minicluster when HDFS replication stalls

2018-06-18 21:46:11 +00:00

create-mini.sql

IMPALA-4110: Clean up issues found by Apache RAT.

2016-09-14 22:09:24 +00:00

create-table-many-blocks.sh

IMPALA-5975: Work around broken beeline clients

2017-09-27 03:27:45 +00:00

generate-block-ids.sh

Expose $IMPALA_MAVEN_OPTIONS for configuring Maven.

2017-11-14 01:29:56 +00:00

generate-load-nested.sh

Expose $IMPALA_MAVEN_OPTIONS for configuring Maven.

2017-11-14 01:29:56 +00:00

generate-schema-statements.py

IMPALA-7061: Rework HBase splitting and assignment

2018-05-25 00:28:18 +00:00

generate-test-vectors.py

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-all.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-hbase.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-hive-server.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-java-service.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-mini-dfs.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

kill-sentry-service.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

load_nested.py

IMPALA-6372: Go parallel for Hive dataload

2018-04-14 00:16:26 +00:00

load-dependent-tables.sql

IMPALA-5842: Write page index in Parquet files

2018-05-17 20:22:02 +00:00

load-hive-builtins.sh

IMPALA-6899: Optimize the HDFS commands used in dataload

2018-04-23 21:29:59 +00:00

load-metastore-snapshot.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

load-test-warehouse-snapshot.sh

IMPALA-7003: Deflake erasure coding data loading

2018-05-15 23:59:58 +00:00

load-tpc-kudu.py

IMPALA-3739: Enable stress tests on Kudu

2016-10-21 11:01:37 +00:00

lzo_indexer.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

minikdc_env.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

minikdc.sh

IMPALA-3918: Remove Cloudera copyrights and add ASF license header

2016-08-09 08:19:41 +00:00

random_avro_schema.py

IMPALA-3786: Replace "cloudera" with "apache" (part 2)

2016-09-29 21:14:13 +00:00

README-BENCHMARK-TEST-GENERATION

Added scripts for generating and running benchmarks across different data sets and file formats

2012-05-08 16:06:45 -07:00

run-all.sh

IMPALA-6850: Print actual error message on Sentry error

2018-04-14 01:41:38 +00:00

run-hbase.sh

IMPALA-6070: Further improvements to test-with-docker.

2018-04-26 20:47:29 +00:00

run-hive-server.sh

IMPALA-5717: Support for reading ORC data files

2018-04-11 05:13:02 +00:00

run-mini-dfs.sh

Warn about Hadoop / Java version incompatibility

2018-05-01 20:40:28 +00:00

run-sentry-service.sh

IMPALA-6850: Print actual error message on Sentry error

2018-04-14 01:41:38 +00:00

run-step.sh

IMPALA-6108, IMPALA-6070: Parallel data load (re-instated).

2017-11-02 00:40:19 +00:00

setup-hdfs-env.sh

IMPALA-7003: Deflake erasure coding data loading

2018-05-15 23:59:58 +00:00

wait-for-hiveserver2.py

Increase wait times for startup of Hive and its Metastore

2016-11-15 20:35:01 +00:00

wait-for-metastore.py

Increase wait times for startup of Hive and its Metastore

2016-11-15 20:35:01 +00:00