Files
impala/testdata/bin/split-hbase.sh
Dan Hecht af956e24ef IMPALA-1143: Tests don't succeed when just running buildall.sh.
There are at least two problems:

1) generate-schema-statements.py wasn't putting a newline on the very
last insert stmt, and beeline apparently was then ignoring it.

2) If HBaseTestDataRegionAssignment fails, then we reload a couple
tables, but were not recomputing stats for those tables.  And some
query-tests expect those tables to have stats.

Tesing: Ran the following commands and see that the tables are now
not-empty and include stats:

    $IMPALA_HOME/bin/load-data.py -w functional-query \
        --table_names=alltypesagg,alltypessmall --table_formats=hbase/none --force
    $IMPALA_HOME/tests/util/compute_table_stats.py --db_names=functional_hbase \
        --table_names=alltypesagg,alltypessmall

Change-Id: I5183e037d0f5499c81b79f2cc1060b71be2d4873
Reviewed-on: http://gerrit.sjc.cloudera.com:8080/3794
Reviewed-by: Nong Li <nong@cloudera.com>
Tested-by: jenkins
(cherry picked from commit 306b87b37edbf10fa4b89ed2206484e158cc8e0d)
Reviewed-on: http://gerrit.sjc.cloudera.com:8080/3802
Reviewed-by: Daniel Hecht <dhecht@cloudera.com>
2014-08-12 01:21:14 -07:00

33 lines
1.0 KiB
Bash
Executable File

#!/usr/bin/env bash
# Copyright (c) 2012 Cloudera, Inc. All rights reserved.
# Split hbasealltypesagg and hbasealltypessmall and assign their splits
set -u
cd $IMPALA_HOME/testdata
mvn clean package
mvn dependency:copy-dependencies
. ${IMPALA_HOME}/bin/set-classpath.sh
export CLASSPATH=$IMPALA_HOME/testdata/target/impala-testdata-0.1-SNAPSHOT.jar:$CLASSPATH
RESULT=1
RETRY_COUNT=0
while [ $RESULT -ne 0 ] && [ $RETRY_COUNT -le 10 ]; do
java com.cloudera.impala.datagenerator.HBaseTestDataRegionAssigment \
functional_hbase.alltypesagg functional_hbase.alltypessmall
RESULT=$?
if [ $RESULT -ne 0 ]; then
((RETRY_COUNT++))
# If the split failed, force reload the hbase tables before trying the next split
$IMPALA_HOME/bin/start-impala-cluster.py
$IMPALA_HOME/bin/load-data.py -w functional-query \
--table_names=alltypesagg,alltypessmall --table_formats=hbase/none --force
$IMPALA_HOME/tests/util/compute_table_stats.py --db_names=functional_hbase \
--table_names=alltypesagg,alltypessmall
fi
done
exit $RESULT