Files
impala/bin/create_testdata.sh
Casey Ching e2bfb6ae2f Misc improvements to shell scripts about error reporting
Changes:
  1) Consistently use "set -euo pipefail".
  2) When an error happens, print the file and line.
  3) Consolidated some of the kill scripts.
  4) Added better error messages to the load data script.
  5) Changed use of #!/bin/sh to bash.

Change-Id: I14fef66c46c1b4461859382ba3fd0dee0fbcdce1
Reviewed-on: http://gerrit.cloudera.org:8080/1620
Reviewed-by: Casey Ching <casey@cloudera.com>
Tested-by: Internal Jenkins
2015-12-17 18:25:27 +00:00

41 lines
993 B
Bash
Executable File

#!/usr/bin/env bash
# Copyright (c) 2012 Cloudera, Inc. All rights reserved.
set -euo pipefail
trap 'echo Error in $0 at line $LINENO: $(awk "NR == $LINENO" $0)' ERR
bin=`dirname "$0"`
bin=`cd "$bin"; pwd`
. "$bin"/impala-config.sh
# location of the generated data
DATALOC=$IMPALA_HOME/testdata/target
# regenerate the test data generator
cd $IMPALA_HOME/testdata
mvn clean
# on jenkins runs, resolve dependencies quietly to avoid log spew
if [ "${USER}" == "jenkins" ]; then
echo "Quietly resolving testdata dependencies."
mvn -q dependency:resolve
fi
mvn package
# find jars
CP=""
JARS=`find target/*.jar 2> /dev/null || true`
for i in $JARS; do
if [ -n "$CP" ]; then
CP=${CP}:${i}
else
CP=${i}
fi
done
# run test data generator
echo $DATALOC
mkdir -p $DATALOC
"$JAVA" -cp $CP com.cloudera.impala.datagenerator.TestDataGenerator $DATALOC
"$JAVA" -cp $CP com.cloudera.impala.datagenerator.CsvToHBaseConverter
echo "SUCCESS, data generated into $DATALOC"