Files
impala/testdata/bin/copy-data-sources.sh
ishaan 2386fb84a8 Enable the data loading infrastructure to switch the underlying file system.
This patch enables loading data to s3 instead of hdfs. It is preliminary in nature,
as such, there are a few caveats:
 - The fe tests do not work.
 - Only loading from a test-warehouse snapshot and metastore snapshot is enabled.
 - Until hive works with s3, only a subset of all the tests will work.

Change-Id: Ia66a5f836b4245e3b022a49de805eec337a51324
Reviewed-on: http://gerrit.sjc.cloudera.com:8080/5851
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: jenkins
2015-02-03 01:02:42 -08:00

14 lines
436 B
Bash
Executable File

#!/bin/bash
# Copyright (c) 2014 Cloudera, Inc. All rights reserved.
#
# This script copies the test data source library into hdfs.
. ${IMPALA_HOME}/bin/impala-config.sh > /dev/null 2>&1
set -e
hadoop fs -mkdir -p ${FILESYSTEM_PREFIX}/test-warehouse/data-sources/
hadoop fs -put -f \
${IMPALA_HOME}/ext-data-source/test/target/impala-data-source-test-*.jar \
${FILESYSTEM_PREFIX}/test-warehouse/data-sources/test-data-source.jar