jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2025-12-19 18:12:08 -05:00
Code Issues Projects Releases Wiki Activity

Allow Impala to run against local filesystem.

Browse Source 
Allow Impala to start only with a running HMS (and no additional services like HDFS,
HBase, Hive, YARN) and use the local file system.

Skip all tests that need these services, use HDFS caching or assume that multiple impalads
are running.

To run Impala with the local filesystem, set TARGET_FILESYSTEM to 'local' and
WAREHOUSE_LOCATION_PREFIX to a location on the local filesystem where the current user has
permissions since this is the location where the test data will be extracted.

Test coverage (with core strategy) in comparison with HDFS and S3:
HDFS             1348 tests passed
S3               1157 tests passed
Local Filesystem 1161 tests passed

Change-Id: Ic9718c7e0307273382b1cc6baf203ff2fb2acd03
Reviewed-on: http://gerrit.cloudera.org:8080/1352
Reviewed-by: Alex Behm <alex.behm@cloudera.com>
Tested-by: Internal Jenkins
Readability: Alex Behm <alex.behm@cloudera.com>
This commit is contained in:
Vlad Berindei
2015-10-28 15:23:45 -07:00
committed by Alex Behm
parent 0f3eb6d53d
commit b6c20b2a40
43 changed files with 273 additions and 91 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/data_errors/test_data_errors.py
View File

@@ -15,7 +15,7 @@
# Tests Impala properly handles errors when reading and writing data.
from tests.common.impala_test_suite import ImpalaTestSuite
from tests.common.skip import SkipIfS3
from tests.common.skip import SkipIfS3, SkipIfLocal
import pytest
class TestDataErrors(ImpalaTestSuite):
@@ -47,6 +47,7 @@ class TestHdfsScanNodeErrors(TestDataErrors):
@SkipIfS3.qualified_path
@SkipIfLocal.qualified_path
class TestHdfsSeqScanNodeErrors(TestHdfsScanNodeErrors):
@classmethod
def add_test_dimensions(cls):