Commit Graph

329 Commits

Author SHA1 Message Date
ishaan
a6cb5f70a4 Introduce the notion of scope to the plugin framework.
Change-Id: I2cf39c38e7e0a359950d9e05e2daed433fc0c38f
Reviewed-on: http://gerrit.ent.cloudera.com:8080/144
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: Ishaan Joshi <ishaan@cloudera.com>
2014-01-08 10:52:05 -08:00
ishaan
43deb6692f Make start-impala-cluster tolerate the failure of importing ImpalaCluster()
Change-Id: I795ed5eed9fb33ab62f2229c8745800393ddb712
Reviewed-on: http://gerrit.ent.cloudera.com:8080/164
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: Ishaan Joshi <ishaan@cloudera.com>
2014-01-08 10:52:05 -08:00
Lenni Kuff
4cd8830814 Simplify building CLASSPATH for run-jdbc-client.sh
Change-Id: I4dd77e0a83b87474260fdc19a93a0ccf4b766ad7
Reviewed-on: http://gerrit.ent.cloudera.com:8080/100
Reviewed-by: Henry Robinson <henry@cloudera.com>
Tested-by: Henry Robinson <henry@cloudera.com>
2014-01-08 10:51:58 -08:00
Nong Li
9af39ad4c4 Add check for llvm version in CMake. 2014-01-08 10:51:55 -08:00
Alan Choi
4c32278782 IMP-973 Reassign HBase regions after HBase restart 2014-01-08 10:51:54 -08:00
Lenni Kuff
fc2d8836c4 Bump version to v1.2 2014-01-08 10:51:51 -08:00
Lenni Kuff
8c264f0395 Added Sentry v1.1.0 to thirdparty 2014-01-08 10:51:48 -08:00
ishaan
caeadcc1f3 Throw an error when impalads don't start in start-impala-cluster. 2014-01-08 10:51:42 -08:00
ishaan
2819f4c56e Fix cluster logging and redirect errors to logfile 2014-01-08 10:51:40 -08:00
ishaan
6f9569ea6f Add a plugin framework for run-workload 2014-01-08 10:51:39 -08:00
Skye Wanderman-Milne
3fecdeb793 IMPALA-441: support default values for Avro tables 2014-01-08 10:51:39 -08:00
Lenni Kuff
63fe068d70 Disable HEAPCHECK when running BE unit tests 2014-01-08 10:51:33 -08:00
Lenni Kuff
9fb3f037e3 Set PPROF_PATH in impala-config so pprof is run when HEAPCHECK fails 2014-01-08 10:51:32 -08:00
Lenni Kuff
31cf1cc560 Fix passing of impalad args in start-impala-cluster 2014-01-08 10:51:29 -08:00
Alan Choi
ecee109e68 IMPALA-387 Add refresh/invalidate SQL 2014-01-08 10:51:25 -08:00
ishaan
e7c6d57f9c IMP-773: Add better logging/error detection to start-impala-cluster.py 2014-01-08 10:51:25 -08:00
Alan Choi
b71357fc28 IMPALA-387 Reuse Hdfs and Hive metastore metadata to perform a fast incremental refresh 2014-01-08 10:51:17 -08:00
Nong Li
4d89735ec5 Fix up bin/make_* scripts to use rm -f. 2014-01-08 10:51:14 -08:00
Skye Wanderman-Milne
e7ea89524b Upgrade Avro library to 1.7.4 2014-01-08 10:51:06 -08:00
Lenni Kuff
6915ef9673 Re-enable failure tests + fix test issue due to metric format change 2014-01-08 10:51:02 -08:00
Lenni Kuff
b152a2e71a Bump version to v1.1-INTERNAL 2014-01-08 10:51:01 -08:00
Lenni Kuff
7ac88e1fa9 IMPALA-400: Add support for SQL statement authorization
This changes adds support for SQL statement authorization in Impala. The authorization
works by updating the Catalog API to require a User + Privilege when getting Table/Db
objects (and in the future can be extended to cover columns as well).
If the user doesn't have permission to access the object, an AuthorizationException is
thrown. The authorization checks are done during analysis as new Catalog objects are
encountered.

These changes build on top of the Hive Access code which handles the actually
processing of authorization requests.  The authorization is currently based
on a "policy file" which will be stored in HDFS. This policy file is read once
on startup and then reloaded every 5 minutes. It can also be reloaded on a
specific impalad by executing a "refresh" command.

Authorization is enabled by setting:
--server_name='server1'
and then pointing the impalad to the policy file using the flag:
--authorization_policy_file=/path/to/policy/file

any authorization configuration problems will result in impalad failing to
start.
2014-01-08 10:50:56 -08:00
Lenni Kuff
00b5f65e08 Enable Java signal-chaining in local test environment
From the Java documentation:

"Signal-chaining enables the Java Platform to better interoperate with
native code that installs its own signal handlers... The signal-chaining facility offers:

A. Support for pre-installed signal handlers when the HotSpot VM is created.
B. Support for signal handler installation after the HotSpot VM is created, inside JNI
code or from another native thread."
2014-01-08 10:50:53 -08:00
Lenni Kuff
c96feb9c60 Change Impala version to v1.0.1 2014-01-08 10:50:47 -08:00
Lenni Kuff
97a1d4d8b8 Update Hive to CDH4.3.0 2014-01-08 10:50:44 -08:00
Lenni Kuff
5ccd53d062 Add CDH 4.3.0 HBase to thirdparty 2014-01-08 10:50:38 -08:00
ishaan
227102f4aa Add cdh4.3 bits to Impala. 2014-01-08 10:50:35 -08:00
Lenni Kuff
2f7198292a Add support for auxiliary workloads, tests, and datasets
This change adds support for auxiliary worksloads, tests, and datasets. This is useful
to augment the regular test runs with some additional tests that do not belong in the
main Impala repo.
2014-01-08 10:50:32 -08:00
ishaan
f026354721 IMP-912 Make force killing an option. Update run-all-tests to pre-emptively force kill. 2014-01-08 10:50:29 -08:00
ishaan
54bd0aeddc Disable process failure tests until they stabilize. 2014-01-08 10:50:21 -08:00
Lenni Kuff
7b500d04a7 Bump version to v1.1 2014-01-08 10:50:19 -08:00
Lenni Kuff
9a4feb7391 Add impala local failure test framework and tests 2014-01-08 10:50:18 -08:00
Nong Li
f4fc37368f Switch from boost::regex to google RE2. 2014-01-08 10:50:16 -08:00
Nong Li
b472b4bca6 Bump version to 1.0. 2014-01-08 10:50:01 -08:00
Skye Wanderman-Milne
0ac303ad82 IMPALA-234: Add some library version validation logic to impalad when loading impala-lzo shared library
Change-Id: I51cdbbe5ed7af2f34b7079faf80d45ab9d4c3c35
2014-01-08 10:49:52 -08:00
Nong Li
83ba08cf13 Bump version to .7.1 2014-01-08 10:49:49 -08:00
Alan Choi
b282175461 IMPA-213 Disable DN server check; disable all checks if impala cannot detech cdh version 2014-01-08 10:49:44 -08:00
Lenni Kuff
1693ad4eb3 Force kill existing Impala processes when running start-impala-cluster 2014-01-08 10:49:43 -08:00
Nong Li
1f6481382e Fix parquet test setup. 2014-01-08 10:49:41 -08:00
Lenni Kuff
cba9cd00dd Fix full data load build break due to constructing incorrect HDFS paths 2014-01-08 10:49:34 -08:00
Alan Choi
c419ae1891 Add 4.1 direct read configuration check
Impala detects the HDFS version by reading the Namenode web UI and run
the corresponding check.

On 4.1, Impala tries to check the datanode (server side) config by reading
the datanode web UI.
2014-01-08 10:49:31 -08:00
Lenni Kuff
558d5ce755 Data loading: Exec DDL statements via Impala and don't recreate metadata if it exists 2014-01-08 10:49:28 -08:00
Lenni Kuff
45bdfeb199 Stop running query tests after the failure in run-all-tests 2014-01-08 10:49:16 -08:00
Sean Mackrory
e260ac202b IMP-817: Rebuilding Hadoop libraries with HDFS fix 2014-01-08 10:49:11 -08:00
Lenni Kuff
b877240ffd Increase the 'field_size_limit' for csv reader/writer used in benchmark result processing 2014-01-08 10:49:04 -08:00
Lenni Kuff
8d1674f638 Run only subset of tests with small batch_sizes + a few small fixes 2014-01-08 10:48:58 -08:00
Lenni Kuff
831ee529be Fixed data loading bugs, moved most tables out of load-dependent-tables 2014-01-08 10:48:56 -08:00
Nong Li
c4c2a7168d Fix IR gen build dependency. 2014-01-08 10:48:52 -08:00
Skye Wanderman-Milne
811d5dd00b Create Avro schema directory in test warehouse 2014-01-08 10:48:50 -08:00
Nong Li
0df9476be1 Parquet data loading. 2014-01-08 10:48:48 -08:00