ishaan
a6cb5f70a4
Introduce the notion of scope to the plugin framework.
...
Change-Id: I2cf39c38e7e0a359950d9e05e2daed433fc0c38f
Reviewed-on: http://gerrit.ent.cloudera.com:8080/144
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com >
Tested-by: Ishaan Joshi <ishaan@cloudera.com >
2014-01-08 10:52:05 -08:00
ishaan
43deb6692f
Make start-impala-cluster tolerate the failure of importing ImpalaCluster()
...
Change-Id: I795ed5eed9fb33ab62f2229c8745800393ddb712
Reviewed-on: http://gerrit.ent.cloudera.com:8080/164
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com >
Tested-by: Ishaan Joshi <ishaan@cloudera.com >
2014-01-08 10:52:05 -08:00
Lenni Kuff
4cd8830814
Simplify building CLASSPATH for run-jdbc-client.sh
...
Change-Id: I4dd77e0a83b87474260fdc19a93a0ccf4b766ad7
Reviewed-on: http://gerrit.ent.cloudera.com:8080/100
Reviewed-by: Henry Robinson <henry@cloudera.com >
Tested-by: Henry Robinson <henry@cloudera.com >
2014-01-08 10:51:58 -08:00
Nong Li
9af39ad4c4
Add check for llvm version in CMake.
2014-01-08 10:51:55 -08:00
Alan Choi
4c32278782
IMP-973 Reassign HBase regions after HBase restart
2014-01-08 10:51:54 -08:00
Lenni Kuff
fc2d8836c4
Bump version to v1.2
2014-01-08 10:51:51 -08:00
Lenni Kuff
8c264f0395
Added Sentry v1.1.0 to thirdparty
2014-01-08 10:51:48 -08:00
ishaan
caeadcc1f3
Throw an error when impalads don't start in start-impala-cluster.
2014-01-08 10:51:42 -08:00
ishaan
2819f4c56e
Fix cluster logging and redirect errors to logfile
2014-01-08 10:51:40 -08:00
ishaan
6f9569ea6f
Add a plugin framework for run-workload
2014-01-08 10:51:39 -08:00
Skye Wanderman-Milne
3fecdeb793
IMPALA-441: support default values for Avro tables
2014-01-08 10:51:39 -08:00
Lenni Kuff
63fe068d70
Disable HEAPCHECK when running BE unit tests
2014-01-08 10:51:33 -08:00
Lenni Kuff
9fb3f037e3
Set PPROF_PATH in impala-config so pprof is run when HEAPCHECK fails
2014-01-08 10:51:32 -08:00
Lenni Kuff
31cf1cc560
Fix passing of impalad args in start-impala-cluster
2014-01-08 10:51:29 -08:00
Alan Choi
ecee109e68
IMPALA-387 Add refresh/invalidate SQL
2014-01-08 10:51:25 -08:00
ishaan
e7c6d57f9c
IMP-773: Add better logging/error detection to start-impala-cluster.py
2014-01-08 10:51:25 -08:00
Alan Choi
b71357fc28
IMPALA-387 Reuse Hdfs and Hive metastore metadata to perform a fast incremental refresh
2014-01-08 10:51:17 -08:00
Nong Li
4d89735ec5
Fix up bin/make_* scripts to use rm -f.
2014-01-08 10:51:14 -08:00
Skye Wanderman-Milne
e7ea89524b
Upgrade Avro library to 1.7.4
2014-01-08 10:51:06 -08:00
Lenni Kuff
6915ef9673
Re-enable failure tests + fix test issue due to metric format change
2014-01-08 10:51:02 -08:00
Lenni Kuff
b152a2e71a
Bump version to v1.1-INTERNAL
2014-01-08 10:51:01 -08:00
Lenni Kuff
7ac88e1fa9
IMPALA-400: Add support for SQL statement authorization
...
This changes adds support for SQL statement authorization in Impala. The authorization
works by updating the Catalog API to require a User + Privilege when getting Table/Db
objects (and in the future can be extended to cover columns as well).
If the user doesn't have permission to access the object, an AuthorizationException is
thrown. The authorization checks are done during analysis as new Catalog objects are
encountered.
These changes build on top of the Hive Access code which handles the actually
processing of authorization requests. The authorization is currently based
on a "policy file" which will be stored in HDFS. This policy file is read once
on startup and then reloaded every 5 minutes. It can also be reloaded on a
specific impalad by executing a "refresh" command.
Authorization is enabled by setting:
--server_name='server1'
and then pointing the impalad to the policy file using the flag:
--authorization_policy_file=/path/to/policy/file
any authorization configuration problems will result in impalad failing to
start.
2014-01-08 10:50:56 -08:00
Lenni Kuff
00b5f65e08
Enable Java signal-chaining in local test environment
...
From the Java documentation:
"Signal-chaining enables the Java Platform to better interoperate with
native code that installs its own signal handlers... The signal-chaining facility offers:
A. Support for pre-installed signal handlers when the HotSpot VM is created.
B. Support for signal handler installation after the HotSpot VM is created, inside JNI
code or from another native thread."
2014-01-08 10:50:53 -08:00
Lenni Kuff
c96feb9c60
Change Impala version to v1.0.1
2014-01-08 10:50:47 -08:00
Lenni Kuff
97a1d4d8b8
Update Hive to CDH4.3.0
2014-01-08 10:50:44 -08:00
Lenni Kuff
5ccd53d062
Add CDH 4.3.0 HBase to thirdparty
2014-01-08 10:50:38 -08:00
ishaan
227102f4aa
Add cdh4.3 bits to Impala.
2014-01-08 10:50:35 -08:00
Lenni Kuff
2f7198292a
Add support for auxiliary workloads, tests, and datasets
...
This change adds support for auxiliary worksloads, tests, and datasets. This is useful
to augment the regular test runs with some additional tests that do not belong in the
main Impala repo.
2014-01-08 10:50:32 -08:00
ishaan
f026354721
IMP-912 Make force killing an option. Update run-all-tests to pre-emptively force kill.
2014-01-08 10:50:29 -08:00
ishaan
54bd0aeddc
Disable process failure tests until they stabilize.
2014-01-08 10:50:21 -08:00
Lenni Kuff
7b500d04a7
Bump version to v1.1
2014-01-08 10:50:19 -08:00
Lenni Kuff
9a4feb7391
Add impala local failure test framework and tests
2014-01-08 10:50:18 -08:00
Nong Li
f4fc37368f
Switch from boost::regex to google RE2.
2014-01-08 10:50:16 -08:00
Nong Li
b472b4bca6
Bump version to 1.0.
2014-01-08 10:50:01 -08:00
Skye Wanderman-Milne
0ac303ad82
IMPALA-234: Add some library version validation logic to impalad when loading impala-lzo shared library
...
Change-Id: I51cdbbe5ed7af2f34b7079faf80d45ab9d4c3c35
2014-01-08 10:49:52 -08:00
Nong Li
83ba08cf13
Bump version to .7.1
2014-01-08 10:49:49 -08:00
Alan Choi
b282175461
IMPA-213 Disable DN server check; disable all checks if impala cannot detech cdh version
2014-01-08 10:49:44 -08:00
Lenni Kuff
1693ad4eb3
Force kill existing Impala processes when running start-impala-cluster
2014-01-08 10:49:43 -08:00
Nong Li
1f6481382e
Fix parquet test setup.
2014-01-08 10:49:41 -08:00
Lenni Kuff
cba9cd00dd
Fix full data load build break due to constructing incorrect HDFS paths
2014-01-08 10:49:34 -08:00
Alan Choi
c419ae1891
Add 4.1 direct read configuration check
...
Impala detects the HDFS version by reading the Namenode web UI and run
the corresponding check.
On 4.1, Impala tries to check the datanode (server side) config by reading
the datanode web UI.
2014-01-08 10:49:31 -08:00
Lenni Kuff
558d5ce755
Data loading: Exec DDL statements via Impala and don't recreate metadata if it exists
2014-01-08 10:49:28 -08:00
Lenni Kuff
45bdfeb199
Stop running query tests after the failure in run-all-tests
2014-01-08 10:49:16 -08:00
Sean Mackrory
e260ac202b
IMP-817: Rebuilding Hadoop libraries with HDFS fix
2014-01-08 10:49:11 -08:00
Lenni Kuff
b877240ffd
Increase the 'field_size_limit' for csv reader/writer used in benchmark result processing
2014-01-08 10:49:04 -08:00
Lenni Kuff
8d1674f638
Run only subset of tests with small batch_sizes + a few small fixes
2014-01-08 10:48:58 -08:00
Lenni Kuff
831ee529be
Fixed data loading bugs, moved most tables out of load-dependent-tables
2014-01-08 10:48:56 -08:00
Nong Li
c4c2a7168d
Fix IR gen build dependency.
2014-01-08 10:48:52 -08:00
Skye Wanderman-Milne
811d5dd00b
Create Avro schema directory in test warehouse
2014-01-08 10:48:50 -08:00
Nong Li
0df9476be1
Parquet data loading.
2014-01-08 10:48:48 -08:00