Commit Graph

193 Commits

Author SHA1 Message Date
Alan Choi
b282175461 IMPA-213 Disable DN server check; disable all checks if impala cannot detech cdh version 2014-01-08 10:49:44 -08:00
Lenni Kuff
1693ad4eb3 Force kill existing Impala processes when running start-impala-cluster 2014-01-08 10:49:43 -08:00
Nong Li
1f6481382e Fix parquet test setup. 2014-01-08 10:49:41 -08:00
Lenni Kuff
cba9cd00dd Fix full data load build break due to constructing incorrect HDFS paths 2014-01-08 10:49:34 -08:00
Alan Choi
c419ae1891 Add 4.1 direct read configuration check
Impala detects the HDFS version by reading the Namenode web UI and run
the corresponding check.

On 4.1, Impala tries to check the datanode (server side) config by reading
the datanode web UI.
2014-01-08 10:49:31 -08:00
Lenni Kuff
558d5ce755 Data loading: Exec DDL statements via Impala and don't recreate metadata if it exists 2014-01-08 10:49:28 -08:00
Lenni Kuff
45bdfeb199 Stop running query tests after the failure in run-all-tests 2014-01-08 10:49:16 -08:00
Sean Mackrory
e260ac202b IMP-817: Rebuilding Hadoop libraries with HDFS fix 2014-01-08 10:49:11 -08:00
Lenni Kuff
b877240ffd Increase the 'field_size_limit' for csv reader/writer used in benchmark result processing 2014-01-08 10:49:04 -08:00
Lenni Kuff
8d1674f638 Run only subset of tests with small batch_sizes + a few small fixes 2014-01-08 10:48:58 -08:00
Lenni Kuff
831ee529be Fixed data loading bugs, moved most tables out of load-dependent-tables 2014-01-08 10:48:56 -08:00
Nong Li
c4c2a7168d Fix IR gen build dependency. 2014-01-08 10:48:52 -08:00
Skye Wanderman-Milne
811d5dd00b Create Avro schema directory in test warehouse 2014-01-08 10:48:50 -08:00
Nong Li
0df9476be1 Parquet data loading. 2014-01-08 10:48:48 -08:00
Lenni Kuff
129c6473b9 Update run-workload to gather, display, and archive runtime profiles for each workload query 2014-01-08 10:48:46 -08:00
Skye Wanderman-Milne
461a48df2b Refactor testing framework to generate Avro tables. 2014-01-08 10:48:45 -08:00
Lenni Kuff
2f8ba3c08e Disable running mini-impala-cluster tests in run-all-tests.sh due to IMPALA-155 2014-01-08 10:48:45 -08:00
ishaan
610da19f15 Revert "IMP-773: Add better logging/error detection to start-impala-cluster.py"
This reverts commit 4375e98e90f7ad9528d8495fb7c5d23551d51123.
2014-01-08 10:48:40 -08:00
ishaan
41904e5109 IMP-773: Add better logging/error detection to start-impala-cluster.py 2014-01-08 10:48:40 -08:00
Lenni Kuff
328ceed4e7 Add support for generating lzo compressed text files and running tests against lzo 2014-01-08 10:48:38 -08:00
Lenni Kuff
90d7e085fa Update tests to use num_nodes=0, use external impala cluster, add sanity check run mode 2014-01-08 10:48:38 -08:00
Henry Robinson
31891f9f69 Revert "Fix snappy-1.0.5 compilation issue on Xubuntu 12.04."
This reverts commit dad37f24f2a3dfa4a967c167cd1ac7d65b7d1e04.
2014-01-08 10:48:34 -08:00
Alex Behm
7b9cd02887 Fix snappy-1.0.5 compilation issue on Xubuntu 12.04. 2014-01-08 10:48:32 -08:00
Elliott Clark
fdda4d70eb fix dirname call in impala-config for zsh 2014-01-08 10:48:31 -08:00
Marcel Kornacker
c02d25baa8 IMPALA-20: Limit clause in inline view not handled correctly by planner
- this adds a SelectNode that evaluates conjuncts and enforces the limit
- all limits are now distributed: enforced both by the child plan fragment and
  by the merging ExchangeNode
- all limits w/ Order By are now distributed: enforced both by the child plan fragment and
  by the merging TopN node
2014-01-08 10:48:29 -08:00
Sean Mackrory
fa4393bc1f Including LD_LIBRARY_PATH in summary of configuration variables 2014-01-08 10:48:26 -08:00
Sean Mackrory
05dd34a819 IMP-594: Impala binaries are embedding build-time locations of libraries 2014-01-08 10:48:25 -08:00
Nong Li
11191d6c82 Default bin/make_release to not use PGO. 2014-01-08 10:48:19 -08:00
Lenni Kuff
d3b9de2222 Add support for detecting significant performance changes (regression and improvements) 2014-01-08 10:48:19 -08:00
Sean Mackrory
d6286e4116 Replacing ternary conditional operator with Python 2.4-compatible syntax 2014-01-08 10:48:19 -08:00
ishaan
09d6d931f4 Change the way data is loaded 2014-01-08 10:48:09 -08:00
Lenni Kuff
a6d89d1ad2 Bumping version to v0.7 2014-01-08 10:48:07 -08:00
Alan Choi
9c11c0ce2d HiveServer2 clean up
This patch adds

1. use boost uuid
2. add unit test for HiveServer2 metadata operation
3. add JDBC metadata unit test
4. implement all remaining HiveServer2: GetFunctions and GetTableTypes
5. remove in-process impala server from fe-support
2014-01-08 10:48:06 -08:00
Lenni Kuff
5be657f4ce Fixed pythonpath after shell egg changes 2014-01-08 10:48:06 -08:00
Skye Wanderman-Milne
8b87099998 IMPALA-2: Support for Avro data files
Adds HdfsAvroScanner, as well as modifies the sequence scanners to be more general.
2014-01-08 10:48:05 -08:00
ishaan
846301c394 Change make_shell_tarball to be able to build external python modules in the repository. 2014-01-08 10:48:00 -08:00
Lenni Kuff
d2e4776731 Support passing snapshot file to buildall, add script to run all tests, remove old tests 2014-01-08 10:47:59 -08:00
Sean Mackrory
67b9d126c4 IMP-755: Build GLog and GFlags exclusively in thirdparty without requiring either to be installed as a package 2014-01-08 10:47:57 -08:00
Lenni Kuff
4d876e01d0 Add support for storing details on number of concurrent clients in backend perf db 2014-01-08 10:47:55 -08:00
Lenni Kuff
4bd6279646 Add targeted failure injection test suite using debug failpoints
Change-Id: I013e913ad3c89f44524bf19638a1da2b83df7463
2014-01-08 10:47:54 -08:00
Alan Choi
251a8a2bf1 IMP-57: rename fe_port to beeswax_port 2014-01-08 10:47:53 -08:00
Nong Li
99aa94149a Bumping version to 0.6 2014-01-08 10:47:50 -08:00
Nong Li
7001fb103e Move Impala to CDH4.2 RC2 2014-01-08 10:47:50 -08:00
Alan Choi
a6c58f195b IMP-546 hbase-table-scanner needs global ref for scan_ and resultscanner_
Enable JNI checking
Add single node test for HBase queries
2014-01-08 10:47:37 -08:00
Sean Mackrory
b56a5c42de Gracefully dealing with unbound PIC_LIB_PATH variable 2014-01-08 10:47:36 -08:00
Alan Choi
bab8cedda4 Add FE/target/dependency/* to the classpath of run-jdbc-client.sh 2014-01-08 10:47:33 -08:00
Sean Mackrory
f276df2ef3 Omitting Perl bindings from thrift build 2014-01-08 10:47:32 -08:00
Sean Mackrory
42366f0387 Adding the option to use Cyrus-SASL and GLog from a separate toolchain location 2014-01-08 10:47:31 -08:00
Lenni Kuff
1a2695781d Add support for targeting JDBC via run-workload and add Impala Jdbc Client tool 2014-01-08 10:47:29 -08:00
Alan Choi
be98df19c8 HiveServer2
This patch implements the HiveServer2  API.

We have tested it with Lenni's patch against the tpch workload. It has also
been tested manually against Hive's beeline with queries and metadata operations.

All of the HiveServer2 code is implemented in impala-hs2-server.cc. Beeswax
code is refactored to impala-beeswax-server.cc.

HiveServer2 has a few more metadata operations. These operations go through
impala-hs2-server to ddl-executor and then to FE. The logics are implemented in
fe/src/main/java/com/cloudera/impala/service/MetadataOp.java.

Because of the Thrift union issue, I have to modify the generated c++ file.
Therefore, all the HiveServer2 thrift generated c++ code are checked into
be/src/service/hiveserver2/. Once the thrift issue is resolved, I'll remove
these files.

Change-Id: I9a8fe5a09bf250ddc43584249bdc87b6da5a5881
2014-01-08 10:47:24 -08:00