Commit Graph

34 Commits

Author SHA1 Message Date
Lenni Kuff
ca0d23a844 IMPALA-157: Support CREATE TABLE LIKE DDL 2014-01-08 10:48:55 -08:00
Nong Li
0df9476be1 Parquet data loading. 2014-01-08 10:48:48 -08:00
ishaan
5ed84d7f65 IMP-739 Results for show queries should check for subset, not equality. 2014-01-08 10:48:46 -08:00
Skye Wanderman-Milne
461a48df2b Refactor testing framework to generate Avro tables. 2014-01-08 10:48:45 -08:00
Lenni Kuff
328ceed4e7 Add support for generating lzo compressed text files and running tests against lzo 2014-01-08 10:48:38 -08:00
Lenni Kuff
90d7e085fa Update tests to use num_nodes=0, use external impala cluster, add sanity check run mode 2014-01-08 10:48:38 -08:00
Lenni Kuff
1cd847c856 IMPALA-81: Add support for CREATE/DROP DATABASE/TABLE
This adds Impala support for CREATE/DROP DATABASE/TABLE. With this change, Impala
supports creating tables in the metastore stored as text, sequence, and rc file format.
It currently only supports creating unpartitioned tables and tables stored in HDFS.
2014-01-08 10:48:30 -08:00
Marcel Kornacker
c02d25baa8 IMPALA-20: Limit clause in inline view not handled correctly by planner
- this adds a SelectNode that evaluates conjuncts and enforces the limit
- all limits are now distributed: enforced both by the child plan fragment and
  by the merging ExchangeNode
- all limits w/ Order By are now distributed: enforced both by the child plan fragment and
  by the merging TopN node
2014-01-08 10:48:29 -08:00
Lenni Kuff
5f9cd044ee Add scanner test suite that runs across all file format/compression permuations 2014-01-08 10:48:25 -08:00
ishaan
09d6d931f4 Change the way data is loaded 2014-01-08 10:48:09 -08:00
Nong Li
e11c5a772c Fix snappy block decompressor and mem pool usage in rc file. 2014-01-08 10:47:50 -08:00
Alan Choi
a6c58f195b IMP-546 hbase-table-scanner needs global ref for scan_ and resultscanner_
Enable JNI checking
Add single node test for HBase queries
2014-01-08 10:47:37 -08:00
Lenni Kuff
19e080136c IMP-735: Add proper cleanup to test that creates out-of-band hive tables 2014-01-08 10:47:36 -08:00
Lenni Kuff
42eef84200 IMPALA-30: Make Catalog Db and Table caches thread safe 2014-01-08 10:47:30 -08:00
Skye Wanderman-Milne
0387bb92bf IMPALA-14: Files with .gz extension reported as 'not supported'
Fix logic in HdfsTable. Rename TestUnsupportedFormats to TestCompressedFormats and refactor with new tests.
2014-01-08 10:47:13 -08:00
Nong Li
02c329b97a Update RC files to use io mgr and remove scanner support for non-io mgr. 2014-01-08 10:47:11 -08:00
Nong Li
63745c749e Fix hang for queries when the limit is first reached by the coordinator.
Remote fragments are waiting for the coordinator to pump rows but the coordinator
decided it was done.  This caused remote fragments to hang.  The coordinator was
in turn waiting for the remote fragments to finish.
2014-01-08 10:47:11 -08:00
Lenni Kuff
deea7a86b9 Remove Trevni from mixed format table and fix data loading bug 2014-01-08 10:47:10 -08:00
Lenni Kuff
5869611fb8 Add targeted cancellation tests 2014-01-08 10:47:07 -08:00
Lenni Kuff
12d18631e3 Test enhancements: dynamic table format data loading, per-workload exploration stategies 2014-01-08 10:47:07 -08:00
Lenni Kuff
5269915fe7 Disable limit tests due to IMP-660 2014-01-08 10:47:06 -08:00
Lenni Kuff
c806738af2 Add scan range length tests to Python test framework 2014-01-08 10:47:06 -08:00
Lenni Kuff
ef9a5c2d0e Add test suite for DEFAULT_ORDER_BY_LIMIT query option 2014-01-08 10:47:05 -08:00
Nong Li
7a4012e15a Fix limit issue in exchange node. 2014-01-08 10:47:05 -08:00
Nong Li
15dfd968fb Disable tpch-q21 and fix plan output for tpch-q22.
We can now generate the temp table for q22 which changes the plan output.
2014-01-08 10:47:03 -08:00
Nong Li
f46c654e01 Enable tpch-q21 and tpch-q22 in tests. 2014-01-08 10:47:03 -08:00
Nong Li
b575b08357 Fix planner to reject compressed text formats. 2014-01-08 10:47:01 -08:00
Lenni Kuff
e20720f5d3 Disable loading Trevni for load/select statements that are not union compatible 2014-01-08 10:46:58 -08:00
Lenni Kuff
f8953ee8e6 Run end-to-end tests before planner tests
This is needed because the planner test expected results depend on some tables
being populated by running tests that do inserts (TPC-H, etc).
2014-01-08 10:46:58 -08:00
Lenni Kuff
30dbf59ef2 Final changes to enable Python test infrastructure and tests
With this change the Python tests will now be called as part of buildall and
the corresponding Java tests have been disabled. The new tests can also be
invoked calling ./tests/run-tests.sh directly.

This includes a fix from Nong that caused wrong results for limit on non-io
manager formats.
2014-01-08 10:46:57 -08:00
Lenni Kuff
2c12200395 Improve logging verbosity in Python test infrastructure 2014-01-08 10:46:55 -08:00
Lenni Kuff
bed633c1ae Extract config/metastore creation from buildall + script for loading warehouse snapshot 2014-01-08 10:46:53 -08:00
Lenni Kuff
1b248d067b Add TPC-DS dataset and workload 2014-01-08 10:46:52 -08:00
Lenni Kuff
ef48f65e76 Add test framework for running Impala query tests via Python
This is the first set of changes required to start getting our functional test
infrastructure moved from JUnit to Python. After investigating a number of
option, I decided to go with a python test executor named py.test
(http://pytest.org/). It is very flexible, open source (MIT licensed), and will
enable us to do some cool things like parallel test execution.

As part of this change, we now use our "test vectors" for query test execution.
This will be very nice because it means if load the "core" dataset you know you
will be able to run the "core" query tests (specified by --exploration_strategy
when running the tests).

You will see that now each combination of table format + query exec options is
treated like an individual test case. this will make it much easier to debug
exactly where something failed.

These new tests can be run using the script at tests/run-tests.sh
2014-01-08 10:46:50 -08:00