Lenni Kuff
831ee529be
Fixed data loading bugs, moved most tables out of load-dependent-tables
2014-01-08 10:48:56 -08:00
Lenni Kuff
7584312540
IMPALA-167: Impala should gracefully handle unsupported Hive table types
2014-01-08 10:48:56 -08:00
Lenni Kuff
ca0d23a844
IMPALA-157: Support CREATE TABLE LIKE DDL
2014-01-08 10:48:55 -08:00
Henry Robinson
8d87972695
Improve parser coverage
...
This patch adds support for the following SQL constructs
- Unary + operator
- The ALL keyword, in SELECT ALL and SELECT aggregate_func(ALL *)
- REAL and INTEGER as type synonyms for DOUBLE and INT respectively
- The AS keyword after a table spec. e.g. SELECT * FROM tbl AS t0
2014-01-08 10:48:54 -08:00
Elliott Clark
ade4453a17
Allow impala hbase serdproperties to have newlines
2014-01-08 10:48:54 -08:00
Alex Behm
be03e6c21c
IMPALA-138: Error messages for unknown column types are particularly bad.
2014-01-08 10:48:53 -08:00
Alex Behm
a01573af63
IMPALA-65: Add MySQL-style string literals with escaping.
2014-01-08 10:48:51 -08:00
Skye Wanderman-Milne
811d5dd00b
Create Avro schema directory in test warehouse
2014-01-08 10:48:50 -08:00
Nong Li
0df9476be1
Parquet data loading.
2014-01-08 10:48:48 -08:00
Lenni Kuff
e0a7b7cb55
Compute column stats on tables used by Planner tests
2014-01-08 10:48:48 -08:00
Nong Li
edaadc5091
Fix old rcfile table
2014-01-08 10:48:47 -08:00
ishaan
5ed84d7f65
IMP-739 Results for show queries should check for subset, not equality.
2014-01-08 10:48:46 -08:00
Skye Wanderman-Milne
461a48df2b
Refactor testing framework to generate Avro tables.
2014-01-08 10:48:45 -08:00
Nong Li
18dfcbd361
Fix build break from bad merge in generate-schema-statements.
2014-01-08 10:48:45 -08:00
Nong Li
6e293090e6
Parquet writer.
...
Change-Id: I7117b545e3d3a7803a219234ad992040a6c7c4ec
2014-01-08 10:48:44 -08:00
Alexander Behm
39e443407b
IMPALA-136: GROUP BY float/double.
2014-01-08 10:48:43 -08:00
Nong Li
0385d14d69
Fix pre-hive 9 rc file scanner.
2014-01-08 10:48:41 -08:00
Marcel Kornacker
d7bfe6c68d
IMPALA-144: partition pruning for arbitrary predicates that are fully bound by partition columns
...
This makes partition pruning more effective by extending it to predicates that are fully bound by the partition column,
e.g., '<col> IN (1, 2, 3)' will also be used to prune partitions, in addition to equality and binary comparisons.
2014-01-08 10:48:41 -08:00
Lenni Kuff
328ceed4e7
Add support for generating lzo compressed text files and running tests against lzo
2014-01-08 10:48:38 -08:00
Lenni Kuff
90d7e085fa
Update tests to use num_nodes=0, use external impala cluster, add sanity check run mode
2014-01-08 10:48:38 -08:00
Lenni Kuff
d57440e87d
Allow column comments for CREATE TABLE and DESCRIBE <table> statements
2014-01-08 10:48:37 -08:00
Lenni Kuff
9f71374875
IMPALA-102: Add support for CREATE TABLE ... PARTITIONED BY (col1, col2)
2014-01-08 10:48:35 -08:00
Lenni Kuff
1cd847c856
IMPALA-81: Add support for CREATE/DROP DATABASE/TABLE
...
This adds Impala support for CREATE/DROP DATABASE/TABLE. With this change, Impala
supports creating tables in the metastore stored as text, sequence, and rc file format.
It currently only supports creating unpartitioned tables and tables stored in HDFS.
2014-01-08 10:48:30 -08:00
Marcel Kornacker
c02d25baa8
IMPALA-20: Limit clause in inline view not handled correctly by planner
...
- this adds a SelectNode that evaluates conjuncts and enforces the limit
- all limits are now distributed: enforced both by the child plan fragment and
by the merging ExchangeNode
- all limits w/ Order By are now distributed: enforced both by the child plan fragment and
by the merging TopN node
2014-01-08 10:48:29 -08:00
Lenni Kuff
5f9cd044ee
Add scanner test suite that runs across all file format/compression permuations
2014-01-08 10:48:25 -08:00
Lenni Kuff
6e1f8d178a
Update utility script to compute column and table stats for given table(s)
2014-01-08 10:48:23 -08:00
ishaan
5138a720bb
IMP-768: Enable the python test framework to check for insert results.
2014-01-08 10:48:22 -08:00
Skye Wanderman-Milne
6c08716439
IMPALA-92: Significant performance difference between LIKE = 'x' AND = 'x'
2014-01-08 10:48:21 -08:00
ishaan
f1d37646ed
Fix creation of the insert_string_partitioned_table
2014-01-08 10:48:20 -08:00
Henry Robinson
222d15c6ca
IMPALA-72: String partition keys should be URL encoded
2014-01-08 10:48:20 -08:00
Skye Wanderman-Milne
f4784947ce
buildall.sh improvements: move 'set -e' higher, kill processes that are accessing postgres before creating metastore
2014-01-08 10:48:18 -08:00
Nong Li
27bc33d6b4
Fix snapshot cleanup.
2014-01-08 10:48:18 -08:00
ishaan
09d6d931f4
Change the way data is loaded
2014-01-08 10:48:09 -08:00
Lenni Kuff
99bb22dcac
Add db name filter to compute stats, run compute stats on functional/text tables
2014-01-08 10:48:08 -08:00
Skye Wanderman-Milne
357327b5c0
Fix file offsets in DataErrorsTest
2014-01-08 10:48:06 -08:00
Alan Choi
73c8ee3d96
IMPALA-18 Ignore hidden file prefixed with . or _
2014-01-08 10:48:00 -08:00
Lenni Kuff
d2e4776731
Support passing snapshot file to buildall, add script to run all tests, remove old tests
2014-01-08 10:47:59 -08:00
Nong Li
a0229cd12e
Update tpch schema to use bigint for keys.
2014-01-08 10:47:54 -08:00
Nong Li
7001fb103e
Move Impala to CDH4.2 RC2
2014-01-08 10:47:50 -08:00
Lenni Kuff
409d2ae5d7
Migrate run-test to python and add mini-stress test as part of buildall
2014-01-08 10:47:34 -08:00
Lenni Kuff
1896701399
IMPALA-44: Database names are case sensitive
2014-01-08 10:47:34 -08:00
Lenni Kuff
3fb375cdc4
Add initial set of queries for targeted perf workload
...
Includes a query that runs a simple "limit 0" as well as queries that perform aggregation
on columns with different numbers of GROUP BY groups.
2014-01-08 10:47:23 -08:00
Lenni Kuff
d5177c3c30
Update run-workload to support specifying table format test vectors from command line
2014-01-08 10:47:20 -08:00
Nong Li
02c329b97a
Update RC files to use io mgr and remove scanner support for non-io mgr.
2014-01-08 10:47:11 -08:00
Lenni Kuff
9d981984e7
Update expected results of the 'show table/database' test to remove trevni tables
2014-01-08 10:47:10 -08:00
Lenni Kuff
deea7a86b9
Remove Trevni from mixed format table and fix data loading bug
2014-01-08 10:47:10 -08:00
Lenni Kuff
e10960b2c9
Disable test execution against Trevni and replace with seq/snap format
2014-01-08 10:47:10 -08:00
Lenni Kuff
12d18631e3
Test enhancements: dynamic table format data loading, per-workload exploration stategies
2014-01-08 10:47:07 -08:00
Lenni Kuff
c806738af2
Add scan range length tests to Python test framework
2014-01-08 10:47:06 -08:00
Nong Li
15dfd968fb
Disable tpch-q21 and fix plan output for tpch-q22.
...
We can now generate the temp table for q22 which changes the plan output.
2014-01-08 10:47:03 -08:00