Commit Graph

988 Commits

Author SHA1 Message Date
Lenni Kuff
831ee529be Fixed data loading bugs, moved most tables out of load-dependent-tables 2014-01-08 10:48:56 -08:00
Lenni Kuff
7584312540 IMPALA-167: Impala should gracefully handle unsupported Hive table types 2014-01-08 10:48:56 -08:00
Nong Li
79066a2cdf Make runtime profile more self contained. 2014-01-08 10:48:55 -08:00
Lenni Kuff
ca0d23a844 IMPALA-157: Support CREATE TABLE LIKE DDL 2014-01-08 10:48:55 -08:00
Lenni Kuff
06b5a3fe67 Stop printing the query string in impala-shell when running the 'profile' command
This information is now embedded in the runtime profile so there is no need to print
it twice.
2014-01-08 10:48:55 -08:00
Henry Robinson
8d87972695 Improve parser coverage
This patch adds support for the following SQL constructs

  - Unary + operator
  - The ALL keyword, in SELECT ALL and SELECT aggregate_func(ALL *)
  - REAL and INTEGER as type synonyms for DOUBLE and INT respectively
  - The AS keyword after a table spec. e.g. SELECT * FROM tbl AS t0
2014-01-08 10:48:54 -08:00
Elliott Clark
ade4453a17 Allow impala hbase serdproperties to have newlines 2014-01-08 10:48:54 -08:00
Nong Li
6fdf65ad0f Add query string to runtime profile. 2014-01-08 10:48:54 -08:00
Alan Choi
9c34c6dde9 IMPALA-166 SimpleScheduler::HasHost should hold host_map_lock_ 2014-01-08 10:48:53 -08:00
Alex Behm
be03e6c21c IMPALA-138: Error messages for unknown column types are particularly bad. 2014-01-08 10:48:53 -08:00
Nong Li
88786fd910 Fix buildall.sh 2014-01-08 10:48:53 -08:00
Nong Li
c4c2a7168d Fix IR gen build dependency. 2014-01-08 10:48:52 -08:00
Alex Behm
b72c6ab71b IMPALA-152: SELECT ... ORDER BY without specifying a table name fails with IllegalStateException 2014-01-08 10:48:52 -08:00
Alex Behm
a01573af63 IMPALA-65: Add MySQL-style string literals with escaping. 2014-01-08 10:48:51 -08:00
Skye Wanderman-Milne
811d5dd00b Create Avro schema directory in test warehouse 2014-01-08 10:48:50 -08:00
Nong Li
0df9476be1 Parquet data loading. 2014-01-08 10:48:48 -08:00
Lenni Kuff
e0a7b7cb55 Compute column stats on tables used by Planner tests 2014-01-08 10:48:48 -08:00
Alex Behm
f4d961a241 IMPALA-151: bad DCHECK on "select count(foo, bar)" queries 2014-01-08 10:48:47 -08:00
ishaan
eceefba4e9 Fix build because of old artifact in a test file. 2014-01-08 10:48:47 -08:00
Nong Li
edaadc5091 Fix old rcfile table 2014-01-08 10:48:47 -08:00
ishaan
84398cca23 Fix a problem caused in test result result verification because of a bad merge. 2014-01-08 10:48:46 -08:00
Lenni Kuff
129c6473b9 Update run-workload to gather, display, and archive runtime profiles for each workload query 2014-01-08 10:48:46 -08:00
ishaan
5ed84d7f65 IMP-739 Results for show queries should check for subset, not equality. 2014-01-08 10:48:46 -08:00
Skye Wanderman-Milne
461a48df2b Refactor testing framework to generate Avro tables. 2014-01-08 10:48:45 -08:00
Lenni Kuff
2f8ba3c08e Disable running mini-impala-cluster tests in run-all-tests.sh due to IMPALA-155 2014-01-08 10:48:45 -08:00
Lenni Kuff
6a7b7ea2e0 IMPALA-149: Serialize Hive Metastore metadata loading
This change serializes the Hive Metastore metadata loading code to workaround HIVE-3521
2014-01-08 10:48:45 -08:00
Nong Li
18dfcbd361 Fix build break from bad merge in generate-schema-statements. 2014-01-08 10:48:45 -08:00
Nong Li
6e293090e6 Parquet writer.
Change-Id: I7117b545e3d3a7803a219234ad992040a6c7c4ec
2014-01-08 10:48:44 -08:00
Lenni Kuff
0bcb54fcf8 Add GetRuntimeProfile RPC and enable printing runtime profile from impala-shell 2014-01-08 10:48:44 -08:00
Alexander Behm
39e443407b IMPALA-136: GROUP BY float/double. 2014-01-08 10:48:43 -08:00
Nong Li
62b4afbde4 Catalog loading now accesses volume id internals to get at disk id. 2014-01-08 10:48:42 -08:00
Henry Robinson
899fcff363 IMPALA-36: Connection metrics for Thrift servers 2014-01-08 10:48:41 -08:00
Nong Li
0385d14d69 Fix pre-hive 9 rc file scanner. 2014-01-08 10:48:41 -08:00
Marcel Kornacker
d7bfe6c68d IMPALA-144: partition pruning for arbitrary predicates that are fully bound by partition columns
This makes partition pruning more effective by extending it to predicates that are fully bound by the partition column,
e.g., '<col> IN (1, 2, 3)' will also be used to prune partitions, in addition to equality and binary comparisons.
2014-01-08 10:48:41 -08:00
Alan Choi
13599845d0 Remove DCHECK in ComputeScanRangeAssignment
The state in simple-scheduler could be unstable during stress test:
impalad's connection to state-store failed intermittently. Therefore
the list of available impalad might change within ComputeScanRangeAssignment.
2014-01-08 10:48:40 -08:00
ishaan
610da19f15 Revert "IMP-773: Add better logging/error detection to start-impala-cluster.py"
This reverts commit 4375e98e90f7ad9528d8495fb7c5d23551d51123.
2014-01-08 10:48:40 -08:00
ishaan
41904e5109 IMP-773: Add better logging/error detection to start-impala-cluster.py 2014-01-08 10:48:40 -08:00
Nong Li
dc13d816ab Update IO manager to support better RM and first part to grouped ranges. 2014-01-08 10:48:39 -08:00
Elliott Clark
83358e9b38 Make Impala's use of HTable thread safe.
* Rename HBaseTableCache to HBaseTableFactory
* Cache ExecutorService so that threads are not created for every HTable
* Add method to close HTables.
* Minor clean up of HBaseTableFactory
* Change GetHBaseTable to return Status
2014-01-08 10:48:39 -08:00
Henry Robinson
57ac128872 Disable state-store-test 2014-01-08 10:48:39 -08:00
Lenni Kuff
328ceed4e7 Add support for generating lzo compressed text files and running tests against lzo 2014-01-08 10:48:38 -08:00
Henry Robinson
ad6b7198d8 IMPALA-131: Fix clang compilation error 2014-01-08 10:48:38 -08:00
Lenni Kuff
90d7e085fa Update tests to use num_nodes=0, use external impala cluster, add sanity check run mode 2014-01-08 10:48:38 -08:00
Lenni Kuff
d57440e87d Allow column comments for CREATE TABLE and DESCRIBE <table> statements 2014-01-08 10:48:37 -08:00
Alan Choi
a5611f3dba IMPALA-119 Block locality spew is confusing
In a cluster, we might not have impalad running along side with every
datanode. But that doesn't mean that we have to do remote read.

There are multiple replicas for each block. Therefore we should read
from a replica where it has a collocated impalad first. Only in the case
where none of the replica has a collocated impalad, we'll do remote read.
2014-01-08 10:48:37 -08:00
Nong Li
322de24982 Fix bug in corner case in BaseSequenceScanner::SkipToSync 2014-01-08 10:48:37 -08:00
Lenni Kuff
f1fc449e93 Fix analysis error message when no matching function is found with the given args 2014-01-08 10:48:36 -08:00
Alex Behm
8453d0aa5c IMPALA-83: Cast of string literal to boolean fails analysis. 2014-01-08 10:48:36 -08:00
Skye Wanderman-Milne
57c3072188 Add support for reading Avro files compressed using the deflate codec. 2014-01-08 10:48:36 -08:00
Lenni Kuff
dd9798c9f3 IMP-785: calculation_util.calculate_mean does not calculate mean (instead median) 2014-01-08 10:48:35 -08:00