jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2025-12-25 02:03:09 -05:00
Code Issues Projects Releases Wiki Activity
520 Commits 49 Branches 63 Tags
6bf2b3c74ee18c8b51f87343e17165ae8ee0f184
Commit Graph

520 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Henry Robinson
6bf2b3c74e Add tarball build-step for shell, also shell version number 2014-01-08 10:45:07 -08:00
Lenni Kuff
1b4f318bf2 Update run-workload to facilitate beeswax execution and support saving of partial results 
This change updates run-workload to provide a more generic interface for query
execution. Now the query executor just takes an execution function and a new
QueryExecOptions object that defines the values to use for execution.
I also made a change to store partial result sets so we can salvage some work if
a run fails.
 2014-01-08 10:45:06 -08:00
Marcel Kornacker
f08ba42df2 fixing deadlock in PlanFragmentExecutor::UpdateStatus() 2014-01-08 10:45:06 -08:00
Nong Li
be33587e10 Added wall based rate counters and other counter cleanup. 2014-01-08 10:45:06 -08:00
Henry Robinson
decf02a1c9 IMP-325: Speed up state-store-test 2014-01-08 10:45:06 -08:00
Marcel Kornacker
f58db29942 Fixing bugs in PlanFragmentExecutor: 
- the report callback is now *always* invoked when execution finishes,
  regardless of --status_report_interval setting
- except that no final report is sent if the execution was cancelled
- the report thread is stopped when execution finishes in Open() or GetNext()
  (ie, not in the d'tor)
 2014-01-08 10:45:05 -08:00
Henry Robinson
a55e7777ef IMP-324: Write command line flags into log at startup 2014-01-08 10:45:05 -08:00
ishaan
42231b7d86 Annotate queries for better benchmark reporting. 2014-01-08 10:45:05 -08:00
ishaan
23db0c0605 Enable query cancellation on Ctrl^c, enable shell exit on Ctrl^D, misc error handling. 2014-01-08 10:45:05 -08:00
Henry Robinson
e7348a209b IMP-232: Parallel INSERT OVERWRITE 2014-01-08 10:45:04 -08:00
Nong Li
cb0685c69f Fix block locations when a data node does not report back. 2014-01-08 10:45:04 -08:00
Nong Li
126971edbb Update Impala to use CDH4.1 rc3. 2014-01-08 10:45:04 -08:00
Nong Li
a895803d84 Updated hive and hbase to rc3. 2014-01-08 10:45:01 -08:00
Nong Li
43da021a27 Updated hadoop to 4.1-rc3. 2014-01-08 10:44:54 -08:00
Daniel Jackoway
bb1db52bdd Hash Aggregation Progress and experiments 
Marcel asked me to just push everything I have.
It's all in experiments/ so not a big deal, and he'll look it over after launch.
 2014-01-08 10:44:51 -08:00
Marcel Kornacker
1b11130a5d extra debugging output: 
- per-query volume id histogram
- info about in-progress backends
- temporarily: log reader on every DiskIoMgr::GetNext() call
 2014-01-08 10:44:51 -08:00
Henry Robinson
afc30baf52 Impalad for Trevni loading shouldn't use a state-store 2014-01-08 10:44:51 -08:00
Lenni Kuff
7d595ba740 Update run-workload result reporting to make reference result comparison more flexible 
Now we save Hive results into a separate file (previously everything was stored
in the same file. Also added ability to do a run-benchmark and specify to skip
impala and which will help generate hive reference results.

Updated the reporting script to reflect this change.
 2014-01-08 10:44:50 -08:00
Henry Robinson
a401b38830 Fix broken state-store-test 2014-01-08 10:44:50 -08:00
Henry Robinson
dc94b9d06f List / set metrics review responses 2014-01-08 10:44:50 -08:00
Henry Robinson
30653278b4 run-query should not start a state-store client by default 2014-01-08 10:44:50 -08:00
Michael Ubell
dafee3e504 Detect EOF when reading more than the scan range offset. 2014-01-08 10:44:49 -08:00
Henry Robinson
eeb63e37ad Add list / set metrics, and num queries metric to impala-server 2014-01-08 10:44:49 -08:00
Henry Robinson
e3e6ba984b Show / describe 2014-01-08 10:44:49 -08:00
Henry Robinson
825c63ad3b IMP-298: Make standalone impalad start a scheduler for a single node 2014-01-08 10:44:49 -08:00
Nong Li
99441da2f4 QueryIds and FragmentIds are now always printed in hex. 2014-01-08 10:44:48 -08:00
Alan Choi
b2822ab410 IMP-274 call to Datanode to retrieve disk volume id per scan node, not per file block 2014-01-08 10:44:48 -08:00
Nong Li
05d1fa5bc6 Fix metadata for runtime profiles. 2014-01-08 10:44:48 -08:00
Henry Robinson
4ab79db94f IMP-266 / IMP-173: Impalad should retry connection to state-store 2014-01-08 10:44:48 -08:00
Marcel Kornacker
c004cdaa1c Thrift structures for the new planner interface. 2014-01-08 10:44:47 -08:00
Nong Li
a417099e66 Fix runtime profile aggregated throughput. 2014-01-08 10:44:47 -08:00
Alan Choi
ca5de77423 IMP-296 runquery fetches as many rows as possible from ImpalaServer 2014-01-08 10:44:47 -08:00
Lenni Kuff
c858580526 Report each Impala/StateStore metric on a newline 
Previously metrics were reported as:

simple-scheduler.assignments.total:0simple-scheduler.initialized:1simple-scheduler.local.assignments.total:0

Now they are reported as:
simple-scheduler.assignments.total:0
simple-scheduler.initialized:1
simple-scheduler.local.assignments.total:0
 2014-01-08 10:44:47 -08:00
Nong Li
80f977afc6 Improve error logging for scanners. Errors accumulated in the log get output to vlog. 2014-01-08 10:44:46 -08:00
Nong Li
3dad9589f4 Add debug function to dump stack trace. 2014-01-08 10:44:46 -08:00
Nong Li
689fb7d799 Push throughput counter to io mgr and other counter fixes. 2014-01-08 10:44:46 -08:00
Marcel Kornacker
c18d0970d7 Changed RuntimeProfile::PrettyPrint() and Coordinator::BackendExecState::GetNodeThroughput() 
not to hold locks while they make function calls.

Changed Frontend.assignIds() to use UUID.randomUUID() to generate the query id.
 2014-01-08 10:44:46 -08:00
Henry Robinson
af2d5e49ff IMP-286: Log number of backends in state-store logs 2014-01-08 10:44:45 -08:00
Alan Choi
8dae344ceb Do not validate filename in DataErrorTest because it is not deterministic. 2014-01-08 10:44:45 -08:00
Alan Choi
22765fc33a IMP-251: re-enable DataErrorTest 
verify that the exception message contains the correct error;
verify that excpected exception is thrown;
verify that no exception is thrown when abort_on_error is set to false
 2014-01-08 10:44:45 -08:00
Marcel Kornacker
b7c2455979 HdfsScanNode.computeHostBlockAssignments() now skips blocks w/o location information 
instead of throwing an IllegalStateException.
 2014-01-08 10:44:45 -08:00
Nong Li
e160e09a85 Fix incorrect use of memcpy llvm codegen intrinsic. 2014-01-08 10:44:44 -08:00
ishaan
4c84cdae51 Handle queries with '%', python does not parse it properly. 2014-01-08 10:44:44 -08:00
Henry Robinson
5a1dc644df Include stack trace in exceptions seen by JNI 2014-01-08 10:44:44 -08:00
Nong Li
00fa6ba2fb Remove explicit includes for glog and gflags. 2014-01-08 10:44:44 -08:00
Nong Li
ca1b47d4b4 Fix link order of glog/gflags 2014-01-08 10:44:43 -08:00
Henry Robinson
70f23ef3a3 Add state-store metric server and first metric 2014-01-08 10:44:43 -08:00
ishaan
b21b1a5aff Change build path for built type CODECOVERAGE_DEBUG 2014-01-08 10:44:43 -08:00
Marcel Kornacker
14e3f29ef9 fixing broken build 2014-01-08 10:44:43 -08:00
Marcel Kornacker
c7f375d732 removing debug logging stmt 2014-01-08 10:44:42 -08:00