Tim Armstrong 5b1157b44b IMPALA-2079: Part 2: handling tmp device errors ...

Tmp devices are blacklisted when a write error is encountered for that
device. No more scratch space will be allocated on the blacklisted
device, based on the assumption that the device is likely to be
misconfigured or failing.

This patch does not attempt to recover the query that experienced the
write error. It also does not attempt to remap any existing blocks away
from the temporary device.

This behaviour is unit tested for several failure scenarios.

This patch adds additional test infrastructure required for testing
BufferedBlockMgr behavior in the presence of faults and in
configurations with multiple tmp directories.

Adds metrics tmp-file-mgr.active-scratch-dirs and
tmp-file-mgr.active-scratch-dirs.list that track the number and set of
active scratch dirs and expose it in the Impala web UI.

Change-Id: I9d80ed3a7afad6ff8e5d739b6ea2bc0949f16746
Reviewed-on: http://gerrit.cloudera.org:8080/579
Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
Tested-by: Internal Jenkins

2015-09-03 01:54:32 +00:00

..

function-registry

IMPALA-1660: addendum: add more aliases

2015-09-01 10:46:16 +00:00

thrift

IMPALA-2079: Part 2: handling tmp device errors

2015-09-03 01:54:32 +00:00

.gitignore

Implmented opcode registry. Added substr() and pi() functions. Added backend testing to buildall.sh

2011-11-20 13:44:41 -08:00