Commit Graph

7 Commits

Author SHA1 Message Date
Casey Ching
0ee478d1ce Python: Improve usability of the ClusterController class
This is general clean up in prep for use with the stress test.

Changes:
  1) Failed commands and failure to connect now raise exceptions.
     Previously run_cmd() was not guaranteed to do anything at all in
     remote mode.
  2) Fix scope of 'hosts' which was at the class level but was modified
     by instance level functions which makes no sense since different
     instances could clash with each other.
  3) Remove uses of opaque *args and **kwargs instead of named args. The
     generic forms should be avoided since they impair readability.
  4) Stop trying to get the cluster hosts from an environment variable
     unconditionally upon construction.
  5) Remove 'local' member variable, it's not needed and allowing 'local'
     to be set to False when no 'hosts' are not set makes no sense.
  6) Simplify and remove unneeded methods and arguments.

Change-Id: Id90bd3b640f2681bb7e82a5e6d5e49ed8c5a7b98
Reviewed-on: http://gerrit.cloudera.org:8080/514
Reviewed-by: Casey Ching <casey@cloudera.com>
Tested-by: Internal Jenkins
2015-07-22 00:44:45 +00:00
Nong Li
b310935424 Minor workload runner logging improvements.
Change-Id: I75d27593599e654f7fab1cd104dd9fe9fa88cfdb
Reviewed-on: http://gerrit.ent.cloudera.com:8080/1145
Reviewed-by: Lenni Kuff <lskuff@cloudera.com>
Tested-by: jenkins

Conflicts:
	tests/common/workload_runner.py
2014-01-08 10:54:38 -08:00
ishaan
6b9f01374b Selectively mute fabric's logging while running remote commands.
This change encloses fabric's task method with its 'hide' context manager. The current
state of the running commands are muted (i.e, hosts connected to, which command is running
etc.). Error messages are NOT muted, and will still be displayed (connection error,
command failure).

Change-Id: Ibfbbb995ab6fe057faec9af8be90449654b21f8c
Reviewed-on: http://gerrit.ent.cloudera.com:8080/1155
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: jenkins
2014-01-08 10:54:37 -08:00
ishaan
c9aa31ac02 Suppress log spew while running plugins in the workload runner.
The plugin runner uses fabric as the underlying mechanism for running remote commands on
cluster hosts. fabric in turn uses paramiko, which generates a lot of log spew. This
change seta parmiko's logging level to ERROR, eliminating excess logging. Additionally,
it also constrains fabric's logging.

Change-Id: I6229d64f95f9c1512cc01842c4a661e96e421086
Reviewed-on: http://gerrit.ent.cloudera.com:8080/1064
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: jenkins
2014-01-08 10:54:23 -08:00
ishaan
1780084753 Fail a performance job when a plugin fails.
Change-Id: I81fd9ec742a9efbdb16466c8ee7387fabe3e16e4
Reviewed-on: http://gerrit.ent.cloudera.com:8080/342
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: Ishaan Joshi <ishaan@cloudera.com>
2014-01-08 10:52:31 -08:00
Alex Leblang
a4e441cc15 VTune Plugin
This is a plugin that runs Intel's VTune from within the Impala test plugin runner framework.

Change-Id: I673a2f6c4785bfcf565e8b002c14ada7a7c8f48a
Reviewed-on: http://gerrit.ent.cloudera.com:8080/195
Reviewed-by: Alex Leblang <alex.leblang@cloudera.com>
Tested-by: Alex Leblang <alex.leblang@cloudera.com>
2014-01-08 10:52:12 -08:00
ishaan
6f9569ea6f Add a plugin framework for run-workload 2014-01-08 10:51:39 -08:00