Commit Graph

4 Commits

Author SHA1 Message Date
Henry Robinson
e87c0eb22a [CDH5] Detect pseudo-distributed Llama cluster
Since we're no longer using the MiniLlama, we need to explicitly set
whether or not the cluster is pseudo-distributed. Impala needs this
information to correctly translate datanode addresses to a format that
Llama understands.

This change (adapted from one made by Casey) adds a method to the
frontend (callable via JNI) to get a configuration value from the Hadoop
configuration. We'll set that configuration value for local RM testing.

Change-Id: Ifd51db98a993ac0270dac2b832babbc394483c1a
Reviewed-on: http://gerrit.ent.cloudera.com:8080/2549
Reviewed-by: Alex Behm <alex.behm@cloudera.com>
Tested-by: jenkins
2014-05-20 21:24:33 -07:00
ishaan
0fa87cba54 Reduce mini dfs logging verbosity.
Currently, the default log level is set to DEBUG. This produces approximately 10-20 GB of
logs per build, which is unacceptable.

Change-Id: Ibbb48876fc72faa23d76f32166f31f0257a7a3a0
Reviewed-on: http://gerrit.ent.cloudera.com:8080/2386
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Reviewed-by: Casey Ching <casey@cloudera.com>
Tested-by: jenkins
Reviewed-on: http://gerrit.ent.cloudera.com:8080/2387
2014-04-28 23:42:48 -07:00
ishaan
405a6fbba3 [CDH5] Change the hdfs-site template to work for CDH5
The hdfs-site template in CDH5 is different from the one we fine in CDH5. Specifically:
  - It has entries that enable hdfs caching.
  - It uses the correct parameter name for hdfs block locations timeout.

Change-Id: I0ca6bd84b074ccbb8f42243d37c5082b305f9bcf
Reviewed-on: http://gerrit.ent.cloudera.com:8080/2338
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: jenkins
2014-04-24 11:36:56 -07:00
casey
2351266d0e Replace single process mini-dfs with multiple processes
This should allow individual service components, such as a single nodemanager,
to be shutdown for failure testing. The mini-cluster bundled with hadoop is a
single process that does not expose the ability to control individual roles.
Now each role can be controlled and configured independently of the others.

Change-Id: Ic1d42e024226c6867e79916464d184fce886d783
Reviewed-on: http://gerrit.ent.cloudera.com:8080/1432
Tested-by: Casey Ching <casey@cloudera.com>
Reviewed-by: Casey Ching <casey@cloudera.com>
Reviewed-on: http://gerrit.ent.cloudera.com:8080/2297
Reviewed-by: Ishaan Joshi <ishaan@cloudera.com>
Tested-by: Ishaan Joshi <ishaan@cloudera.com>
2014-04-23 18:24:05 -07:00