0

We have an Hadoop cluster, clients are installed on Linux Red Hat machines and central management via Apache Ambari.

yum list | grep ambari-server
ambari-server.x86_64                  2.5.0.3-7               @ambari-2.5.0.3 

We found a nice way to set an update of a value's via Ambari as the following:

/var/lib/ambari-server/resources/scripts/configs.sh set localhost c1 mapred-site "mapreduce.map.memory.mb" "512"

Whereby in the example:

CONFIG_TYPE = mapred-site
CONFIG_KEY = mapreduce.map.memory.mb

But we have a little problem here. In my example, mapred-site is a CONFIG-TYPE. According to the script configs.sh –help:

<CONFIG_TYPE>: One of the various configuration types in Ambari. Ex:global, core-site, hdfs-site, mapred-queue-acls, etc.

For more info about the script see documentation paragraph “Edit configuration using configs.sh”.

In order to see all CONFIG-TYPE values and CONFIG_KEY values I've generated the following blueprint.json file:

 curl  -u admin:admin -H "X-Requested-By: ambari" -X GET http://<ip>:8080/api/v1/clusters/HDP01?format=blueprint -o /tmp/blueprint.json
 grep "\-site" /tmp/blueprint.json

  "tez-interactive-site" : {
  "hdfs-site" : {
  "yarn-site" : {
  "hiveserver2-site" : {
  "ams-hbase-security-site" : {
  "ams-site" : {
  "mapred-site" : {
  "hive-site" : {
  "tez-site" : {
  "webhcat-site" : {

So how to know the right CONFIG_TYPE value for the CONFIG_KEY value?

0

As far as I understand from your description and question you seems to be interested in a complete list of properties which are used in the Hadoop framework. For the meaning of each property, possible, recommended or good values, I like to recommend to follow up with the official framework documentation.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.