#Resource Specification Resource specification is an input to Slider to specify the Yarn resource needs for each component type that belong to the application.

Some parameters that can be specified for a component instance include:

  • yarn.memory: amount of memory requried for the component instance
  • env.MALLOC_ARENA_MAX: maximum number of memory pools used, arbitrary environment settings can be provided through format env.NAME_OF_THE_VARIABLE
  • component.instances: number of instances requested
  • component.name: name of the component
  • yarn.vcores: number of vcores requested

An example resource requirement for an application that has two components “master” and “worker” is as follows. Slider will automatically add the requirements for the AppMaster for the application. This compoent is named “slider”.

"components" : {
  "worker" : {
    "yarn.memory" : "768",
    "yarn.component.instances" : "1",
    "yarn.component.name" : "worker",
    "yarn.vcores" : "1"
  },
  "slider" : {
    "yarn.memory" : "256",
    "yarn.component.instances" : "1",
    "yarn.component.name" : "slider",
    "yarn.vcores" : "1"
  },
  "master" : {
    "yarn.memory" : "1024",
    "yarn.component.instances" : "1",
    "yarn.component.name" : "master",
    "yarn.vcores" : "1"
  }
}