Configuration

System Level Configuration

Eagle system level configuration is typically configured in conf/eagle.conf.

# ---------------------------------------------
# Eagle REST Web Service Configuration
# ---------------------------------------------
service {
  env = "testing"
  host = "localhost"
  port = 9090
  username = "admin"
  password = "secret"
  readTimeOutSeconds = 60
  context = "/rest"
  timezone = "UTC"
}

zookeeper {
  zkQuorum = "localhost:2181"
  zkSessionTimeoutMs : 15000
  zkRetryTimes : 3
  zkRetryInterval : 20000
}

# ---------------------------------------------
# Eagle Deep Storage Configuration
# ---------------------------------------------

storage {
  # storage type: ["hbase","jdbc"]
  # default is "hbase"
  type = "hbase"

  hbase {
    # hbase configuration: hbase.zookeeper.quorum
    # default is "localhost"
    zookeeperQuorum = "localhost"

    # hbase configuration: hbase.zookeeper.property.clientPort
    # default is 2181
    zookeeperPropertyClientPort = 2181

    # hbase configuration: zookeeper.znode.parent
    # default is "/hbase"
    zookeeperZnodeParent = "/hbase-unsecure"

    # eagle web login profile: [sandbox, default]
    # default is sandbox
    tableNamePrefixedWithEnvironment = false

    # eagle coprocessor enabled or not: [true, false]
    # default is false
    coprocessorEnabled = false
  }
}

# ---------------------------------------------
# Eagle Metadata Store Configuration
# ---------------------------------------------
metadata {
  store = org.apache.eagle.metadata.service.memory.MemoryMetadataStore
  jdbc {
    username = "root"
    password = ""
    driverClassName = com.mysql.jdbc.Driver
    url = "jdbc:mysql://server.eagle.apache.org:3306/eagle"
  }
}

# ---------------------------------------------
# Eagle Application Configuration
# ---------------------------------------------
application {
  sink {
    type = org.apache.eagle.app.sink.KafkaStreamSink
  }
  storm {
    nimbusHost = "server.eagle.apache.org"
    nimbusThriftPort = 6627
  }
  updateStatus: {
    initialDelay: 10
    period: 10
  }
}

# ---------------------------------------------
# Eagle Alert Engine Configuration
# ---------------------------------------------

# Coordinator Configuration
coordinator {
  policiesPerBolt = 5
  boltParallelism = 5
  policyDefaultParallelism = 5
  boltLoadUpbound = 0.8
  topologyLoadUpbound = 0.8
  numOfAlertBoltsPerTopology = 5
  zkConfig {
    zkQuorum = "server.eagle.apache.org:2181"
    zkRoot = "/alert"
    zkSessionTimeoutMs = 10000
    connectionTimeoutMs = 10000
    zkRetryTimes = 3
    zkRetryInterval = 3000
  }
  metadataService {
    host = "localhost",
    port = 9090,
    context = "/rest"
  }
  metadataDynamicCheck {
    initDelayMillis = 1000
    delayMillis = 30000
  }
}

Web Server Level Configuration

Web Server Level Configuration is typically configured in conf/server.yaml:

server:
  applicationConnectors:
    - type: http
      port: 9090
  adminConnectors:
    - type: http
      port: 9091


# ---------------------------------------------
# Eagle Authentication Configuration
# ---------------------------------------------
auth:
  # indicating if authentication is enabled, true for enabled, false for disabled
  enabled: false

  # indicating authentication mode, "simple" or "ldap"
  mode: simple

  # indicating whether to use cache: cache is usually used for authentications that may
  # not handle high throughput (an RDBMS or LDAP server, for example)
  caching: false

  # indicating the cache policy, containing maximumSize and expireAfterWrite, e.g. maximumSize=10000, expireAfterWrite=10m
  cachePolicy: maximumSize=10000, expireAfterWrite=1m

  # indicating whether authorization is needed
  authorization: false

  # indicating whether @Auth annotation on parameters is needed
  annotated: true

  # for basic authentication, effective only when auth.mode=simple
  simple:
    # username for basic authentication, effective only when auth.mode=simple
    username: admin
    # password for basic authentication, effective only when auth.mode=simple
    password: secret

  # for ldap authentication, effective only when auth.mode=ldap
  ldap:
    uri: ldaps://ldap.server.address:636
    userFilter: ou=x,dc=y,dc=z
    groupFilter: ou=x,dc=y,dc=z
    userNameAttribute: cn
    groupNameAttribute: cn
    groupMembershipAttribute: memberUid
    groupClassName: posixGroup
    restrictToGroups:
      - user
      - admin
    connectTimeout: 500ms
    readTimeout: 500ms

As eagle server by default is based on DropWizard, so for more confgiruation details, please refer to Dropwizard Configuration Reference

Application Level Configuration

Application level configurations could be set with Settings form during installation or modification. For more details of each application level configuration, please refer to “Application” guide pages.


REST APIs

MethodPathResource
DELETE/rest/metadata/clustersorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/clusters/{clusterId}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/datasourcesorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/datasources/{datasourceId}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/policiesorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/policies/{policyId}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/publishmentTypesorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/publishmentTypes/{pubType}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/publishmentsorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/publishments/{name}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/streamsorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/streams/{streamId}org.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/topologiesorg.apache.eagle.service.metadata.resource.MetadataResource
DELETE/rest/metadata/topologies/{topologyName}org.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/alertsorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/alerts/{alertId}org.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/assignmentsorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/clustersorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/datasourcesorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/policiesorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/policies/{policyId}org.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/policies/{policyId}/publishmentsorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/publishmentTypesorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/publishmentsorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/schedulestatesorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/schedulestates/{versionId}org.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/streamsorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/metadata/topologiesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/alertsorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/alerts/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/assignmentsorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/clearorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/clustersorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/clusters/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/datasourcesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/datasources/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/exportorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/importorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policiesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policies/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policies/parseorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policies/validateorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policies/{policyId}/publishmentsorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/policies/{policyId}/status/{status}org.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/publishmentTypesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/publishmentTypes/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/publishmentsorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/publishments/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/schedulestatesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/streamsorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/streams/batchorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/topologiesorg.apache.eagle.service.metadata.resource.MetadataResource
POST/rest/metadata/topologies/batchorg.apache.eagle.service.metadata.resource.MetadataResource
GET/rest/alert/topologiesorg.apache.eagle.service.topology.resource.TopologyMgmtResource
POST/rest/alert/topologies/{topologyName}/startorg.apache.eagle.service.topology.resource.TopologyMgmtResource
POST/rest/alert/topologies/{topologyName}/stoporg.apache.eagle.service.topology.resource.TopologyMgmtResource
GET/rest/coordinator/assignmentsorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
GET/rest/coordinator/periodicForceBuildStateorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
POST/rest/coordinator/buildorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
POST/rest/coordinator/disablePeriodicForceBuildorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
POST/rest/coordinator/enablePeriodicForceBuildorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
POST/rest/coordinator/refreshUsagesorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
POST/rest/coordinator/validateorg.apache.eagle.alert.coordinator.resource.CoordinatorResource
DELETE/rest/sitesorg.apache.eagle.metadata.resource.SiteResource
DELETE/rest/sites/{siteId}org.apache.eagle.metadata.resource.SiteResource
GET/rest/sitesorg.apache.eagle.metadata.resource.SiteResource
GET/rest/sites/{siteId}org.apache.eagle.metadata.resource.SiteResource
POST/rest/sitesorg.apache.eagle.metadata.resource.SiteResource
PUT/rest/sitesorg.apache.eagle.metadata.resource.SiteResource
PUT/rest/sites/{siteId}org.apache.eagle.metadata.resource.SiteResource
DELETE/rest/apps/uninstallorg.apache.eagle.app.resource.ApplicationResource
GET/rest/appsorg.apache.eagle.app.resource.ApplicationResource
GET/rest/apps/providersorg.apache.eagle.app.resource.ApplicationResource
GET/rest/apps/providers/{type}org.apache.eagle.app.resource.ApplicationResource
GET/rest/apps/{appUuid}org.apache.eagle.app.resource.ApplicationResource
POST/rest/apps/installorg.apache.eagle.app.resource.ApplicationResource
POST/rest/apps/startorg.apache.eagle.app.resource.ApplicationResource
POST/rest/apps/statusorg.apache.eagle.app.resource.ApplicationResource
POST/rest/apps/stoporg.apache.eagle.app.resource.ApplicationResource
POST/rest/apps/{appUuid}org.apache.eagle.app.resource.ApplicationResource
PUT/rest/apps/providers/reloadorg.apache.eagle.app.resource.ApplicationResource
GET/rest/exampleorg.apache.eagle.app.example.extensions.ExampleResource
GET/rest/example/commonorg.apache.eagle.app.example.extensions.ExampleResource
GET/rest/example/configorg.apache.eagle.app.example.extensions.ExampleResource
GET/rest/metadata/security/hbaseSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
GET/rest/metadata/security/hdfsSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
GET/rest/metadata/security/hiveSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
GET/rest/metadata/security/ipzoneorg.apache.eagle.security.service.SecurityExternalMetadataResource
GET/rest/metadata/security/oozieSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
POST/rest/metadata/security/hbaseSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
POST/rest/metadata/security/hdfsSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
POST/rest/metadata/security/hiveSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
POST/rest/metadata/security/ipzoneorg.apache.eagle.security.service.SecurityExternalMetadataResource
POST/rest/metadata/security/oozieSensitivityorg.apache.eagle.security.service.SecurityExternalMetadataResource
GET/rest/stream/attributeresolveorg.apache.eagle.service.alert.resolver.AttributeResolveResource
POST/rest/stream/attributeresolveorg.apache.eagle.service.alert.resolver.AttributeResolveResource
GET/rest/hbaseResource/columnsorg.apache.eagle.service.security.hbase.HbaseMetadataBrowseWebResource
GET/rest/hbaseResource/namespacesorg.apache.eagle.service.security.hbase.HbaseMetadataBrowseWebResource
GET/rest/hbaseResource/tablesorg.apache.eagle.service.security.hbase.HbaseMetadataBrowseWebResource
GET/rest/oozieResource/coordinatorsorg.apache.eagle.service.security.oozie.res.OozieMetadataBrowseWebResource
DELETE/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
GET/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
GET/rest/entities/jsonporg.apache.eagle.service.generic.GenericEntityServiceResource
GET/rest/entities/rowkeyorg.apache.eagle.service.generic.GenericEntityServiceResource
POST/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
POST/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
POST/rest/entities/deleteorg.apache.eagle.service.generic.GenericEntityServiceResource
POST/rest/entities/rowkeyorg.apache.eagle.service.generic.GenericEntityServiceResource
PUT/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
PUT/rest/entitiesorg.apache.eagle.service.generic.GenericEntityServiceResource
GET/rest/listorg.apache.eagle.service.generic.ListQueryResource
GET/rest/list/jsonporg.apache.eagle.service.generic.ListQueryResource
GET/rest/list/legacyorg.apache.eagle.service.generic.ListQueryResource
GET/rest/metaorg.apache.eagle.service.generic.MetadataResource
GET/rest/meta/resourceorg.apache.eagle.service.generic.MetadataResource
GET/rest/meta/serviceorg.apache.eagle.service.generic.MetadataResource
POST/rest/metricorg.apache.eagle.service.metric.EagleMetricResource
GET/rest/rowkeyqueryorg.apache.eagle.service.rowkey.RowKeyQueryResource
DELETE/rest/rowkeyorg.apache.eagle.service.rowkey.RowkeyResource
GET/rest/rowkeyorg.apache.eagle.service.rowkey.RowkeyResource
GET/rest/ValidateInternalsorg.apache.eagle.service.selfcheck.EagleServiceSelfCheckResource
GET/rest/servicesorg.apache.eagle.service.selfcheck.ServiceResource
GET/rest/services/jsonporg.apache.eagle.service.selfcheck.ServiceResource
GET/rest/hdfsResourceorg.apache.eagle.service.security.hdfs.rest.HDFSResourceWebResource
GET/rest/mrJobsorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrJobs/jobCountsByDurationorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrJobs/jobMetrics/entitiesorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrJobs/jobMetrics/listorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrJobs/runningJobCountsorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrJobs/searchorg.apache.eagle.service.jpm.MRJobExecutionResource
GET/rest/mrTasks/historyTaskCountorg.apache.eagle.service.jpm.MRTaskExecutionResource
GET/rest/mrTasks/taskCountsByDurationorg.apache.eagle.service.jpm.MRTaskExecutionResource
GET/rest/mrTasks/taskDistribution/{counterName}org.apache.eagle.service.jpm.MRTaskExecutionResource
GET/rest/mrTasks/taskSuggestionorg.apache.eagle.service.jpm.MRTaskExecutionResource
GET/rest/swagger.{type:json or yaml}io.swagger.jaxrs.listing.ApiListingResource