Log Search - Log Feeder:

Log Feeder is a component of the Log Search service that reads logs, parses them and stores them in Apache Solr for the purpose of later analysis.

Start locally from maven / IDE

First you need to start every required service (except logfeeder), go to ambari-logsearch/docker folder and run:

docker-compose up -d zookeeper solr logsearch

Secondly, if you are planning to run Log Feeder from an IDE, for running the LogFeeder main methoud, you will need to set the working directory to ambari/ambari-logsearch/ambari-logsearch-logfeeder or set LOGFEEDER_RELATIVE_LOCATION env variable. With Maven, you won't need these steps, just run this command from the ambari-logsearch-logfeeder folder:

mvn clean package -DskipTests spring-boot:run

Input Configuration

The configuration for the log feeder contains

• description of the log files
• description of the filters that parse the data of the log entries
• description of the mappers that modify the parsed fields

The element description can be found here

All these data are stored in json files, which should be named in the directory /etc/ambari-logsearch-logfeeder/conf, and the name of the files should be input.config-<service_name>.json