Apache Ambari Log Search
Log Search is a sub-project of Apache Ambari
Introduction
Log aggregation, analysis, and visualization for Ambari managed (or any other) services.
Features
- Parse / aggregate and ship logs
- Send and index logs in Solr
- Store logs (structured or unstructured format) in Cloud Storage (S3 / GCS / ADLS / WASB)
- Full-text Search in logs (if the logs are shipped to Solr)
- JWT/SSO support
- Support testing the log parsing on the UI
Architecture
- Log Feeder: agent component on all hosts to monitor and ship logs.
- Log Search Portal: REST API + UI for rendering logs
- Solr (Optional - default): storage for logs, used by both Log Search Portal and Log Feeder
- ZooKeeper (Optional - default): configuration service for Solr, Log Search and Log Feeder
- HDFS / S3 / GCS / ADLS: storage for logs (write only), used by Log Feeder cloud mode
Contents
- 1. Installation
- 2. Collections
- 3. Adding new logs to monitor
- 4. Development guide
- 5. Using Log Feeder in Cloud mode
Contributing
https://cwiki.apache.org/confluence/display/AMBARI/How+to+Contribute
(That is the ambari contribution guide, everything is the same here except use ambari-logsearch repository instead of ambari)