
Release Notes - Apache Eagle 0.4.0 (incubating)

** Highlights **
    * JBDC Metadata Storage Extension
    * Topology management in remote mode including start/stop/status operations
    * Auditlogparser for MapR's audit log
    * Oozie auditlog integration for Oozie security monitoring
    * Add applicaiton "maprFSAuditLog"
    * Refactor bin/eagle-sandbox-starter.sh to make it easier to use

** New Feature
    * [EAGLE-169] - Dynamic security event correlation in Eagle
    * [EAGLE-203] - Metrics feature support merge chart
    * [EAGLE-225] - Create eagle bootstrap scripts for examples 
    * [EAGLE-226] - Refactor Eagle scripts to avoid heavily depending on Hortonworks Sandbox
    * [EAGLE-232] - Create local Kafka/Zookeeper/Storm runner tools for quickstart examples and add related scripts to start/top zk/kafka
    * [EAGLE-238] - Support scheduling topology in local mode including start/stop/status operations
    * [EAGLE-266] - Integrate MkDocs for eagle-docs: http://www.mkdocs.org/
    * [EAGLE-271] - Topology management in remote mode including start/stop/status operations
    * [EAGLE-272] - Support topology management in UI including creating topology and monitoring status
    * [EAGLE-282] - Auditlogparser for MapR's audit log 
    * [EAGLE-284] - Connect to MapR's CLDB service
    * [EAGLE-298] - Oozie auditlog integration for Oozie security monitoring
    * [EAGLE-307] - Add applicaiton "maprFSAuditLog" 

** Improvement
    * [EAGLE-103] - add comments to readme to tell users: currently, eagle is tested under jdk1.7.x, may have compile error with jdk1.8.x
    * [EAGLE-182] - Replace Legacy "dataSource" field with "application" in UI request
    * [EAGLE-185] - UI create cache after building
    * [EAGLE-190] - JBDC Metadata Storage Extension
    * [EAGLE-193] - UI metric dashboard support sortable
    * [EAGLE-194] - UI show exception alert if service error
    * [EAGLE-195] - policy metric display with interval of 5 min or customized interval
    * [EAGLE-196] - eagle-topology.sh should have jar file path as parameter
    * [EAGLE-201] - Change maven group name to org.apache.eagle instead of eagle
    * [EAGLE-205] - Metric dashboard support multi metrics
    * [EAGLE-207] - Management page add tips
    * [EAGLE-208] - UI metric dashboard should support order & rename
    * [EAGLE-216] - Added RM Policy and GC Policies in Resource
    * [EAGLE-223] - Notification plugin to enable multiple instance of given alert plugin 
    * [EAGLE-237] - Add development tools for quickly starting zookeeper, kafka and webservice without depending on sandbox
    * [EAGLE-248] - Rename directories according industrial common sense
    * [EAGLE-287] - Make EagleStore as the default notification method
    * [EAGLE-288] - Need to add "Alert De-Dup Interval" setting in "PolicyObjectBase" 
    * [EAGLE-295] - Add configuration value to enable application Manager
    * [EAGLE-303] - Refactor message format in the email template.
    * [EAGLE-305] - Add a config tip to the document for "Application Manager Tutorial" - setting "appCommandLoaderEnabled=true"
    * [EAGLE-306] - add metadata for showing "Topology" tab in left-nav by default
    * [EAGLE-315] - Add tutorial for mapr audit log monitoring
    * [EAGLE-316] - Feature topology should not be added into an application
    * [EAGLE-339] - Create HBase tables if not exists 
    * [EAGLE-340] - refactor bin/eagle-sandbox-starter.sh to make it easier to use 

** Bug
    * [EAGLE-8] - In eagle-check-env.sh shell , Itbad way to check kafka installation
    * [EAGLE-18] - Follow up with infra about website creation
    * [EAGLE-157] - policy metric should be refreshed every minute
    * [EAGLE-171] - Policy listing table is messed up by too long policy name.
    * [EAGLE-172] - Scripting string is allowed to create policy rules.
    * [EAGLE-173] - Mark/Un-mark a sensitivity type does not sync status mark in the table list.
    * [EAGLE-176] - Metric dashboard UI keep api refresh after page switch
    * [EAGLE-192] - Uncaught ReferenceError: damControllers is not defined (doc.js:7628)
    * [EAGLE-200] - GC Log Monitoring  Not Working
    * [EAGLE-210] - UI application group not display correctly
    * [EAGLE-211] - Fix sometime unit test failing at TestSiddhiStateSnapshotAndRestore
    * [EAGLE-212] - Fix AlertDataSourceEntity Bug in Hive web
    * [EAGLE-213] - Updates fail for MySql  
    * [EAGLE-214] - Policy edit page need auto switch application
    * [EAGLE-217] - Fix unstable unit tests about state snapshot management
    * [EAGLE-224] - Column not found to EAGLE_METRIC when using JDBC
    * [EAGLE-227] - java.lang.NoClassDefFoundError: org/apache/commons/pool/impl/CursorableLinkedList$ListIter
    * [EAGLE-228] - org.apache.eagle.notification.plugin.NotificationPluginManagerImpl - fail invoking plugin's onAlert, continue  java.lang.NullPointerException: null
    * [EAGLE-229] - java.lang.IncompatibleClassChangeError: class net.sf.extcos.internal.JavaResourceAccessor$AnnotatedClassVisitor has interface org.objectweb.asm.ClassVisitor as super class
    * [EAGLE-230] - Exception in persisting entitiesService side exception: org.codehaus.jackson.map.JsonMappingException: Conflicting setter definitions for property "alertContext"
    * [EAGLE-235] - org.codehaus.jackson.map.JsonMappingException: Conflicting setter definitions for property "alertContext"
    * [EAGLE-239] - Alert list and details are not correctly displayed
    * [EAGLE-240] - java.lang.ArrayIndexOutOfBoundsException thrown by MetricKeyCodeDecoder
    * [EAGLE-242] -  Import the notification plugin metadata when initializing
    * [EAGLE-254] - HdfsAuditLog topology keeps alerting for one piece of log
    * [EAGLE-258] - Automatically add apache-github and apache-git in pr tools
    * [EAGLE-269] - Comparisons between 'LONG VARCHAR (UCS_BASIC)' and 'LONG VARCHAR (UCS_BASIC)' are not supported
    * [EAGLE-270] - JDBC: Create table fail for some of the tables
    * [EAGLE-273] -  Issue with creating MySql tables , only 14 were created out of 24, reason being varchar(30000) for multiple columns lead to exceeding the maximum row size of 65,535 bytes.
    * [EAGLE-274] - 2016-04-15 15:50:20 b.s.d.worker [ERROR] Error on initialization of server mk-worker java.lang.RuntimeException: java.lang.ClassNotFoundException: org.slf4j.impl.Log4jLoggerAdapter
    * [EAGLE-275] - Eagle email alert bug: $elem["dataSource"] Alert Detected
    * [EAGLE-291] - JDBC: Update transactions fail in PostgreSQL
    * [EAGLE-292] - Updated hbase policy failed: Data too long for column 'policyDef' when using mysql storage
    * [EAGLE-294] - If a policy metadata field is not set, null attributes can not be able to add into input stream for SiddhiCEP 
    * [EAGLE-297] - Email with authentication can not be validated and sent out.
    * [EAGLE-300] - Disable spring debug log by default in webservice
    * [EAGLE-301] - Tables omitted for using mysql
    * [EAGLE-304] - Enable Advanced dedup configuration in policy definition 
    * [EAGLE-308] - Consistency issue: deleting a topology doesn't delete existing topology-execution bound to it.
    * [EAGLE-310] - already existing active topology status not displayed when a deleted topology+execution re-created with same name
    * [EAGLE-311] - operations of items listed on topology-management monitoring page require buffering loading approaches
    * [EAGLE-313] - normally stopped topology-execution shows error message in the description column
    * [EAGLE-319] - java.sql.SQLSyntaxErrorException caught when querying from table topologyExecutionEntity
    * [EAGLE-321] - java.lang.NoSuchMethodError: com.google.protobuf.LazyStringList.getUnmodifiableView
    * [EAGLE-326] - typo found in eagle documentation
    * [EAGLE-327] - java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Integer
    * [EAGLE-330] - Hive ql.Parser can't parser a hive query sql with keywords
    * [EAGLE-338] - fix topology-assembly build issue because of module name change
    * [EAGLE-346] - ClassNotFoundException thrown out when topology is executing
    * [EAGLE-355] - UI advanced policy expression can't parse
    * [EAGLE-356] - Fix Authentication problem to query resource manager web service

** Task
    * [EAGLE-73] - Put docker steps to site tutorial
    * [EAGLE-221] - Support cusomized notification type in policy editor
    * [EAGLE-222] - Documentation for eagle alert plugin mechnism
    * [EAGLE-280] - Update logstash-kafka-conf.md
    * [EAGLE-309] - Add code formatter template

** Sub-task
    * [EAGLE-219] - Use PUT method for updating request when possible in front-end.


Release Notes - Apache Eagle 0.3.1 (incubating)

** Highlights **
    * Hadoop JMX metric monitoring.
    * NameNode log monitoring for GC alerts.
    * Eagle UI Modularization (With new customizable UI options).
    * Generic Notification Plugin Framework for integrating alerts with various third parties.
    * Docker Image for Eagle.
    * Provide analytic DSL support.

** New Feature
    * [EAGLE-15] - HBase auditlog integration for HBase security monitoring
    * [EAGLE-17] - HDFS security log integration for HDFS security monitoring
    * [EAGLE-46] - track the work before moving code to apache site
    * [EAGLE-47] - Ability to audit who made changes to Eagle policies
    * [EAGLE-53] - Docker Image for Eagle
    * [EAGLE-79] - Provide analytic DSL support
    * [EAGLE-81] - Notification Plugin Framework
    * [EAGLE-100] - provide tools to collect hadoop jmx metrics
    * [EAGLE-122] - Create a generic notification plugin for integrating alerts

** Bug
    * [EAGLE-4] - configure parallelism with bolt/spout friendly name
    * [EAGLE-6] - group-by user between bolts and spouts for hdfs/hive audit log monitoring
    * [EAGLE-10] - Bad way to check kafka installation in eagle-check-env.sh
    * [EAGLE-28] - Znode root should be configurable.
    * [EAGLE-30] - Topology run in storm local mode should not terminate after Integer.MAX_VALUE milliseconds
    * [EAGLE-41] - Eagle policy engine supports customizable ExceptionHandler instead of using FetalExceptionHandler
    * [EAGLE-48] - Alert message time is wrong in some cases
    * [EAGLE-56] - Building failed for artifact jdk.tools:jdk.tools:jar:1.7 not found
    * [EAGLE-69] - http 404 bug in accessing http://localhost:9099/eagle-service
    * [EAGLE-70] - Fix Goovy into Groovy in pom
    * [EAGLE-74] - in sandbox setup, change package name from eagle. to org.apache.eagle
    * [EAGLE-76] - Disable creating newStream for common user role
    * [EAGLE-85] - Fix unit test failure.
    * [EAGLE-94] - fix the bug of eagle docker in Mac
    * [EAGLE-95] - DAM HDFS topology fails to start, if there is invalid policy.
    * [EAGLE-104] - Fix the unit test TestHDFSSecuritylogParser
    * [EAGLE-118] - Siddhi contains is neither a function extension nor an aggregated attribute extension
    * [EAGLE-119] - fix unit testing bugs
    * [EAGLE-125] - Add LICENSE in eagle external
    * [EAGLE-128] - Fix unit test failure
    * [EAGLE-141] - fix some unit testing exception which is thrown within annoymous class
    * [EAGLE-142] - Replace AlertDefinitionDAOImpl with PolicyDefinitionDAOImpl
    * [EAGLE-148] - Master build failure due to siddhi ql test
    * [EAGLE-163] - HDFS topology not working.

** Improvement
    * [EAGLE-7] - expose storm config as individual eagle topology config
    * [EAGLE-13] - Eagle machine learning no longer needs hourly aggregation
    * [EAGLE-14] - Re-assemble high level hdfs commands for better policy
    * [EAGLE-24] - Load skew issue when partition by user
    * [EAGLE-29] - Update Alert page for display more infomation
    * [EAGLE-38] - reminder for Alerts in the UI
    * [EAGLE-40] - Policy detail page support alert list display
    * [EAGLE-42] - Customized partition support for Kafka spout
    * [EAGLE-44] - previous page should be reloaded after login session is timed out and re-login
    * [EAGLE-50] - Eagle internal metric framework
    * [EAGLE-52] - Eagle framework should support custom group by function in addition to group by fields
    * [EAGLE-55] - JobCompletedConfigServiceURLBuilderImpl in hive running spout miss anonymous paramter
    * [EAGLE-58] - Enhance Hive query parse model
    * [EAGLE-62] - Add jshint for front end UI building
    * [EAGLE-66] - Eagle TypeSafe Stream Processing DSL
    * [EAGLE-80] - remove httpd directory
    * [EAGLE-86] - Rewrite HDFSAuditLogParser to a non-regular expression version
    * [EAGLE-88] - Eagle web-service should have status url
    * [EAGLE-99] - policy distribution statistics to be printed in log
    * [EAGLE-106] - UI use same chart component
    * [EAGLE-107] - Build Status Icon has been enabled for our github repo, please apply it to readme.md
    * [EAGLE-108] - a tool tests performace between mongodb3.0 and couchDB1.6.1
    * [EAGLE-109] - add hdfs related ports mapping from docker container to host
    * [EAGLE-112] - Should support sum aggregation in front end for slide window function
    * [EAGLE-114] - Enable RAT check and fix missing license headers
    * [EAGLE-138] - Extend JMX Collector to support "hadoop.namenode.JournalTransaction"
    * [EAGLE-143] - Create Eagle release 0.3.1
    * [EAGLE-149] - Enable hadoop jmx metric cases
    * [EAGLE-152] - hadoop-metric monitoring automation script
    * [EAGLE-158] - Disable org.apache.eagle.datastream.EagleTuple
    * [EAGLE-166] - Enhance metric collector script to extract hadoop ha status as metric

** Task
    * [EAGLE-83] - Integrate Jenkins with GitHub for checking pull requests
    * [EAGLE-84] - Create scripts for merging PRs automatically
    * [EAGLE-102] - ask jenkins-admin's help to setup "Embeddable Build Status Plugin" and make the status visible in Readme.md of incubator-eagle.git
    * [EAGLE-117] - update Build Status Link and make it point to CI job building upon master
    * [EAGLE-131] - make eagle main CI build pass
    * [EAGLE-136] - Setup hadoop metric application
    * [EAGLE-154] - hadoop-metric monitoring sandbox starter script
    * [EAGLE-164] - Tutorial for setting up the development environment on mac
    * [EAGLE-165] - Add more jmx metric cases

** Sub-task
    * [EAGLE-51] - Clean and manage external licensed static resource dependencies in eagle web with npm and grunt
    * [EAGLE-60] - HBase sensitivity UI
    * [EAGLE-63] - Improve docker image for quick preview
    * [EAGLE-64] - Push eagle docker image to docker hub
    * [EAGLE-65] - Eagle docker consistent port mapping
    * [EAGLE-71] - Fix eagle docker run command
    * [EAGLE-75] - Leverage dropwizard metrics for generating Eagle Topology and DataSource Metrics
    * [EAGLE-78] - eagle-lib.sh script not work for mac osx and windows
    * [EAGLE-130] - Eagle Pipeline DSL: Parser, Compiler, Runner
    * [EAGLE-140] - Eagle Pipeline Package and Script


Release Notes - Apache Eagle 0.3.0 (incubating)

** Highlights **
    * Hadoop JMX metric monitoring.
    * NameNode log monitoring for GC alerts.
    * Eagle UI Modularization (With new customizable UI options).
    * Generic Notification Plugin Framework for integrating alerts with various third parties.
    * Docker Image for Eagle.
    * Provide analytic DSL support.

** New Feature
    * [EAGLE-15] - HBase auditlog integration for HBase security monitoring
    * [EAGLE-17] - HDFS security log integration for HDFS security monitoring
    * [EAGLE-46] - track the work before moving code to apache site
    * [EAGLE-47] - Ability to audit who made changes to Eagle policies
    * [EAGLE-53] - Docker Image for Eagle
    * [EAGLE-79] - Provide analytic DSL support
    * [EAGLE-81] - Notification Plugin Framework
    * [EAGLE-100] - provide tools to collect hadoop jmx metrics
    * [EAGLE-122] - Create a generic notification plugin for integrating alerts

** Bug
    * [EAGLE-4] - configure parallelism with bolt/spout friendly name
    * [EAGLE-6] - group-by user between bolts and spouts for hdfs/hive audit log monitoring
    * [EAGLE-10] - Bad way to check kafka installation in eagle-check-env.sh
    * [EAGLE-28] - Znode root should be configurable.
    * [EAGLE-30] - Topology run in storm local mode should not terminate after Integer.MAX_VALUE milliseconds
    * [EAGLE-41] - Eagle policy engine supports customizable ExceptionHandler instead of using FetalExceptionHandler
    * [EAGLE-48] - Alert message time is wrong in some cases
    * [EAGLE-56] - Building failed for artifact jdk.tools:jdk.tools:jar:1.7 not found
    * [EAGLE-69] - http 404 bug in accessing http://localhost:9099/eagle-service
    * [EAGLE-70] - Fix Goovy into Groovy in pom
    * [EAGLE-74] - in sandbox setup, change package name from eagle. to org.apache.eagle
    * [EAGLE-76] - Disable creating newStream for common user role
    * [EAGLE-85] - Fix unit test failure.
    * [EAGLE-94] - fix the bug of eagle docker in Mac
    * [EAGLE-95] - DAM HDFS topology fails to start, if there is invalid policy.
    * [EAGLE-104] - Fix the unit test TestHDFSSecuritylogParser
    * [EAGLE-118] - Siddhi contains is neither a function extension nor an aggregated attribute extension
    * [EAGLE-119] - fix unit testing bugs
    * [EAGLE-125] - Add LICENSE in eagle external
    * [EAGLE-128] - Fix unit test failure
    * [EAGLE-141] - fix some unit testing exception which is thrown within annoymous class
    * [EAGLE-142] - Replace AlertDefinitionDAOImpl with PolicyDefinitionDAOImpl
    * [EAGLE-148] - Master build failure due to siddhi ql test
    * [EAGLE-163] - HDFS topology not working.

** Improvement
    * [EAGLE-7] - expose storm config as individual eagle topology config
    * [EAGLE-13] - Eagle machine learning no longer needs hourly aggregation
    * [EAGLE-14] - Re-assemble high level hdfs commands for better policy
    * [EAGLE-24] - Load skew issue when partition by user
    * [EAGLE-29] - Update Alert page for display more infomation
    * [EAGLE-38] - reminder for Alerts in the UI
    * [EAGLE-40] - Policy detail page support alert list display
    * [EAGLE-42] - Customized partition support for Kafka spout
    * [EAGLE-44] - previous page should be reloaded after login session is timed out and re-login
    * [EAGLE-50] - Eagle internal metric framework
    * [EAGLE-52] - Eagle framework should support custom group by function in addition to group by fields
    * [EAGLE-55] - JobCompletedConfigServiceURLBuilderImpl in hive running spout miss anonymous paramter
    * [EAGLE-58] - Enhance Hive query parse model
    * [EAGLE-62] - Add jshint for front end UI building
    * [EAGLE-66] - Eagle TypeSafe Stream Processing DSL
    * [EAGLE-80] - remove httpd directory
    * [EAGLE-86] - Rewrite HDFSAuditLogParser to a non-regular expression version
    * [EAGLE-88] - Eagle web-service should have status url
    * [EAGLE-99] - policy distribution statistics to be printed in log
    * [EAGLE-106] - UI use same chart component
    * [EAGLE-107] - Build Status Icon has been enabled for our github repo, please apply it to readme.md
    * [EAGLE-108] - a tool tests performace between mongodb3.0 and couchDB1.6.1
    * [EAGLE-109] - add hdfs related ports mapping from docker container to host
    * [EAGLE-112] - Should support sum aggregation in front end for slide window function
    * [EAGLE-114] - Enable RAT check and fix missing license headers
    * [EAGLE-138] - Extend JMX Collector to support "hadoop.namenode.JournalTransaction"
    * [EAGLE-143] - Create Eagle release 0.3.0
    * [EAGLE-149] - Enable hadoop jmx metric cases
    * [EAGLE-152] - hadoop-metric monitoring automation script
    * [EAGLE-158] - Disable org.apache.eagle.datastream.EagleTuple
    * [EAGLE-166] - Enhance metric collector script to extract hadoop ha status as metric

** Task
    * [EAGLE-83] - Integrate Jenkins with GitHub for checking pull requests
    * [EAGLE-84] - Create scripts for merging PRs automatically
    * [EAGLE-102] - ask jenkins-admin's help to setup "Embeddable Build Status Plugin" and make the status visible in Readme.md of incubator-eagle.git
    * [EAGLE-117] - update Build Status Link and make it point to CI job building upon master
    * [EAGLE-131] - make eagle main CI build pass
    * [EAGLE-136] - Setup hadoop metric application
    * [EAGLE-154] - hadoop-metric monitoring sandbox starter script
    * [EAGLE-164] - Tutorial for setting up the development environment on mac
    * [EAGLE-165] - Add more jmx metric cases

** Sub-task
    * [EAGLE-51] - Clean and manage external licensed static resource dependencies in eagle web with npm and grunt
    * [EAGLE-60] - HBase sensitivity UI
    * [EAGLE-63] - Improve docker image for quick preview
    * [EAGLE-64] - Push eagle docker image to docker hub
    * [EAGLE-65] - Eagle docker consistent port mapping
    * [EAGLE-71] - Fix eagle docker run command
    * [EAGLE-75] - Leverage dropwizard metrics for generating Eagle Topology and DataSource Metrics
    * [EAGLE-78] - eagle-lib.sh script not work for mac osx and windows
    * [EAGLE-130] - Eagle Pipeline DSL: Parser, Compiler, Runner
    * [EAGLE-140] - Eagle Pipeline Package and Script