Apache Falcon Changelog

Release 0.11

INCOMPATIBLE CHANGES:

None

NEW FEATURES:

JIRA	Summary	Component	Priority	Contributor	Reporter
FALCON-2235	FALCON-2182 Suspend/Resume API support for extension job (user extension)	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2195	FALCON-2182 Add API to get details of an extension job	extensions	Major	sandeep samudrala	Pallavi Rao
FALCON-1610	FALCON-1596 Add instance commands to Falcon spring-shell CLI	client	Major	Praveen Adlakha	Rajat Khandelwal
FALCON-2209	FALCON-2182 Registering user extensions in embedded/distributed mode	extensions, prism	Major	Praveen Adlakha	sandeep samudrala
FALCON-2194	FALCON-2182 Enhance validate API to support config validation for user extensions	extensions	Major	sandeep samudrala	Pallavi Rao
FALCON-2006	FALCON-1992 Update documentation on site and announce the release	ease	Major	Balu Vellanki	Balu Vellanki
FALCON-2231	FALCON-2182 Support Schedule for User Extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2226	FALCON-2182 Submit ,Schedule and submitAndSchedule API for extension in distributed mode	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2223	FALCON-2182 Distributed mode support for User Extension	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2227	FALCON-2182 Intitutive error handling in Falcon Client	extensions	Major	sandeep samudrala	Praveen Adlakha
FALCON-1611	FALCON-1596 Add admin commands to Falcon spring-shell CLI	client	Major	Praveen Adlakha	Rajat Khandelwal
FALCON-2200	FALCON-2182 Update API support for extension job (user extension)	extensions	Major	sandeep samudrala	Pallavi Rao
FALCON-2225	FALCON-2182 Falcon fails to start with ExtensionService	extensions	Major	Pracheer Agarwal	Praveen Adlakha
FALCON-2190	FALCON-2182 Add server side checks to not let any entity mutations on entities generated by extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2184	FALCON-2182 Support to delete a non trusted recipe metadata from server	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2260	FALCON-2182 Enhance extension List api to support for user extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2207	FALCON-2182 Only the owner of the extension, should be able to unregister, disable, enable.	extensions	Major	Pracheer Agarwal	Pallavi Rao
FALCON-2191	FALCON-2182 Extension Rest Api changes to support new user extensions and extension job metastore changes	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2159	FALCON-2170 Update document for adding BackLogEmitterService	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-1997	FALCON-1992 Verify source tarball and run few end to end tests	build-tools	Major	Balu Vellanki	Balu Vellanki
FALCON-2186	FALCON-2182 Rest api to get details of an extension	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2181	FALCON-2182 Support for storing metadata of non trusted recipe	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2156	FALCON-2170 Logmover listener gets stuck while listening to WorkflowJobEndNotificationService	messaging	Major	Praveen Adlakha	Pragya Mittal
FALCON-1780	FALCON-1596 Add falcon-cli executable and link that to falcon executable when no arguments are provided	client	Major	Praveen Adlakha	Rajat Khandelwal
FALCON-2258	FALCON-2182 Improve error message for definition/describe api in case extension does not exist	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2211	FALCON-2182 Falcon Fails to start in distributed mode	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2201	FALCON-2182 Falcon Unit changes to support extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2003	FALCON-1992 Check licenses and copyright information	docs	Major	Balu Vellanki	Balu Vellanki
FALCON-2210	FALCON-2182 Server side changes for submit and submitAndSchedule for user extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2233	FALCON-2182 Make changes in falcon unit to enable/disable extensions	falcon-unit	Major	Pracheer Agarwal	Pracheer Agarwal
FALCON-2187	FALCON-2182 Refactor modules to create a new module for entity xsd specifications and jaxb bindings	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2164	FALCON-2170 NPE exception in GraphiteNotification Plugin	common	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2185	FALCON-2182 Falcon Client changes for Falcon user extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2157	FALCON-2170 Pending instances are not getting deleted from database even though the instance finishes	prism	Major	sandeep samudrala	Pragya Mittal
FALCON-1612	FALCON-1596 Add Metadata commands to Falcon spring-shell CLI	client	Major	Praveen Adlakha	Rajat Khandelwal
FALCON-2205	FALCON-2182 describe for non trusted extension	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2155	FALCON-2170 LogMover service fails to move logs in distributed mode	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2193	FALCON-2182 Fix test case failure caused by FALCON-2188	extensions	Major	Pallavi Rao	Pallavi Rao
FALCON-2160	FALCON-2170 Update startup.properties to contain valid application services	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2188	FALCON-2182 Rest api to register extension	extensions	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2161	FALCON-2170 Process Sla API does not show sla for last instance	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2208	FALCON-2182 Falcon CLI(client) need hadoop in the classpath	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2199	FALCON-2182 Delete API support for extension job (user extension)	extensions	Major	sandeep samudrala	Pallavi Rao
FALCON-2183	FALCON-2182 Extension Builder changes to support new user extensions	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2149	FALCON-2170 On deleting process entries still exist in BACKLOG_METRIC	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2154	FALCON-2170 On deleting entity backlog emitter does not go back to zero	messaging	Major	Praveen Adlakha	Pragya Mittal
FALCON-2004	FALCON-1992 Update CHANGES.txt to change 0.10 branch to release	ease	Major	Balu Vellanki	Balu Vellanki
FALCON-2197	FALCON-2182 Add enable and disable option for an extension	extensions	Major	Pracheer Agarwal	Pallavi Rao
FALCON-2189	FALCON-2182 Falcon build is failing for falcon jpa service to be initialized before extension servivce	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2153	FALCON-2170 Resetting Gauge value in BacklogEmitterService	common	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2082	Add CSRF filter for REST APIs	prism	Major	Ying Zheng	Ying Zheng
FALCON-1596	Spring shell based CLI for falcon	shell	Major	Praveen Adlakha	Rajat Khandelwal

IMPROVEMENTS:

JIRA	Summary	Component	Priority	Contributor	Reporter
FALCON-1856	Fix ProcessInstanceStatusTest	regression	Major	Pragya Mittal	Pragya Mittal
FALCON-2123	Make Blocking Queue configurable in LogMoverService	general	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2246	Api to list all the jobs in the system (and what extensions do they refer to)	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2170	Umbrella jira for bugs in EntitySLAMonitoring and BacklogEmitter service	metrics	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2077	Api support for Process SLA	process	Major	Praveen Adlakha	Praveen Adlakha
FALCON-1494	Revisit of Client and Apis	client, general	Major	Narayan Periwal	sandeep samudrala
FALCON-2228	Falcon should also set the feed output names as a coord property	feed	Major	sandeep samudrala	Pallavi Rao
FALCON-2173	BacklogEmitterService should emit 0 for process which donot have backlog	metrics	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2039	Move falcon post processing to falcon server and remove post processing action from falcon workflow	general	Major	Praveen Adlakha	sandeep samudrala
FALCON-2119	Minor Licensing Issue	license	Major	Ajay Yadava	Ajay Yadava
FALCON-2204	Change mode for falcon_merge_pr.py to executable	dev-tools	Major	Ajay Yadava	Ajay Yadava
FALCON-1944	Ability to provide additional DistCP options for mirroring extensions and feed replication	replication, extensions	Major	Sowmya Ramesh	Sowmya Ramesh
FALCON-2247	Include status of the entities of the extensionJob in getDetailExtensionJobs	extensions	Minor	Pracheer Agarwal	Pracheer Agarwal
FALCON-2044	Persist Process stats in db	metrics	Major	Praveen Adlakha	Praveen Adlakha
FALCON-1776	Process instance update in titan DB based on JMS notifications on coordinator actions	process	Major	Ying Zheng	Ying Zheng
FALCON-2288	Remove job_name validations for trusted extensions	extensions	Major	Pracheer Agarwal	Pracheer Agarwal
FALCON-2289	Report final state of metrics into graphite before stopping metric notification service	common	Major	Pracheer Agarwal	Pracheer Agarwal

BUG FIXES:

JIRA	Summary	Component	Priority	Contributor	Reporter
FALCON-2303	Backloginmins is not getting updated	metrics	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2305	workflow metrics thread failures	metrics	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2221	Submitting an existing job fails with MySQLIntegrityConstraintViolationException	extensions	Minor	Pracheer Agarwal	Pragya Mittal
FALCON-2261	Job submission fails with IllegalArgumentException	extensions	Major	sandeep samudrala	Pragya Mittal
FALCON-2096	Feed instance listing doesn't give instance status of all the clusters.	common	Major	sandeep samudrala	sandeep samudrala
FALCON-2111	Build failed due to checkstyle violation	general	Major	Balu Vellanki	Balu Vellanki
FALCON-2097	Feed update with replication delay creates random number of holes/overlaps	replication	Major	sandeep samudrala	sandeep samudrala
FALCON-2272	Extension update succeeds while it is disabled	extensions	Major	sandeep samudrala	Pragya Mittal
FALCON-2270	Extension job details returns incomplete response	extensions	Major	Pallavi Rao	Pragya Mittal
FALCON-2163	Feed replication based on partition does not produce expected output	feed, prism	Major	Pallavi Rao	Pragya Mittal
FALCON-2269	Extension api fails via server in distributed mode	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2203	Minor issues in EntitySLAmonitoring	process	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2175	java.lang.IllegalArgumentException in LogMover service	general	Major	Pallavi Rao	Pallavi Rao
FALCON-2171	When feed from multiple colos are replicated, the colo folders get overwritten	replication	Major	Pallavi Rao	Pallavi Rao
FALCON-2238	Falcon extension describe feature is broken	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2125	Feed replication fails due to failed post processing action missing in workflow	feed, process	Major	Praveen Adlakha	Pragya Mittal
FALCON-2146	EntitySlaAlertService runs only once irrespective of the configured frequency	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2271	Scheduling non existing job fails with non intuitive response	extensions	Major	sandeep samudrala	Pragya Mittal
FALCON-2268	Extension list api does not follow default ASC order	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2263	Deletion of entities for an extension has to have a specific order of deleting processes first and then feeds	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2127	Fix the falcon regression compilation issue and delete the deprecated recipe test cases	merlin	Critical	Murali Ramasami	Murali Ramasami
FALCON-2120	falcon-regression build is failing because of CLI and hive changes	regression	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2118	Proposal for new UI changes for FALCON	falcon-ui	Major	Venkat Ranganathan	Venkat Ranganathan
FALCON-2267	Definition api fails if resources are empty	extensions	Major	Unassigned	Pragya Mittal
FALCON-2128	Status api shows timeout instances as failed	prism	Major	sandeep samudrala	Pragya Mittal
FALCON-2116	Queue defined in is not getting used in actual retention job	retention	Major	sandeep samudrala	sandeep samudrala
FALCON-2266	Non-intuitive response while registering/unregistering/submitting extension via server	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2108	Fix licensing issues for Falcon release	general	Blocker	Srikanth Sundarrajan	Srikanth Sundarrajan
FALCON-2080	Exceptions in the log	general	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2215	Extension job submission throws non intuitive error	common	Major	sandeep samudrala	Pragya Mittal
FALCON-2230	Extension API failure after APIResult changes	extensions	Major	Pracheer Agarwal	Pracheer Agarwal
FALCON-2047	HiveDR tests are failed due to data-mirroring does not have correct ownership/permissions	replication	Critical	Sowmya Ramesh	Murali Ramasami
FALCON-2240	Enable/disable feature is broken	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2147	Excess logging due to SlaMonitoring service and Backlog emitter service	prism	Major	Pallavi Rao	Pragya Mittal
FALCON-2229	Process Update/delete fails for issue with backlog metric service	process	Major	sandeep samudrala	sandeep samudrala
FALCON-2280	Unable to create mirror on WASB target due to “Cluster entity not found”	extensions	Major	Sowmya Ramesh	Sowmya Ramesh
FALCON-2177	Improve error message when entity suspend fails	prism	Minor	Pallavi Rao	Pallavi Rao
FALCON-2148	Entries not removed from sla list when instance succeeds	prism	Major	Praveen Adlakha	Pragya Mittal
FALCON-2028	HDFS extension: Validate and append/remove the scheme://authority for the paths	extensions	Major	Sowmya Ramesh	Sowmya Ramesh
FALCON-2133	Disable the LogMover assertions from FeedReplication on Secure Mode	merlin	Major	Murali Ramasami	Murali Ramasami
FALCON-2242	Extension validate feature is broken	extensions	Major	sandeep samudrala	Pragya Mittal
FALCON-2072	Hive2 URLs in Falcon should allow additional configuration elements in the URL	general	Major	Sowmya Ramesh	Venkat Ranganathan
FALCON-2239	Falcon extension definition feature is broken	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2224	Change return type of extension APIs to APIResult	extensions	Major	Pracheer Agarwal	Praveen Adlakha
FALCON-2121	If a feed does not exist on a cluster, process submission fails with NPE	prism	Major	Pallavi Rao	Pallavi Rao
FALCON-2115	UT test failure on FalconCSRFFilterTest	general	Major	Ying Zheng	Ying Zheng
FALCON-2259	Unregister an extension only if no extension jobs are dependant on the extension	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2219	Untracked files after falcon build	general	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2284	Error while listing extension jobs	extensions	Major	Pracheer Agarwal	Richie Varghese
FALCON-2113	Falcon retry happens in few cases inspite of a manual kill from the user	common	Major	sandeep samudrala	sandeep samudrala
FALCON-2281	HiveDRTest tests are getting permissions denied	general	Major	Sowmya Ramesh	Cheng Xu
FALCON-2214	Falcon extension registered without fully qualified hdfs path	extensions	Major	Praveen Adlakha	Pragya Mittal
FALCON-2264	Error response returns object instead of response-message	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2293	falcon extension fails for deletion if 2 extensions have same entity name	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2286	Falcon upgradation fails to create new tables	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2292	User Extension submission is failing because of the validate late inputs	extensions	Major	sandeep samudrala	sandeep samudrala
FALCON-2291	Incorrect path to the REST calls on extension (POST)	docs	Major	Pengfei Xuan	Pengfei Xuan
FALCON-2290	Change staging directory for entity creation while extension job submission	extensions	Major	Pracheer Agarwal	Pracheer Agarwal
FALCON-2287	Extension list fails with MIME type error on server	extensions	Major	Pracheer Agarwal	Pragya Mittal
extensions	Major	sandeep samudrala	Richie Varghese		FALCON-2279
FALCON-2277	Incorrect error message on registering trusted exceptions	extensions	Major	Pracheer Agarwal	Richie Varghese
FALCON-2276	FalconCLIException while submitting trusted extension job	extensions	Major	sandeep samudrala	Richie Varghese
FALCON-2274	Job list in extension is failing with IllegalArgumentException	extensions	Major	Pracheer Agarwal	Pragya Mittal
FALCON-2273	Disallow external entity injection and clean up some log messages	general	Major	Venkat Ranganathan	Venkat Ranganathan
FALCON-2275	Unable to list instances of an extension	extensions	Major	Pracheer Agarwal	Pragya Mittal

DOCUMENTATION:

JIRA	Summary	Priority	Contributor	Reporter
FALCON-2143	Documentation of BacklogEmitter Service	Major	Praveen Adlakha	Praveen Adlakha
FALCON-2078	Documentation for Process SLA	Major	Praveen Adlakha	Praveen Adlakha