Release 1.99.7

  SUB-TASK

    SQOOP-926: Sqoop2: Devguide: Connector developer guide

    SQOOP-1116: Sqoop2: Devguide: Upgrade connectors from sqoop1 to sqoop2

    SQOOP-1256: Sqoop2: Tool: Load repository dump into a different repository

    SQOOP-1758: Sqoop2: HDFS connector documentation

    SQOOP-1766: Sqoop2: Add Kite Connector Usage into User Manual

    SQOOP-1803: Sqoop2: Update and save configuration upon job success

    SQOOP-1853: Sqoop2: Kafka connector supporting FROM direction

    SQOOP-1951: Sqoop2: Load Kafka at beginning of suite

    SQOOP-1952: Sqoop2: Load miniclusters at beginning of integration tests

    SQOOP-1953: Sqoop2: Tomcat at beginning of Suite

    SQOOP-1954: Sqoop2: Load derby at beginning of integration tests

    SQOOP-2126: Sqoop2: Implement FTP TO Connector Support

    SQOOP-2217: Sqoop2: Implement SFTP To Connector Support

    SQOOP-2244: Sqoop2: Generic JDBC: Automatically escape table and column names from configuration objects

    SQOOP-2287: Sqoop2: Create TO direction documentation

    SQOOP-2306: Sqoop2: Use LinkConfiguration in Executor rather then LinkConfig

    SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests

    SQOOP-2365: Sqoop2: Create annotation and base class

    SQOOP-2366: Sqoop2: Create infrastructure providers for hadoop, tomcat, and database providers

    SQOOP-2378: Sqoop2: Revoke all privileges command

    SQOOP-2379: Sqoop2: Check whether resource exists before run privilege check

    SQOOP-2426: Sqoop2: Precommit: Provide maven profile that will run all tests for precomit hook at once

    SQOOP-2427: Sqoop2: Precommit: Use the precommit maven profile to run tests

    SQOOP-2428: Sqoop2: Precommit: Print actions in order they've been executed

    SQOOP-2429: Sqoop2: Precommit: Add parameter --run-integration-tests

    SQOOP-2430: Sqoop2: Precommit: Add test coverage reports

    SQOOP-2434: Sqoop2: Partition support for Kafka connector (FROM direction)

    SQOOP-2435: Sqoop2: Incremental/offset support for Kafka connector (FROM direction)

    SQOOP-2441: Sqoop2: Generic JDBC: Drop support for specifying custom query when exporting data

    SQOOP-2442: Sqoop2: Generic JDBC: Drop tests for specifying schema name and custom SQL at the same time

    SQOOP-2443: Sqoop2: Generic JDBC: Properly detect compound primary keys in GenericJdbcExecutor

    SQOOP-2445: Sqoop2: Generic JDBC: Prevent use of tableColumns and sql at the same time

    SQOOP-2447: Sqoop2: Precommit: Improve cobertura test coverage reporting

    SQOOP-2449: Sqoop2: Findbugs: Fix smaller-ish warnings in common module

    SQOOP-2450: Sqoop2: Precommit: Introduce findbugs checks

    SQOOP-2451: Sqoop2: Findbugs: Add explicit charset to client ResourceRequest class

    SQOOP-2452: Sqoop2: Findbugs: Convert anonymous class in ResourceRequest to static inner class

    SQOOP-2458: Sqoop2: Precommit: Stop copying test results directly inside the pre-commit hook

    SQOOP-2459: Sqoop2: Precommit: Do not wipe out working directory on finish

    SQOOP-2460: Sqoop2: Refactor repository-common to use methods

    SQOOP-2461: Sqoop2: Add MySQL support for the metadata repository

    SQOOP-2469: Sqoop2: Custom HTTP requests test base class

    SQOOP-2473: "Modify" is misspelled in pre-commit hook

    SQOOP-2479: Sqoop2: Pass configuration objects to Intermediate Data Format

    SQOOP-2483: Sqoop2: Findbugs: Fix singleton class problem in AuthenticationManager and AuthorizationManager

    SQOOP-2484: Sqoop2: Findbugs: Fix resource leak problem in SqoopConfiguration and ConnectorManagerUtils

    SQOOP-2485: Sqoop2: Findbugs: Fix smaller-ish warnings in core module

    SQOOP-2486: Sqoop2: Findbugs: bug fix for MapContext

    SQOOP-2491: Sqoop2: Common external JAR handling in configuration

    SQOOP-2499: Sqoop2: Findbugs: Fix the problem of URF_UNREAD_PUBLIC_OR_PROTECTED_FIELD for ExampleValue

    SQOOP-2500: Sqoop2: Findbugs: Fix the resource leak problem in ProviderAsserts and DatabaseProvider

    SQOOP-2501: Sqoop2: Findbugs: Fix smaller-ish warnings in common-test module

    SQOOP-2506: Sqoop2: Generic JDBC: Remove duplicate code to create schema from result set metadata

    SQOOP-2507: Sqoop2: Do not use default Tomcat handlers for unsupported HTTP methods

    SQOOP-2508: Sqoop2: Findbugs: Fix warnings in connector-sdk module

    SQOOP-2509: Sqoop2: Findbugs: Fix resource leak problem in GenericJdbcExecutor and related classes

    SQOOP-2511: Sqoop2: Findbugs: Fix warnings in connector-generic-jdbc module

    SQOOP-2512: Sqoop2: Findbugs: Fix warnings in connector-ftp, connector-sftp and connector-hdfs module

    SQOOP-2514: Sqoop2: Findbugs: Fix security problems in ConfigUtils

    SQOOP-2515: Sqoop2: Findbugs: Fix warning in common module

    SQOOP-2516: Sqoop2: Findbugs: Fix warning in execution module

    SQOOP-2517: Sqoop2: Findbugs: Fix resource leak problem in CommonRepositoryHandler

    SQOOP-2518: Sqoop2: Findbugs: Fix warning in repository-derby module

    SQOOP-2519: Sqoop2: Findbugs: Fix warning in repository-postgresql module

    SQOOP-2521: Sqoop2: Findbugs: Fix warning in repository-mysql module

    SQOOP-2522: Sqoop2: Findbugs: Fix warning in security module

    SQOOP-2523: Sqoop2: Findbugs: Fix warning in server module

    SQOOP-2526: Sqoop2: findbugs: Fix warning in shell module

    SQOOP-2527: Sqoop2: findbugs: Fix warning in submission module

    SQOOP-2528: Sqoop2: findbugs: Fix warning in test module

    SQOOP-2529: Sqoop2: findbugs: Fix warning in tools module

    SQOOP-2530: Sqoop2: Add utility methods to get object name from object id

    SQOOP-2532: Sqoop2: Findbugs: Fix SIC_INNER_SHOULD_BE_STATIC_ANON problem in ConfigValidationRunner

    SQOOP-2533: Sqoop2: Findbugs: Fix warning for ConfigurableServlet

    SQOOP-2537: Sqoop2: Use object name instead of object id for the name filed in MResource

    SQOOP-2539: Sqoop2: Enforce resource name not null when creating table

    SQOOP-2541: Sqoop2: Provide test infrastructure base class for upgrade tests

    SQOOP-2542: Sqoop2: Provide test infrastructure base class for connector tests

    SQOOP-2544: Sqoop2: Drop connectors servlet

    SQOOP-2545: Sqoop2: RESTiliency: Provide tests for non-existing end points

    SQOOP-2546: Sqoop2: RESTiliency: Unify behavior on getting details on non-existing connector

    SQOOP-2547: Sqoop2: RESTiliency: Provide REST tests for v1/connector servlet

    SQOOP-2548: Sqoop2: RESTiliency: Enforce strict connector names

    SQOOP-2550: Sqoop2: Findbugs: Add filter for the warning SQL_NONCONSTANT_STRING_PASSED_TO_EXECUTE and SQL_PREPARED_STATEMENT_GENERATED_FROM_NONCONSTANT_STRING

    SQOOP-2553: Sqoop2: Jetty: Update testcases using Jetty instead of Tomcat

    SQOOP-2555: Sqoop2: Findbugs: Add filter for the unnecessary warning

    SQOOP-2557: Sqoop2: Findbugs: move findbug dependency to the root pom.xml

    SQOOP-2558: Sqoop2: Jetty: Updaet sqoop-server, package with jar, remove war

    SQOOP-2560: Sqoop2: Jetty: Create new class for Jetty server

    SQOOP-2563: Sqoop2: Jetty: Update script for Jetty server

    SQOOP-2565: Sqoop2: Jetty: Update package for sqoop

    SQOOP-2573: Sqoop2: Use object name instead of object id for job, link and connector in Sqoop 2 server

    SQOOP-2577: Sqoop2: Support loading classes using custom classloader in ClassUtils

    SQOOP-2578: Sqoop2: Port the ApplicationClassLoader in Hadoop into Sqoop

    SQOOP-2580: Sqoop2: Jetty: Update the initialization for Sqoop server

    SQOOP-2581: Sqoop2: Drop the jobId parameter in JobManager

    SQOOP-2583: Sqoop2: Encode object name in the http request

    SQOOP-2621: Sqoop2: Provide classpath isolation for Connectors

    SQOOP-2622: Sqoop2: Add documentation about connector classpath isolation

    SQOOP-2623: Sqoop2: Add documentation about connector classpath isolation

    SQOOP-2626: Sqoop2: Provide test for CreateCommand

    SQOOP-2630: Sqoop2: Provide tests for all SqoopCommand

    SQOOP-2631: Sqoop2: Add tests for shell commands in interactive mode

    SQOOP-2632: Sqoop2: add partition class to FROM

    SQOOP-2633: Sqoop2: Allow to specify extra system classes for ConnectorClassLoader

    SQOOP-2634: Sqoop2: Provide classpath isolation for connectors and its dependencies

    SQOOP-2635: Sqoop2: Improve ConnectorClassLoader to support loading classes from the dependencies inside the connector jar

    SQOOP-2636: Sqoop2: Provide connector classpath isolation during running MR job

    SQOOP-2637: Sqoop2: Provide connector classpath isolation during running MR job

    SQOOP-2638: Sqoop2: Add integration tests for connector classpath isolation

    SQOOP-2648: Sqoop2: Add tests for ConfigFiller

    SQOOP-2653: Sqoop2: Separate each connector documentation to it's own page

    SQOOP-2660: Sqoop2: Generic JDBC: Convert input Columns from String to List

    SQOOP-2662: Sqoop2: Remove unnecessary dependencies of sqoop server module

    SQOOP-2668: Sqoop2: Doc: Build documentation only in binary profile

    SQOOP-2669: Sqoop2: Drop Links and Jobs servlet

    SQOOP-2670: Sqoop2: RESTiliency: Allow getting links by connector only for all

    SQOOP-2671: Sqoop2: Add client call to get all links by a connector

    SQOOP-2673: Sqoop2: Remove the notion of LinksBeans and JobsBeans

    SQOOP-2675: Sqoop2: Remove the id from public interface for Job

    SQOOP-2677: Sqoop2: RESTiliency: Refactore the one line try-catch statement in InvalidRESTTest

    SQOOP-2678: Sqoop2: Remove the id from public interface for Link

    SQOOP-2680: Sqoop2: Remove the id from public interface for connection

    SQOOP-2682: Sqoop2: Add test cases for the object name with special char

    SQOOP-2683: Sqoop2: Doc: Update "Installing dependencies" section in Installation guide

    SQOOP-2685: Sqoop2: Doc: Document need for sqoop2 user to be allowed to impersonate other users

    SQOOP-2688: Sqoop2: Provide utility method to safely retrieve value from JSONObject

    SQOOP-2689: Sqoop2: RESTiliency: InvalidRESTCallsTest is using wrong order when serializing data to request

    SQOOP-2690: Sqoop2: Use connector name in MLink.

    SQOOP-2691: Sqoop2: Use maven shade plugin to package connector dependencies with the connector jar itself

    SQOOP-2692: Sqoop2: Use link name in shell

    SQOOP-2694: Sqoop2: Doc: Register structure in sphinx for our docs

    SQOOP-2695: Sqoop2: Doc: Clean up git warnings for doc files

    SQOOP-2696: Sqoop2: Doc: Select final theme for the docs

    SQOOP-2697: Sqoop2: Docs: Clean up conf.py file

    SQOOP-2698: Sqoop2: RESTiliency: Split the InvalidRESTCallsTest into independent test cases

    SQOOP-2701: Sqoop2: Command "show job" doesn't work after removing support for ids:

    SQOOP-2703: Sqoop2: Use connector name in MJob

    SQOOP-2705: Sqoop2: Add kerberos support for SqoopMiniCluster

    SQOOP-2708: Sqoop2: Docs: Update Installation.rst

    SQOOP-2713: Sqoop2: Use link name in MJob

    SQOOP-2716: Sqoop2: Doc: Create special chapter about all the ways how to load jars

    SQOOP-2717: Sqoop2: Use connector name in shell

    SQOOP-2734: Sqoop2: Use job name in shell

    SQOOP-2735: Sqoop2: Use job name in MSubmission

    SQOOP-2736: Sqoop2: Document change command line shell interface

    SQOOP-2739: Sqoop2: Use resource name instead of resource id in authorization engine

    SQOOP-2740: Sqoop2: Use name instead of id for ValidationResultBean

    SQOOP-2741: Sqoop2: Use name instead of id for ValidationResultBean

    SQOOP-2742: Sqoop2: Clear useless method after remove id from public interface

    SQOOP-2743: Sqoop2: Update RepositoryLoadTool and RepositoryDumpTool

    SQOOP-2744: Sqoop2: Enable kerberos for HadoopMiniCluster

    SQOOP-2752: Sqoop2: Add impersonation support for kite hdfs

    SQOOP-2754: Sqoop2: Fix bug in integration test for Mysql and Postgresql

    SQOOP-2755: Sqoop2:Docs: Add section for examples and describe S3 import

    SQOOP-2756: Sqoop2: Add impersonation support for kite hive

    SQOOP-2757: Sqoop2: Add module connector-sdk-hadoop to hold hadoop specific SDK classes used by the connectors

    SQOOP-2761: Sqoop2: Provide test infrastructure base class for tool tests

    SQOOP-2762: Sqoop2: Provide test infrastructure base class for connector loading tests

    SQOOP-2768: Sqoop2: Remove the notion of LinksBeans

    SQOOP-2769: Sqoop2: Remove the notion of JobsBeans

    SQOOP-2770: Sqoop2: Remove the notion of ConnectorsBeans

    SQOOP-2771: Sqoop2: Remove the notion of SubmissionBean

    SQOOP-2772: Sqoop2: Remove the notion of PrincipalsBean

    SQOOP-2774: Sqoop2: Remove the notion of RolesBean

    SQOOP-2776: Sqoop2: Add web interface for thread dump

    SQOOP-2778: Sqoop2: LinkRestTest failed

    SQOOP-2782: Sqoop2: improvement SqoopInfrastructureProvider to support restart with different SqoopMiniCluster

    SQOOP-2796: Sqoop2: Add base version of the tool

    SQOOP-2799: Sqoop2: Add custom branch detection to upload-patch.py

    SQOOP-2804: Sqoop2: Document use of the script in contribution guide

    SQOOP-2805: Sqoop2: Detect if both fixVersion and affectedVersions are empty and report it

    SQOOP-2813: Sqoop2: Enable kerberos for real Hadoop cluster in the integration test

    SQOOP-2818: Sqoop2: Doc: Update broken links

    SQOOP-2822: Sqoop2: RESTiliency: Provide tests for Link POST action

    SQOOP-2823: Sqoop2: RESTiliency: Remove repetitive try-catch block for accessing POST and PUT request

    SQOOP-2826: Sqoop2: Doc: Auto-generate connector pages

    SQOOP-2827: Sqoop2: Doc: Provide doc preprocessor facilities

    SQOOP-2836: Sqoop2: Patch upload tool should detect if the JIRA number is correct

    SQOOP-2843: Sqoop2: Enable SSL/TLS for API calls

    SQOOP-2844: Sqoop2: TrustStore support for shell

    SQOOP-2845: Sqoop2: Derive keystore password from a script passed to configuration

    SQOOP-2848: Sqoop2: RESTiliency: Simplify JobRequestHandler.getJobs similarly as was done for getLinks

    SQOOP-2855: Sqoop2: Enrich Generic JDBC Connector resource file

    SQOOP-2856: Sqoop2: Enrich HDFS Connector resource file

    SQOOP-2867: Sqoop2: ResTiliency: Define one single constant for all

    SQOOP-2870: Sqoop2: RESTiliency: Add tests for DriverHandler

    SQOOP-2871: Sqoop2: Enrich FTP Connector resource file

    SQOOP-2872: Sqoop2: Enrich Kafka Connector resource file

    SQOOP-2876: Sqoop2: Document TLS support

    SQOOP-2877: Sqoop2: Enrich Kite Connector resource file

    SQOOP-2881: Sqoop2: EnrichOraOop Connector resource file

    SQOOP-2882: Sqoop2: Enrich SFTP Connector resource file

    SQOOP-2883: Sqoop2: Update model classes to represent new constant for connector resource bundles

    SQOOP-2889: Read and write from encrypted repository

    SQOOP-2890: Provide tooling to encrypt non-encrypted repository and rotate keys

    SQOOP-2891: Repository encryption documentation

    SQOOP-2900: Support encrypting map inputs with sensitive fields

    SQOOP-2954: Sanitize issues

    SQOOP-2955: Cut 1.99.7 branch

    SQOOP-2956: Update change log with 1.99.7 release

    SQOOP-2957: Update POM with new version

    SQOOP-2958: Create release candidate

    SQOOP-2959: Run vote on RC candidates

    SQOOP-2963: Update license file

    SQOOP-2965: Create release candidate for RC-1

    SQOOP-2966: Run vote on RC candidates for RC-1

  BUG

    SQOOP-691: Improve the way the data is written out into the FS

    SQOOP-910: Sqoop2: Move to embedded jetty from tomcat

    SQOOP-1253: Sqoop2: Implement various maintenance tools

    SQOOP-1442: Sqoop2: Validations: Serialize validations over the wire for client transfer

    SQOOP-1531: Sqoop2: Support getting connectors by Direction

    SQOOP-1690: Implement doAs for Sqoop2

    SQOOP-1732: Sqoop2: Add version to connector upgrade API

    SQOOP-1824: Sqoop2: Create a common RDBMS table structure doc

    SQOOP-1924: Improvement features for Kerberos support on Sqoop 2

    SQOOP-2048: SQOOP2: Improvement of Role Based Access Control

    SQOOP-2121: Sqoop2: Show job should show connection information

    SQOOP-2133: Sqoop2: Hdfs Intermediate Data Format

    SQOOP-2151: Sqoop2: Sqoop mapreduce job gets into deadlock when loader throws an exception

    SQOOP-2196: Sqoop2: Add Runner factory for Kafka

    SQOOP-2197: Add concrete DatabaseType to MySQL provider

    SQOOP-2262: Sqoop2: Create LoggerStream

    SQOOP-2269: Sqoop2: Parquet integration tests

    SQOOP-2280: Sqoop2: Handle fixed point columns

    SQOOP-2285: Sqoop2: Change POM version back to 2.0.0-SNAPSHOT

    SQOOP-2299: Sqoop2: Store context classes in repository

    SQOOP-2300: Sqoop2: DerbySchemaCreateQuery have copy&paste error with SQ_CONFIG_DIRECTIONS comment

    SQOOP-2303: EmptyTypeList when returned from DatabaseProvider class results in NPE in TestNG

    SQOOP-2305: Sqoop2: ConfigUtils is not properly serializing Enum values

    SQOOP-2318: Use hadoop configuration defaults for MapReduceSubmissionEngine

    SQOOP-2319: Sqoop2: Sqoop2-shell should take in JAVA_OPTS

    SQOOP-2320: Sqoop2: AllTypesTest should be in slow category

    SQOOP-2321: Sqoop2: Clean up FromRDBMSToHDFS test

    SQOOP-2322: Sqoop2: Kafka topic should vary on a per method basis

    SQOOP-2323: Sqoop2: Add validation for connector supported directions

    SQOOP-2342: Sqoop2: Provide an external application classloader

    SQOOP-2347: Sqoop2: Typo in code snippet in sqoop documentation

    SQOOP-2350: Sqoop2: log4j properties file should be configurable

    SQOOP-2351: Sqoop2: Connector cache should be cleared when role is deleted

    SQOOP-2352:  Sqoop2: Generic JDBC Connector support for fetch size

    SQOOP-2356: Sqoop2: Derby upgrade should automatically rename jobs that have conflicting names

    SQOOP-2359: Sqoop2: Zookeeper dependency should be documented

    SQOOP-2360: Sqoop2: Upgrade should consider both directions for a single connector

    SQOOP-2369: Sqoop2: Use random port for AJP end point in TomcatSqoopMiniCluster

    SQOOP-2374: Sqoop2: Kite connector documention note on dataset URIs

    SQOOP-2380: Sqoop2: Wrong argument for show link client command

    SQOOP-2382: Sqoop2: Arithmetic exception in partitioner when allow null is true

    SQOOP-2384: SQOOP2: Remove source code from binary distribution

    SQOOP-2386: Sqoop2: refactor code in HandlerUtils

    SQOOP-2388: SQOOP2: Remove duplicate code in ConfigUtils.fromConfigs()

    SQOOP-2390: Sqoop2: FindJob will throw exception when job doesn't exist

    SQOOP-2391: Sqoop2: MySQL JDBC Driver is packaged with binary distribution

    SQOOP-2395: Sqoop2: Signature of method getConnectorIdFromIdentifier in HandlerUtils is inconsistent with other methods

    SQOOP-2396: Sqoop2: Race condition in purge/update threads on Server shutdown

    SQOOP-2397: Sqoop2: Propagate CSVWriter in Kite connector to execution engine

    SQOOP-2409: Sqoop2: Bump up Tomcat version to 6.0.37 in integration test

    SQOOP-2410: Sqoop2: Integration test report have incorrect suffix

    SQOOP-2414: Sqoop2: Change JUnit Assert class to TestNG Assert class

    SQOOP-2419: Sqoop2: Use object name instead of id if possible

    SQOOP-2422: Sqoop2: Test TestJSONIntermediateDataFormat is failing on JDK8

    SQOOP-2424: Sqoop2: Provide custom TestNG listener in integration tests

    SQOOP-2425: Sqoop2: Improve our pre-commit hook

    SQOOP-2431: Sqoop2: Precommit: Refactore the file handling

    SQOOP-2432: Sqoop2: Update maven-site-plugin for in root pom.xml

    SQOOP-2433: Sqoop2: Add way to invoke findbugs checks from maven

    SQOOP-2436: Sqoop2: PreCommit script crashes when testing a patch that was already committed

    SQOOP-2439: Sqoop2: NullPointerException when calling job status notification URL

    SQOOP-2444: Sqoop2: Integration tests are using the same working directory

    SQOOP-2446: Sqoop2: Fix incorrect notification URL for execution engine

    SQOOP-2448: Sqoop2: Resolve findbugs warnings

    SQOOP-2454: Drop JDK6 support

    SQOOP-2462: Sqoop2: Provide List type for configuration objects

    SQOOP-2463: Sqoop2: Add support for schema-less to schema-less transfer for CSV IDF

    SQOOP-2464: Initializer object is not reused when calling getSchema

    SQOOP-2472: Sqoop2: Upgrade to newer version of cobertura maven plugin

    SQOOP-2474: Fix the problem in the integration test case Derby1_99_4UpgradeTest

    SQOOP-2476: Sqoop2: Fix failing precommit hook

    SQOOP-2477: Sqoop2: Add protection for HTTP error 404 to precommit hook

    SQOOP-2478: Sqoop2: Downgrade cobertura plugin to version 2.6

    SQOOP-2480: Sqoop2: Provide ability to add entire Map instance to our MutableMapContext

    SQOOP-2481: Sqoop2: Precommit: Drop call to clean while running unit tests

    SQOOP-2482: Sqoop2: Precommit: Cobertura method is using wrong variable name

    SQOOP-2487: Sqoop2: ConnectorTestCase have wrong order of arguments in assertEquals

    SQOOP-2488: Sqoop2: Precommit hook is using incorrect string insertion

    SQOOP-2489: Sqoop2: Hive with Parquet in Kite Connector

    SQOOP-2492: Sqoop2: getNestedProperties() in MapContext puts key instead of value

    SQOOP-2494: Sqoop2: Improve resiliency for malformed connectors

    SQOOP-2495: Sqoop2: Provide simple test that can validate if connector is reasonably formed

    SQOOP-2496: Sqoop2: Provide a way to inject external connectors

    SQOOP-2497: Sqoop2: Do not require constructors initializing all properties in configuration objects

    SQOOP-2498: Sqoop2: Precommit: Fix formatting typo

    SQOOP-2505: Sqoop2: Add ability to specify custom configuration properties for HDFS connector

    SQOOP-2513: Sqoop2: Deadlock occurs between getJobStatus and JobManager.UpdateThread#updateSubmission

    SQOOP-2520: Sqoop2: Update documentation that JDK7+ is required now

    SQOOP-2524: Sqoop2: Add S3 support to HDFS Connector

    SQOOP-2525: Sqoop2: Add support for incremental From in HDFS Connector

    SQOOP-2538: Sqoop2: Use the table name variable instead of the table name string

    SQOOP-2540: Sqoop2: Add RepositoryProvider for MySQL

    SQOOP-2543: Sqoop2: Create sqoop mini cluster factory and provider

    SQOOP-2549: Sqoop2: Allow connector developers to mask certain keys in Maps when sending them back to clients

    SQOOP-2551: Sqoop2: Explicit encode data sent in SqoopClient with charset

    SQOOP-2554: Sqoop2: Enforce the element column in FromJobConfig of JDBC connector is a comma separated list

    SQOOP-2556: Sqoop2: Declare default constructor private for singleton classes

    SQOOP-2559: Sqoop2: Provide DateTime type for configuration objects

    SQOOP-2562: Sqoop2: Should decode the key and value in MMapInput#restoreFromUrlSafeValueString

    SQOOP-2572: MODEL_004:Usage of unsupported data type when using DateTime type

    SQOOP-2579: Sqoop2: Refactore RepositoryManager to not load structure from repository when loading jobs and links

    SQOOP-2584: Sqoop2: Fix test failure in InvalidRESTCallsTest

    SQOOP-2586: Sqoop2: Oracle DATE type error

    SQOOP-2588: Sqoop2: CommonRepositoryHandler#inUseLink only check if link is used in the from side of a job

    SQOOP-2589: Sqoop2: Tool: Introduce integration tests for the tools

    SQOOP-2590: Sqoop2: Equals operator abuse in MInputs

    SQOOP-2591: Sqoop2: Is there a better way to represent sensitive values in JSON responses from he server?

    SQOOP-2592: Sqoop2: Unit tests for serialization of sensitive inputs

    SQOOP-2593: Sqoop2: repository-mysql tests should not run when integration tests are run

    SQOOP-2598: Sqoop2: Main sqoop.log is missing log outputs from classes other then org.apache.sqoop

    SQOOP-2599: Sqoop2: Classutils behaves badly when the classpath changes.

    SQOOP-2602: Sqoop2: Static initialization of ClassUtils defaultClassloader is fragile

    SQOOP-2603: Sqoop2: Packaging script should make executables to be executable by default for everyone

    SQOOP-2604: Sqoop2: Add "run" mode to sqoop2-server script

    SQOOP-2605: Sqoop2: Allow to override location of configuration directory

    SQOOP-2606: Sqoop2: Do not reconfigure log4j if there are no log4j properties inside sqoop.properties file

    SQOOP-2608: Sqoop2: MNamedElement should inherit from MValidatedElement

    SQOOP-2611: Sqoop2: Update sqoop.properties for Sqoop extra classpath

    SQOOP-2619: Sqoop2: Provide ability to run integration tests against real Sqoop 2 server

    SQOOP-2624: Sqoop2: Provide tests for shell module

    SQOOP-2629: Sqoop2: Add ability to "blacklist" connectors

    SQOOP-2640: Not possible to enter "last value" when creating incremental job

    SQOOP-2641: SQOOP2: Fix test case failure for repository-postgresql

    SQOOP-2645: Sqoop2: Ensure that classpath loading integration tests are run by default

    SQOOP-2652: Sqoop2: Add test case for S3 incremental import to HDFS

    SQOOP-2654: Sqoop2: Fix the problem in integration test with MySql repository

    SQOOP-2655: Sqoop2: Code clean in server module

    SQOOP-2656: Sqoop2: NPE will happen in connector-loading-tests when do the slow integration test

    SQOOP-2659: Sqoop2: Do not stop services that haven't been started in our integration test suite

    SQOOP-2667: Sqoop2: Improve documentation

    SQOOP-2672: Sqoop2: Remove double dependency on mockito in shell module

    SQOOP-2679: Sqoop2: Remove junit import from TestMapContext

    SQOOP-2681: Sqoop2: Connectors failing to register

    SQOOP-2684: Sqoop2: Upgrade groovy to 2.4.0

    SQOOP-2693: Sqoop2: Command line should let user retry Name it's invalid

    SQOOP-2699: Sqoop2: Oraoop: Improve Oracle parameters

    SQOOP-2700: Sqoop2: Tests in shell module are in infinite loop

    SQOOP-2704: Sqoop2: Provide kerberos support for integration tests

    SQOOP-2709: Sqoop2: HDFS: Impersonation on secured cluster doesn't work

    SQOOP-2710: Sqoop2: Move user from context classes to parent TransferableContext

    SQOOP-2715: Sqoop2: The test case ShowJobInOrderTest always failed

    SQOOP-2718: Sqoop2: Remove extra entry from IncrementalType enum

    SQOOP-2719: Sqoop2: Ensure the GenericJDBCConnector integration tests work against MySQL, PostgreSQL, and Oracle

    SQOOP-2720: Sqoop2: Allow the integration tests to be run against a real cluster

    SQOOP-2725: Sqoop2: Integration Tests: Prefer using Timestamp types and PreparedStatements for inserting rows into test databases

    SQOOP-2726: Sqoop2: Integration Tests: Do not use ansi_quotes mode for MySQL

    SQOOP-2727: Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions

    SQOOP-2728: Sqoop2: Avoid casting after calling getObject on ResultSet

    SQOOP-2729: Sqoop2: Integration Tests: In ShortStories.java we have a varchar(10000) column, which is too long for oracle

    SQOOP-2730: Sqoop2: Integration: Oracle does not support a boolean type, so do not use them in tests

    SQOOP-2731: Sqoop2: DisabledObjectsTest creates table that is too long for oracle

    SQOOP-2732: Sqoop2: Integration Tests: For Oracle compatibility use decimal instead of numeric sql type

    SQOOP-2733: Sqoop2: Integration Tests: Clean up mapreduce directory for IncrementalReadTest

    SQOOP-2760: Sqoop2: Fix update command with name for link and job

    SQOOP-2763: Sqoop2: Sqoop shell is accepting non existing arguments

    SQOOP-2764: Sqoop2: Sqoop shell history is no longer working

    SQOOP-2765: Sqoop2: Client is not exposing the real exception when retrieving exception from server

    SQOOP-2766: Sqoop2: Create debugging web interface for Sqoop 2

    SQOOP-2773: Sqoop2: Ensure that the connector-sdk-hadoop jar is shipped to mappers

    SQOOP-2775: Sqoop2: mark repositorydumploadtooltest to not run on a real cluster

    SQOOP-2781: Sqoop2: Connector isolated class loader should be used when running validations

    SQOOP-2785: Sqoop2: Update developer list in pom.xml file

    SQOOP-2798: Sqoop2: Add cmd tool to automate patch upload process

    SQOOP-2800: Not able to trnasfer unicode data to Teradata

    SQOOP-2802: Sqoop2: Logging level should be debug for integration tests

    SQOOP-2811: Sqoop2: Extracting sequence files may result in duplicates

    SQOOP-2816: Sqoop2: Shell integration tests should pass when running against a real cluster

    SQOOP-2817: Sqoop2: NullValueTest fails when running against MySQL database

    SQOOP-2819: Use connector name instead of id in Repository.findJobsForConnector methods

    SQOOP-2828: Sqoop2: AvroIntermediateDataFormat should read Decimals as BigDecimals instead of Strings

    SQOOP-2829: Sqoop2: LinkRestTest should pass when run against a real cluster

    SQOOP-2831: Sqoop2: Precommit: Do not run multiple execution for integration tests

    SQOOP-2832: Sqoop2: Precommit: Create log files for individual tests

    SQOOP-2833: Sqoop2: Integration Tests: Allow setting which "time type" should be used based on the DatabaseProvider

    SQOOP-2834: Sqoop2: Integration: Limit debug log to only classes that we're interested in

    SQOOP-2849: Sqoop2: Job failure when writing parquet in hdfs with data coming from mysql

    SQOOP-2857: Sqoop2: toParquetTest fails frequently on the pre-commit hook

    SQOOP-2860: Sqoop2: Should be able to run integration tests on a real cluster without kerberos

    SQOOP-2865: Sqoop2: Increase test timeout from one hour

    SQOOP-2866: Sqoop2: Add Abe Fine to committer list in our pom file

    SQOOP-2868: Sqoop2: Introduce link and job validations

    SQOOP-2875: Sqoop2: Integration tests should on include a request body with a delete request

    SQOOP-2888: Test case ShowCommandTest is failing after SQOOP-2848

    SQOOP-2908: Sqoop2: Increase maximal length for jdbc connection strings

    SQOOP-2914: Sqoop2: Support using password generators for repository passwords

    SQOOP-2918: Sqoop2: Increase maximum length of input names

    SQOOP-2923: Sqoop2: Reword documentation to make it clear that the api endpoints fall under /sqoop

  IMPROVEMENT

    SQOOP-736: Move loaders from execution engine to core module

    SQOOP-2329: Sqoop2: Provide integration test infrastructure base class

    SQOOP-2330: Sqoop2: 1.99.2 repository upgrade test

    SQOOP-2341: Sqoop2: Test repository infrastructure

    SQOOP-2375: Sqoop2: Add authorization component in SecurityGuide

    SQOOP-2383: SQOOP2: Add do user support in authorization engine

    SQOOP-2398: Sqoop2: Show all job with order

    SQOOP-2405: Sqoop2: Remove active wait in test cases after executeJob() call

    SQOOP-2490: Sqoop2: Add extra jars to job

    SQOOP-2595: Add Oracle connector to Sqoop 2

    SQOOP-2610: Sqoop2: Tomcat related code should be cleanup

    SQOOP-2614: Sqoop2: Update the document for using Jetty as server

    SQOOP-2618: Sqoop2: Mask S3 sensitive properties in HDFS configuration

    SQOOP-2625: Sqoop2: Fix test case failure for repository-mysql

    SQOOP-2661: Improved sqoop extraction of Oracle 11 timestamp data type exception problem

    SQOOP-2674: Sqoop2: Remove the id from public interfaces for conection/job/link

    SQOOP-2758: Sqoop2: Add integration test for shell

    SQOOP-2786: Sqoop2: If AUTHENTICATION_KERBEROS_KEYTAB is not found in the properties throw a meaningful exception

    SQOOP-2797: Sqoop2: Add new schema object for the Blob

    SQOOP-2807: Sqoop2: Add admin user list to configuration file

    SQOOP-2814: Sqoop2: Create system wide rc file for the shell

    SQOOP-2820: Sqoop2: Encryption over the REST interface

    SQOOP-2838: Sqoop2: Add new schema object for the Clob

    SQOOP-2852: Sqoop2: Revert and re-commit SQOOP-2843: Sqoop2: Enable SSL/TLS for API calls

    SQOOP-2853: Sqoop2: Refactor TableDisplayer to be used in document generation

    SQOOP-2854: Sqoop2: Enrich connector resource files

  NEW FEATURE

    SQOOP-923: Sqoop2: Create developer guide

    SQOOP-1529: Kite Connector Support

    SQOOP-1756: Sqoop2: Specific connector documentation

    SQOOP-2574: Sqoop2: Provide classpath isolation for Connectors

    SQOOP-2615: Sqoop2: We should have a validator to test if an Integer input is within a range

    SQOOP-2788: Sqoop2: Parquet support for HdfsConnector

    SQOOP-2887: Sqoop2: Encrypt sensitive information in the repository

    SQOOP-2932: Sqoop2: Avro support for HdfsConnector

  TASK

    SQOOP-499: Sqoop2: Implement kerberos support for client shell

    SQOOP-641: Add unit tests to Sqoop 2

    SQOOP-668: Formalize network protocol that is in use

    SQOOP-2393: Sqoop2: Add Qian Xu to developers list

    SQOOP-2394: Add Richard Zhou to the developers list

  TEST

    SQOOP-2790: Remove the duplicate test cases in shell module

    SQOOP-2808: Sqoop2: Integration tests should test rows with null values

Release 1.99.6

  SUB-TASK

    SQOOP-1528: Sqoop2: Kerberos support on DoAs function

    SQOOP-1757: Sqoop2: Document generic jdbc connector

    SQOOP-1961: Sqoop2: addDelegationTokens is not exposed in SqoopClient

    SQOOP-1978: Sqoop2: Command line support

    SQOOP-1979: Sqoop2: Rest API support

    SQOOP-1998: Sqoop2: Kite Connector: Hive support

    SQOOP-2016: Sqoop2: Create integration test for JDBC to Hive

    SQOOP-2019: Sqoop2: Handle post-function for updating/deleting resource

    SQOOP-2079: Sqoop2: Remove useless functions for RBAC

    SQOOP-2080: Sqoop2: Combine privileges into READ and WRITE

    SQOOP-2092: Support for LONG in MInputType

    SQOOP-2094: Sqoop2: Update RESTAPI.rst

    SQOOP-2101: Sqoop2: Add SqoopClient support to call Restful API

    SQOOP-2139: Sqoop2: Change create role API from PUT to POST

    SQOOP-2144: Sqoop2: Show command for CLI

    SQOOP-2146: Sqoop2: Sqoop client should return model objects for RBAC methods

    SQOOP-2148: Sqoop2: Fix wrong input sequence of name and type in function new Principal and Resource

    SQOOP-2160: Sqoop2: Datatypes: Provide foundation for the exhaustive type checks

    SQOOP-2166: Sqoop2: Add &quot;Authorization Exception&quot; error code in SecurityError.java

    SQOOP-2183: Sqoop2: Change resource type, privilege action and principal type from String to Enum.

    SQOOP-2184: Sqoop2: Add ServerName for authorization handler

    SQOOP-2198: Sqoop2: Datatypes: Add boolean/char/date support to DerbyTypeList

    SQOOP-2204: Sanitize issues

    SQOOP-2205: Cut 1.99.6 branch

    SQOOP-2206: Update change log with 1.99.6 release

    SQOOP-2207: Update POM with new version

    SQOOP-2208: Create release candidate

    SQOOP-2209: Run vote on RC candidates

    SQOOP-2210: Release artifacts

    SQOOP-2211: Finish release

    SQOOP-2212: Update website

    SQOOP-2220: Sqoop2: Fix the privilege check on job using the link id not the connector id 

    SQOOP-2226: Sqoop2: Access denied in shell

    SQOOP-2227: Sqoop2: Clear connector cache in ShowConnectorFunction.java

    SQOOP-2246: Sqoop2: Use jdbcProperties when creating database connection in GenericJDBCExecutor

    SQOOP-2248: Sqoop2: ErrorCodes: Move ServerError to server module

    SQOOP-2249: Sqoop2: ErrorCodes: Move SecurityError to core module

    SQOOP-2251: Sqoop2: ErrorCodes: Move RepositoryError to core module

    SQOOP-2255: Sqoop2: Throw Exception when no permission to the resource

    SQOOP-2256: Sqoop2: Creator should have access to its entities

    SQOOP-2304: Update license file

    SQOOP-2313: Update change log with 1.99.6 release for RC-1

    SQOOP-2314: Create release candidate for RC-1

    SQOOP-2315: Run vote on RC candidates for RC-1

  BUG

    SQOOP-1439: Sqoop2: Refactor validations

    SQOOP-1516: Sqoop2: Config Input as a Top Level Entity - RepositoryAPI changes

    SQOOP-1577: Sqoop2: Refactor repository dump and load tools

    SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work

    SQOOP-1738: Sqoop2: HDFS Connector : Check for output directory

    SQOOP-1746: Sqoop2: Mapreduce job is running in DEBUG mode by default

    SQOOP-1790: Sqoop2: Upgrade configs with name conflicts

    SQOOP-1808: Add Integration tests to for Incremental read / write between JDBC and HDFS

    SQOOP-1841: Sqoop2: Upgrade from 1.99.1 to 1.99.4 onwards is broken

    SQOOP-1868: Sqoop2: Document MySQL Fast Connector

    SQOOP-1949: Sqoop2: HDFS append only support

    SQOOP-2036: Sqoop2: JDBC Connector need to send BigDecimal for decimal type in Object array

    SQOOP-2089: Sqoop2: Clone configuration object instead of overwriting global

    SQOOP-2095: Sqoop2: Remove duplicate maven dependency org.mockito:mockito-all

    SQOOP-2102: Binary tarball missing executable bit on sqoop2-* files

    SQOOP-2106: Upgrade the version of Derby to 6 and Postgres to 1 in sqoop trunk

    SQOOP-2117: Sqoop2: Shell command &#39;show link&#39; should show connector name

    SQOOP-2119: Sqoop2: Remove remaining imports from junit in PostgreSQL repository tests

    SQOOP-2120: Sqoop2: Test classes using powermock fails badly when compiling with java target version 1.7

    SQOOP-2122: Sqoop2: Build documentation only in binary packaging profile

    SQOOP-2123: Sqoop2: Copy shell libraries only in binary package profile

    SQOOP-2124: Sqoop2: Pre-Commit hook should report how many tests are executed

    SQOOP-2129: Sqoop2: SQ_SUBMISSION deletes should cascade

    SQOOP-2140: Sqoop2: Cast exception when try to cast an integer to Avro&#39;s Long type

    SQOOP-2150: Sqoop2: Kite 1.0 don&#39;t allow dashes to be used in dataset names

    SQOOP-2152: Sqoop2: Kite connector always assumes that FixedPoint is long regardless of the configured size

    SQOOP-2153: Sqoop2: Ensure creation of valid Avro schema names

    SQOOP-2155: Sqoop2: KiteDatasetExecutor is not cleaning up merged datasets

    SQOOP-2156: Sqoop2: HdfsUtils.getOutputMapreduceFiles should ignore hidden files

    SQOOP-2157: Sqoop2: Kite: Add simple integration test for TO direction

    SQOOP-2158: Sqoop2: Pre-Commit hook is incorrectly counting number of executed tests

    SQOOP-2159: Sqoop2: Use BeforeSuite/AfterSuite for startHadoop/stopHadoop in integration tests

    SQOOP-2162: Sqoop2: InputEditable should be optional in JSON API

    SQOOP-2163: Sqoop2: Remove jackson dependency

    SQOOP-2167: Sqoop2: Change getUserName to getShortUserName in AuthorizationEngine.java

    SQOOP-2169: Sqoop2: Kafka integration test bug

    SQOOP-2171: Sqoop2: Incorrect basic type boxing with JDK1.7

    SQOOP-2172: Sqoop2: Move ErrorCode&#39;s sub-class from sqoop-core to sqoop-common

    SQOOP-2188: Sqoop2: Failed to merge Kite datasets

    SQOOP-2190: Sqoop2: Remove hadoop200 profile from test-patch.py

    SQOOP-2201: Sqoop2: Add possibility to read Hadoop configuration files to HFDS connector

    SQOOP-2202: Sqoop2: Add validator to check existence of local directory on Sqoop 2 server

    SQOOP-2213: Sqoop2: toCSVFixedPoint ClassCastException

    SQOOP-2214: Sqoop2: Add ability to easily iterate over entries stored in Context

    SQOOP-2215: Sqoop2: Remember all test logs in pre-commit hook

    SQOOP-2219: Sqoop2: Skip missing input in DirectoryExistsValidator

    SQOOP-2225: Sqoop2: Shell client clobbers server exceptions

    SQOOP-2228: Sqoop2: HDFS Connector: Import data to temporary directory before moving them to target directory

    SQOOP-2229: Sqoop2: Kite connector should handle doubles

    SQOOP-2230: Sqoop2: Kite connector can use URIBuilder

    SQOOP-2231: Sqoop2: Kite connector should use authority in link configuration

    SQOOP-2232: Sqoop2: Test initializer against local filesystem

    SQOOP-2233: Sqoop2: Move TestHdfsConnector class under test directory

    SQOOP-2234: Sqoop2: Move DatasetURIValidator to Kite package as it&#39;s not generally usable validator

    SQOOP-2235: Sqoop2: Move PrefixContext back to mapreduce execution engine

    SQOOP-2236: Sqoop2: Drop outdated comment from SubmissionCallbacks class

    SQOOP-2238: Sqoop2: Parquet jars missing

    SQOOP-2239: Sqoop2: Remove Repository.updateSubmission() call from Mapreduce submission engine

    SQOOP-2240: Sqoop2: Remove Hadoop 1.x example from catalina.properties

    SQOOP-2241: Sqoop2: PreCommit hook is incorrectly counting number of executed tests

    SQOOP-2242: Sqoop2: Add support for full table names into our DatabaseProvider infrastructure

    SQOOP-2265: Sqoop2: Standardize on methods

    SQOOP-2268: Sqoop2: Fix a typo in ShowLinkFunction

    SQOOP-2273: Sqoop2: Move authorizationServlet into v1 package

    SQOOP-2276: MapReduce execution error in Sqoop job

    SQOOP-2277: Sqoop2: Add annotation for public usage classes in Sqoop Core

    SQOOP-2278: Sqoop2: Fix bug for all user could read connector

    SQOOP-2279: Sqoop2: Clean connector cache after grant and revoke statements

    SQOOP-2307: Sqoop2: Fix a typo for hdfs-connector-config.properties and kafka-connector-config.properties

    SQOOP-2308: Sqoop2: Fix a typo for hdfs-connector-config.properties and kafka-connector-config.properties

    SQOOP-2309: Sqoop2: Add to link id in show job --all command

    SQOOP-2310: Sqoop2: fix a typo for Hadoop conf directory

    SQOOP-2327: Sqoop2: Change package name from Authorization to authorization

  IMPROVEMENT

    SQOOP-1805: Sqoop2: GenericJdbcConnector: Delta read support

    SQOOP-2134: Update Kite dependency to 1.0.0

    SQOOP-2250: Sqoop2: SQ_LINK_INPUT is missing a foreign key constraint

  TASK

    SQOOP-506: Create Sqoop integration test infrastructure.

Release 1.99.5

  SUB-TASK

    SQOOP-1348: Sqoop2: Remove Data class

    SQOOP-1349: Sqoop2: Use configurable writable to get Intermediate Data Format

    SQOOP-1526: Sqoop2: Kerberos support when starting service

    SQOOP-1527: Sqoop2: Kerberos support (SPNEGO) in communication between server and client

    SQOOP-1549: Simplifying the Configuration class concept in Connector api

    SQOOP-1552: Revisit if we need a config list for the link/from/to configs in connector api

    SQOOP-1588: Sqoop2: Kite connector write data to HDFS

    SQOOP-1589: Sqoop2: Create common constants, error codes, and queries

    SQOOP-1590: Sqoop2: PostgreSQL repository implementation

    SQOOP-1591: Sqoop2: PostgreSQL integration tests

    SQOOP-1592: Sqoop2: Remove Hadoop1 profile

    SQOOP-1602: Sqoop2:  Fix the current balancing across Loaders internal to Sqoop 

    SQOOP-1621: Sqoop2: Allow null as a dummy Schema

    SQOOP-1624: Sqoop2: Apply repository upgrader api

    SQOOP-1647: Sqoop2: Read data from HDFS in KiteConnector

    SQOOP-1651: Sqoop2: Cleanup: Naming and ordering of methods in Repo relates classes

    SQOOP-1681: DOC: Create an API doc for the Sqoop Execution engine ( since its extensible)

    SQOOP-1702: Fix typo for SQOOP-1526

    SQOOP-1703: Sqoop2: rename Type to Column Type + size to length + minor doc fixes

    SQOOP-1706: Add IDF API doc/wiki  for the IDF interface and Schema -&gt; ColumnTypes

    SQOOP-1707: SQOOP2: Address the validate method in Column class

    SQOOP-1708: Rename Unsupported Column type to Unknown and add java doc

    SQOOP-1709: Column Type enhancements for complex types

    SQOOP-1715: Make name for column required ( fix the corr tests)

    SQOOP-1716: Add Options as a field in the Enum object ( so it can be used for validation)

    SQOOP-1717: Sqoop2: Remove Data class from docs

    SQOOP-1733: Port SQOOP-1728 to sqoop2 branch

    SQOOP-1734: Port SQOOP-1725 to sqoop2 branch

    SQOOP-1741: Port SQOOP-1736 to sqoop2 branch

    SQOOP-1749: Support List Type in CSV IDF

    SQOOP-1750: Support Map Type in  CSV IDF

    SQOOP-1751: Sqoop2: Rearrange LinkConfig and ToJobConfig of Kite Connector

    SQOOP-1752: Kite connector cannot submit CSV import job

    SQOOP-1754: Sqoop2: Remove JarUtil class

    SQOOP-1755: Sqoop2: Security guide

    SQOOP-1761: Sqoop2: Unit tests for  different Column sub classes Array/Set and Map types 

    SQOOP-1765: Sqoop2: Time/Timestamp format support for CSV IDF

    SQOOP-1769: Fix Enum to no inherit from list

    SQOOP-1771: Investigation CSV IDF FORMAT of the Array/NestedArray/ Set/ Map in Postgres and HIVE.

    SQOOP-1776: Sqoop2: Delegation Token support for Authentication

    SQOOP-1791: Sqoop2: Add simple authentication parameters to documentation

    SQOOP-1796: Support Incremental Semantics in command line tool for Job

    SQOOP-1797: Support Incremental semantics in the REST apis 

    SQOOP-1798: Support a API/ command line utility to retrieve the last value or any JOB_OUTPUT

    SQOOP-1799: Connector API : Ability for connector to indicate if its FROM and TO support incremental reading/ writing

    SQOOP-1801: Delta Fetch Merge Config API : Validations for the Delta Fetch/Merge Configs

    SQOOP-1804: Add editable and override attribute to inputs

    SQOOP-1811: Sqoop2: IDF API changes

    SQOOP-1813: Sqoop2: Add SqoopIDFUtils class and unit tests

    SQOOP-1815: Sqoop2: Date and DateTime is not encoded in Single Quotes

    SQOOP-1817: Sqoop2: Update CSVIntermediate BIT data type

    SQOOP-1819: Support Enum in CSVIDF ( + add unit tests)

    SQOOP-1825: Sqoop2: Handle NULLs for all types in CSV Intermediate Data Format

    SQOOP-1829: Sqoop2: Define IDF object model

    SQOOP-1834: Sqoop2: RBAC pluggable framework

    SQOOP-1842: Sqoop2: Fix timestamp type casting

    SQOOP-1845: Sqoop2: Make DateTime Column type support datetime with and without timezone

    SQOOP-1846: Sqoop2: DateTime support in CSV IDF and iso8601

    SQOOP-1849: Using JODA for datetime means we only have 3 digit millisecond representation for fraction

    SQOOP-1870: Sqoop2: Merge SPI and connector-sdk packages

    SQOOP-1876: Update the submission JSON in the doc (restAPI.rst)

    SQOOP-1879: Sqoop2: Submission Engine does not set all details on SubmissionRecord in Local mode

    SQOOP-1881: Randomize ports for Kafka integration tests

    SQOOP-1897: Sqoop2: Submission Engine API change for better performance

    SQOOP-1898: Change the API of getJars to use SET than LIST to avoid duplicate jars

    SQOOP-1899: Minor change to CSVIDF to use Set instead of Lists

    SQOOP-1900: Fix the SqoopWritable read/ write method to delegate the toIDF methods

    SQOOP-1901: Sqoop2: Support DRY code in IDF impementations and add JSONIDF

    SQOOP-1902: Sqoop2: Avro IDF class and unit tests

    SQOOP-1903: Wrap up the design doc once implementation is done

    SQOOP-1908: Sqoop2: Document external connector support

    SQOOP-1909: Sqoop2: Connect security guide to main docs

    SQOOP-1913: Sqoop2: Add jackson as a dependency

    SQOOP-1915: sqoop2: parseCSV in CSVIDF doesn&#39;t correctly parse strings with commas

    SQOOP-1925: Sqoop2: Clean up duplicate constants in DerbySchemaConstants, use CommonRepoConstants

    SQOOP-1930: Sqoop2: Enforce a non empty schema name and column names

    SQOOP-1931: Tech debt : Alternative to isTest flag in the SqoopOutputFormatExecutor

    SQOOP-1935: Sqoop2: Fix TestSqoopWritable test and make getString and setString package private

    SQOOP-1936: Sqoop2: Sort by comparing IDF data in shuffle phase

    SQOOP-1937: Why need  SqoopWritable, ? why not just Text?

    SQOOP-1938: DOC:update the sqoop MR engine implementation details

    SQOOP-1940: Add hashcode and equals methods to SqoopWritable

    SQOOP-1950: Sqoop2: Use TestNG

    SQOOP-1956: Sqoop2: Cleanup IDF implementations

    SQOOP-1960: Sqoop2: Share auth token across ResourceRequest in SqoopClient

    SQOOP-1962: Sqoop2: Start sqoop2 minicluster on random port

    SQOOP-1974:  Sqoop2: parseCSVString in SQOOPIDFUtils add more tests

    SQOOP-1980: Sqoop2: Rule based rest API protection

    SQOOP-1981: Sqoop2: Default implementation of RBAC in Sqoop

    SQOOP-1982: Sqoop2: Provide username globally via AuthenticationProvider

    SQOOP-1984: Sqoop2: Add error summary and details to PostgreSQL repository

    SQOOP-1985: Sqoop2: On job delete cascade to submission

    SQOOP-1988: Sqoop2: isNull handling should be moved to CSVIntermediateDataFormat

    SQOOP-1991: Sqoop2: Define slow category in integration tests

    SQOOP-1994: Sqoop2: Use common repository constants

    SQOOP-2002: Sqoop2: Refactor existing security component

    SQOOP-2004: Sqoop2: Make annotations run always

    SQOOP-2012: DOC:Explain the connector project structure and relevant modules in sqoop to depend on

    SQOOP-2013: What is the story for External Connectors to write unit and integration tests?

    SQOOP-2015: Sqoop2: Create HBase code path in Kite connector

    SQOOP-2026: Sqoop2: Make getUserName function in RequestContext support Kerberos

    SQOOP-2028: add license header to TestConnectorManagerUtils

    SQOOP-2064: Sqoop2: Update POM version on new 1.99.5 branch

    SQOOP-2072: Sqoop2: Add editable and override attributes for postgres

    SQOOP-2074: Sqoop2: Add input attributes documentation

    SQOOP-2084: Sqoop2: Fix Indentation in input attributes documentation

    SQOOP-2085: Sqoop2: Null handling in AuthorizationEngine

    SQOOP-2096: Sqoop2: Fix typos in comments in SecurityConstants

  BUG

    SQOOP-1452: Sqoop2: Upgrade to Hadoop 2.5.1

    SQOOP-1523: Sqoop2: Support for PostgreSQL database for hosting the sqoop entity repository

    SQOOP-1572: Sqoop2: Duplicate Column Name in Multiple Tables Import

    SQOOP-1604: Base/ Marker class for Config and Configuration

    SQOOP-1636: Sqoop2: Add unique constraint to the SQI_INPUT name per type per config

    SQOOP-1640: Sqoop2: Pull DatabaseProvider into sqoop-common-test module

    SQOOP-1672: Sqoop2 import inserting null strings(&#39;null&#39;) for empty values in Oracle

    SQOOP-1680:  DOC: Create an Public API doc for the Sqoop repository.

    SQOOP-1695: Sqoop2: Removed hardcoded version in pom.xml of connector-sdk 

    SQOOP-1705: SQOOP2: Support AVRO as a an implementation for the IDF interface

    SQOOP-1713: Sqoop2: Remove SQOOP-1348.patch file

    SQOOP-1730: Sqoop2: httpcore and httpclient version has not upgrade after hadoop upgraded

    SQOOP-1740: Sqoop2:The sqoop.properties should say driver.autoupgrade

    SQOOP-1747: Sqoop2: Provide more information for Kerberos initialization exception

    SQOOP-1748: Sqoop2: Client throws NPE when misconfigured for Kerberos

    SQOOP-1773: Sqoop2: ClassAvailable validator null handling

    SQOOP-1774: Sqoop2: Allow anonymous authentication

    SQOOP-1775: Sqoop2: Migrate to URL parameter user.name instead of using header

    SQOOP-1777: Sqoop2: Add integration tests to Pre-Commit build

    SQOOP-1778: Sqoop2: Increase default memory allocations for tests

    SQOOP-1782: Sqoop2: Get submissions per job

    SQOOP-1783: Sqoop2: Create derby integration upgrade tests

    SQOOP-1784: Sqoop2: Sending POST request to link or job end-point might end up with NPE

    SQOOP-1785: Sqoop2: Send driver validation results back to client when creating job

    SQOOP-1786: Sqoop2: Stop using JSONValue.parse method call

    SQOOP-1787: Sqoop2: Fix dual guava dependency warnings in maven

    SQOOP-1788: Sqoop2: Add missing version for build-helper-maven-plugin

    SQOOP-1789: Sqoop2: Add validation for partition column when using query based import

    SQOOP-1792: Sqoop2: Default to simple authentication type

    SQOOP-1806: Sqoop2: Remove the duplicate connector-config.properties file in Kite connector

    SQOOP-1812: Sqoop2: Repository upgrade issue will prevent server startup

    SQOOP-1816: Sqoop2: Add logging to the test DerbyProvider implementation

    SQOOP-1818: Sqoop2: Allow transfer between 2 schema less data sources

    SQOOP-1821: Sqoop2: External connector loading

    SQOOP-1823: Sqoop2: Fix Derby schema javadocs

    SQOOP-1827: Sqoop2: Add pattern SQOOP-XYZ-vX.patch to our pre-commit hook

    SQOOP-1830: GenericJdBcExtractor does not create java date objects when extracting

    SQOOP-1831: Sqoop2: Log filenames of detected Mapreduce files in HdfsUtils

    SQOOP-1832: Sqoop2: Enforce that integration test working directory is always in target/ directory

    SQOOP-1833: Sqoop2: Add elapsed time information to pre-commit hook

    SQOOP-1836: Sqoop2: Convert the List in Schema Columns to Array for better lookup time

    SQOOP-1837: Sqoop2: Verify that executing job has been successful in ConnectorTestCase

    SQOOP-1838: Sqoop2: While running Integration tests in IDE ( we get Derby Start Error)

    SQOOP-1839: Sqoop2: Mapreduce submission record should propogate failure info as well

    SQOOP-1840: Sqoop2: Guard test DerbyProvider from infinite waits in Derby implementation

    SQOOP-1843: Sqoop2: Fix anonymous configuration bug

    SQOOP-1844: Sqoop2: Start Derby server in DerbyProvider on random port

    SQOOP-1847: Sqoop2: Move rat configuration from special execution to the main execution

    SQOOP-1850: Sqoop2: DerbyProvider retry ping

    SQOOP-1857: Sqoop2: Add rat check to pre-commit hook

    SQOOP-1858: Sqoop2: Print out warnings from git apply on output of precommit hook

    SQOOP-1861: Sqoop2: ResourceRequest clobbers uncaught server exceptions

    SQOOP-1862:  Sqoop2: JDBC Connector To side needs to handle converting JODA objects to sql date 

    SQOOP-1871: Sqoop2: Upgrade to Hadoop 2.6.0

    SQOOP-1872: IDF API should expose a method to add dependent jars

    SQOOP-1874: Sqoop2: ConfigurableError should be in the configurable package

    SQOOP-1875: Sqoop2: Sync MSubmission with repository and add tests for the max limit handling for submission fields

    SQOOP-1882: JobManager currently ignores the TO connector IDF and assumed all IDF use String for the generic T

    SQOOP-1885: Sqoop2: KafkaConnector pom.xml needs license header

    SQOOP-1893: add license header to TestSqoopIDFUtils.

    SQOOP-1894: Sqoop2: Print out files that failed license check in pre-commit hook

    SQOOP-1895: Sqoop2: Add links to output reports to pre-commit hook

    SQOOP-1896: Upgrade the Derby repo version to 5 for 1.99.5 release

    SQOOP-1910: Sqoop2: Add test categories

    SQOOP-1911: Sqoop2: Derby1_99_4UpgradeTest is constantly failing on pre-commit hook

    SQOOP-1917: Sqoop2: &quot;show connector --all&quot; fails

    SQOOP-1927: Sqoop2: Move CSVURIValidator into validators package

    SQOOP-1929: Sqoop2: Track number of records written in Loader

    SQOOP-1934: SqoopWritable and MR engine documentation

    SQOOP-1943: Sqoop2: PreCommit should continue if license check fails

    SQOOP-1945: Sqoop2: Add table escaping to JDBC Repository

    SQOOP-1963: Generated files such as .project and .classpath files are included in source distribution 

    SQOOP-1971: Sqoop2: strURL may not be initialized when calling addDelegationToken 

    SQOOP-1972: Sqoop2: PreCommit hook have incorrect link for test reports

    SQOOP-1973: Sqoop2: Remove maven module spi completely after merging it with connector-sdk

    SQOOP-1977: Sqoop2: Pre-commit hook does not work for Python 2.6 environment

    SQOOP-1995: Sqoop2: Allow nulls only if the column for that field has IsNullable to be true 

    SQOOP-1996: Sqoop2: Change getNullable to isNullable

    SQOOP-2018: GenericJDBCConnector SqlTypes INTEGER should be set 4 bytes

    SQOOP-2021: Sqoop2: Generic JDBC Connector extractor uses wrong nulls

    SQOOP-2022: Sqoop2: SqoopIDFUtils uses bit size instead of byteSize to check for INT/LONG/FLOAT/Double

    SQOOP-2023: GenericJDBCConnector Handling unsigned Ints is broken

    SQOOP-2027: Sqoop2: SqoopIDFUtils handling of decimal need to be fixed

    SQOOP-2029:  Sqoop2: Get jobs by connector

    SQOOP-2030: Should we allow creating a job with both from and to to id been the same

    SQOOP-2032: Command line exception message says class not found

    SQOOP-2034: Sqoop2: Clean up docstring and names in repository API

    SQOOP-2041: Sqoop2: Escape identifier names

    SQOOP-2043: Sqoop2: Server errors don&#39;t look informative enough in the client

    SQOOP-2054: Sqoop2: Client cannot understand server exceptions

    SQOOP-2077: Sqoop2: Enclose missing/extra lines in output of HdfsAsserts.assertMapreduceOutput

    SQOOP-2078: Sqoop2: Add ParametrizedUtils.toArrayOfArrays utils method

    SQOOP-2081: Sqoop2: Provide ability to dump content of testing table to log

    SQOOP-2086: Sqoop2: Use named constraints

    SQOOP-2087: Sqoop2: Named constraints should be quoted

    SQOOP-2088: Sqoop2: Rename constants for named constraints to match convention

    SQOOP-2099: Sqoop2: Postgresql&#39;s detectRepositoryVersion uses wrong casing

    SQOOP-2100: Sqoop2: Connectors documentation is malformed

    SQOOP-2109: Sqoop2: Shell module is including test dependencies when building binary artifact

    SQOOP-2116: Sqoop2: RequestContext should use user short name

  IMPROVEMENT

    SQOOP-1678: Sqoop2: [HDFS Connector] Configurable null values

    SQOOP-1727: Sqoop2: Log server initialization errors to log4j

    SQOOP-1767: Sqoop2: commands in 5 minute demo docs are out-of-sync 

    SQOOP-1869: Sqoop2: Expand schema matching to support two schemaless connectors

    SQOOP-1944: Sqoop2: No (or wrong) log message when Derby server startup/shutdown unexpectedly

    SQOOP-1966: Turn off maven&#39;s source distribution profile by default

    SQOOP-1968: Optimize schema operation in getMatchingData of NameMatcher

    SQOOP-1969: Support getColumnSize method for Schema class

    SQOOP-2006: bad smell: NPE check in SQOOP-1995 is not obvious

  NEW FEATURE

    SQOOP-1763: Sqoop2: Role Based Access Control

    SQOOP-1926: Sqoop2: Add annotations for visibilty and compatibility guarantees

  TASK

    SQOOP-1350: Sqoop2: Support all supported data types in the CSV Intermediate Data Format implementation

    SQOOP-1525: Kerberos support on Sqoop 2

    SQOOP-2033: Technical Guide of the Sqoop Server

Release 1.99.4

  NEW FEATURE

    SQOOP-777   Sqoop2: Implement intermediate data format representation policy

    SQOOP-1232  Sqoop2: Provide tooling infrastructure for Sqoop2

    SQOOP-1367  Sqoop2: From/To

  IMPROVEMENT

    SQOOP-773   Sqoop2: Batch execution support for client commands

    SQOOP-1144  Sqoop2: Add fixVersion to PreCommit branch detection

    SQOOP-1189  Sqoop2: Ensure that clone methods will correctly copy over all values from all parents

    SQOOP-1196  Sqoop2: Add support for arbitrary compression codecs

    SQOOP-1211  Sqoop2: Derby repo: Sync maximal length of versions

    SQOOP-1225  Sqoop 2 documentation for connector development

    SQOOP-1290  Sqoop2: Kill Tomcat in case that Sqoop Server fails to load

    SQOOP-1509  Sqoop2: Sqoop2 Rest API refactoring

    SQOOP-1547  Sqoop2: Connector API stabilization

    SQOOP-1557  Sqoop2: SQ_CONFIGURABLE ( for entities who own configs)

    SQOOP-1566  Sqoop2: Fix the upgrade logic for SQOOP-1498

    SQOOP-1585  Sqoop2: Prefix mapreduce classes with MR ( no functionality change)

    SQOOP-1586  Sqoop2: Rename leftovers from the SQOOP2 merge of 1367

    SQOOP-1597  Sqoop2: Refactor DerbySchemaQuery into one for create/ update/ and then CRUD operarations

    SQOOP-1620  Sqoop2: FileSystem should be configurable in HDFS connector

  BUG

    SQOOP-1208  Sqoop2: job ID column is too small

    SQOOP-1218  Sqoop2: Upgrade Hadoop 2 to GA release 2.2.0

    SQOOP-1233  Sqoop2: Remove unnecessary explicit call to MessageFormat

    SQOOP-1247  Sqoop2: Distribution module is missing dependency on Tomcat module

    SQOOP-1258  Sqoop2: FrameworkMetadataUpgrade can't handle new inputs

    SQOOP-1263  Sqoop2: Using CATALINA_HOME as CATALINA_BASE

    SQOOP-1264  Sqoop2: Remove unnecessary cd command calls from sqoop.sh

    SQOOP-1285  Sqoop2: ToolRunner is not exiting with proper exit value on error

    SQOOP-1288  Add mengwei to commiter list in our root pom.xml file

    SQOOP-1291  Sqoop2: Binary package do not have top level commands executable

    SQOOP-1296  Sqoop2: Revert SQOOP-1233

    SQOOP-1308  Sqoop2: Database export with the Generic-JDBC-Connector loses rows

    SQOOP-1320  Sqoop2: Log entire SQLExceptions chain in GenericJdbcExecutor

    SQOOP-1331  Sqoop2: Add method "findConnectors" to repository API

    SQOOP-1338  Sqoop2: Exclude intellij idea project files from git

    SQOOP-1339  Synchronize .gitignore files

    SQOOP-1354  Sqoop2: wrong maven-site-plugin version

    SQOOP-1383  Sqoop2: MSSQL Export not working

    SQOOP-1424  Sqoop2: Simplify SqoopCommand in shell package

    SQOOP-1425  Sqoop2: Improve ClassUtils to enable use of primitive types and subclasses

    SQOOP-1426  Sqoop2: ThrowableBean should correct reconstruct SqoopException

    SQOOP-1436  Sqoop2: Support custom form name via the Form Annotation

    SQOOP-1537  Sqoop2: File TestJobManager is missing proper license header

    SQOOP-1578  Sqoop2: getJars should take from and to configurations

    SQOOP-1581  Sqoop2: LoaderContext has the wrong Schema

    SQOOP-1594  Sqoop2: DestroyerContext has the wrong Schema

    SQOOP-1605  Sqoop2: Misc From/to cleanups

    SQOOP-1619  Sqoop2: Enforce Unique constraint for name on configurable table

    SQOOP-1623  Sqoop2: Derive the correct Client version for sqoop

    SQOOP-1625  Repository upgrade issue

    SQOOP-1629  Sqoop2: Add unique constraint on the Config table for name and type

    SQOOP-1636  Sqoop2: Add unique constraint to the SQI_INPUT name per type per config

    SQOOP-1639  Sqoop2: CLOB data type wrong type

    SQOOP-1641  DOC: Sqoop 5 minute demo.rst update to reflect latest in code

    SQOOP-1655  SQOOP2 DOC: Document getSchema() and its use in the connector dev guide

    SQOOP-1660  DOC: Connector SDK docs + validation to be updated

    SQOOP-1661  Sqoop2: Intermediate data format text null handling

    SQOOP-1662  Sqoop2: allowNullValueInPartitionColumn should be partitionColumnNull

    SQOOP-1664  Sqoop2: Remove the unused SqoopFileOutputFormat class

    SQOOP-1665  Sqoop2: Misc Cleanup / rename lingering connection to link

    SQOOP-1668  Sqoop2: Update existing job meets NPE ( regression from SQOOP 1510)

    SQOOP-1669  Sqoop2: JDBC connector does not understand iso8610 representation using " " as separator

    SQOOP-1671  Fix incorrect merge from SQOOP-1645

    SQOOP-1673  DOC: Update Upgrade.rst to reflect the latest in the code

    SQOOP-1674  DOC: index.rst updates for Sqoop

    SQOOP-1675  Sqoop2: Update Upgrade.rst to to address Rb comments

    SQOOP-1676  Sqoop2: clientAPI.rst changes to reflect latest code

    SQOOP-1677  DOC: CommandLineClient.rst update to reflect latest in code

    SQOOP-1679  Sqoop2: Fix inconsistent naming in shell for entity driver in sqoop2

    SQOOP-1694  Sqoop2: Fix broken Hadoop100 build

    SQOOP-1696  Sqoop2: TestMapReduce.testOutputFormat is failing on Hadoop 1 profile

    SQOOP-1697  Sqoop2: HDFS Connector TestLoader.verifyOutput have invalid default value for Hadoop 1

    SQOOP-1718  Sqoop2: CommandLineClient doc error

    SQOOP-1721  Sqoop2: common jars missing for MR job

    SQOOP-1723  Sqoop2: findJobsByConnector fails

    SQOOP-1724  Sqoop2: Support old config types for backward compatibility in connector data upgrade

    SQOOP-1725  Sqoop2: Connector upgrade in 1.99.4 fails with delete configs

    SQOOP-1728  Sqoop2: Force HDFS connector as a configurable fixes

    SQOOP-1729  Sqoop2: The existing genericJDBC connector code upgrade logic  is incomplete.

    SQOOP-1731  Sqoop2: Generic JDBC upgrade from 1.99.3 to 1.99.4

    SQOOP-1736  Sqoop2: Driver missing during upgrade

    SQOOP-1740  Sqoop2:The sqoop.properties should say driver.autoupgrade

    SQOOP-1742  Sqoop2: Add type to connectors during upgrade

  TASK

    SQOOP-1219  Sqoop2: Bump up Tomcat version to 6.0.37

    SQOOP-1220  Sqoop2: Improve default catalina.properties file to work out of the box on both Hadoop 1 and 2

    SQOOP-1234  Sqoop2: Clean up comments in MSubmission class

    SQOOP-1235  Sqoop2: Repository should be immutable by default

    SQOOP-1236  Sqoop2: Classpath generated by Submission engine should contain only unique elements

    SQOOP-1266  Sqoop2: Introduce top level commands

  SUB-TASK

    SQOOP-927   Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster

    SQOOP-1254  Sqoop2: Tool: Upgrade tool

    SQOOP-1255  Sqoop2: Tool: Dump repository content to a repository independent format

    SQOOP-1262  Sqoop2: Tool: Create user guide entry for the Tooling infrastructure

    SQOOP-1376  Sqoop2: From/To: Refactor connector interface

    SQOOP-1377  Sqoop2: From/To: Improve client/server communication

    SQOOP-1379  Sqoop2: From/To: Disable tests

    SQOOP-1380  Sqoop2: From/To: Refactor models

    SQOOP-1381  Sqoop2: From/To: Refactor submission/execution engine

    SQOOP-1444  Sqoop2: Validations: Remove all references to the original Validation infastructure

    SQOOP-1469  Sqoop2: Validations: Rename constants in Status class

    SQOOP-1499  Sqoop2: Refactor MJob to hold fromConfig, ToConfig and DriverConfig ( mandatory to create a job)

    SQOOP-1500  Sqoop2: Rename Forms to Config, Create FromConfig and ToConfig

    SQOOP-1501  Sqoop2: Refactor MConnector

    SQOOP-1503  Sqoop2: Refactor MFramework (rename to MDriver) and add MDriverConfig

    SQOOP-1504  Sqoop2: Refactor MConnection (rename to MLink)

    SQOOP-1505  Sqoop2: Rename the repository schema objects to adhere to the model objects

    SQOOP-1510  Sqoop2: Refactor JobRequestHandler for submit/abort job and SubmissionHandler for get operation only

    SQOOP-1512  Refactor ConnectionRequestHandler and add ConfigurableRequestHandler

    SQOOP-1513  Sqoop2: Refactor LinkRequestHandler

    SQOOP-1514  Refactor FrameworkRequestHandler to DriverRequestHandler

    SQOOP-1515  Sqoop2: VersionRequestHandler - fixes

    SQOOP-1517  Test CommandLineClient  to accomodate the JSON API refactoring

    SQOOP-1518  Sqoop2: Update the Rest API documentation

    SQOOP-1542  Sqoop2: From/To: MConnector should handle null forms

    SQOOP-1550  Sqoop2: Remove the indirection in MDriverConfig, let it extend the MConfig instead of has-a MConfig

    SQOOP-1551  Sqoop2: Repository Upgrader api - Extensibility

    SQOOP-1554  Sqoop2: Add NullConfigurationClass/ EmptyConfigurationClass to support use cases that do not have a particular type of config

    SQOOP-1575  Sqoop2: Validations: Migrate HDFS connector to new validators

    SQOOP-1576  Sqoop2: Validations: Migrate Repository upgrade to the new validator infrastructure

    SQOOP-1628  Sqoop2: Ensure Connector/Driver/Version only support GET method

    SQOOP-1637  Sqoop2: Validations: Update documentation with the new Validator infrastructure

    SQOOP-1645  Sqoop2: Update label text and (optional) required info for the generic jdbc connector config properties

    SQOOP-1653  Sqoop2: Link and connector handler minor fixes

    SQOOP-1686  Sqoop2: Fix the JSON names for config and config values

    SQOOP-1687  Sqoop2: Single resource in JSON should not be a list

    SQOOP-1688  Sqoop2: Fix the Validation Response JSON for configs

Release 1.99.3

  SUB-TASK

    SQOOP-659: Design metadata upgrade procedure

    SQOOP-924: Sqoop2: Devguide: Describe wire protocol

    SQOOP-945: Sqoop2: Integration: Auxiliary methods that will support export functionality

    SQOOP-994: Sqoop2: Upgrade: Add calling validation to the upgrade method

    SQOOP-996: Sqoop2: Upgrade: Create upgrade tests

    SQOOP-997: Sqoop2: Upgrade: Provide ability to disable the automatic upgrade

    SQOOP-998: Sqoop2: Upgrade: Add framework upgrader

    SQOOP-1009: Sqoop2: Integration: Create Teradata provider

    SQOOP-1014: Sqoop2: Splitter: Add Bit/Boolean based implementation

    SQOOP-1015: Sqoop2: Splitter: Add Datetime based implementation

    SQOOP-1016: Sqoop2: Splitter: Add text char implementation

    SQOOP-1022: Metadata upgrade fails with NPE getConnector method

    SQOOP-1023: STMT_DELETE_FORMS_FOR_CONNECTOR query in DerbySchemaSquery looks for incorrect column

    SQOOP-1024: GenericJdbcConnectorUpgrader must ignore inputs which may not exist in old version

    SQOOP-1025: Sqoop metadata upgrade must set job id in the new job being created

    SQOOP-1077: Sqoop2: Integration: Create Netezza provider

    SQOOP-1087: Sqoop2: Integration: Abstract common functionality into src module

    SQOOP-1091: Sqoop2: Submission history API - provide SqoopClient programming API

    SQOOP-1092: Sqoop2: Submission history API - provide client shell function `show submission`

    SQOOP-1101: Sqoop2: Basic schema: Provide implementation of the proposed data types

    SQOOP-1102: Sqoop2: Basic schema: Generate the schema on import in Generic JDBC Connector

    SQOOP-1103: Sqoop2: Basic schema: Provide facility transfer Schema  from server to client

    SQOOP-1114: Sqoop2: Integration: Add tests for various Generic JDBC Connector splitters

    SQOOP-1115: Sqoop2: Integration: Provide helper methods for synchronous job submission

    SQOOP-1200: Sqoop2 1.99.3 Pom files version change on release branch

    SQOOP-1201: Sqoop2: Update docs to reflect correct version on the release branch

  BUG

    SQOOP-515: Sqoop2: Datatype support

    SQOOP-827: Sqoop2: MMapInput is null while retrieving from DB if pass empty map on write

    SQOOP-897: Sqoop2: Remove script addtowar.sh and use catalina&#39;s common.loader instead

    SQOOP-958: Sqoop2: fix version tests in Mac OS X

    SQOOP-974: Sqoop2: Add staging table support to generic jdbc export job

    SQOOP-982: Sqoop2: Allow user to pass custom parameters to catalina.sh

    SQOOP-989: Sqoop2: setenv.sh overrides value of JAVA_OPTS

    SQOOP-993: Sqoop2: Metadata upgrade

    SQOOP-995: Sqoop2: Add cloning ability to model classes

    SQOOP-1002: Sqoop2: Mapreduce local mode detection is not working correctly on Hadoop 2.x

    SQOOP-1003: Sqoop2: sqoop.sh execution error

    SQOOP-1005: Sqoop2: Update year in the notice file to 2013

    SQOOP-1019: Sqoop2: Client side caching input forms

    SQOOP-1036: Sqoop2: JobClient.getCounters can return NULL

    SQOOP-1039: Sqoop2: show version with no args should show something

    SQOOP-1040: Sqoop2: NPE in TableDisplayer

    SQOOP-1041: Sqoop2: Framework upgrade in JdbcRepository returns the outdated value

    SQOOP-1046: Sqoop2: Importing single row using decimal splitter will not import anything

    SQOOP-1048: Sqoop2: NPE when importing NULL value

    SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL

    SQOOP-1062: Misspell in &quot;isVerboose()&quot; method, it should be &quot;isVerbose()&quot;

    SQOOP-1069: Sqoop2: Incorrect error message from FrameworkValidator

    SQOOP-1070: Shell scripts should not rely on $PATH if $JAVA_HOME is set

    SQOOP-1080: Sqoop2: Investigate Jenkins test failures

    SQOOP-1081: destroy() method of ConnectorManager has not been implemented yet.

    SQOOP-1082: Implement pre-commit testing with Jenkins

    SQOOP-1088: Sqoop2: Submission history API

    SQOOP-1089: Sqoop2: Accept Language header default

    SQOOP-1095: Sqoop2: PreCommit Hook have incorrect branch name

    SQOOP-1100: Sqoop2: Missing setBoolean() method for MutableContext interface

    SQOOP-1104: Sqoop2: Allow versioned patches in the PreCommit hook

    SQOOP-1105: Sqoop2: Remove our implementation of StringUtils

    SQOOP-1112: Sqoop2: Date splitter might return splits omitting some boundaries

    SQOOP-1113: Sqoop2: Text splitter will fail on interval &quot;Breezy Badger&quot;&quot; to &quot;Warty Warthog&quot;&quot;

    SQOOP-1121: Sqoop2: Serialize schema and make them available in the MR job.

    SQOOP-1123: Sqoop2: Add eclipse project metadata folder excluded from maven

    SQOOP-1128: Sqoop2: SqoopException being nested into another SqoopException in Repository

    SQOOP-1130: Sqoop2: Sqoop MapReduce Job Failed when max and min boundary are both null

    SQOOP-1131: New test added in SQOOP-1121 is using unsupported API in Hadoop 100

    SQOOP-1136: Sqoop2: MBooleanInput forget to copy persistenceId when do clone()

    SQOOP-1139: Sqoop2: JobManager.java indentation is inconsistent with rest of the codebase

    SQOOP-1145: Sqoop2: Use JSON object for serializing MAP input type

    SQOOP-1147: Sqoop2: show framework function does not behave as expected

    SQOOP-1154: Sqoop2: Text partitioner might miss or include edge values

    SQOOP-1169: Sqoop2: org.apache.sqoop.repository.schema.immutable should default to false

    SQOOP-1178: Sqoop2: get connections for connector columns out of order

    SQOOP-1180: Sqoop2: Metadata upgrade is calling validators with Model classes instead of configuration objects

    SQOOP-1205: Sqoop2: Provide upgrade guide for end users

    SQOOP-1210: Exporting data with malformed records causes sqoop2 jobs to hang until killed or they timeout

  IMPROVEMENT

    SQOOP-675: Sqoop2: Substitute submission command with top level commands start, stop and status

    SQOOP-921: Sqoop2: Create standalone shell package

    SQOOP-943: Sqoop2: Repository wide configuration of immutable disk structures

    SQOOP-971: Sqoop2: Component reconfigurability

    SQOOP-973: Sqoop2: Merge host, port and app to single server URL in Sqoop shell

    SQOOP-983: Sqoop2: Document client synchronous mode

    SQOOP-984: Sqoop2: Improve user experience on synchronous job submission

    SQOOP-985: Sqoop2: Introduce synchronous job submission to Client API

    SQOOP-990: Sqoop2: Allow users to override Sqoop2&#39;s default http port and admin port

    SQOOP-1012: Sqoop2: Generic JDBC Connector should have one static instance of validator

    SQOOP-1017: Sqoop2: Split FrameworkManager into two classes

    SQOOP-1028: Remove poll timeout parameter from Sqoop shell synchronous submission

    SQOOP-1042: Sqoop2: Name constraints in Derby repository

    SQOOP-1043: Sqoop2: Improve error messages in Derby repository

    SQOOP-1044: Sqoop2: Improve logging in metadata upgrade methods

    SQOOP-1059: Sqoop2: Remove ad hoc modle cloning methods in common module

    SQOOP-1060: Sqoop2: Increase maximal size of custom query in Generic JDBC Connector

    SQOOP-1065: Sqoop2: Remove special lock object in FrameworkManager

    SQOOP-1067: Sqoop2: Tests should not use /tmp/ directory for storing data

    SQOOP-1073: Sqoop2: Introduce schema for transferred data

    SQOOP-1075: Sqoop2: Persist Framework metadata version in repository

    SQOOP-1111: Sqoop2: Implement version detection and structure updates into Derby repository

    SQOOP-1141: Sqoop2: Provide ability to enable/disable connections and jobs

    SQOOP-1142: Sqoop2: Provide creater and last edited by to metadata structures

    SQOOP-1143: Sqoop2: Provide server audit log for operations upon metadata structures

    SQOOP-1182: Expose compression options for Sqoop2 import

    SQOOP-1183: Sqoop2: Add getConnector(String) to the client API

    SQOOP-1184: Sqoop2: Improve error messages during metadata upgrade

  NEW FEATURE

    SQOOP-663: Sqoop2: Introduce connector SDK

    SQOOP-1013: Sqoop2: Provide splitters for additional data types to Generic JDBC Connector

    SQOOP-1076: Sqoop2: Introduce Boolean model type

    SQOOP-1155: Sqoop 2 documentation for connector development

  TASK

    SQOOP-672: Unify logger usage across entire code base

    SQOOP-744: Sqoop2: Supply log4j configuration for generated mapreduce job

    SQOOP-745: Sqoop2: Change &quot;submit&quot; client command to &quot;submission&quot;

    SQOOP-1001: Sqoop2: Document methods for overriding server port

    SQOOP-1109: Sqoop2: Add new committers to root pom.xml file

    SQOOP-1110: Sqoop2: Precommit: Add routine to detect if patch touch test

Release 1.99.2

  SUB-TASK

    SQOOP-831: Unit test for common module

    SQOOP-861: Sqoop2: Integration: Create basic integration infrastructure

    SQOOP-882: Sqoop2 integration: Auxiliary classes for various database support

    SQOOP-896: Sqoop2: Remove PrefixContext dependency in Execution engine

    SQOOP-908: Sqoop2 integration: Create MySQL and PostgreSQL database providers

    SQOOP-909: Sqoop2 integration: Create Oracle and Microsoft SQL Server database providers

    SQOOP-925: Sqoop2: Devguide: Describe client API for embedding Sqoop client in applications

    SQOOP-930: Sqoop2: Devguide: Building and setting up developer environment

    SQOOP-939: Sqoop2: devguide: Document how to open project in Eclipse

    SQOOP-946: Sqoop2: Integration: Enhance the POC test case

    SQOOP-953: Sqoop2: Integration: Schema support

    SQOOP-987: Exclude mockito jars from being copied into the sqoop2 distribution

  BUG

    SQOOP-746: Sqoop2: Mapreduce job should have running with speculative execution disabled

    SQOOP-783: Sqoop2: Merge HdfsSequenceExportExtractor and HdfsTextExportExtractor to one Extractor

    SQOOP-799: Sqoop2: Change SqoopConnector interface to abstract class

    SQOOP-802: Sqoop2: Convert main &quot;Manager&quot; classes to singletons.

    SQOOP-811: Client shell variable substitution for recent commands

    SQOOP-812: Sqoop2: Serialization of Configuration objects to and from json is not working properly

    SQOOP-813: Sqoop2: LoaderExecutor might get into deadlock when exception is raised outside Loader itself

    SQOOP-815: Sqoop2: Get version for client requires working connection to server

    SQOOP-822: Sqoop2: Git repository revision is not fetched

    SQOOP-835: Sqoop2: Do not recreate package-info.java each compilation

    SQOOP-843: Sqoop2: Generic JDBC connector is committing transaction on export with autoCommit on

    SQOOP-844: Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions

    SQOOP-845: Sqoop2: Improve Generic JDBC validator

    SQOOP-850: Sqoop2: Move server initialization from server module to core

    SQOOP-851: Sqoop2: NullPointerException in Mapreduce Submission engine initialization

    SQOOP-852: Sqoop2: Mapreduce submission engine is not closing opened JobClient object

    SQOOP-858: Sqoop2: Add validation messages on form level

    SQOOP-865: Sqoop2: Client request cache is incorrectly setting the framework validations

    SQOOP-867: Sqoop2 client shows wrong msg

    SQOOP-868: Mismatched msg in sqoop2 client

    SQOOP-871: Connector-level job-specific prop gives wrong help msg

    SQOOP-872: sqoop2 client &#39;show framework&#39; command isn&#39;t resolving the show.prompt_framework_opts prop

    SQOOP-873: Sqoop2 build should ignore Intellij files

    SQOOP-874: Sqoop2: Provide log4j configuration for client

    SQOOP-875: Sqoop2: ClassUtils.instantiate class should not be logging on ERROR level

    SQOOP-879: Sqoop2: NPE when deleting job object that do not have associated any submissions

    SQOOP-880: Sqoop2: NPE when stopping job that was never executed

    SQOOP-881: Sqoop2: Change default port from 8080

    SQOOP-884: Sqoop2: Disable interactive client commands in batch mode

    SQOOP-887: Sqoop2: Move string constants from FormDisplayer to resource file

    SQOOP-888: Sqoop2: Move out checking of special condition token to Validator in Generic JDBC Manager

    SQOOP-889: Sqoop2: Move tomcat related properties from dist/pom.xml to root pom.xml

    SQOOP-892: Sqoop2: Validate acceptable number of mappers and reducers

    SQOOP-893: Fix job submission progress percentage

    SQOOP-894: Sqoop2: Increase counter and group size in derby repository

    SQOOP-905: Sqoop 2: Job submission shows wrong date format in client console

    SQOOP-941: Sqoop2: Do not send sensitive values from server to client

    SQOOP-942: Sqoop2: Refactore code repetition in SqoopRequests objects

    SQOOP-952: Sqoop2: Create job function requires uppercased type name

    SQOOP-966: Sqoop2: Remove placeholder class IgnoredForm

    SQOOP-980: Sqoop2: Show connection and job command hung

  IMPROVEMENT

    SQOOP-647: Provide facility to cache server responses on client side

    SQOOP-660: Improve user experience in displaying connection/job metadata

    SQOOP-678: Sqoop2: Add counters handling to map reduce submission engine

    SQOOP-682: Sqoop2: Use templating in job.etl classes

    SQOOP-723: Add possibility to have synchronous submissions in Sqoop 2

    SQOOP-750: Sqoop2: Introduce show option client command

    SQOOP-803: Sqoop2: Add gpg profile to pom file so that we can easily deploy artifacts to mvn repository

    SQOOP-806: Sqoop2: Put &quot;creation&quot; and &quot;lastUpdate&quot; date to Connection and Job objects

    SQOOP-807: Sqoop2: Verify whether job object can be safely removed prior removing

    SQOOP-814: Sqoop2: Start using configuration objects in Generic JDBC Connector

    SQOOP-826: Sqoop2: Add log4j test configuration to all maven modules

    SQOOP-833: add *.eml &quot;ant eclipse&quot; (IntelliJ import) generated file, to .gitignore

    SQOOP-841: Sqoop2: Remove final keyword from manager classes

    SQOOP-842: Sqoop2: Put partition to template in Extractor as well

    SQOOP-863: Sqoop2: Introduce ProgressThread into Extractor and Loader

    SQOOP-864: Sqoop2: Introduce ETL context objects

    SQOOP-866: Sqoop2: Introduce framework validations

    SQOOP-876: Expose the xid and cid when show status of job in sqoop2 client

    SQOOP-877: Sqoop2: Increase field size of output.outputDirectory property value from 25 to 50

    SQOOP-899: Sqoop2: Properly document REST endpoints in the server handler classes

    SQOOP-900: Sqoop2: Introduce human readable coding style for queries stored in DerbySchemaQuery

    SQOOP-919: Sqoop2: Improve Form API for simple java handling

    SQOOP-920: Sqoop2: Print out warnings in client shell for objects created with status ACCEPTABLE

    SQOOP-922: Sqoop2: Shell commands are throwing exceptions when invalid function is specified

    SQOOP-947: Sqoop2: Introduce the concept of &quot;sensitivity&quot; input to all supported metadata structures

    SQOOP-967: Sqoop2: Introduce dummy configuration key to easily identify Sqoop2 job

    SQOOP-972: Sqoop2: Load server URL from environment in shell

    SQOOP-975: Sqoop2: Port conflict problems in tomcat

    SQOOP-986: Sqoop2: Add detection of local mode to mapreduce submission engine

  NEW FEATURE

    SQOOP-643: Sqoop2: Implement simple listings for connector and job objects

    SQOOP-664: Send user name as HTTP header in client to server communication

    SQOOP-785: Sqoop2: Add splitter implementation for NUMERIC/DECIMAL type

    SQOOP-895: Sqoop2: Do not serialize framework and connector configurations into mapreduce configuration object

    SQOOP-903: Sqoop2: Add schema support to Generic JDBC Connector

    SQOOP-918: Sqoop2: Introduce client API and change Sqoop shell to use it

  TASK

    SQOOP-805: Sqoop2: Document show option function in CommandClientGuide

    SQOOP-809: Sqoop2: Remove old deprecated comments from distribution pom file

Release 1.99.1

  SUB-TASK

    SQOOP-680: Re enable unit tests for map reduce execution engine

    SQOOP-698: Document installation procedure for Sqoop 2

    SQOOP-699: Create content for User guide for Sqoop 2

    SQOOP-700: Provide examples to Sqoop 2 user guide

    SQOOP-701: Create content for Sqoop 2 Developer guide

    SQOOP-703: Move sqoop 2 documentation to top level directory in binary artefact

    SQOOP-708: Create documentation for Sqoop 2 client

    SQOOP-713: Introduce maven profiles for different Hadoop versions

    SQOOP-714: Make map reduce related code to be compatible with Hadoop 1

    SQOOP-715: Add support for Hadoop 1 to addtowar.sh script in Sqoop 2

    SQOOP-742: Put 5 minutes demo on index page in Sqoop 2 documentation

    SQOOP-753: Sqoop2: Update top level README file

    SQOOP-755: Sqoop2: Provide license file with license information for all artifacts included in binary release

    SQOOP-756: Sqoop2: Exclude junit jar from our binary artifact

    SQOOP-757: Sqoop2: Disable maven reports project wise

    SQOOP-758: Sqoop2: Generate documentation in package goal

    SQOOP-786: Sqoop2: Include jars from WAR archive in LICENSE.txt file

    SQOOP-787: Sqoop2: Provide CHANGELOG.txt file

    SQOOP-800: Sqoop2: Update NOTICE file

  BUG

    SQOOP-511: Need to set persistent id for connector if in repository already

    SQOOP-537: TestMPersistableEntity does not contain license header

    SQOOP-596: Implement connection resource end-to-end

    SQOOP-608: Implement job resource from end to end

    SQOOP-631: Sqoop2 client is not working on Mac OS X

    SQOOP-632: Sqoop 2 client help text contains link to old incubator page

    SQOOP-644: Remove DISCLAMER.txt file from branch sqoop2

    SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files

    SQOOP-655: Generic JDBC connector for export

    SQOOP-671: Mapreduce counters are not used in generated mapreduce jobs

    SQOOP-673: Mapreduce submission manager should not call update() on finished submissions

    SQOOP-674: Sqoop2: Exceptions in special map reduce threads can cause mapreduce job to freeze

    SQOOP-686: Empty job name will result in NPE during job submission

    SQOOP-688: Add netbeans files to gitignore and rat

    SQOOP-690: Fix threading issues in SqoopOutputFormatLoadExecutor

    SQOOP-692: Move execution specific error codes from CoreError to it&#39;s own error codes class

    SQOOP-693: Intermediate data format support for export

    SQOOP-695: Change default host on client to &quot;localhost&quot;

    SQOOP-696: Client command submission status will finish gracefully when executed for non existing job

    SQOOP-702: Refactor OutputLoadExecutor

    SQOOP-705: Framework-defined text/sequence partitioner/extractor for HDFS

    SQOOP-707: Update developer list in Sqoop 2 pom file

    SQOOP-710: Remove dependency on unreleased commons-cli 1.3 from Sqoop 2 client

    SQOOP-727: We should use more strict regular expressions in addtowar.sh script

    SQOOP-728: Increase varchar limits for external link and exceptions in Derby repository

    SQOOP-729: SubmissionDisplayer should display Stack Trace only in Verbose mode

    SQOOP-738: Sqoop is not importing all data in Sqoop 2

    SQOOP-759: Sqoop2: Loading client resource file is failing on ResourceBundle not found exception

    SQOOP-760: Sqoop2: Fix invalid \h escape sequence in client resource file

    SQOOP-761: HDFSTextExportExtractor loses lines around partition boundaries

    SQOOP-764: Sqoop2: Fix typo in client resource file &quot;prompt.conn_id&quot;

    SQOOP-765: Sqoop2: JDBC repository is incorrectly checking if job exists in update handler

    SQOOP-766: Sqoop2: Fix client resources

    SQOOP-768: Sqoop2: Compilation on hadoop profile 100 will fail

    SQOOP-770: Sqoop2: executable scripts in binary distribution tarball are not executable

    SQOOP-771: Sqoop2: Improve addtowar.sh

    SQOOP-772: OutOfMemory from document generation

    SQOOP-774: Sqoop2: exception is thrown when creating a connection object if connectionString starts with an empty space

    SQOOP-775: Sqoop2: addtowar.sh script is silently ignoring unknown arguments

    SQOOP-778: Remove empty SqoopUserGuide and SqoopDeveloperGuide

    SQOOP-779: Sqoop2: NPE when JobConnectorContext has a null value

    SQOOP-780: Sqoop2: GENERIC_JDBC_CONNECTOR_0011:The type is not supported - 2

    SQOOP-781: Sqoop2: Improve logging in GenericJdbcImportInitializer

    SQOOP-782: Update comment to reflect that TestHdfsExtract works fine.

    SQOOP-784: Sqoop2: Creating job for connection with id &gt; 1 will results in NullPointerException

    SQOOP-788: Sqoop2: Import sometimes duplicate some data

    SQOOP-789: Fix Hadoop-1 build

    SQOOP-790: Remove flakiness from TestSqoopOutputformatLoadExecutor

  IMPROVEMENT

    SQOOP-306: Move to a maven build

    SQOOP-347: Pull versions into properties in the pom.xml

    SQOOP-507: Update dist/pom.xml so that maven doesn&#39;t download tomcat every time

    SQOOP-525: Enable dist package build by default

    SQOOP-534: Add ability to find out if MPersistableEntity do already have persistent ID

    SQOOP-545: Add IntelliJ IDEA files to RAT exclude

    SQOOP-567: Support connection validation in JDBC repository

    SQOOP-568: Configuration reload period should be configurable in PropertiesConfigurationProvider

    SQOOP-573: Do not change working directory for client

    SQOOP-581: Client should be sending used locale back to sqoop server to retrieve locale aware data

    SQOOP-590: Switch Sqoop 2 to Apache Tomcat 6 For Better Integration With Apache Bigtop

    SQOOP-612: Provide unit tests for derby metadata repository

    SQOOP-618: Remove most important FindBugs warnings and errors in Sqoop 2

    SQOOP-619: Display user persistent id of newly created connection and job objects

    SQOOP-620: Introduce name to connection and job objects

    SQOOP-625: Enforce checking advertised maximal size for MStringInput

    SQOOP-629: Provide better exception handling during server-client communication

    SQOOP-630: Check if connection/job is in use before deleting as deleting used entity might result in FK violations

    SQOOP-642: Provide resource reading for both interactive and batch mode processing

    SQOOP-645: Separate job engine to separate maven module

    SQOOP-646: Provide support for &quot;set&quot; metadata in Sqoop 2

    SQOOP-648: Move all string message in client to resource file for easy translation

    SQOOP-662: Introduce pluggable configuration objects

    SQOOP-667: We should persist in repository all properties of MSubmission metadata class

    SQOOP-676: Add lastUpdateDate to MSubmission

    SQOOP-677: Destroyer needs to be called from OutputCommitter

    SQOOP-679: Wrap exception to MSubmission metadata object

    SQOOP-681: Split configuration in Generic JDBC connector between job and connection

    SQOOP-684: Encode type of the job into executed map reduce job

    SQOOP-694: Introduce client &quot;verbose&quot; mode

    SQOOP-704: Exclude patches from RAT checks in Sqoop2

    SQOOP-719: Improve user experience with addtowar.sh script in Sqoop 2

    SQOOP-722: Improve Sqoop 2 packaging

    SQOOP-734: Change ConnectorBean to send JSON objects rather than sets of arrays

    SQOOP-735: Introduce output format option to Sqoop 2 import

    SQOOP-737: Give user option to set number of extractors and loaders

    SQOOP-762: Sqoop2: Improve logging in mapreduce execution engine

    SQOOP-776: Sqoop2: show connection command shows password in plain text

  NEW FEATURE

    SQOOP-531: Define connector execution lifecycle

    SQOOP-532: Define intefaces for connector-defined execution classes

    SQOOP-533: Intermediate data format support for import

    SQOOP-588: MapReduce infrastructure for executing ETL framework

    SQOOP-589: Framework-defined text/sequence loaders for HDFS

    SQOOP-605: Generic JDBC connector for import

    SQOOP-610: Job submission engine for import

    SQOOP-613: Add support for integer type to metadata model

    SQOOP-614: Provide client side ability to clone connection or job object

    SQOOP-623: Add support for loading Map inputs in Sqoop2

    SQOOP-624: Add test coverage plugin to root pom file

    SQOOP-627: Convert forms structures on connector level to configuration classes

    SQOOP-656: End to end submission engine

    SQOOP-658: Solve hadoop dependency distribution/loading on server side

    SQOOP-666: Introduce execution engine

    SQOOP-712: Add support of Hadoop 1.x to Sqoop 2

    SQOOP-716: Create server notification REST callback to get information if job has update

    SQOOP-739: Connectors in Sqoop 2 should be versionable

    SQOOP-740: Provide export submission engine implementation for Sqoop 2

  TASK

    SQOOP-491: Create configuration directory with documented configuration files under Sqoop2.

    SQOOP-492: Implement a documentation system for Sqoop2

    SQOOP-493: Distribution build for Sqoop2 should contain sources

    SQOOP-494: Create client infrastructure to allow interactive selection of options of a command.

    SQOOP-495: Support for parameter substitution in the client shell.

    SQOOP-496: Refine the interface for Connector and Repository to support connection metadata

    SQOOP-497: Enhance repository interface to support Connection CRUD

    SQOOP-501: Infrastructure to support input of sensitive information like passwords in the client shell

    SQOOP-502: Implement show connector command end-to-end

    SQOOP-512: Intermediate data representation

    SQOOP-514: Layout changes for Sqoop 2 distribution

    SQOOP-544: Split job metadata for different job types (import, export)

    SQOOP-576: Implement command &quot;show framework&quot; end to end

    SQOOP-577: Design storage in derby repository for connect and job metadata

    SQOOP-584: Create facility to validate user supplied connection and job forms

    SQOOP-697: Put together documentation for Sqoop 2

    SQOOP-733: Remove unnecessary version repetition in Sqoop 2 pom files

    SQOOP-747: Sqoop 1.99.1 release preparation