| Release 1.99.7 |
| |
| SUB-TASK |
| |
| SQOOP-926: Sqoop2: Devguide: Connector developer guide |
| |
| SQOOP-1116: Sqoop2: Devguide: Upgrade connectors from sqoop1 to sqoop2 |
| |
| SQOOP-1256: Sqoop2: Tool: Load repository dump into a different repository |
| |
| SQOOP-1758: Sqoop2: HDFS connector documentation |
| |
| SQOOP-1766: Sqoop2: Add Kite Connector Usage into User Manual |
| |
| SQOOP-1803: Sqoop2: Update and save configuration upon job success |
| |
| SQOOP-1853: Sqoop2: Kafka connector supporting FROM direction |
| |
| SQOOP-1951: Sqoop2: Load Kafka at beginning of suite |
| |
| SQOOP-1952: Sqoop2: Load miniclusters at beginning of integration tests |
| |
| SQOOP-1953: Sqoop2: Tomcat at beginning of Suite |
| |
| SQOOP-1954: Sqoop2: Load derby at beginning of integration tests |
| |
| SQOOP-2126: Sqoop2: Implement FTP TO Connector Support |
| |
| SQOOP-2217: Sqoop2: Implement SFTP To Connector Support |
| |
| SQOOP-2244: Sqoop2: Generic JDBC: Automatically escape table and column names from configuration objects |
| |
| SQOOP-2287: Sqoop2: Create TO direction documentation |
| |
| SQOOP-2306: Sqoop2: Use LinkConfiguration in Executor rather then LinkConfig |
| |
| SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests |
| |
| SQOOP-2365: Sqoop2: Create annotation and base class |
| |
| SQOOP-2366: Sqoop2: Create infrastructure providers for hadoop, tomcat, and database providers |
| |
| SQOOP-2378: Sqoop2: Revoke all privileges command |
| |
| SQOOP-2379: Sqoop2: Check whether resource exists before run privilege check |
| |
| SQOOP-2426: Sqoop2: Precommit: Provide maven profile that will run all tests for precomit hook at once |
| |
| SQOOP-2427: Sqoop2: Precommit: Use the precommit maven profile to run tests |
| |
| SQOOP-2428: Sqoop2: Precommit: Print actions in order they've been executed |
| |
| SQOOP-2429: Sqoop2: Precommit: Add parameter --run-integration-tests |
| |
| SQOOP-2430: Sqoop2: Precommit: Add test coverage reports |
| |
| SQOOP-2434: Sqoop2: Partition support for Kafka connector (FROM direction) |
| |
| SQOOP-2435: Sqoop2: Incremental/offset support for Kafka connector (FROM direction) |
| |
| SQOOP-2441: Sqoop2: Generic JDBC: Drop support for specifying custom query when exporting data |
| |
| SQOOP-2442: Sqoop2: Generic JDBC: Drop tests for specifying schema name and custom SQL at the same time |
| |
| SQOOP-2443: Sqoop2: Generic JDBC: Properly detect compound primary keys in GenericJdbcExecutor |
| |
| SQOOP-2445: Sqoop2: Generic JDBC: Prevent use of tableColumns and sql at the same time |
| |
| SQOOP-2447: Sqoop2: Precommit: Improve cobertura test coverage reporting |
| |
| SQOOP-2449: Sqoop2: Findbugs: Fix smaller-ish warnings in common module |
| |
| SQOOP-2450: Sqoop2: Precommit: Introduce findbugs checks |
| |
| SQOOP-2451: Sqoop2: Findbugs: Add explicit charset to client ResourceRequest class |
| |
| SQOOP-2452: Sqoop2: Findbugs: Convert anonymous class in ResourceRequest to static inner class |
| |
| SQOOP-2458: Sqoop2: Precommit: Stop copying test results directly inside the pre-commit hook |
| |
| SQOOP-2459: Sqoop2: Precommit: Do not wipe out working directory on finish |
| |
| SQOOP-2460: Sqoop2: Refactor repository-common to use methods |
| |
| SQOOP-2461: Sqoop2: Add MySQL support for the metadata repository |
| |
| SQOOP-2469: Sqoop2: Custom HTTP requests test base class |
| |
| SQOOP-2473: "Modify" is misspelled in pre-commit hook |
| |
| SQOOP-2479: Sqoop2: Pass configuration objects to Intermediate Data Format |
| |
| SQOOP-2483: Sqoop2: Findbugs: Fix singleton class problem in AuthenticationManager and AuthorizationManager |
| |
| SQOOP-2484: Sqoop2: Findbugs: Fix resource leak problem in SqoopConfiguration and ConnectorManagerUtils |
| |
| SQOOP-2485: Sqoop2: Findbugs: Fix smaller-ish warnings in core module |
| |
| SQOOP-2486: Sqoop2: Findbugs: bug fix for MapContext |
| |
| SQOOP-2491: Sqoop2: Common external JAR handling in configuration |
| |
| SQOOP-2499: Sqoop2: Findbugs: Fix the problem of URF_UNREAD_PUBLIC_OR_PROTECTED_FIELD for ExampleValue |
| |
| SQOOP-2500: Sqoop2: Findbugs: Fix the resource leak problem in ProviderAsserts and DatabaseProvider |
| |
| SQOOP-2501: Sqoop2: Findbugs: Fix smaller-ish warnings in common-test module |
| |
| SQOOP-2506: Sqoop2: Generic JDBC: Remove duplicate code to create schema from result set metadata |
| |
| SQOOP-2507: Sqoop2: Do not use default Tomcat handlers for unsupported HTTP methods |
| |
| SQOOP-2508: Sqoop2: Findbugs: Fix warnings in connector-sdk module |
| |
| SQOOP-2509: Sqoop2: Findbugs: Fix resource leak problem in GenericJdbcExecutor and related classes |
| |
| SQOOP-2511: Sqoop2: Findbugs: Fix warnings in connector-generic-jdbc module |
| |
| SQOOP-2512: Sqoop2: Findbugs: Fix warnings in connector-ftp, connector-sftp and connector-hdfs module |
| |
| SQOOP-2514: Sqoop2: Findbugs: Fix security problems in ConfigUtils |
| |
| SQOOP-2515: Sqoop2: Findbugs: Fix warning in common module |
| |
| SQOOP-2516: Sqoop2: Findbugs: Fix warning in execution module |
| |
| SQOOP-2517: Sqoop2: Findbugs: Fix resource leak problem in CommonRepositoryHandler |
| |
| SQOOP-2518: Sqoop2: Findbugs: Fix warning in repository-derby module |
| |
| SQOOP-2519: Sqoop2: Findbugs: Fix warning in repository-postgresql module |
| |
| SQOOP-2521: Sqoop2: Findbugs: Fix warning in repository-mysql module |
| |
| SQOOP-2522: Sqoop2: Findbugs: Fix warning in security module |
| |
| SQOOP-2523: Sqoop2: Findbugs: Fix warning in server module |
| |
| SQOOP-2526: Sqoop2: findbugs: Fix warning in shell module |
| |
| SQOOP-2527: Sqoop2: findbugs: Fix warning in submission module |
| |
| SQOOP-2528: Sqoop2: findbugs: Fix warning in test module |
| |
| SQOOP-2529: Sqoop2: findbugs: Fix warning in tools module |
| |
| SQOOP-2530: Sqoop2: Add utility methods to get object name from object id |
| |
| SQOOP-2532: Sqoop2: Findbugs: Fix SIC_INNER_SHOULD_BE_STATIC_ANON problem in ConfigValidationRunner |
| |
| SQOOP-2533: Sqoop2: Findbugs: Fix warning for ConfigurableServlet |
| |
| SQOOP-2537: Sqoop2: Use object name instead of object id for the name filed in MResource |
| |
| SQOOP-2539: Sqoop2: Enforce resource name not null when creating table |
| |
| SQOOP-2541: Sqoop2: Provide test infrastructure base class for upgrade tests |
| |
| SQOOP-2542: Sqoop2: Provide test infrastructure base class for connector tests |
| |
| SQOOP-2544: Sqoop2: Drop connectors servlet |
| |
| SQOOP-2545: Sqoop2: RESTiliency: Provide tests for non-existing end points |
| |
| SQOOP-2546: Sqoop2: RESTiliency: Unify behavior on getting details on non-existing connector |
| |
| SQOOP-2547: Sqoop2: RESTiliency: Provide REST tests for v1/connector servlet |
| |
| SQOOP-2548: Sqoop2: RESTiliency: Enforce strict connector names |
| |
| SQOOP-2550: Sqoop2: Findbugs: Add filter for the warning SQL_NONCONSTANT_STRING_PASSED_TO_EXECUTE and SQL_PREPARED_STATEMENT_GENERATED_FROM_NONCONSTANT_STRING |
| |
| SQOOP-2553: Sqoop2: Jetty: Update testcases using Jetty instead of Tomcat |
| |
| SQOOP-2555: Sqoop2: Findbugs: Add filter for the unnecessary warning |
| |
| SQOOP-2557: Sqoop2: Findbugs: move findbug dependency to the root pom.xml |
| |
| SQOOP-2558: Sqoop2: Jetty: Updaet sqoop-server, package with jar, remove war |
| |
| SQOOP-2560: Sqoop2: Jetty: Create new class for Jetty server |
| |
| SQOOP-2563: Sqoop2: Jetty: Update script for Jetty server |
| |
| SQOOP-2565: Sqoop2: Jetty: Update package for sqoop |
| |
| SQOOP-2573: Sqoop2: Use object name instead of object id for job, link and connector in Sqoop 2 server |
| |
| SQOOP-2577: Sqoop2: Support loading classes using custom classloader in ClassUtils |
| |
| SQOOP-2578: Sqoop2: Port the ApplicationClassLoader in Hadoop into Sqoop |
| |
| SQOOP-2580: Sqoop2: Jetty: Update the initialization for Sqoop server |
| |
| SQOOP-2581: Sqoop2: Drop the jobId parameter in JobManager |
| |
| SQOOP-2583: Sqoop2: Encode object name in the http request |
| |
| SQOOP-2621: Sqoop2: Provide classpath isolation for Connectors |
| |
| SQOOP-2622: Sqoop2: Add documentation about connector classpath isolation |
| |
| SQOOP-2623: Sqoop2: Add documentation about connector classpath isolation |
| |
| SQOOP-2626: Sqoop2: Provide test for CreateCommand |
| |
| SQOOP-2630: Sqoop2: Provide tests for all SqoopCommand |
| |
| SQOOP-2631: Sqoop2: Add tests for shell commands in interactive mode |
| |
| SQOOP-2632: Sqoop2: add partition class to FROM |
| |
| SQOOP-2633: Sqoop2: Allow to specify extra system classes for ConnectorClassLoader |
| |
| SQOOP-2634: Sqoop2: Provide classpath isolation for connectors and its dependencies |
| |
| SQOOP-2635: Sqoop2: Improve ConnectorClassLoader to support loading classes from the dependencies inside the connector jar |
| |
| SQOOP-2636: Sqoop2: Provide connector classpath isolation during running MR job |
| |
| SQOOP-2637: Sqoop2: Provide connector classpath isolation during running MR job |
| |
| SQOOP-2638: Sqoop2: Add integration tests for connector classpath isolation |
| |
| SQOOP-2648: Sqoop2: Add tests for ConfigFiller |
| |
| SQOOP-2653: Sqoop2: Separate each connector documentation to it's own page |
| |
| SQOOP-2660: Sqoop2: Generic JDBC: Convert input Columns from String to List |
| |
| SQOOP-2662: Sqoop2: Remove unnecessary dependencies of sqoop server module |
| |
| SQOOP-2668: Sqoop2: Doc: Build documentation only in binary profile |
| |
| SQOOP-2669: Sqoop2: Drop Links and Jobs servlet |
| |
| SQOOP-2670: Sqoop2: RESTiliency: Allow getting links by connector only for all |
| |
| SQOOP-2671: Sqoop2: Add client call to get all links by a connector |
| |
| SQOOP-2673: Sqoop2: Remove the notion of LinksBeans and JobsBeans |
| |
| SQOOP-2675: Sqoop2: Remove the id from public interface for Job |
| |
| SQOOP-2677: Sqoop2: RESTiliency: Refactore the one line try-catch statement in InvalidRESTTest |
| |
| SQOOP-2678: Sqoop2: Remove the id from public interface for Link |
| |
| SQOOP-2680: Sqoop2: Remove the id from public interface for connection |
| |
| SQOOP-2682: Sqoop2: Add test cases for the object name with special char |
| |
| SQOOP-2683: Sqoop2: Doc: Update "Installing dependencies" section in Installation guide |
| |
| SQOOP-2685: Sqoop2: Doc: Document need for sqoop2 user to be allowed to impersonate other users |
| |
| SQOOP-2688: Sqoop2: Provide utility method to safely retrieve value from JSONObject |
| |
| SQOOP-2689: Sqoop2: RESTiliency: InvalidRESTCallsTest is using wrong order when serializing data to request |
| |
| SQOOP-2690: Sqoop2: Use connector name in MLink. |
| |
| SQOOP-2691: Sqoop2: Use maven shade plugin to package connector dependencies with the connector jar itself |
| |
| SQOOP-2692: Sqoop2: Use link name in shell |
| |
| SQOOP-2694: Sqoop2: Doc: Register structure in sphinx for our docs |
| |
| SQOOP-2695: Sqoop2: Doc: Clean up git warnings for doc files |
| |
| SQOOP-2696: Sqoop2: Doc: Select final theme for the docs |
| |
| SQOOP-2697: Sqoop2: Docs: Clean up conf.py file |
| |
| SQOOP-2698: Sqoop2: RESTiliency: Split the InvalidRESTCallsTest into independent test cases |
| |
| SQOOP-2701: Sqoop2: Command "show job" doesn't work after removing support for ids: |
| |
| SQOOP-2703: Sqoop2: Use connector name in MJob |
| |
| SQOOP-2705: Sqoop2: Add kerberos support for SqoopMiniCluster |
| |
| SQOOP-2708: Sqoop2: Docs: Update Installation.rst |
| |
| SQOOP-2713: Sqoop2: Use link name in MJob |
| |
| SQOOP-2716: Sqoop2: Doc: Create special chapter about all the ways how to load jars |
| |
| SQOOP-2717: Sqoop2: Use connector name in shell |
| |
| SQOOP-2734: Sqoop2: Use job name in shell |
| |
| SQOOP-2735: Sqoop2: Use job name in MSubmission |
| |
| SQOOP-2736: Sqoop2: Document change command line shell interface |
| |
| SQOOP-2739: Sqoop2: Use resource name instead of resource id in authorization engine |
| |
| SQOOP-2740: Sqoop2: Use name instead of id for ValidationResultBean |
| |
| SQOOP-2741: Sqoop2: Use name instead of id for ValidationResultBean |
| |
| SQOOP-2742: Sqoop2: Clear useless method after remove id from public interface |
| |
| SQOOP-2743: Sqoop2: Update RepositoryLoadTool and RepositoryDumpTool |
| |
| SQOOP-2744: Sqoop2: Enable kerberos for HadoopMiniCluster |
| |
| SQOOP-2752: Sqoop2: Add impersonation support for kite hdfs |
| |
| SQOOP-2754: Sqoop2: Fix bug in integration test for Mysql and Postgresql |
| |
| SQOOP-2755: Sqoop2:Docs: Add section for examples and describe S3 import |
| |
| SQOOP-2756: Sqoop2: Add impersonation support for kite hive |
| |
| SQOOP-2757: Sqoop2: Add module connector-sdk-hadoop to hold hadoop specific SDK classes used by the connectors |
| |
| SQOOP-2761: Sqoop2: Provide test infrastructure base class for tool tests |
| |
| SQOOP-2762: Sqoop2: Provide test infrastructure base class for connector loading tests |
| |
| SQOOP-2768: Sqoop2: Remove the notion of LinksBeans |
| |
| SQOOP-2769: Sqoop2: Remove the notion of JobsBeans |
| |
| SQOOP-2770: Sqoop2: Remove the notion of ConnectorsBeans |
| |
| SQOOP-2771: Sqoop2: Remove the notion of SubmissionBean |
| |
| SQOOP-2772: Sqoop2: Remove the notion of PrincipalsBean |
| |
| SQOOP-2774: Sqoop2: Remove the notion of RolesBean |
| |
| SQOOP-2776: Sqoop2: Add web interface for thread dump |
| |
| SQOOP-2778: Sqoop2: LinkRestTest failed |
| |
| SQOOP-2782: Sqoop2: improvement SqoopInfrastructureProvider to support restart with different SqoopMiniCluster |
| |
| SQOOP-2796: Sqoop2: Add base version of the tool |
| |
| SQOOP-2799: Sqoop2: Add custom branch detection to upload-patch.py |
| |
| SQOOP-2804: Sqoop2: Document use of the script in contribution guide |
| |
| SQOOP-2805: Sqoop2: Detect if both fixVersion and affectedVersions are empty and report it |
| |
| SQOOP-2813: Sqoop2: Enable kerberos for real Hadoop cluster in the integration test |
| |
| SQOOP-2818: Sqoop2: Doc: Update broken links |
| |
| SQOOP-2822: Sqoop2: RESTiliency: Provide tests for Link POST action |
| |
| SQOOP-2823: Sqoop2: RESTiliency: Remove repetitive try-catch block for accessing POST and PUT request |
| |
| SQOOP-2826: Sqoop2: Doc: Auto-generate connector pages |
| |
| SQOOP-2827: Sqoop2: Doc: Provide doc preprocessor facilities |
| |
| SQOOP-2836: Sqoop2: Patch upload tool should detect if the JIRA number is correct |
| |
| SQOOP-2843: Sqoop2: Enable SSL/TLS for API calls |
| |
| SQOOP-2844: Sqoop2: TrustStore support for shell |
| |
| SQOOP-2845: Sqoop2: Derive keystore password from a script passed to configuration |
| |
| SQOOP-2848: Sqoop2: RESTiliency: Simplify JobRequestHandler.getJobs similarly as was done for getLinks |
| |
| SQOOP-2855: Sqoop2: Enrich Generic JDBC Connector resource file |
| |
| SQOOP-2856: Sqoop2: Enrich HDFS Connector resource file |
| |
| SQOOP-2867: Sqoop2: ResTiliency: Define one single constant for all |
| |
| SQOOP-2870: Sqoop2: RESTiliency: Add tests for DriverHandler |
| |
| SQOOP-2871: Sqoop2: Enrich FTP Connector resource file |
| |
| SQOOP-2872: Sqoop2: Enrich Kafka Connector resource file |
| |
| SQOOP-2876: Sqoop2: Document TLS support |
| |
| SQOOP-2877: Sqoop2: Enrich Kite Connector resource file |
| |
| SQOOP-2881: Sqoop2: EnrichOraOop Connector resource file |
| |
| SQOOP-2882: Sqoop2: Enrich SFTP Connector resource file |
| |
| SQOOP-2883: Sqoop2: Update model classes to represent new constant for connector resource bundles |
| |
| SQOOP-2889: Read and write from encrypted repository |
| |
| SQOOP-2890: Provide tooling to encrypt non-encrypted repository and rotate keys |
| |
| SQOOP-2891: Repository encryption documentation |
| |
| SQOOP-2900: Support encrypting map inputs with sensitive fields |
| |
| SQOOP-2954: Sanitize issues |
| |
| SQOOP-2955: Cut 1.99.7 branch |
| |
| SQOOP-2956: Update change log with 1.99.7 release |
| |
| SQOOP-2957: Update POM with new version |
| |
| SQOOP-2958: Create release candidate |
| |
| SQOOP-2959: Run vote on RC candidates |
| |
| SQOOP-2963: Update license file |
| |
| SQOOP-2965: Create release candidate for RC-1 |
| |
| SQOOP-2966: Run vote on RC candidates for RC-1 |
| |
| BUG |
| |
| SQOOP-691: Improve the way the data is written out into the FS |
| |
| SQOOP-910: Sqoop2: Move to embedded jetty from tomcat |
| |
| SQOOP-1253: Sqoop2: Implement various maintenance tools |
| |
| SQOOP-1442: Sqoop2: Validations: Serialize validations over the wire for client transfer |
| |
| SQOOP-1531: Sqoop2: Support getting connectors by Direction |
| |
| SQOOP-1690: Implement doAs for Sqoop2 |
| |
| SQOOP-1732: Sqoop2: Add version to connector upgrade API |
| |
| SQOOP-1824: Sqoop2: Create a common RDBMS table structure doc |
| |
| SQOOP-1924: Improvement features for Kerberos support on Sqoop 2 |
| |
| SQOOP-2048: SQOOP2: Improvement of Role Based Access Control |
| |
| SQOOP-2121: Sqoop2: Show job should show connection information |
| |
| SQOOP-2133: Sqoop2: Hdfs Intermediate Data Format |
| |
| SQOOP-2151: Sqoop2: Sqoop mapreduce job gets into deadlock when loader throws an exception |
| |
| SQOOP-2196: Sqoop2: Add Runner factory for Kafka |
| |
| SQOOP-2197: Add concrete DatabaseType to MySQL provider |
| |
| SQOOP-2262: Sqoop2: Create LoggerStream |
| |
| SQOOP-2269: Sqoop2: Parquet integration tests |
| |
| SQOOP-2280: Sqoop2: Handle fixed point columns |
| |
| SQOOP-2285: Sqoop2: Change POM version back to 2.0.0-SNAPSHOT |
| |
| SQOOP-2299: Sqoop2: Store context classes in repository |
| |
| SQOOP-2300: Sqoop2: DerbySchemaCreateQuery have copy&paste error with SQ_CONFIG_DIRECTIONS comment |
| |
| SQOOP-2303: EmptyTypeList when returned from DatabaseProvider class results in NPE in TestNG |
| |
| SQOOP-2305: Sqoop2: ConfigUtils is not properly serializing Enum values |
| |
| SQOOP-2318: Use hadoop configuration defaults for MapReduceSubmissionEngine |
| |
| SQOOP-2319: Sqoop2: Sqoop2-shell should take in JAVA_OPTS |
| |
| SQOOP-2320: Sqoop2: AllTypesTest should be in slow category |
| |
| SQOOP-2321: Sqoop2: Clean up FromRDBMSToHDFS test |
| |
| SQOOP-2322: Sqoop2: Kafka topic should vary on a per method basis |
| |
| SQOOP-2323: Sqoop2: Add validation for connector supported directions |
| |
| SQOOP-2342: Sqoop2: Provide an external application classloader |
| |
| SQOOP-2347: Sqoop2: Typo in code snippet in sqoop documentation |
| |
| SQOOP-2350: Sqoop2: log4j properties file should be configurable |
| |
| SQOOP-2351: Sqoop2: Connector cache should be cleared when role is deleted |
| |
| SQOOP-2352: Sqoop2: Generic JDBC Connector support for fetch size |
| |
| SQOOP-2356: Sqoop2: Derby upgrade should automatically rename jobs that have conflicting names |
| |
| SQOOP-2359: Sqoop2: Zookeeper dependency should be documented |
| |
| SQOOP-2360: Sqoop2: Upgrade should consider both directions for a single connector |
| |
| SQOOP-2369: Sqoop2: Use random port for AJP end point in TomcatSqoopMiniCluster |
| |
| SQOOP-2374: Sqoop2: Kite connector documention note on dataset URIs |
| |
| SQOOP-2380: Sqoop2: Wrong argument for show link client command |
| |
| SQOOP-2382: Sqoop2: Arithmetic exception in partitioner when allow null is true |
| |
| SQOOP-2384: SQOOP2: Remove source code from binary distribution |
| |
| SQOOP-2386: Sqoop2: refactor code in HandlerUtils |
| |
| SQOOP-2388: SQOOP2: Remove duplicate code in ConfigUtils.fromConfigs() |
| |
| SQOOP-2390: Sqoop2: FindJob will throw exception when job doesn't exist |
| |
| SQOOP-2391: Sqoop2: MySQL JDBC Driver is packaged with binary distribution |
| |
| SQOOP-2395: Sqoop2: Signature of method getConnectorIdFromIdentifier in HandlerUtils is inconsistent with other methods |
| |
| SQOOP-2396: Sqoop2: Race condition in purge/update threads on Server shutdown |
| |
| SQOOP-2397: Sqoop2: Propagate CSVWriter in Kite connector to execution engine |
| |
| SQOOP-2409: Sqoop2: Bump up Tomcat version to 6.0.37 in integration test |
| |
| SQOOP-2410: Sqoop2: Integration test report have incorrect suffix |
| |
| SQOOP-2414: Sqoop2: Change JUnit Assert class to TestNG Assert class |
| |
| SQOOP-2419: Sqoop2: Use object name instead of id if possible |
| |
| SQOOP-2422: Sqoop2: Test TestJSONIntermediateDataFormat is failing on JDK8 |
| |
| SQOOP-2424: Sqoop2: Provide custom TestNG listener in integration tests |
| |
| SQOOP-2425: Sqoop2: Improve our pre-commit hook |
| |
| SQOOP-2431: Sqoop2: Precommit: Refactore the file handling |
| |
| SQOOP-2432: Sqoop2: Update maven-site-plugin for in root pom.xml |
| |
| SQOOP-2433: Sqoop2: Add way to invoke findbugs checks from maven |
| |
| SQOOP-2436: Sqoop2: PreCommit script crashes when testing a patch that was already committed |
| |
| SQOOP-2439: Sqoop2: NullPointerException when calling job status notification URL |
| |
| SQOOP-2444: Sqoop2: Integration tests are using the same working directory |
| |
| SQOOP-2446: Sqoop2: Fix incorrect notification URL for execution engine |
| |
| SQOOP-2448: Sqoop2: Resolve findbugs warnings |
| |
| SQOOP-2454: Drop JDK6 support |
| |
| SQOOP-2462: Sqoop2: Provide List type for configuration objects |
| |
| SQOOP-2463: Sqoop2: Add support for schema-less to schema-less transfer for CSV IDF |
| |
| SQOOP-2464: Initializer object is not reused when calling getSchema |
| |
| SQOOP-2472: Sqoop2: Upgrade to newer version of cobertura maven plugin |
| |
| SQOOP-2474: Fix the problem in the integration test case Derby1_99_4UpgradeTest |
| |
| SQOOP-2476: Sqoop2: Fix failing precommit hook |
| |
| SQOOP-2477: Sqoop2: Add protection for HTTP error 404 to precommit hook |
| |
| SQOOP-2478: Sqoop2: Downgrade cobertura plugin to version 2.6 |
| |
| SQOOP-2480: Sqoop2: Provide ability to add entire Map instance to our MutableMapContext |
| |
| SQOOP-2481: Sqoop2: Precommit: Drop call to clean while running unit tests |
| |
| SQOOP-2482: Sqoop2: Precommit: Cobertura method is using wrong variable name |
| |
| SQOOP-2487: Sqoop2: ConnectorTestCase have wrong order of arguments in assertEquals |
| |
| SQOOP-2488: Sqoop2: Precommit hook is using incorrect string insertion |
| |
| SQOOP-2489: Sqoop2: Hive with Parquet in Kite Connector |
| |
| SQOOP-2492: Sqoop2: getNestedProperties() in MapContext puts key instead of value |
| |
| SQOOP-2494: Sqoop2: Improve resiliency for malformed connectors |
| |
| SQOOP-2495: Sqoop2: Provide simple test that can validate if connector is reasonably formed |
| |
| SQOOP-2496: Sqoop2: Provide a way to inject external connectors |
| |
| SQOOP-2497: Sqoop2: Do not require constructors initializing all properties in configuration objects |
| |
| SQOOP-2498: Sqoop2: Precommit: Fix formatting typo |
| |
| SQOOP-2505: Sqoop2: Add ability to specify custom configuration properties for HDFS connector |
| |
| SQOOP-2513: Sqoop2: Deadlock occurs between getJobStatus and JobManager.UpdateThread#updateSubmission |
| |
| SQOOP-2520: Sqoop2: Update documentation that JDK7+ is required now |
| |
| SQOOP-2524: Sqoop2: Add S3 support to HDFS Connector |
| |
| SQOOP-2525: Sqoop2: Add support for incremental From in HDFS Connector |
| |
| SQOOP-2538: Sqoop2: Use the table name variable instead of the table name string |
| |
| SQOOP-2540: Sqoop2: Add RepositoryProvider for MySQL |
| |
| SQOOP-2543: Sqoop2: Create sqoop mini cluster factory and provider |
| |
| SQOOP-2549: Sqoop2: Allow connector developers to mask certain keys in Maps when sending them back to clients |
| |
| SQOOP-2551: Sqoop2: Explicit encode data sent in SqoopClient with charset |
| |
| SQOOP-2554: Sqoop2: Enforce the element column in FromJobConfig of JDBC connector is a comma separated list |
| |
| SQOOP-2556: Sqoop2: Declare default constructor private for singleton classes |
| |
| SQOOP-2559: Sqoop2: Provide DateTime type for configuration objects |
| |
| SQOOP-2562: Sqoop2: Should decode the key and value in MMapInput#restoreFromUrlSafeValueString |
| |
| SQOOP-2572: MODEL_004:Usage of unsupported data type when using DateTime type |
| |
| SQOOP-2579: Sqoop2: Refactore RepositoryManager to not load structure from repository when loading jobs and links |
| |
| SQOOP-2584: Sqoop2: Fix test failure in InvalidRESTCallsTest |
| |
| SQOOP-2586: Sqoop2: Oracle DATE type error |
| |
| SQOOP-2588: Sqoop2: CommonRepositoryHandler#inUseLink only check if link is used in the from side of a job |
| |
| SQOOP-2589: Sqoop2: Tool: Introduce integration tests for the tools |
| |
| SQOOP-2590: Sqoop2: Equals operator abuse in MInputs |
| |
| SQOOP-2591: Sqoop2: Is there a better way to represent sensitive values in JSON responses from he server? |
| |
| SQOOP-2592: Sqoop2: Unit tests for serialization of sensitive inputs |
| |
| SQOOP-2593: Sqoop2: repository-mysql tests should not run when integration tests are run |
| |
| SQOOP-2598: Sqoop2: Main sqoop.log is missing log outputs from classes other then org.apache.sqoop |
| |
| SQOOP-2599: Sqoop2: Classutils behaves badly when the classpath changes. |
| |
| SQOOP-2602: Sqoop2: Static initialization of ClassUtils defaultClassloader is fragile |
| |
| SQOOP-2603: Sqoop2: Packaging script should make executables to be executable by default for everyone |
| |
| SQOOP-2604: Sqoop2: Add "run" mode to sqoop2-server script |
| |
| SQOOP-2605: Sqoop2: Allow to override location of configuration directory |
| |
| SQOOP-2606: Sqoop2: Do not reconfigure log4j if there are no log4j properties inside sqoop.properties file |
| |
| SQOOP-2608: Sqoop2: MNamedElement should inherit from MValidatedElement |
| |
| SQOOP-2611: Sqoop2: Update sqoop.properties for Sqoop extra classpath |
| |
| SQOOP-2619: Sqoop2: Provide ability to run integration tests against real Sqoop 2 server |
| |
| SQOOP-2624: Sqoop2: Provide tests for shell module |
| |
| SQOOP-2629: Sqoop2: Add ability to "blacklist" connectors |
| |
| SQOOP-2640: Not possible to enter "last value" when creating incremental job |
| |
| SQOOP-2641: SQOOP2: Fix test case failure for repository-postgresql |
| |
| SQOOP-2645: Sqoop2: Ensure that classpath loading integration tests are run by default |
| |
| SQOOP-2652: Sqoop2: Add test case for S3 incremental import to HDFS |
| |
| SQOOP-2654: Sqoop2: Fix the problem in integration test with MySql repository |
| |
| SQOOP-2655: Sqoop2: Code clean in server module |
| |
| SQOOP-2656: Sqoop2: NPE will happen in connector-loading-tests when do the slow integration test |
| |
| SQOOP-2659: Sqoop2: Do not stop services that haven't been started in our integration test suite |
| |
| SQOOP-2667: Sqoop2: Improve documentation |
| |
| SQOOP-2672: Sqoop2: Remove double dependency on mockito in shell module |
| |
| SQOOP-2679: Sqoop2: Remove junit import from TestMapContext |
| |
| SQOOP-2681: Sqoop2: Connectors failing to register |
| |
| SQOOP-2684: Sqoop2: Upgrade groovy to 2.4.0 |
| |
| SQOOP-2693: Sqoop2: Command line should let user retry Name it's invalid |
| |
| SQOOP-2699: Sqoop2: Oraoop: Improve Oracle parameters |
| |
| SQOOP-2700: Sqoop2: Tests in shell module are in infinite loop |
| |
| SQOOP-2704: Sqoop2: Provide kerberos support for integration tests |
| |
| SQOOP-2709: Sqoop2: HDFS: Impersonation on secured cluster doesn't work |
| |
| SQOOP-2710: Sqoop2: Move user from context classes to parent TransferableContext |
| |
| SQOOP-2715: Sqoop2: The test case ShowJobInOrderTest always failed |
| |
| SQOOP-2718: Sqoop2: Remove extra entry from IncrementalType enum |
| |
| SQOOP-2719: Sqoop2: Ensure the GenericJDBCConnector integration tests work against MySQL, PostgreSQL, and Oracle |
| |
| SQOOP-2720: Sqoop2: Allow the integration tests to be run against a real cluster |
| |
| SQOOP-2725: Sqoop2: Integration Tests: Prefer using Timestamp types and PreparedStatements for inserting rows into test databases |
| |
| SQOOP-2726: Sqoop2: Integration Tests: Do not use ansi_quotes mode for MySQL |
| |
| SQOOP-2727: Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions |
| |
| SQOOP-2728: Sqoop2: Avoid casting after calling getObject on ResultSet |
| |
| SQOOP-2729: Sqoop2: Integration Tests: In ShortStories.java we have a varchar(10000) column, which is too long for oracle |
| |
| SQOOP-2730: Sqoop2: Integration: Oracle does not support a boolean type, so do not use them in tests |
| |
| SQOOP-2731: Sqoop2: DisabledObjectsTest creates table that is too long for oracle |
| |
| SQOOP-2732: Sqoop2: Integration Tests: For Oracle compatibility use decimal instead of numeric sql type |
| |
| SQOOP-2733: Sqoop2: Integration Tests: Clean up mapreduce directory for IncrementalReadTest |
| |
| SQOOP-2760: Sqoop2: Fix update command with name for link and job |
| |
| SQOOP-2763: Sqoop2: Sqoop shell is accepting non existing arguments |
| |
| SQOOP-2764: Sqoop2: Sqoop shell history is no longer working |
| |
| SQOOP-2765: Sqoop2: Client is not exposing the real exception when retrieving exception from server |
| |
| SQOOP-2766: Sqoop2: Create debugging web interface for Sqoop 2 |
| |
| SQOOP-2773: Sqoop2: Ensure that the connector-sdk-hadoop jar is shipped to mappers |
| |
| SQOOP-2775: Sqoop2: mark repositorydumploadtooltest to not run on a real cluster |
| |
| SQOOP-2781: Sqoop2: Connector isolated class loader should be used when running validations |
| |
| SQOOP-2785: Sqoop2: Update developer list in pom.xml file |
| |
| SQOOP-2798: Sqoop2: Add cmd tool to automate patch upload process |
| |
| SQOOP-2800: Not able to trnasfer unicode data to Teradata |
| |
| SQOOP-2802: Sqoop2: Logging level should be debug for integration tests |
| |
| SQOOP-2811: Sqoop2: Extracting sequence files may result in duplicates |
| |
| SQOOP-2816: Sqoop2: Shell integration tests should pass when running against a real cluster |
| |
| SQOOP-2817: Sqoop2: NullValueTest fails when running against MySQL database |
| |
| SQOOP-2819: Use connector name instead of id in Repository.findJobsForConnector methods |
| |
| SQOOP-2828: Sqoop2: AvroIntermediateDataFormat should read Decimals as BigDecimals instead of Strings |
| |
| SQOOP-2829: Sqoop2: LinkRestTest should pass when run against a real cluster |
| |
| SQOOP-2831: Sqoop2: Precommit: Do not run multiple execution for integration tests |
| |
| SQOOP-2832: Sqoop2: Precommit: Create log files for individual tests |
| |
| SQOOP-2833: Sqoop2: Integration Tests: Allow setting which "time type" should be used based on the DatabaseProvider |
| |
| SQOOP-2834: Sqoop2: Integration: Limit debug log to only classes that we're interested in |
| |
| SQOOP-2849: Sqoop2: Job failure when writing parquet in hdfs with data coming from mysql |
| |
| SQOOP-2857: Sqoop2: toParquetTest fails frequently on the pre-commit hook |
| |
| SQOOP-2860: Sqoop2: Should be able to run integration tests on a real cluster without kerberos |
| |
| SQOOP-2865: Sqoop2: Increase test timeout from one hour |
| |
| SQOOP-2866: Sqoop2: Add Abe Fine to committer list in our pom file |
| |
| SQOOP-2868: Sqoop2: Introduce link and job validations |
| |
| SQOOP-2875: Sqoop2: Integration tests should on include a request body with a delete request |
| |
| SQOOP-2888: Test case ShowCommandTest is failing after SQOOP-2848 |
| |
| SQOOP-2908: Sqoop2: Increase maximal length for jdbc connection strings |
| |
| SQOOP-2914: Sqoop2: Support using password generators for repository passwords |
| |
| SQOOP-2918: Sqoop2: Increase maximum length of input names |
| |
| SQOOP-2923: Sqoop2: Reword documentation to make it clear that the api endpoints fall under /sqoop |
| |
| IMPROVEMENT |
| |
| SQOOP-736: Move loaders from execution engine to core module |
| |
| SQOOP-2329: Sqoop2: Provide integration test infrastructure base class |
| |
| SQOOP-2330: Sqoop2: 1.99.2 repository upgrade test |
| |
| SQOOP-2341: Sqoop2: Test repository infrastructure |
| |
| SQOOP-2375: Sqoop2: Add authorization component in SecurityGuide |
| |
| SQOOP-2383: SQOOP2: Add do user support in authorization engine |
| |
| SQOOP-2398: Sqoop2: Show all job with order |
| |
| SQOOP-2405: Sqoop2: Remove active wait in test cases after executeJob() call |
| |
| SQOOP-2490: Sqoop2: Add extra jars to job |
| |
| SQOOP-2595: Add Oracle connector to Sqoop 2 |
| |
| SQOOP-2610: Sqoop2: Tomcat related code should be cleanup |
| |
| SQOOP-2614: Sqoop2: Update the document for using Jetty as server |
| |
| SQOOP-2618: Sqoop2: Mask S3 sensitive properties in HDFS configuration |
| |
| SQOOP-2625: Sqoop2: Fix test case failure for repository-mysql |
| |
| SQOOP-2661: Improved sqoop extraction of Oracle 11 timestamp data type exception problem |
| |
| SQOOP-2674: Sqoop2: Remove the id from public interfaces for conection/job/link |
| |
| SQOOP-2758: Sqoop2: Add integration test for shell |
| |
| SQOOP-2786: Sqoop2: If AUTHENTICATION_KERBEROS_KEYTAB is not found in the properties throw a meaningful exception |
| |
| SQOOP-2797: Sqoop2: Add new schema object for the Blob |
| |
| SQOOP-2807: Sqoop2: Add admin user list to configuration file |
| |
| SQOOP-2814: Sqoop2: Create system wide rc file for the shell |
| |
| SQOOP-2820: Sqoop2: Encryption over the REST interface |
| |
| SQOOP-2838: Sqoop2: Add new schema object for the Clob |
| |
| SQOOP-2852: Sqoop2: Revert and re-commit SQOOP-2843: Sqoop2: Enable SSL/TLS for API calls |
| |
| SQOOP-2853: Sqoop2: Refactor TableDisplayer to be used in document generation |
| |
| SQOOP-2854: Sqoop2: Enrich connector resource files |
| |
| NEW FEATURE |
| |
| SQOOP-923: Sqoop2: Create developer guide |
| |
| SQOOP-1529: Kite Connector Support |
| |
| SQOOP-1756: Sqoop2: Specific connector documentation |
| |
| SQOOP-2574: Sqoop2: Provide classpath isolation for Connectors |
| |
| SQOOP-2615: Sqoop2: We should have a validator to test if an Integer input is within a range |
| |
| SQOOP-2788: Sqoop2: Parquet support for HdfsConnector |
| |
| SQOOP-2887: Sqoop2: Encrypt sensitive information in the repository |
| |
| SQOOP-2932: Sqoop2: Avro support for HdfsConnector |
| |
| TASK |
| |
| SQOOP-499: Sqoop2: Implement kerberos support for client shell |
| |
| SQOOP-641: Add unit tests to Sqoop 2 |
| |
| SQOOP-668: Formalize network protocol that is in use |
| |
| SQOOP-2393: Sqoop2: Add Qian Xu to developers list |
| |
| SQOOP-2394: Add Richard Zhou to the developers list |
| |
| TEST |
| |
| SQOOP-2790: Remove the duplicate test cases in shell module |
| |
| SQOOP-2808: Sqoop2: Integration tests should test rows with null values |
| |
| Release 1.99.6 |
| |
| SUB-TASK |
| |
| SQOOP-1528: Sqoop2: Kerberos support on DoAs function |
| |
| SQOOP-1757: Sqoop2: Document generic jdbc connector |
| |
| SQOOP-1961: Sqoop2: addDelegationTokens is not exposed in SqoopClient |
| |
| SQOOP-1978: Sqoop2: Command line support |
| |
| SQOOP-1979: Sqoop2: Rest API support |
| |
| SQOOP-1998: Sqoop2: Kite Connector: Hive support |
| |
| SQOOP-2016: Sqoop2: Create integration test for JDBC to Hive |
| |
| SQOOP-2019: Sqoop2: Handle post-function for updating/deleting resource |
| |
| SQOOP-2079: Sqoop2: Remove useless functions for RBAC |
| |
| SQOOP-2080: Sqoop2: Combine privileges into READ and WRITE |
| |
| SQOOP-2092: Support for LONG in MInputType |
| |
| SQOOP-2094: Sqoop2: Update RESTAPI.rst |
| |
| SQOOP-2101: Sqoop2: Add SqoopClient support to call Restful API |
| |
| SQOOP-2139: Sqoop2: Change create role API from PUT to POST |
| |
| SQOOP-2144: Sqoop2: Show command for CLI |
| |
| SQOOP-2146: Sqoop2: Sqoop client should return model objects for RBAC methods |
| |
| SQOOP-2148: Sqoop2: Fix wrong input sequence of name and type in function new Principal and Resource |
| |
| SQOOP-2160: Sqoop2: Datatypes: Provide foundation for the exhaustive type checks |
| |
| SQOOP-2166: Sqoop2: Add "Authorization Exception" error code in SecurityError.java |
| |
| SQOOP-2183: Sqoop2: Change resource type, privilege action and principal type from String to Enum. |
| |
| SQOOP-2184: Sqoop2: Add ServerName for authorization handler |
| |
| SQOOP-2198: Sqoop2: Datatypes: Add boolean/char/date support to DerbyTypeList |
| |
| SQOOP-2204: Sanitize issues |
| |
| SQOOP-2205: Cut 1.99.6 branch |
| |
| SQOOP-2206: Update change log with 1.99.6 release |
| |
| SQOOP-2207: Update POM with new version |
| |
| SQOOP-2208: Create release candidate |
| |
| SQOOP-2209: Run vote on RC candidates |
| |
| SQOOP-2210: Release artifacts |
| |
| SQOOP-2211: Finish release |
| |
| SQOOP-2212: Update website |
| |
| SQOOP-2220: Sqoop2: Fix the privilege check on job using the link id not the connector id |
| |
| SQOOP-2226: Sqoop2: Access denied in shell |
| |
| SQOOP-2227: Sqoop2: Clear connector cache in ShowConnectorFunction.java |
| |
| SQOOP-2246: Sqoop2: Use jdbcProperties when creating database connection in GenericJDBCExecutor |
| |
| SQOOP-2248: Sqoop2: ErrorCodes: Move ServerError to server module |
| |
| SQOOP-2249: Sqoop2: ErrorCodes: Move SecurityError to core module |
| |
| SQOOP-2251: Sqoop2: ErrorCodes: Move RepositoryError to core module |
| |
| SQOOP-2255: Sqoop2: Throw Exception when no permission to the resource |
| |
| SQOOP-2256: Sqoop2: Creator should have access to its entities |
| |
| SQOOP-2304: Update license file |
| |
| SQOOP-2313: Update change log with 1.99.6 release for RC-1 |
| |
| SQOOP-2314: Create release candidate for RC-1 |
| |
| SQOOP-2315: Run vote on RC candidates for RC-1 |
| |
| BUG |
| |
| SQOOP-1439: Sqoop2: Refactor validations |
| |
| SQOOP-1516: Sqoop2: Config Input as a Top Level Entity - RepositoryAPI changes |
| |
| SQOOP-1577: Sqoop2: Refactor repository dump and load tools |
| |
| SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work |
| |
| SQOOP-1738: Sqoop2: HDFS Connector : Check for output directory |
| |
| SQOOP-1746: Sqoop2: Mapreduce job is running in DEBUG mode by default |
| |
| SQOOP-1790: Sqoop2: Upgrade configs with name conflicts |
| |
| SQOOP-1808: Add Integration tests to for Incremental read / write between JDBC and HDFS |
| |
| SQOOP-1841: Sqoop2: Upgrade from 1.99.1 to 1.99.4 onwards is broken |
| |
| SQOOP-1868: Sqoop2: Document MySQL Fast Connector |
| |
| SQOOP-1949: Sqoop2: HDFS append only support |
| |
| SQOOP-2036: Sqoop2: JDBC Connector need to send BigDecimal for decimal type in Object array |
| |
| SQOOP-2089: Sqoop2: Clone configuration object instead of overwriting global |
| |
| SQOOP-2095: Sqoop2: Remove duplicate maven dependency org.mockito:mockito-all |
| |
| SQOOP-2102: Binary tarball missing executable bit on sqoop2-* files |
| |
| SQOOP-2106: Upgrade the version of Derby to 6 and Postgres to 1 in sqoop trunk |
| |
| SQOOP-2117: Sqoop2: Shell command 'show link' should show connector name |
| |
| SQOOP-2119: Sqoop2: Remove remaining imports from junit in PostgreSQL repository tests |
| |
| SQOOP-2120: Sqoop2: Test classes using powermock fails badly when compiling with java target version 1.7 |
| |
| SQOOP-2122: Sqoop2: Build documentation only in binary packaging profile |
| |
| SQOOP-2123: Sqoop2: Copy shell libraries only in binary package profile |
| |
| SQOOP-2124: Sqoop2: Pre-Commit hook should report how many tests are executed |
| |
| SQOOP-2129: Sqoop2: SQ_SUBMISSION deletes should cascade |
| |
| SQOOP-2140: Sqoop2: Cast exception when try to cast an integer to Avro's Long type |
| |
| SQOOP-2150: Sqoop2: Kite 1.0 don't allow dashes to be used in dataset names |
| |
| SQOOP-2152: Sqoop2: Kite connector always assumes that FixedPoint is long regardless of the configured size |
| |
| SQOOP-2153: Sqoop2: Ensure creation of valid Avro schema names |
| |
| SQOOP-2155: Sqoop2: KiteDatasetExecutor is not cleaning up merged datasets |
| |
| SQOOP-2156: Sqoop2: HdfsUtils.getOutputMapreduceFiles should ignore hidden files |
| |
| SQOOP-2157: Sqoop2: Kite: Add simple integration test for TO direction |
| |
| SQOOP-2158: Sqoop2: Pre-Commit hook is incorrectly counting number of executed tests |
| |
| SQOOP-2159: Sqoop2: Use BeforeSuite/AfterSuite for startHadoop/stopHadoop in integration tests |
| |
| SQOOP-2162: Sqoop2: InputEditable should be optional in JSON API |
| |
| SQOOP-2163: Sqoop2: Remove jackson dependency |
| |
| SQOOP-2167: Sqoop2: Change getUserName to getShortUserName in AuthorizationEngine.java |
| |
| SQOOP-2169: Sqoop2: Kafka integration test bug |
| |
| SQOOP-2171: Sqoop2: Incorrect basic type boxing with JDK1.7 |
| |
| SQOOP-2172: Sqoop2: Move ErrorCode's sub-class from sqoop-core to sqoop-common |
| |
| SQOOP-2188: Sqoop2: Failed to merge Kite datasets |
| |
| SQOOP-2190: Sqoop2: Remove hadoop200 profile from test-patch.py |
| |
| SQOOP-2201: Sqoop2: Add possibility to read Hadoop configuration files to HFDS connector |
| |
| SQOOP-2202: Sqoop2: Add validator to check existence of local directory on Sqoop 2 server |
| |
| SQOOP-2213: Sqoop2: toCSVFixedPoint ClassCastException |
| |
| SQOOP-2214: Sqoop2: Add ability to easily iterate over entries stored in Context |
| |
| SQOOP-2215: Sqoop2: Remember all test logs in pre-commit hook |
| |
| SQOOP-2219: Sqoop2: Skip missing input in DirectoryExistsValidator |
| |
| SQOOP-2225: Sqoop2: Shell client clobbers server exceptions |
| |
| SQOOP-2228: Sqoop2: HDFS Connector: Import data to temporary directory before moving them to target directory |
| |
| SQOOP-2229: Sqoop2: Kite connector should handle doubles |
| |
| SQOOP-2230: Sqoop2: Kite connector can use URIBuilder |
| |
| SQOOP-2231: Sqoop2: Kite connector should use authority in link configuration |
| |
| SQOOP-2232: Sqoop2: Test initializer against local filesystem |
| |
| SQOOP-2233: Sqoop2: Move TestHdfsConnector class under test directory |
| |
| SQOOP-2234: Sqoop2: Move DatasetURIValidator to Kite package as it's not generally usable validator |
| |
| SQOOP-2235: Sqoop2: Move PrefixContext back to mapreduce execution engine |
| |
| SQOOP-2236: Sqoop2: Drop outdated comment from SubmissionCallbacks class |
| |
| SQOOP-2238: Sqoop2: Parquet jars missing |
| |
| SQOOP-2239: Sqoop2: Remove Repository.updateSubmission() call from Mapreduce submission engine |
| |
| SQOOP-2240: Sqoop2: Remove Hadoop 1.x example from catalina.properties |
| |
| SQOOP-2241: Sqoop2: PreCommit hook is incorrectly counting number of executed tests |
| |
| SQOOP-2242: Sqoop2: Add support for full table names into our DatabaseProvider infrastructure |
| |
| SQOOP-2265: Sqoop2: Standardize on methods |
| |
| SQOOP-2268: Sqoop2: Fix a typo in ShowLinkFunction |
| |
| SQOOP-2273: Sqoop2: Move authorizationServlet into v1 package |
| |
| SQOOP-2276: MapReduce execution error in Sqoop job |
| |
| SQOOP-2277: Sqoop2: Add annotation for public usage classes in Sqoop Core |
| |
| SQOOP-2278: Sqoop2: Fix bug for all user could read connector |
| |
| SQOOP-2279: Sqoop2: Clean connector cache after grant and revoke statements |
| |
| SQOOP-2307: Sqoop2: Fix a typo for hdfs-connector-config.properties and kafka-connector-config.properties |
| |
| SQOOP-2308: Sqoop2: Fix a typo for hdfs-connector-config.properties and kafka-connector-config.properties |
| |
| SQOOP-2309: Sqoop2: Add to link id in show job --all command |
| |
| SQOOP-2310: Sqoop2: fix a typo for Hadoop conf directory |
| |
| SQOOP-2327: Sqoop2: Change package name from Authorization to authorization |
| |
| IMPROVEMENT |
| |
| SQOOP-1805: Sqoop2: GenericJdbcConnector: Delta read support |
| |
| SQOOP-2134: Update Kite dependency to 1.0.0 |
| |
| SQOOP-2250: Sqoop2: SQ_LINK_INPUT is missing a foreign key constraint |
| |
| TASK |
| |
| SQOOP-506: Create Sqoop integration test infrastructure. |
| |
| Release 1.99.5 |
| |
| SUB-TASK |
| |
| SQOOP-1348: Sqoop2: Remove Data class |
| |
| SQOOP-1349: Sqoop2: Use configurable writable to get Intermediate Data Format |
| |
| SQOOP-1526: Sqoop2: Kerberos support when starting service |
| |
| SQOOP-1527: Sqoop2: Kerberos support (SPNEGO) in communication between server and client |
| |
| SQOOP-1549: Simplifying the Configuration class concept in Connector api |
| |
| SQOOP-1552: Revisit if we need a config list for the link/from/to configs in connector api |
| |
| SQOOP-1588: Sqoop2: Kite connector write data to HDFS |
| |
| SQOOP-1589: Sqoop2: Create common constants, error codes, and queries |
| |
| SQOOP-1590: Sqoop2: PostgreSQL repository implementation |
| |
| SQOOP-1591: Sqoop2: PostgreSQL integration tests |
| |
| SQOOP-1592: Sqoop2: Remove Hadoop1 profile |
| |
| SQOOP-1602: Sqoop2: Fix the current balancing across Loaders internal to Sqoop |
| |
| SQOOP-1621: Sqoop2: Allow null as a dummy Schema |
| |
| SQOOP-1624: Sqoop2: Apply repository upgrader api |
| |
| SQOOP-1647: Sqoop2: Read data from HDFS in KiteConnector |
| |
| SQOOP-1651: Sqoop2: Cleanup: Naming and ordering of methods in Repo relates classes |
| |
| SQOOP-1681: DOC: Create an API doc for the Sqoop Execution engine ( since its extensible) |
| |
| SQOOP-1702: Fix typo for SQOOP-1526 |
| |
| SQOOP-1703: Sqoop2: rename Type to Column Type + size to length + minor doc fixes |
| |
| SQOOP-1706: Add IDF API doc/wiki for the IDF interface and Schema -> ColumnTypes |
| |
| SQOOP-1707: SQOOP2: Address the validate method in Column class |
| |
| SQOOP-1708: Rename Unsupported Column type to Unknown and add java doc |
| |
| SQOOP-1709: Column Type enhancements for complex types |
| |
| SQOOP-1715: Make name for column required ( fix the corr tests) |
| |
| SQOOP-1716: Add Options as a field in the Enum object ( so it can be used for validation) |
| |
| SQOOP-1717: Sqoop2: Remove Data class from docs |
| |
| SQOOP-1733: Port SQOOP-1728 to sqoop2 branch |
| |
| SQOOP-1734: Port SQOOP-1725 to sqoop2 branch |
| |
| SQOOP-1741: Port SQOOP-1736 to sqoop2 branch |
| |
| SQOOP-1749: Support List Type in CSV IDF |
| |
| SQOOP-1750: Support Map Type in CSV IDF |
| |
| SQOOP-1751: Sqoop2: Rearrange LinkConfig and ToJobConfig of Kite Connector |
| |
| SQOOP-1752: Kite connector cannot submit CSV import job |
| |
| SQOOP-1754: Sqoop2: Remove JarUtil class |
| |
| SQOOP-1755: Sqoop2: Security guide |
| |
| SQOOP-1761: Sqoop2: Unit tests for different Column sub classes Array/Set and Map types |
| |
| SQOOP-1765: Sqoop2: Time/Timestamp format support for CSV IDF |
| |
| SQOOP-1769: Fix Enum to no inherit from list |
| |
| SQOOP-1771: Investigation CSV IDF FORMAT of the Array/NestedArray/ Set/ Map in Postgres and HIVE. |
| |
| SQOOP-1776: Sqoop2: Delegation Token support for Authentication |
| |
| SQOOP-1791: Sqoop2: Add simple authentication parameters to documentation |
| |
| SQOOP-1796: Support Incremental Semantics in command line tool for Job |
| |
| SQOOP-1797: Support Incremental semantics in the REST apis |
| |
| SQOOP-1798: Support a API/ command line utility to retrieve the last value or any JOB_OUTPUT |
| |
| SQOOP-1799: Connector API : Ability for connector to indicate if its FROM and TO support incremental reading/ writing |
| |
| SQOOP-1801: Delta Fetch Merge Config API : Validations for the Delta Fetch/Merge Configs |
| |
| SQOOP-1804: Add editable and override attribute to inputs |
| |
| SQOOP-1811: Sqoop2: IDF API changes |
| |
| SQOOP-1813: Sqoop2: Add SqoopIDFUtils class and unit tests |
| |
| SQOOP-1815: Sqoop2: Date and DateTime is not encoded in Single Quotes |
| |
| SQOOP-1817: Sqoop2: Update CSVIntermediate BIT data type |
| |
| SQOOP-1819: Support Enum in CSVIDF ( + add unit tests) |
| |
| SQOOP-1825: Sqoop2: Handle NULLs for all types in CSV Intermediate Data Format |
| |
| SQOOP-1829: Sqoop2: Define IDF object model |
| |
| SQOOP-1834: Sqoop2: RBAC pluggable framework |
| |
| SQOOP-1842: Sqoop2: Fix timestamp type casting |
| |
| SQOOP-1845: Sqoop2: Make DateTime Column type support datetime with and without timezone |
| |
| SQOOP-1846: Sqoop2: DateTime support in CSV IDF and iso8601 |
| |
| SQOOP-1849: Using JODA for datetime means we only have 3 digit millisecond representation for fraction |
| |
| SQOOP-1870: Sqoop2: Merge SPI and connector-sdk packages |
| |
| SQOOP-1876: Update the submission JSON in the doc (restAPI.rst) |
| |
| SQOOP-1879: Sqoop2: Submission Engine does not set all details on SubmissionRecord in Local mode |
| |
| SQOOP-1881: Randomize ports for Kafka integration tests |
| |
| SQOOP-1897: Sqoop2: Submission Engine API change for better performance |
| |
| SQOOP-1898: Change the API of getJars to use SET than LIST to avoid duplicate jars |
| |
| SQOOP-1899: Minor change to CSVIDF to use Set instead of Lists |
| |
| SQOOP-1900: Fix the SqoopWritable read/ write method to delegate the toIDF methods |
| |
| SQOOP-1901: Sqoop2: Support DRY code in IDF impementations and add JSONIDF |
| |
| SQOOP-1902: Sqoop2: Avro IDF class and unit tests |
| |
| SQOOP-1903: Wrap up the design doc once implementation is done |
| |
| SQOOP-1908: Sqoop2: Document external connector support |
| |
| SQOOP-1909: Sqoop2: Connect security guide to main docs |
| |
| SQOOP-1913: Sqoop2: Add jackson as a dependency |
| |
| SQOOP-1915: sqoop2: parseCSV in CSVIDF doesn't correctly parse strings with commas |
| |
| SQOOP-1925: Sqoop2: Clean up duplicate constants in DerbySchemaConstants, use CommonRepoConstants |
| |
| SQOOP-1930: Sqoop2: Enforce a non empty schema name and column names |
| |
| SQOOP-1931: Tech debt : Alternative to isTest flag in the SqoopOutputFormatExecutor |
| |
| SQOOP-1935: Sqoop2: Fix TestSqoopWritable test and make getString and setString package private |
| |
| SQOOP-1936: Sqoop2: Sort by comparing IDF data in shuffle phase |
| |
| SQOOP-1937: Why need SqoopWritable, ? why not just Text? |
| |
| SQOOP-1938: DOC:update the sqoop MR engine implementation details |
| |
| SQOOP-1940: Add hashcode and equals methods to SqoopWritable |
| |
| SQOOP-1950: Sqoop2: Use TestNG |
| |
| SQOOP-1956: Sqoop2: Cleanup IDF implementations |
| |
| SQOOP-1960: Sqoop2: Share auth token across ResourceRequest in SqoopClient |
| |
| SQOOP-1962: Sqoop2: Start sqoop2 minicluster on random port |
| |
| SQOOP-1974: Sqoop2: parseCSVString in SQOOPIDFUtils add more tests |
| |
| SQOOP-1980: Sqoop2: Rule based rest API protection |
| |
| SQOOP-1981: Sqoop2: Default implementation of RBAC in Sqoop |
| |
| SQOOP-1982: Sqoop2: Provide username globally via AuthenticationProvider |
| |
| SQOOP-1984: Sqoop2: Add error summary and details to PostgreSQL repository |
| |
| SQOOP-1985: Sqoop2: On job delete cascade to submission |
| |
| SQOOP-1988: Sqoop2: isNull handling should be moved to CSVIntermediateDataFormat |
| |
| SQOOP-1991: Sqoop2: Define slow category in integration tests |
| |
| SQOOP-1994: Sqoop2: Use common repository constants |
| |
| SQOOP-2002: Sqoop2: Refactor existing security component |
| |
| SQOOP-2004: Sqoop2: Make annotations run always |
| |
| SQOOP-2012: DOC:Explain the connector project structure and relevant modules in sqoop to depend on |
| |
| SQOOP-2013: What is the story for External Connectors to write unit and integration tests? |
| |
| SQOOP-2015: Sqoop2: Create HBase code path in Kite connector |
| |
| SQOOP-2026: Sqoop2: Make getUserName function in RequestContext support Kerberos |
| |
| SQOOP-2028: add license header to TestConnectorManagerUtils |
| |
| SQOOP-2064: Sqoop2: Update POM version on new 1.99.5 branch |
| |
| SQOOP-2072: Sqoop2: Add editable and override attributes for postgres |
| |
| SQOOP-2074: Sqoop2: Add input attributes documentation |
| |
| SQOOP-2084: Sqoop2: Fix Indentation in input attributes documentation |
| |
| SQOOP-2085: Sqoop2: Null handling in AuthorizationEngine |
| |
| SQOOP-2096: Sqoop2: Fix typos in comments in SecurityConstants |
| |
| BUG |
| |
| SQOOP-1452: Sqoop2: Upgrade to Hadoop 2.5.1 |
| |
| SQOOP-1523: Sqoop2: Support for PostgreSQL database for hosting the sqoop entity repository |
| |
| SQOOP-1572: Sqoop2: Duplicate Column Name in Multiple Tables Import |
| |
| SQOOP-1604: Base/ Marker class for Config and Configuration |
| |
| SQOOP-1636: Sqoop2: Add unique constraint to the SQI_INPUT name per type per config |
| |
| SQOOP-1640: Sqoop2: Pull DatabaseProvider into sqoop-common-test module |
| |
| SQOOP-1672: Sqoop2 import inserting null strings('null') for empty values in Oracle |
| |
| SQOOP-1680: DOC: Create an Public API doc for the Sqoop repository. |
| |
| SQOOP-1695: Sqoop2: Removed hardcoded version in pom.xml of connector-sdk |
| |
| SQOOP-1705: SQOOP2: Support AVRO as a an implementation for the IDF interface |
| |
| SQOOP-1713: Sqoop2: Remove SQOOP-1348.patch file |
| |
| SQOOP-1730: Sqoop2: httpcore and httpclient version has not upgrade after hadoop upgraded |
| |
| SQOOP-1740: Sqoop2:The sqoop.properties should say driver.autoupgrade |
| |
| SQOOP-1747: Sqoop2: Provide more information for Kerberos initialization exception |
| |
| SQOOP-1748: Sqoop2: Client throws NPE when misconfigured for Kerberos |
| |
| SQOOP-1773: Sqoop2: ClassAvailable validator null handling |
| |
| SQOOP-1774: Sqoop2: Allow anonymous authentication |
| |
| SQOOP-1775: Sqoop2: Migrate to URL parameter user.name instead of using header |
| |
| SQOOP-1777: Sqoop2: Add integration tests to Pre-Commit build |
| |
| SQOOP-1778: Sqoop2: Increase default memory allocations for tests |
| |
| SQOOP-1782: Sqoop2: Get submissions per job |
| |
| SQOOP-1783: Sqoop2: Create derby integration upgrade tests |
| |
| SQOOP-1784: Sqoop2: Sending POST request to link or job end-point might end up with NPE |
| |
| SQOOP-1785: Sqoop2: Send driver validation results back to client when creating job |
| |
| SQOOP-1786: Sqoop2: Stop using JSONValue.parse method call |
| |
| SQOOP-1787: Sqoop2: Fix dual guava dependency warnings in maven |
| |
| SQOOP-1788: Sqoop2: Add missing version for build-helper-maven-plugin |
| |
| SQOOP-1789: Sqoop2: Add validation for partition column when using query based import |
| |
| SQOOP-1792: Sqoop2: Default to simple authentication type |
| |
| SQOOP-1806: Sqoop2: Remove the duplicate connector-config.properties file in Kite connector |
| |
| SQOOP-1812: Sqoop2: Repository upgrade issue will prevent server startup |
| |
| SQOOP-1816: Sqoop2: Add logging to the test DerbyProvider implementation |
| |
| SQOOP-1818: Sqoop2: Allow transfer between 2 schema less data sources |
| |
| SQOOP-1821: Sqoop2: External connector loading |
| |
| SQOOP-1823: Sqoop2: Fix Derby schema javadocs |
| |
| SQOOP-1827: Sqoop2: Add pattern SQOOP-XYZ-vX.patch to our pre-commit hook |
| |
| SQOOP-1830: GenericJdBcExtractor does not create java date objects when extracting |
| |
| SQOOP-1831: Sqoop2: Log filenames of detected Mapreduce files in HdfsUtils |
| |
| SQOOP-1832: Sqoop2: Enforce that integration test working directory is always in target/ directory |
| |
| SQOOP-1833: Sqoop2: Add elapsed time information to pre-commit hook |
| |
| SQOOP-1836: Sqoop2: Convert the List in Schema Columns to Array for better lookup time |
| |
| SQOOP-1837: Sqoop2: Verify that executing job has been successful in ConnectorTestCase |
| |
| SQOOP-1838: Sqoop2: While running Integration tests in IDE ( we get Derby Start Error) |
| |
| SQOOP-1839: Sqoop2: Mapreduce submission record should propogate failure info as well |
| |
| SQOOP-1840: Sqoop2: Guard test DerbyProvider from infinite waits in Derby implementation |
| |
| SQOOP-1843: Sqoop2: Fix anonymous configuration bug |
| |
| SQOOP-1844: Sqoop2: Start Derby server in DerbyProvider on random port |
| |
| SQOOP-1847: Sqoop2: Move rat configuration from special execution to the main execution |
| |
| SQOOP-1850: Sqoop2: DerbyProvider retry ping |
| |
| SQOOP-1857: Sqoop2: Add rat check to pre-commit hook |
| |
| SQOOP-1858: Sqoop2: Print out warnings from git apply on output of precommit hook |
| |
| SQOOP-1861: Sqoop2: ResourceRequest clobbers uncaught server exceptions |
| |
| SQOOP-1862: Sqoop2: JDBC Connector To side needs to handle converting JODA objects to sql date |
| |
| SQOOP-1871: Sqoop2: Upgrade to Hadoop 2.6.0 |
| |
| SQOOP-1872: IDF API should expose a method to add dependent jars |
| |
| SQOOP-1874: Sqoop2: ConfigurableError should be in the configurable package |
| |
| SQOOP-1875: Sqoop2: Sync MSubmission with repository and add tests for the max limit handling for submission fields |
| |
| SQOOP-1882: JobManager currently ignores the TO connector IDF and assumed all IDF use String for the generic T |
| |
| SQOOP-1885: Sqoop2: KafkaConnector pom.xml needs license header |
| |
| SQOOP-1893: add license header to TestSqoopIDFUtils. |
| |
| SQOOP-1894: Sqoop2: Print out files that failed license check in pre-commit hook |
| |
| SQOOP-1895: Sqoop2: Add links to output reports to pre-commit hook |
| |
| SQOOP-1896: Upgrade the Derby repo version to 5 for 1.99.5 release |
| |
| SQOOP-1910: Sqoop2: Add test categories |
| |
| SQOOP-1911: Sqoop2: Derby1_99_4UpgradeTest is constantly failing on pre-commit hook |
| |
| SQOOP-1917: Sqoop2: "show connector --all" fails |
| |
| SQOOP-1927: Sqoop2: Move CSVURIValidator into validators package |
| |
| SQOOP-1929: Sqoop2: Track number of records written in Loader |
| |
| SQOOP-1934: SqoopWritable and MR engine documentation |
| |
| SQOOP-1943: Sqoop2: PreCommit should continue if license check fails |
| |
| SQOOP-1945: Sqoop2: Add table escaping to JDBC Repository |
| |
| SQOOP-1963: Generated files such as .project and .classpath files are included in source distribution |
| |
| SQOOP-1971: Sqoop2: strURL may not be initialized when calling addDelegationToken |
| |
| SQOOP-1972: Sqoop2: PreCommit hook have incorrect link for test reports |
| |
| SQOOP-1973: Sqoop2: Remove maven module spi completely after merging it with connector-sdk |
| |
| SQOOP-1977: Sqoop2: Pre-commit hook does not work for Python 2.6 environment |
| |
| SQOOP-1995: Sqoop2: Allow nulls only if the column for that field has IsNullable to be true |
| |
| SQOOP-1996: Sqoop2: Change getNullable to isNullable |
| |
| SQOOP-2018: GenericJDBCConnector SqlTypes INTEGER should be set 4 bytes |
| |
| SQOOP-2021: Sqoop2: Generic JDBC Connector extractor uses wrong nulls |
| |
| SQOOP-2022: Sqoop2: SqoopIDFUtils uses bit size instead of byteSize to check for INT/LONG/FLOAT/Double |
| |
| SQOOP-2023: GenericJDBCConnector Handling unsigned Ints is broken |
| |
| SQOOP-2027: Sqoop2: SqoopIDFUtils handling of decimal need to be fixed |
| |
| SQOOP-2029: Sqoop2: Get jobs by connector |
| |
| SQOOP-2030: Should we allow creating a job with both from and to to id been the same |
| |
| SQOOP-2032: Command line exception message says class not found |
| |
| SQOOP-2034: Sqoop2: Clean up docstring and names in repository API |
| |
| SQOOP-2041: Sqoop2: Escape identifier names |
| |
| SQOOP-2043: Sqoop2: Server errors don't look informative enough in the client |
| |
| SQOOP-2054: Sqoop2: Client cannot understand server exceptions |
| |
| SQOOP-2077: Sqoop2: Enclose missing/extra lines in output of HdfsAsserts.assertMapreduceOutput |
| |
| SQOOP-2078: Sqoop2: Add ParametrizedUtils.toArrayOfArrays utils method |
| |
| SQOOP-2081: Sqoop2: Provide ability to dump content of testing table to log |
| |
| SQOOP-2086: Sqoop2: Use named constraints |
| |
| SQOOP-2087: Sqoop2: Named constraints should be quoted |
| |
| SQOOP-2088: Sqoop2: Rename constants for named constraints to match convention |
| |
| SQOOP-2099: Sqoop2: Postgresql's detectRepositoryVersion uses wrong casing |
| |
| SQOOP-2100: Sqoop2: Connectors documentation is malformed |
| |
| SQOOP-2109: Sqoop2: Shell module is including test dependencies when building binary artifact |
| |
| SQOOP-2116: Sqoop2: RequestContext should use user short name |
| |
| IMPROVEMENT |
| |
| SQOOP-1678: Sqoop2: [HDFS Connector] Configurable null values |
| |
| SQOOP-1727: Sqoop2: Log server initialization errors to log4j |
| |
| SQOOP-1767: Sqoop2: commands in 5 minute demo docs are out-of-sync |
| |
| SQOOP-1869: Sqoop2: Expand schema matching to support two schemaless connectors |
| |
| SQOOP-1944: Sqoop2: No (or wrong) log message when Derby server startup/shutdown unexpectedly |
| |
| SQOOP-1966: Turn off maven's source distribution profile by default |
| |
| SQOOP-1968: Optimize schema operation in getMatchingData of NameMatcher |
| |
| SQOOP-1969: Support getColumnSize method for Schema class |
| |
| SQOOP-2006: bad smell: NPE check in SQOOP-1995 is not obvious |
| |
| NEW FEATURE |
| |
| SQOOP-1763: Sqoop2: Role Based Access Control |
| |
| SQOOP-1926: Sqoop2: Add annotations for visibilty and compatibility guarantees |
| |
| TASK |
| |
| SQOOP-1350: Sqoop2: Support all supported data types in the CSV Intermediate Data Format implementation |
| |
| SQOOP-1525: Kerberos support on Sqoop 2 |
| |
| SQOOP-2033: Technical Guide of the Sqoop Server |
| |
| Release 1.99.4 |
| |
| NEW FEATURE |
| |
| SQOOP-777 Sqoop2: Implement intermediate data format representation policy |
| |
| SQOOP-1232 Sqoop2: Provide tooling infrastructure for Sqoop2 |
| |
| SQOOP-1367 Sqoop2: From/To |
| |
| IMPROVEMENT |
| |
| SQOOP-773 Sqoop2: Batch execution support for client commands |
| |
| SQOOP-1144 Sqoop2: Add fixVersion to PreCommit branch detection |
| |
| SQOOP-1189 Sqoop2: Ensure that clone methods will correctly copy over all values from all parents |
| |
| SQOOP-1196 Sqoop2: Add support for arbitrary compression codecs |
| |
| SQOOP-1211 Sqoop2: Derby repo: Sync maximal length of versions |
| |
| SQOOP-1225 Sqoop 2 documentation for connector development |
| |
| SQOOP-1290 Sqoop2: Kill Tomcat in case that Sqoop Server fails to load |
| |
| SQOOP-1509 Sqoop2: Sqoop2 Rest API refactoring |
| |
| SQOOP-1547 Sqoop2: Connector API stabilization |
| |
| SQOOP-1557 Sqoop2: SQ_CONFIGURABLE ( for entities who own configs) |
| |
| SQOOP-1566 Sqoop2: Fix the upgrade logic for SQOOP-1498 |
| |
| SQOOP-1585 Sqoop2: Prefix mapreduce classes with MR ( no functionality change) |
| |
| SQOOP-1586 Sqoop2: Rename leftovers from the SQOOP2 merge of 1367 |
| |
| SQOOP-1597 Sqoop2: Refactor DerbySchemaQuery into one for create/ update/ and then CRUD operarations |
| |
| SQOOP-1620 Sqoop2: FileSystem should be configurable in HDFS connector |
| |
| BUG |
| |
| SQOOP-1208 Sqoop2: job ID column is too small |
| |
| SQOOP-1218 Sqoop2: Upgrade Hadoop 2 to GA release 2.2.0 |
| |
| SQOOP-1233 Sqoop2: Remove unnecessary explicit call to MessageFormat |
| |
| SQOOP-1247 Sqoop2: Distribution module is missing dependency on Tomcat module |
| |
| SQOOP-1258 Sqoop2: FrameworkMetadataUpgrade can't handle new inputs |
| |
| SQOOP-1263 Sqoop2: Using CATALINA_HOME as CATALINA_BASE |
| |
| SQOOP-1264 Sqoop2: Remove unnecessary cd command calls from sqoop.sh |
| |
| SQOOP-1285 Sqoop2: ToolRunner is not exiting with proper exit value on error |
| |
| SQOOP-1288 Add mengwei to commiter list in our root pom.xml file |
| |
| SQOOP-1291 Sqoop2: Binary package do not have top level commands executable |
| |
| SQOOP-1296 Sqoop2: Revert SQOOP-1233 |
| |
| SQOOP-1308 Sqoop2: Database export with the Generic-JDBC-Connector loses rows |
| |
| SQOOP-1320 Sqoop2: Log entire SQLExceptions chain in GenericJdbcExecutor |
| |
| SQOOP-1331 Sqoop2: Add method "findConnectors" to repository API |
| |
| SQOOP-1338 Sqoop2: Exclude intellij idea project files from git |
| |
| SQOOP-1339 Synchronize .gitignore files |
| |
| SQOOP-1354 Sqoop2: wrong maven-site-plugin version |
| |
| SQOOP-1383 Sqoop2: MSSQL Export not working |
| |
| SQOOP-1424 Sqoop2: Simplify SqoopCommand in shell package |
| |
| SQOOP-1425 Sqoop2: Improve ClassUtils to enable use of primitive types and subclasses |
| |
| SQOOP-1426 Sqoop2: ThrowableBean should correct reconstruct SqoopException |
| |
| SQOOP-1436 Sqoop2: Support custom form name via the Form Annotation |
| |
| SQOOP-1537 Sqoop2: File TestJobManager is missing proper license header |
| |
| SQOOP-1578 Sqoop2: getJars should take from and to configurations |
| |
| SQOOP-1581 Sqoop2: LoaderContext has the wrong Schema |
| |
| SQOOP-1594 Sqoop2: DestroyerContext has the wrong Schema |
| |
| SQOOP-1605 Sqoop2: Misc From/to cleanups |
| |
| SQOOP-1619 Sqoop2: Enforce Unique constraint for name on configurable table |
| |
| SQOOP-1623 Sqoop2: Derive the correct Client version for sqoop |
| |
| SQOOP-1625 Repository upgrade issue |
| |
| SQOOP-1629 Sqoop2: Add unique constraint on the Config table for name and type |
| |
| SQOOP-1636 Sqoop2: Add unique constraint to the SQI_INPUT name per type per config |
| |
| SQOOP-1639 Sqoop2: CLOB data type wrong type |
| |
| SQOOP-1641 DOC: Sqoop 5 minute demo.rst update to reflect latest in code |
| |
| SQOOP-1655 SQOOP2 DOC: Document getSchema() and its use in the connector dev guide |
| |
| SQOOP-1660 DOC: Connector SDK docs + validation to be updated |
| |
| SQOOP-1661 Sqoop2: Intermediate data format text null handling |
| |
| SQOOP-1662 Sqoop2: allowNullValueInPartitionColumn should be partitionColumnNull |
| |
| SQOOP-1664 Sqoop2: Remove the unused SqoopFileOutputFormat class |
| |
| SQOOP-1665 Sqoop2: Misc Cleanup / rename lingering connection to link |
| |
| SQOOP-1668 Sqoop2: Update existing job meets NPE ( regression from SQOOP 1510) |
| |
| SQOOP-1669 Sqoop2: JDBC connector does not understand iso8610 representation using " " as separator |
| |
| SQOOP-1671 Fix incorrect merge from SQOOP-1645 |
| |
| SQOOP-1673 DOC: Update Upgrade.rst to reflect the latest in the code |
| |
| SQOOP-1674 DOC: index.rst updates for Sqoop |
| |
| SQOOP-1675 Sqoop2: Update Upgrade.rst to to address Rb comments |
| |
| SQOOP-1676 Sqoop2: clientAPI.rst changes to reflect latest code |
| |
| SQOOP-1677 DOC: CommandLineClient.rst update to reflect latest in code |
| |
| SQOOP-1679 Sqoop2: Fix inconsistent naming in shell for entity driver in sqoop2 |
| |
| SQOOP-1694 Sqoop2: Fix broken Hadoop100 build |
| |
| SQOOP-1696 Sqoop2: TestMapReduce.testOutputFormat is failing on Hadoop 1 profile |
| |
| SQOOP-1697 Sqoop2: HDFS Connector TestLoader.verifyOutput have invalid default value for Hadoop 1 |
| |
| SQOOP-1718 Sqoop2: CommandLineClient doc error |
| |
| SQOOP-1721 Sqoop2: common jars missing for MR job |
| |
| SQOOP-1723 Sqoop2: findJobsByConnector fails |
| |
| SQOOP-1724 Sqoop2: Support old config types for backward compatibility in connector data upgrade |
| |
| SQOOP-1725 Sqoop2: Connector upgrade in 1.99.4 fails with delete configs |
| |
| SQOOP-1728 Sqoop2: Force HDFS connector as a configurable fixes |
| |
| SQOOP-1729 Sqoop2: The existing genericJDBC connector code upgrade logic is incomplete. |
| |
| SQOOP-1731 Sqoop2: Generic JDBC upgrade from 1.99.3 to 1.99.4 |
| |
| SQOOP-1736 Sqoop2: Driver missing during upgrade |
| |
| SQOOP-1740 Sqoop2:The sqoop.properties should say driver.autoupgrade |
| |
| SQOOP-1742 Sqoop2: Add type to connectors during upgrade |
| |
| TASK |
| |
| SQOOP-1219 Sqoop2: Bump up Tomcat version to 6.0.37 |
| |
| SQOOP-1220 Sqoop2: Improve default catalina.properties file to work out of the box on both Hadoop 1 and 2 |
| |
| SQOOP-1234 Sqoop2: Clean up comments in MSubmission class |
| |
| SQOOP-1235 Sqoop2: Repository should be immutable by default |
| |
| SQOOP-1236 Sqoop2: Classpath generated by Submission engine should contain only unique elements |
| |
| SQOOP-1266 Sqoop2: Introduce top level commands |
| |
| SUB-TASK |
| |
| SQOOP-927 Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster |
| |
| SQOOP-1254 Sqoop2: Tool: Upgrade tool |
| |
| SQOOP-1255 Sqoop2: Tool: Dump repository content to a repository independent format |
| |
| SQOOP-1262 Sqoop2: Tool: Create user guide entry for the Tooling infrastructure |
| |
| SQOOP-1376 Sqoop2: From/To: Refactor connector interface |
| |
| SQOOP-1377 Sqoop2: From/To: Improve client/server communication |
| |
| SQOOP-1379 Sqoop2: From/To: Disable tests |
| |
| SQOOP-1380 Sqoop2: From/To: Refactor models |
| |
| SQOOP-1381 Sqoop2: From/To: Refactor submission/execution engine |
| |
| SQOOP-1444 Sqoop2: Validations: Remove all references to the original Validation infastructure |
| |
| SQOOP-1469 Sqoop2: Validations: Rename constants in Status class |
| |
| SQOOP-1499 Sqoop2: Refactor MJob to hold fromConfig, ToConfig and DriverConfig ( mandatory to create a job) |
| |
| SQOOP-1500 Sqoop2: Rename Forms to Config, Create FromConfig and ToConfig |
| |
| SQOOP-1501 Sqoop2: Refactor MConnector |
| |
| SQOOP-1503 Sqoop2: Refactor MFramework (rename to MDriver) and add MDriverConfig |
| |
| SQOOP-1504 Sqoop2: Refactor MConnection (rename to MLink) |
| |
| SQOOP-1505 Sqoop2: Rename the repository schema objects to adhere to the model objects |
| |
| SQOOP-1510 Sqoop2: Refactor JobRequestHandler for submit/abort job and SubmissionHandler for get operation only |
| |
| SQOOP-1512 Refactor ConnectionRequestHandler and add ConfigurableRequestHandler |
| |
| SQOOP-1513 Sqoop2: Refactor LinkRequestHandler |
| |
| SQOOP-1514 Refactor FrameworkRequestHandler to DriverRequestHandler |
| |
| SQOOP-1515 Sqoop2: VersionRequestHandler - fixes |
| |
| SQOOP-1517 Test CommandLineClient to accomodate the JSON API refactoring |
| |
| SQOOP-1518 Sqoop2: Update the Rest API documentation |
| |
| SQOOP-1542 Sqoop2: From/To: MConnector should handle null forms |
| |
| SQOOP-1550 Sqoop2: Remove the indirection in MDriverConfig, let it extend the MConfig instead of has-a MConfig |
| |
| SQOOP-1551 Sqoop2: Repository Upgrader api - Extensibility |
| |
| SQOOP-1554 Sqoop2: Add NullConfigurationClass/ EmptyConfigurationClass to support use cases that do not have a particular type of config |
| |
| SQOOP-1575 Sqoop2: Validations: Migrate HDFS connector to new validators |
| |
| SQOOP-1576 Sqoop2: Validations: Migrate Repository upgrade to the new validator infrastructure |
| |
| SQOOP-1628 Sqoop2: Ensure Connector/Driver/Version only support GET method |
| |
| SQOOP-1637 Sqoop2: Validations: Update documentation with the new Validator infrastructure |
| |
| SQOOP-1645 Sqoop2: Update label text and (optional) required info for the generic jdbc connector config properties |
| |
| SQOOP-1653 Sqoop2: Link and connector handler minor fixes |
| |
| SQOOP-1686 Sqoop2: Fix the JSON names for config and config values |
| |
| SQOOP-1687 Sqoop2: Single resource in JSON should not be a list |
| |
| SQOOP-1688 Sqoop2: Fix the Validation Response JSON for configs |
| |
| Release 1.99.3 |
| |
| SUB-TASK |
| |
| SQOOP-659: Design metadata upgrade procedure |
| |
| SQOOP-924: Sqoop2: Devguide: Describe wire protocol |
| |
| SQOOP-945: Sqoop2: Integration: Auxiliary methods that will support export functionality |
| |
| SQOOP-994: Sqoop2: Upgrade: Add calling validation to the upgrade method |
| |
| SQOOP-996: Sqoop2: Upgrade: Create upgrade tests |
| |
| SQOOP-997: Sqoop2: Upgrade: Provide ability to disable the automatic upgrade |
| |
| SQOOP-998: Sqoop2: Upgrade: Add framework upgrader |
| |
| SQOOP-1009: Sqoop2: Integration: Create Teradata provider |
| |
| SQOOP-1014: Sqoop2: Splitter: Add Bit/Boolean based implementation |
| |
| SQOOP-1015: Sqoop2: Splitter: Add Datetime based implementation |
| |
| SQOOP-1016: Sqoop2: Splitter: Add text char implementation |
| |
| SQOOP-1022: Metadata upgrade fails with NPE getConnector method |
| |
| SQOOP-1023: STMT_DELETE_FORMS_FOR_CONNECTOR query in DerbySchemaSquery looks for incorrect column |
| |
| SQOOP-1024: GenericJdbcConnectorUpgrader must ignore inputs which may not exist in old version |
| |
| SQOOP-1025: Sqoop metadata upgrade must set job id in the new job being created |
| |
| SQOOP-1077: Sqoop2: Integration: Create Netezza provider |
| |
| SQOOP-1087: Sqoop2: Integration: Abstract common functionality into src module |
| |
| SQOOP-1091: Sqoop2: Submission history API - provide SqoopClient programming API |
| |
| SQOOP-1092: Sqoop2: Submission history API - provide client shell function `show submission` |
| |
| SQOOP-1101: Sqoop2: Basic schema: Provide implementation of the proposed data types |
| |
| SQOOP-1102: Sqoop2: Basic schema: Generate the schema on import in Generic JDBC Connector |
| |
| SQOOP-1103: Sqoop2: Basic schema: Provide facility transfer Schema from server to client |
| |
| SQOOP-1114: Sqoop2: Integration: Add tests for various Generic JDBC Connector splitters |
| |
| SQOOP-1115: Sqoop2: Integration: Provide helper methods for synchronous job submission |
| |
| SQOOP-1200: Sqoop2 1.99.3 Pom files version change on release branch |
| |
| SQOOP-1201: Sqoop2: Update docs to reflect correct version on the release branch |
| |
| BUG |
| |
| SQOOP-515: Sqoop2: Datatype support |
| |
| SQOOP-827: Sqoop2: MMapInput is null while retrieving from DB if pass empty map on write |
| |
| SQOOP-897: Sqoop2: Remove script addtowar.sh and use catalina's common.loader instead |
| |
| SQOOP-958: Sqoop2: fix version tests in Mac OS X |
| |
| SQOOP-974: Sqoop2: Add staging table support to generic jdbc export job |
| |
| SQOOP-982: Sqoop2: Allow user to pass custom parameters to catalina.sh |
| |
| SQOOP-989: Sqoop2: setenv.sh overrides value of JAVA_OPTS |
| |
| SQOOP-993: Sqoop2: Metadata upgrade |
| |
| SQOOP-995: Sqoop2: Add cloning ability to model classes |
| |
| SQOOP-1002: Sqoop2: Mapreduce local mode detection is not working correctly on Hadoop 2.x |
| |
| SQOOP-1003: Sqoop2: sqoop.sh execution error |
| |
| SQOOP-1005: Sqoop2: Update year in the notice file to 2013 |
| |
| SQOOP-1019: Sqoop2: Client side caching input forms |
| |
| SQOOP-1036: Sqoop2: JobClient.getCounters can return NULL |
| |
| SQOOP-1039: Sqoop2: show version with no args should show something |
| |
| SQOOP-1040: Sqoop2: NPE in TableDisplayer |
| |
| SQOOP-1041: Sqoop2: Framework upgrade in JdbcRepository returns the outdated value |
| |
| SQOOP-1046: Sqoop2: Importing single row using decimal splitter will not import anything |
| |
| SQOOP-1048: Sqoop2: NPE when importing NULL value |
| |
| SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL |
| |
| SQOOP-1062: Misspell in "isVerboose()" method, it should be "isVerbose()" |
| |
| SQOOP-1069: Sqoop2: Incorrect error message from FrameworkValidator |
| |
| SQOOP-1070: Shell scripts should not rely on $PATH if $JAVA_HOME is set |
| |
| SQOOP-1080: Sqoop2: Investigate Jenkins test failures |
| |
| SQOOP-1081: destroy() method of ConnectorManager has not been implemented yet. |
| |
| SQOOP-1082: Implement pre-commit testing with Jenkins |
| |
| SQOOP-1088: Sqoop2: Submission history API |
| |
| SQOOP-1089: Sqoop2: Accept Language header default |
| |
| SQOOP-1095: Sqoop2: PreCommit Hook have incorrect branch name |
| |
| SQOOP-1100: Sqoop2: Missing setBoolean() method for MutableContext interface |
| |
| SQOOP-1104: Sqoop2: Allow versioned patches in the PreCommit hook |
| |
| SQOOP-1105: Sqoop2: Remove our implementation of StringUtils |
| |
| SQOOP-1112: Sqoop2: Date splitter might return splits omitting some boundaries |
| |
| SQOOP-1113: Sqoop2: Text splitter will fail on interval "Breezy Badger"" to "Warty Warthog"" |
| |
| SQOOP-1121: Sqoop2: Serialize schema and make them available in the MR job. |
| |
| SQOOP-1123: Sqoop2: Add eclipse project metadata folder excluded from maven |
| |
| SQOOP-1128: Sqoop2: SqoopException being nested into another SqoopException in Repository |
| |
| SQOOP-1130: Sqoop2: Sqoop MapReduce Job Failed when max and min boundary are both null |
| |
| SQOOP-1131: New test added in SQOOP-1121 is using unsupported API in Hadoop 100 |
| |
| SQOOP-1136: Sqoop2: MBooleanInput forget to copy persistenceId when do clone() |
| |
| SQOOP-1139: Sqoop2: JobManager.java indentation is inconsistent with rest of the codebase |
| |
| SQOOP-1145: Sqoop2: Use JSON object for serializing MAP input type |
| |
| SQOOP-1147: Sqoop2: show framework function does not behave as expected |
| |
| SQOOP-1154: Sqoop2: Text partitioner might miss or include edge values |
| |
| SQOOP-1169: Sqoop2: org.apache.sqoop.repository.schema.immutable should default to false |
| |
| SQOOP-1178: Sqoop2: get connections for connector columns out of order |
| |
| SQOOP-1180: Sqoop2: Metadata upgrade is calling validators with Model classes instead of configuration objects |
| |
| SQOOP-1205: Sqoop2: Provide upgrade guide for end users |
| |
| SQOOP-1210: Exporting data with malformed records causes sqoop2 jobs to hang until killed or they timeout |
| |
| IMPROVEMENT |
| |
| SQOOP-675: Sqoop2: Substitute submission command with top level commands start, stop and status |
| |
| SQOOP-921: Sqoop2: Create standalone shell package |
| |
| SQOOP-943: Sqoop2: Repository wide configuration of immutable disk structures |
| |
| SQOOP-971: Sqoop2: Component reconfigurability |
| |
| SQOOP-973: Sqoop2: Merge host, port and app to single server URL in Sqoop shell |
| |
| SQOOP-983: Sqoop2: Document client synchronous mode |
| |
| SQOOP-984: Sqoop2: Improve user experience on synchronous job submission |
| |
| SQOOP-985: Sqoop2: Introduce synchronous job submission to Client API |
| |
| SQOOP-990: Sqoop2: Allow users to override Sqoop2's default http port and admin port |
| |
| SQOOP-1012: Sqoop2: Generic JDBC Connector should have one static instance of validator |
| |
| SQOOP-1017: Sqoop2: Split FrameworkManager into two classes |
| |
| SQOOP-1028: Remove poll timeout parameter from Sqoop shell synchronous submission |
| |
| SQOOP-1042: Sqoop2: Name constraints in Derby repository |
| |
| SQOOP-1043: Sqoop2: Improve error messages in Derby repository |
| |
| SQOOP-1044: Sqoop2: Improve logging in metadata upgrade methods |
| |
| SQOOP-1059: Sqoop2: Remove ad hoc modle cloning methods in common module |
| |
| SQOOP-1060: Sqoop2: Increase maximal size of custom query in Generic JDBC Connector |
| |
| SQOOP-1065: Sqoop2: Remove special lock object in FrameworkManager |
| |
| SQOOP-1067: Sqoop2: Tests should not use /tmp/ directory for storing data |
| |
| SQOOP-1073: Sqoop2: Introduce schema for transferred data |
| |
| SQOOP-1075: Sqoop2: Persist Framework metadata version in repository |
| |
| SQOOP-1111: Sqoop2: Implement version detection and structure updates into Derby repository |
| |
| SQOOP-1141: Sqoop2: Provide ability to enable/disable connections and jobs |
| |
| SQOOP-1142: Sqoop2: Provide creater and last edited by to metadata structures |
| |
| SQOOP-1143: Sqoop2: Provide server audit log for operations upon metadata structures |
| |
| SQOOP-1182: Expose compression options for Sqoop2 import |
| |
| SQOOP-1183: Sqoop2: Add getConnector(String) to the client API |
| |
| SQOOP-1184: Sqoop2: Improve error messages during metadata upgrade |
| |
| NEW FEATURE |
| |
| SQOOP-663: Sqoop2: Introduce connector SDK |
| |
| SQOOP-1013: Sqoop2: Provide splitters for additional data types to Generic JDBC Connector |
| |
| SQOOP-1076: Sqoop2: Introduce Boolean model type |
| |
| SQOOP-1155: Sqoop 2 documentation for connector development |
| |
| TASK |
| |
| SQOOP-672: Unify logger usage across entire code base |
| |
| SQOOP-744: Sqoop2: Supply log4j configuration for generated mapreduce job |
| |
| SQOOP-745: Sqoop2: Change "submit" client command to "submission" |
| |
| SQOOP-1001: Sqoop2: Document methods for overriding server port |
| |
| SQOOP-1109: Sqoop2: Add new committers to root pom.xml file |
| |
| SQOOP-1110: Sqoop2: Precommit: Add routine to detect if patch touch test |
| |
| Release 1.99.2 |
| |
| SUB-TASK |
| |
| SQOOP-831: Unit test for common module |
| |
| SQOOP-861: Sqoop2: Integration: Create basic integration infrastructure |
| |
| SQOOP-882: Sqoop2 integration: Auxiliary classes for various database support |
| |
| SQOOP-896: Sqoop2: Remove PrefixContext dependency in Execution engine |
| |
| SQOOP-908: Sqoop2 integration: Create MySQL and PostgreSQL database providers |
| |
| SQOOP-909: Sqoop2 integration: Create Oracle and Microsoft SQL Server database providers |
| |
| SQOOP-925: Sqoop2: Devguide: Describe client API for embedding Sqoop client in applications |
| |
| SQOOP-930: Sqoop2: Devguide: Building and setting up developer environment |
| |
| SQOOP-939: Sqoop2: devguide: Document how to open project in Eclipse |
| |
| SQOOP-946: Sqoop2: Integration: Enhance the POC test case |
| |
| SQOOP-953: Sqoop2: Integration: Schema support |
| |
| SQOOP-987: Exclude mockito jars from being copied into the sqoop2 distribution |
| |
| BUG |
| |
| SQOOP-746: Sqoop2: Mapreduce job should have running with speculative execution disabled |
| |
| SQOOP-783: Sqoop2: Merge HdfsSequenceExportExtractor and HdfsTextExportExtractor to one Extractor |
| |
| SQOOP-799: Sqoop2: Change SqoopConnector interface to abstract class |
| |
| SQOOP-802: Sqoop2: Convert main "Manager" classes to singletons. |
| |
| SQOOP-811: Client shell variable substitution for recent commands |
| |
| SQOOP-812: Sqoop2: Serialization of Configuration objects to and from json is not working properly |
| |
| SQOOP-813: Sqoop2: LoaderExecutor might get into deadlock when exception is raised outside Loader itself |
| |
| SQOOP-815: Sqoop2: Get version for client requires working connection to server |
| |
| SQOOP-822: Sqoop2: Git repository revision is not fetched |
| |
| SQOOP-835: Sqoop2: Do not recreate package-info.java each compilation |
| |
| SQOOP-843: Sqoop2: Generic JDBC connector is committing transaction on export with autoCommit on |
| |
| SQOOP-844: Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions |
| |
| SQOOP-845: Sqoop2: Improve Generic JDBC validator |
| |
| SQOOP-850: Sqoop2: Move server initialization from server module to core |
| |
| SQOOP-851: Sqoop2: NullPointerException in Mapreduce Submission engine initialization |
| |
| SQOOP-852: Sqoop2: Mapreduce submission engine is not closing opened JobClient object |
| |
| SQOOP-858: Sqoop2: Add validation messages on form level |
| |
| SQOOP-865: Sqoop2: Client request cache is incorrectly setting the framework validations |
| |
| SQOOP-867: Sqoop2 client shows wrong msg |
| |
| SQOOP-868: Mismatched msg in sqoop2 client |
| |
| SQOOP-871: Connector-level job-specific prop gives wrong help msg |
| |
| SQOOP-872: sqoop2 client 'show framework' command isn't resolving the show.prompt_framework_opts prop |
| |
| SQOOP-873: Sqoop2 build should ignore Intellij files |
| |
| SQOOP-874: Sqoop2: Provide log4j configuration for client |
| |
| SQOOP-875: Sqoop2: ClassUtils.instantiate class should not be logging on ERROR level |
| |
| SQOOP-879: Sqoop2: NPE when deleting job object that do not have associated any submissions |
| |
| SQOOP-880: Sqoop2: NPE when stopping job that was never executed |
| |
| SQOOP-881: Sqoop2: Change default port from 8080 |
| |
| SQOOP-884: Sqoop2: Disable interactive client commands in batch mode |
| |
| SQOOP-887: Sqoop2: Move string constants from FormDisplayer to resource file |
| |
| SQOOP-888: Sqoop2: Move out checking of special condition token to Validator in Generic JDBC Manager |
| |
| SQOOP-889: Sqoop2: Move tomcat related properties from dist/pom.xml to root pom.xml |
| |
| SQOOP-892: Sqoop2: Validate acceptable number of mappers and reducers |
| |
| SQOOP-893: Fix job submission progress percentage |
| |
| SQOOP-894: Sqoop2: Increase counter and group size in derby repository |
| |
| SQOOP-905: Sqoop 2: Job submission shows wrong date format in client console |
| |
| SQOOP-941: Sqoop2: Do not send sensitive values from server to client |
| |
| SQOOP-942: Sqoop2: Refactore code repetition in SqoopRequests objects |
| |
| SQOOP-952: Sqoop2: Create job function requires uppercased type name |
| |
| SQOOP-966: Sqoop2: Remove placeholder class IgnoredForm |
| |
| SQOOP-980: Sqoop2: Show connection and job command hung |
| |
| IMPROVEMENT |
| |
| SQOOP-647: Provide facility to cache server responses on client side |
| |
| SQOOP-660: Improve user experience in displaying connection/job metadata |
| |
| SQOOP-678: Sqoop2: Add counters handling to map reduce submission engine |
| |
| SQOOP-682: Sqoop2: Use templating in job.etl classes |
| |
| SQOOP-723: Add possibility to have synchronous submissions in Sqoop 2 |
| |
| SQOOP-750: Sqoop2: Introduce show option client command |
| |
| SQOOP-803: Sqoop2: Add gpg profile to pom file so that we can easily deploy artifacts to mvn repository |
| |
| SQOOP-806: Sqoop2: Put "creation" and "lastUpdate" date to Connection and Job objects |
| |
| SQOOP-807: Sqoop2: Verify whether job object can be safely removed prior removing |
| |
| SQOOP-814: Sqoop2: Start using configuration objects in Generic JDBC Connector |
| |
| SQOOP-826: Sqoop2: Add log4j test configuration to all maven modules |
| |
| SQOOP-833: add *.eml "ant eclipse" (IntelliJ import) generated file, to .gitignore |
| |
| SQOOP-841: Sqoop2: Remove final keyword from manager classes |
| |
| SQOOP-842: Sqoop2: Put partition to template in Extractor as well |
| |
| SQOOP-863: Sqoop2: Introduce ProgressThread into Extractor and Loader |
| |
| SQOOP-864: Sqoop2: Introduce ETL context objects |
| |
| SQOOP-866: Sqoop2: Introduce framework validations |
| |
| SQOOP-876: Expose the xid and cid when show status of job in sqoop2 client |
| |
| SQOOP-877: Sqoop2: Increase field size of output.outputDirectory property value from 25 to 50 |
| |
| SQOOP-899: Sqoop2: Properly document REST endpoints in the server handler classes |
| |
| SQOOP-900: Sqoop2: Introduce human readable coding style for queries stored in DerbySchemaQuery |
| |
| SQOOP-919: Sqoop2: Improve Form API for simple java handling |
| |
| SQOOP-920: Sqoop2: Print out warnings in client shell for objects created with status ACCEPTABLE |
| |
| SQOOP-922: Sqoop2: Shell commands are throwing exceptions when invalid function is specified |
| |
| SQOOP-947: Sqoop2: Introduce the concept of "sensitivity" input to all supported metadata structures |
| |
| SQOOP-967: Sqoop2: Introduce dummy configuration key to easily identify Sqoop2 job |
| |
| SQOOP-972: Sqoop2: Load server URL from environment in shell |
| |
| SQOOP-975: Sqoop2: Port conflict problems in tomcat |
| |
| SQOOP-986: Sqoop2: Add detection of local mode to mapreduce submission engine |
| |
| NEW FEATURE |
| |
| SQOOP-643: Sqoop2: Implement simple listings for connector and job objects |
| |
| SQOOP-664: Send user name as HTTP header in client to server communication |
| |
| SQOOP-785: Sqoop2: Add splitter implementation for NUMERIC/DECIMAL type |
| |
| SQOOP-895: Sqoop2: Do not serialize framework and connector configurations into mapreduce configuration object |
| |
| SQOOP-903: Sqoop2: Add schema support to Generic JDBC Connector |
| |
| SQOOP-918: Sqoop2: Introduce client API and change Sqoop shell to use it |
| |
| TASK |
| |
| SQOOP-805: Sqoop2: Document show option function in CommandClientGuide |
| |
| SQOOP-809: Sqoop2: Remove old deprecated comments from distribution pom file |
| |
| Release 1.99.1 |
| |
| SUB-TASK |
| |
| SQOOP-680: Re enable unit tests for map reduce execution engine |
| |
| SQOOP-698: Document installation procedure for Sqoop 2 |
| |
| SQOOP-699: Create content for User guide for Sqoop 2 |
| |
| SQOOP-700: Provide examples to Sqoop 2 user guide |
| |
| SQOOP-701: Create content for Sqoop 2 Developer guide |
| |
| SQOOP-703: Move sqoop 2 documentation to top level directory in binary artefact |
| |
| SQOOP-708: Create documentation for Sqoop 2 client |
| |
| SQOOP-713: Introduce maven profiles for different Hadoop versions |
| |
| SQOOP-714: Make map reduce related code to be compatible with Hadoop 1 |
| |
| SQOOP-715: Add support for Hadoop 1 to addtowar.sh script in Sqoop 2 |
| |
| SQOOP-742: Put 5 minutes demo on index page in Sqoop 2 documentation |
| |
| SQOOP-753: Sqoop2: Update top level README file |
| |
| SQOOP-755: Sqoop2: Provide license file with license information for all artifacts included in binary release |
| |
| SQOOP-756: Sqoop2: Exclude junit jar from our binary artifact |
| |
| SQOOP-757: Sqoop2: Disable maven reports project wise |
| |
| SQOOP-758: Sqoop2: Generate documentation in package goal |
| |
| SQOOP-786: Sqoop2: Include jars from WAR archive in LICENSE.txt file |
| |
| SQOOP-787: Sqoop2: Provide CHANGELOG.txt file |
| |
| SQOOP-800: Sqoop2: Update NOTICE file |
| |
| BUG |
| |
| SQOOP-511: Need to set persistent id for connector if in repository already |
| |
| SQOOP-537: TestMPersistableEntity does not contain license header |
| |
| SQOOP-596: Implement connection resource end-to-end |
| |
| SQOOP-608: Implement job resource from end to end |
| |
| SQOOP-631: Sqoop2 client is not working on Mac OS X |
| |
| SQOOP-632: Sqoop 2 client help text contains link to old incubator page |
| |
| SQOOP-644: Remove DISCLAMER.txt file from branch sqoop2 |
| |
| SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files |
| |
| SQOOP-655: Generic JDBC connector for export |
| |
| SQOOP-671: Mapreduce counters are not used in generated mapreduce jobs |
| |
| SQOOP-673: Mapreduce submission manager should not call update() on finished submissions |
| |
| SQOOP-674: Sqoop2: Exceptions in special map reduce threads can cause mapreduce job to freeze |
| |
| SQOOP-686: Empty job name will result in NPE during job submission |
| |
| SQOOP-688: Add netbeans files to gitignore and rat |
| |
| SQOOP-690: Fix threading issues in SqoopOutputFormatLoadExecutor |
| |
| SQOOP-692: Move execution specific error codes from CoreError to it's own error codes class |
| |
| SQOOP-693: Intermediate data format support for export |
| |
| SQOOP-695: Change default host on client to "localhost" |
| |
| SQOOP-696: Client command submission status will finish gracefully when executed for non existing job |
| |
| SQOOP-702: Refactor OutputLoadExecutor |
| |
| SQOOP-705: Framework-defined text/sequence partitioner/extractor for HDFS |
| |
| SQOOP-707: Update developer list in Sqoop 2 pom file |
| |
| SQOOP-710: Remove dependency on unreleased commons-cli 1.3 from Sqoop 2 client |
| |
| SQOOP-727: We should use more strict regular expressions in addtowar.sh script |
| |
| SQOOP-728: Increase varchar limits for external link and exceptions in Derby repository |
| |
| SQOOP-729: SubmissionDisplayer should display Stack Trace only in Verbose mode |
| |
| SQOOP-738: Sqoop is not importing all data in Sqoop 2 |
| |
| SQOOP-759: Sqoop2: Loading client resource file is failing on ResourceBundle not found exception |
| |
| SQOOP-760: Sqoop2: Fix invalid \h escape sequence in client resource file |
| |
| SQOOP-761: HDFSTextExportExtractor loses lines around partition boundaries |
| |
| SQOOP-764: Sqoop2: Fix typo in client resource file "prompt.conn_id" |
| |
| SQOOP-765: Sqoop2: JDBC repository is incorrectly checking if job exists in update handler |
| |
| SQOOP-766: Sqoop2: Fix client resources |
| |
| SQOOP-768: Sqoop2: Compilation on hadoop profile 100 will fail |
| |
| SQOOP-770: Sqoop2: executable scripts in binary distribution tarball are not executable |
| |
| SQOOP-771: Sqoop2: Improve addtowar.sh |
| |
| SQOOP-772: OutOfMemory from document generation |
| |
| SQOOP-774: Sqoop2: exception is thrown when creating a connection object if connectionString starts with an empty space |
| |
| SQOOP-775: Sqoop2: addtowar.sh script is silently ignoring unknown arguments |
| |
| SQOOP-778: Remove empty SqoopUserGuide and SqoopDeveloperGuide |
| |
| SQOOP-779: Sqoop2: NPE when JobConnectorContext has a null value |
| |
| SQOOP-780: Sqoop2: GENERIC_JDBC_CONNECTOR_0011:The type is not supported - 2 |
| |
| SQOOP-781: Sqoop2: Improve logging in GenericJdbcImportInitializer |
| |
| SQOOP-782: Update comment to reflect that TestHdfsExtract works fine. |
| |
| SQOOP-784: Sqoop2: Creating job for connection with id > 1 will results in NullPointerException |
| |
| SQOOP-788: Sqoop2: Import sometimes duplicate some data |
| |
| SQOOP-789: Fix Hadoop-1 build |
| |
| SQOOP-790: Remove flakiness from TestSqoopOutputformatLoadExecutor |
| |
| IMPROVEMENT |
| |
| SQOOP-306: Move to a maven build |
| |
| SQOOP-347: Pull versions into properties in the pom.xml |
| |
| SQOOP-507: Update dist/pom.xml so that maven doesn't download tomcat every time |
| |
| SQOOP-525: Enable dist package build by default |
| |
| SQOOP-534: Add ability to find out if MPersistableEntity do already have persistent ID |
| |
| SQOOP-545: Add IntelliJ IDEA files to RAT exclude |
| |
| SQOOP-567: Support connection validation in JDBC repository |
| |
| SQOOP-568: Configuration reload period should be configurable in PropertiesConfigurationProvider |
| |
| SQOOP-573: Do not change working directory for client |
| |
| SQOOP-581: Client should be sending used locale back to sqoop server to retrieve locale aware data |
| |
| SQOOP-590: Switch Sqoop 2 to Apache Tomcat 6 For Better Integration With Apache Bigtop |
| |
| SQOOP-612: Provide unit tests for derby metadata repository |
| |
| SQOOP-618: Remove most important FindBugs warnings and errors in Sqoop 2 |
| |
| SQOOP-619: Display user persistent id of newly created connection and job objects |
| |
| SQOOP-620: Introduce name to connection and job objects |
| |
| SQOOP-625: Enforce checking advertised maximal size for MStringInput |
| |
| SQOOP-629: Provide better exception handling during server-client communication |
| |
| SQOOP-630: Check if connection/job is in use before deleting as deleting used entity might result in FK violations |
| |
| SQOOP-642: Provide resource reading for both interactive and batch mode processing |
| |
| SQOOP-645: Separate job engine to separate maven module |
| |
| SQOOP-646: Provide support for "set" metadata in Sqoop 2 |
| |
| SQOOP-648: Move all string message in client to resource file for easy translation |
| |
| SQOOP-662: Introduce pluggable configuration objects |
| |
| SQOOP-667: We should persist in repository all properties of MSubmission metadata class |
| |
| SQOOP-676: Add lastUpdateDate to MSubmission |
| |
| SQOOP-677: Destroyer needs to be called from OutputCommitter |
| |
| SQOOP-679: Wrap exception to MSubmission metadata object |
| |
| SQOOP-681: Split configuration in Generic JDBC connector between job and connection |
| |
| SQOOP-684: Encode type of the job into executed map reduce job |
| |
| SQOOP-694: Introduce client "verbose" mode |
| |
| SQOOP-704: Exclude patches from RAT checks in Sqoop2 |
| |
| SQOOP-719: Improve user experience with addtowar.sh script in Sqoop 2 |
| |
| SQOOP-722: Improve Sqoop 2 packaging |
| |
| SQOOP-734: Change ConnectorBean to send JSON objects rather than sets of arrays |
| |
| SQOOP-735: Introduce output format option to Sqoop 2 import |
| |
| SQOOP-737: Give user option to set number of extractors and loaders |
| |
| SQOOP-762: Sqoop2: Improve logging in mapreduce execution engine |
| |
| SQOOP-776: Sqoop2: show connection command shows password in plain text |
| |
| NEW FEATURE |
| |
| SQOOP-531: Define connector execution lifecycle |
| |
| SQOOP-532: Define intefaces for connector-defined execution classes |
| |
| SQOOP-533: Intermediate data format support for import |
| |
| SQOOP-588: MapReduce infrastructure for executing ETL framework |
| |
| SQOOP-589: Framework-defined text/sequence loaders for HDFS |
| |
| SQOOP-605: Generic JDBC connector for import |
| |
| SQOOP-610: Job submission engine for import |
| |
| SQOOP-613: Add support for integer type to metadata model |
| |
| SQOOP-614: Provide client side ability to clone connection or job object |
| |
| SQOOP-623: Add support for loading Map inputs in Sqoop2 |
| |
| SQOOP-624: Add test coverage plugin to root pom file |
| |
| SQOOP-627: Convert forms structures on connector level to configuration classes |
| |
| SQOOP-656: End to end submission engine |
| |
| SQOOP-658: Solve hadoop dependency distribution/loading on server side |
| |
| SQOOP-666: Introduce execution engine |
| |
| SQOOP-712: Add support of Hadoop 1.x to Sqoop 2 |
| |
| SQOOP-716: Create server notification REST callback to get information if job has update |
| |
| SQOOP-739: Connectors in Sqoop 2 should be versionable |
| |
| SQOOP-740: Provide export submission engine implementation for Sqoop 2 |
| |
| TASK |
| |
| SQOOP-491: Create configuration directory with documented configuration files under Sqoop2. |
| |
| SQOOP-492: Implement a documentation system for Sqoop2 |
| |
| SQOOP-493: Distribution build for Sqoop2 should contain sources |
| |
| SQOOP-494: Create client infrastructure to allow interactive selection of options of a command. |
| |
| SQOOP-495: Support for parameter substitution in the client shell. |
| |
| SQOOP-496: Refine the interface for Connector and Repository to support connection metadata |
| |
| SQOOP-497: Enhance repository interface to support Connection CRUD |
| |
| SQOOP-501: Infrastructure to support input of sensitive information like passwords in the client shell |
| |
| SQOOP-502: Implement show connector command end-to-end |
| |
| SQOOP-512: Intermediate data representation |
| |
| SQOOP-514: Layout changes for Sqoop 2 distribution |
| |
| SQOOP-544: Split job metadata for different job types (import, export) |
| |
| SQOOP-576: Implement command "show framework" end to end |
| |
| SQOOP-577: Design storage in derby repository for connect and job metadata |
| |
| SQOOP-584: Create facility to validate user supplied connection and job forms |
| |
| SQOOP-697: Put together documentation for Sqoop 2 |
| |
| SQOOP-733: Remove unnecessary version repetition in Sqoop 2 pom files |
| |
| SQOOP-747: Sqoop 1.99.1 release preparation |
| |