Changelog

Unreleased

Full Changelog

Closed issues:

  • Create Minio connector examples #456
  • Support topics.regex #454
  • Define a default naming for converters, transforms and aggregation packages #439

Merged pull requests:

camel-kafka-connector-0.5.0 (2020-09-09)

Full Changelog

Implemented enhancements:

  • Add the connector class to use in the documentation of each connector #321
  • Support multiple topics for connector configuration #197
  • Generate a catalog of supported connectors #141

Fixed bugs:

  • flaky syslog integration test #367
  • UnitOfWork.done() needs to be called on Polled exchanges #202

Closed issues:

  • Unreleased Resource: Database #436
  • Create an NSQ example #429
  • Archetype: Add a parameter to the archetype generator to be able to specify what connector we want to extend #419
  • IMPROVEMENT REQUEST: Add a transformer mode to the connectors to make lightweight edits to the messages while they are being produced/consumed #410
  • aws2-S3-connector: (gzip/zip) compression with sink #387
  • Discussion: troubleshooting documentation? #381
  • Bump to Camel 3.4.3 #379
  • Documentation: SJMS2 connector is incompatible with activemq-all #378
  • Unclean startup causes an NPE on shutdown #376
  • Make the camel-kafka-connector archetype use the parent POM #362
  • Exception on endpoint being treated as a polling consumer before createPollingConsumer is called. #361
  • Add a Nats connector examples in camel-kafka-connector-examples repo #359
  • Add a compatibility matrix related to camel version in docs #344
  • aws2S3connector: moveAfterRead true bucket not created #339
  • CamelAwssqsSinkConnector does not work when specifying AWS credentials in camel.sink.endpoint #319
  • Create a Kinesis Firehose Connector example #318
  • Nullpointer exception at org.apache.camel.component.aws2.s3.AWS2S3Producer.processSingleOp #299
  • Add Aggregate integration test #291
  • Enable testRetrieveFromCassandraWithCustomStrategy on CamelSourceCassandraITCase #288

Merged pull requests:

  • Fix potentially unreleased DB resources in test code #437 (orpiske)
  • Automatic changelog: Run it just one time during the night #435 (oscerd)
  • Run the changelog automatic updated every hour #434 (oscerd)
  • Update try-it-out-on-openshift-with-strimzi.adoc with latest AWS S3 connector config #433 (smccarthy-ie)
  • Pr Build and push build needs to point to master #432 (oscerd)
  • adding a key transformer to the AWS2-SQS connector so that the CamelH… #431 (codexetreme)
  • Proposed fix for issue #414 #428 (orpiske)
  • Camel 3.5.0 #427 (oscerd)
  • Docs: Updated archetypes docs #422 (oscerd)
  • Archetype: Add a parameter to the archetype generator to be able to s… #421 (oscerd)
  • Fix a minor typo #420 (oscerd)
  • Removed deploy phase from jenkinsfile, we already have the daily snap… #418 (oscerd)
  • Remove deploy phase from Jenkinsfile, we have the daily snapshot depl… #417 (oscerd)
  • [Github Actions] Periodic Sync Camel-kafka-connector camel-master Branch #416 (github-actions[bot])
  • Activemq-all note for SJMS2 connector #415 (oscerd)
  • Rework the testing documentation and adds test writing details #413 (orpiske)
  • Added new test for Azure Storage Queue sink #412 (orpiske)
  • Support Multiple topics on Source Connector #411 (oscerd)
  • Added connector class on each connector documentation page #405 (oscerd)
  • Added a pipeline for deploying on daily basis #404 (oscerd)
  • #389 - Fix doc- Kubernetes command #401 (rogeriob2br)
  • Fix mongodb test #396 (unsortedhashsets)
  • Removed wrong terminal output from example in archetype docs #394 (oscerd)
  • Kafka-clients is not a test dependency #393 (oscerd)
  • Added automatic-sync gh action for camel-kafka-connector on camel-mas… #392 (oscerd)
  • Adds basic aggregation test (github issue #291) #388 (orpiske)
  • Fix flaky syslog test #386 (orpiske)
  • Added a simple troubleshooting guide #383 (orpiske)
  • Upgrade to camel 3.4.3 #380 (oscerd)
  • Prevent NPEs on shutdown when critical errors occur #377 (orpiske)
  • Fixed incorrect number of log arguments in S3 exception handling #375 (orpiske)
  • Defer topic deletion #374 (orpiske)
  • Fixes for edge cases #373 (orpiske)
  • Added missing fromUrl to the log message #372 (orpiske)
  • Removes debugging message #370 (orpiske)
  • Removing backport gh action. It doesn't work. #369 (oscerd)
  • Minor AWS tests cleanups #368 (orpiske)
  • Building endpoint uris should for secret options automatic use RAW() … #366 (davsclaus)
  • Cutting down connectors #365 (oscerd)
  • Make the camel-kafka-connector archetype use the parent POM #363 (oscerd)
  • AWS SDK v2 integration tests: Kinesis #358 (orpiske)
  • Use latest Strimzi's docker images #357 (oscerd)
  • Fixed camel compatibility matrix table #356 (oscerd)
  • Added a camel-compatibility matrix page #355 (oscerd)
  • Upgrade Archetype docs #354 (oscerd)
  • Fixed index adoc #352 (oscerd)
  • Added missing connector in connectors pom #350 (oscerd)
  • Release 0.4.0 #346 (oscerd)
  • AWS Kinesis test fixes when in remote mode #345 (orpiske)

camel-kafka-connector-0.4.0 (2020-07-29)

Full Changelog

Implemented enhancements:

  • Being able to inject an aggregator in a sink connector #274
  • In case of Sink we need to use toD instead of to #252
  • Upgrade to Kafka 2.5.0 #249
  • Improve integration test support when component dependencies are present #211
  • Support both marshal and unmarshal in source and sinks #194
  • camel-kafka-connector-generator-maven-plugin: implement a component exclusion mechanism #148

Fixed bugs:

  • BigDecimal values are not handled correctly in Headers serialization and deserialization #325
  • Camel HDFS: does not work due to dependencies conflicts #263
  • NullPointerException during shutdown when using Salesforce component #245

Closed issues:

  • Camel-Elasticsearch Connector not working on OpenShift #342
  • aws2S3connector connected to minio ClassCastException #338
  • Add documentation for archetype #333
  • Add an archetype to be able to extend the existing connectors with converters/aggregators/transformations/pojo etc. #329
  • The committed block count cannot exceed the maximum limit of 50,000 blocks. #324
  • Upgrade to Camel 3.4.2 once released #322
  • CamelAwssqsSinkConnector is leaking AWS credentials into Kafka Connect log #320
  • How install camel-jira-kafka-connector #315
  • From S3 to kafka, when using Idempotent filter, Do we still fetch S3 file content ? #314
  • How to break messages when ingesting into kafka #313
  • In S3 source connector, how to fetch only new files ? #311
  • CAMEL-15063 work-around may be removed #310
  • Add an aggregation page in docs #303
  • Outdated camel-dependencies version? #297
  • Aggregator support for completionTimeout too #290
  • Upgrade to Camel 3.4.0 LTS version #283
  • Camel-MongoDB Kafka connector: example with sink connector #212

Merged pull requests:

camel-kafka-connector-0.3.0 (2020-06-17)

Full Changelog

Implemented enhancements:

  • Use camel-depencencies to import versions of common libraries like Jakson, qpid, log4j etc. #241
  • Autogenerate and example config file for each connector #220
  • S3 source connector delete files from source bucket #97
  • Create example and itest for camel-syslog #77

Fixed bugs:

  • Camel-elasticsearch-rest-kafka-connector throws java.lang.NoClassDefFoundError: org/apache/logging/log4j/LogManager #259
  • Wrong signature of autogenerated method public static ConfigDef conf\(Map\<String, String\> parsedConfig\) of each Camel\*ConnectorConfig #221
  • Possible problems in CamelSinkAWSSQSITCase tests #215

Closed issues:

  • Question: How to provide aws role:arn value to authenticate S3 #267
  • Add CamelAMQP source and sink example properties #264
  • Add download links to the connectors list page #261
  • AWS S3: bucket name not resolved when using URL configuration #260
  • Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.camel.kafkaconnector.CamelSinkConnectorConfig #251
  • Camel AWS2-S3: Add the same converters and transforms we have for AWS-S3 connector #250
  • pls #248
  • Connectors doc generation shuld be moved from core to connectors module #226
  • Investigate why syslog documentation result in a missing link #225
  • CamelSinkTask Properties need to be cleaned up before going ahead #224
  • CamelSinkTask headers must be cleaned before sending them ahead #223
  • Updater the readme of autogenerated connectors doc page #219
  • Bump to Camel 3.3.0 #217

Merged pull requests:

camel-kafka-connector-0.2.0 (2020-05-17)

Full Changelog

Implemented enhancements:

  • Avoid Thread.sleep in test, use Awaitility FTW #186
  • make the topics property consistent between source and sink connectors #175
  • Produce an assembly artifact containing all the released artifacts #165
  • Create and ad hoc connector for syslog #145
  • Take in to account endpoint path options order into connector code generation #144

Fixed bugs:

  • Ordering of endpoint path options is not taken in account #143

Closed issues:

  • Add connector dependencies in distribution package #203
  • Switch to Camel 3.2.0 #199
  • Cannot apply transforms to Telegram Source Connector #188
  • Connectors doc: Show up only the priority in the table column #182
  • Add an index for connectors in docs #169
  • Autogenerate documentation for sink and source connectors #167
  • Provided dependencies management #158
  • Checkstyle missing unused imports? #156
  • Generate a table with supported connectors #142
  • Test coverage: springboot autoconfigurations vs kafka-connect configuration format #132
  • Release 0.1.0 #130

Merged pull requests:

  • Syslog connector #214 (valdar)
  • Bump Testcontainers to version 1.14.2 #213 (oscerd)
  • Removes usage of fixed hostnames in integration tests #210 (orpiske)
  • Grammar fixes in basic concepts adoc #209 (oscerd)
  • chore: rename poorly named variable in test code #208 (orpiske)
  • Re-enable Cassandra test using properties #207 (orpiske)
  • Bump to Camel 3.2.0 #206 (oscerd)
  • Improved CamelSourceTaskTest #205 (fvaleri)
  • Removed Thread.seep(...) in unit tests in order to avoid possible sou… #204 (valdar)
  • Flakey tests #200 (valdar)
  • Generate a table with supported connectors #198 (oscerd)
  • Make the topics property consistent between source and sink connectors #196 (oscerd)
  • Produce an assembly artifact containing all the released artifacts #195 (oscerd)
  • Switched to use RuntimeCatalog.asEndpointUri method to construct the … #192 (valdar)
  • Connectors doc: Show up only the priority in the table column #190 (oscerd)
  • Added test on different component properties formats fix #132 #187 (valdar)
  • Code cleanup #184 (fvaleri)
  • Lets try to use a shortname of 50 for connectors options #181 (oscerd)
  • Camel-kafka-generator-maven-plugin: Use the Strings class from toolin… #180 (oscerd)
  • Introduce the shortName method for option name #179 (oscerd)
  • Added a little example of AWS-S3 source connector #177 (oscerd)
  • Docs generation now contains also the number of options available per connectors #176 (oscerd)
  • Adds a manual test for the Camel Slack sink connector #174 (orpiske)
  • Special case for coap+tcp and coaps+tcp #173 (oscerd)
  • Regen docs #172 (oscerd)
  • Regen docs pages by adding title, so Antora will be happy #171 (oscerd)
  • Add an index for docs #170 (oscerd)
  • Docs sink source #168 (oscerd)
  • Pom fixes #161 (valdar)
  • Added a building section in the docs #160 (oscerd)
  • Fixes a couple of style violations and warnings on test code #157 (orpiske)
  • Additional tests for different configuration styles #155 (orpiske)
  • Release0.1.0 #154 (valdar)
  • Fixed github action issue with never released builts. #153 (valdar)
  • Upgrade testcontainers to version 1.14.1 #152 (oscerd)

camel-kafka-connector-0.1.0 (2020-04-25)

Full Changelog

Implemented enhancements:

  • Migrating to Junit 5 #74
  • Replace confluentinc/cp-kafka image with an upstream version #43
  • Test code cleanups: embedded connect runtime improvements #24
  • Add a CI job for PR #19
  • Support Map and List as Headers #18
  • Find a way to manage dependencies #15
  • Unclean shutdown causing lots of warning messages in the logs #13

Fixed bugs:

  • Unable to initialize REST resources in tests #120
  • ERROR - Plugin class loader for connector: was not found. #118
  • Flaky test: CamelSinkCassandraITCase #67
  • Integrations tests fails if confluentinc/cp-kafka:5.2.1 has not been pulled #25

Closed issues:

  • Create a documentation index and reflect it on the website #136
  • Documentation: Add instructions on how to use the packaged connectors in Kafka Connect #134
  • Generate documentation to be integrated with Antora and camel website #128
  • Define how to package the connectors #127
  • Upgrade to Kafka 2.4.1 #105
  • Not able to add resource file #104
  • Not able to run aws s3 source connector #95
  • Bump Kafka to version 2.4.0 #69
  • Unstable test: CamelSourceTaskTest.testSourcePollingTimeout #55
  • Add a sink and sources examples with camel-cassandraql #35
  • Better support for value Schema in the SourceTask #32
  • run integration test insided github actions? #31
  • INFRA - Turn off mail noise to Camel @dev mailing list #30
  • Allow the user to set the key of the SourceRecord explicitly #20
  • support camel type converters #16
  • The camel-kafka-connector artifacts pulls number of dependencies #9
  • Add Release profile #7

Merged pull requests:

  • Moved from camel-core to camel-core-engine as a dependecnies. #140 (valdar)
  • Added gpg key for valdar. #139 (valdar)
  • Test code fixes for the auto-generated connectors #138 (orpiske)
  • Misc #133 (valdar)
  • Packaging the connectors as zip and tar.gz #131 (oscerd)
  • Auto gen #129 (valdar)
  • Upgrade Testcontainers to version 1.14.0 #126 (oscerd)
  • Upgrade Junit Jupiter to version 5.6.2 #125 (oscerd)
  • Replaces our own connect runtime implementation with the embedded one from Kafka #124 (orpiske)
  • Removed unused class HTTPEchoService #123 (orpiske)
  • Fixes a misplaced log error message flooding the logs w/ invalid errors #122 (orpiske)
  • Sidebar menu Tidy up name -issue 14567 #121 (rimshach)
  • Bump Qpid JMS to version 0.50.0 #119 (oscerd)
  • Improve documentation for the about section #116 (AemieJ)
  • Binded itests to test phase to better accommodate github actions disk… #115 (valdar)
  • Auto gen #114 (valdar)
  • Added a Jenkinsfile for JDK11 #113 (oscerd)
  • Added a Jenkinsfile for JDK8 and being able to deploy automatically #112 (oscerd)
  • Pointing to ASF Snapshot and use the apache Parent #111 (oscerd)
  • Bump Junit Jupiter to version 5.6.1 #110 (oscerd)
  • Bump ActiveMQ to version 5.15.12 #109 (oscerd)
  • Avoid building all the code for sourcecheck verification #108 (orpiske)
  • Added support for remote AWS testing #107 (orpiske)
  • Upgrade Kafka to version 2.4.1 - fixes #105 #106 (oscerd)
  • Upgrade Jackson to version 2.10.3 #103 (oscerd)
  • Auto gen step 2: generated connectors structure and dependencies. #102 (valdar)
  • Ensure that local containers used during tests are properly shutdown after the test is completed #101 (orpiske)
  • Upgrade test containers #100 (orpiske)
  • Bump to Camel 3.1.0 #99 (oscerd)
  • Little updates to docs #98 (oscerd)
  • Fix missing licenses #94 (orpiske)
  • Adds support for running tests against external ElasticSearch instances #93 (orpiske)
  • Adds support for running tests against external Cassandra instances #92 (orpiske)
  • Small adjustment to sourcechecks. #91 (valdar)
  • Fixed README.adoc links after Antora init. #90 (valdar)
  • fix(docs): replace anchor syntax for placeholder #89 (zregvart)
  • chore(docs): cleanup wording and syntax #88 (zregvart)
  • feat(docs): setup Antora #87 (zregvart)
  • [SECURITY] Use HTTPS to resolve dependencies in Maven Build #86 (JLLeitschuh)
  • First step for issue #15 #85 (valdar)
  • Upgrade Qpid JMS client to version 0.48.0 #84 (oscerd)
  • Added support for using an external JMS broker #83 (orpiske)
  • Added support for loading test properties from a properties file #82 (orpiske)
  • Bump TestContainers to version 1.12.5 #81 (oscerd)
  • Bump to Camel 3.0.1 #80 (oscerd)
  • Upgrade Junit to version 5.6.0 #79 (oscerd)
  • Upgrade strimzi images to the latest version #78 (orpiske)
  • Migrates all the test cases to Junit 5 #75 (orpiske)
  • Added sourcecheck to github actions, added master push github action … #73 (valdar)
  • Updated integration test image to kafka 2.4 #72 (valdar)
  • Fix issue #67: Flaky test: CamelSinkCassandraITCase #71 (orpiske)
  • Bump Kafka to version 2.4.0 #70 (oscerd)
  • Upgrade ActiveMQ to version 5.15.11 #68 (oscerd)
  • Added support for testing the Kafka service using Strimzi #66 (valdar)
  • Auto gen #65 (valdar)
  • Add integration test for Cassandra CQL #64 (orpiske)
  • Bump Jackson to version 2.10.2 #63 (oscerd)
  • Use artifactId instead of project.name to build colon-less distro paths #62 (ppalaga)
  • Bump Junit to version 4.13 #61 (oscerd)
  • Should use year instead of week year #60 (orpiske)
  • Property placeholders #59 (oscerd)
  • Relaxing condition to accomodate some timeout glitches, fix #55 #58 (valdar)
  • Convert the embeddable Kafka Connect runner to a JUnit rule #57 (orpiske)
  • Stop removing JMS-related containers after they are built #56 (orpiske)
  • Upgrade test containers to the latest version #54 (orpiske)
  • Fixes #52 (valdar)
  • Rearrange date and time #51 (omarsmak)
  • Fixed missing license #50 (orpiske)
  • fix checkstyle violation #49 (omarsmak)
  • Add checkstyle profile #48 (omarsmak)
  • CassandraQL sink connector example #47 (oscerd)
  • Cassandraql source example #46 (oscerd)
  • Added a gitter badge for our chat #45 (oscerd)
  • Fix Kafka instance type should read from the property not from the system env #42 (orpiske)
  • Adds an example configuration for ElasticSearch Index #41 (orpiske)
  • Allow to configure a source record key from camel message header key #39 (omarsmak)
  • Replaces artemis with qpid-dispatch router #38 (orpiske)
  • Infer the suitable schema in the SourceTask #37 (omarsmak)
  • Adds support for ElasticSearch index operation + tests #36 (orpiske)
  • Support camel type converter #34 (omarsmak)
  • Send S3ObjectSerializer I/O error to the LOG instead of stdout #33 (orpiske)
  • Support using an external Kafka for the tests #29 (orpiske)
  • Camel-AWS S3 example: Use a Transformation instead of a converter #28 (oscerd)
  • Map list as headers #26 (oscerd)
  • Setting up POM as ASF standard #14 (oscerd)
  • Reduce log default log verbosity #12 (orpiske)
  • Cleanup the AWS SQS Sink test #11 (orpiske)
  • Mark camel components as provided dependencies #10 (jerrinot)
  • Added release profile for the beginning #8 (oscerd)
  • Fix Sink File test #6 (orpiske)
  • chore: update maven to v3.6.3 #5 (lburgazzoli)
  • chore(build): set up github actions #4 (lburgazzoli)

* This Changelog was automatically generated by github_changelog_generator