InLong Changelog

Release InLong 1.3.0 - Released (as of 2022-08-23)

Agent

ISSUESummary
INLONG-5540[Bug][Agent] MySQL binlog reader has NPE error
INLONG-5533[Improve][Agent] Support structured output in the Kubernetes
INLONG-5474[Improve][Manager][Agent] Add metadata parameter
INLONG-5466[Improve][Agent] Add Manager Open API secret config
INLONG-5428[Improve][Agent] Abstract metrics interface to be easier to extend
INLONG-5382[Improve][Manager][Agent] Optimized the file collection configuration
INLONG-5362[Feature][Agent] Supports the collection of data splicing metadata information
INLONG-5347[Feature][Agent] Incremental and full reads of file contents
INLONG-5277[Bug][Agent] The getManagerIpList request method should change to POST
INLONG-5272[Improve][Agent] Change agent.sh format
INLONG-5224[Improve][Agent][DataProxy] Remove unused StreamConfigLog related classes
INLONG-5222[Improve][Manager][Agent][DataProxy] Add heartbeat mechanism for Inlong component cluster
INLONG-5164[Bug][Agent] The agent receive count is zero but the send count not
INLONG-5149[Bug][Agent][DataProxy] The log directory for the unit test was incorrect
INLONG-5054[Bug][Agent] Agent can not import old job after reboot
INLONG-5046[Feature][Agent] Support collect data from PostgreSQL
INLONG-4824[Improve][Agent] Log output has no line numbers
INLONG-4821[Bug][Agent] The error of null value for key job.instance.id
INLONG-4535[Feature][Agent] Support configurable automatic exit function when OOM happens
INLONG-4233[Feature][Umbrella] Support collect data from a specified position for MySQL binlog
INLONG-4232[Feature][Agent][Manager] Support collect data from a specified position for MySQL binlog
INLONG-3407[Feature] Make sure job send all messages before it stops
INLONG-3266[Improve][Agent] Get local IP when IP in config is not present
INLONG-5601[Improve][Agent] The default triggering policy for file collection is FULL
INLONG-5259[Feature][Agent] File data sources support custom end-of-line symbols
INLONG-5393[Bug][Agent] Docker image of agent stuck in starting
INLONG-5000[Bug][Agent] The forked VM terminated without properly saying goodbye
INLONG-4998[Bug][Agent] Create PrometheusMetric repeatedly
INLONG-4854[Improve][Agent] Report metrics at inongGroupId and inlongStreamId
INLONG-5589[Improve][Agent] To extend type of file data for k8s log

Audit

ISSUESummary
INLONG-4983[Bug][Audit] Unable to start audit proxy using proxy-start.sh
INLONG-4921[Improve][Audit] Set the configuration file to an absolute path
INLONG-4579[Feature][Audit] Delete redundant configuration in channel and sink
INLONG-4559[Feature][Audit] Support select channels by random routing
INLONG-4919[Bug][Audit] Delete the wrong driver-class-name
INLONG-4741[Feature][Audit] AuditStore support ClickHouse sink
INLONG-5402[Bug][Audit] store-start.sh startup script exception

Dashboard

ISSUESummary
INLONG-5596[Improve][Dashboard] Support locales extends
INLONG-5592[Improve][Dashboard] HighSelect support addonAfter prop
INLONG-5574[Improve][Dashboard] Support extended consumption fields
INLONG-5565[Improve][Dashboard] Support extended group fields
INLONG-5523[Improve][Dashboard] Support menu permission control
INLONG-5522[Improve][Dashboard] Disable editing of user roles and names
INLONG-5520[Improve][Dashboard] Move cluster config to metas
INLONG-5508[Improve][Dashboard] Adaptive naming conventions
INLONG-5479[Improve][Dashboard] Optimize the group configuration process and use meta management
INLONG-5456[Improve][Dashboard] Support source/sink metadata management
INLONG-5391[Improve][Dashboard] Unified consumption creation/management logic
INLONG-5355[Bug][Dashboard] SinkType config error
INLONG-5345[Improve][Dashboard] Group approval supports partial field modification
INLONG-5340[Bug][Dashboard] 404 error is reported when accessing the dashboard container
INLONG-5330[Improve][Dashboard] Stream page optimization adjustment, remove collapse mode
INLONG-5319[Bug][Dashboard] An error occurred while creating the dataproxy cluster
INLONG-5234[Bug][Dashboard] Some fields are missing when creating a new stream
INLONG-5213[Improve][Dashboard] Adapt to the new data structure of the stream list API
INLONG-5142[Improve][Dashboard] Change API paths and parameters to adapt the Manager module
INLONG-5120[Feature][Dashboard] The list page of stream, source and sink supports status filtering
INLONG-5082[Bug][Dashboard] Elasticsearch fields cannot be saved
INLONG-5077[Bug][Dashboard] Cannot read properties of undefined (reading ‘version’)
INLONG-5076[Feature][Dashboard] Support HBase sink
INLONG-5059[Bug][Dashboard] Unable to get total number
INLONG-5056[Bug][Dashboard] Unable to get stream list when creating
INLONG-5004[Feature][Dashboard] Support PostgreSQL sink
INLONG-4997[Improve][Dashboard] Support cluster tag bind and unbind
INLONG-4989[Improve][Dashboard] Modify MySQL sink parameters
INLONG-4953[Improve][Dashboard] Modify Greenplum sink parameters
INLONG-4906[Feature][Dashboard] Support Oracle sink
INLONG-4902[Improve][Dashboard] Supports audit queries with different time precisions
INLONG-4888[Feature][Dashboard] Support MySQL sink
INLONG-4885[Feature][Dashboard] Support Greenplum Sink
INLONG-4876[Improve][Dashboard] Added prompt information on tag modification and deletion
INLONG-4857[Bug][Dashboard] Unable to get stream information
INLONG-4850[Improve][Dashboard] Add prompt information for some fields in cluster management
INLONG-4845[Improve][Dashboard] Update the Tube configuration form
INLONG-4809[Improve][Dashboard] Remove and optimize some old logic
INLONG-4752[Bug][Dashboard] Keyword param error
INLONG-4739[Bug][Dashboard] The pagination of the execution log of the group is invalid
INLONG-4668[Feature][Dashboard] Support the config management of the Elasticsearch sink
INLONG-5406[Bug][Dashboard] No restrictions are added to the input of port numbers, such as dataproxy node
INLONG-5349[Bug][Dashboard] Failed to create stream
INLONG-5035[Improve][Dashboard] Support version control for backend APIs
INLONG-4865[Bug][Dashboard] The storage config can still be modified after submitting for approval
INLONG-4820[Feature][Dashboard] Support cluster tag manage

DataProxy

ISSUESummary
INLONG-5551[Improve][DataProxy] Add metric log output information in TubeSink
INLONG-5538[Improve][DataProxy] Optimize the Producer construction logic in TubeSink
INLONG-5489[Improve][DataProxy] Optimize message deduplication logic
INLONG-5433[Improve][DataProxy] Select the corresponding configuration parameters according to the type of MQ
INLONG-5238[Bug][DataProxy] Error metric params in PulsarZoneSinkContext::addSendFailMetric
INLONG-5192[Improve][DataProxy] Added unit tests for the TubeMQ sink
INLONG-5163[Bug][DataProxy] Dataproxy can not send data to pulsar as topic NotFoundException
INLONG-5161[Improve][SDK] Remove the redundant annotation for the author
INLONG-5055[Bug][DataProxy] Data send failed due to Pulsar client error
INLONG-4816[Bug][DataProxy] Caught IllegalStateException: No tube service url specified
INLONG-4803[Bug][DataProxy] Caught IllegalStateException: No pulsar server url specified

Manager

ISSUESummary
INLONG-5585[Bug][Manager] Some errors of inlong stream API and user API
INLONG-5577[Feature][Manager][Sort] Support function fieldType
INLONG-5570[Improve][Manager] Add manager client packages into the lib directory
INLONG-5559[Feature][Manager] Supplement the workflow approver API in the manager client
INLONG-5555[Bug][Manager] Fix missing heartbeat fields and stream source subtask creation
INLONG-5536[Bug][Manager] Client api version missing on stream info update
INLONG-5529[Bug][Manager] Fix the error of version not set before updating operation
INLONG-5517[Bug][Manager] Manager client does not write back the version when updating info
INLONG-5515[Bug][Manager] Repair type of form_data when data too long
INLONG-5501[Bug][Manager] Repair type of workflow_process.form_data when data too long
INLONG-5499[Bug][Manager] The data source is successful, but the status always is issued or added
INLONG-5497[Bug][Manager] DataProxyConfigRepository get error field name
INLONG-5493[Feature][Manager] Supplement the user API in the manager client
INLONG-5491[Bug][Manager] Pulsar failed to configure non partitioned topic
INLONG-5476[Bug][Manager] Heartbeat is not functioning properly under sparse report
INLONG-5452[Improve][Manager] Change creating resource after group approval to be asynchronous
INLONG-5432[Improve][Manager] Return the type of the MQ cluster when processing the getConfig method
INLONG-5424[Bug][Manager] JSON serialization error for Authentication when getting inlongGroupInfo
INLONG-5419[Bug][Manager] Pulsar creates a specified queue model's error
INLONG-5411[Improve][Manager] Optimize the creation code of databases and tables of PostgreSQL
INLONG-5409[Bug][Manager] Fix JSON serialization for class BaseSortConf
INLONG-5401[Bug][Manager] Fix the problem that StreamSinkFieldEntity and SinkField fields do not match
INLONG-5397[Feature][Manager] Add delete resource in manager client
INLONG-5394[Feature][Manager] Support batch task for Inlong group
INLONG-5387[Feature][Manager][Sort] Support encrypt records
INLONG-5380[Feature][Manager] Modify the saving function of the data node
INLONG-5369[Improve][Manager] Optimize the user service related function to support third party authentication and authorization plugin
INLONG-5368[Bug][Manager] Update workflow approver error
INLONG-5359[Improve][Manager] Add query workflow approver API
INLONG-5337[Improve][Manager] Add Agent cluster info and operator
INLONG-5335[Improve][Manager] Unserialize Sort config when getting GroupInfo
INLONG-5333[Improve][Manager] Add array, map, struct, and decimal format
INLONG-5324[Improve][Manager] Optimize configuration files and scripts
INLONG-5308[Improve][Dashboard] Change MQ and cluster type to adapt the Manager module
INLONG-5305[Improve][Manager] Change the type enum that needs to be extended to a string constant
INLONG-5296[Improve][Manager] Add fields for DataProxy cluster info
INLONG-5286[Improve][Manager] Move pojo classes into the manager-pojo module
INLONG-5285[Improve][Manager] Support custom query for group, stream, source and sink
INLONG-5283[Improve][Manager] OpenAPI authentication should not be mandatory
INLONG-5279[Improve][Manager] Optimize the creation code of databases and tables, including Oracle and MySQL
INLONG-5269[Feature][Manager] Workflow supports rapid scaling of MQ resources
INLONG-5264[Improve][Manager] Remove unused StreamConfigLog related classes and tables
INLONG-5246[Bug][Manager] Agent gets dataproxy list and always returns empty
INLONG-5245[Improve][Manager] Optimize the URI paths of the WebAPI and OpenAPI
INLONG-5240[Improve][Manager] Unify the workflow approver and process classes and tables
INLONG-5232[Improve][Manager] Unify the user and role tables
INLONG-5228[Feature][Manager] Support create SQLServer databases and tables
INLONG-5219[Bug][Manager] The inlong group is still pending approval after approval
INLONG-5212[Feature][Manager] Merge the Selector classes into their related Listeners
INLONG-5203[Improve][Manager] Refactor the user interface
INLONG-5201[Bug][Manager] The inlong group cannot be updated normally after the approval is successful
INLONG-5194[Improve][Manager] Update MD5 hashing to SHA-256
INLONG-5188[Bug][Manager] Create group workflow fail
INLONG-5184[Improve][Manager] Add more info for some error logs
INLONG-5178[Improve][Manager] There is so much Warning info when compiling the Manager module
INLONG-5175[Improve][Manager] Remove redundant StreamSinkExt table and classes
INLONG-5167[Feature][Manager] OpenAPI authentication support
INLONG-5166[Bug][Manager] Cluster tags are not separated by commas when querying clusters
INLONG-5165[Bug][Manager] Getting Sort source collects wrong topic properties of each stream
INLONG-5157[Bug][Manager] Failed to build Sort config as the relations is empty
INLONG-5148[Improve][Manager] Handle the lightweight and standard inlong groups differently in workflow
INLONG-5144[Bug][Manager] Fail to execute Group-InitSort
INLONG-5137[Bug][Manager] The API to get the group list loses the mqType field
INLONG-5136[Improve][Manager] Update the get DataProxy cluster nodes API
INLONG-5127[Improve][Manager] Rename second_xxx to backup_xxx in sort-standalone management interface
INLONG-5112[Improve][Manager] Improve creating Pulsar topic by using the lookups method
INLONG-5104[Improve][Manager] Update Flink address environment for Sort Flink plugin
INLONG-5103[Feature][Manager] Add constant field support for stream source and transform node
INLONG-5088[Feature][Manager] Support only consumes the MQ cluster with the same tag
INLONG-5086[Feature][Manager] Support create Oracle databases and tables
INLONG-5085[Feature][Manager] Support create MySQL databases and tables
INLONG-5070[Feature][Manager] Add more parameter settings support for stream source
INLONG-5066[Improve][Manager] Remove the LightGroup-related workflow listener and definitions
INLONG-5052[Bug][Manager] The workflow that failed to execute still failed, but returned success
INLONG-5031[Improve][Manager] Encryption saves all password fields
INLONG-5026[Improve][Manager] The unit test code contains a real IP address
INLONG-5018[Feature][Manager] Support for Tube data sources
INLONG-4993[Improve][Manager] Return details when querying a list of StreamSources
INLONG-4974[Umbrella][Manager] Support create sink resource
INLONG-4965[Improve][Manager] Eliminate NullPointerException on user management
INLONG-4951[Bug][Manger] Unable to save the change when updating the chargers of cluster tag
INLONG-4949[Feature][Manager] Support to extend different types of Sort protocol
INLONG-3922[Feature][Manager] Fetch source failed and update task status through heartbeat
INLONG-5442[Bug][Manager] Fix accept logic error for SortConfigListener
INLONG-5299[Improve][Manager] Remove redundant configuration and class files
INLONG-5371[Feature][Manager] Supplement the data node API in the manager client
INLONG-5029[Umbrella][Manager] Unify the InlongGroup workflow
INLONG-5020[Improve][Manager] Refactoring InnerInlongManagerClient of manager client
INLONG-5007[Feature][Manager] Client supports getting sink details by id
INLONG-5006[Improve][Manager] Return details when querying a list of StreamSinks
INLONG-4897[Improve][Manager] Change length of field name
INLONG-4928[Feature][Manager] Supplement or modify the inlong stream api in the manager client

Sort

ISSUESummary
INLONG-5580[Feature][Sort] Add InlongMetric interface for extract and load nodes
INLONG-5576[Feature][Sort] Add redis extract node and support temporal join
INLONG-5488[Feature][Sort] Add metric for Iceberg and DLC with Flink metrics group and audit SDK
INLONG-5485[Feature][Sort] Support JSON UDF getter and JSON getter function
INLONG-5484[Feature][Sort] Add audit info for Elasticsearch 6 connector and report metric when delete mode
INLONG-5478[Improve][Sort] MySQL connector lost inlong metric feature for no primary key table
INLONG-5470[Bug][Sort] Fix compile error
INLONG-5464[Improve][Sort] Optimize the implementation of the sort-connector-base metric common abstract
INLONG-5463[Feature][Sort] Add audit for HBase load node
INLONG-5462[Feature][Sort] Add audit for Oracle extract Node
INLONG-5461[Feature][Sort] Add audit for MongoDB extract node
INLONG-5460[Feature][Sort] Add audit for PostgreSQL extract node
INLONG-5448[Improve][Sort] Optimize cls callback when send failed
INLONG-5447[Feature][Sort] Add lookup support for Redis
INLONG-5423[Feature][SortStandalone] Revise invalid partition time when dispatch messages
INLONG-5404[Bug][Sort] Fix EncryptFunction checkstyle
INLONG-5377[Feature][Sort] Add reporting metrics for kafka connector sink
INLONG-5375[Improve][Sort] Iceberg-inlong connector lose its meta-inf
INLONG-5352[Feature][Sort] Add audit report for Pulsar source
INLONG-5327[Bug][Sort] Lack of service file of Inlong Pb format msg
INLONG-5262[Feature][Sort] Add metric report for Pulsar source
INLONG-5242[Feature][Sort] Add metric computing for Oracle and MongoDB
INLONG-5215[Bug][TubeMQ] Initialization script init-tube-cluster.sh execution error
INLONG-5211[Improve][Sort] Replace 1.3.0-snapshot with inlong-version
INLONG-5210[Feature][Sort] Add reporting metrics for Elasticsearch 7 connector and audit SDK
INLONG-5205[Feature][Sort] Add reporting metrics for Elasticsearch 6 connector
INLONG-5169[Bug][Sort] Metrics of HBaseSinkFunction are not collected accurately
INLONG-5158[Feature][Sort] Add metric for Kafka source with Flink metrics group and audit SDK
INLONG-5156[Feature][Sort] Add metric for SQLServer source with Flink metrics group and audit SDK
INLONG-5152[Feature][Manager][Sort] Add union parse support for FlinkSqlParser
INLONG-5119[Feature][Sort] Import all changelog mode data ingest into Kafka
INLONG-5117[Feature][Sort-Standalone] Support specify component type from remote config
INLONG-5100[Feature][Sort] Add reporting metrics for JDBC
INLONG-5094[Feature][SortStandalone] Implements time interval interceptor
INLONG-5072[Feature][Sort] Add metric computing of MySQL and PostgreSQL and HBase for user query metric by label
INLONG-5068[Bug][Sort] Fix RegexpReplace replacing uncorrectly
INLONG-4892[Bug][Sort] Sort connector package without own Factory files
INLONG-4858[Bug][Sort] Building connectors twice without clean command causes failures
INLONG-4815[Improve][Sort] Supporting field type cast when sinking data to HBase
INLONG-4808[Feature][InLong] Extract end-to-end testing capabilities
INLONG-4807[Feature][Sort] CSV deserialization schema support process data whose input field length unmatch the register table
INLONG-4806[Feature][Sort] Sort support pb format deserializationSchema
INLONG-4751[Improve][Sort] Optimize the metadata implementation of Extract Nodes and Load Nodes
INLONG-4735[Improve][Sort] Add precision support for DecimalFormatInfo,TimeFormatInfo
INLONG-4732[Bug][Sort] Table not found when Iceberg commit Hive table
INLONG-4730[Bug] [Sort] Fix meta field format is null when parse json to sql
INLONG-4693[Bug] [Sort] Fix DLC connector maven package problem
INLONG-4685[Improve][Sort] Add data type convert implicitly support
INLONG-4678[Improve][Sort] Add util class of parsing meta info for data node
INLONG-4665[Improve][Sort] The primary key of the MongoDB CDC connector must be _id
INLONG-4659[Feature][Sort] Support routing field for Elasticsearch connector
INLONG-4650[Bug][Sort] Iceberg connector not found the Hive classpath
INLONG-4431[Feature][Sort] Sort lightwieght support load data to DLC
INLONG-4166[Feature][Sort] Add metrics test
INLONG-4894[Feature][Sort] Add TubeMQ extract node
INLONG-4890[Feature][Sort] Support TubeMQ connector
INLONG-5315[Feature][Sort] Import all changelog mode data ingest into JDBC
INLONG-5312[Feature][Sort] Add unified inlong.metric parameter injection support for nodes
INLONG-5451[Improve][Sort] kafka sink use customized partitioner
INLONG-5446[Feature][Sort] Add reporting metric from JDBC to audit SDK and refactor according to connector-base
INLONG-5353[Bug][Sort] Fix HBase connector packaging problem and inlong metrics delimiter problem
INLONG-5217[Feature][Sort] Add connector-base component for common code
INLONG-5074[Improve][Sort] KafkaExtractNode support more StartupMode
INLONG-5012[Improve][Sort] Remove the duplicate declaration of elasticsearch7
INLONG-4943[Improve][Sort] Remove redundant information in licenses
INLONG-4726[Feature][SortStandalone] Support ClickHouse sink
INLONG-4763[Feature][Sort] Import sort end2end unit test with sql file input
INLONG-4670[Improve][Sort] Update the README.md for the sort
INLONG-4777[Feature][Sort-Standalone] Change ack policy from checking message count to checking every message

SDK

ISSUESummary
INLONG-5496[Improve][SDK] Refactor single topic manager in Sort SDK
INLONG-5418[Feature][SDK] Sort SDK support seek topic or partitions to a given timestamp
INLONG-5270[Feature][SDK] Add unit tests and manual for DataProxy C++ SDK
INLONG-5267[Feature][SDK] Add config file and demo for DataProxy C++ SDK
INLONG-5265[Feature][SDK] Build config for DataProxy C++ SDK
INLONG-5256[Feature][SDK] Support network operation and management for DataProxy C++ SDK
INLONG-5253[Feature][SDK] Support buffer manager for DataProxy C++ SDK
INLONG-5251[Feature][SDK] Add proxy client config and proxylist manager for DataProxy SDK(C++)
INLONG-5249[Feature][SDK] Add DataProxy SDK(C++) utils file
INLONG-5160[Improve][DataProxy-SDK] Update DataProxy cluster API and response parsing method
INLONG-5095[Feature][SortSDK] Support consume stream from a certain time
INLONG-5092[Feature][SDK] Change Kafka default partition assignment strategy to RangeAssignor
INLONG-4995[Improve][SDK] The md5 digest is not secure and triggers a CodeQL warning.
INLONG-4884[Bug][SortSDK] Fix data duplicated problem when default ackTimeout value of Pulsar consumer is not 0
INLONG-4871[Bug][SDK] The generateMd5 method generate md2 not md5
INLONG-4790[Improve][DataProxySDK] Replace DES with a more secure encryption algorithm
INLONG-5258[Feature][SDK] Add core interface for DataProxy C++ SDK

TubeMQ

ISSUESummary
INLONG-5567[Bug][TubeMQ] Master start failed with NullPointerException
INLONG-5435[TubeMQ] Adjust the parameter requirements in Audit and Prometheus sections
INLONG-5386[Feature][TubeMQ] Supports reporting metrics data through Prometheus
INLONG-5373[Feature][TubeMQ] Supports outputting traffic information through the audit SDK
INLONG-5314[Bug][TubeMQ] When a non-master node is configured in the first position of the address, the service cannot be started
INLONG-5303[Improve][TubeMQ] Simplify flush check for appendMsg in FileMsgStore
INLONG-5281[Bug][TubeMQ] After running for a period of time, it has been unable to connect to the broker
INLONG-5138[Bug][TubeMQ] compile error with gcc >= 8.0 on rapidjson
INLONG-5097[Bug][TubeMQ] The protocol from 1.1.0 and later is not smoothly compatible with previous versions
INLONG-5087[Bug][TubeMQ] In MySQL 5.7 initialize the database failure: Unknown collation ‘utf8mb4_0900_ai_ci’
INLONG-4942[Improve][TubeMQ] Add the display of the IP address of consumer
INLONG-4934[Bug][TubeMQ] Reversed value for admin_enable_stats methods
INLONG-4927[TubeMQ] Add version info in history offset record
INLONG-4924[TubeMQ] Add admin_get_methods method
INLONG-4883[TubeMQ] No error report for incorrect topic subscription
INLONG-4805[Bug][TubeMQ] Tube-Manager startup failed
INLONG-4721[TubeMQ] Remove the “incubat*” tag in the tubemq-go-sdk code
INLONG-4664[Feature][TubeMQ] Add GroupController and TopicBackendWorker
INLONG-4551[Feature][TubeMQ] Batch delete consumer groups and authorized consumer groups from the blacklist
INLONG-4123[BUG][TubeMQ] All images can not work when using go example
INLONG-5282[TubeMQ] An error when deploying tubemq-manager according to the documentation on the official website

Other

ISSUESummary
INLONG-5583[Improve][K8S] Add timezone to helm chart
INLONG-5553[Imporve][Common] Adjust the log output level of MetricListenerRunnable
INLONG-5527[Improve][Docker] Add configmap.yaml for MySQL
INLONG-5439[Bug][Docker] Fix arm docker build script
INLONG-5294[Improve][CVE] Upgrade gson version due to CVE
INLONG-5292[Improve][CVE] Upgrade shiro version due to CVE
INLONG-5207[Improve][K8S] Add components for helm chart
INLONG-5190[Bug][Build] The build of InLong is missing some packages
INLONG-5182[Improve][CI] Upgrade apache-rat-plugin to compatible with parallel builds
INLONG-5179[Bug][K8S] External mysql information has not been used in manager
INLONG-5154[Improve][Doc] Update the architecture image
INLONG-5124[Improve] Add initial sort connectors to the manager docker image
INLONG-5115[Improve][Pom] There are redundant agent dependencies in Distribution
INLONG-5098[Improve][CI] Use maven parallel build feature to improve project workflow build speed
INLONG-5064[Improve][CI] Decrease Vulnerabilities Scan run time
INLONG-5016[Improve][CI] Improve Vulnerabilities Scan build speed
INLONG-5009[Bug][Docker] Dataproxy proc cannot startup
INLONG-4991[Improve] Update the lables for CI/CD workflows
INLONG-4977[Bug][K8s] Divide persistent volume claim by statefulsets
INLONG-4910[Improve][CI] CI_docker runs time too long
INLONG-4862[Improve][Docker] Add publish images by arch and push manifest script
INLONG-4838[Improve][Docker] Add MQ Type environment for Audit and DataProxy
INLONG-4827[Improve][Kubernets] Add Flink config into the YAML files
INLONG-4826[Bug][K8s] Helm upgrade inlong failed
INLONG-4769[Bug][CI] Error trigger conditions in the docker workflow
INLONG-4758[Improve][Doc] Command-line codes in README should remove the leading $ sign
INLONG-4746[Website] Modify the how-to-vote-a-committer-pmc file
INLONG-4737[Doc] Remove “(Incubating)” tag in licenses dirs
INLONG-4727[Doc] Update InLong project link in readme and pom.xml
INLONG-4724[Pom] Change version to 1.3.0-SNAPSHOT
INLONG-4719[Improve][All] Remove commons-lang 2.6 dependency
INLONG-4717[Doc] Remove DISCLAIMER file
INLONG-4716[Bug][Doc] 404 issue for document links in guides
INLONG-4710[Improve][Website] Modify how to release and verify
INLONG-4708[Website] Modify the “(incubating)” tag associated with the link
INLONG-4702[Umbrella][Website][Doc] Remove incubation related content information
INLONG-4698[Improve][Doc] Update the definitions and features to make them accurate
INLONG-4696[Improve][Doc] Update the supported data nodes
INLONG-4673[Feature][Docker] Support for building Docker images for the ARM architecture
INLONG-4653[Improve][CI] Add concurrency support on GitHub Actions
INLONG-4636[Feature][CI] Add check PR title workflow
INLONG-4616[Improve][Office-Website] Set Apache events on footer
INLONG-4606[Improve][CI] Improve the trigger conditions of the Docker image build
INLONG-2440[Improve] add a workflow to Scan InLong common vulnerabilities
INLONG-1831[Feature] Add official website content search button

Release InLong 1.2.0-incubating - Released (as of 2022-06-08)

Agent

ISSUESummary
INLONG-4483[Bug][Agent] Many ConnectException logs in unit test of Kafka source
INLONG-4193[Improve][Agent] Add Java docs
INLONG-4112[Feature][Agent] Support collect data from a specified position for MySQL binlog
INLONG-2563[Feature][Agent] Move public domain from agent to agent-common
INLONG-4397[Feature][Agent] Supports collect of full data for file type
INLONG-4359[Improve][Agent] Simplify agent process commands
INLONG-4292[Improve][Agent][TubeMQ][Sort] Upgrade the property file for all modules from log4j to log4j2
INLONG-4283[Bug][Agent] The kafka-clients with 3.0.0 does not package to the jar
INLONG-4235[Bug][Agent] Config the log info for unit tests of the agent plugin

Audit

ISSUESummary
INLONG-4594[Improve][Audit] Make Elasticsearch authentication configurable
INLONG-4520[Improve][Audit] Audit-proxy supports Pulsar authenticate
INLONG-4477[Improve][Audit] Audit-store supports Pulsar authenticate
INLONG-3895[Bug][Audit] Proxy store startup script log path error
INLONG-3853[Bug][Audit] audit can not start for script bug

Dashboard

ISSUESummary
INLONG-4612[Improve][Dashboard][Manager] Iceberg sink configuration protocol key update
INLONG-4610[Improve][Dashboard] Save sink fields failed
INLONG-4588[Improve][Dashboard] Approval management splits different routes
INLONG-4580[Bug][Dashboard] File source IP and Hive conf dir are mandatory
INLONG-4577[Feature][Dashboard] Support TubeMQ cluster management
INLONG-4550[Feature][Dashboard] Support DataProxy Cluster and Node management
INLONG-4544[Improve][Dashboard] Pulsar Cluster support tenant param
INLONG-4523[Feature][Dashboard] Support Clusters Module
INLONG-4500[Improve][Manager][Dashboard] Remove non-null restriction on hiveConfDir parameter
INLONG-4436[Bug][Dashboard] Hive Sink confDir parameter tooltip error
INLONG-4488[Improve][Dashboard] Remove useless modules
INLONG-4423[Improve][Dashboard] Hive Sink adds hiveConfDir parameter
INLONG-4319[Improve][Dashboard] Approve page support cluster info
INLONG-4284[Improve][Dashboard] Modify ClickHouse sink parameters
INLONG-4274[Improve][Dashboard] Update the parameters to adapt the manager module
INLONG-4218[Feature][Dashboard] Unified group page
INLONG-4119[Improve][Dashboard] Change the keyWord to keyword in query request params
INLONG-4102[Improve][Dashboard] Add tooltip for dataPath of the Hive sink
INLONG-4089[Feature][Dashboard] Create ClickHouse sink need to fill more params
INLONG-4031[Bug][Dashboard] Kafka sink storage topic partitionNum key error
INLONG-4028[Bug][Dashboard] ClickHouse types do not match what ClickHouse using
INLONG-3938[Bug][Dashboard] CI workflow build failed incidentally
INLONG-3851[Improve][Dashboard] Unify the naming of data streams

DataProxy

ISSUESummary
INLONG-4521[Improve][DataProxy][Manager] Change the naming of third-party cluster related classes
INLONG-4056[Feature][DataProxy] Return the response to the SDK/Agent after saving the event to the cache cluster

Manager

ISSUESummary
INLONG-4648[Improve][Manager] Read the path of Sort connectors from configuration file
INLONG-4626[Improve][Manager] Remove redundant connector sub directory
INLONG-4622[Bug][Manager] Append db name in JDBC URL for load node
INLONG-4615[Improve][Manager] PluginClassLoader adapts to the Windows system
INLONG-4612[Improve][Dashboard][Manager] Iceberg sink configuration protocol key update
INLONG-4607[Bug][Manager] Add ClickHouse field types for FormatInfo
INLONG-4601[Bug][Manager] The fieldList in SinkRequest should be changed to sinkFieldList
INLONG-4598[Bug][Manager] Pulsar topic incorrect
INLONG-4586[Improve][Manager] Fix redefined streamFields in stream source
INLONG-4583[Bug][Manager] Query InlongGroup info error from the browser
INLONG-4563[Feature][Manager] Support create TubeMQ resources by its origin APIs
INLONG-4556[Improve][Manager] Optimize ProcessorExecutor Logic
INLONG-4552[Improve][Manager] Add composite index for table in DDL
INLONG-4543[Improve][Manager] Query MQ clusters from inlong cluster table
INLONG-4541[Feature][Manager] Support save extension params for inlong cluster
INLONG-4534[Improve][Manager] Add complete unit test to create data flow
INLONG-4532[Improve][Manager] Init sort config error during initing group info in the client
INLONG-4529[Improve][Manager] Fix PluginClassLoader unit test error
INLONG-4528[Feature][Manager] Support Greenplum sink
INLONG-4521[Improve][DataProxy][Manager] Change the naming of third-party cluster related classes
INLONG-4519[Feature][Manager] Support Elasticsearch sink
INLONG-4516[Improve][Manager] Get the MQ cluster for data proxy from the inlong cluster table
INLONG-4513[Improve][Manager] Add Iceberg and HBase examples for the manager client
INLONG-4512[Improve][Manager] Remove third_party_cluster and data_proxy_cluster tables
INLONG-4510[Improve][Manager] Remove GsonUtils, InlongParser, and Gson dependency
INLONG-4508[Improve][Manager] Remove the management of the DB and file servers' config
INLONG-4505[Improve][Manager] Improve the return information of validation rules
INLONG-4503[Bug][Manager] Client executes request error
INLONG-4500[Improve][Manager][Dashboard] Remove non-null restriction on hiveConfDir parameter
INLONG-4497[Improve][Manager] Fix deleteGroup Async method in Client
INLONG-4487[Improve][Manager] Fix json parse exception for streamSource/streamSink
INLONG-4481[Improve][Manager] Restore iceberg fields that may still have dependents
INLONG-4473[Bug][Manager] DuplicateKeyException when save StreamSinkField
INLONG-4471[Improve][Manager] Fix json parse exception in Client
INLONG-4468[Improve][Manager] Use config url to create pulsar admin
INLONG-4466[Bug][Manager] The Oracle data source could not be parsed
INLONG-4464[Improve][Manager] Fix problems emerged from full link path test
INLONG-4462[Improve][Manager] Fix NPE when parsing pageInfo in manager client
INLONG-4476[Improve][Sort][Manager] Remove zk and related classes
INLONG-4458[Improve][Sort][Manager] Unify the meta field naming
INLONG-4445[Improve][Manager] Change the relationship to relation to adapt the Sort protocol
INLONG-4443[Improve][Manager] Remove some deprecated classes
INLONG-4439[Improve][Manager] Refactor gson adapter for managerctl
INLONG-4438[Bug][Manager] Caught BusinessException when deploy InLong cluster firstly
INLONG-4428[Improve][Sort][Manager] Optimize the name for Data Node related modules and classes
INLONG-4427[Improve][Manager] The manager-client module reuses the source classes in manager-common
INLONG-4421[Improve][Manager] Remove unused classes and table structures
INLONG-4419[Improve][Manager] The manager-client module reuses the sink classes in manager-common
INLONG-4417[Improve][Manager] Manager print error logs when deploy by docker-compose
INLONG-4414[Feature][Manager] Support MySQL data sink
INLONG-4408[Feature][Manager][Sort] Add iceberg sink load node
INLONG-4406[Improve][Manager] Fix InlongGroupInfo parse exception
INLONG-4398[Bug][Manager] Status display incomplete for managerctl
INLONG-4388[Bug][Manager] Elasticsearch create command scaling_factor use wrong mapping info
INLONG-4384[Improve][Manager] Store the specific field params of the Iceberg to extParams
INLONG-4381[Improve][Manager] Optimize client http request
INLONG-4377[Feature][Manager] Add hbase and elasticsearch sink type support in manager client sdk
INLONG-4376[Feature][Manager] Support SqlServer sink
INLONG-4369[Improve][Manager] Support for modification of information after approval
INLONG-4364[Improve][Manager] Optimize sort protocol
INLONG-4362[Bug][Manager] Lack of flink dependencies for inlong-manager/manager-plugins
INLONG-4361[Improve][Manager] Refactor the manager client module
INLONG-4358[Feature][Manager] Support SqlServer source
INLONG-4337[Improve][Manager] Remove inlong group pulsar related tables and classes
INLONG-4332[Feature][Manager][Sort] Support ClickHouse load node
INLONG-4325[Bug][Manager] Register sql function exception
INLONG-4315[Bug][Manager] Incorrect task service node order in create-group workflow
INLONG-4310[Feature][Manager] Manager-plugin adapt changes in sort entrance
INLONG-4309[Feature][Manager] Supplement hbase dependencies and license file
INLONG-4301[Feature][Manager] Support oracle source
INLONG-4300[Improve][Manager] Autowired the workflow resources to simply the bean management
INLONG-4299[Improve][Manager] Add InlongStreamExtensionInfo
INLONG-4295[Improve][Manager] Add Json sub type support for InlongGroupInfo
INLONG-4280[Feature][Manager] Add params for Iceberg sink
INLONG-4278[Improve][Manager] Support pulsar extract node in Manager
INLONG-4273[Feature][Manager] Add MongoDB source support
INLONG-4270[Feature][Manager] Inlong group supports extensions of different types of MQ
INLONG-4263[Feature][Manager] Support HBase sink resource creation
INLONG-4254[Bug][Manager] Lack of flink dependencies for inlong-manager/manager-plugins
INLONG-4247[Improve][Manager] Add stream create/suspend/restart/delete api
INLONG-4245[Improve][Manager][Sort] Manager transmit consumer group name of kafka to sort
INLONG-4240[Feature][Manager] Add postgres source and sink node configuration utils
INLONG-4239[Improve][Manager] Remove fastjson dependency
INLONG-4236[Feature][Manager] Support operating the indices and mappings for Elasticsearch
INLONG-4228[Feature][Sort][Manager] Adaptive HDFS Load Node
INLONG-4223[Improve][Manager] Refactor the consumption table structure
INLONG-4221[Improve][Manager] Remove duplicate serializationType in KafkaSourceListResponse
INLONG-4220[Feature][Manager] Add StreamResourceProcessForm
INLONG-4212[Bug][Manager] The processor executor maybe throws a null pointer exception
INLONG-4208[Improve][Manager] Merge UpdateGroupProcessForm into GroupResourceProcessForm
INLONG-4203[Improve][Manager] Improve the HTTP request and response parse
INLONG-4197[Feature][Manager] Add Hbase sink info and load node utils
INLONG-4194[Improve][Manager] Add update sort config API in manager client
INLONG-4188[Improve][Manager] Check whether the stream exists in the manager client
INLONG-4186[Improve][Manager] Add token field in cluster and node table
INLONG-4183[Improve][Manager] Fix splitFields in manager service
INLONG-4181[Improve][Manager]Fix transform update api
INLONG-4179[Improve][Manager] Add comments in manager modules
INLONG-4177[Feature][Manager] Refactor getSortClusterConfig interface
INLONG-4168[Feature][Manager] Update inlong_group table schema
INLONG-4164[Improve][Manager] Migrate the use of third_party_cluster table to inlong_cluster table
INLONG-4155[Improve][Manager] Change constants and remove clone method in WorkflowContext
INLONG-4146[Feature][Manager] Get DataProxy configuration data from inlong_cluster table
INLONG-4142[Improve][Manager] Improve ServiceTask clone method
INLONG-4139[Improve][Manager] Query inlong group by the status list in manager client
INLONG-4133[Improve][Manager] Not pass the type field when querying sources and sinks
INLONG-4128[Improve][Manager] Abstracting the logic for creating Hive tables
INLONG-4120[Improve][Manager] Change the keyWord to keyword in query params
INLONG-4118[Improve][Manager] It should not return an empty list when paging the auto-push source
INLONG-4110[Improve][Manager] Create cascade function wrapper
INLONG-4108[Improve][Manager] Merge two enums of manager
INLONG-4105[Improve][Manager] Refactor the sink workflow and sink resource operator
INLONG-4100[Improve][Manager] Add id in update request for source/sink/transform
INLONG-4099[Feature][Manager] Support iceberg stream sink resource operator
INLONG-4095[Bug][Manager] Managerctl unit test error and characters are not aligned
INLONG-4092[Improve][Manager] Add primary key in Kafka source
INLONG-4085[Improve][Manager] Change the inlong_group and inlong_stream table structure
INLONG-4084[Improve][Manager] Add some fields for stream_source and stream_sink
INLONG-4078[Improve][Manager] Add notes for manager client api
INLONG-4077[Improve][Manager] Implement the APIs of data node management
INLONG-4071[Feature][Manager] Add data cluster table
INLONG-4070[Improve][Manager] Add update api In Inlong stream
INLONG-4069[Improve][Manager] Add ext_tag field for inlong cluster table
INLONG-4067[Improve][Manager] Optimize fieldRelationShip in split transform
INLONG-4063[Umbrella][Manager] Refactor the inlong group interfaces to support easily extending different MQs
INLONG-4060[Improve][Manager] Fix NodeUtils for sort
INLONG-4052[Improve][Manager] Remove zone tag field of inlong cluster table
INLONG-4046[Feature][Manager] Fix Filter Function of Join node
INLONG-4042[Improve][Manager] Add properties in MysqlExtractNode for migrating all databases
INLONG-4040[Bug][Manager] Hive sink table path config error
INLONG-4034[Improve][Manager] Add originFieldName in StreamField
INLONG-4026[Improve][Manager] Fix field type of StreamSourceFieldMapper
INLONG-4017[Bug][Manager] Fix DataType deserialized exception
INLONG-4012[Feature][Manager] Add kafka sink resource operator
INLONG-4000[Improve][Manager] Refactor the implementations of heartbeat interfaces
INLONG-3993[Improve][Manager] Support HiveLoadNode in light mode
INLONG-3981[Improve][Manager] Fix status check of lightweight Group
INLONG-3958[Improve][Manager] Fix NPEs in manager service
INLONG-3951[Bug][Manager] Unique index error for cluster_name in SQL file
INLONG-3947[Improve][Manager] Support blank middleware
INLONG-3946[Improve][Manager] Implement the APIs of cluster management
INLONG-3943[Feature][Manager] Add inlong_cluster and inlong_cluster_node tables
INLONG-3942[Umbrella][Manager] Provides cluster management features for the InLong
INLONG-3929[Improve][Manager] Support deDuplicate transform in manager
INLONG-3921[Improve][Manager] Add primary key in Kafka source
INLONG-3920[Improve][Manager] Add primary key in Binlog source
INLONG-3919[Improve][Manager] Data consumption and data source module supports access control
INLONG-3915[Bug][Manager] Missing delete flag on entity creation
INLONG-3888[Bug][Manager] The method of batchSaveAll occurred error as the sink_name was null
INLONG-3883[Feature][Manager] Support create table of ClickHouse
INLONG-3879[Improve][Manager] Update status enum for group, stream, source, and sink
INLONG-3876[Bug][Manager] The managerctl tool crashes when lunches with -h or --help argument
INLONG-3874[Improve][Manager] Abstract the operator class for creating Sink resources
INLONG-3866[Improve][Manager] Rename the third-party package to resource
INLONG-3861[Improve][Manager] Support the expansion of TubeMQ, Pulsar, or other message queues
INLONG-3858[Bug][Manager] The other admin role can not list all inlong group info and stream info
INLONG-3856[Feature][Manager] Add heartbeat report handler
INLONG-3855[Feature][Manager] Add lightweight mode for inlong group
INLONG-3782[Improve][Manager] Improve the log configuration
INLONG-3776[Improve][Manager] Update the third-party components LICENSEs
INLONG-3775[Improve][Manager] Add a specific meaning for the managerctl status output
INLONG-3731[Improve][Manager] Make state more abstract for managerctl
INLONG-3719[Feature][Manager] Support data_transformation feature
INLONG-3698[Feature][Manager] Support complex data type distribution for hive-sink
INLONG-3636[Improve][Manager] Fix the warning logs during the build
INLONG-3392[Improve][Manager] Optimize groupName and groupId
INLONG-3238[Bug][Manager] The data grouping list cannot be edited?
INLONG-2901[Bug][Manager] Maven cannot run test classes
INLONG-2544[Improve][Manager] Refactor the CreateStreamWorkflowDefinition
INLONG-2305[Feature][Manager] Add Cluster Management for MQ/DataProxy/Sort Cluster
INLONG-1858[Bug][Manager] Adding columns to a Hive table does not take effect

SDK

ISSUESummary
INLONG-4400[Improve][SDK] Unified dataproxy sdk clusterId property name
INLONG-4354[Bug][SDK] ProxyConfigEntry cluster id NPE

Sort

ISSUESummary
INLONG-4647[Improve][Sort] Re-optimize the distribution package of the Sort connectors
INLONG-4638[Improve][Sort] Remove the dependency of spotbugs-annotations
INLONG-4624[Improve][Sort] Package Pulsar and Hive connectors to the same file
INLONG-4619[Bug][Sort] Fix maven package problem of Hive connector
INLONG-4596[Bug][Sort] Fix jdbc-connector packaging lost dependency
INLONG-4591[Bug][Sort] Set the default Hive version and upgrade the log4j to log4j2
INLONG-4557[Bug][Sort] Fix HBase connector dependency and pom relocation problem
INLONG-4527[Improve][Sort] Upgrade the Elasticsearch version and add related license
INLONG-4493[Improve][Sort] Remove hiveConfDir not null constraint
INLONG-4491[Bug][Sort] Missing dependencies after packaging for sort-dist module
INLONG-4476[Improve][Sort][Manager] Remove zk and related classes
INLONG-4458[Improve][Sort][Manager] Unify the meta field naming
INLONG-4448[Feature][Sort] Add Greenplum database data load support
INLONG-4429[Improve][Sort] Add sqlserver jdbc driver and management version
INLONG-4428[Improve][Sort][Manager] Optimize the name for Data Node related modules and classes
INLONG-4408[Feature][Manager][Sort] Add iceberg sink load node
INLONG-4405[Feature][Sort] Support run SQL script
INLONG-4394[Feature][Sort] Add Oracle data load support
INLONG-4390[Bug][Sort] Exclude mysql:mysql-connector-java:jar package
INLONG-4385[Bug][Sort] Exclude or remove the mysql:mysql-connector-java:jar:8.0.21 package
INLONG-4383[Feature][Sort] Add MySQL data load support
INLONG-4371[Bug][Sort] Remove null constraint on Hive version
INLONG-4353[Improve][Sort] Optimize code structure and shading jar
INLONG-4346[Improve][Sort] Enhance upsert capability for SqlServer
INLONG-4345[Feature][Sort] Support sink changelog stream to TDSQL PostgreSQL
INLONG-4342[Improve][Sort] Duplicate audit-sdk dependency in sort core
INLONG-4339[Improve][Sort] Rollback debezium-core to 1.5.4
INLONG-4332[Feature][Manager][Sort] Support ClickHouse load node
INLONG-4327[Bug][Sort] Fix missing some connector table factory error after packaging
INLONG-4312[Feature][Sort] Add SqlServer data load support
INLONG-4306[Bug][Sort] Parameter error connector of file system
INLONG-4303[Improve][Sort] Iceberg Load Node add required option
INLONG-4292[Improve][Agent][TubeMQ][Sort] Upgrade the property file for all modules from log4j to log4j2
INLONG-4282[Improve][Sort] Optimize the sort package structure
INLONG-4264[Bug][Sort] Sort lightweight start ‘pulsar-to-kafka’ task failed
INLONG-4262[Feature][Sort] Add SqlServer data extract support
INLONG-4259[Feature][Sort] Import inlong format json serialize/deserialize
INLONG-4250[Feature][Sort] Add Elasticsearch load node
INLONG-4245[Improve][Manager][Sort] Manager transmit consumer group name of kafka to sort
INLONG-4243[Feature][Sort] Add Oracle data extract support
INLONG-4228[Feature][Sort][Manager] Adaptive HDFS Load Node
INLONG-4227[Feature][Sort] Sort lightweight support extract data to ClickHouse
INLONG-4224[Improve][Sort] Add debezium module to connectors
INLONG-4244[Improve][Sort] Remove flink-avro relocation
INLONG-4215[Improve][Sort] Add license for Hive connector of Sort
INLONG-4198[Feature][Sort] Add Postgres load node
INLONG-4189[Feature][Sort] Change the NOTICE to LICENSE
INLONG-4174[Feature][Sort] Add Postgres extract node supporting
INLONG-4171[Feature][Sort] Add FileSystem extract node
INLONG-4170[Feature][Sort] Add FileSystem load node
INLONG-4169[Improve][Sort] Add Java docs in sort
INLONG-4167[Feature][Sort] Add MongoDB extract node
INLONG-4157[Feature][Sort] Sort lightweight support load data to Iceberg
INLONG-4156[Feature][Sort] Support HBase load node
INLONG-4141[Feature][Sort] Sort lightweight support load data from Pulsar
INLONG-4097[Improve][Sort] Use javax constrain notNull annotation
INLONG-4090[Improve][Sort] Add license for MySQL CDC in Sort single tenant
INLONG-4086[Improve][Sort] Remove BufferedSocketInputStream class as it is not used
INLONG-4081[Bug][Sort] Fix upsert_kafka constant to upsert-kafka
INLONG-4066[Feature][Sort] Add Inlong Msg format for inlong msg
INLONG-4058[Improve][Sort] Resolve AVRO format dependency conflict
INLONG-4050[Bug][Sort] Parameter definition error of HiveLoad
INLONG-4048[Bug][Sort] Fix metadata type process error and hive-exec dependency scope error
INLONG-4044[Bug][Sort] Resolve conflict of flink-table-api-java-bridge jar
INLONG-4035[Bug][Sort] Change the restriction of Hive catalogName from not nullable to nullable
INLONG-4030[Improve][Sort] Import all changelog mode data ingest into Hive
INLONG-4022[Bug][Sort] Flink table catalog only supports timestamp of precision 9
INLONG-4013[Feature][Sort] Support write metadata in canal format
INLONG-4007[Improve][Sort] Modify default settings of CSV format
INLONG-4005[Bug][Sort] Remove some inappropriate comment and code
INLONG-3996[Feature][Sort] Support all migrate for database
INLONG-3979[Bug][Sort] Fix mysqlExtractNode options append error and conflict of flink jar
INLONG-3973[Feature][Sort] CDC support all migration
INLONG-3961[Feature][Sort] Add MySQL CDC append
INLONG-3956[Feature][Sort] Add Hive connector to support CDC
INLONG-3953[Feature][Sort] Add MySQL dynamic table implementation - modified from Flink CDC
INLONG-3924[Feature][Sort] Add MySQL cdc and support multiple meta data
INLONG-3899[Feature][Sort] Add string regexp replace support for transform
INLONG-3893[Feature][Sort] Add string delimiting support for transform
INLONG-3890[Feature][Sort] Add StringConstantParam to enhance support for constant parameters
INLONG-3885[Feature][Sort] Add KafkaExtractNode to support Kafka source
INLONG-3868[Feature][Sort] Support data from mysql binlog sync to kafka
INLONG-3860[Improve][Sort] Add some format for ExtractNode and LoadNode
INLONG-3841[Feature][Sort] Add distinct support based time column for transform
INLONG-3839[Feature][Sort] Add cascade function support for transform
INLONG-3837[Feature][Sort] Optimize the time window correlation function format
INLONG-3836[Feature][Sort] Add join support for transform
INLONG-3835[Feature][Sort] Register CascadeFunctionWrapper in the parent interface
INLONG-3834[Feature][Sort] Fix unit test sporadic errors
INLONG-3831[Feature][Sort] Add meta field support for sort lightweight
INLONG-3829[Feature][Sort] Optimize the sort entrance program to support lightweight
INLONG-3827[Feature][Sort] Add functions definition to support transform
INLONG-3826[Feature][Sort] Enhance field format to support varchar types and timestamp of different precisions
INLONG-3823[Feature][Sort] Fix error caused by unregistered custom function
INLONG-3822[Feature][Sort] Add node relations definition to support transform
INLONG-3817[Feature][Sort] Fix null point exception in canal-json format
INLONG-3816[Feature][Sort] Fix NPE in RegexpReplaceFirstFunction
INLONG-3815[Feature][Sort] Fix meta field sync error
INLONG-3805[Feature][Sort] Add operators definition to support transform
INLONG-3800[Feature][Sort] Add GroupInfo, StreamInfo definition to support transform
INLONG-3794[Feature][Sort] Add TimeUnitConstantParam definition to support transform
INLONG-3793[Feature][Sort] Add ConstantParam definition to support transform
INLONG-3791[Feature][Sort] Add WatermarkField definition to support transform
INLONG-3790[Feature][Sort] Add FieldRelationShip definition to support transform
INLONG-3789[Feature][Sort] Add NodeRelationShip definition to support transform
INLONG-3788[Feature][Sort] Add Node interface and derived interface definitions to support transform
INLONG-3787[Feature][Sort] Add Function interface and derived interface definitions to support transform
INLONG-3786[Feature][Sort] Add Operator interface and derived interface definitions to support transform
INLONG-3778[Feature][Sort] FieldInfo enhanced to support transform in the future
INLONG-3777[Feature][Sort] ExtractNode,LoadNode implementation
INLONG-3658[Umbrella][Sort] Data integration lightweight
INLONG-1823[Feature][Sort] Support store data to Elasticsearch

Sort-Standalone

ISSUESummary
INLONG-4453[Bug][Sort-Standalone] Wrong audit when send to kafka failed
INLONG-3773[Feature][Sort-Standalone] Support configurable handler to transform data of Kafka
INLONG-3667[Feature][Sort-Standalone] Add manage entry to stop cache consumer before node offline or upgrade
INLONG-1933[Feature][Sort-Standalone] Read API support inlong manager commands

TubeMQ

ISSUESummary
INLONG-4486[Improve][TubeMQ] Adjust the parameter requirements of group consume delete control APIs
INLONG-4470[Improve][TubeMQ] The adminQueryBlackGroupInfo method adds query topicName field
INLONG-4451[Bug][TubeMQ] The zookeeper service can not start for TubeMQ Docker Container
INLONG-4324[Improve][TubeMQ] Add Javadoc for methods
INLONG-4321[Improve][TubeMQ] Add Javadoc comments for methods
INLONG-4292[Improve][Agent][TubeMQ][Sort] Upgrade the property file for all modules from log4j to log4j2
INLONG-4217[Improve][TubeMQ] Add the flow control method and filtering method of the consumption group settings
INLONG-4130[Improve][TubeMQ] Optimize the broker replication method and topic replication method
INLONG-4114[Bug][TubeMQ] All container can not start successfully
INLONG-3975[Improve][TubeMQ] Modify the MasterConfigTest file to configure the incoming parameters
INLONG-3869[Improve][TubeMQ] Remove hibernate for tube manager
INLONG-3475[Feature][TubeMQ] Add an API for batch deletion of authorized consumer group records

Other

ISSUESummary
INLONG-4640[License] Complete the LICENSE of the third-party dependencies of the Sort connectors
INLONG-4633[License] Add the third-party dependency LICENSE of Sort connectors module
INLONG-4628[License] Update inlong-manager's third-party dependency LICENSE
INLONG-4574[Release] Bumped version to 1.3.0-incubating-SNAPSHOT
INLONG-4568[Release] Bumped version to 1.2.1-incubating-SNAPSHOT
INLONG-4567[Release] Update changes log for the 1.2.0 version
INLONG-4565[Release] Add the 1.2.0 version option for the bug report
INLONG-4368[License] Final LICENSE check of all modules
INLONG-4336[License] Update inlong-sort's third-party dependency LICENSE
INLONG-4318[License] Update inlong-manager's third-party dependency LICENSE
INLONG-4314[License] Update Sort-standalone's third-party dependency LICENSE
INLONG-4305[License] Update TubeMQ-Manager's third-party dependency LICENSE
INLONG-4296[License] Update Audit, DataProxy, TubeMQ's third-party dependency LICENSE
INLONG-4288[License] Update Agent's third-party dependency LICENSE
INLONG-3968[License] Remove the “WIP” label of the DISCLAIMER file
INLONG-3864[License] Recheck the third-party dependencies by combing each module
INLONG-3849[License] Update the third-party components LICENSEs for inlong-audit
INLONG-3771[License] Update the third-party components LICENSEs for inlong-agent
INLONG-3422[License] Sort out the LICENSEs of the third-party components that the project depends on
INLONG-4426[Improve][Office-Website] Update CI Nodejs Version
INLONG-4150[Improve][Office-Website] Automatically identify version number sorting
INLONG-4455[Improve][GitHub] Update the Pull Request TEMPLATE to make it more clear
INLONG-4267[Bug][GitHub] The checks pipeline of PR was incorrect
INLONG-4251[Improve][GitHub] Improve GitHub configuration in .asf.yaml
INLONG-4205[Bug][GitHub] Error in the greeting workflow
INLONG-4201[Improve][GitHub] Improve workflows and documentation
INLONG-4161[Bug][GitHub] Incorrect name in stale workflow
INLONG-4153[Feature][GitHub] Add support for first interaction
INLONG-4038[Improve][GitHub] Enable the alert of dependabot, and disable the automatic update
INLONG-4024[Improve][GitHub] Improve trigger conditions in the stable workflow
INLONG-4019[Improve][GitHub] Update the dependency from dependabot
INLONG-4001[Improve][Docker] Modify the MySQL Docker image version to 8.0.28
INLONG-3998[Improve][GitHub] Improve labeler workflow with docker, k8s and github labels
INLONG-3995[Improve][GitHub] Improve Dependabot configuration
INLONG-3974[Feature][GitHub] Add support for Dependabot
INLONG-3473[Feature][GitHub][K8s] Add support for helm chart testing
INLONG-4349[Improve][Doc] Update check style to avoid the Javadoc missing and error
INLONG-4256[Improve][Doc] Add java doc to solve the checkstyle issues
INLONG-4073[Improve][Doc] Modify the invitation email templates of Committer or PPMC
INLONG-3965[Improve][Doc] Add how-to-maintain-3rd-party-dependencies.md
INLONG-3930[Improve][Doc] Add more deployment and development guides in Readme
INLONG-3843[Bug][Doc] The link to “Contribution Guide for Apache InLong” is invalid
INLONG-1839[Improve][Doc] Supplement deployment document
INLONG-4351[Improve][Pom] Update the fastjson to solve the CVEs
INLONG-4484[Improve][Pom] Upgrade Spring version from 5.3.19 to 5.3.20
INLONG-3940[Improve][Pom] Bump spring-core from 5.3.18 to 5.3.19
INLONG-3935[Feature][Pom] Remove dependency of testng
INLONG-3780[Improve][Pom] Upgrade postgresql due to CVEs
INLONG-4434[Bug][Docker] Audit Container caught error when create pulsar topic
INLONG-3898[Bug][Docker] The log paths of Agent, Audit, Dataproxy and TubeMQ Manager containers are incorrect
INLONG-3744[Bug][Docker] Docker images are not pushed in release-* branches
INLONG-3553[Bug][Docker][K8s] TubeMQ pod fails to start
INLONG-4144[Bug][K8s] HTTP error appears on the login dashboard when deploying InLong using helm
INLONG-3845[Bug][K8s] The manager pod fails to start
INLONG-3635[Improve][JavaDoc] Fix the Javadoc check style problems for all modules

Release InLong 1.1.0-incubating - Released (as of 2022-04-15)

Agent

ISSUESummary
INLONG-3699[Improve][Agent] Exclude mysql-connector-java
INLONG-3692[Bug][Agent] There are many agent processes after recovering the directory
INLONG-3652[Improve][Agent] Improve TestBinlogOffsetManager unit test
INLONG-3650[Bug] Agent fix timeoffset npe
INLONG-3638[Bug] Agent and DataProxy can not listen to the 8080 port for Prometheus
INLONG-3629[Improve][Agent] Improve TestFileAgent unit test
INLONG-3620[Improve] Update the file agent guide document
INLONG-3587[Bug][Agent]Resource leak
INLONG-3476[Bug][Agent] debezium 1.8.1 has npe
INLONG-3466[Feature][Agent] Remove protobuf dependency
INLONG-3463[Bug][Agent] Fix unit test of TestTaskWrapper
INLONG-3448[Improve][Manager] Limit the number of Agent pull tasks
INLONG-3437[Agent] Sort out the LICENSEs of the third-party components of inlong-agent
INLONG-3381[Feature] Agent wait one minute for dataproxy to prepare topic config
INLONG-3349[Feature] Agent add limitation for job number
INLONG-3335[Bug] fix agent snapshot mode won't work and optimize jvm parameters
INLONG-3326[Improve][Agent] The unit test for TestTaskWrapper was running too long
INLONG-3317[Improve][Agent] Change agent heartbeat/report interval to 10s
INLONG-3308[Bug][Agent] NPE occurred in parsing deliveryTime
INLONG-3306[Feature][Agent] Use rocksdb as default db in agent
INLONG-3304[Bug][Agent] Reader cost too much CPU
INLONG-3299[Bug][Agent] Report job result rather than task result
INLONG-3298[Feature][Agent] Remove dbd implementation
INLONG-3297[Feature] Add version control in Agent CommandEntity
INLONG-3274[Bug][Agent] When Kafka topic is deleted
INLONG-3271[Bug][Agent] Cannot get localip in docker.sh
INLONG-3168[Bug][Agent] Change the deserialization type from String to byte array
INLONG-3148[Bug][Agent] fix avro serialization
INLONG-3104[Bug][Agent] Add default value for kafka consumer group
INLONG-3100[Bug][Agent] Upgrade Kafka to newest version 3.1.0
INLONG-3099[Bug][Agent] Duplicate send message when agent receive data
INLONG-3083[Bug][Agent] Upgrade Scala version in Kafka client
INLONG-3077[Bug][Agent] FileNotFoundException occurred in unit tests
INLONG-3076[Bug][Agent] MalformedObjectNameException occurred in unit tests
INLONG-3050[Bug][Agent] Update guava version
INLONG-3045[Feature][Agent] Add rocksDb implementation
INLONG-3027[Feature][Agent] Upgrade snappy version
INLONG-3022[Bug] agent pod start failed
INLONG-2985[Bug][Manager] Fix task type and UTF question for agent
INLONG-2974[Improve][Manager] Support agent to pull tasks without ip and uuid
INLONG-2933[Bug][Agent][Manager] Change the type of the deliveryTime field from Date to String
INLONG-2908[Bug][Agent] Delete uuid around space
INLONG-2894[Improve][Agent] Adapt the interface and field modification of the Inlong-Manager
INLONG-2883[Bug][Agent] ManagerFetcher throws exception when invoke the Gson.fromJson method
INLONG-2877[Bug][Agent] Task position manager throws NPE when send dataproxy ack success
INLONG-2870[Bug][Agent] Use base64 to encode snapshot instead of using iso-8859-1
INLONG-2860[Feature][Agent] Create file folder when history file set by user does not exist
INLONG-2859[Improve][Agent] Optimize stopping Kafka tasks
INLONG-2857[Feature][Agent] Support to destroy task
INLONG-2851[Feature] Agent change task id string to integer
INLONG-2826[Bug] Agent mysql connection should set allowPublicKeyRetrieval to true to support mysql 8.0
INLONG-2818[Bug] Agent kafka job and binlog job has jar conflict
INLONG-2790[Bug][Agent] Log4j cannot be output due to jar conflict
INLONG-2788[Feature] Agent support sync send data to dataproxy when needed (binlog etc.)
INLONG-2786[Feature] Agent jetty server support different job type
INLONG-2779[Feature] Agent support delete job using jetty server
INLONG-2756[Improve][Agent] Add more logs when sending data to proxy
INLONG-2754[Feature][Agent] Add strea metric data to Prometheus and JMX
INLONG-2736[Bug][Manager] Agent get task from manager error
INLONG-2735[INLONG][Agent] Fix dataprofile properties
INLONG-2688[Feature][Agent] Support task freeze and restart when needed
INLONG-2687[Feature][Agent] Provide binlog reader ability using debezium engine
INLONG-2686[Feature][Agent] Support snapshot for each task
INLONG-2680[Improve][Common][Agent] Move common class from inlong-agent module to inlong-common
INLONG-2675[Feature][Agent] Fix the problem of common dependcy
INLONG-2666[Feature][Agent] Support kafka collection
INLONG-2654[Feature][Agent] Report heartbeat to manager
INLONG-2530[Bug] Agent data time never changes
INLONG-2285[Feature][Agent] Make berkeleydb-je an optional dependency of InLong-Agent

DataProxy

ISSUESummary
INLONG-3638[Bug] Agent and DataProxy can not listen to the 8080 port for Prometheus
INLONG-3573[Feature][Dataproxy][Audit]Tidy up dependencies between dataproxy
INLONG-3520[Improve][DataProxy] Unify the data directory
INLONG-3459[Bug] DataProxy start error Due to IllegalArgumentException
INLONG-3436[DataProxy] Sort out the LICENSEs of the third-party components of inlong-dataproxy
INLONG-3352[Bug][Dataproxy] Dataproxy keeps trying to send messages that have send failed
INLONG-3291[Bug][Dataproxy] Default channel config for order message didn't work
INLONG-3282[Feature][DataProxy] Add default order message configuration
INLONG-3250[Bug][DataProxy] Fix duration error of DataProxy metric
INLONG-3231[Feature][DataProxy] Change the default topic to an optional configuration
INLONG-3183[Bug][Dataproxy] When creating a producer fails
INLONG-3181[Improve][DataProxy] Optimizing unit tests and code style
INLONG-3161[Bug][Dataproxy] When sending order messages, no response message is returned to client
INLONG-3136[Feature] DataProxy get NOUPDATE"" configuration from Manager when request md5 is same
INLONG-3080[Bug][DataProxy] Fix dataproxy UT bug add mock of MetricRegister
INLONG-3067[Feature][DataProxy] Upgrading the documentation of using the default Pulsar configuration
INLONG-3060[Feature][DataProxy] Use Pulsar configuration by default
INLONG-3058[Feature][DataProxy] Add some configs while creating Pulsar producer
INLONG-3047[Bug][DataProxy] All common.properties configs are overwritten
INLONG-3031[Bug][Dataproxy] Repeated registration jmx metric bean
INLONG-2962[Bug][UT] Unit tests throw so many error msg for DataProxy
INLONG-2961[Improve][DataProxy] Check style error in DataProxy
INLONG-2906[Improve] Fix conflict defined of mq in Dataproxy and Sort
INLONG-2812[Improve][DataProxy] Modify flume conf and rename MetaSink
INLONG-2805[Feature][DataProxy] Add stream config log report
INLONG-2802[Bug][DataProxy] Update mx.properties local file too often
INLONG-2783[Bug][DataProxy] Port conflict with pulsar port
INLONG-2781[Feature][DataProxy] Update netty version to 4.x
INLONG-2719[Bug][DataProxy] Setting multiple topics for the same groupId doesn't work for Pulsar
INLONG-2711[Bug][SDK] Dataproxy-SDK get manager ip list error
INLONG-2607[Feature][DataProxy] Supports prometheus metric report for PulsarSink
INLONG-2568[Feature][Dataproxy] Support dynamically getting TubeMq config from Manager
INLONG-2491[Feature][Dataproxy] update netty version to 4.1.72.Final and log4j to log4j2
INLONG-2381[Feature] DataProxy support Tube sink of PB compression cache message protocol.
INLONG-2379[Feature] DataProxy support Pulsar sink of PB compression cache message protocol.
INLONG-2377[Feature] DataProxy support PB compression protocol format source.

Manager

ISSUESummary
INLONG-3716[Improve][Manager] Decrease the size of manager plugins
INLONG-3712[Bug][Manager] validation-api dependency conflict
INLONG-3710[Bug][Manager] Update the import package for ObjectMapper
INLONG-3704[Improve][Manager] change the log level for status report
INLONG-3701[Improve][Manager] Decrease the size of manager client tools
INLONG-3697[Improve][Manager] Replenish manager client examples
INLONG-3686[Improve][Manager] Remove the check for the serialization type of file source
INLONG-3683[Improve] Add AUTO_PUSH source stream in Manager
INLONG-3662[Improve][Manager] Disable ZooKeeper by default and deserialize file source from stream info
INLONG-3652[Improve][Agent] Improve TestBinlogOffsetManager unit test
INLONG-3647[Bug] Manager caught Sniffer : error while sniffing nodes java.net.ConnectException
INLONG-3642[Improve][Manager] Update start script and log configuration
INLONG-3627[Improve][Manager] Remove deprecated source_file related classes
INLONG-3603[Improve][Manager] The serialization type cannot be empty for File source
INLONG-3601[Bug][Manager] Should not create Hive resource when sink type is Kafka
INLONG-3599[Bug][Manager] Null pointer exception occurred when list file sources
INLONG-3596[Bug] manager can not start successfully
INLONG-3589[Feature][Manager] Add Iceberg sink info for Sort
INLONG-3580[Improve][Manager] Remove agentIp param in StreamSource
INLONG-3565[Improve][Manager] Unified the interface for Flink plugin
INLONG-3550[Improve][Manager] Add file source in Manager Client
INLONG-3544[Feature][Manager] Refactor file source request and response
INLONG-3542[Feature][Manager] Add Iceberg params and change SQL files
INLONG-3538[Improve][Manager] Adjust mode of getting sort URL
INLONG-3537[Improve][Manager] Remove unused APIs and change Kafka sink params
INLONG-3535[Improve][Manager] Update JDBC configs and maven pom files
INLONG-3510[Bug][Manager] When deployed
INLONG-3507[Bug][Manager] Upgrade Elasticsearch jar due to cve
INLONG-3480[Bug][Manager] Fix null pointer exception when calling sink method in manager client
INLONG-3462[Feature][Manager] Add test module for manager client
INLONG-3454[Improve][Manager] Remove the dependency of nimbusds which was unused
INLONG-3451[Bug][Manager] Got wrong results when querying tube cluster info
INLONG-3448[Improve][Manager] Limit the number of Agent pull tasks
INLONG-3438[Manager] Sort out the LICENSEs of the third-party components of inlong-manager
INLONG-3428[Improve][Manager] Set the default value and code refactor
INLONG-3405[Improve][Manager] Support generic partition configuration for Hive sink
INLONG-3398[Bug][Manager] Fix database error when saving sink field
INLONG-3397[Bug][Manager] SQL error when saving sink fields
INLONG-3383[Bug][Manager] Fix the null pointer caused by sink field not configured with source field
INLONG-3376[Improve][Manager] Support custom field format in client
INLONG-3370[Improve][Manager] Optimize stream source delete logic
INLONG-3369[Improve][Manager] Add StreamSource in list API
INLONG-3367[Improve][Manager] Support custom field format
INLONG-3362[Improve][Manager] Make Group.updateStatus new Transaction
INLONG-3339[Bug][Manager] Should update status when agent result was failed
INLONG-3337[Bug][Manager] Fix API error in manger client
INLONG-3334[Improve][Manager] Get source field list from stream field table for Sort
INLONG-3323[Improve][Manager] Add APIs in manager client
INLONG-3312[Improve][Manager] Optimize the delete operation for stream source
INLONG-3310[Improve][Manager] Optimize Pessimistic Lock for select stream sources
INLONG-3301[Improve][Manager] Remove deprecated classes and tables
INLONG-3300[Improve][Manager] Optimize the interface of the inlong-stream page
INLONG-3294[Bug][Manager] Protocol of client and manager is inconsistent
INLONG-3293[Improve][Manager] Add version controller for stream source
INLONG-3287[Bug][Manager] Fix heartbeat manager init in Manager Service
INLONG-3280[Bug][Manager][Dashboard] Update and delete datasource failed
INLONG-3269[Improve][Manager] Change the request method of list query from GET to POST
INLONG-3264[Improve][Manager] MySQL deadlocked when operating stream source
INLONG-3257[Bug][Manager][Dashboard] Create CommonServerDB return 404
INLONG-3252[Bug][Manager] Remove transaction in select method
INLONG-3246[Improve][Manager] Add config_failed status after suspend/restart/delete failed for inlong group
INLONG-3242[Bug][Manager] ConsumptionMqExtBase cannot be cast to ConsumptionPulsarInfo
INLONG-3239[Bug][Manager] Listing inlong group failed in manager client
INLONG-3228[Bug][Manager] Deadlock found when trying to get lock
INLONG-3225[Improve][Manager] Resolves multiple IPs when querying a DataProxy cluster
INLONG-3222[Improve][Manager] Check source state while operate stop / restart / delete
INLONG-3210[Feature] [Manager] Support group batch query in manager client
INLONG-3209[Improve][Manager] Optimize timeout handling in manager client
INLONG-3208[Improve][Manager] Support batch query by inlong group name and inlong group id
INLONG-3192[Improve][Manager] Optimize group state collect in Manager Client
INLONG-3190[Bug][Manager] Sql error in select source list
INLONG-3188[Bug][Manager] Inlong group status was not right after approve
INLONG-3179[Improve][Manager] Check the source name can not be the same when saving stream source
INLONG-3178[Improve][Manager] Add check param for manager-client
INLONG-3176[Bug][Manager] Fix duplicate key exception in manager client
INLONG-3175[Feature][Manager] SortService check md5
INLONG-3166[Improve][Manager] Replace hdfsDefaultFs and warehouseDir of Hive sink with dataPath field
INLONG-3160[Bug][Manager] Deleting stream source failed as the status was not allowed to delete
INLONG-3156[Feature][Manager] Add Shiro interfaces for manager authorization
INLONG-3152[Improve][Manager] Stop and update operation in initializing state
INLONG-3149[Improve][Manager] Add async method for inlong group stop/restart/delete
INLONG-3146[Improve][Manager] Optimize FieldType enums
INLONG-3140[Bug][Manager] Fix NPE in Manager Client
INLONG-3134[Bug][Manager] Save stream sink field error
INLONG-3112[Feature][Manager] Support metadata in manager and manager client
INLONG-3101[Improve][Manager] Support user defined properties in StreamSource
INLONG-3095[Improve][Manager] Update inlong group info in the complete listeners
INLONG-3090[Improve][Manager] Add TDMQ_PULSAR type in manager
INLONG-3089[Bug][Manager] Create group resource faild after approving one inlong group
INLONG-3073[Improve][Manager] Get MQ cluster by the type and mq_set_name
INLONG-3068[Improve][Manager] Add autoOffsetReset param for Kafka source
INLONG-3065[Improve][Manager] Support download plugins from remote address
INLONG-3064[Improve][Manager] Unify field types of sink and source in manager client
INLONG-3062[Improve][Manager] Merge the data_proxy_cluster table and the third_party_cluster table
INLONG-3053[Bug][Manager] Push sort config failed as the mqExtInfo is null in workflow form
INLONG-3046[Bug][Manager] The status was incorrect after approving an inlong group
INLONG-3042[Improve][Manager] Supplements of binlog allMigration stream
INLONG-3039[Improve][Manager] Add properties in sinkRequest
INLONG-3037[Improve][Manager] Add field mapping support for source and sink in manage client
INLONG-3024[Bug][Manager] Save cluster failed as the token field is too long
INLONG-3017[Bug][Manager] The interface of OpenAPI does not need authentication
INLONG-3012[Improve][Manager] Support built-in field for source and sink info
INLONG-3000[Improve][Manager] Add token field for cluster info
INLONG-2993[Bug][Manager] Check whether the mq info is NULL to avoid NPE
INLONG-2992[Feature][Manager] Support the field mapping feature for Sort
INLONG-2985[Bug][Manager] Fix task type and UTF question for agent
INLONG-2974[Improve][Manager] Support agent to pull tasks without ip and uuid
INLONG-2973[Bug][Manager] Fix get pulsar info from third party cluster table
INLONG-2971[Improve][Manager] Support stream log collecting in manager client
INLONG-2969[Bug][Manager] Fix interface of open API cluster
INLONG-2957[Improve][Manager] Optimize the cluster management interface
INLONG-2944[Improve][Manager] Should not change the modify_time when updating the source snapshot
INLONG-2939[Improve][Manager] Support sync message transfer in manager client
INLONG-2934[Bug][Manager] Manager client occured NPE since not check NULL
INLONG-2933[Bug][Agent][Manager] Change the type of the deliveryTime field from Date to String
INLONG-2930[Feature][Manager] Add ClickHouse sink support in manager-client
INLONG-2913[Bug][Manager] Fix get data proxy cluster failed and update inlong group failed
INLONG-2912[Improve][Manager] Add fields for the binlog task
INLONG-2900[Bug][Manager] Pulsar topics for DataProxy are inconsistent with topics for Sort
INLONG-2898[Bug][Manager] Fix parse Json exception in manager client
INLONG-2892[Improve][Manager] Update status of StreamSource after approving the InlongGroup or InlongStream
INLONG-2890[Feature][Manager] Support query source list in stream/listAll API
INLONG-2888[Bug][Manager] Stream source was not deleted when calling delete operate
INLONG-2886[Improve][Manager] Check if the URL is valid to avoid network security attacks
INLONG-2873[Bug][Manager] Fix serialization problem
INLONG-2869[Feature][Manager] Support config sync send data for agent and sort
INLONG-2867[Feature][Manager] Support report the task result and get tasks for the agent
INLONG-2862[Feature][Manager] Startup sort task through the ordinary flink cluster
INLONG-2856[Improve][Manager] Support multi-source and multi-sink in one stream
INLONG-2855[Feature][Manager] Support use other plugin of Authorization
INLONG-2849[Bug][Manager] Manager client occurred NPE
INLONG-2845[Bug][Manager] Manager client occurred NPE when parsing the ext info
INLONG-2841[Bug][Manager] New Inlong group cannot invoke the related listeners
INLONG-2839[Improve][Manager] Add intermediate state for Inlong group
INLONG-2837[Bug][Manager] Loss update Kafka operation when using manager client to update config
INLONG-2830[Improve][Manager] Support more than one source for a pair of group and streams
INLONG-2829[Feature][Manager] Support for migrating all databases in a database server for the inlong-sort module
INLONG-2827[Feature][Manager] Support configurable plugin when creating Hive table
INLONG-2821[Improve][Manager] Change the status of the source after receiving the task snapshot
INLONG-2815[Improve][Manager] Optimize Inlong domains for manager-client
INLONG-2808[Feature][Manager] Support kafka sink in manager client
INLONG-2807[Improve][Manager] Optimize state defined in manager client
INLONG-2794[Bug] Manager website should not display port when adding agent job
INLONG-2791[Improve][Manager] Optimize manager client APIs
INLONG-2768[Bug][Manager] The middleware_type not same after creating group
INLONG-2764[Bug][Manager] Key was duplicate when InlongGroup extList already has the same key
INLONG-2760[Bug][Manager] Delete data grouping exception
INLONG-2759[Bug][Manager] InlongGroupController update interface status problem
INLONG-2751[Bug][Manager] Fix the response code while query failing
INLONG-2743[Improve][Manager] Support getting inlong workflow error for manager-client module
INLONG-2741[Feature][Manager] Inlong client adds an interface for querying inlong group
INLONG-2736[Bug][Manager] Agent get task from manager error
INLONG-2734[Improve][Manager] Support multi serialization type for Sort in Manager
INLONG-2732[Feature][Manager] Support more parameters for Kafka source
INLONG-2723[Bug][Manager] Manager module occurred exception when startup
INLONG-2720[Bug][Manager] data_source_cmd_config table not exit
INLONG-2717[Improve][Manager] Support middleware of NONE
INLONG-2715[Feature][Manager] Support more parameters for the StreamSource entity
INLONG-2714[Bug][Manager] Create stream_source table failed
INLONG-2711[Bug][SDK] Dataproxy-SDK get manager ip list error
INLONG-2707[Bug][Manager] Table name and field type was inconsistent in SQL and XML file
INLONG-2701[Bug][Manager] Occurred NPE as the data proxy cluster name is null
INLONG-2700[Bug][Manager] Inlong group status was incorrect
INLONG-2699[Bug][Manager] Field ext_params in table data_proxy_cluster not exits
INLONG-2697[Bug][Manager] Inlong manager occurred NullpointException
INLONG-2694[Feature][Manager] Implement services of getSortSource interface
INLONG-2693[Feature][Manager] Define tables and beans for getSortSource interface
INLONG-2690[Improve][Manager] Optimize group state in workflow
INLONG-2689[Feature][Manager] Support report heartbeat for source agent
INLONG-2682[Feature][Manager] Add metric and config log report interface
INLONG-2678[Improve][Manager] Update field type in manager sql script
INLONG-2677[Feature][Manager] Get MQ cluster Info from database
INLONG-2676[Improve][Manager] Support stop / restart / finish stream source task
INLONG-2669[Improve][Manager] Optimizing source module code structure
INLONG-2662[Bug][Manager] Fix duplicate listener in manager service
INLONG-2660[Improve][Manager] Optimize manager state machine
INLONG-2655[Bug][Manager] Fix non-null limit in sql file
INLONG-2653[Feature][Manager] Support Kafka source in Inong Stream
INLONG-2638[Bug][Manager] apache_inlong_manager.sql file execution exception
INLONG-2636[Improve][Manager] Enable sort config generate when zookeeper is disabled;
INLONG-2617[Bug][Manager] After approving the new group
INLONG-2616[Improve][Manager] Optimize manager client and some APIs
INLONG-2614[Feature][Sort] Support array and map data structures in Hive sink and ClickHouse sink
INLONG-2612[Improve][Manager] Unify the domain model of the Manager module
INLONG-2610[Feature][Manager] Plug-in support for StreamSource
INLONG-2605[Improve][Manager] Refactor the manager-workflow module
INLONG-2600[Improve][Manager] Rename the third party cluster class name and table name
INLONG-2588[Feature][Manager] Support cluster management
INLONG-2586[Feature][Manager] Support agent to get task from manager
INLONG-2579[Feature][Manager] Support stream sink to ClickHouse
INLONG-2574[Feature][Manager] Add getSortSource interface for Sort
INLONG-2573[Feature][Manager] Inlong manager support getSortSource interface
INLONG-2571[Bug][Manager] Fix unit tests bugs
INLONG-2558[Improve][Manager] Optimizing manager test pattern
INLONG-2529[Bug][manager] get NumberFormatException when creating a new stream
INLONG-2512[Improve] [Manager] Add manager client
INLONG-2507[Bug][Manager] Init sort config failed
INLONG-2492[Feature][Manager] Plug-in support for DataStorage
INLONG-2491[Feature][Dataproxy] update netty version to 4.1.72.Final and log4j to log4j2
INLONG-2490[Feature][Manager] Support to startup a single tenant sort job
INLONG-2483[Feature] Manager provide metadata interface to Dataproxy
INLONG-2414[Manager] Exclude test jar file during the apache-rat-plugin check
INLONG-2410[Improve] Inlong Manager support business workflow suspend
INLONG-2353[Feature] Tube manager cluster adds support for multi-master configuration
INLONG-2286[Feature][Manager] Put inlong group id in dataflow info for Sort
INLONG-2162[Feature][Manager] Manager support getSortSourceConfig interface
INLONG-1517[Feature][Manager] Support sink data to ClickHouse

Audit

ISSUESummary
INLONG-3606[Bug] lack of the guide for Sort to configure Audit and Flink Plugin
INLONG-3573[Feature][Dataproxy][Audit]Tidy up dependencies between dataproxy
INLONG-3543[Feature][Audit]Upgrade audit netty version to 4.1.72.Final and log4j to log4j2
INLONG-3528[Improve] unify the log directory for manager and audit
INLONG-3440[Audit] Sort out the LICENSEs of the third-party components of inlong-audit
INLONG-3417[Improve] add audit configuration for other component docker image
INLONG-3288[Improve][Audit] Support TubMQ for website
INLONG-3159[Feature][Audit] Store support TubeMQ
INLONG-3158[Feature][Audit] Proxy support TubeMQ
INLONG-3013[Bug][Audit] Error occurred in started container on tencent eks
INLONG-2960[Bug][Audit] Unit tests error when executing mvn test command
INLONG-2640[Bug][K8s] The Audit Configmap can not be handled as a ConfigMap
INLONG-2623[Improve][Audit] Add audit image for docker publish script
INLONG-2591[Bug][Audit] Audit proxy and store process with wrong options
INLONG-2549[Improve] [audit] update audit protobuf field type
INLONG-2548[Bug] update version of lombok from 1.18.20 to 1.18.22
INLONG-2540[agent] create db sql collect task by config from manager
INLONG-2538[TubeMQ] Optimize message write cache logic
INLONG-2535[Improve][dashboard] Audit module display time in reverse order
INLONG-2523[Improve][Audit] Modify package name according to specification
INLONG-2468[Bug][Audit] CommunicationsException occurred in unit tests
INLONG-2441[Improve] [InLong audit] Modify the version of audit protobuf
INLONG-2408[Audit] protobuf-java dependency has security vulnerability

Sort

ISSUESummary
INLONG-3682[Improve] Optimize classification for the sort and usage manual guide
INLONG-3672[Feature][Sort-standalone] Tidy up dependencies.
INLONG-3670[Improve][Dashboard] Add dashboard plugin docs to official website
INLONG-3668[Sort-standalone] exclude spotbugs-annotations package
INLONG-3606[Bug] lack of the guide for Sort to configure Audit and Flink Plugin
INLONG-3591[Feature] Support multiple SortTask with the one-on-one relationship of Source and SortTask.
INLONG-3589[Feature][Manager] Add Iceberg sink info for Sort
INLONG-3546[Feature] Support reporting metrics by audit-sdk in sort-single-tenant
INLONG-3538[Improve][Manager] Adjust mode of getting sort URL
INLONG-3523[Sort-Flink] Remove lzo-core dependency
INLONG-3501[Sort-standalone] Sort out the LICENSEs of the third-party components of inlong-standalone
INLONG-3486[Bug][Sort] Data with Timestamp/Date type are written wrongly when using parquet format
INLONG-3483[Bug][Sort] Wrong date data in ORC formatted output
INLONG-3457[Improve][Sort] Exclude partition fields when writing data with parquet/orc format to hive
INLONG-3450[Feature][SDK] Sort-SDK change ack log from info to debug
INLONG-3426[Improve][Sort] Unify the value of binlog event type
INLONG-3418[Feature][Sort-Standalone] Upgrade protobuf version to 3.19.4
INLONG-3414[Improve][Sort] Set the default value of field includeUpdateBefore for DebeziumDeserializationInfo
INLONG-3408[Bug][Sort-Standalone] Replace IP and authentication in configuration example
INLONG-3396[Feature][Sort] Support multiple dataflow to write the same hive table
INLONG-3378[Feature] Add configuration example of Sort-standalone(Hive+ElasticSearch)
INLONG-3372[Bug][Sort] The binlog type is always INSERT when the output format is Canal
INLONG-3340[Bug][Sort-Standalone] ClsSink cannot acquire correct IdConfig and type overflow
INLONG-3332[Bug][Sort-Standalone] NP when init ClsSink and data race problem when first get ClsIdConfig field list
INLONG-3329[Bug][Sort] Wrong class mapping of debezium serialization info
INLONG-3328[Feature][Sort-Standalone] Support to load sort-sdk configuration from file
INLONG-3321[Improve][Sort] Set the correspond field in output to null if the field value in input is null
INLONG-3316[Bug][Sort] Change target sort jar in inlong-distribution module
INLONG-3285[Bug][Sort] Elasticsearch jar has security issue
INLONG-3260[Improve][Sort] Change the default semantic to at-least-once when using kafka producer
INLONG-3256[Improve][SDK] Improve sort-sdk log info
INLONG-3243[Feature][Sort-Standalone] Support multiple scenes to request configs
INLONG-3237[Feature][Sort-Standalone] SdkSource support periodiclly update sdk config and remove expire client.
INLONG-3218[Bug][SDK] Sort-SDK may creating multiple duplicate consumers
INLONG-3206[Improve][Sort] Do not specify uid for kafka sink in case of transactionalId conflict
INLONG-3202[Feature][SDK] Unify SortSourceConfig of Sort-Sdk and Manager
INLONG-3173[Bug][Sort-Standalone] Unify SortClusterConfig in manager and sort-standalone
INLONG-3130[Feature][Sort] Support extract specified metadata from input data with canal format
INLONG-3122[Bug][Sort-Standalone] Missing TASK_NAME parameter when report to Audit
INLONG-3117[Bug][Sort-Standalone] Parameter error when invoking SortSdk ack method
INLONG-3116[Bug][Sort-Standalone] SortSdkSource does not specify the manager url
INLONG-3115[Bug][Sort-Standalone] optimize the sort-standalone
INLONG-3113[Bug][Sort] Date and Time related bugs
INLONG-3110[Improve][Sort] Shade flink-avro to avoid potential conflicts
INLONG-3108[TubeMQ] Optimize the implementation of KeepAlive Interface
INLONG-3086[Improve][Sort] Check style error in Sort
INLONG-3078[Bug][Sort] TubeClientException occurred in unit tests
INLONG-3055[Bug][Sort] Fix bugs of deserializing TransformationInfo json string
INLONG-3054[Bug][Sort] Start sort task failed as parsing the config error
INLONG-3053[Bug][Manager] Push sort config failed as the mqExtInfo is null in workflow form
INLONG-3011[Feature][Sort] Add deploy command of sort-standalone
INLONG-2910[Bug][Sort] Deserialization failure of BuiltInField
INLONG-2872[Feature][Sort] Support field mapping when transforming
INLONG-2847[Feature][Sort] Support whole-database migration from debezium format to canal format
INLONG-2820[Improve][Sort] Improve the deserialization processing of the update event in DebeziumDeserializationSchema
INLONG-2816[Bug][Sort-sdk] java.lang.OutOfMemoryError: Java heap space
INLONG-2793[Bug][Sort] Bugs related to hive sink
INLONG-2785[Feature][Sort] Support extract metadata from data with debezium format and write them to data with canal format
INLONG-2774[Bug][Sort] Fix bugs in sort-single-tenant
INLONG-2730[Feature][Sort] Stand-alone CLS sink reduce the number of AsyncProducerClient
INLONG-2728[TubeMQ] Optimize the content of statistical metrics
INLONG-2723[Bug][Manager] Manager module occurred exception when startup
INLONG-2721[Bug][Sort] Fix bugs in HiveSinkInfo
INLONG-2684[Bug][SDK] Sort SDK occurred OOM in unit tests
INLONG-2667[Bug][Sort] Bugs occurred when starting up sort-single-tenant
INLONG-2659[Bug][Sort] Could not build the program from JAR file.
INLONG-2651[Feature][Sort] Add CLS sink
INLONG-2650[Feature][Sort] Define sort stand-alone CLS context and config bean
INLONG-2649[Feature][Sort] Implement default IEvent2LogItemHandler interface
INLONG-2642[Feature][Sort] Use proxy user to write hive
INLONG-2634[Feature][Sort] Support CHDFS filesystem when using Hive sink
INLONG-2625[Feature][Sort] Support extracting data time in deserialization
INLONG-2614[Feature][Sort] Support array and map data structures in Hive sink and ClickHouse sink
INLONG-2572[Bug][SDK] Sort sdk cause with name javax/management/MBeanServer in unit tests
INLONG-2561[Feature][Sort] Update deploy settings of InLong-Sort
INLONG-2554[Feature][Sort] Support array and map data structures in ORC writer
INLONG-2526[Feature][Sort] Support serialization and deserialization of debezium-json formatted data
INLONG-2524[Feature][InLong-Sort] Support deserialization of json
INLONG-2507[Bug][Manager] Init sort config failed
INLONG-2496[Feature][Sort]Support COS filesystem when using hive sink
INLONG-2435[Feature] Fix Sort-standalone UT problem.
INLONG-2413[Feature][Sort]Support non-partitioned table when using hive sink
INLONG-2382[Feature] Sort-sdk support Pulsar consumer of PB compression cache message protocol.
INLONG-2346[Feature][InLong-Sort] Support avro and canal formats for sort sink
INLONG-1928[Feature]Inlong-Sort-Standalone support to consume events from Tube cache clusters.
INLONG-1896[Feature]Inlong-Sort-Standalone support to sort the events to Kafka clusters.

TubeMQ

ISSUESummary
INLONG-3644[Feature][TubeMQ]Upgrade netty version and tidy up dependencies.
INLONG-3621[Improve][TubeMQ] Added cluster switching method and delete cluster support to delete master
INLONG-3598[Improve][TubeMQ] Add broker modify method
INLONG-3568[Improve][TubeMQ] Nodes realize batch online
INLONG-3560[Bug][TubeMQ][InLong] The tubemq pod is invalid
INLONG-3547[Bug][TubeMQ] curl and ps commands not found in tubemq docker container
INLONG-3514[Improve][TubeMQ] Add name and IP attributes for query cluster API
INLONG-3509[TubeMQ]Optimize the LICENSE file format of inlong-tubemq third-party components
INLONG-3477[TubeMQ] Remove direct reference to log4j1.x
INLONG-3453[Feature][TubeMQ] Remove hibernete for tube manager
INLONG-3451[Bug][Manager] Got wrong results when querying tube cluster info
INLONG-3445[Feature][TubeMQ] Remove the hibernate dependency for the tube manager
INLONG-3432[TubeMQ] Sort out the LICENSEs of the third-party components of inlong-tubemq-manager
INLONG-3431[TubeMQ] Sort out the LICENSEs of the third-party components of inlong-tubemq
INLONG-3429[TubeMQ] Add missing adminQueryMasterVersion method
INLONG-3363[TubeMQ]Added how to use optional BDB components and documentation
INLONG-3354[TubeMQ]Update master.ini configuration guidelines document
INLONG-3348[TubeMQ] Update protobuf-java version to 3.19.4
INLONG-3324[TubeMQ]Optimize CliMetaDataBRU class implementation
INLONG-3290[TubeMQ]Add the query API for finding the consumption group based on the specified topic
INLONG-3268[TubeMQ] Fix some bugs when metadata is saved to ZooKeeper
INLONG-3254[TubeMQ]Replace the call of MetaDataManager with DefaultMetaDataService
INLONG-3201[Improve][TubeMQ] Improve the cluster query function
INLONG-3154[TubeMQ] Adjust the Master.ini file reading implementation
INLONG-3143[TubeMQ] Optimize Metadatamanager class implementation
INLONG-3108[TubeMQ] Optimize the implementation of KeepAlive Interface
INLONG-3105[TubeMQ] Add MetaStoreMapper related implementation
INLONG-3095[Improve][Manager] Update inlong group info in the complete listeners
INLONG-3093[TubeMQ] Optimize the AbsXXXMapperImpl implementation classes
INLONG-3079[Bug][TubeMQ] An NPE was thrown when starting the Tube-Manager
INLONG-3078[Bug][Sort] TubeClientException occurred in unit tests
INLONG-3072[TubeMQ] Output the total count of control block in admin_query_cluster_topic_view
INLONG-3035[TubeMQ] Optimize the MetaStoreService implementation class
INLONG-3029[TubeMQ] Adjust the implementation classes under the impl.bdbimpl package
INLONG-3020[Improve] Format the some code of TubeMQ Go SDK
INLONG-3015[Feature][TubeMQ] Add configuration to support the number of reloaded machines per batch
INLONG-2980[TubeMQ] Modify the code style problems of the metadata classes
INLONG-2979[Feature] Tubemq cluster delete provides token code
INLONG-2955[TubeMQ] Adjust the offsetstorage and zookeeper package paths
INLONG-2915[TubeMQ] Fix code style issues
INLONG-2844[TubeMQ] Implement the ZooKeeper-based metadata Mapper class
INLONG-2813[Improve] update the docker config for getting TubeMq config dynamically
INLONG-2803[Improve][TubeMQ] Update the Python client package
INLONG-2776[TubeMQ] Add metadata backup cli script
INLONG-2728[TubeMQ] Optimize the content of statistical metrics
INLONG-2620[TubeMQ] Add direct write to disk control
INLONG-2609[TubeMQ] Fix Javadoc related errors
INLONG-2603[TubeMQ] Remove obsolete metric codes
INLONG-2596[Improve][TubeMQ] Fix param in the client module and the main class of tubeManager pom is error
INLONG-2569[TubeMQ] Discarded msgTime value when msgType is empty
INLONG-2555[TubeMQ] Remove slf4j-log4j12
INLONG-2552[TubeMQ] Add Master metric operation APIs
INLONG-2538[TubeMQ] Optimize message write cache logic
INLONG-2518[TubeMQ] Adjust the client's metric statistics logic
INLONG-2517[TubeMQ] Adjust the statistical logic of the Master service status
INLONG-2516[TubeMQ] Optimize Broker's JMX metric interface
INLONG-2508[TubeMQ] Add Broker metric operation APIs
INLONG-2505[TubeMQ] Add MsgStoreStatsHolder class
INLONG-2488[TubeMQ] Optimize MsgFileStatisInfo implementation logic
INLONG-2484[TubeMQ]Optimize MsgMemStatisInfo implementation logic
INLONG-2480[TubeMQ] Add WebCallStatsHolder class for Web API call statistics
INLONG-2478[TubeMQ] Optimize GroupCountService logic implementation
INLONG-2474[TubeMQ] Adjust the statistics of Broker's message service part
INLONG-2451[TubeMQ] Add Histogram implementation classes
INLONG-2445[TubeMQ] Add Gauge and Counter implementation classes
INLONG-2433[TubeMQ] Abstract metrics' interface
INLONG-2353[Feature] Tube manager cluster adds support for multi-master configuration
INLONG-2282[Feature][TubeMQ] Add ZooKeeper as the metadata storage component of TubeMQ
INLONG-2204[Improve][TubeMQ] Optimize the collection of metrics for TubeMQ
INLONG-1655[Improve] TubeMQ Documents should use English pictures

Dashboard

ISSUESummary
INLONG-3684[Improve][Dashboard] Add tooltip for stream data type
INLONG-3670[Improve][Dashboard] Add dashboard plugin docs to official website
INLONG-3660[Improve][Dashboard] Change visible for dataType and dataSeparator
INLONG-3631[Improve][Dashboard] Change the ClickHouse sink page to adapt the Manager module
INLONG-3617[Improve][Dashboard] Add params for stream source to adapt Manager module
INLONG-3556[Feature][Dashboard] Add Iceberg params to adapt the Manager module
INLONG-3518[Feature][Dashboard] Support Iceberg Sink
INLONG-3506[Feature][Dashboard] Support Kafka
INLONG-3498[Improve][Dashboard] Adapt manager streams update API
INLONG-3496[Improve][Dashboard] Update node version
INLONG-3492[Improve][Dashboard] Initialize a npmrc file
INLONG-3471[Improve][Dashboard] Hive sink adapts to new manager API
INLONG-3442[Dashboard] Sort out the LICENSEs of the third-party components of inlong-dashboard
INLONG-3423[Improve][Dashboard] Add user and password config to binlog source
INLONG-3394[Improve][Dashboard] Remove the stream owner parameter and manage it uniformly by group
INLONG-3390[Improve][Dashboard] Text form support date and array dataType
INLONG-3341[Feature][Dashboard] Sink supports plug-in configuration
INLONG-3314[Improve][Dashboard] Support for new data stream API data formats
INLONG-3280[Bug][Manager][Dashboard] Update and delete datasource failed
INLONG-3275[Improve][Dashboard] Change the request method of list query from GET to POST
INLONG-3257[Bug][Manager][Dashboard] Create CommonServerDB return 404
INLONG-3220[Improve][Dashboard] The binlog configuration aligns the parameters of the managerAPI
INLONG-3128[Feature][Dashboard] Make binlog as a source type
INLONG-2997[Improve][Dashboard] The group execution log needs to distinguish between different states
INLONG-2996[Bug][Dashboard] An error is reported after closing the group execution log modal
INLONG-2895[Feature][Dashboard] The data source in the data stream supports binlog collection
INLONG-2861[Feature][Dashboard] Support common data source module
INLONG-2799[Bug][Dashboard] Some code specification issues
INLONG-2624[Improve][Dashboard] Modify the interface and parameters to adapt to changes in the Manager
INLONG-2535[Improve][dashboard] Audit module display time in reverse order
INLONG-2500[Feature][Dashboard] Adapt to Manager's modification of data storage
INLONG-2461[Bug] a number of CVEs exist for NPMs exist in dashboard

Release 1.0.0-incubating - Released (as of 2022-2-1)

FEATURES:

ISSUESummary
INLONG-2347[Feature]Support hive sink in sort-single-tenant
INLONG-2334[Feature][inlong-dataproxy]create pulsar client need support config ioThreads
INLONG-2333[Feature]Support clickhouse sink in sort-single-tenant
INLONG-2266[Feature]Support reporting metrics by audit-sdk in sort
INLONG-2250[Feature][InLong-Sort] Support Kafka sink in InLong-Sort
INLONG-2247Read the consume group offset and store to the specified topic
INLONG-2236[Feature]Support iceberg sink in sort-single-tenant
INLONG-2232Add start and end timestamp of segment
INLONG-2218[Feature][InLong-DataProxy] Inlong-DataProxy support authentication access pulsar
INLONG-2217[Feature][InLong-DataProxy] Add TCP protocol client demo and config doc feature
INLONG-2216[Feature][InLong-DataProxy] Add UDP protocol client demo and config doc
INLONG-2215[Feature][InLong-DataProxy] Add http protocol client demo and config doc
INLONG-2326[Feature] Inlong-Sort-Standalone support to sort the events to ElasticSearch cluster.
INLONG-2322[Feature][InLong-Sort] Support json format for kafka sink
INLONG-2301[Feature] Support Standalone deployment for InLong
INLONG-2207[Feature][InLong-Website] Add component about charts
INLONG-2187[Feature] Website support audit view
INLONG-2183[Feature][InLong-Sort] Bump flink version to 1.13.5
INLONG-2176Add histogram metric and client-side metric output
INLONG-2170[Feature] add Inlong-Sort-standalone document.
INLONG-2169[Feature] [Agent] should provide docs for agent db sql collect
INLONG-2167[Feature] [Agent] support db SQL collect
INLONG-2164[Feature] Sort-standalone expose metric data using prometheus HttpServer.
INLONG-2161[Feature][InLong-Manager] Manager support getClusterConfig
INLONG-2138[Feature] Agent should provide docs for programmers to customize their own source or sink
INLONG-2106[Feature] DataProxy expose metric data using prometheus HttpServer.
INLONG-2096[Feature] DataProxy add InlongGroupId+InlongStreamId metric dimensions in TDSDKSource and TubeSink.
INLONG-2077[Feature]sort-sdk change pulsar consume mode from listener to fetch
INLONG-2076[Feature] Tube sink of DataProxy support new Message format.
INLONG-2075[Feature] SDK Source of DataProxy support new Message format.
INLONG-2058[Feature] The metric of Sort-standalone append a dimension(minute level) of event time, supporting audit reconciliation of minute level.
INLONG-2056[Feature]The metric of DataProxy append a dimension(minute level) of event time, supporting audit reconciliation of minute level.
INLONG-2055[Feature] [InLong audit] Audit SDK Support real-time report
INLONG-2054[Feature] [InLong audit] Audit SDK Support disaster tolerance
INLONG-2053[Feature] [InLong audit] Audit Web Page Display
INLONG-2051[Feature] [InLong audit] Add Audit API for Manager
INLONG-2050[Feature] [InLong audit] Audit Strore for Elasticsearch
INLONG-2045[Feature]sort-sdk support Prometheus monitor
INLONG-2028[Feature][CI] Add support for docker build on GitHub Actions
INLONG-1992[Feature]sort-flink support configurable loader of getting configuration.
INLONG-1950[Feature] DataProxy add supporting to udp protocol for reporting data
INLONG-1949[Feature] DataProxy sdk add demo
INLONG-1931[Feature]Inlong-Sort-Standalone-readapi support to consume events from inlong cache clusters(tube)
INLONG-1895[Feature]Inlong-Sort-Standalone support to sort the events to Hive cluster.
INLONG-1894[Feature]Inlong-Sort-Standalone support JMX metrics listener for pushing.
INLONG-1892[Feature]Inlong-Sort-Standalone support to consume events from Pulsar cache clusters.
INLONG-1738[Feature] InLong audit

IMPROVEMENTS:

ISSUESummary
INLONG-2373[Improve] Refactor of CreateBusinessWorkflow
INLONG-2358[InLong audit] modify audit proxy name of introduction
INLONG-2352[InLong audit] add audit introduction
INLONG-2349[inlong-dataproxy] change log file name from flum.log to dataproxy.log
INLONG-2331[Improve] Extract connector related code to sort-connector module
INLONG-2329[Improve][inlong-dataproxy-sdk] asyncSendMessage in sender.java can be optimized to reduce the number of invalid objects
INLONG-2297[Improve][agent] support audit for source and sink
INLONG-2296Added lag consumption log
INLONG-2294Rename the variable BROKER_VERSION to SERVER_VERSION
INLONG-2279[Improve] Supplement TubeMQ's Javadoc information
INLONG-2274[Improve][Manager] Supports configuring whether to create a Hive database or table
INLONG-2271[Improve] rename the TDMsg to InLongMsg
INLONG-2258[Improve][dashboard] Audit page support auto select datastream
INLONG-2254Add historical offset query API
INLONG-2245[Improve] Supports database-level isolation of audit queries
INLONG-2229[Improve] Manager support pulsar authentification
INLONG-2225[Improve][InLong-Dashboard] Audit module support i18n
INLONG-2220[Improve] move dataproxy-sdk to inlong-sdk
INLONG-2210[Improve] package inlong-manager-web as inlong-manager
INLONG-2200[Feature] DataProxy add supporting to http protocol for reporting data
INLONG-2196[Improve] move website to dashboard
INLONG-2193[Improve] optimize inlong manager structure
INLONG-2160[Improve] Time format conversion using DateTimeFormatter
INLONG-2151[Improve] Add time and sort statistics by topic
INLONG-2133Update year to 2022
INLONG-2126[Improve]prepare_env.sh can be merged into dataproxy-start.sh，as a InLong beginner maybe forgot this step
INLONG-2122[Improve] Send a dev notifications email for issue status
INLONG-2119[Improve][Website][CI] Add support for building inlong website when building or testing project
INLONG-2117[Improve][agent] optimize class name
INLONG-2116[Improve][Website] Improve the README document
INLONG-2107[Improve] [InLong Manager] remove gson and json-simple from dependency
INLONG-2103[Improve] update the definition of Apache InLong
INLONG-2073[Improve] [InLong agent] remove spring 2.5.6 from dependencyManagement
INLONG-2072[Improve] update the deployment guide for sort
INLONG-2070[Improve] update the default pulsar demo configuration for dataproxy
INLONG-1944Bumped version to 0.13.0-incubating-SNAPSHOT for the master branch

BUG FIXES:

ISSUESummary
INLONG-2371[Bug][inlong-dataproxy] monitorIndex should not use msgid for key,it affects performance
INLONG-2361[Bug] audit have no data
INLONG-2344[Bug][InLong-Sort] Kafka sink ut failed under multithread compiling
INLONG-2338[Bug] agent can not get dataproxy for docker-compose environment
INLONG-2336[Bug][agent] the manager fetcher thread was shielded
INLONG-2288[Bug] sort-flink task catches an NPE
INLONG-2264[Bug] DataProxy get metric value with error JMX ObjectName
INLONG-2263[Bug] SortStandalone get metric value with error JMX ObjectName
INLONG-2252[Bug] Remove <> character in sort-standalone quick_start.md.
INLONG-2242[BUG][manager] table field incorrect: db_collector_detail_task, ‘sql’ should be ‘sql_statement’
INLONG-2237[Bug] call audit query interface error
INLONG-2230[Bug] manager started get jackson error
INLONG-2227[Bug] build failed for dataproxy-sdk
INLONG-2224[Bug][inlong-DataProxy] Source receive one message will be send to pulsar twice when config both memery channel and file channel
INLONG-2202[Bug] add lower version log4j exclusion in sort-standalone pom.xml
INLONG-2199[Bug][inlong-audit][audit-source] one message will put tow channel, and store two message
INLONG-2191[Bug][inlong-audit][audit-source] requestId is not set in response message
INLONG-2190[Bug][inlong-audit][audit-store] can not started by start shell
INLONG-2174[Bug]Clickhouse sink can cause data loss when checkpointing
INLONG-2155[Bug][Manager] Some unit tests running failed
INLONG-2148[Bug][sort]Pattern used for extracting clickhouse metadata is not compatible with some versions of clickhouse
INLONG-2143[Bug][sort] caught a NoClassDefFoundError exception
INLONG-2137[Bug] version 0.12.0 cannot pass UT
INLONG-2130[Bug] inlong-sort occurs ClassNotFoundException: og.objenesis..ClassUtils
INLONG-2113[Bug][Docker] Audit docker image build failed
INLONG-2098[Bug] agent can not restart successfully
INLONG-2097[Bug][Docker] error while building tubemq image
INLONG-2094[Bug] summit job failed after enabling Prometheus
INLONG-2089[Bug]tubemq-manager throws error when starting: java.lang.ClassNotFoundException: javax.validation.ClockProvider
INLONG-2087[Bug] Miss a “-p” flag before 2181:2181 in the command “Start Standalone Container”
INLONG-2085[Bug] Solve the incubator-inlong-website Compilation failure problem
INLONG-2084[Bug]A bug in the Go SDK demo, and the API result class is not clear enough
INLONG-2082[Bug] file agent collector file failed
INLONG-2080[Bug] file agent send file failed
INLONG-2078[Bug] create pulsar subscription failed
INLONG-2068[Bug] the class name in dataproxy stop.sh is wrong
INLONG-2066Each message will be consumed twice.[Bug]
INLONG-2064[Bug]master branch, tubemq-manager module occurs: package Java.validation.constraints not exists
INLONG-2061[Bug][Office-Website] The homepage structure image error
INLONG-1989[Bug]some font of " DataProxy-SDK architecture " page incorrectly
INLONG-1342[Bug] Create tube consumer group failed where the group exists

Release 0.12.0-incubating - Released (as of 2021-12-22)

FEATURES:

ISSUESummary
INLONG-1310[Feature] [Feature] Support Pulsar
INLONG-1711[feature] website support process pulsar dataflow
INLONG-1712[Feature][agent] Add agent metric statistics
INLONG-1722[Feature] Add IssueNavigationLink for IDEA
INLONG-1725[Feature] [InLong-Manager] Modify bid and tid (or dsid) to inlongGroupId and inlongStreamId
INLONG-1726[Feature] [InLong-Website] Adapt the Manager module and modify the field names of bid and dsid
INLONG-1732[Feature] [InLong-Agent] Modify bid and tid to inlongGroupId and inlongStreamId
INLONG-1738[Feature] InLong audit
INLONG-1764[Feature]Use black for code block background style
INLONG-1768[Feature] Adding consume type that allows partition assign from the client
INLONG-1785[Feature] add 0.11.0 release article for blog
INLONG-1786[Feature]Inlong-common provide monitoring indicator reporting mechanism with JMX, user can implement the code that read the metrics and report to user-defined monitor system.
INLONG-1791[Feature][InLong-Manager] Some bid fields have not been modified
INLONG-1796[Feature]DataProxy support monitor indicator with JMX.
INLONG-1809[Feature] Adjust the font style of the official home page
INLONG-1814[Feature] Show document file subdirectories
INLONG-1817[Feature][InLong-Manager] Workflow supports data stream for Pulsar
INLONG-1821[INLONG-810] Sort Module Support store data to ApacheDoris
INLONG-1826[Feature] Use jmx metric defined in inlong-common
INLONG-1830[Feature] Add a star reminder
INLONG-1833[Feature] Add Team button to the navigation bar
INLONG-1840[Feature] add a Welcome committer articles to official website blog
INLONG-1847[Feature][InLong-Manager] Add consumption APIs for Pulsar MQ
INLONG-1849[Feature][InLong-Manager] Push Sort config for Pulsar
INLONG-1851[Feature]TubeMQ supports monitoring indicators with JMX.
INLONG-1853[Feature] Agent should provide docs for jmx metrics
INLONG-1854[Feature] Agent Rmi args should be added in agent-env.sh
INLONG-1856[Feature] Add a news tab on the official website
INLONG-1867[Feature] Add a user column display to the official website
INLONG-1873[Feature] refactor the structure of the document for the official website
INLONG-1874[Feature] Add contact information and common links at the bottom of the homepage of the official website
INLONG-1878[Feature] Optimize user display page layout style
INLONG-1901[Feature] Optimize the layout of the user display page
INLONG-1910[Feature]Inlong-Sort-Standalone-sort-sdk support to consume events from inlong cache clusters(pulsar)
INLONG-1926[Feature]Inlong-Sort-Standalone support JMX metrics listener for pulling.
INLONG-1938[Feature] DataProxy send message to multi-pulsar cluster conf demo
INLONG-2002[Feature]creating data access with pulsar, users should be able to change the ensemble param

IMPROVEMENTS:

ISSUESummary
INLONG-1708[Improve] Add restrict of @author and Chinese in java file
INLONG-1729[Improve] Avoid using constant value as version when referencing other modules
INLONG-1739[Improve] Optimization of TubeMQ SDK usage demo
INLONG-1740[Improve] change bid/tid to be more identifiable
INLONG-1746[improve] the log4j properties for dataproxy contains some useless code and some class name are incorrect
INLONG-1756[Improve] Use metadata to manage data sources and flow fields
INLONG-1772[Improve]Adjust the ProcessResult class implementation
INLONG-1798[Improve]RestTemplate does not read configuration from the configuration file
INLONG-1802[Improve] Optimize document version management
INLONG-1808[Improve] Optimize document of DataProxy about monitor metric.
INLONG-1810[Improve] update the architecture for office-website
INLONG-1811[Improve] Modify the architecture diagram of README.md
INLONG-1815[Improve][translation] the blog of the 0.11.0 release should be translated into English
INLONG-1819Optimize GC parameter configuration in TubeMQ's env.sh file
INLONG-1822Optimize the table formatting in some MD documents
INLONG-1824Refine the how-to-vote-a-committer-ppmc.md
INLONG-1857[Improve] Adjust the content of the Disclaimer and Events column
INLONG-1859[Improve][InLong-Manager] Remove duplicate SQL files
INLONG-1861[Improve] Update document for docker-compose
INLONG-1863[Improve][TubeMQ] repHelperHost for master should be exposed in configuration
INLONG-1864[Improve] Agent Website doc contains a typo
INLONG-1865[Improve] There are several errors in TubeMQ's guidance document
INLONG-1877[Improve] improve the document's format for the office website
INLONG-1886[Improve][InLong-Manager] Refactor and delete unused entities
INLONG-1916[Improve][website] modify the Business to InLong Group
INLONG-1934[Improve] update the image of the hive example after the bid changed
INLONG-1935[Improve] package the SQL file for the manager
INLONG-1939[Improve] add basic concepts for InLong
INLONG-1952[Improve] Update the office website structure image
INLONG-1987[Improve] Add function comment information in TubeMQ
INLONG-2017[Improve] Add more guide documents for Pulsar

BUG FIXES:

ISSUESummary
INLONG-1706[Bug] there are some incorrect expressions for issues tracking in the how-to-contribute file
INLONG-1716[Bug][manager] can not login successfully
INLONG-1731[Bug] release template has sth wrong with KEY URL
INLONG-1745[Bug]TubeMQ HTTP API download link cannot be opened
INLONG-1752[Bug] The official website action failed to build, it may be that the node version needs to be upgraded
INLONG-1754[Bug] confused navigation in download page
INLONG-1755[Bug] Broken link in the ANNOUNCE email template
INLONG-1769[Bug][TubeMQ]Util function SpitToMap in Go SDK panic
INLONG-1771[Bug] Website readme error
INLONG-1776[Bug] Get error while parse td msg with go client
INLONG-1777[Bug][TubeMQ]Go SDK failed to parse tdmsg v4
INLONG-1781[Bug] Get uncorrect time value of attributes
INLONG-1783[Bug] Topic filters config has't any effects
INLONG-1828[Bug]parse message error: invalid default attr's msg Length
INLONG-1876[Bug] office website build failed
INLONG-1897[Bug][Website] form cannot use chain name
INLONG-1898[Bug][Website] The error of the person responsible for the second edit of the new consumption
INLONG-1902[Bug][Website] Access create params error
INLONG-1911[Bug] Some questions about the metric implementation in the common module
INLONG-1915[Bug] tubemq master can not start
INLONG-1919[Bug] TubeMQ HTTP API xls can not download
INLONG-1920[Bug]Failed to start up MultiSession factory by following the demo code
INLONG-1953[Bug]It can not be submitted when I create data access using file data source
INLONG-1954[Bug]inlong-sort does not support pulsar ???
INLONG-1955[Bug]Source data fields' type are all mapped to tinyint, and can not be modified
INLONG-1958[Bug]Avoid the security risks of log4j package
INLONG-1966[Bug][InLong-Manager] The stream name field is not required, but error occurs when create a data stream with name field not filled
INLONG-1967[Bug][InLong-Manager] Cannot create the Pulsar subscription
INLONG-1973[Bug]with the demo conf of dataproxy, the app can not start rightly
INLONG-1975[Bug]error occurs when deleting a data access
INLONG-1978[Bug]Create multiple file import tasks, and inlong-agent reports an error when registering metric
INLONG-1980[Bug]the content of topics.properties generated incorrectly，and too much backup files generate automatically
INLONG-1981[Bug] When compiling the project, the InLong-audit module reported Warning errors
INLONG-1984[Bug][InLong-Manager] Create pulsar access, modify pulsar related parameters failed
INLONG-1995[Bug] Compile Audit-SDK and report TestNGException
INLONG-1996[Bug] Compile the project and InLong-Agent module throws 3 exceptions
INLONG-1997[Bug]after the compilation of inlong, no lib directory in inlong-dataproxy
INLONG-2009[Bug]Topic obtained through “/api/inlong/manager/openapi/dataproxy/getConfig” is not right
INLONG-2012[Bug] Inlong-agent could not fetch file agent task through api --“/api/inlong/manager/openapi/agent/fileAgent/getTaskConf”
INLONG-2014[Bug]inlong-dataproxy could not identify the groupId and topic format of topics.properties
INLONG-2018[Bug]after approving a data access, some failures happen and the data access is always in the state of configuration
INLONG-2020[Bug] Dependency of “jul-to-slf4j” is missing for pulsar connector
INLONG-2023[Bug] Agent stream id is not passed to proxy
INLONG-2026[Bug] Found Pulsar client create failure when starting Sort
INLONG-2030[Bug]inlong-agent raises NPE error when running
INLONG-2032[Bug]“javax.xml.parsers.FactoryConfigurationError” throwed in flink when starting a inlong-sort job
INLONG-2035[Bug] Agent use wrong tid __ to generate message
INLONG-2038[Bug]inlong-sort abandon data from pulsar due to an ClassCastException
INLONG-2043[Bug] Sort module renames tid to streamId

Release 0.11.0-incubating - Released (as of 2021-10-25)

FEATURES:

ISSUESummary
INLONG-624[Feature] Go SDK support for TubeMQ
INLONG-1308[Feature] Support Deploying All Modules on Kubernetes
INLONG-1330[Feature] DataProxy support Pulsar
INLONG-1631[Feature] [office-website] Refactor incubator-inlong-website by docusaurus

IMPROVEMENTS:

ISSUESummary
INLONG-1324[Improve] [Manager] The consumption details should be refreshed after editing successfully
INLONG-1327[Improve] [Manager] Supports pagi`ng query for workflow execution log
INLONG-1578[Improve] Go SDK should provide a more elegant way to set the parameter of config`
INLONG-1571[Improve] [CI] Check License Heade
INLONG-1584[Improve] TDMsg Decode Support For Go SDK
INLONG-1585[Improve] Improve issue template with issue forms
INLONG-1589[Improve] [Manager] Manager provide an openapi of DataProxy configuration data for multi-subcluster
INLONG-1593[Improve] Add EmptyLineSeparator java code checkstyle rule
INLONG-1595[Improve] inlong-dataproxy start by the configuration data from inlong-manager
INLONG-1623[Improve] Optimize EntityStatus enum
INLONG-1619[Improve] Add improve suggestion template
INLONG-1611[Improve] Enable Merge Button
INLONG-1623[Improve] add contribution guide document for the main repo
INLONG-1626[Improve] [office-website] Agent introduce a Message filter
INLONG-1628[Improve] Remove commitlint in package.json
INLONG-1629[Improve] Disable merge commit
INLONG-1632[Improve] [office-website] Refactoring of basic projects
INLONG-1633[Improve] [office-website] Migrate modules documentation
INLONG-1634[Improve] [office-website] Migrate download documentation
INLONG-1635[Improve] [office-website] Migrate development documentation
INLONG-1636[Improve] [office-website] Replace the default language selection icon
INLONG-1637[Improve] [office-website] Add docusaurus i18n docs
INLONG-1638[Improve] [office-website] Adapt new github action command
INLONG-1641[Improve] [Agent] Agent introduce a Message filter
INLONG-1642[Improve] [Agent] Agent Use Message filter to get tid from different lines in a file
INLONG-1650[Improve] [TubeMQ] Provide a more elegant way to define config address
INLONG-1662[Improve] [GitHub] Improve issue templates
INLONG-1666[Improve] [TubeMQ] README for Go SDK
INLONG-1668[Improve] [office-website] Adapt quick edit link
INLONG-1669[Improve] [office-website] Adapt docusaurus build command
INLONG-1670[Improve] [Manager] Add H2 in UT
INLONG-1680[Improve] [doc] remove the redundant download links
INLONG-1682[Improve] [TubeMQ] New Go module for Go SDK
INLONG-1699[Improve] [doc] add a correct interpretation for InLong
INLONG-1701[Improve] [InLong-Manager] Adjust unit tests

BUG FIXES:

ISSUESummary
INLONG-1498ignore the files with versionsBackup suffix for the bumped version
INLONG-1507Go Client should reconnect to server if the server is shutdown and restarted
INLONG-1509duplicate issues be counted in CHANGES.md
INLONG-1511release guild documents has some errors
INLONG-1514the license header is not correct for inlong-website/nginx.conf
INLONG-1525Go SDK fail to parse SubscribeInfo
INLONG-1527GoSDK should throw error if it fail to connect to master
INLONG-1529Go SDK should reset heartbeat if register to master successfully
INLONG-1531Go SDK should init the flow control item of the partition
INLONG-1533Go SDK should provide more example
INLONG-1535Go SDK should be closed before stopping the event processing goroutine
INLONG-1538TubeMQ reports the error “Topic xxx not publish” when producing data
INLONG-1550Go SDK should obey the flow control rule
INLONG-1552Java SDK should deal with the default flow control rule
INLONG-1553migrate the user manual documents at first class
INLONG-1554remove the Console Introduction for manager
INLONG-1555Go SDK should record the consumer config to the log
INLONG-1558Go SDK should provide a multi goroutine consumer example
INLONG-1560C++ SDK can not return error code of PartInUse and PartWaiting correctly
INLONG-1562[K8s] There are some syntax bugs and configuration bugs in helm chart
INLONG-1563Go SDK can not stop the heartbeat timer after the consumer has been closed
INLONG-1566The user defined partition offset of Go SDK can not take effect
INLONG-1568C++ SDK cant not return the whether the partition has been registered correctly
INLONG-1569The first_registered is not the same with its naming
INLONG-1573Add TDMsg decode logic to TubeMQ's C++ SDK
INLONG-1575Modify the download url of version 0.9.0
INLONG-1579lots of files are not standard License Header
INLONG-1581InLong's website does not work without Javascript
INLONG-1587Fix compile error
INLONG-1592TextFileReader: The cpu utilization rate is very high, nearly 50%
INLONG-1600There are some YAML errors in bug report and feature request issue forms
INLONG-1604Some resultType is wrong in mapper
INLONG-1607The master version should be added in the bug-report.yml
INLONG-1614dataProxyConfigRepository constructor error
INLONG-1617Ignore mysql directory after run docker compose
INLONG-1621RestTemplateConfig cannot load config from properties
INLONG-1625some page links are not available for Contribution Guide
INLONG-1645[Bug] Druid datasource is not used
INLONG-1665Adjust the content of the document title
INLONG-1673some links are not available after office-website refactored
INLONG-1676two recent PRs were overwritten after the office-website refactored
INLONG-1677the architecture picture is lost in README
INLONG-1685the Chinese Quick Start Guide has some incorrect place after the office-webiste refactored
INLONG-1694Build docker mirror error for TubeMQ C++
INLONG-1695[Bug][DataProxy] Build failed

Release 0.10.0-incubating - Released (as of 2021-09-01)

IMPROVEMENTS:

ISSUESummary
INLONG-570Optimizing the implementations of HTTP API for Master
INLONG-726Optimize The Deployment For InLong
INLONG-732Optimize the CI/CD workflow for build and integration test
INLONG-733Unity the Manger-API/Manger-OpenAPI, and change Manager-API to Manager-Web
INLONG-744Error log, should use log4j
INLONG-750Add configuration descriptions for ‘defEthName’ in ‘broker.ini’
INLONG-756package start.sh script executable for agent
INLONG-768add github pull request template
INLONG-789make agent readme more friendly
INLONG-792tubemanager add a cluster after configuration
INLONG-800Fix codestyle of some comments and methods names.
INLONG-804Optimize the ASF Configuration
INLONG-805Migrate InLong Issues from JIRA to GitHub
INLONG-808Missing dataproxy sdk readme
INLONG-809dataproxy readme delete reference url
INLONG-1498ignore the files with versionsBackup suffix for the bumped version
INLONG-1487remove the user number limit when create a new data stream
INLONG-1486[agent] update the document about configuring the dataprxy address
INLONG-1485[sort] add the guide documents for using Pulsar
INLONG-1484Bid and Tid is not well explained in agent and might cause send error
INLONG-1464Add code CheckStyle rules
INLONG-1459proxy address configuration is redundant for inlong-agent
INLONG-1457remove the user limit for creating a new data access
INLONG-1455add a script to publish docker images
INLONG-1443Provide management interface SDK
INLONG-1439Add the port legal check and remove the useless deleteWhen field
INLONG-1430Go SDK example
INLONG-1429update the asf config for inlong office website
INLONG-1427Go SDK return maxOffset and updateTime in ConsumerOffset
INLONG-1424change the format of the configuration file: make the yaml to properties
INLONG-1423modify the docker image of the inlong-manager module
INLONG-1417rename the distribution file for inlong
INLONG-1415[TubeMQ Docker] expose zookeeper port for other component usages
INLONG-1409Sort out the LICENSE information of the 3rd-party components that the DataProxy submodule depends on
INLONG-1407[DataProxy]Adjust the pom dependency of the DataProxy module
INLONG-1405too many issues mail at dev@inlong mailbox

BUG FIXES:

ISSUESummary
INLONG-751InLong Manager start up error
INLONG-776fix the version error for tubemq cpp client docker image
INLONG-777InLong Manager new data stream error
INLONG-782Optimize The PULL_REQUEST_TEMPLATE
INLONG-787The actions “reviewdog/action-setup” is not allowed to be used
INLONG-797the document for deployment DataProxy is not complete
INLONG-799can not find common.properties for dataproxy
INLONG-1488there are still some chinese characters for website
INLONG-1475Tube manager compile ch.qos.logback with error
INLONG-1474the interface of get data proxy configurations got abnormal status result
INLONG-1470Java.util.ConcurrentModificationException error when rebalance
INLONG-1468The update interval of dataproxy is quite long and may cause produce error when config is not updated
INLONG-1466get snappy error when the agent collecting data
INLONG-1462dataproxy can not create configuration properties successfully in the docker container
INLONG-1458The http port in agent readme should be 8008 to be consistent with the code
INLONG-1453agent connect dataproxy fail when using docker-compose
INLONG-1448The Manager throws an exception when creating a business
INLONG-1447Fix Group Control API logic bug
INLONG-1444Fix Web API multiple field search logic bug
INLONG-1441Repair Broker configuration API bugs
INLONG-1436[CI] The checkstyle workflow is redundant
INLONG-1432The manager url of agent and dataproxy need to be updated since manager merged openapi and api into one module
INLONG-1403fix some error in dataproxy-sdk readme

SUB-TASK:

ISSUESummary
INLONG-576Build metadata entity classes
INLONG-578Build implementation classes based on BDB storage
INLONG-579Add structure mapping of BDB and metadata entity classes
INLONG-580Build active and standby keep-alive services
INLONG-581Add data cache in BDB metadata Mapper implementations
INLONG-582Adjust the business logic related to the BdbClusterSettingEntity class
INLONG-583Adjust BrokerConfManager class implementation
INLONG-584Adjust WebMasterInfoHandler class implementation
INLONG-593Add WebGroupConsumeCtrlHandler class implementation
INLONG-595Add WebBrokerConfHandler class implementation
INLONG-596Add WebTopicConfHandler class implementation
INLONG-597Adjust WebTopicCtrlHandler class implementation
INLONG-598Adjust WebTopicCtrlHandler class implementation
INLONG-599Adjust WebParameterUtils.java's static functions
INLONG-601Adjust WebBrokerDefConfHandler class implementation
INLONG-602Add replacement processing after metadata changes
INLONG-611Add FSM for broker configure manage
INLONG-617Add unit tests for WebParameterUtils
INLONG-618Add unit tests for metastore.dao.entity.*
INLONG-625Add unit tests for metamanage.metastore.impl.*
INLONG-626Fix broker and topic confiugre implement bugs
INLONG-707Bumped version to 0.10.0-SNAPSHOT
INLONG-740Merge the changes in INLONG-739 to master and delete the temporary branch
INLONG-755Go SDK Consumer Result
INLONG-757fix the artifactId of dataproxy
INLONG-758remove redundant baseDirectory for manager output files
INLONG-759fix assembly issue for TubeMQ manager
INLONG-760standardize the directories name for the sort sub-module
INLONG-761unify all modules target files to a singe directory
INLONG-762refactor the deployment document
INLONG-763make the inlong-websit be a maven module of InLong project
INLONG-764Fix Go SDK RPC Request bug
INLONG-766Fix Go SDK Codec Bug
INLONG-770update the readme document
INLONG-771Fix Go SDK Authorization Bug
INLONG-773add manager docker image
INLONG-774update TubeMQ docker images to InLong repo
INLONG-778Fix Go SDK Consumer Bug
INLONG-779update tubemq manager docker image
INLONG-781add inlong agent docker image support
INLONG-784Fix Go SDK Heartbeat Bug
INLONG-785Fix Go SDK Metadata Bug
INLONG-786add dataproxy docker image
INLONG-788Fix Go SDK Remote Cache Bug
INLONG-791Go SDK Support multiple topic address
INLONG-793Fix Some Corner Case in Go SDK
INLONG-794add website docker image
INLONG-803add docker requirement for building InLong
INLONG-806open GitHub Issue For InLong
INLONG-807migrate issue history to inlong
INLONG-1491Add 0.10.0 version release modification to CHANGES.md
INLONG-1492Bumped version to 0.11.0-incubating-SNAPSHOT
INLONG-1493Modify download&release notes for 0.10.0
INLONG-1494Adjust the version information of all pom.xml to 0.10.0-incubating
INLONG-1495Update Office website content for release 0.10.0
INLONG-1496Release InLong 0.10.0
INLONG-1497create a 0.10.0 branch to release
INLONG-1502publish all 0.10.0 images to docker hub

Release 0.9.0-incubating - Released (as of 2021-07-11)

IMPROVEMENTS:

JIRASummaryPriority
INLONG-594Trpc-go tube sdk strongly rely on local configMajor
INLONG-616Adjust the content in .asf.yaml according to the new project nameMajor
INLONG-651Refine the tubemq-client-cpp build descriptionMajor
INLONG-655add dependency in tube-managerMajor
INLONG-656fix tubemanager start.shMajor
INLONG-657remove some test cases in agentMajor
INLONG-659fix unit test in agentMajor
INLONG-666change tar name in agentMajor
INLONG-697fix decode error in proxySdkMajor
INLONG-705add stop.sh in dataproxyMajor
INLONG-743Adjust the rat check setting of the pom.xmlMajor

BUG FIXES:

JIRASummaryPriority
INLONG-577reload status output and topic config output mismatchMajor
INLONG-612Restful api “admin_snapshot_message” is not compatible with the old versionMajor
INLONG-638Issues About Disk Error recoveryMajor
INLONG-688change additionstr to additionAtr in agentMajor
INLONG-703Query after adding a consumer group policy and report a null errorMajor
INLONG-724Encountered a symbol not found error when compilingMajor

TASK:

JIRASummaryPriority
INLONG-613Adjust the project codes according to the renaming requirementsMajor

SUB-TASK:

JIRASummaryPriority
INLONG-519Bumped version to 0.9.0-SNAPSHOTMajor
INLONG-565Replace simple scripts and code implementationMajor
INLONG-571Adjust WebOtherInfoHandler class implementationMajor
INLONG-573Adjust WebAdminFlowRuleHandler class implementationMajor
INLONG-574Adjust WebAdminGroupCtrlHandler class implementationMajor
INLONG-632Add inlong-manager subdirectoryMajor
INLONG-633Add inlong-sort subdirectoryMajor
INLONG-634Add inlong-tubemq subdirectoryMajor
INLONG-635Add inlong-dataproxy subdirectoryMajor
INLONG-636Add inlong-agent subdirectoryMajor
INLONG-640Adjust the main frame of the InLong projectMajor
INLONG-641Add inlong-common moduleMajor
INLONG-642Add inlong-website subdirectoryMajor
INLONG-643Add inlong-dataproxy-sdk subdirectoryMajor
INLONG-644Remove “/dist” from .gitignore and add subdirectory dist in inlong-sortMajor
INLONG-646Remove time related unit tests until timezone is configurable in inlong-sortMajor
INLONG-647Adjust the introduction content of the README.mdMajor
INLONG-648Change initial version of inlong-sort to 0.9.0-incubating-SNAPSHOTMajor
INLONG-649Modify the suffix of the docs/zh-cn/download/release-0.8.0.md fileMajor
INLONG-650Adjust .asf.yaml's labelMajor
INLONG-654Adjust the link in ReadMe.md according to the latest documentMajor
INLONG-658modify the dependency of inlong-managerMajor
INLONG-663modify the tar package name of inlong-managerMajor
INLONG-667rename tar in agentMajor
INLONG-673add tube cluster id in inlong-managerMajor
INLONG-674adjust HiveSinkInfo in inlong-managerMajor
INLONG-675modify the npm script of inlong-websiteMajor
INLONG-676modify manager-web to manager-api in inlong-manager moduleMajor
INLONG-677Support dt as built-in data time partition field in inlong-sortMajor
INLONG-681modify assembly in agent proxy tubemanagerMajor
INLONG-687set schemaName to m0_day when save business in inlong-managerMajor
INLONG-689add sort app nameMajor
INLONG-691update properties and scripts for inlong-managerMajor
INLONG-692remove hive cluster entity in inlong-managerMajor
INLONG-693change data type to tdmsgMajor
INLONG-694Add retry mechanism for creating tube consumer groupMajor
INLONG-695update getConfig API in inlong-managerMajor
INLONG-696modify the status of the entities after approvalMajor
INLONG-699Fix serialization issue of DeserializationInfo 's subType in inlong-sortMajor
INLONG-700Optimize dependencies in inlong-sortMajor
INLONG-701Update create resource workflow definitionMajor
INLONG-702sort config field spillterMajor
INLONG-706Add 0.9.0 version release modification to CHANGES.mdMajor
INLONG-709Adjust the version information of all pom.xml to 0.9.0-incubatingMajor
INLONG-712adjust partition info for hive sinkMajor
INLONG-713add partition filed when create hive tableMajor
INLONG-714Enable checkpointing in inlong-sortMajor
INLONG-715Make shouldRollOnCheckpoint always return true in DefaultRollingPolicy in inlong-sortMajor
INLONG-716set terminated symbol when create hive tableMajor
INLONG-717Declare the 3rd party Catagory x LICENSE components in useMajor

Release 0.8.0-incubating - Released (as of 2021-01-18)

IMPROVEMENTS:

JIRASummaryPriority
INLONG-430Optimizing the implementation of HTTP API for brokeMajor
INLONG-445Adjust the status check default sleep interval of pullConsumeReadyChkSliceMsMajor
INLONG-448Add Committer and PPMC operation processMajor
INLONG-449Adjust Example implementationMajor
INLONG-452Optimize rebalance performanceMajor
INLONG-467Add WEB APIs of Master and BrokerMajor
INLONG-489Add the maximum message length parameter settingMajor
INLONG-495Code implementation adjustment based on SpotBugs checkMajor
INLONG-511Replace the conditional operator (?:) with mid()Major
INLONG-512Add package length control based on TopicMajor
INLONG-515Add cluster Topic view web apiMajor

BUG FIXES:

JIRASummaryPriority
INLONG-437Fix tubemq table source sink factory instance creating problemMajor
INLONG-441An error occurred when using the Tubemq class to create a sink tableMajor
INLONG-442Modifying the jvm parameters when the broker starts does not take effectMajor
INLONG-443TubemqSourceFunction class prints too many logs problemMajor
INLONG-446Small bugs fix that do not affect the main logicsMajor
INLONG-450TubeClientException: Generate producer id failedMajor
INLONG-453TubemqSourceFunction class prints too many logs problemMajor
INLONG-506cmakelist errorMajor
INLONG-510Found a bug in MessageProducerExample classMajor
INLONG-518fix parameter pass errorMajor
INLONG-526Adjust the packaging script and version check list, remove the “-WIP” tagMajor
INLONG-555short session data can only be written to a specific partitionMajor
INLONG-556Index value is bigger than the actual number of recordsLow

TASK:

JIRASummaryPriority
INLONG-505Remove the “WIP” label of the DISCLAIMER fileMajor
INLONG-543Modify the LICENSE statement of multiple files and othersMajor
INLONG-557Handle the issues mentioned in the 0.8.0-RC2 reviewMajor
INLONG-562Update project contents according to the 0.8.0-RC3 reviewMajor

SUB-TASK:

JIRASummaryPriority
INLONG-428Bumped version to 0.8.0-SNAPSHOTMajor
INLONG-433add tubemq perf-consumer/producer scriptsMajor
INLONG-434Adjust Broker API mappingMajor
INLONG-435Create Web field MappingMajor
INLONG-436Adjust Broker's HTTP API implementationMajor
INLONG-439Add Cli field Scheme definitionMajor
INLONG-440Add feature package tube-manager to zipMajor
INLONG-444Add consume and produce Cli commandsMajor
INLONG-447Add Broker-Admin CliMajor
INLONG-451Replace ConsumeTupleInfo with Tuple2Major
INLONG-457There is no need to return StringBuilder in Master.javaMajor
INLONG-463Adjust Master rebalance process implementationMajor
INLONG-464Add parameter rebalanceParallel in master.iniMajor
INLONG-470Add query API of TopicName and BrokerId collectionMajor
INLONG-471Add query API Introduction of TopicName and BrokerId collectionMajor
INLONG-472Adjust Broker's AbstractWebHandler class implementationMajor
INLONG-475add the offset clone api of the consume groupMajor
INLONG-482Add offset query apiMajor
INLONG-484Add query API for topic publication informationMajor
INLONG-485Add the batch setting API of consume group offsetMajor
INLONG-486Add the delete API of consumer group offsetMajor
INLONG-494Update API interface instruction documentMajor
INLONG-499Add configure storeMajor
INLONG-500Add setting operate APIMajor
INLONG-501Adjust max message size check logicMajor
INLONG-502Add setting API interface documentMajor
INLONG-504Adjust the WebMethodMapper class interfacesMajor
INLONG-508Optimize Broker's PB parameter check processing logicMajor
INLONG-509Adjust the packet length check when data is loadedMajor
INLONG-522Add admin_query_cluster_topic_view API documentMajor
INLONG-544Adjust the LICENSE statement in the client.conf files of Python and C/C++ SDKMajor
INLONG-546Restore the original license header of the referenced external source filesMajor
INLONG-547Recode the implementation of the *Startup.java classes in the Tool packageMajor
INLONG-548Handle the LICENSE authorization of font files in the resourcesMajor
INLONG-549Handling the problem of compilation failureMajor
INLONG-550Adjust LICENSE file contentMajor
INLONG-551Adjust NOTICE file contentMajor
INLONG-558Adjust the LICENSE of the file headerMajor
INLONG-559Update the LICENSE file according to the 0.8.0-RC2 reviewMajor
INLONG-560Remove unprepared modulesMajor

Release 0.7.0-incubating - Released (as of 2020-11-25)

New Features:

JIRASummaryPriority
INLONG-162Python SDK support in TubeMQHigh
INLONG-336Propose web portal to manage tube cluster Phase-IMajor
INLONG-390support build C++ SDK with docker imageNormal

IMPROVEMENTS:

JIRASummaryPriority
INLONG-369hope to add an option in the compilation script (like make lib etc...)Major
INLONG-373Reduce the redundant code of Utils::Split functionsMajor
INLONG-374Adjust some coding style issuesMajor
INLONG-375Add a section to the README file about how to compile the projectMajor
INLONG-385update docker imagesMajor
INLONG-393Optimize the mapping code of WEB APIMajor
INLONG-406test_consumer.py works for both Python 2 and 3Minor
INLONG-410install python package and simplify test_consumer.pyMajor
INLONG-416support consume from specified positionMajor
INLONG-417C++ Client support parse message from binary data for Python SDKMajor
INLONG-419SetMaxPartCheckPeriodMs() negative number, getMessage() stillMajor

BUG FIXES:

JIRASummaryPriority
INLONG-365Whether the consumption setting is wrong after the processRequest exceptionMajor
INLONG-370Calling GetCurConsumedInfo API always returns failureMajor
INLONG-376Move pullrequests_status notifications commits mail listMajor
INLONG-366Found a nullpointerexception bug in brokerNormal
INLONG-379Modify the memory cache size default to 3MNormal
INLONG-380Cpp client link error when gcc optimization is disabledMajor
INLONG-405python sdk install files lack of the whole cpp configurationMajor
INLONG-401python sdk readme bugMinor
INLONG-407Fix some content in README.mdTrivial
INLONG-418C++ SDK function SetMaxPartCheckPeriodMs() can't workMajor

SUB-TASK:

JIRASummaryPriority
INLONG-276add python client encode/decode protobuf message for TubeMQ RPC ProtocolMajor
INLONG-338web pages for tubemq managerMajor
INLONG-341open independent sub-project for tubemqMajor
INLONG-342abstract backend threads for routine managementMajor
INLONG-346remove chinese commentsMinor
INLONG-355Add business entity for topic managerMajor
INLONG-361create topic when getting requestMajor
INLONG-364uniform response format for exception stateMajor
INLONG-383document about Installation/API Reference/ExampleMajor
INLONG-387add manager web pagesMajor
INLONG-392add query rest api for clustersMajor
INLONG-394Creating Mapper class from web api to inner handlerMajor
INLONG-395Create Abstract WebHandler classMajor
INLONG-396Adjust the WebXXXHandler classes implementationMajor
INLONG-397Add master info and other info web handlerMajor
INLONG-398reinit project for using pybind11Major
INLONG-399expose C++ SDK method by Pybind11Major
INLONG-400add example for consume message by bypind11Major
INLONG-402add modify rest api for clustersMajor
INLONG-412tube manager start stop scrrptsMajor
INLONG-415exclude apache license for front end codeMajor

Release 0.6.0-incubating - Released (as of 2020-09-25)

New Features:

JIRASummaryPriority
INLONG-319In the pull mode, consumers support the suspension of consumption for a certain partitionMajor
INLONG-3C++ SDK support in TubeMQNormal

IMPROVEMENTS:

JIRASummaryPriority
INLONG-311Feedback more production informationMajor
INLONG-312Feedback more consumption informationMajor
INLONG-325Add 406 ~ 408 error code to pullSelect callMajor
INLONG-345Optimize the call logic of getMessage() in Pull modeMajor
INLONG-352Set the parameters of the example at startupMajor
INLONG-353Update LICENSE about C/C++ SDK's code referenceMajor
INLONG-356C++ SDK Codec decode add requestidMajor
INLONG-327Fix the concurrency problem in the exampleNormal

BUG FIXES:

JIRASummaryPriority
INLONG-316Where the port the port is aleady used, the process throw the exception, but not exitMajor
INLONG-317The Store Manager throws java.lang.NullPointerExceptionMajor
INLONG-320Request for static web contents would get responses with no contentMajor
INLONG-354Found a dns translate bug in C/C++ sdkMajor
INLONG-306Raise Nullpointer Exception when create tubemq instanceLow
INLONG-359TubeMQ consume speed dropped to 0 in some partitions, it is a very serious bugBlocker

SUB-TASK:

JIRASummaryPriority
INLONG-250Create C/C++ configure filesMajor
INLONG-251Create C/C++ Codec utilsMajor
INLONG-252Create C/C++ Metadata classesMajor
INLONG-262Create C++ flow control handlerMajor
INLONG-263Create C/C++ ini file read utilsMajor
INLONG-266[INLONG-266] Add Tencent/rapidjson as submoduleMajor
INLONG-267Create C/C++ Message classMajor
INLONG-269Create C/C++ RmtDataCache classMajor
INLONG-272Unified C/C++ files's code styleMajor
INLONG-274Support CMake compilationMajor
INLONG-275Thread Pool & TimerMajor
INLONG-280Create C/C++ subscribe info classMajor
INLONG-281atomic_def.h use C++11 stdlib classMajor
INLONG-282Create C/C++ return result classMajor
INLONG-283Adjust C/C++ some file names: add “tubemq_” prefixMajor
INLONG-285Replace C/C++ pthread's mutex to std::mutexMajor
INLONG-286Create C/C++ SDK's manager classMajor
INLONG-287C++ SDK io bufferMajor
INLONG-288C++ SDK Codec interfaceMajor
INLONG-289C++ SDK Codec TubeMQ proto supportMajor
INLONG-290C++ SDK TCP ConnectMajor
INLONG-291C++ SDK Connect PoolMajor
INLONG-293C++ SDK Create Future classMajor
INLONG-296Adjust the version information of all pom.xmlMajor
INLONG-300Update LICENSEMajor
INLONG-308Upgrade Jetty 6 (mortbay) => Jetty 9 (eclipse)Major
INLONG-309Add POST support to WebAPIMajor
INLONG-326[website] Added 405 ~ 408 error code definitionMajor
INLONG-347C++ SDK Create client APIMajor
INLONG-348C++SDK Client handler detailMajor
INLONG-349C++ SDK Create Thread PoolMajor
INLONG-350C++ SDK client code adjMajor
INLONG-351C++ SDK example&testsMajor
INLONG-358Adjust tubemq-manager, remove it from master, and develop with INLONG-336 branchMajor
INLONG-268C++ SDK log moduleNormal
INLONG-292C++ SDK singleton & executor_pool optimizationNormal
INLONG-270this point c++ SDK classMinor
INLONG-271C++ SDK copy constructor and assignment constructorMinor
INLONG-273C++ SDK dir name change inc -> include/tubemq/Minor

Release 0.5.0-incubating - released (as of 2020-07-22)

NEW FEATURES:

JIRASummaryPriority
INLONG-122Increase JAVA version collection of SDK environmentMajor
INLONG-163Flume sink for TubeMQMajor
INLONG-197Support TubeMQ connector for Apache FlinkMajor
INLONG-238Support TubeMQ connector for Apache Spark StreamingMajor
INLONG-239support deployment on kubernetesMajor

IMPROVEMENTS:

JIRASummaryPriority
INLONG-46Correct some spelling issuesLow
INLONG-53fix some typosLow
INLONG-55fix some typosLow
INLONG-57fix some typos & todoLow
INLONG-58fix some typosLow
INLONG-60Remove unnecessary synchronized & using IllegalArgumentException instead of IllegalStateExceptionLow
INLONG-61minor update & fix some typosLow
INLONG-64minor update & fix some typosLow
INLONG-67remove synchronized & fix some typosLow
INLONG-71using IllegalArgumentException & fix some typosLow
INLONG-73remove duplicate codes & some minor updatesNormal
INLONG-74minor updates for DefaultBdbStoreServiceLow
INLONG-75remove unused LoggerMajor
INLONG-76rename the classesLow
INLONG-77fix typoLow
INLONG-79fix typoMajor
INLONG-80Fix some typosLow
INLONG-82Fix some typos & update commentsLow
INLONG-83Fix some typosLow
INLONG-87Minor updatesLow
INLONG-89Minor updatesLow
INLONG-90Remove unused codes in TubeBrokerNormal
INLONG-91replace explicit type with <>Low
INLONG-93Substitute the parameterized type for client module & missed server moduleLow
INLONG-94Substitute the parameterized type for core moduleLow
INLONG-95Substitute the parameterized type for server moduleLow
INLONG-96Fix typo & use IllegalArgumentExceptionLow
INLONG-98Fix typo & Simplify ‘instanceof’ judgmentLow
INLONG-100Fix typos & remove unused codesLow
INLONG-101Optimize code & Fix typeLow
INLONG-103Substitute Chinese comments with EnglishNormal
INLONG-108About maven jdk version configuration problemMinor
INLONG-127Fixed a bug & minor changesLow
INLONG-128Shorten the log clearup check cycleMajor
INLONG-138Optimize core module test case codeLow
INLONG-141Remove the requirement to provide localHostIPMajor
INLONG-152Modify the master.ini file's annotationsNormal
INLONG-154Modify the wrong comment & Minor changes for example moduleLow
INLONG-155Use enum class for consume positionNormal
INLONG-156Update for README.mdNormal
INLONG-166Hide bdbStore configs in master.iniMajor
INLONG-167Change to relative paths in default configsTrivial
INLONG-168Example module: remove localhost IP configuration parametersMinor
INLONG-170improve build/deployment/configuration for quick startMajor
INLONG-196use log to print exceptionLow
INLONG-201[Website] Adjust user guide & fix demo exampleMajor
INLONG-202Add protobuf protocol syntax declarationMajor
INLONG-213Optimize code & Minor changesLow
INLONG-216use ThreadUtil.sleep replace Thread.sleepLow
INLONG-222Optimize code: Unnecessary boxing/unboxing conversionNormal
INLONG-224Fixed: Unnecessary conversion to string inspection for server moduleLow
INLONG-226Add Windows startup scriptsHigh
INLONG-227remove build guide in docker-build readmeMajor
INLONG-232TubeBroker#register2Master, reconnect and waitLow
INLONG-234Add .asf.yaml to change notificationsMajor
INLONG-235Add code coverage supporting for pull request created.Normal
INLONG-237add maven module build for docker imageMajor

BUG FIXES:

JIRASummaryPriority
INLONG-47Fix some typosMajor
INLONG-102Fix question [INLONG-101] [Optimize code]Major
INLONG-121Fix compilation alarmMajor
INLONG-139a bug in the equals method of the TubeClientConfig classMajor
INLONG-157Optimize Broker disk anomaly checkNormal
INLONG-158nextWithAuthInfo2B status should be managed independently according to BrokerNormal
INLONG-159Fix some typosNormal
INLONG-165Remove unnecessary fiilesMajor
INLONG-205Duplicate dependency of jetty in tuber-server pom fileMinor
INLONG-206There are some residual files after executed unit testsMajor
INLONG-210Add log4j properties file for unit testsMinor
INLONG-217UPdate the je download pathMajor
INLONG-218build failed: Too many files with unapproved licenseMajor
INLONG-230TubeMQ run mvn test failed with openjdk version 13.0.2Major
INLONG-236Can't get dependencies from the maven repositoryMajor
INLONG-253tube-consumer fetch-worker cpu used too highMajor
INLONG-254support using different mapping port for standalone modeMajor
INLONG-265Unexpected broker disappearance in broker list after updating default broker metadataMajor

TASK:

JIRASummaryPriority
INLONG-193Update project document contentMajor

SUB-TASK:

JIRASummaryPriority
INLONG-123Batch flush data to diskMajor
INLONG-126Increase the unflushed data bytes controlMajor
INLONG-140Remove the SSD auxiliary consumption functionMajor
INLONG-160Improve the protocol between Broker and MasterMajor
INLONG-169support build with docker imageMajor
INLONG-171master and broker support config hostname with “localhost” or “127.0.0.1” or dns addressMajor
INLONG-172simplify start/stop scriptMajor
INLONG-173change jvm memory parameters for default deploymentMajor
INLONG-174hange defaule accessing url of web gui to http://your-master-ip:8080Major
INLONG-178change default IPs configuration to localhostMajor
INLONG-188the example for demo topic catch exceptionMajor
INLONG-194[website]Remove SSD auxiliary storage introductionMajor
INLONG-195[website] Adjust the content of the Chinese part of the documentMajor
INLONG-198Support TubeMQ source for flinkMajor
INLONG-199Support TubeMQ sink for flinkMajor
INLONG-204Remove document address guidelineMajor
INLONG-221make quick start doc more easy for readingMajor
INLONG-240add status command for broker/master scriptMajor
INLONG-241add helm chart for tubemqMajor
INLONG-242Support Table interface for TubeMQ flink connectorMajor
INLONG-244tubemq web support access using proxy IPMajor
INLONG-246support register broker using hostnameMajor
INLONG-295Modify CHANGES.md to add 0.5.0 version release modificationMajor
INLONG-299Fix RAT check warnningMajor
INLONG-300Update LICENSEMajor

Release 0.3.0-incubating - Released (as of 2020-06-08)

NEW FEATURES:

JIRASummaryPriority
INLONG-42Add peer information about message received Major New FeatureMajor

IMPROVEMENTS:

JIRASummaryPriority
INLONG-16Correct BdbStoreService#isPrimaryNodeActived to BdbStoreService#isPrimaryNodeActiveLow
INLONG-18Correct TMaster#idGenerater to TMaster#idGeneratorLow
INLONG-19Correct parameter names to fit in camel caseLow
INLONG-20Correct DefaultLoadBalancer#balance parameterLow
INLONG-21Change version number from x.y-SNAPSHOT to x.y.z-incubating-SNAPSHOTNormal
INLONG-22Correct ClientSubInfo#getTopicProcesser -> ClientSubInfo#getTopicProcessorLow
INLONG-23Improve project README content introductionMajor
INLONG-24Add NOTICE and adjust LICENSEMajor
INLONG-26correct spelling (difftime-> diffTime)Low
INLONG-27replace StringBuffer with StringBuilderMajor
INLONG-28ignore path errorMajor
INLONG-29Change the package name to org.apache.tubemq.""Major
INLONG-33refactor enum implement from annoymouse inner classMajor
INLONG-38Add Broker's running status checkMajor
INLONG-39Optimize the loadMessageStores() logicNor
INLONG-40Optimize message disk store classes's logicMajor
INLONG-43Add DeletePolicy's value checkMajor
INLONG-44Remove unnecessary synchronized definition of shutdown () functionNormal
INLONG-49setTimeoutTime change to updTimeoutTimeMajor
INLONG-50Replace fastjson to gsonMajor
INLONG-7Using StringBuilder instead of StringBuffer in BaseResultLow
INLONG-9Remove some unnecessary codeMinor

BUG FIXES:

JIRASummaryPriority
INLONG-10Fix Javadoc errorLow
INLONG-14Some compilation errorsMajor
INLONG-15Correct typo in http_access_API_definition.mdLow
INLONG-32File path not match with package name in tubemq-client moduleMajor
INLONG-35check illegal package's field valueNormal
INLONG-36Remove unnecessary removefirst() function printingNormal
INLONG-37Offset is set to 0 when Broker goes offlineMajor
INLONG-45Check groupName with checkHostName functionMajor
INLONG-48No timeout when setting consumer timeoutMajor
INLONG-59Null pointer exception is thrown while constructing ConsumerConfig with MasterInfoNormal
INLONG-62consumed and set consumerConfig.setConsumeModel (0) for the first timeMajor
INLONG-66TubeSingleSessionFactory shutdown bugNormal
INLONG-85There is NPE when creating PullConsumer with TubeSingleSessionFactoryMajor
INLONG-88Broker does not take effect after the deletePolicy value is changedMajor
INLONG-149Some of the consumers stop consuming their corresponding partitions and never release the partition to othersMajor
INLONG-153update copyright notices year to 2020Major
INLONG-165Remove unnecessary fiilesMajor

TASK:

JIRASummaryPriority
INLONG-12Change to use Apache License V2Major

SUB-TASK:

JIRASummaryPriority
INLONG-130Generate CHANGES.md and DISCLAIMER-WIPMajor
INLONG-133Add Apache parent pomMajor
INLONG-134add maven-source-plugin for generate source jarMajor
INLONG-135Refactoring all pom.xmlMajor
INLONG-136Add LICENSE/NOTICE/DISCLAIMER-WIP to binary packageMajor