Pulsar-client-go Changelog
All notable changes to this project will be documented in this file.
[0.10.0] 2023-03-27
Feature
Improve
New Contributors
[0.9.0] 2022-07-07
Feature
- Add TableView support, see PR-743
- Support ack response for Go SDK, see PR-776
- Add basic authentication, see PR-778
- Support multiple schema version for producer and consumer, see PR-611
- Add schema support to Reader, see PR-741
Improve
- Add consumer seek by time on partitioned topic, see PR-782
- Fix using closed connection in consumer, see PR-785
- Add go 1.18 to the test matrix, see PR-790
- Schema creation and validation functions without panic, see PR-794
- Fix ack request not set requestId when enable AckWithResponse option, see PR-780
- Fix nil pointer dereference in TopicNameWithoutPartitionPart, see PR-734
- Add error response for Ack func, see PR-775
- Fix sequenceID is not equal to cause the connection to be closed incorrectly, see PR-774
- Add consumer state check when request commands, see PR-772
- Fix panic caused by flushing current batch with an incorrect internal function, see PR-750
- Fix deadlock in Producer Send when message fails to encode, see PR-762
- Add
-c/--max-connections
parameter to pulsar-perf-go and set it to 1 by default, see PR-765 - Fix producer unable register when cnx closed, see PR-761
- Fix annotation typo in
consumer.go
, see PR-758 - Dlq producer on topic with schema, see PR-723
- Add service not ready check, see PR-757
- Fix ack timeout cause reconnect, see PR-756
- Cleanup topics after unit tests, see PR-755
- Allow config reader subscription name, see PR-754
- Exposing broker metadata, see PR-745
- Make go version consistent, see PR-751
- Temporarily point ci to pulsar 2.8.2, see PR-747
- Upgrade klauspost/compress to v1.14.4, see PR-740
- Stop ticker when create producer failed, see PR-730
New Contributors
[0.8.1] 2022-03-08
What's Changed
New Contributors
@shubham1172 made their first contribution in https://github.com/apache/pulsar-client-go/pull/735 @nicoloboschi made their first contribution in https://github.com/apache/pulsar-client-go/pull/738
[0.8.0] 2022-02-16
What's Changed
New Contributors
[0.7.0] 2021-10-31
Feature
Improve
- Fix batch size limit validation, see PR-528
- Fix logic of command for sendError, see PR-622
- Drain connection requests channel without closing, see PR-645
- Fix ConsumersOpened counter not incremented when use multitopic or regexp consumer, see PR-619
- Fix reconnection logic when topic is deleted, see PR-627
- Fix panic when scale down partitions, see PR-601
- Fix missing metrics for topics by registration of existing collector, see PR-600
- Fix producer panic by oldProducers, see PR-598
- Fail pending messages when topic is terminated, see PR-588
- Fix handle send error panic, see PR-576
[0.6.0] 2021-07-21
Feature
- Make PartitionsAutoDiscoveryInterval configurable, see PR-514.
- Always check connection close channell, before attempting to put requests, see PR-521.
- Add
LedgerId,EntryId,BatchIdx,PartitionIdx
func for MessageId interface, see PR-529. - Add DisableReplication to Producer Message, see PR-543.
- Updating comments to conform to golang comment specification, see PR-532.
- Producer respects Context passed to Send() and SendAsync() when applying backpressure, see PR-534.
- Simplify connection close logic, see PR-559.
- Add open tracing to pulsar go client, see PR-518.
- Update proto file, see PR-562.
- Add send error logic for connection, see PR-566.
- Add license file for depend on libs, see PR-567.
Improve
- Update jwt-go dependency to resolve vulnerabilities, see PR-524.
- Fixed Athenz repository name, see PR-522.
- Fix reader latest position, see PR-525.
- Fix timeout guarantee for RequestOnCnx, see PR-492.
- Fix nil pointer error with GetPartitionedTopicMetadata, see PR-536.
- Release locks before calling producer consumer response callbacks, see PR-542.
- Fix lookup service not implemented GetTopicsOfNamespace, see PR-541.
- Regenerate the certs to work with Pulsar 2.8.0 and Java 11, see PR-548.
- Fix race condition when resend pendingItems, see PR-551.
- Fix data race while accessing connection in partitionConsumer, see PR-535.
- Fix channel data race, see PR-558.
- Fix write to closed channel panic() in internal/connection during connection close, see PR-539.
- Fix possible race condition in connection pool, see PR-561.
- Fix default connection timeout, see PR-563.
- Add lock for compressionProviders to fix data race problem, see PR-533.
- Fix send goroutine blocked, see PR-530.
[0.5.0] 2021-05-14
Feature
- Add http lookup service support, see PR-510.
- Support listener name for go the client, see PR-502.
- Add multiple hosts support, see PR-484.
- Improve error log for frame size too big and maxMessageSize, see PR-459.
- Update jwt-go version to v4, see PR-481.
Improve
- Fix range channel deadlock error, see PR-499.
- Add sentAt when put item into pendingQueue, see PR-509.
- Fix race condition/goroutine leak in partition discovery goroutine, see PR-474.
- Close cnxPool when closing a Client, see PR-494.
- Use newError to build return error, see PR-471.
- Move GetPartitionedTopicMetadata to lookup service, see PR-478.
- Fix wrong batch flush method bug, see PR-476.
- Fix reader with start latest message id inclusive, see PR-467.
- Fix unexpected nil pointer when reading item from keyring, see PR-470.
- Reverted datadog to DataDog, see PR-465.
[0.4.0] 2021-02-09
Feature
- Support send timeout in Producer side, see PR-394.
- Add metric for internal publish latency, see PR-397.
- Add key_based Batch logic, see PR-363.
- Add error label to publish errors metric, see PR-405.
- Add const client label to metrics, see PR-406.
- Attach topic and custom labels to Prometheus metrics, see PR-410.
- Add orderingKey apis, see PR-427.
- Support jwt and trusted cert for pulsar perf client, see PR-427.
Improve
- Fix bot action CI yaml file, see PR-395.
- Update go-keyring to v1.1.6 to remove warnings on MacOS Catalina+ , see PR-404.
- Read the clock fewer times during message routing, see PR-372.
- Close dangling autoDiscovery goroutine in consumer, see PR-411.
- Fix discard unacked messages, see PR-413.
- Fixed logic to attempt reconnections to same broker, see PR-414.
- Reduce the default TCP connection timeout from 30 to 5 seconds, see PR-415.
- Removed unused
import "C"
statement, see PR-416. - Renamed
Metrics.RpcRequestCount
to RPCRequestCount
to conform to style check, see PR-417. - Fix leaked nack tracker goroutine, see PR-418.
- Clearing message queues after seek requests, see PR-419.
- Fix retry policy not effective with partitioned topic, see PR-425.
- Deduplicate user provided topics before using them, see PR-426.
- The
reader.HasNext()
returns true on empty topic, see PR-441. - Upgrade
gogo/protobuf
to 1.3.2, see PR-446. - Fix
logrusWrapper
shrink interfaces slice into an interface, see PR-449. - Logging what really caused lookup failure, see PR-450.
- Make state thread safe in consumer_partition and connection, see PR-451.
- Fix
KeyFileTypeServiceAccount
not found compile error, see PR-455. - Fix unsubscribe blocked when consumer is closing or has closed, see PR-457.
- The asynchronized send timeout checking without pending queue lock, see PR-460.
[0.3.0] 2020-11-11
Feature
- Support retry letter topic in Go client, see PR-359.
- Support limit the retry number of reconnectToBroker, see PR-360.
- Support key shared policy in Go client, see PR-363.
- Add schema logic in producer and consumer, see PR-368.
Improve
- Fix panic on receiverQueueSize set to
-1
, see PR-361. - Fix may lead to panic test case, see PR-369.
- Send delay message individually even batching is enabled, see PR-372.
- Fixed buffer resize when writing request on connection, see PR-374.
- Fixed deadlock in DLQ ack processing, see PR-375.
- Fix deadlock when connection closed, see PR-376.
- Fix producer deadlock after write failure, see PR-378.
- Fix maxMessageSize not effective even if aligned with broker, see PR-381.
- Update default router to switch partition on all batching thresholds, see PR-383.
- Replaced
github.com/DataDog/zstd
with github.com/datadog/zstd
, see PR-385. - Fix retry policy not effective with non-FQDN topics, see PR-386.
[0.2.0] 2020-08-28
Feature
- Expose BatchingMaxSize from ProducerOptions, see PR-280.
- Allow applications to configure the compression level, see PR-290.
- Support producer name for Message, see PR-299.
- Support oauth2 authentication for pulsar-client-go, see PR-313.
- Add interceptor feature for Go client, see PR-314.
- Export client metrics to Prometheus, see PR-317.
- Add Name method to Consumer interface, see PR-321.
- Add oauth2 to the provider, see PR-338.
- Support specified the oauth2 private key with prefix
file://
and data://
, see PR-343. - Fix the keyfile unmarshal error, see PR-339.
- Add a new method to create auth provider from tls cert supplier, see PR-347.
- Add seek logic for reader, see PR-356.
Improve
- Use .asf.yaml to configure github repo, see PR-216.
- Auto update the client to handle changes in number of partitions, see PR-221.
- Clean callbacks of connection after run loop stopped, see PR-248.
- Fix unable to close consumer after unsubscribe in Shared Subscription, see PR-283.
- Introduced lifecycle for compression providers, see PR-284.
- Use maxPendingMessages for sizing producer eventsChan, see PR-285.
- Avoid contention on producer mutex on critical path, see PR-286.
- Switched to DataDog zstd wrapper, reusing the compression ctx, see PR-287.
- Fix panic when creating consumer with ReceiverQueueSize set to -1, see PR-289.
- Used pooled buffering for compression and batch serialization, see PR-292.
- Use gogofast to have in-place protobuf serialization, see PR-294.
- Added semaphore implementation with lower contention, see PR-298.
- Fixed pooled buffer lifecycle, see PR-300.
- Removed blocking queue iterator, see PR-301.
- Fix panic in CreateReader API using custom MessageID for ReaderOptions, see PR-305.
- Change connection failed warn log to error and print error message, see PR-309.
- Share buffer pool across all partitions, see PR-310.
- Add rerun feature test command to repo, see PR-311.
- Fix CompressMaxSize() for ZLib provider, see PR-312.
- Reduce the size of the MessageID structs by one word on 64-bit arch, see PR-316.
- Do not allocate MessageIDs on the heap, see PR-319.
- Different MessageID implementations for message Production and Consumption, see PR-324.
- Fix producer block when the producer with the same id, see PR-326.
- Get the last message when LatestMessageID and inclusive, see PR-329.
- Fix go.mod issue with invalid version, see PR-330.
- Fix producer goroutine leak, see PR-331.
- Fix producer state by reconnecting when receiving unexpected receipts, see PR-336.
- Avoid producer deadlock on connection closing, see PR-337.
Contributors
Our thanks go to the following contributors from the community for helping this release:
[0.1.1] 2020-06-19
Improve
Contributors
Our thanks go to the following contributors from the community for helping this release:
[0.1.0] 2020-03-24
New Feature
Client
- Support
TLS
logic - Support
Authentication
logic - Support
Proxy
logic - Support
Hostname verification
logic
Producer
- Add
Send()
method in Producer
interface - Add
SendAsync()
method in Producer
interface - Add
LastSequenceID()
method in Producer
interface - Add
Flush()
method in Producer
interface - Add
Close()
method in Producer
interface - Add
Topic()
method in Producer
interface - Add
Name()
method in Producer
interface - Support
MessageRouter
logic - Support
batch
logic - Support
compression message
logic - Support
HashingScheme
logic - Support
User defined properties producer
logic
Consumer
- Add
Subscription()
method in Consumer
interface - Add
Unsubscribe()
method in Consumer
interface - Add
Receive()
method in Consumer
interface - Add
Ack()
method in Consumer
interface - Add
AckID()
method in Consumer
interface - Add
Nack()
method in Consumer
interface - Add
NackID()
method in Consumer
interface - Add
Seek()
method in Consumer
interface - Add
SeekByTime()
method in Consumer
interface - Add
Close()
method in Consumer
interface - Support
Dead Letter Queue
consumer policy - Support
Topics Pattern
and Topics
logic - Support
topic consumer regx
logic - Support
multi topics consumer
logic - Support
Exclusive
, Failover
, Shared
and KeyShared
subscribe type logic - Support
Latest
and Earliest
logic - Support
ReadCompacted
logic - Support
ReplicateSubscriptionState
logic - Support
User defined properties consumer
logic - Support
Delayed Delivery Messages
logic
Reader
- Add
Topic()
method in Reader
interface - Add
Next()
method in Reader
interface - Add
HasNext()
method in Reader
interface - Add
Close()
method in Reader
interface - Support
read compacted
logic - Support
start messageID
logic - Support
User defined properties reader
logic
Contributors
Our thanks go to the following contributors from the community for helping this release: