Pulsar-client-go Changelog

All notable changes to this project will be documented in this file.

[0.5.0] 2021-05-14

Feature

• Add http lookup service support, see PR-510.
• Support listener name for go the client, see PR-502.
• Add multiple hosts support, see PR-484.
• Improve error log for frame size too big and maxMessageSize, see PR-459.
• Update jwt-go version to v4, see PR-481.

Improve

• Fix range channel deadlock error, see PR-499.
• Add sentAt when put item into pendingQueue, see PR-509.
• Fix race condition/goroutine leak in partition discovery goroutine, see PR-474.
• Close cnxPool when closing a Client, see PR-494.
• Use newError to build return error, see PR-471.
• Move GetPartitionedTopicMetadata to lookup service, see PR-478.
• Fix wrong batch flush method bug, see PR-476.
• Fix reader with start latest message id inclusive, see PR-467.
• Fix unexpected nil pointer when reading item from keyring, see PR-470.
• Reverted datadog to DataDog, see PR-465.

[0.4.0] 2021-02-09

Feature

• Support send timeout in Producer side, see PR-394.
• Add metric for internal publish latency, see PR-397.
• Add key_based Batch logic, see PR-363.
• Add error label to publish errors metric, see PR-405.
• Add const client label to metrics, see PR-406.
• Attach topic and custom labels to Prometheus metrics, see PR-410.
• Add orderingKey apis, see PR-427.
• Support jwt and trusted cert for pulsar perf client, see PR-427.

Improve

• Fix bot action CI yaml file, see PR-395.
• Update go-keyring to v1.1.6 to remove warnings on MacOS Catalina+ , see PR-404.
• Read the clock fewer times during message routing, see PR-372.
• Close dangling autoDiscovery goroutine in consumer, see PR-411.
• Fix discard unacked messages, see PR-413.
• Fixed logic to attempt reconnections to same broker, see PR-414.
• Reduce the default TCP connection timeout from 30 to 5 seconds, see PR-415.
• Removed unused import "C" statement, see PR-416.
• Renamed Metrics.RpcRequestCount to RPCRequestCount to conform to style check, see PR-417.
• Fix leaked nack tracker goroutine, see PR-418.
• Clearing message queues after seek requests, see PR-419.
• Fix retry policy not effective with partitioned topic, see PR-425.
• Deduplicate user provided topics before using them, see PR-426.
• The reader.HasNext() returns true on empty topic, see PR-441.
• Upgrade gogo/protobuf to 1.3.2, see PR-446.
• Fix logrusWrapper shrink interfaces slice into an interface, see PR-449.
• Logging what really caused lookup failure, see PR-450.
• Make state thread safe in consumer_partition and connection, see PR-451.
• Fix KeyFileTypeServiceAccount not found compile error, see PR-455.
• Fix unsubscribe blocked when consumer is closing or has closed, see PR-457.
• The asynchronized send timeout checking without pending queue lock, see PR-460.

[0.3.0] 2020-11-11

Feature

• Support retry letter topic in Go client, see PR-359.
• Support limit the retry number of reconnectToBroker, see PR-360.
• Support key shared policy in Go client, see PR-363.
• Add schema logic in producer and consumer, see PR-368.

Improve

• Fix panic on receiverQueueSize set to -1, see PR-361.
• Fix may lead to panic test case, see PR-369.
• Send delay message individually even batching is enabled, see PR-372.
• Fixed buffer resize when writing request on connection, see PR-374.
• Fixed deadlock in DLQ ack processing, see PR-375.
• Fix deadlock when connection closed, see PR-376.
• Fix producer deadlock after write failure, see PR-378.
• Fix maxMessageSize not effective even if aligned with broker, see PR-381.
• Update default router to switch partition on all batching thresholds, see PR-383.
• Replaced github.com/DataDog/zstd with github.com/datadog/zstd, see PR-385.
• Fix retry policy not effective with non-FQDN topics, see PR-386.

[0.2.0] 2020-08-28

Feature

• Expose BatchingMaxSize from ProducerOptions, see PR-280.
• Allow applications to configure the compression level, see PR-290.
• Support producer name for Message, see PR-299.
• Support oauth2 authentication for pulsar-client-go, see PR-313.
• Add interceptor feature for Go client, see PR-314.
• Export client metrics to Prometheus, see PR-317.
• Add Name method to Consumer interface, see PR-321.
• Add oauth2 to the provider, see PR-338.
• Support specified the oauth2 private key with prefix file:// and data://, see PR-343.
• Fix the keyfile unmarshal error, see PR-339.
• Add a new method to create auth provider from tls cert supplier, see PR-347.
• Add seek logic for reader, see PR-356.

Improve

• Use .asf.yaml to configure github repo, see PR-216.
• Auto update the client to handle changes in number of partitions, see PR-221.
• Clean callbacks of connection after run loop stopped, see PR-248.
• Fix unable to close consumer after unsubscribe in Shared Subscription, see PR-283.
• Introduced lifecycle for compression providers, see PR-284.
• Use maxPendingMessages for sizing producer eventsChan, see PR-285.
• Avoid contention on producer mutex on critical path, see PR-286.
• Switched to DataDog zstd wrapper, reusing the compression ctx, see PR-287.
• Fix panic when creating consumer with ReceiverQueueSize set to -1, see PR-289.
• Used pooled buffering for compression and batch serialization, see PR-292.
• Use gogofast to have in-place protobuf serialization, see PR-294.
• Added semaphore implementation with lower contention, see PR-298.
• Fixed pooled buffer lifecycle, see PR-300.
• Removed blocking queue iterator, see PR-301.
• Fix panic in CreateReader API using custom MessageID for ReaderOptions, see PR-305.
• Change connection failed warn log to error and print error message, see PR-309.
• Share buffer pool across all partitions, see PR-310.
• Add rerun feature test command to repo, see PR-311.
• Fix CompressMaxSize() for ZLib provider, see PR-312.
• Reduce the size of the MessageID structs by one word on 64-bit arch, see PR-316.
• Do not allocate MessageIDs on the heap, see PR-319.
• Different MessageID implementations for message Production and Consumption, see PR-324.
• Fix producer block when the producer with the same id, see PR-326.
• Get the last message when LatestMessageID and inclusive, see PR-329.
• Fix go.mod issue with invalid version, see PR-330.
• Fix producer goroutine leak, see PR-331.
• Fix producer state by reconnecting when receiving unexpected receipts, see PR-336.
• Avoid producer deadlock on connection closing, see PR-337.

Contributors

Our thanks go to the following contributors from the community for helping this release:

• LvBay
• cgfork
• jaysun91
• liangyuanpeng
• nitishv
• quintans
• snowcrumble
• shohi
• simonswine
• dferstay
• zymap

[0.1.1] 2020-06-19

Improve

• Fixed batching flag logic
• Fix data race when accessing partition producer state
• Fixed tls connection issue
• Add flag to disable forced topic creation
• Add Athenz authentication provider
• Fixed race condition in producer Flush() operation
• Removed unnecessary flush in sync Send() operation
• Allow empty payload for nonbatch message
• Add internal connectionReader readAtLeast error information
• Fix zstd memory leak of zstdProvider
• Expose replicated from filed on message struct
• Fix send async comments
• Fix perf-produce cannot be closed
• Fix perf-producer target
• Fix fail to add batchbuilder
• skip debug print out when batch disabled with no messages
• Add check for max message size
• Build and test with multiple versions of Go
• When CGO is enabled, use C version of ZStd
• Stop partition discovery on Close
• Microbenchmark for compression
• Allow to have multiple connections per broker
• Increase writeRequestsCh channel buffer size

Contributors

Our thanks go to the following contributors from the community for helping this release:

• yarthur1
• vergnes
• sijie
• shustsud
• rueian
• mileschao
• keithnull
• abatilo
• cornelk
• equanz
• jerrypeng
• jonyhy96

[0.1.0] 2020-03-24

New Feature

Client

• Support TLS logic
• Support Authentication logic
• Support Proxy logic
• Support Hostname verification logic

Producer

• Add Send() method in Producer interface
• Add SendAsync() method in Producer interface
• Add LastSequenceID() method in Producer interface
• Add Flush() method in Producer interface
• Add Close() method in Producer interface
• Add Topic() method in Producer interface
• Add Name() method in Producer interface
• Support MessageRouter logic
• Support batch logic
• Support compression message logic
• Support HashingScheme logic
• Support User defined properties producer logic

Consumer

• Add Subscription() method in Consumer interface
• Add Unsubscribe() method in Consumer interface
• Add Receive() method in Consumer interface
• Add Ack() method in Consumer interface
• Add AckID() method in Consumer interface
• Add Nack() method in Consumer interface
• Add NackID() method in Consumer interface
• Add Seek() method in Consumer interface
• Add SeekByTime() method in Consumer interface
• Add Close() method in Consumer interface
• Support Dead Letter Queue consumer policy
• Support Topics Pattern and Topics logic
• Support topic consumer regx logic
• Support multi topics consumer logic
• Support Exclusive, Failover, Shared and KeyShared subscribe type logic
• Support Latest and Earliest logic
• Support ReadCompacted logic
• Support ReplicateSubscriptionState logic
• Support User defined properties consumer logic
• Support Delayed Delivery Messages logic

Reader

• Add Topic() method in Reader interface
• Add Next() method in Reader interface
• Add HasNext() method in Reader interface
• Add Close() method in Reader interface
• Support read compacted logic
• Support start messageID logic
• Support User defined properties reader logic

Contributors

Our thanks go to the following contributors from the community for helping this release:

• merlimat
• wolfstudy
• cckellogg
• xujianhai666
• reugn
• freeznet
• zzzming
• wty4427300
• stevenwangnarvar
• dsmlily
• banishee
• archfish
• Morsicus