What's New

Added support for Change Data Capture (CDC) based on MongoDB change stream events

Added the NamespaceMapper interface to allow for dynamic namespace mapping

Added the TopicMapper interface to allow topic mapping

Changed the top-level inferred schema to be mandatory

Fixed a validation issue and synthetic configuration property in the Sink Connector

Corrected general exception logging

Updated to clone the LazyBsonDocument instead of the unwrapped BsonDocument

Added support for records that contain Bson byte types

Added support for the errors.tolerance property

Changed max.num.retries default to 1

Improved the error messages for business key errors

Improved the error handling for List and JSON array configuration options

Updated to use the dot notation for filters in key update strategies

Added support to output a key or value as a Bson byte type

Added support for schema and custom Avro schema definitions

Added support for dead letter queue and the errors.tolerance property

Added configurations for the following formatters:

• DefaultJson

• ExtendedJson

• SimplifiedJson

Added configuration for copy.existing.pipeline to allow you to use indexes during the copying process

Added configuration for copy.existing.namespace.regex to allow you to copy the filtering of namespaces

Added configuration for offset.partition.name to allow for custom partitioning naming strategies

Updated to validate that the fullDocument field is a document

Updated to sanitize the connection string in the offset partition map to improve maintenance of the connection.uri, database, and collection parameters

Updated to disable publishing a source record without a topic name

Stopped MongoDB 3.6 from copying existing issues when the collection didn't exist in the Source Connector

Added configurations for the following properties:

• document.id.strategy.overwrite.existing

• UuidStrategy output types

• document.id.strategy.partial.value.projection.type

• document.id.strategy.partial.value.projection.list

• document.id.strategy.partial.key.projection.type

• document.id.strategy.partial.key.projection.list

• UuidProvidedInKeyStrategy

• UuidProvidedInValueStrategy

Added the UpdateOneBusinessKeyTimestampStrategy post processor

Added built-in support for parallelism and scalable data copying by assigning topic partitions to tasks

Improved the error messaging for missing resume tokens

Removed failures with the MongoCopyDataManager when the source database does not exist

Fixed the copying the existing resumability error in the Source Connector

Added support for the topics.regex property

Updated to ignore unused source record key or value fields

Added validation for the connection using MongoSinkConnector.validate

Added validation for the connection using MongoSourceConnector.validate

Removed the "Unrecognized field: startAfter" error for resuming a change stream in the Source Connector