We have a requiremnt to merge two collections and write it to a new collection in real time.
Mostly we are looking for any kind of Kafka Connectors through which it can take change streams from both the collections and merge it to new collection in the same database.
Ideally the collection we dump data should be updated on the fly as on when any changes made to first two collections.
Would appreciate if you could share me other approaches.
Note: Our use case is the merge should consistent and resilient. Means at any point of time data available in both the collections should be same as merged collection.