Data charts, images, and papers with a magnifying glass clustered around 3 green tiers to represent simplified data estates. 

Atlas Stream Processing simplifies integrating MongoDB and Kafka—it’s easy to use, cost-effective, and performant.

l3m29roh17ihdl5a0-Query_Insight.svg

An easier way to integrate MongoDB and Kafka

Promo banner kafka-connector

The official <a href="/docs/kafka-connector/current/" target="_self">MongoDB Connector for Apache® Kafka®</a> is developed and supported by MongoDB and verified by <a href="https://www.confluent.io/" target="_blank">Confluent</a>. The Connector enables MongoDB to be configured as both a sink and a source for <a href="http://kafka.apache.org/" target="_blank">Apache Kafka</a>. Easily build robust, reactive data pipelines that stream events between applications and services in near real time.

slalom1kafka.svg

Configure your connection

Slalom1 kafka-connector

Default

Why MongoDB and Apache Kafka?

MongoDB and Kafka are at the heart of modern data architectures. Kafka is designed for boundless streams of data that sequentially write events into commit logs, allowing low latency data movement between your services.

Section Overview1 kafka-connector

Configure as a Sink

connectors_kafka_sink.svg

Map and persist events from Kafka topics directly to MongoDB collections with ease. Ingest events from your Kafka topics directly into MongoDB collections, exposing the data to your services for efficient querying, enrichment, and analytics.

Card1 for Card Grid1 kafka-connector

Configure as a Source

connectors_kafka_source.svg

Publish data changes from MongoDB into Kafka topics for streaming to consuming apps. Data is captured via <a href="https://docs.mongodb.com/manual/changeStreams/?_ga=2.178169318.290014579.1649258771-1223676955.1643406626&_gac=1.187428698.1647454191.CjwKCAjwlcaRBhBYEiwAK341jSzBbJEryvLIhhyu9ZmZxujVI51zQ5uWrH38fVaOYXkW2Qnhf2zOaBoC9xIQAvD_BwE">Change Streams</a> within the MongoDB cluster and published into Kafka topics. This enables consuming apps to react to data changes in real time using an event-driven programming style.

Card2 for Card Grid1 kafka-connector

Card Grid1 kafka-connector

Why MongoDB?

MongoDB customers have experienced success with the Kafka Connector across a span of industries and companies for a variety of use cases.

Section Overview2 kafka-connector

BW1 kafka-connector

eCommerce and Customer Single View

industry_retail.svg

<a href="https://ao.com/" target="_blank">ao.com</a>, a leading online electrical retailer, uses Kafka to <a href="/blog/post/aocom-turns-to-mongodb-to-build-a-single-customer-view" target="_self">push all data changes</a> from its source databases to MongoDB Atlas. This creates a single source of truth for all customer data to drive new and enhanced applications and business processes including customer service, fraud detection, and GDPR compliance. Employees with appropriate permissions can access customer data from one easy-to-consume operational data layer.

Card1 for CG2 kafka-connector

industry_enterprise.svg

Josh Software, part of a project in India to house more than 100,000 people in affordable smart homes, pushes data from millions of sensors to Kafka, processes it in Apache Spark, and writes the results to MongoDB, which connects the operational and analytical data sets. By streaming data from millions of sensors in near real-time, the project is creating truly smart homes, and citizens can access data via a mobile app to better manage their homes.

Card2 for CG2 kafka-connector

Financial Services

industry_finance.svg

AHL, a subsidiary of The Man Group, which is one of the world’s largest hedge fund investment firms, used MongoDB to <a href="/replacing-traditional-technologies-mongodb-single-platform-all-financial-data-ahl-transcript" target="_self">create a single platform</a> for all of its financial data. The system receives data for up to 150,000 ticks per second from multiple financial sources and writes it to Kafka. Kafka provides both consolidation and buffering of events before they are stored in MongoDB, where the data can be analyzed.

Card3 for CG2 kafka-connector

Opinion and Polling

general_events_breakout.svg

State, an intelligent opinion network connecting people with similar beliefs, writes survey data to MongoDB and leverages MongoDB Change Streams to push database changes into Kafka topics where they are consumed by its user recommendation engine. This engine suggests potentially interesting users and updates instantly as soon as a user contributes a new opinion.

Card5 for CG2 kafka-connector

Card Grid2 for BW2 kafka-connector

Featured Resources

Link Header kafka-connector