ATLAS
Data Federation. Transform and enrich your data.
Seamlessly query, transform, and aggregate data from one or more MongoDB Atlas databases and cloud object storage offerings.
Easily aggregate, transform, and persist data
Reduce the time and effort you spend building aggregations that transform and enrich your data. Data Federation reduces the effort, time-sink, and complexity of pipelines and ETL tools when working with data in different formats. Use it to generate insights to power real-time applications or downstream analytics.
Enable downstream analytics
Convert Atlas data from one or more clusters to a columnar file format and output that data to cloud object storage to be consumed by downstream teams, enabling faster insights and simpler data movement on data when used with analytics tools.
Power real-time applications
Preserving the rich structure of your data is invaluable. Now you can directly query Atlas databases and cloud object storage together using a single API. Run powerful but easy-to-understand aggregations to create a refined data set, then persist that data into your preferred location to power real-time applications.
Feature overview
Multiple formats
Analyze data stored in JSON, BSON, CSV, TSV, Avro, ORC and Parquet in place without the complexity, cost, and time-sink of data ingestion and transformation.
Powerful aggregations
Run powerful, modular aggregations on data in-place and persist the results to your preferred storage tier for more control over your dataflows.
Federated query
Run a single query to analyze data across multiple MongoDB databases and cloud object storage together and in-place for faster insights.
Serverless
No infrastructure to set up and manage - create your cloud federated database with a few clicks and start running queries immediately.
On demand
You only pay for the queries you run and only when actively working with your data. With an on-demand service, you can eliminate the need to predict demand or capacity.
Fully integrated with MongoDB Atlas
Get access to our other product offerings such as Charts for advanced data visualization and Compass for a visual exploration of your data.
Use Data Federation on MongoDB
Configure a Federated Database Instance
xxxxxxxxxx
// ... Database in Federated Database Instance defined above
"collections" : [
{
"name" : "atlasCollection", // Virtual collection in your Federated Database Instance
"dataSources" : [{
"storeName" : "atlasClusterStore", // Store name defined in "stores" document
"database" : "metrics", // Database name in the Atlas Cluster
"collection" : "hardware" // Collection name in the Atlas Cluster
}]
},
Combine, transform and enrich data
xxxxxxxxxx
db.virtualCollection.aggregate(
[
{
"$match": {
"serverType": "M60",
"storageUtilization": {"$gt": 90.0}
}
},
{
"$addFields" : {
"OnlineArchiveCandidate": true
}
}
]
)
Persist query results
xxxxxxxxxx
db.virtualCollection.aggregate([
{ "$out": {
"s3": {
"bucket": "my-s3-bucket",
"region": "us-east-1",
"filename": {
"$concat": [
"archive/", "$age" // Data Lake will auto partition on age
]},
"format" : {
"name" : "parquet", // Write directly to parquet
"maxFileSize" : "10GB",
"maxRowGroupSize" : "100MB"
}
}
}
}
])
Get started with Data Federation today
- A unified data platform
- Powerful aggregations
- Sample datasets
- Native tools and drivers
- Multiple data formats
- Pay-as-you-go model