Introducing: Multi-Kubernetes Cluster Deployment Support

Rutuja Rajwade and Dan Mckean
October 10, 2024 | Updated: December 4, 2024
#Kubernetes

Resilience and scalability are critical for today's production applications. MongoDB and Kubernetes are both well known for their ability to support those needs to the highest level. TA single Kubernetes cluster is typically limited to a single region, so to better enable developers using MongoDB and Kubernetes, we’ve introduced a series of updates and capabilities that makes it possible to manage MongoDB across multiple Kubernetes clusters. Since those Kubernetes clusters can be located in different regions, this offers new levels of resilience and control over where your data lives. In addition to the previously released support for running MongoDB replica sets and Ops Manager across multiple Kubernetes clusters, we're excited to announce the public preview release of support for Sharded Clusters spanning multiple Kubernetes clusters (GA to follow in November 2024).

Support for deployment across multiple Kubernetes clusters is facilitated through the Enterprise Kubernetes Operator. As a recap for anyone unaware, the Enterprise Operator automates the deployment, scaling, and management of MongoDB clusters in Kubernetes. It simplifies database operations by handling tasks such as configuration, resizing, upgrades, and failover, whilst ensuring consistent performance and reliability in the Kubernetes environment.

Multi-Kubernetes cluster deployment support enhances availability, resilience, and scalability for critical MongoDB workloads, empowering developers to efficiently manage these workloads within Kubernetes. This approach unlocks the highest level of availability and resilience by allowing shards to be located closer to users and applications, increasing geographical flexibility and reducing latency for globally distributed applications.

Deploying replica sets across multiple Kubernetes clusters

MongoDB replica sets are engineered to ensure high availability, data redundancy, and automated failover in database deployments. A replica set consists of multiple MongoDB instances—one primary and several secondary nodes—all maintaining the same dataset. The primary node handles all write operations, while the secondary nodes replicate the data and are available to take over as primary if the original primary node fails. This architecture is critical for maintaining continuous data availability, especially in production environments where downtime can be costly.

Support for deploying MongoDB replica sets across multiple Kubernetes clusters helps remove the Kubernetes cluster itself as a single point of failure. Deploying MongoDB replica sets across multiple Kubernetes clusters enables you to distribute your data, not only across nodes in the Kubernetes cluster, but across different clusters and geographic locations, ensuring your deployments operational (even if one or more Kubernetes clusters or locations fail) and facilitating faster disaster recovery.

To learn more about how to deploy replica sets across multiple Kubernetes clusters using the Enterprise Kubernetes Operator, visit our documentation.

Sharding MongoDB across multiple Kubernetes clusters

While replica sets duplicate data for resilience (and higher read rates), MongoDB sharded clusters divide the data up between shards, each of which is effectively a replica set, providing resilience for each portion of the data. Crucially, this also helps your database handle large datasets and higher-throughput operations since each shard has a primary member handling write operations to that portion of the data; this allows MongoDB to scale up the write throughput horizontally, rather than requiring vertical scaling of every member of a replica set. In a Kubernetes environment, each shard can now be deployed across multiple Kubernetes clusters, giving every shard higher resilience in the event of a loss of a Kubernetes cluster or an entire geographic location. This also offers the ability to locate shards or their primaries in the same region as the applications or users accessing that portion of the data, reducing latency and improving user experience. Sharding is particularly useful for applications with large datasets and those requiring high availability and resilience as they grow.

Support for sharding MongoDB across multiple Kubernetes clusters is currently in public preview and will be generally available in November.

Deploying Ops Manager across multiple Kubernetes clusters

Ops Manager is the self-hosted management erver that supports automation, monitoring, and backup of MongoDB on your own infrastructure.

Ops Manager's most critical function is backup of MongoDB deployments, and deploying it across multiple Kubernetes clusters greatly improves resilience and disaster recovery for your MongoDB deployments in Kubernetes. With Ops Manager distributed across several Kubernetes clusters, you can ensure that backups of deployments remain robust and available, even if one Kubernetes cluster or site fails. Furthermore, it allows Ops Manager to efficiently manage and monitor MongoDB deployments that are themselves distributed across multiple clusters, improving central oversight of your deployments.

To learn more about how to deploy Ops Manager across multiple Kubernetes clusters using the Enterprise Kubernetes Operator, visit our documentation.

To leverage multi-Kubernetes-cluster support, you can get started with the Enterprise Kubernetes Operator.

← Previous

Building Gen AI with MongoDB & AI Partners | September 2024

Last week I was in London for MongoDB.local London —the 19th stop of the 2024 MongoDB.local tour—where MongoDB, our customers, and our AI partners came together to share solutions we’ve been building that enable companies to accelerate their AI journey. I love attending these events because they offer an opportunity to celebrate our collective achievements, and because it’s great to meet so many (mainly Zoom) friends in person! One of the highlights of MongoDB.local London 2024 was the release of our reference architecture with our MAAP partners AWS and Anthropic , which supports memory-enhanced AI agents. This architecture is already helping businesses streamline complex processes and develop smarter, more responsive applications. We also announced a robust set of vector quantization capabilities in MongoDB Atlas Vector Search that will help developers build powerful semantic search and generative AI applications with more scale—and at a lower cost. Now, with support for the ingestion of scalar quantized vectors, you can import and work with quantized vectors from your embedding model providers of choice, including MAAP partners Cohere, Nomic, and others. A big thank you to all of MongoDB’s AI partners, who continually amaze me with their innovation. MongoDB.local London was another great reminder of the power of collaboration, and I’m excited for what lies ahead as we continue to shape the future of AI together. As the Brits say: Cheers! Welcoming new AI and tech partners In September we also welcomed seven new AI and tech partners that offer product integrations with MongoDB. Read on to learn more about each great new partner! Arize Arize AI is a platform that helps organizations visualize and debug the flow of data through AI applications by quickly identifying bottlenecks in LLM calls and understanding agentic paths. "At Arize AI, we are committed to helping AI teams build, evaluate, and troubleshoot cutting-edge agentic systems. Partnering with MongoDB allows us to provide a comprehensive solution for managing the memory and retrieval that these systems rely on”, said Jason Lopatecki, co-founder and CEO of Arize AI. “With MongoDB’s robust vector search and flexible document storage, combined with Arize’s advanced observability and evaluation tools, we’re empowering developers to confidently build and deploy AI applications." Baseten Baseten provides the applied AI research and infrastructure needed to serve custom and open-source machine learning models performantly, scalably, and cost-efficiently. " We're excited to partner with MongoDB to combine their scalable vector database with Baseten's high-performance inference infrastructure and high-performance models. Together, we're enabling companies to build and deploy generative AI applications, such as RAG apps, that not only scale infinitely but also deliver optimal performance per dollar,” said Tuhin Srivastava, CEO of Baseten. “This partnership empowers developers to bring mission-critical AI solutions to market faster, while maintaining cost-effectiveness at every stage of growth." Doppler Doppler is a cloud-based platform that helps teams manage, organize, and secure secrets across environments and applications that can be used throughout the entire development lifecycle. “Doppler rigorously focuses on making the easy path, the most secure path for developers. This is only possible with deep product partnerships with all the tooling developers have come to love. We are excited to join forces with MongoDB to make zero-downtime secrets rotation for non-relational databases effortlessly simple to set up and maintenance-free,” said Brian Vallelunga, founder and CEO of Doppler. “This will immediately bolster the security posture of a company’s most sensitive data without any additional overhead or distractions." Haize Labs Haize Labs automates language model stress testing at massive scales to discover and eliminate failure modes. This, alongside their inference-time mitigations and observability tools, enables the risk-free adoption of AI. " We're thrilled to partner with MongoDB in empowering companies to build RAG applications that are both powerful yet secure, safe, and reliable,” said Leonard Tang, co-founder and CEO of Haize Labs. “MongoDB Atlas has streamlined the process of developing production-ready GenAI systems, and we're excited to work together to accelerate customers' journey to trust and confidence in their GenAI initiatives." Modal Modal is a serverless platform for data and AI/ML engineers to run and deploy code in the cloud without having to think about infrastructure. Run generative AI models, large-scale batch jobs, job queues, and more, all faster than ever before. “The coming wave of intelligent applications will be built on the potent combination of foundation models, large-scale data, and fast search,” explained Charles Frye, AI Engineer at Modal. “MongoDB Atlas provides an excellent platform for storing, querying, and searching data, from hot new techniques like vector indices to old standbys like lexical search. It's the perfect counterpart to Modal's flexible compute, like serverless GPUs. Together, MongoDB and Modal make it easy to get started with this new paradigm, and then they make it easy to scale it out to millions of users querying billions of records & maxing out thousands of GPUs.” Portkey AI Portkey AI is an AI gateway and observability suite that helps companies develop, deploy, and manage LLM-based applications. " Our partnership with MongoDB is a game-changer for organizations looking to operationalize AI at scale. By combining Portkey's LLMOps expertise with MongoDB's comprehensive data solution, we're enabling businesses to deploy, manage, and scale AI applications with unprecedented efficiency and control,” said Ayush Garg, Chief Technology Officer of Portkey AI. “Together, we're not just streamlining the path from POC to production; we're setting a new standard for how businesses can leverage AI to drive innovation and deliver tangible value." Reka Reka offers fully multimodal models including images, videos with audio, text, and documents to empower AI agents that can see, hear, and speak. "At Reka, we know how challenging it can be to retrieve information buried in unstructured multimodal data. We are excited to join forces with MongoDB to help companies test and optimize multimodal RAG features for faster production deployment,” said Dani Yogatama, CEO of Reka. “Our models understand and reason over multimodal data including text, tables, and images in PDF documents or conversations in videos. Our joint solution streamlines the whole RAG development lifecycle, speeding up time to market and helping companies deliver real values to their customers faster." But wait, there's more! To learn more about building AI-powered apps with MongoDB, check out our AI Resources Hub , and stop by our Partner Ecosystem Catalog to read about our integrations with MongoDB’s ever-evolving AI partner ecosystem.

October 9, 2024
Next →

MongoDB Named a Leader in the 2024 Gartner® Magic Quadrant™ for Cloud Database Management Systems

I’m pleased to announce that MongoDB has been named a Leader in the 2024 Gartner® Magic Quadrant™ for Cloud Database Management Systems (DBMSs) for the third consecutive year. In our view, this recognition cements MongoDB’s status as the only pure-play database provider in the cloud database management system category, underscoring MongoDB’s innovation, execution, and customer-centric approach. According to Gartner, “The cloud DBMS market remains as vibrant as ever and is transforming in important ways, especially in the use of gen AI and how DBMSs interact with other data management components. This Magic Quadrant will help data and analytics leaders make the right cloud DBMS choices in this essential market.” We believe this continued recognition by Gartner is a testament to MongoDB’s commitment to serving developers, as well as the investments we’ve made in our unified platform and integrated services. Driving innovation for enterprises MongoDB's mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. 2024 was a year of innovation and accolades at MongoDB, and I’m proud to share some of its highlights: In October, we released MongoDB 8.0 , the best performing version of MongoDB yet. MongoDB 8.0 is over 30% faster than the previous version of the database, it’s more secure than ever, horizontal scaling is faster and easier (at a lower cost), and MongoDB 8.0 gives teams greater control for optimizing database performance. We also launched—and grew—the MongoDB AI Applications Program (MAAP) . With MAAP, MongoDB offers customers a full AI stack and an integrated set of professional services to help them keep pace with innovation, identify the best AI use cases, and to help them future-proof AI investments. MongoDB became a founding member of the U.S. Artificial Intelligence Safety Institute Consortium . Established by the U.S. Department of Commerce’s National Institute of Standards and Technology, the Consortium supports the development and deployment of safe and trustworthy AI. MongoDB released hundreds of features and enhancements to accelerate innovation, manage costs, and simplify building applications at scale. MongoDB was recognized as the most loved vector database in Retool’s State of AI report —for the second consecutive year. The Gartner Magic Quadrant for cloud database management systems “Gartner defines the cloud database management systems (DBMSs) market as solutions designed to store, manipulate, and persist data, primarily delivered as Software-as-a-Service (SaaS). These systems must support transactional, analytical, and hybrid workloads while enabling enterprises to innovate across multi-cloud, hybrid, and intercloud ecosystems.” 1 It’s our opinion that this recognition by Gartner is a testament to MongoDB’s strong ability to execute and support customers today, as well as MongoDB’s comprehensive product vision that positions our platform to support tomorrow's operational workloads. What is the Magic Quadrant, and what is a Leader? “A Gartner Magic Quadrant is a culmination of research in a specific market, giving you a wide-angle view of the relative positions of the market’s competitors.  By applying a graphical treatment and a uniform set of evaluation criteria, a Magic Quadrant helps you quickly ascertain how well technology providers are executing their stated visions and how well they are performing against Gartner’s market view.” 2 According to Gartner, “Leaders execute well against their current vision and are well positioned for tomorrow.” Overall, Magic Quadrants can help you “get quickly educated about a market’s competing technology providers and their ability to deliver on what end-users require now and in the future.” Powering innovation at scale with MongoDB Atlas Enterprises choose MongoDB Atlas because it gives them the freedom and agility they need to succeed in a rapidly evolving digital landscape. MongoDB Atlas’s multi-cloud architecture—including availability across Amazon Web Services, Google Cloud, and Microsoft Azure—ensures customers can design for unmatched scale and resilience. By automating functions like scaling and performance optimization , and giving them the ability to leverage industry-first capabilities like MongoDB Queryable Encryption (which allows customers to encrypt, store, and perform queries directly on data), with MongoDB Atlas customers can spend less time managing infrastructure and more time delivering experiences. MongoDB Atlas’s integrated capabilities to support multi-modal data types and use cases—like full-text and vector search , stream processing , and data federation —accelerate innovation, helping enterprises quickly respond to market changes, power AI-driven insights, and deliver meaningful digital experiences to their end users—all without the burden of operational complexity. Modernizing and building for the future In our opinion, the Gartner Magic Quadrant provides organizations with a clear and accessible evaluation framework to identify solutions that fit their needs, today and tomorrow. The placement of MongoDB in the Leader quadrant for Cloud Database Management Systems—for the third year in a row!—validates the efforts MongoDB has made to help developers and organizations take advantage of their most valuable resource, their data. I talk to MongoDB customers frequently, and many say the same thing: in today’s digital-first economy, AI-powered applications and scalable data infrastructure aren’t just advantages, they’re absolute necessities. They say that the time to act is now, and they’re looking for solutions that will help them innovate, streamline, and seize the AI-driven future. And when it comes to modernizing their operations, they consistently point to MongoDB as their go-to partner. Begin your cloud journey with MongoDB Atlas today. Contact our sales team or register for a free account to begin building! And to learn how MongoDB can help accelerate your AI journey, visit the MongoDB AI Applications Program page. Footnotes Gartner, Magic Quadrant for Cloud Database Management Systems,  Henry Cook, Ramke Ramakrishnan, et al., 18 December 2024 GARTNER is a registered trademark and service mark of Gartner, Inc. and/or its affiliates in the U.S. and internationally, and MAGIC QUADRANT is a registered trademark of Gartner, Inc. and/or its affiliates and are used herein with permission. All rights reserved. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. 1 Gartner Peer Insights, Cloud Database Management Systems, December 2024 https://www.gartner.com/reviews/market/cloud-database-management-systems 2 Gartner Research Methodologies, Gartner Magic Quadrant, 20 December 2024 https://www.gartner.com/en/research/methodologies/magic-quadrants-research

December 23, 2024