Convert a Self-Managed Replica Set to a Sharded Cluster

Get the Existing Users and Roles from the Replica Set

To get existing users and roles, run mongodump:

mongodump -d=admin --out=adminDump -u <adminUser> -p <password> --host <replicaSetURI> --dumpDbUsersAndRoles

Deploy the Config Server Replica Set

Deploy a three-member replica set for the config servers. In this example, the config servers use the following hosts:

• mongodb7.example.net

• mongodb8.example.net

• mongodb9.example.net

1. Configure the Config Servers

   Configure a mongod instance on each config server host. Specify these options in the configuration file for each mongod instance:

   Option	Value
   replication.replSetName	configReplSet
   sharding.clusterRole	configsvr
   net.bindIp	localhost, followed by any other hostnames on which the mongod should listen for client connections.

   replication:
     replSetName: configReplSet
   sharding:
     clusterRole: configsvr
   net:
     bindIp: localhost,<hostname(s)>

   Include additional options as appropriate for your deployment.

2. Start the Config Servers

   Deploy the mongod with your specified configuration:

   mongod --config <PATH_TO_CONFIG_FILE>

   The config servers use the default data directory /data/configdb and the default port 27019.

3. Connect to one of the config servers.

   Use mongosh to connect to one of the config servers. For example:

   mongosh "mongodb://mongodb7.example.net:27019"

4. Initiate the config server replica set.

   To initiate the replica set, run rs.initiate():

   rs.initiate( {
      _id: "configReplSet",
      configsvr: true,
      members: [
         { _id: 0, host: "mongodb7.example.net:27019" },
         { _id: 1, host: "mongodb8.example.net:27019" },
         { _id: 2, host: "mongodb9.example.net:27019" }
      ]
   } )

   The preceding command uses the localhost exception to perform administrative actions without authentication.

   Important

   Run rs.initiate() on just one and only one mongod instance for the replica set.

Restore Existing Users and Roles to the New Config

Restore the existing users and roles you got when you ran mongodump.

mongorestore ./adminDump --nsInclude "admin.*" --host <configPrimaryURI>

The preceding command uses the localhost exception to perform administrative actions without authentication.

The output from running this command may be similar to:

0 document(s) restored successfully

This message does not indicate a problem. This output means that 0 documents other than the users and roles were restored.

Secure Config Server Replica Set

Reconfigure and restart the config server replica set.

1. Reconfigure the Config Servers

   Select the tab for your authentication mechanism:

   Keyfile Authentication

   x.509 Authentication

   Restart a mongod instance on each of these hosts:

   • mongodb7.example.net

   • mongodb8.example.net

   • mongodb9.example.net

   Specify these options in the configuration file for each mongod instance:

   Option	Value
   security.keyFile	The path to the key file used for your initial replica set.

   security:
      keyFile: <PATH_TO_KEYFILE>
   replication:
      replSetName: configReplSet
   sharding:
      clusterRole: configsvr
   net:
      bindIp: localhost,<hostname(s)>

   Include additional options as appropriate for your deployment.

   Restart a mongod instance on each of these hosts:

   • mongodb7.example.net

   • mongodb8.example.net

   • mongodb9.example.net

   Specify these options in the configuration file for each mongod instance in addition to the options you already configured:

   Option	Value
   security.clusterAuthMode	x509
   net.tls.mode	requireTLS
   net.tls.certificateKeyFile	The absolute path to the .pem file that contains both the TLS certificate and key.
   net.tls.CAFile	The absolute path to the .pem file that contains the root certificate chain from the Certificate Authority.
   net.bindIp	localhost, followed by any other hostnames on which the mongod should listen for client connections. WARNING: Before you bind your instance to a publicly-accessible IP address, you must secure your cluster from unauthorized access. For a complete list of security recommendations, see Security Checklist for Self-Managed Deployments. At minimum, consider enabling authentication and hardening network infrastructure.

   sharding:
      clusterRole: configsvr
   replication:
      replSetName: configReplSet
   security:
      clusterAuthMode: x509
   net:
      tls:
         mode: requireTLS
         certificateKeyFile: <FILE_WITH_COMBINED_CERT_AND_KEY>
         CAFile: <CA_FILE>
      bindIp: localhost,<hostname(s)>

   Include additional options as appropriate for your deployment, such as net.tls.certificateKeyFilePassword if your TLS certificate-key file is encrypted with a password.

2. Restart MongoDB

   Restart the mongod with your specified configuration:

   mongod --config <PATH_TO_CONFIG_FILE> --shutdown
   mongod --config <PATH_TO_CONFIG_FILE>

Deploy the mongos

The mongos provides the interface between the client applications and the sharded cluster.

1. Create a configuration file for the mongos.

   Keyfile Authentication

   x.509 Authentication

   Specify these options in your mongos configuration file:

   Option	Value
   sharding.configDB	configReplSet, followed by a slash / and at least one of the config server hostnames and ports.
   security.keyFile	The path to the key file used for your initial replica set.
   net.bindIp	localhost, followed by any other hostnames on which the mongos should listen for client connections.

   sharding:
      configDB: configReplSet/mongodb7.example.net:27019,mongodb8.example.net:27019,mongodb9.example.net:27019
   security:
      keyFile: <PATH_TO_KEYFILE>
   net:
      bindIp: localhost,<hostname(s)>

   Include additional options as appropriate for your deployment.

   Specify these options in your mongos configuration file:

   Option	Value
   sharding.configDB	configReplSet, followed by a slash / and at least one of the config server hostnames and ports.
   security.clusterAuthMode	x509
   net.tls.mode	requireTLS
   net.tls.certificateKeyFile	The absolute path to the .pem file that contains both the TLS certificate and key.
   net.tls.CAFile	The absolute path to the .pem file that contains the root certificate chain from the Certificate Authority.
   net.bindIp	localhost, followed by any other hostnames on which the mongos should listen for client connections.

   sharding:
      configDB: configReplSet/mongodb7.example.net:27019,mongodb8.example.net:27019,mongodb9.example.net:27019
   security:
      clusterAuthMode: x509
   net:
      tls:
         mode: requireTLS
         certificateKeyFile: <FILE_WITH_COMBINED_CERT_AND_KEY>
         CAFile: <CA_FILE>
      bindIp: localhost,<hostname(s)>

   Include any additional options appropriate for your deployment.

2. Deploy the mongos.

   Deploy the mongos with your specified configuration:

   mongos --config <PATH_TO_CONFIG_FILE>

Restart the Initial Replica Set as a Shard

In this example, your initial replica set is a three-member replica set. This step updates the initial replica set so that it can be added as a shard to your sharded cluster.

The replica set runs on these hosts:

• mongodb0.example.net:27017

• mongodb1.example.net:27017

• mongodb2.example.net:27017

For sharded clusters, you must set the role for each mongod instance in the shard to shardsvr. To specify the server role, set the sharding.clusterRole setting in the mongod configuration file.

1. Connect to a member of your initial replica set.

   Use mongosh to connect to one of the members of your initial replica set.

   Keyfile Authentication

   x.509 Authentication

   mongosh "mongodb://<username>@mongodb0.example.net:27017"

   If your deployment uses x.509 authentication, specify these mongosh options:

   • --tls

   • --tlsCAFile

   • --tlsCertificateKeyFile

   For example:

   mongosh "mongodb://<username>@mongodb0.example.net:27017" --tls --tlsCAFile <CA_FILE> --tlsCertificateKeyFile <filename>

2. Determine the replica set's primary and secondaries.

   Run rs.status() to determine the primary and secondaries:

   rs.status()

   In the command output, the replSetGetStatus.members[n].stateStr field indicates which member is the primary and which members are secondaries.

3. Restart the secondaries with the --shardsvr option.

   Warning

   This step requires some downtime for applications connected to the replica set secondaries.

   After you restart a secondary, any applications that are connected to that secondary return a CannotVerifyAndSignLogicalTime error until you perform the steps in Add the Initial Replica Set as a Shard.

   You can also restart your application to stop it from receiving CannotVerifyAndSignLogicalTime errors.

   Keyfile Authentication

   x.509 Authentication

   1. Connect to a secondary.

      Use mongosh to connect to one of the secondaries.

      mongosh "mongodb://<username>@<host>:<port>"

   2. Shut down the secondary.

      Run the following commands:

      use admin
      db.shutdownServer()

   3. Edit the secondary's configuration file.

      In the secondary's configuration file, set sharding.clusterRole to shardsvr:

      security:
         keyFile: <PATH_TO_KEYFILE>
      replication:
        replSetName: rs0
      sharding:
         clusterRole: shardsvr
      net:
         port: 27017
         bindIp: localhost,<hostname(s)>

      Include additional options as appropriate for your deployment.

   4. Restart the secondary as a shard server.

      Run the following command on the host containing the secondary:

      mongod --config <PATH_TO_CONFIG_FILE>

   5. Repeat the shut down and restart steps for the other secondary.

   1. Connect to a secondary.

      Use mongosh to connect to one of the secondaries.

      If your deployment uses x.509 authentication, specify these mongosh options:

      • --tls

      • --tlsCAFile

      • --tlsCertificateKeyFile

      mongosh "mongodb://<username>@<host>:<port>" --tls --tlsCAFile <CA_FILE> --tlsCertificateKeyFile <filename>

   2. Shut down the secondary.

      Run the following commands:

      use admin
      db.shutdownServer()

   3. Edit the secondary's configuration file.

      In the secondary's configuration file, set sharding.clusterRole to shardsvr:

      replication:
         replSetName: rs0
      sharding:
         clusterRole: shardsvr
      security:
         clusterAuthMode: x509
      net:
         port: 27017
         tls:
            mode: requireTLS
            certificateKeyFile: <FILE_WITH_COMBINED_CERT_AND_KEY>
            CAFile: <CA_FILE>
         bindIp: localhost,<hostname(s)>

      Include additional options as appropriate for your deployment, such as net.tls.certificateKeyFilePassword if your TLS certificate-key file is encrypted with a password.

   4. Restart the secondary as a shard server.

      Run the following command on the host containing the secondary:

      mongod --config <PATH_TO_CONFIG_FILE>

   5. Repeat the shut down and restart steps for the other secondary.

Restart the primary with the --shardsvr option.

Add the Initial Replica Set as a Shard

After you convert the initial replica set (rs0) to a shard, add it to the sharded cluster.

1. Connect to the mongos as your cluster's administrative user.

   The mongos instance is running on host mongodb6.example.net.

   Keyfile Authentication

   x.509 Authentication

   To connect mongosh to the mongos, run the following command:

   mongosh "mongodb://admin01@mongodb6.example.net:27017"

   If your deployment uses x.509 authentication, specify these mongosh options:

   If your deployment uses x.509 authentication, specify these mongosh options:

   • --tls

   • --tlsCAFile

   • --tlsCertificateKeyFile

   mongosh "mongodb://admin01@mongodb6.example.net:27017" --tls --tlsCAFile <CA_FILE> --tlsCertificateKeyFile <filename>

   This command authenticates you as the admin01 user you created on the sharded cluster. After you enter the command, enter your user's password.

2. Add the shard.

   To add a shard to the cluster, run the sh.addShard() method:

   sh.addShard( "rs0/mongodb0.example.net:27017,mongodb1.example.net:27017,mongodb2.example.net:27017" )

   Warning

   Once the new shard is active, mongosh and other clients must always connect to the mongos instance. Do not connect directly to the mongod instances. If your clients connect to shards directly, you may create data or metadata inconsistencies.

Update Your Application Connection String

After you add the first shard to your cluster, update the connection string used by your applications to the connection string for your sharded cluster. Then, restart your applications.

Deploy a Second Replica Set

Deploy a new replica set called rs1. The members of replica set rs1 are on the following hosts:

• mongodb3.example.net

• mongodb4.example.net

• mongodb5.example.net

1. Start each member of the replica set.

   Keyfile Authentication

   x.509 Authentication

   For each mongod instance in the replica set, create a configuration file with these options:

   Option	Value
   security.keyFile	The path to the key file used for your initial replica set.
   replication.replSetName	rs1
   sharding.clusterRole	shardsvr
   net.bindIp	localhost, followed by any other hostnames on which the mongod should listen for client connections.

   security:
      keyFile: <PATH_TO_KEYFILE>
   replication:
      replSetName: rs1
   sharding:
      clusterRole: shardsvr
   net:
      bindIp: localhost,<hostname(s)>

   Include additional options as appropriate for your deployment.

   For each member, start a mongod with the following options:

   Option	Value
   replication.replSetName	rs1
   sharding.clusterRole	shardsvr
   security.clusterAuthMode	x509
   net.tls.mode	requireTLS
   net.tls.certificateKeyFile	The absolute path to the .pem file that contains both the TLS certificate and key.
   net.tls.CAFile	The absolute path to the .pem file that contains the root certificate chain from the Certificate Authority.
   net.bindIp	localhost, followed by any other hostnames on which the mongod should listen for client connections.

   replication:
      replSetName: rs1
   sharding:
      clusterRole: shardsvr
   security:
      clusterAuthMode: x509
   net:
      tls:
         mode: requireTLS
         certificateKeyFile: <FILE_WITH_COMBINED_CERT_AND_KEY>
         CAFile: <CA_FILE>
      bindIp: localhost,<hostname(s)>

   Deploy the mongod with your specified configuration:

   mongod --config <PATH_TO_CONFIG_FILE>

   Note

   When you specify the --shardsvr option for a mongod instance, the instance runs on port 27018 by default.

2. Start each member of the replica set.

3. Connect to a replica set member.

   Use mongosh to connect to one of the replica set members. For example:

   Keyfile Authentication

   x.509 Authentication

   mongosh "mongodb://mongodb3.example.net:27018"

   mongosh "mongodb://mongodb3.example.net:27018" --tls --tlsCAFile <CA_FILE> --tlsCertificateKeyFile <filename>

4. Initiate the replica set.

   In mongosh, run the rs.initiate() method to initiate a replica set that contains the current member:

   rs.initiate( {
      _id : "rs1",
      members: [
          { _id: 0, host: "mongodb3.example.net:27018" },
          { _id: 1, host: "mongodb4.example.net:27018" },
          { _id: 2, host: "mongodb5.example.net:27018" }
      ]
   } )

   The preceding command requires the localhost exception to perform administrative actions without authentication.

   Important

   Run rs.initiate() on just one and only one mongod instance for the replica set.

5. Add an administrative user for the replica set.

   After you deploy the replica set, use the localhost exception to create the replica set's first user.

   1. Determine the replica set primary.

      To determine the primary, run rs.status():

      rs.status()

      In the command output, the replSetGetStatus.members[n].stateStr field indicates which member is the primary.

   2. Connect to the replica set primary.

      Connect to the replica set primary with mongosh. For example, if the primary is mongodb4.example.net, run this command:

      Keyfile Authentication

      mongosh "mongodb://mongodb4.example.net:27018"

   3. Create an administrative user.

      Run the following db.createUser() method to create a user named rs1Admin with the userAdmin role:

      use admin
      db.createUser(
         {
            user: "rs1Admin",
            pwd: passwordPrompt(),
            roles: [
               { role: "userAdmin", db: "admin" }
            ]
         }
      )

      After you run the command, the database prompts you to enter a password for the rs1Admin user.

Add the Second Replica Set to the Cluster as a Shard

Add the new replica set, rs1, to the sharded cluster.

1. Connect mongosh to the mongos.

   Run the following command from the command line to connect to the mongos instance running on host mongodb6.example.net:

   Keyfile Authentication

   x.509 Authentication

   mongosh "mongodb://admin01@mongodb6.example.net:27017/admin"

   mongosh "mongodb://admin01@mongodb6.example.net:27017/admin" --tls --tlsCAFile <CA_FILE> --tlsCertificateKeyFile <filename>

   This command authenticates you as the admin01 user you created on the sharded cluster. After you enter the command, enter your user's password.

2. Add the second shard.

   After you connect to the mongos, add the replica set rs1 as a shard to the cluster with the sh.addShard() method:

   sh.addShard( "rs1/mongodb3.example.net:27018,mongodb4.example.net:27018,mongodb5.example.net:27018" )

Shard a Collection

The final step of the procedure is to shard a collection in the sharded cluster.

1. Determine the shard key.

   Determine the shard key for the collection. The shard key indicates how MongoDB distributes the documents between shards. Good shard keys:

   • Have values that are evenly distributed among all documents.

   • Group documents that are often accessed at the same time into contiguous chunks.

   • Allow for effective distribution of activity among shards.

   For more information, see Choose a Shard Key.

   This procedure uses the number field as the shard key for the test_collection collection.

2. Create an index on the shard key.

   Before you shard a non-empty collection, create an index on the shard key:

   use test
   db.test_collection.createIndex( { "number" : 1 } )

3. Shard the collection.

   In the test database, shard the test_collection. Specify number as the shard key.

   sh.shardCollection( "test.test_collection", { "number" : 1 } )

   The next time that the balancer runs, it redistributes chunks of documents between shards. As clients insert additional documents into this collection, the mongos routes the documents to the appropriate shard.

   When the balancer redistributes chunks, it may negatively impact your application's performance. To minimize performance impact, you can specify when the balancer runs so it does not run during peak hours. To learn more, see Schedule the Balancing Window.