Integrate with Prometheus

On this page

Prerequisites

Procedure
Example Configurations
Import a Sample Grafana Dashboard
Performance Metrics Available to Prometheus
MongoDB Metric Labels
MongoDB Information Metrics
Hardware Metrics
Hardware Metric Labels

Cloud Manager will no longer support Automation, Backup, and Monitoring for MongoDB 3.6 and 4.0 after August 30th, 2024. Please upgrade your MongoDB deployment or migrate to Atlas.

OAuth 2.0 authentication for programmatic access to Cloud Manager is available as a Preview feature.: The feature and the corresponding documentation might change at any time during the Preview period. To use OAuth 2.0 authentication, create a service account to use in your requests to the Cloud Manager Public API.

Prometheus collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts when it observes specific conditions.

Our integration allows you to configure Cloud Manager to send metric data about your deployment to your Prometheus instance.

Prerequisites

Prometheus integration is available in automation managed clusters that use MongoDB Agent 12.0.15.7646 or later. MongoDB Agent 12.0.15.7646 is released with Cloud Manager 6.0.7.
Have a working Prometheus instance. To set up a working instance, see their Installation Guide.
(Optional) Use Grafana to visualize your Prometheus metrics.

Procedure

To integrate Cloud Manager with Prometheus:

In MongoDB Cloud Manager, go to the Project Integrations page.

If it's not already displayed, select the organization that contains your desired project from the Organizations menu in the navigation bar.
If it's not already displayed, select your desired project from the Projects menu in the navigation bar.
Next to the Projects menu, expand the Options menu, then click Integrations.
The Project Integrations page displays.

Click Configure for the Prometheus integration card.

Enter your preferred username and password.

Prometheus authentication credentials are specifically designed for use with the Prometheus integration in Cloud Manager. Cloud Manager uses these credentials to only access the Prometheus discovery endpoint and scrape Prometheus metrics from Cloud Manager nodes. They are strictly limited to these functions and do not have any additional permissions or capabilities beyond accessing and collecting monitoring data.

Important

Copy your username and password in a secure location. You can't access the password after you leave this screen.

Enter your IP address and port.

Tip

The default value, 0.0.0.0:9216, scrapes metrics on port 9216 on all IPv4 addresses on the local machine.

(Optional) Encrypt all Prometheus metrics.

If you enable this setting, Cloud Manager assures that your Prometheus instance uses https to scrape metrics.

Fields	Description
TLS Certificate Key File Path	`PEM` file path that contains certificate and key required to spin up a `https` Prometheus scraping endpoint. You are responsible for the following: TLS Certificate Key File issuance and renewal. Checking if the endpoint started correctly in the automation agent logs.
TLS Certificate Key File Password	Required if the certificate key file is encrypted.

Select your preferred service discovery method.

Discovery Method

Description

HTTP SD

This method requires Prometheus v2.28 and later. It generates the scrape_config part of your configuration file to discover targets over an HTTP endpoint.

File Service Discovery

This method allows Prometheus to read YAML or JSON documents to configure the targets to scrape from.

You are responsible for providing the targets by making a request to the Discovery API and storing its results in a targets.json file.

To make the request, substitute the placeholder text in one of the following tabs or create your own script in another language.

# Sets the `Authorization` header on every scrape
# request with the username and password from the
# previous step. The URL that Prometheus fetches the
# targets from.
# Replace the <group-id> with the project ID of your
# Atlas instance.
curl --header 'Accept: application/json' \
     --user <username>:<password> \
     --request GET "https://cloud.mongodb.com/prometheus/v1.0/groups/{GROUP-ID}/discovery"

If you need to install the requests library, see their Installation Guide.

import time, json, requests
# This script sets the `Authorization` header on every
# scrape request with the configured username and
# password. Then it tells Prometheus to fetch targets
# from the specified URL.
#
# Note: Replace the <username> and <password> with the
# values in the previous step, and <group-id> with the
# project ID of your Atlas instance.
basic_auth_user="<username>"
basic_auth_password="<password>"
discovery_api_url="https://cloud.mongodb.com/prometheus/v1.0/groups/{GROUP-ID}/discovery"
# The script updates your targets.json file every
# minute, if it successfully retrieves targets.
#
# Note: Replace the <path-to-targets.json> with the
# path to your targets.json file.
starttime = time.time()
while True:
  r = requests.get(discovery_api_url, auth=(basic_auth_user, basic_auth_password))
  if  r.status_code == 200:
    with open('<path-to-targets.json>', 'w') as f:
      json.dump(r.json(), f)
  time.sleep(60.0 - ((time.time() - starttime) % 60.0))

To learn more about the Discovery API, see Return the Latest Targets for Prometheus.

Click Save.

View Your Cluster Metrics on Prometheus.

Copy the generated snippet into the scrape_configs section of your configuration file and substitute the placeholder text.
For an example of the configuration file in either method, see Example Configurations.
Restart your Prometheus instance.
In your Prometheus instance, click Status in the top navigation bar, and click Targets to see the metrics of your deployment.

Example Configurations

The following shows examples of the configuration file when you use the HTTP Service Discovery or File Service Discovery method.

The configuration file in both methods contains the following fields:

Field	Description
`scrape_interval`	Time that indicates how frequently to scrape targets. This setting supports a minimum time of 10s.
`job_name`	Human-readable label assigned to scraped metrics.
`metrics_path`	HTTP resource path that indicates where to fetch metrics from targets.
`scheme`	Your Prometheus protocol scheme configured for requests, either `http` or `https`. If you configure `https`, you must specify `tlsPemPath`.
`basic_auth`	Authorization header to use on every scrape request.

HTTP Service Discovery

The HTTP Service Discovery method also contains the http_sd_configs field with the following sub-fields:

Field	Description
`url`	URL from which Prometheus fetches the targets.
`refresh_interval`	Time that indicates when to re-query the endpoint.
`basic_auth`	Credentials to use for authenticating to the API server.

global:
  scrape_interval: 15s
scrape_configs:
  - job_name: "CM-Testing-mongo-metrics"
    scrape_interval: 10s
    metrics_path: /metrics
    scheme : https
    basic_auth:
      username: prom_user_61e6e34e93eac1632d39f457
      password: V7hTyLfkjwiWQbv
    http_sd_configs:
      - url: https://cloud.mongodb.com/prometheus/v1.0/groups/61e6e34e93eac1632d39f457/discovery
        refresh_interval: 60s
        basic_auth:
          username: prom_user_61e6e34e93eac1632d39f457
          password: V7hTyLfkjwiWQbv

File Service Discovery

The File Service Discovery method also contains the file_sd_configs field with the following sub-field:

Field	Description
`files`	List that contains the files from which to extract the metrics scraping targets.

global:
  scrape_interval: 15s
scrape_configs:
  - job_name: "CM-Testing-mongo-metrics"
    scrape_interval: 10s
    metrics_path: /metrics
    scheme : https
    basic_auth:
      username: prom_user_61e6e34e93eac1632d39f457
      password: V7hTyLfkjwiWQbv
    file_sd_configs:
      - files:
        - /usr/local/etc/targets.json

Import a Sample Grafana Dashboard

To import a sample Grafana dashboard:

Navigate to the Import screen.

In the Grafana UI, click the button, and then click Import.

Click Upload JSON File.

Copy over the `mongo-metrics.json` or the `hardware-metrics.json` file to create a dashboard.

mongo-metrics.json

1 {
2  "__inputs": [
3    {
4      "name": "DS_THANOS",
5      "label": "thanos",
6      "description": "",
7      "type": "datasource",
8      "pluginId": "prometheus",
9      "pluginName": "Prometheus"
10    }
11  ],
12  "__elements": [],
13  "__requires": [
14    {
15      "type": "grafana",
16      "id": "grafana",
17      "name": "Grafana",
18      "version": "8.5.6"
19    },
20    {
21      "type": "panel",
22      "id": "graph",
23      "name": "Graph (old)",
24      "version": ""
25    },
26    {
27      "type": "datasource",
28      "id": "prometheus",
29      "name": "Prometheus",
30      "version": "1.0.0"
31    },
32    {
33      "type": "panel",
34      "id": "table",
35      "name": "Table",
36      "version": ""
37    }
38  ],
39  "annotations": {
40    "list": [
41      {
42        "builtIn": 1,
43        "datasource": {
44          "type": "datasource",
45          "uid": "grafana"
46        },
47        "enable": true,
48        "hide": true,
49        "iconColor": "rgba(0, 211, 255, 1)",
50        "name": "Annotations & Alerts",
51        "target": {
52          "limit": 100,
53          "matchAny": false,
54          "tags": [],
55          "type": "dashboard"
56        },
57        "type": "dashboard"
58      }
59    ]
60  },
61  "editable": true,
62  "fiscalYearStartMonth": 0,
63  "graphTooltip": 0,
64  "id": null,
65  "iteration": 1657202032408,
66  "links": [],
67  "liveNow": false,
68  "panels": [
69    {
70      "collapsed": false,
71      "datasource": {
72        "type": "prometheus",
73        "uid": "000000010"
74      },
75      "gridPos": {
76        "h": 1,
77        "w": 24,
78        "x": 0,
79        "y": 0
80      },
81      "id": 10,
82      "panels": [],
83      "title": "Overview",
84      "type": "row"
85    },
86    {
87      "datasource": {
88        "type": "prometheus",
89        "uid": "${DS_THANOS}"
90      },
91      "fieldConfig": {
92        "defaults": {
93          "color": {
94            "mode": "thresholds"
95          },
96          "custom": {
97            "align": "auto",
98            "displayMode": "auto",
99            "inspect": false
100          },
101          "decimals": 2,
102          "displayName": "",
103          "mappings": [],
104          "thresholds": {
105            "mode": "absolute",
106            "steps": [
107              {
108                "color": "green",
109                "value": null
110              },
111              {
112                "color": "red",
113                "value": 80
114              }
115            ]
116          },
117          "unit": "short"
118        },
119        "overrides": [
120          {
121            "matcher": {
122              "id": "byName",
123              "options": "Value"
124            },
125            "properties": [
126              {
127                "id": "unit",
128                "value": "short"
129              },
130              {
131                "id": "decimals",
132                "value": 2
133              },
134              {
135                "id": "custom.align"
136              }
137            ]
138          }
139        ]
140      },
141      "gridPos": {
142        "h": 4,
143        "w": 24,
144        "x": 0,
145        "y": 1
146      },
147      "id": 41,
148      "options": {
149        "footer": {
150          "fields": "",
151          "reducer": [
152            "sum"
153          ],
154          "show": false
155        },
156        "showHeader": true
157      },
158      "pluginVersion": "8.5.6",
159      "targets": [
160        {
161          "datasource": {
162            "type": "prometheus",
163            "uid": "${DS_THANOS}"
164          },
165          "exemplar": false,
166          "expr": "label_replace( sum(mongodb_info{group_id=~\"$group_id\", cl_name=~\"$cl_name\", instance=~\"$host.*\"}) by (group_id, org_id, rs_nm, cl_name), \"hostname\", \"$1\", \"instance\", \"(.*)\")\n",
167          "format": "table",
168          "instant": true,
169          "interval": "",
170          "legendFormat": "",
171          "refId": "A"
172        }
173      ],
174      "title": "Group Metadata",
175      "transformations": [
176        {
177          "id": "organize",
178          "options": {
179            "excludeByName": {
180              "Time": true,
181              "Value #A": true,
182              "instance": true,
183              "rs_nm": false
184            },
185            "indexByName": {
186              "": 2,
187              "Time": 0,
188              "Value #A": 6,
189              "cl_name": 4,
190              "group_id": 3,
191              "org_id": 1,
192              "rs_nm": 5
193            },
194            "renameByName": {
195              "": "Group Name ",
196              "Time": "",
197              "cl_name": "Cluster Name",
198              "group_id": "Group Id",
199              "hostname": "Host",
200              "instance": "",
201              "org_id": "Org Id",
202              "process_port": "Port",
203              "replica_state": "ReplicaSet State",
204              "rs_nm": "ReplicaSet Name"
205            }
206          }
207        },
208        {
209          "id": "groupBy",
210          "options": {
211            "fields": {
212              "Cluster Name": {
213                "aggregations": [],
214                "operation": "groupby"
215              },
216              "Group Id": {
217                "aggregations": [],
218                "operation": "groupby"
219              },
220              "Group Name ": {
221                "aggregations": [],
222                "operation": "groupby"
223              },
224              "Host": {
225                "aggregations": [],
226                "operation": "groupby"
227              },
228              "Host ": {
229                "aggregations": [],
230                "operation": "groupby"
231              },
232              "Org Id": {
233                "aggregations": [],
234                "operation": "groupby"
235              },
236              "Port": {
237                "aggregations": [],
238                "operation": "groupby"
239              },
240              "Replica set state": {
241                "aggregations": [],
242                "operation": "groupby"
243              },
244              "ReplicaSet Name": {
245                "aggregations": [],
246                "operation": "groupby"
247              },
248              "ReplicaSet State": {
249                "aggregations": [],
250                "operation": "groupby"
251              },
252              "host ": {
253                "aggregations": [],
254                "operation": "groupby"
255              },
256              "hostname": {
257                "aggregations": [],
258                "operation": "groupby"
259              },
260              "instance": {
261                "aggregations": [],
262                "operation": "groupby"
263              },
264              "port": {
265                "aggregations": [],
266                "operation": "groupby"
267              },
268              "process_port": {
269                "aggregations": [],
270                "operation": "groupby"
271              },
272              "replica set": {
273                "aggregations": [],
274                "operation": "groupby"
275              },
276              "replica set state": {
277                "aggregations": [],
278                "operation": "groupby"
279              },
280              "replica_state": {
281                "aggregations": [],
282                "operation": "groupby"
283              },
284              "rs_nm": {
285                "aggregations": [],
286                "operation": "groupby"
287              }
288            }
289          }
290        },
291        {
292          "id": "merge",
293          "options": {
294            "reducers": []
295          }
296        }
297      ],
298      "type": "table"
299    },
300    {
301      "datasource": {
302        "type": "prometheus",
303        "uid": "${DS_THANOS}"
304      },
305      "fieldConfig": {
306        "defaults": {
307          "color": {
308            "mode": "thresholds"
309          },
310          "custom": {
311            "align": "auto",
312            "displayMode": "auto",
313            "inspect": false
314          },
315          "decimals": 0,
316          "displayName": "",
317          "mappings": [],
318          "thresholds": {
319            "mode": "absolute",
320            "steps": [
321              {
322                "color": "green",
323                "value": null
324              },
325              {
326                "color": "red",
327                "value": 80
328              }
329            ]
330          },
331          "unit": "none"
332        },
333        "overrides": []
334      },
335      "gridPos": {
336        "h": 6,
337        "w": 24,
338        "x": 0,
339        "y": 5
340      },
341      "id": 42,
342      "options": {
343        "footer": {
344          "fields": "",
345          "reducer": [
346            "sum"
347          ],
348          "show": false
349        },
350        "showHeader": true
351      },
352      "pluginVersion": "8.5.6",
353      "targets": [
354        {
355          "datasource": {
356            "type": "prometheus",
357            "uid": "${DS_THANOS}"
358          },
359          "exemplar": false,
360          "expr": "label_replace( sum(mongodb_info{group_id=~\"$group_id\", cl_name=~\"$cl_name\", instance=~\"$host.*\"}) by (instance, replica_state_name, process_port, rs_nm, process_type), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
361          "format": "table",
362          "instant": true,
363          "interval": "",
364          "legendFormat": "",
365          "refId": "A"
366        }
367      ],
368      "title": "Cluster host list",
369      "transformations": [
370        {
371          "id": "organize",
372          "options": {
373            "excludeByName": {
374              "Time": true,
375              "Value #A": true,
376              "instance": false,
377              "rs_nm": false
378            },
379            "indexByName": {
380              "Time": 0,
381              "Value": 6,
382              "instance": 1,
383              "process_port": 2,
384              "process_type": 4,
385              "replica_state_name": 5,
386              "rs_nm": 3
387            },
388            "renameByName": {
389              "Time": "",
390              "Value": "",
391              "hostname": "Host",
392              "instance": "Hostname",
393              "process_port": "Port",
394              "process_type": "Process Type",
395              "replica_state": "ReplicaSet State",
396              "replica_state_name": "Replica State",
397              "rs_nm": "ReplicaSet Name"
398            }
399          }
400        },
401        {
402          "id": "groupBy",
403          "options": {
404            "fields": {
405              "Host": {
406                "aggregations": [],
407                "operation": "groupby"
408              },
409              "Host ": {
410                "aggregations": [],
411                "operation": "groupby"
412              },
413              "Hostname": {
414                "aggregations": [],
415                "operation": "groupby"
416              },
417              "Port": {
418                "aggregations": [],
419                "operation": "groupby"
420              },
421              "Process Type": {
422                "aggregations": [],
423                "operation": "groupby"
424              },
425              "Replica State": {
426                "aggregations": [],
427                "operation": "groupby"
428              },
429              "Replica set state": {
430                "aggregations": [],
431                "operation": "groupby"
432              },
433              "ReplicaSet Name": {
434                "aggregations": [],
435                "operation": "groupby"
436              },
437              "ReplicaSet State": {
438                "aggregations": [],
439                "operation": "groupby"
440              },
441              "host ": {
442                "aggregations": [],
443                "operation": "groupby"
444              },
445              "hostname": {
446                "aggregations": [],
447                "operation": "groupby"
448              },
449              "instance": {
450                "aggregations": [],
451                "operation": "groupby"
452              },
453              "port": {
454                "aggregations": [],
455                "operation": "groupby"
456              },
457              "process_port": {
458                "aggregations": [],
459                "operation": "groupby"
460              },
461              "replica set": {
462                "aggregations": [],
463                "operation": "groupby"
464              },
465              "replica set state": {
466                "aggregations": [],
467                "operation": "groupby"
468              },
469              "replica_state": {
470                "aggregations": [],
471                "operation": "groupby"
472              },
473              "rs_nm": {
474                "aggregations": [],
475                "operation": "groupby"
476              }
477            }
478          }
479        },
480        {
481          "id": "merge",
482          "options": {
483            "reducers": []
484          }
485        }
486      ],
487      "type": "table"
488    },
489    {
490      "collapsed": false,
491      "datasource": {
492        "type": "prometheus",
493        "uid": "000000010"
494      },
495      "gridPos": {
496        "h": 1,
497        "w": 24,
498        "x": 0,
499        "y": 11
500      },
501      "id": 8,
502      "panels": [],
503      "title": "Memory",
504      "type": "row"
505    },
506    {
507      "aliasColors": {},
508      "bars": false,
509      "dashLength": 10,
510      "dashes": false,
511      "datasource": {
512        "type": "prometheus",
513        "uid": "${DS_THANOS}"
514      },
515      "description": "The number of megabytes resident. MMAPv1: It is typical over time, on a dedicated database server, for this number to approach the amount of physical ram on the box. WiredTiger: In a standard deployment resident is the amount of memory used by the WiredTiger cache plus the memory dedicated to other in memory structures used by the mongod process. By default, mongod with WiredTiger reserves 50% of the total physical memory on the server for the cache and at steady state, WiredTiger tries to limit cache usage to 80% of that total. For example, if a server has 16GB of memory, WiredTiger will assume it can use 8GB for cache and at steady state should use about 6.5GB.",
516      "fieldConfig": {
517        "defaults": {
518          "links": [],
519          "unit": "decmbytes"
520        },
521        "overrides": []
522      },
523      "fill": 1,
524      "fillGradient": 0,
525      "gridPos": {
526        "h": 8,
527        "w": 12,
528        "x": 0,
529        "y": 12
530      },
531      "hiddenSeries": false,
532      "id": 2,
533      "legend": {
534        "avg": false,
535        "current": false,
536        "max": false,
537        "min": false,
538        "show": true,
539        "total": false,
540        "values": false
541      },
542      "lines": true,
543      "linewidth": 1,
544      "nullPointMode": "null",
545      "options": {
546        "alertThreshold": true,
547        "legend": {
548          "calcs": [],
549          "displayMode": "list",
550          "placement": "bottom"
551        },
552        "tooltip": {
553          "mode": "single"
554        }
555      },
556      "percentage": false,
557      "pluginVersion": "8.5.6",
558      "pointradius": 2,
559      "points": false,
560      "renderer": "flot",
561      "seriesOverrides": [],
562      "spaceLength": 10,
563      "stack": false,
564      "steppedLine": false,
565      "targets": [
566        {
567          "exemplar": true,
568          "expr": "label_replace(sum(mongodb_mem_resident{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
569          "interval": "",
570          "legendFormat": "{{hostname}}:{{process_port}}",
571          "refId": "A",
572          "datasource": {
573            "type": "prometheus",
574            "uid": "${DS_THANOS}"
575          }
576        }
577      ],
578      "thresholds": [],
579      "timeRegions": [],
580      "title": "Memory - Resident",
581      "tooltip": {
582        "shared": true,
583        "sort": 0,
584        "value_type": "individual"
585      },
586      "type": "graph",
587      "xaxis": {
588        "mode": "time",
589        "show": true,
590        "values": []
591      },
592      "yaxes": [
593        {
594          "format": "decmbytes",
595          "logBase": 1,
596          "show": true
597        },
598        {
599          "format": "short",
600          "logBase": 1,
601          "show": true
602        }
603      ],
604      "yaxis": {
605        "align": false
606      }
607    },
608    {
609      "aliasColors": {},
610      "bars": false,
611      "dashLength": 10,
612      "dashes": false,
613      "datasource": {
614        "type": "prometheus",
615        "uid": "${DS_THANOS}"
616      },
617      "description": "The virtual megabytes for the mongod process. MMAPv1: Generally virtual should be a little larger than mapped (or 2x with --journal), but if virtual is many gigabytes larger, it indicates that excessive memory is being used by other aspects than the memory mapping of files -- that would be bad/suboptimal. The most common case of usage of a high amount of memory for non-mapped is that there are very many connections to the database. Each connection has a thread stack and the memory for those stacks can add up to a considerable amount. WiredTiger: Generally virtual should be a little larger than mapped, but if virtual is many gigabytes larger, it indicates that excessive memory is being used by other aspects than the memory mapping of files -- that would be bad/suboptimal. The most common case of usage of a high amount of memory for non-mapped is that there are very many connections to the database. Each connection has a thread stack and the memory for those stacks can add up to a considerable amount.",
618      "fieldConfig": {
619        "defaults": {
620          "links": [],
621          "unit": "decmbytes"
622        },
623        "overrides": []
624      },
625      "fill": 1,
626      "fillGradient": 0,
627      "gridPos": {
628        "h": 8,
629        "w": 12,
630        "x": 12,
631        "y": 12
632      },
633      "hiddenSeries": false,
634      "id": 72,
635      "legend": {
636        "avg": false,
637        "current": false,
638        "max": false,
639        "min": false,
640        "show": true,
641        "total": false,
642        "values": false
643      },
644      "lines": true,
645      "linewidth": 1,
646      "nullPointMode": "null",
647      "options": {
648        "alertThreshold": true,
649        "legend": {
650          "calcs": [],
651          "displayMode": "list",
652          "placement": "bottom"
653        },
654        "tooltip": {
655          "mode": "single"
656        }
657      },
658      "percentage": false,
659      "pluginVersion": "8.5.6",
660      "pointradius": 2,
661      "points": false,
662      "renderer": "flot",
663      "seriesOverrides": [],
664      "spaceLength": 10,
665      "stack": false,
666      "steppedLine": false,
667      "targets": [
668        {
669          "exemplar": true,
670          "expr": "label_replace(sum(mongodb_mem_virtual{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
671          "interval": "",
672          "legendFormat": "{{hostname}}:{{process_port}}",
673          "refId": "A",
674          "datasource": {
675            "type": "prometheus",
676            "uid": "${DS_THANOS}"
677          }
678        }
679      ],
680      "thresholds": [],
681      "timeRegions": [],
682      "title": "Memory - Virtual",
683      "tooltip": {
684        "shared": true,
685        "sort": 0,
686        "value_type": "individual"
687      },
688      "type": "graph",
689      "xaxis": {
690        "mode": "time",
691        "show": true,
692        "values": []
693      },
694      "yaxes": [
695        {
696          "format": "decmbytes",
697          "logBase": 1,
698          "show": true
699        },
700        {
701          "format": "short",
702          "logBase": 1,
703          "show": true
704        }
705      ],
706      "yaxis": {
707        "align": false
708      }
709    },
710    {
711      "collapsed": false,
712      "datasource": {
713        "type": "prometheus",
714        "uid": "000000010"
715      },
716      "gridPos": {
717        "h": 1,
718        "w": 24,
719        "x": 0,
720        "y": 20
721      },
722      "id": 17,
723      "panels": [],
724      "title": "Asserts",
725      "type": "row"
726    },
727    {
728      "aliasColors": {},
729      "bars": false,
730      "dashLength": 10,
731      "dashes": false,
732      "datasource": {
733        "type": "prometheus",
734        "uid": "${DS_THANOS}"
735      },
736      "description": "The average rate of regular asserts raised per second over the selected sample period\n",
737      "fieldConfig": {
738        "defaults": {
739          "links": [],
740          "unit": "/s"
741        },
742        "overrides": []
743      },
744      "fill": 1,
745      "fillGradient": 0,
746      "gridPos": {
747        "h": 8,
748        "w": 6,
749        "x": 0,
750        "y": 21
751      },
752      "hiddenSeries": false,
753      "id": 73,
754      "legend": {
755        "avg": false,
756        "current": false,
757        "max": false,
758        "min": false,
759        "show": true,
760        "total": false,
761        "values": false
762      },
763      "lines": true,
764      "linewidth": 1,
765      "nullPointMode": "null",
766      "options": {
767        "alertThreshold": true,
768        "legend": {
769          "calcs": [],
770          "displayMode": "list",
771          "placement": "bottom"
772        },
773        "tooltip": {
774          "mode": "single"
775        }
776      },
777      "percentage": false,
778      "pluginVersion": "8.5.6",
779      "pointradius": 2,
780      "points": false,
781      "renderer": "flot",
782      "seriesOverrides": [],
783      "spaceLength": 10,
784      "stack": false,
785      "steppedLine": false,
786      "targets": [
787        {
788          "exemplar": true,
789          "expr": "label_replace(sum(rate(mongodb_asserts_regular{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
790          "interval": "",
791          "legendFormat": "{{hostname}}:{{process_port}}",
792          "refId": "A",
793          "datasource": {
794            "type": "prometheus",
795            "uid": "${DS_THANOS}"
796          }
797        }
798      ],
799      "thresholds": [],
800      "timeRegions": [],
801      "title": "Asserts - Regular",
802      "tooltip": {
803        "shared": true,
804        "sort": 0,
805        "value_type": "individual"
806      },
807      "type": "graph",
808      "xaxis": {
809        "mode": "time",
810        "show": true,
811        "values": []
812      },
813      "yaxes": [
814        {
815          "format": "/s",
816          "logBase": 1,
817          "show": true
818        },
819        {
820          "format": "short",
821          "logBase": 1,
822          "show": true
823        }
824      ],
825      "yaxis": {
826        "align": false
827      }
828    },
829    {
830      "aliasColors": {},
831      "bars": false,
832      "dashLength": 10,
833      "dashes": false,
834      "datasource": {
835        "type": "prometheus",
836        "uid": "${DS_THANOS}"
837      },
838      "description": "The average rate of warnings per second over the selected sample period",
839      "fieldConfig": {
840        "defaults": {
841          "links": [],
842          "unit": "/s"
843        },
844        "overrides": []
845      },
846      "fill": 1,
847      "fillGradient": 0,
848      "gridPos": {
849        "h": 8,
850        "w": 6,
851        "x": 6,
852        "y": 21
853      },
854      "hiddenSeries": false,
855      "id": 74,
856      "legend": {
857        "avg": false,
858        "current": false,
859        "max": false,
860        "min": false,
861        "show": true,
862        "total": false,
863        "values": false
864      },
865      "lines": true,
866      "linewidth": 1,
867      "nullPointMode": "null",
868      "options": {
869        "alertThreshold": true,
870        "legend": {
871          "calcs": [],
872          "displayMode": "list",
873          "placement": "bottom"
874        },
875        "tooltip": {
876          "mode": "single"
877        }
878      },
879      "percentage": false,
880      "pluginVersion": "8.5.6",
881      "pointradius": 2,
882      "points": false,
883      "renderer": "flot",
884      "seriesOverrides": [],
885      "spaceLength": 10,
886      "stack": false,
887      "steppedLine": false,
888      "targets": [
889        {
890          "exemplar": true,
891          "expr": "label_replace(sum(rate(mongodb_asserts_warning{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
892          "interval": "",
893          "legendFormat": "{{hostname}}:{{process_port}}",
894          "refId": "A",
895          "datasource": {
896            "type": "prometheus",
897            "uid": "${DS_THANOS}"
898          }
899        }
900      ],
901      "thresholds": [],
902      "timeRegions": [],
903      "title": "Asserts - Warning",
904      "tooltip": {
905        "shared": true,
906        "sort": 0,
907        "value_type": "individual"
908      },
909      "type": "graph",
910      "xaxis": {
911        "mode": "time",
912        "show": true,
913        "values": []
914      },
915      "yaxes": [
916        {
917          "format": "/s",
918          "logBase": 1,
919          "show": true
920        },
921        {
922          "format": "short",
923          "logBase": 1,
924          "show": true
925        }
926      ],
927      "yaxis": {
928        "align": false
929      }
930    },
931    {
932      "aliasColors": {},
933      "bars": false,
934      "dashLength": 10,
935      "dashes": false,
936      "datasource": {
937        "type": "prometheus",
938        "uid": "${DS_THANOS}"
939      },
940      "description": "The average rate of message asserts per second over the selected sample period. These are internal server errors that have a well defined text string. Stack traces are logged for these",
941      "fieldConfig": {
942        "defaults": {
943          "links": [],
944          "unit": "/s"
945        },
946        "overrides": []
947      },
948      "fill": 1,
949      "fillGradient": 0,
950      "gridPos": {
951        "h": 8,
952        "w": 6,
953        "x": 12,
954        "y": 21
955      },
956      "hiddenSeries": false,
957      "id": 75,
958      "legend": {
959        "avg": false,
960        "current": false,
961        "max": false,
962        "min": false,
963        "show": true,
964        "total": false,
965        "values": false
966      },
967      "lines": true,
968      "linewidth": 1,
969      "nullPointMode": "null",
970      "options": {
971        "alertThreshold": true,
972        "legend": {
973          "calcs": [],
974          "displayMode": "list",
975          "placement": "bottom"
976        },
977        "tooltip": {
978          "mode": "single"
979        }
980      },
981      "percentage": false,
982      "pluginVersion": "8.5.6",
983      "pointradius": 2,
984      "points": false,
985      "renderer": "flot",
986      "seriesOverrides": [],
987      "spaceLength": 10,
988      "stack": false,
989      "steppedLine": false,
990      "targets": [
991        {
992          "exemplar": true,
993          "expr": "label_replace(sum(rate(mongodb_asserts_msg{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
994          "interval": "",
995          "legendFormat": "{{hostname}}:{{process_port}}",
996          "refId": "A",
997          "datasource": {
998            "type": "prometheus",
999            "uid": "${DS_THANOS}"
1000          }
1001        }
1002      ],
1003      "thresholds": [],
1004      "timeRegions": [],
1005      "title": "Asserts - Message",
1006      "tooltip": {
1007        "shared": true,
1008        "sort": 0,
1009        "value_type": "individual"
1010      },
1011      "type": "graph",
1012      "xaxis": {
1013        "mode": "time",
1014        "show": true,
1015        "values": []
1016      },
1017      "yaxes": [
1018        {
1019          "format": "/s",
1020          "logBase": 1,
1021          "show": true
1022        },
1023        {
1024          "format": "short",
1025          "logBase": 1,
1026          "show": true
1027        }
1028      ],
1029      "yaxis": {
1030        "align": false
1031      }
1032    },
1033    {
1034      "aliasColors": {},
1035      "bars": false,
1036      "dashLength": 10,
1037      "dashes": false,
1038      "datasource": {
1039        "type": "prometheus",
1040        "uid": "${DS_THANOS}"
1041      },
1042      "description": "The average rate of user asserts per second over the selected sample period. These are errors that can be generated by a user such as out of disk space or duplicate key",
1043      "fieldConfig": {
1044        "defaults": {
1045          "links": [],
1046          "unit": "/s"
1047        },
1048        "overrides": []
1049      },
1050      "fill": 1,
1051      "fillGradient": 0,
1052      "gridPos": {
1053        "h": 8,
1054        "w": 6,
1055        "x": 18,
1056        "y": 21
1057      },
1058      "hiddenSeries": false,
1059      "id": 76,
1060      "legend": {
1061        "avg": false,
1062        "current": false,
1063        "max": false,
1064        "min": false,
1065        "show": true,
1066        "total": false,
1067        "values": false
1068      },
1069      "lines": true,
1070      "linewidth": 1,
1071      "nullPointMode": "null",
1072      "options": {
1073        "alertThreshold": true,
1074        "legend": {
1075          "calcs": [],
1076          "displayMode": "list",
1077          "placement": "bottom"
1078        },
1079        "tooltip": {
1080          "mode": "single"
1081        }
1082      },
1083      "percentage": false,
1084      "pluginVersion": "8.5.6",
1085      "pointradius": 2,
1086      "points": false,
1087      "renderer": "flot",
1088      "seriesOverrides": [],
1089      "spaceLength": 10,
1090      "stack": false,
1091      "steppedLine": false,
1092      "targets": [
1093        {
1094          "exemplar": true,
1095          "expr": "label_replace(sum(rate(mongodb_asserts_user{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1096          "interval": "",
1097          "legendFormat": "{{hostname}}:{{process_port}}",
1098          "refId": "A",
1099          "datasource": {
1100            "type": "prometheus",
1101            "uid": "${DS_THANOS}"
1102          }
1103        }
1104      ],
1105      "thresholds": [],
1106      "timeRegions": [],
1107      "title": "Asserts - User",
1108      "tooltip": {
1109        "shared": true,
1110        "sort": 0,
1111        "value_type": "individual"
1112      },
1113      "type": "graph",
1114      "xaxis": {
1115        "mode": "time",
1116        "show": true,
1117        "values": []
1118      },
1119      "yaxes": [
1120        {
1121          "format": "/s",
1122          "logBase": 1,
1123          "show": true
1124        },
1125        {
1126          "format": "short",
1127          "logBase": 1,
1128          "show": true
1129        }
1130      ],
1131      "yaxis": {
1132        "align": false
1133      }
1134    },
1135    {
1136      "collapsed": false,
1137      "datasource": {
1138        "type": "prometheus",
1139        "uid": "000000010"
1140      },
1141      "gridPos": {
1142        "h": 1,
1143        "w": 24,
1144        "x": 0,
1145        "y": 29
1146      },
1147      "id": 44,
1148      "panels": [],
1149      "title": "Cache",
1150      "type": "row"
1151    },
1152    {
1153      "aliasColors": {},
1154      "bars": false,
1155      "dashLength": 10,
1156      "dashes": false,
1157      "datasource": {
1158        "type": "prometheus",
1159        "uid": "${DS_THANOS}"
1160      },
1161      "description": "The average rate of bytes per second read into WiredTiger's cache over the selected sample period.",
1162      "fieldConfig": {
1163        "defaults": {
1164          "links": [],
1165          "unit": "Bps"
1166        },
1167        "overrides": []
1168      },
1169      "fill": 1,
1170      "fillGradient": 0,
1171      "gridPos": {
1172        "h": 8,
1173        "w": 6,
1174        "x": 0,
1175        "y": 30
1176      },
1177      "hiddenSeries": false,
1178      "id": 77,
1179      "legend": {
1180        "avg": false,
1181        "current": false,
1182        "max": false,
1183        "min": false,
1184        "show": true,
1185        "total": false,
1186        "values": false
1187      },
1188      "lines": true,
1189      "linewidth": 1,
1190      "nullPointMode": "null",
1191      "options": {
1192        "alertThreshold": true,
1193        "legend": {
1194          "calcs": [],
1195          "displayMode": "list",
1196          "placement": "bottom"
1197        },
1198        "tooltip": {
1199          "mode": "single"
1200        }
1201      },
1202      "percentage": false,
1203      "pluginVersion": "8.5.6",
1204      "pointradius": 2,
1205      "points": false,
1206      "renderer": "flot",
1207      "seriesOverrides": [],
1208      "spaceLength": 10,
1209      "stack": false,
1210      "steppedLine": false,
1211      "targets": [
1212        {
1213          "exemplar": true,
1214          "expr": "label_replace(sum(irate(mongodb_wiredTiger_cache_bytes_read_into_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1215          "interval": "",
1216          "legendFormat": "{{hostname}}:{{process_port}}",
1217          "refId": "A",
1218          "datasource": {
1219            "type": "prometheus",
1220            "uid": "${DS_THANOS}"
1221          }
1222        }
1223      ],
1224      "thresholds": [],
1225      "timeRegions": [],
1226      "title": "Cache Activity - Read Into",
1227      "tooltip": {
1228        "shared": true,
1229        "sort": 0,
1230        "value_type": "individual"
1231      },
1232      "type": "graph",
1233      "xaxis": {
1234        "mode": "time",
1235        "show": true,
1236        "values": []
1237      },
1238      "yaxes": [
1239        {
1240          "format": "Bps",
1241          "logBase": 1,
1242          "show": true
1243        },
1244        {
1245          "format": "short",
1246          "logBase": 1,
1247          "show": true
1248        }
1249      ],
1250      "yaxis": {
1251        "align": false
1252      }
1253    },
1254    {
1255      "aliasColors": {},
1256      "bars": false,
1257      "dashLength": 10,
1258      "dashes": false,
1259      "datasource": {
1260        "type": "prometheus",
1261        "uid": "${DS_THANOS}"
1262      },
1263      "description": "The average rate of bytes per second written from WiredTiger's cache over the selected sample period.\n",
1264      "fieldConfig": {
1265        "defaults": {
1266          "links": [],
1267          "unit": "Bps"
1268        },
1269        "overrides": []
1270      },
1271      "fill": 1,
1272      "fillGradient": 0,
1273      "gridPos": {
1274        "h": 8,
1275        "w": 6,
1276        "x": 6,
1277        "y": 30
1278      },
1279      "hiddenSeries": false,
1280      "id": 78,
1281      "legend": {
1282        "avg": false,
1283        "current": false,
1284        "max": false,
1285        "min": false,
1286        "show": true,
1287        "total": false,
1288        "values": false
1289      },
1290      "lines": true,
1291      "linewidth": 1,
1292      "nullPointMode": "null",
1293      "options": {
1294        "alertThreshold": true,
1295        "legend": {
1296          "calcs": [],
1297          "displayMode": "list",
1298          "placement": "bottom"
1299        },
1300        "tooltip": {
1301          "mode": "single"
1302        }
1303      },
1304      "percentage": false,
1305      "pluginVersion": "8.5.6",
1306      "pointradius": 2,
1307      "points": false,
1308      "renderer": "flot",
1309      "seriesOverrides": [],
1310      "spaceLength": 10,
1311      "stack": false,
1312      "steppedLine": false,
1313      "targets": [
1314        {
1315          "exemplar": true,
1316          "expr": "label_replace(sum(irate(mongodb_wiredTiger_cache_bytes_written_from_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1317          "interval": "",
1318          "legendFormat": "{{hostname}}:{{process_port}}",
1319          "refId": "A",
1320          "datasource": {
1321            "type": "prometheus",
1322            "uid": "${DS_THANOS}"
1323          }
1324        }
1325      ],
1326      "thresholds": [],
1327      "timeRegions": [],
1328      "title": "Cache Activity - Write From",
1329      "tooltip": {
1330        "shared": true,
1331        "sort": 0,
1332        "value_type": "individual"
1333      },
1334      "type": "graph",
1335      "xaxis": {
1336        "mode": "time",
1337        "show": true,
1338        "values": []
1339      },
1340      "yaxes": [
1341        {
1342          "format": "Bps",
1343          "logBase": 1,
1344          "show": true
1345        },
1346        {
1347          "format": "short",
1348          "logBase": 1,
1349          "show": true
1350        }
1351      ],
1352      "yaxis": {
1353        "align": false
1354      }
1355    },
1356    {
1357      "aliasColors": {},
1358      "bars": false,
1359      "dashLength": 10,
1360      "dashes": false,
1361      "datasource": {
1362        "type": "prometheus",
1363        "uid": "${DS_THANOS}"
1364      },
1365      "description": "The number of bytes currently in the WiredTiger cache.",
1366      "fieldConfig": {
1367        "defaults": {
1368          "links": [],
1369          "unit": "bytes"
1370        },
1371        "overrides": []
1372      },
1373      "fill": 1,
1374      "fillGradient": 0,
1375      "gridPos": {
1376        "h": 8,
1377        "w": 6,
1378        "x": 12,
1379        "y": 30
1380      },
1381      "hiddenSeries": false,
1382      "id": 79,
1383      "legend": {
1384        "avg": false,
1385        "current": false,
1386        "max": false,
1387        "min": false,
1388        "show": true,
1389        "total": false,
1390        "values": false
1391      },
1392      "lines": true,
1393      "linewidth": 1,
1394      "nullPointMode": "null",
1395      "options": {
1396        "alertThreshold": true,
1397        "legend": {
1398          "calcs": [],
1399          "displayMode": "list",
1400          "placement": "bottom"
1401        },
1402        "tooltip": {
1403          "mode": "single"
1404        }
1405      },
1406      "percentage": false,
1407      "pluginVersion": "8.5.6",
1408      "pointradius": 2,
1409      "points": false,
1410      "renderer": "flot",
1411      "seriesOverrides": [],
1412      "spaceLength": 10,
1413      "stack": false,
1414      "steppedLine": false,
1415      "targets": [
1416        {
1417          "exemplar": true,
1418          "expr": "label_replace(sum(mongodb_wiredTiger_cache_bytes_currently_in_the_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1419          "interval": "",
1420          "legendFormat": "{{hostname}}:{{process_port}}",
1421          "refId": "A",
1422          "datasource": {
1423            "type": "prometheus",
1424            "uid": "${DS_THANOS}"
1425          }
1426        }
1427      ],
1428      "thresholds": [],
1429      "timeRegions": [],
1430      "title": "Cache Usage - Used",
1431      "tooltip": {
1432        "shared": true,
1433        "sort": 0,
1434        "value_type": "individual"
1435      },
1436      "type": "graph",
1437      "xaxis": {
1438        "mode": "time",
1439        "show": true,
1440        "values": []
1441      },
1442      "yaxes": [
1443        {
1444          "format": "bytes",
1445          "logBase": 1,
1446          "show": true
1447        },
1448        {
1449          "format": "short",
1450          "logBase": 1,
1451          "show": true
1452        }
1453      ],
1454      "yaxis": {
1455        "align": false
1456      }
1457    },
1458    {
1459      "aliasColors": {},
1460      "bars": false,
1461      "dashLength": 10,
1462      "dashes": false,
1463      "datasource": {
1464        "type": "prometheus",
1465        "uid": "${DS_THANOS}"
1466      },
1467      "description": "The number of tracked dirty bytes currently in the WiredTiger cache.",
1468      "fieldConfig": {
1469        "defaults": {
1470          "links": [],
1471          "unit": "bytes"
1472        },
1473        "overrides": []
1474      },
1475      "fill": 1,
1476      "fillGradient": 0,
1477      "gridPos": {
1478        "h": 8,
1479        "w": 6,
1480        "x": 18,
1481        "y": 30
1482      },
1483      "hiddenSeries": false,
1484      "id": 80,
1485      "legend": {
1486        "avg": false,
1487        "current": false,
1488        "max": false,
1489        "min": false,
1490        "show": true,
1491        "total": false,
1492        "values": false
1493      },
1494      "lines": true,
1495      "linewidth": 1,
1496      "nullPointMode": "null",
1497      "options": {
1498        "alertThreshold": true,
1499        "legend": {
1500          "calcs": [],
1501          "displayMode": "list",
1502          "placement": "bottom"
1503        },
1504        "tooltip": {
1505          "mode": "single"
1506        }
1507      },
1508      "percentage": false,
1509      "pluginVersion": "8.5.6",
1510      "pointradius": 2,
1511      "points": false,
1512      "renderer": "flot",
1513      "seriesOverrides": [],
1514      "spaceLength": 10,
1515      "stack": false,
1516      "steppedLine": false,
1517      "targets": [
1518        {
1519          "exemplar": true,
1520          "expr": "label_replace(sum(mongodb_wiredTiger_cache_tracked_dirty_bytes_in_the_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1521          "interval": "",
1522          "legendFormat": "{{hostname}}:{{process_port}}",
1523          "refId": "A",
1524          "datasource": {
1525            "type": "prometheus",
1526            "uid": "${DS_THANOS}"
1527          }
1528        }
1529      ],
1530      "thresholds": [],
1531      "timeRegions": [],
1532      "title": "Cache Usage - Dirty",
1533      "tooltip": {
1534        "shared": true,
1535        "sort": 0,
1536        "value_type": "individual"
1537      },
1538      "type": "graph",
1539      "xaxis": {
1540        "mode": "time",
1541        "show": true,
1542        "values": []
1543      },
1544      "yaxes": [
1545        {
1546          "format": "bytes",
1547          "logBase": 1,
1548          "show": true
1549        },
1550        {
1551          "format": "short",
1552          "logBase": 1,
1553          "show": true
1554        }
1555      ],
1556      "yaxis": {
1557        "align": false
1558      }
1559    },
1560    {
1561      "collapsed": false,
1562      "datasource": {
1563        "type": "prometheus",
1564        "uid": "000000010"
1565      },
1566      "gridPos": {
1567        "h": 1,
1568        "w": 24,
1569        "x": 0,
1570        "y": 38
1571      },
1572      "id": 28,
1573      "panels": [],
1574      "title": "Connections",
1575      "type": "row"
1576    },
1577    {
1578      "aliasColors": {},
1579      "bars": false,
1580      "dashLength": 10,
1581      "dashes": false,
1582      "datasource": {
1583        "type": "prometheus",
1584        "uid": "${DS_THANOS}"
1585      },
1586      "description": "The number of currently active connections to this server. A stack is allocated per connection; thus very many connections can result in significant RAM usage.",
1587      "fieldConfig": {
1588        "defaults": {
1589          "links": [],
1590          "unit": "none"
1591        },
1592        "overrides": []
1593      },
1594      "fill": 1,
1595      "fillGradient": 0,
1596      "gridPos": {
1597        "h": 9,
1598        "w": 24,
1599        "x": 0,
1600        "y": 39
1601      },
1602      "hiddenSeries": false,
1603      "id": 81,
1604      "legend": {
1605        "avg": false,
1606        "current": false,
1607        "max": false,
1608        "min": false,
1609        "show": true,
1610        "total": false,
1611        "values": false
1612      },
1613      "lines": true,
1614      "linewidth": 1,
1615      "nullPointMode": "null",
1616      "options": {
1617        "alertThreshold": true,
1618        "legend": {
1619          "calcs": [],
1620          "displayMode": "list",
1621          "placement": "bottom"
1622        },
1623        "tooltip": {
1624          "mode": "single"
1625        }
1626      },
1627      "percentage": false,
1628      "pluginVersion": "8.5.6",
1629      "pointradius": 2,
1630      "points": false,
1631      "renderer": "flot",
1632      "seriesOverrides": [],
1633      "spaceLength": 10,
1634      "stack": false,
1635      "steppedLine": false,
1636      "targets": [
1637        {
1638          "exemplar": true,
1639          "expr": "label_replace(sum(mongodb_connections_current{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1640          "interval": "",
1641          "legendFormat": "{{hostname}}:{{process_port}}",
1642          "refId": "A",
1643          "datasource": {
1644            "type": "prometheus",
1645            "uid": "${DS_THANOS}"
1646          }
1647        }
1648      ],
1649      "thresholds": [],
1650      "timeRegions": [],
1651      "title": "Connections - Current",
1652      "tooltip": {
1653        "shared": true,
1654        "sort": 0,
1655        "value_type": "individual"
1656      },
1657      "type": "graph",
1658      "xaxis": {
1659        "mode": "time",
1660        "show": true,
1661        "values": []
1662      },
1663      "yaxes": [
1664        {
1665          "format": "none",
1666          "logBase": 1,
1667          "show": true
1668        },
1669        {
1670          "format": "short",
1671          "logBase": 1,
1672          "show": true
1673        }
1674      ],
1675      "yaxis": {
1676        "align": false
1677      }
1678    },
1679    {
1680      "collapsed": false,
1681      "datasource": {
1682        "type": "prometheus",
1683        "uid": "000000010"
1684      },
1685      "gridPos": {
1686        "h": 1,
1687        "w": 24,
1688        "x": 0,
1689        "y": 48
1690      },
1691      "id": 30,
1692      "panels": [],
1693      "title": "Cursors",
1694      "type": "row"
1695    },
1696    {
1697      "aliasColors": {},
1698      "bars": false,
1699      "dashLength": 10,
1700      "dashes": false,
1701      "datasource": {
1702        "type": "prometheus",
1703        "uid": "${DS_THANOS}"
1704      },
1705      "description": "The number of cursors that the server is maintaining for clients. Because MongoDB exhausts unused cursors, typically this value is small or zero. However, if there is a queue, stale tailable cursors, or a large number of operations this value may rise.",
1706      "fieldConfig": {
1707        "defaults": {
1708          "links": [],
1709          "unit": "none"
1710        },
1711        "overrides": []
1712      },
1713      "fill": 1,
1714      "fillGradient": 0,
1715      "gridPos": {
1716        "h": 8,
1717        "w": 13,
1718        "x": 0,
1719        "y": 49
1720      },
1721      "hiddenSeries": false,
1722      "id": 82,
1723      "legend": {
1724        "avg": false,
1725        "current": false,
1726        "max": false,
1727        "min": false,
1728        "show": true,
1729        "total": false,
1730        "values": false
1731      },
1732      "lines": true,
1733      "linewidth": 1,
1734      "nullPointMode": "null",
1735      "options": {
1736        "alertThreshold": true,
1737        "legend": {
1738          "calcs": [],
1739          "displayMode": "list",
1740          "placement": "bottom"
1741        },
1742        "tooltip": {
1743          "mode": "single"
1744        }
1745      },
1746      "percentage": false,
1747      "pluginVersion": "8.5.6",
1748      "pointradius": 2,
1749      "points": false,
1750      "renderer": "flot",
1751      "seriesOverrides": [],
1752      "spaceLength": 10,
1753      "stack": false,
1754      "steppedLine": false,
1755      "targets": [
1756        {
1757          "exemplar": true,
1758          "expr": "label_replace(sum(mongodb_metrics_cursor_open_total{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1759          "interval": "",
1760          "legendFormat": "{{hostname}}:{{process_port}}",
1761          "refId": "A",
1762          "datasource": {
1763            "type": "prometheus",
1764            "uid": "${DS_THANOS}"
1765          }
1766        }
1767      ],
1768      "thresholds": [],
1769      "timeRegions": [],
1770      "title": "Cursors - Total Open",
1771      "tooltip": {
1772        "shared": true,
1773        "sort": 0,
1774        "value_type": "individual"
1775      },
1776      "type": "graph",
1777      "xaxis": {
1778        "mode": "time",
1779        "show": true,
1780        "values": []
1781      },
1782      "yaxes": [
1783        {
1784          "format": "none",
1785          "logBase": 1,
1786          "show": true
1787        },
1788        {
1789          "format": "short",
1790          "logBase": 1,
1791          "show": true
1792        }
1793      ],
1794      "yaxis": {
1795        "align": false
1796      }
1797    },
1798    {
1799      "aliasColors": {},
1800      "bars": false,
1801      "dashLength": 10,
1802      "dashes": false,
1803      "datasource": {
1804        "type": "prometheus",
1805        "uid": "${DS_THANOS}"
1806      },
1807      "description": "The average rate of cursors that have timed out per second over the selected sample period",
1808      "fieldConfig": {
1809        "defaults": {
1810          "links": [],
1811          "unit": "none"
1812        },
1813        "overrides": []
1814      },
1815      "fill": 1,
1816      "fillGradient": 0,
1817      "gridPos": {
1818        "h": 8,
1819        "w": 11,
1820        "x": 13,
1821        "y": 49
1822      },
1823      "hiddenSeries": false,
1824      "id": 83,
1825      "legend": {
1826        "avg": false,
1827        "current": false,
1828        "max": false,
1829        "min": false,
1830        "show": true,
1831        "total": false,
1832        "values": false
1833      },
1834      "lines": true,
1835      "linewidth": 1,
1836      "nullPointMode": "null",
1837      "options": {
1838        "alertThreshold": true,
1839        "legend": {
1840          "calcs": [],
1841          "displayMode": "list",
1842          "placement": "bottom"
1843        },
1844        "tooltip": {
1845          "mode": "single"
1846        }
1847      },
1848      "percentage": false,
1849      "pluginVersion": "8.5.6",
1850      "pointradius": 2,
1851      "points": false,
1852      "renderer": "flot",
1853      "seriesOverrides": [],
1854      "spaceLength": 10,
1855      "stack": false,
1856      "steppedLine": false,
1857      "targets": [
1858        {
1859          "exemplar": true,
1860          "expr": "label_replace(sum(mongodb_metrics_cursor_timedOut{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1861          "interval": "",
1862          "legendFormat": "{{hostname}}:{{process_port}}",
1863          "refId": "A",
1864          "datasource": {
1865            "type": "prometheus",
1866            "uid": "${DS_THANOS}"
1867          }
1868        }
1869      ],
1870      "thresholds": [],
1871      "timeRegions": [],
1872      "title": "Cursors - Timed Out",
1873      "tooltip": {
1874        "shared": true,
1875        "sort": 0,
1876        "value_type": "individual"
1877      },
1878      "type": "graph",
1879      "xaxis": {
1880        "mode": "time",
1881        "show": true,
1882        "values": []
1883      },
1884      "yaxes": [
1885        {
1886          "format": "none",
1887          "logBase": 1,
1888          "show": true
1889        },
1890        {
1891          "format": "short",
1892          "logBase": 1,
1893          "show": true
1894        }
1895      ],
1896      "yaxis": {
1897        "align": false
1898      }
1899    },
1900    {
1901      "collapsed": false,
1902      "datasource": {
1903        "type": "prometheus",
1904        "uid": "000000010"
1905      },
1906      "gridPos": {
1907        "h": 1,
1908        "w": 24,
1909        "x": 0,
1910        "y": 57
1911      },
1912      "id": 32,
1913      "panels": [],
1914      "title": "Document Metrics",
1915      "type": "row"
1916    },
1917    {
1918      "aliasColors": {},
1919      "bars": false,
1920      "dashLength": 10,
1921      "dashes": false,
1922      "datasource": {
1923        "type": "prometheus",
1924        "uid": "${DS_THANOS}"
1925      },
1926      "description": "The average rate per second of documents returned by queries over the selected sample period.",
1927      "fieldConfig": {
1928        "defaults": {
1929          "links": [],
1930          "unit": "/s"
1931        },
1932        "overrides": []
1933      },
1934      "fill": 1,
1935      "fillGradient": 0,
1936      "gridPos": {
1937        "h": 8,
1938        "w": 6,
1939        "x": 0,
1940        "y": 58
1941      },
1942      "hiddenSeries": false,
1943      "id": 84,
1944      "legend": {
1945        "avg": false,
1946        "current": false,
1947        "max": false,
1948        "min": false,
1949        "show": true,
1950        "total": false,
1951        "values": false
1952      },
1953      "lines": true,
1954      "linewidth": 1,
1955      "nullPointMode": "null",
1956      "options": {
1957        "alertThreshold": true,
1958        "legend": {
1959          "calcs": [],
1960          "displayMode": "list",
1961          "placement": "bottom"
1962        },
1963        "tooltip": {
1964          "mode": "single"
1965        }
1966      },
1967      "percentage": false,
1968      "pluginVersion": "8.5.6",
1969      "pointradius": 2,
1970      "points": false,
1971      "renderer": "flot",
1972      "seriesOverrides": [],
1973      "spaceLength": 10,
1974      "stack": false,
1975      "steppedLine": false,
1976      "targets": [
1977        {
1978          "exemplar": true,
1979          "expr": "label_replace(sum(irate(mongodb_metrics_document_returned{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1980          "interval": "",
1981          "legendFormat": "{{hostname}}:{{process_port}}",
1982          "refId": "A",
1983          "datasource": {
1984            "type": "prometheus",
1985            "uid": "${DS_THANOS}"
1986          }
1987        }
1988      ],
1989      "thresholds": [],
1990      "timeRegions": [],
1991      "title": "Document Metrics - Returned",
1992      "tooltip": {
1993        "shared": true,
1994        "sort": 0,
1995        "value_type": "individual"
1996      },
1997      "type": "graph",
1998      "xaxis": {
1999        "mode": "time",
2000        "show": true,
2001        "values": []
2002      },
2003      "yaxes": [
2004        {
2005          "format": "/s",
2006          "logBase": 1,
2007          "show": true
2008        },
2009        {
2010          "format": "short",
2011          "logBase": 1,
2012          "show": true
2013        }
2014      ],
2015      "yaxis": {
2016        "align": false
2017      }
2018    },
2019    {
2020      "aliasColors": {},
2021      "bars": false,
2022      "dashLength": 10,
2023      "dashes": false,
2024      "datasource": {
2025        "type": "prometheus",
2026        "uid": "${DS_THANOS}"
2027      },
2028      "description": "The average rate per second of documents inserted over the selected sample period.",
2029      "fieldConfig": {
2030        "defaults": {
2031          "links": [],
2032          "unit": "/s"
2033        },
2034        "overrides": []
2035      },
2036      "fill": 1,
2037      "fillGradient": 0,
2038      "gridPos": {
2039        "h": 8,
2040        "w": 6,
2041        "x": 6,
2042        "y": 58
2043      },
2044      "hiddenSeries": false,
2045      "id": 87,
2046      "legend": {
2047        "avg": false,
2048        "current": false,
2049        "max": false,
2050        "min": false,
2051        "show": true,
2052        "total": false,
2053        "values": false
2054      },
2055      "lines": true,
2056      "linewidth": 1,
2057      "nullPointMode": "null",
2058      "options": {
2059        "alertThreshold": true,
2060        "legend": {
2061          "calcs": [],
2062          "displayMode": "list",
2063          "placement": "bottom"
2064        },
2065        "tooltip": {
2066          "mode": "single"
2067        }
2068      },
2069      "percentage": false,
2070      "pluginVersion": "8.5.6",
2071      "pointradius": 2,
2072      "points": false,
2073      "renderer": "flot",
2074      "seriesOverrides": [],
2075      "spaceLength": 10,
2076      "stack": false,
2077      "steppedLine": false,
2078      "targets": [
2079        {
2080          "exemplar": true,
2081          "expr": "label_replace(sum(irate(mongodb_metrics_document_inserted{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2082          "interval": "",
2083          "legendFormat": "{{hostname}}:{{process_port}}",
2084          "refId": "A",
2085          "datasource": {
2086            "type": "prometheus",
2087            "uid": "${DS_THANOS}"
2088          }
2089        }
2090      ],
2091      "thresholds": [],
2092      "timeRegions": [],
2093      "title": "Document Metrics - Inserted",
2094      "tooltip": {
2095        "shared": true,
2096        "sort": 0,
2097        "value_type": "individual"
2098      },
2099      "type": "graph",
2100      "xaxis": {
2101        "mode": "time",
2102        "show": true,
2103        "values": []
2104      },
2105      "yaxes": [
2106        {
2107          "format": "/s",
2108          "logBase": 1,
2109          "show": true
2110        },
2111        {
2112          "format": "short",
2113          "logBase": 1,
2114          "show": true
2115        }
2116      ],
2117      "yaxis": {
2118        "align": false
2119      }
2120    },
2121    {
2122      "aliasColors": {},
2123      "bars": false,
2124      "dashLength": 10,
2125      "dashes": false,
2126      "datasource": {
2127        "type": "prometheus",
2128        "uid": "${DS_THANOS}"
2129      },
2130      "description": "The average rate per second of documents updated over the selected sample period.",
2131      "fieldConfig": {
2132        "defaults": {
2133          "links": [],
2134          "unit": "/s"
2135        },
2136        "overrides": []
2137      },
2138      "fill": 1,
2139      "fillGradient": 0,
2140      "gridPos": {
2141        "h": 8,
2142        "w": 6,
2143        "x": 12,
2144        "y": 58
2145      },
2146      "hiddenSeries": false,
2147      "id": 86,
2148      "legend": {
2149        "avg": false,
2150        "current": false,
2151        "max": false,
2152        "min": false,
2153        "show": true,
2154        "total": false,
2155        "values": false
2156      },
2157      "lines": true,
2158      "linewidth": 1,
2159      "nullPointMode": "null",
2160      "options": {
2161        "alertThreshold": true,
2162        "legend": {
2163          "calcs": [],
2164          "displayMode": "list",
2165          "placement": "bottom"
2166        },
2167        "tooltip": {
2168          "mode": "single"
2169        }
2170      },
2171      "percentage": false,
2172      "pluginVersion": "8.5.6",
2173      "pointradius": 2,
2174      "points": false,
2175      "renderer": "flot",
2176      "seriesOverrides": [],
2177      "spaceLength": 10,
2178      "stack": false,
2179      "steppedLine": false,
2180      "targets": [
2181        {
2182          "exemplar": true,
2183          "expr": "label_replace(sum(irate(mongodb_metrics_document_updated{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2184          "interval": "",
2185          "legendFormat": "{{hostname}}:{{process_port}}",
2186          "refId": "A",
2187          "datasource": {
2188            "type": "prometheus",
2189            "uid": "${DS_THANOS}"
2190          }
2191        }
2192      ],
2193      "thresholds": [],
2194      "timeRegions": [],
2195      "title": "Document Metrics - Updated",
2196      "tooltip": {
2197        "shared": true,
2198        "sort": 0,
2199        "value_type": "individual"
2200      },
2201      "type": "graph",
2202      "xaxis": {
2203        "mode": "time",
2204        "show": true,
2205        "values": []
2206      },
2207      "yaxes": [
2208        {
2209          "format": "/s",
2210          "logBase": 1,
2211          "show": true
2212        },
2213        {
2214          "format": "short",
2215          "logBase": 1,
2216          "show": true
2217        }
2218      ],
2219      "yaxis": {
2220        "align": false
2221      }
2222    },
2223    {
2224      "aliasColors": {},
2225      "bars": false,
2226      "dashLength": 10,
2227      "dashes": false,
2228      "datasource": {
2229        "type": "prometheus",
2230        "uid": "${DS_THANOS}"
2231      },
2232      "description": "The average rate per second of documents deleted over the selected sample period.",
2233      "fieldConfig": {
2234        "defaults": {
2235          "links": [],
2236          "unit": "/s"
2237        },
2238        "overrides": []
2239      },
2240      "fill": 1,
2241      "fillGradient": 0,
2242      "gridPos": {
2243        "h": 8,
2244        "w": 6,
2245        "x": 18,
2246        "y": 58
2247      },
2248      "hiddenSeries": false,
2249      "id": 85,
2250      "legend": {
2251        "avg": false,
2252        "current": false,
2253        "max": false,
2254        "min": false,
2255        "show": true,
2256        "total": false,
2257        "values": false
2258      },
2259      "lines": true,
2260      "linewidth": 1,
2261      "nullPointMode": "null",
2262      "options": {
2263        "alertThreshold": true,
2264        "legend": {
2265          "calcs": [],
2266          "displayMode": "list",
2267          "placement": "bottom"
2268        },
2269        "tooltip": {
2270          "mode": "single"
2271        }
2272      },
2273      "percentage": false,
2274      "pluginVersion": "8.5.6",
2275      "pointradius": 2,
2276      "points": false,
2277      "renderer": "flot",
2278      "seriesOverrides": [],
2279      "spaceLength": 10,
2280      "stack": false,
2281      "steppedLine": false,
2282      "targets": [
2283        {
2284          "exemplar": true,
2285          "expr": "label_replace(sum(irate(mongodb_metrics_document_deleted{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2286          "interval": "",
2287          "legendFormat": "{{hostname}}:{{process_port}}",
2288          "refId": "A",
2289          "datasource": {
2290            "type": "prometheus",
2291            "uid": "${DS_THANOS}"
2292          }
2293        }
2294      ],
2295      "thresholds": [],
2296      "timeRegions": [],
2297      "title": "Document Metrics - Deleted",
2298      "tooltip": {
2299        "shared": true,
2300        "sort": 0,
2301        "value_type": "individual"
2302      },
2303      "type": "graph",
2304      "xaxis": {
2305        "mode": "time",
2306        "show": true,
2307        "values": []
2308      },
2309      "yaxes": [
2310        {
2311          "format": "/s",
2312          "logBase": 1,
2313          "show": true
2314        },
2315        {
2316          "format": "short",
2317          "logBase": 1,
2318          "show": true
2319        }
2320      ],
2321      "yaxis": {
2322        "align": false
2323      }
2324    },
2325    {
2326      "collapsed": false,
2327      "datasource": {
2328        "type": "prometheus",
2329        "uid": "000000010"
2330      },
2331      "gridPos": {
2332        "h": 1,
2333        "w": 24,
2334        "x": 0,
2335        "y": 66
2336      },
2337      "id": 69,
2338      "panels": [],
2339      "title": "Network",
2340      "type": "row"
2341    },
2342    {
2343      "aliasColors": {},
2344      "bars": false,
2345      "dashLength": 10,
2346      "dashes": false,
2347      "datasource": {
2348        "type": "prometheus",
2349        "uid": "${DS_THANOS}"
2350      },
2351      "description": "The average rate of requests sent to this database server per second over the selected sample period",
2352      "fieldConfig": {
2353        "defaults": {
2354          "links": [],
2355          "unit": "/s"
2356        },
2357        "overrides": []
2358      },
2359      "fill": 1,
2360      "fillGradient": 0,
2361      "gridPos": {
2362        "h": 8,
2363        "w": 8,
2364        "x": 0,
2365        "y": 67
2366      },
2367      "hiddenSeries": false,
2368      "id": 88,
2369      "legend": {
2370        "avg": false,
2371        "current": false,
2372        "max": false,
2373        "min": false,
2374        "show": true,
2375        "total": false,
2376        "values": false
2377      },
2378      "lines": true,
2379      "linewidth": 1,
2380      "nullPointMode": "null",
2381      "options": {
2382        "alertThreshold": true,
2383        "legend": {
2384          "calcs": [],
2385          "displayMode": "list",
2386          "placement": "bottom"
2387        },
2388        "tooltip": {
2389          "mode": "single"
2390        }
2391      },
2392      "percentage": false,
2393      "pluginVersion": "8.5.6",
2394      "pointradius": 2,
2395      "points": false,
2396      "renderer": "flot",
2397      "seriesOverrides": [],
2398      "spaceLength": 10,
2399      "stack": false,
2400      "steppedLine": false,
2401      "targets": [
2402        {
2403          "exemplar": true,
2404          "expr": "label_replace(sum(irate(mongodb_network_numRequests{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2405          "interval": "",
2406          "legendFormat": "{{hostname}}:{{process_port}}",
2407          "refId": "A",
2408          "datasource": {
2409            "type": "prometheus",
2410            "uid": "${DS_THANOS}"
2411          }
2412        }
2413      ],
2414      "thresholds": [],
2415      "timeRegions": [],
2416      "title": "Network - Num Requests",
2417      "tooltip": {
2418        "shared": true,
2419        "sort": 0,
2420        "value_type": "individual"
2421      },
2422      "type": "graph",
2423      "xaxis": {
2424        "mode": "time",
2425        "show": true,
2426        "values": []
2427      },
2428      "yaxes": [
2429        {
2430          "format": "/s",
2431          "logBase": 1,
2432          "show": true
2433        },
2434        {
2435          "format": "short",
2436          "logBase": 1,
2437          "show": true
2438        }
2439      ],
2440      "yaxis": {
2441        "align": false
2442      }
2443    },
2444    {
2445      "aliasColors": {},
2446      "bars": false,
2447      "dashLength": 10,
2448      "dashes": false,
2449      "datasource": {
2450        "type": "prometheus",
2451        "uid": "${DS_THANOS}"
2452      },
2453      "description": "The average rate of physical (after any wire compression) bytes sent to this database server per second over the selected sample period",
2454      "fieldConfig": {
2455        "defaults": {
2456          "links": [],
2457          "unit": "binBps"
2458        },
2459        "overrides": []
2460      },
2461      "fill": 1,
2462      "fillGradient": 0,
2463      "gridPos": {
2464        "h": 8,
2465        "w": 16,
2466        "x": 8,
2467        "y": 67
2468      },
2469      "hiddenSeries": false,
2470      "id": 90,
2471      "legend": {
2472        "avg": false,
2473        "current": false,
2474        "max": false,
2475        "min": false,
2476        "show": true,
2477        "total": false,
2478        "values": false
2479      },
2480      "lines": true,
2481      "linewidth": 1,
2482      "nullPointMode": "null",
2483      "options": {
2484        "alertThreshold": true,
2485        "legend": {
2486          "calcs": [],
2487          "displayMode": "list",
2488          "placement": "bottom"
2489        },
2490        "tooltip": {
2491          "mode": "single"
2492        }
2493      },
2494      "percentage": false,
2495      "pluginVersion": "8.5.6",
2496      "pointradius": 2,
2497      "points": false,
2498      "renderer": "flot",
2499      "seriesOverrides": [],
2500      "spaceLength": 10,
2501      "stack": false,
2502      "steppedLine": false,
2503      "targets": [
2504        {
2505          "exemplar": true,
2506          "expr": "label_replace(sum(irate(mongodb_network_bytesIn{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2507          "interval": "",
2508          "legendFormat": "rx - {{hostname}}:{{process_port}}",
2509          "refId": "A",
2510          "datasource": {
2511            "type": "prometheus",
2512            "uid": "${DS_THANOS}"
2513          }
2514        },
2515        {
2516          "expr": "label_replace(-1 * sum(irate(mongodb_network_bytesOut{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2517          "legendFormat": "tx - {{hostname}}:{{process_port}}",
2518          "refId": "B",
2519          "datasource": {
2520            "type": "prometheus",
2521            "uid": "${DS_THANOS}"
2522          }
2523        }
2524      ],
2525      "thresholds": [],
2526      "timeRegions": [],
2527      "title": "Network - Bytes In",
2528      "tooltip": {
2529        "shared": true,
2530        "sort": 0,
2531        "value_type": "individual"
2532      },
2533      "type": "graph",
2534      "xaxis": {
2535        "mode": "time",
2536        "show": true,
2537        "values": []
2538      },
2539      "yaxes": [
2540        {
2541          "format": "binBps",
2542          "logBase": 1,
2543          "show": true
2544        },
2545        {
2546          "format": "short",
2547          "logBase": 1,
2548          "show": true
2549        }
2550      ],
2551      "yaxis": {
2552        "align": false
2553      }
2554    },
2555    {
2556      "collapsed": false,
2557      "datasource": {
2558        "type": "prometheus",
2559        "uid": "000000010"
2560      },
2561      "gridPos": {
2562        "h": 1,
2563        "w": 24,
2564        "x": 0,
2565        "y": 75
2566      },
2567      "id": 93,
2568      "panels": [],
2569      "title": "Opcounters",
2570      "type": "row"
2571    },
2572    {
2573      "aliasColors": {},
2574      "bars": false,
2575      "dashLength": 10,
2576      "dashes": false,
2577      "datasource": {
2578        "type": "prometheus",
2579        "uid": "${DS_THANOS}"
2580      },
2581      "description": "The average rate of commands performed per second over the selected sample period",
2582      "fieldConfig": {
2583        "defaults": {
2584          "links": [],
2585          "unit": "/s"
2586        },
2587        "overrides": []
2588      },
2589      "fill": 1,
2590      "fillGradient": 0,
2591      "gridPos": {
2592        "h": 8,
2593        "w": 8,
2594        "x": 0,
2595        "y": 76
2596      },
2597      "hiddenSeries": false,
2598      "id": 96,
2599      "legend": {
2600        "avg": false,
2601        "current": false,
2602        "max": false,
2603        "min": false,
2604        "show": true,
2605        "total": false,
2606        "values": false
2607      },
2608      "lines": true,
2609      "linewidth": 1,
2610      "nullPointMode": "null",
2611      "options": {
2612        "alertThreshold": true,
2613        "legend": {
2614          "calcs": [],
2615          "displayMode": "list",
2616          "placement": "bottom"
2617        },
2618        "tooltip": {
2619          "mode": "single"
2620        }
2621      },
2622      "percentage": false,
2623      "pluginVersion": "8.5.6",
2624      "pointradius": 2,
2625      "points": false,
2626      "renderer": "flot",
2627      "seriesOverrides": [],
2628      "spaceLength": 10,
2629      "stack": false,
2630      "steppedLine": false,
2631      "targets": [
2632        {
2633          "exemplar": true,
2634          "expr": "label_replace(sum(irate(mongodb_opcounters_command{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2635          "interval": "",
2636          "legendFormat": "{{hostname}}:{{process_port}}",
2637          "refId": "A",
2638          "datasource": {
2639            "type": "prometheus",
2640            "uid": "${DS_THANOS}"
2641          }
2642        }
2643      ],
2644      "thresholds": [],
2645      "timeRegions": [],
2646      "title": "Opcounters - Command",
2647      "tooltip": {
2648        "shared": true,
2649        "sort": 0,
2650        "value_type": "individual"
2651      },
2652      "type": "graph",
2653      "xaxis": {
2654        "mode": "time",
2655        "show": true,
2656        "values": []
2657      },
2658      "yaxes": [
2659        {
2660          "format": "/s",
2661          "logBase": 1,
2662          "show": true
2663        },
2664        {
2665          "format": "short",
2666          "logBase": 1,
2667          "show": true
2668        }
2669      ],
2670      "yaxis": {
2671        "align": false
2672      }
2673    },
2674    {
2675      "aliasColors": {},
2676      "bars": false,
2677      "dashLength": 10,
2678      "dashes": false,
2679      "datasource": {
2680        "type": "prometheus",
2681        "uid": "${DS_THANOS}"
2682      },
2683      "description": "The average rate of queries performed per second over the selected sample period",
2684      "fieldConfig": {
2685        "defaults": {
2686          "links": [],
2687          "unit": "/s"
2688        },
2689        "overrides": []
2690      },
2691      "fill": 1,
2692      "fillGradient": 0,
2693      "gridPos": {
2694        "h": 8,
2695        "w": 8,
2696        "x": 8,
2697        "y": 76
2698      },
2699      "hiddenSeries": false,
2700      "id": 101,
2701      "legend": {
2702        "avg": false,
2703        "current": false,
2704        "max": false,
2705        "min": false,
2706        "show": true,
2707        "total": false,
2708        "values": false
2709      },
2710      "lines": true,
2711      "linewidth": 1,
2712      "nullPointMode": "null",
2713      "options": {
2714        "alertThreshold": true,
2715        "legend": {
2716          "calcs": [],
2717          "displayMode": "list",
2718          "placement": "bottom"
2719        },
2720        "tooltip": {
2721          "mode": "single"
2722        }
2723      },
2724      "percentage": false,
2725      "pluginVersion": "8.5.6",
2726      "pointradius": 2,
2727      "points": false,
2728      "renderer": "flot",
2729      "seriesOverrides": [],
2730      "spaceLength": 10,
2731      "stack": false,
2732      "steppedLine": false,
2733      "targets": [
2734        {
2735          "exemplar": true,
2736          "expr": "label_replace(sum(irate(mongodb_opcounters_query{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2737          "interval": "",
2738          "legendFormat": "{{hostname}}:{{process_port}}",
2739          "refId": "A",
2740          "datasource": {
2741            "type": "prometheus",
2742            "uid": "${DS_THANOS}"
2743          }
2744        }
2745      ],
2746      "thresholds": [],
2747      "timeRegions": [],
2748      "title": "Opcounters - Query",
2749      "tooltip": {
2750        "shared": true,
2751        "sort": 0,
2752        "value_type": "individual"
2753      },
2754      "type": "graph",
2755      "xaxis": {
2756        "mode": "time",
2757        "show": true,
2758        "values": []
2759      },
2760      "yaxes": [
2761        {
2762          "format": "/s",
2763          "logBase": 1,
2764          "show": true
2765        },
2766        {
2767          "format": "short",
2768          "logBase": 1,
2769          "show": true
2770        }
2771      ],
2772      "yaxis": {
2773        "align": false
2774      }
2775    },
2776    {
2777      "aliasColors": {},
2778      "bars": false,
2779      "dashLength": 10,
2780      "dashes": false,
2781      "datasource": {
2782        "type": "prometheus",
2783        "uid": "${DS_THANOS}"
2784      },
2785      "description": "The average rate of updates performed per second over the selected sample period",
2786      "fieldConfig": {
2787        "defaults": {
2788          "links": [],
2789          "unit": "/s"
2790        },
2791        "overrides": []
2792      },
2793      "fill": 1,
2794      "fillGradient": 0,
2795      "gridPos": {
2796        "h": 8,
2797        "w": 8,
2798        "x": 16,
2799        "y": 76
2800      },
2801      "hiddenSeries": false,
2802      "id": 100,
2803      "legend": {
2804        "avg": false,
2805        "current": false,
2806        "max": false,
2807        "min": false,
2808        "show": true,
2809        "total": false,
2810        "values": false
2811      },
2812      "lines": true,
2813      "linewidth": 1,
2814      "nullPointMode": "null",
2815      "options": {
2816        "alertThreshold": true,
2817        "legend": {
2818          "calcs": [],
2819          "displayMode": "list",
2820          "placement": "bottom"
2821        },
2822        "tooltip": {
2823          "mode": "single"
2824        }
2825      },
2826      "percentage": false,
2827      "pluginVersion": "8.5.6",
2828      "pointradius": 2,
2829      "points": false,
2830      "renderer": "flot",
2831      "seriesOverrides": [],
2832      "spaceLength": 10,
2833      "stack": false,
2834      "steppedLine": false,
2835      "targets": [
2836        {
2837          "exemplar": true,
2838          "expr": "label_replace(sum(irate(mongodb_opcounters_update{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2839          "interval": "",
2840          "legendFormat": "{{hostname}}:{{process_port}}",
2841          "refId": "A",
2842          "datasource": {
2843            "type": "prometheus",
2844            "uid": "${DS_THANOS}"
2845          }
2846        }
2847      ],
2848      "thresholds": [],
2849      "timeRegions": [],
2850      "title": "Opcounters - Update",
2851      "tooltip": {
2852        "shared": true,
2853        "sort": 0,
2854        "value_type": "individual"
2855      },
2856      "type": "graph",
2857      "xaxis": {
2858        "mode": "time",
2859        "show": true,
2860        "values": []
2861      },
2862      "yaxes": [
2863        {
2864          "format": "/s",
2865          "logBase": 1,
2866          "show": true
2867        },
2868        {
2869          "format": "short",
2870          "logBase": 1,
2871          "show": true
2872        }
2873      ],
2874      "yaxis": {
2875        "align": false
2876      }
2877    },
2878    {
2879      "aliasColors": {},
2880      "bars": false,
2881      "dashLength": 10,
2882      "dashes": false,
2883      "datasource": {
2884        "type": "prometheus",
2885        "uid": "${DS_THANOS}"
2886      },
2887      "description": "The average rate of deletes performed per second over the selected sample period",
2888      "fieldConfig": {
2889        "defaults": {
2890          "links": [],
2891          "unit": "/s"
2892        },
2893        "overrides": []
2894      },
2895      "fill": 1,
2896      "fillGradient": 0,
2897      "gridPos": {
2898        "h": 8,
2899        "w": 8,
2900        "x": 0,
2901        "y": 84
2902      },
2903      "hiddenSeries": false,
2904      "id": 99,
2905      "legend": {
2906        "avg": false,
2907        "current": false,
2908        "max": false,
2909        "min": false,
2910        "show": true,
2911        "total": false,
2912        "values": false
2913      },
2914      "lines": true,
2915      "linewidth": 1,
2916      "nullPointMode": "null",
2917      "options": {
2918        "alertThreshold": true,
2919        "legend": {
2920          "calcs": [],
2921          "displayMode": "list",
2922          "placement": "bottom"
2923        },
2924        "tooltip": {
2925          "mode": "single"
2926        }
2927      },
2928      "percentage": false,
2929      "pluginVersion": "8.5.6",
2930      "pointradius": 2,
2931      "points": false,
2932      "renderer": "flot",
2933      "seriesOverrides": [],
2934      "spaceLength": 10,
2935      "stack": false,
2936      "steppedLine": false,
2937      "targets": [
2938        {
2939          "exemplar": true,
2940          "expr": "label_replace(sum(irate(mongodb_opcounters_delete{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2941          "interval": "",
2942          "legendFormat": "{{hostname}}:{{process_port}}",
2943          "refId": "A",
2944          "datasource": {
2945            "type": "prometheus",
2946            "uid": "${DS_THANOS}"
2947          }
2948        }
2949      ],
2950      "thresholds": [],
2951      "timeRegions": [],
2952      "title": "Opcounters - Delete",
2953      "tooltip": {
2954        "shared": true,
2955        "sort": 0,
2956        "value_type": "individual"
2957      },
2958      "type": "graph",
2959      "xaxis": {
2960        "mode": "time",
2961        "show": true,
2962        "values": []
2963      },
2964      "yaxes": [
2965        {
2966          "format": "/s",
2967          "logBase": 1,
2968          "show": true
2969        },
2970        {
2971          "format": "short",
2972          "logBase": 1,
2973          "show": true
2974        }
2975      ],
2976      "yaxis": {
2977        "align": false
2978      }
2979    },
2980    {
2981      "aliasColors": {},
2982      "bars": false,
2983      "dashLength": 10,
2984      "dashes": false,
2985      "datasource": {
2986        "type": "prometheus",
2987        "uid": "${DS_THANOS}"
2988      },
2989      "description": "The average rate of getMores performed per second on any cursor over the selected sample period. On a primary, this number can be high even if the query count is low as the secondaries \"getMore\" from the primary often as part of replication.",
2990      "fieldConfig": {
2991        "defaults": {
2992          "links": [],
2993          "unit": "/s"
2994        },
2995        "overrides": []
2996      },
2997      "fill": 1,
2998      "fillGradient": 0,
2999      "gridPos": {
3000        "h": 8,
3001        "w": 8,
3002        "x": 8,
3003        "y": 84
3004      },
3005      "hiddenSeries": false,
3006      "id": 97,
3007      "legend": {
3008        "avg": false,
3009        "current": false,
3010        "max": false,
3011        "min": false,
3012        "show": true,
3013        "total": false,
3014        "values": false
3015      },
3016      "lines": true,
3017      "linewidth": 1,
3018      "nullPointMode": "null",
3019      "options": {
3020        "alertThreshold": true,
3021        "legend": {
3022          "calcs": [],
3023          "displayMode": "list",
3024          "placement": "bottom"
3025        },
3026        "tooltip": {
3027          "mode": "single"
3028        }
3029      },
3030      "percentage": false,
3031      "pluginVersion": "8.5.6",
3032      "pointradius": 2,
3033      "points": false,
3034      "renderer": "flot",
3035      "seriesOverrides": [],
3036      "spaceLength": 10,
3037      "stack": false,
3038      "steppedLine": false,
3039      "targets": [
3040        {
3041          "exemplar": true,
3042          "expr": "label_replace(sum(irate(mongodb_opcounters_getmore{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3043          "interval": "",
3044          "legendFormat": "{{hostname}}:{{process_port}}",
3045          "refId": "A",
3046          "datasource": {
3047            "type": "prometheus",
3048            "uid": "${DS_THANOS}"
3049          }
3050        }
3051      ],
3052      "thresholds": [],
3053      "timeRegions": [],
3054      "title": "Opcounters - Getmore",
3055      "tooltip": {
3056        "shared": true,
3057        "sort": 0,
3058        "value_type": "individual"
3059      },
3060      "type": "graph",
3061      "xaxis": {
3062        "mode": "time",
3063        "show": true,
3064        "values": []
3065      },
3066      "yaxes": [
3067        {
3068          "format": "/s",
3069          "logBase": 1,
3070          "show": true
3071        },
3072        {
3073          "format": "short",
3074          "logBase": 1,
3075          "show": true
3076        }
3077      ],
3078      "yaxis": {
3079        "align": false
3080      }
3081    },
3082    {
3083      "aliasColors": {},
3084      "bars": false,
3085      "dashLength": 10,
3086      "dashes": false,
3087      "datasource": {
3088        "type": "prometheus",
3089        "uid": "${DS_THANOS}"
3090      },
3091      "description": "The average rate of inserts performed per second over the selected sample period",
3092      "fieldConfig": {
3093        "defaults": {
3094          "links": [],
3095          "unit": "/s"
3096        },
3097        "overrides": []
3098      },
3099      "fill": 1,
3100      "fillGradient": 0,
3101      "gridPos": {
3102        "h": 8,
3103        "w": 8,
3104        "x": 16,
3105        "y": 84
3106      },
3107      "hiddenSeries": false,
3108      "id": 98,
3109      "legend": {
3110        "avg": false,
3111        "current": false,
3112        "max": false,
3113        "min": false,
3114        "show": true,
3115        "total": false,
3116        "values": false
3117      },
3118      "lines": true,
3119      "linewidth": 1,
3120      "nullPointMode": "null",
3121      "options": {
3122        "alertThreshold": true,
3123        "legend": {
3124          "calcs": [],
3125          "displayMode": "list",
3126          "placement": "bottom"
3127        },
3128        "tooltip": {
3129          "mode": "single"
3130        }
3131      },
3132      "percentage": false,
3133      "pluginVersion": "8.5.6",
3134      "pointradius": 2,
3135      "points": false,
3136      "renderer": "flot",
3137      "seriesOverrides": [],
3138      "spaceLength": 10,
3139      "stack": false,
3140      "steppedLine": false,
3141      "targets": [
3142        {
3143          "exemplar": true,
3144          "expr": "label_replace(sum(irate(mongodb_opcounters_insert{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3145          "interval": "",
3146          "legendFormat": "{{hostname}}:{{process_port}}",
3147          "refId": "A",
3148          "datasource": {
3149            "type": "prometheus",
3150            "uid": "${DS_THANOS}"
3151          }
3152        }
3153      ],
3154      "thresholds": [],
3155      "timeRegions": [],
3156      "title": "Opcounters - Insert",
3157      "tooltip": {
3158        "shared": true,
3159        "sort": 0,
3160        "value_type": "individual"
3161      },
3162      "type": "graph",
3163      "xaxis": {
3164        "mode": "time",
3165        "show": true,
3166        "values": []
3167      },
3168      "yaxes": [
3169        {
3170          "format": "/s",
3171          "logBase": 1,
3172          "show": true
3173        },
3174        {
3175          "format": "short",
3176          "logBase": 1,
3177          "show": true
3178        }
3179      ],
3180      "yaxis": {
3181        "align": false
3182      }
3183    },
3184    {
3185      "collapsed": false,
3186      "datasource": {
3187        "type": "prometheus",
3188        "uid": "000000010"
3189      },
3190      "gridPos": {
3191        "h": 1,
3192        "w": 24,
3193        "x": 0,
3194        "y": 92
3195      },
3196      "id": 95,
3197      "panels": [],
3198      "title": "Operation Execution Times",
3199      "type": "row"
3200    },
3201    {
3202      "aliasColors": {},
3203      "bars": false,
3204      "dashLength": 10,
3205      "dashes": false,
3206      "datasource": {
3207        "type": "prometheus",
3208        "uid": "${DS_THANOS}"
3209      },
3210      "description": "The average execution time in milliseconds per read operation over the selected sample period.",
3211      "fieldConfig": {
3212        "defaults": {
3213          "links": [],
3214          "unit": "µs"
3215        },
3216        "overrides": []
3217      },
3218      "fill": 1,
3219      "fillGradient": 0,
3220      "gridPos": {
3221        "h": 8,
3222        "w": 8,
3223        "x": 0,
3224        "y": 93
3225      },
3226      "hiddenSeries": false,
3227      "id": 102,
3228      "legend": {
3229        "avg": false,
3230        "current": false,
3231        "max": false,
3232        "min": false,
3233        "show": true,
3234        "total": false,
3235        "values": false
3236      },
3237      "lines": true,
3238      "linewidth": 1,
3239      "nullPointMode": "null",
3240      "options": {
3241        "alertThreshold": true,
3242        "legend": {
3243          "calcs": [],
3244          "displayMode": "list",
3245          "placement": "bottom"
3246        },
3247        "tooltip": {
3248          "mode": "single"
3249        }
3250      },
3251      "percentage": false,
3252      "pluginVersion": "8.5.6",
3253      "pointradius": 2,
3254      "points": false,
3255      "renderer": "flot",
3256      "seriesOverrides": [],
3257      "spaceLength": 10,
3258      "stack": false,
3259      "steppedLine": false,
3260      "targets": [
3261        {
3262          "exemplar": true,
3263          "expr": "label_replace(sum(irate(mongodb_opLatencies_reads_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_reads_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3264          "interval": "",
3265          "legendFormat": "{{hostname}}:{{process_port}}",
3266          "refId": "A",
3267          "datasource": {
3268            "type": "prometheus",
3269            "uid": "${DS_THANOS}"
3270          }
3271        }
3272      ],
3273      "thresholds": [],
3274      "timeRegions": [],
3275      "title": "Operation Execution Times - Avg Ms/Read",
3276      "tooltip": {
3277        "shared": true,
3278        "sort": 0,
3279        "value_type": "individual"
3280      },
3281      "type": "graph",
3282      "xaxis": {
3283        "mode": "time",
3284        "show": true,
3285        "values": []
3286      },
3287      "yaxes": [
3288        {
3289          "format": "µs",
3290          "logBase": 1,
3291          "show": true
3292        },
3293        {
3294          "format": "short",
3295          "logBase": 1,
3296          "show": true
3297        }
3298      ],
3299      "yaxis": {
3300        "align": false
3301      }
3302    },
3303    {
3304      "aliasColors": {},
3305      "bars": false,
3306      "dashLength": 10,
3307      "dashes": false,
3308      "datasource": {
3309        "type": "prometheus",
3310        "uid": "${DS_THANOS}"
3311      },
3312      "description": "The average execution time in milliseconds per write operation over the selected sample period.",
3313      "fieldConfig": {
3314        "defaults": {
3315          "links": [],
3316          "unit": "µs"
3317        },
3318        "overrides": []
3319      },
3320      "fill": 1,
3321      "fillGradient": 0,
3322      "gridPos": {
3323        "h": 8,
3324        "w": 8,
3325        "x": 8,
3326        "y": 93
3327      },
3328      "hiddenSeries": false,
3329      "id": 104,
3330      "legend": {
3331        "avg": false,
3332        "current": false,
3333        "max": false,
3334        "min": false,
3335        "show": true,
3336        "total": false,
3337        "values": false
3338      },
3339      "lines": true,
3340      "linewidth": 1,
3341      "nullPointMode": "null",
3342      "options": {
3343        "alertThreshold": true,
3344        "legend": {
3345          "calcs": [],
3346          "displayMode": "list",
3347          "placement": "bottom"
3348        },
3349        "tooltip": {
3350          "mode": "single"
3351        }
3352      },
3353      "percentage": false,
3354      "pluginVersion": "8.5.6",
3355      "pointradius": 2,
3356      "points": false,
3357      "renderer": "flot",
3358      "seriesOverrides": [],
3359      "spaceLength": 10,
3360      "stack": false,
3361      "steppedLine": false,
3362      "targets": [
3363        {
3364          "exemplar": true,
3365          "expr": "label_replace(sum(irate(mongodb_opLatencies_writes_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_writes_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3366          "interval": "",
3367          "legendFormat": "{{hostname}}:{{process_port}}",
3368          "refId": "A",
3369          "datasource": {
3370            "type": "prometheus",
3371            "uid": "${DS_THANOS}"
3372          }
3373        }
3374      ],
3375      "thresholds": [],
3376      "timeRegions": [],
3377      "title": "Operation Execution Times - Avg Ms/Write",
3378      "tooltip": {
3379        "shared": true,
3380        "sort": 0,
3381        "value_type": "individual"
3382      },
3383      "type": "graph",
3384      "xaxis": {
3385        "mode": "time",
3386        "show": true,
3387        "values": []
3388      },
3389      "yaxes": [
3390        {
3391          "format": "µs",
3392          "logBase": 1,
3393          "show": true
3394        },
3395        {
3396          "format": "short",
3397          "logBase": 1,
3398          "show": true
3399        }
3400      ],
3401      "yaxis": {
3402        "align": false
3403      }
3404    },
3405    {
3406      "aliasColors": {},
3407      "bars": false,
3408      "dashLength": 10,
3409      "dashes": false,
3410      "datasource": {
3411        "type": "prometheus",
3412        "uid": "${DS_THANOS}"
3413      },
3414      "description": "The average execution time in milliseconds per command operation over the selected sample period.",
3415      "fieldConfig": {
3416        "defaults": {
3417          "links": [],
3418          "unit": "µs"
3419        },
3420        "overrides": []
3421      },
3422      "fill": 1,
3423      "fillGradient": 0,
3424      "gridPos": {
3425        "h": 8,
3426        "w": 8,
3427        "x": 16,
3428        "y": 93
3429      },
3430      "hiddenSeries": false,
3431      "id": 103,
3432      "legend": {
3433        "avg": false,
3434        "current": false,
3435        "max": false,
3436        "min": false,
3437        "show": true,
3438        "total": false,
3439        "values": false
3440      },
3441      "lines": true,
3442      "linewidth": 1,
3443      "nullPointMode": "null",
3444      "options": {
3445        "alertThreshold": true,
3446        "legend": {
3447          "calcs": [],
3448          "displayMode": "list",
3449          "placement": "bottom"
3450        },
3451        "tooltip": {
3452          "mode": "single"
3453        }
3454      },
3455      "percentage": false,
3456      "pluginVersion": "8.5.6",
3457      "pointradius": 2,
3458      "points": false,
3459      "renderer": "flot",
3460      "seriesOverrides": [],
3461      "spaceLength": 10,
3462      "stack": false,
3463      "steppedLine": false,
3464      "targets": [
3465        {
3466          "exemplar": true,
3467          "expr": "label_replace(sum(irate(mongodb_opLatencies_commands_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_commands_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3468          "interval": "",
3469          "legendFormat": "{{hostname}}:{{process_port}}",
3470          "refId": "A",
3471          "datasource": {
3472            "type": "prometheus",
3473            "uid": "${DS_THANOS}"
3474          }
3475        }
3476      ],
3477      "thresholds": [],
3478      "timeRegions": [],
3479      "title": "Operation Execution Times - Avg Ms/Command",
3480      "tooltip": {
3481        "shared": true,
3482        "sort": 0,
3483        "value_type": "individual"
3484      },
3485      "type": "graph",
3486      "xaxis": {
3487        "mode": "time",
3488        "show": true,
3489        "values": []
3490      },
3491      "yaxes": [
3492        {
3493          "format": "µs",
3494          "logBase": 1,
3495          "show": true
3496        },
3497        {
3498          "format": "short",
3499          "logBase": 1,
3500          "show": true
3501        }
3502      ],
3503      "yaxis": {
3504        "align": false
3505      }
3506    },
3507    {
3508      "collapsed": false,
3509      "datasource": {
3510        "type": "prometheus",
3511        "uid": "000000010"
3512      },
3513      "gridPos": {
3514        "h": 1,
3515        "w": 24,
3516        "x": 0,
3517        "y": 101
3518      },
3519      "id": 106,
3520      "panels": [],
3521      "title": "Page Faults",
3522      "type": "row"
3523    },
3524    {
3525      "aliasColors": {},
3526      "bars": false,
3527      "dashLength": 10,
3528      "dashes": false,
3529      "datasource": {
3530        "type": "prometheus",
3531        "uid": "${DS_THANOS}"
3532      },
3533      "description": "The average rate of page faults on this process per second over the selected sample period. In non-Windows environments this is hard page faults only.",
3534      "fieldConfig": {
3535        "defaults": {
3536          "links": [],
3537          "unit": "/s"
3538        },
3539        "overrides": []
3540      },
3541      "fill": 1,
3542      "fillGradient": 0,
3543      "gridPos": {
3544        "h": 8,
3545        "w": 24,
3546        "x": 0,
3547        "y": 102
3548      },
3549      "hiddenSeries": false,
3550      "id": 107,
3551      "legend": {
3552        "avg": false,
3553        "current": false,
3554        "max": false,
3555        "min": false,
3556        "show": true,
3557        "total": false,
3558        "values": false
3559      },
3560      "lines": true,
3561      "linewidth": 1,
3562      "nullPointMode": "null",
3563      "options": {
3564        "alertThreshold": true,
3565        "legend": {
3566          "calcs": [],
3567          "displayMode": "list",
3568          "placement": "bottom"
3569        },
3570        "tooltip": {
3571          "mode": "single"
3572        }
3573      },
3574      "percentage": false,
3575      "pluginVersion": "8.5.6",
3576      "pointradius": 2,
3577      "points": false,
3578      "renderer": "flot",
3579      "seriesOverrides": [],
3580      "spaceLength": 10,
3581      "stack": false,
3582      "steppedLine": false,
3583      "targets": [
3584        {
3585          "exemplar": true,
3586          "expr": "label_replace(sum(irate(mongodb_extra_info_page_faults{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3587          "interval": "",
3588          "legendFormat": "{{hostname}}:{{process_port}}",
3589          "refId": "A",
3590          "datasource": {
3591            "type": "prometheus",
3592            "uid": "${DS_THANOS}"
3593          }
3594        }
3595      ],
3596      "thresholds": [],
3597      "timeRegions": [],
3598      "title": "Page Faults",
3599      "tooltip": {
3600        "shared": true,
3601        "sort": 0,
3602        "value_type": "individual"
3603      },
3604      "type": "graph",
3605      "xaxis": {
3606        "mode": "time",
3607        "show": true,
3608        "values": []
3609      },
3610      "yaxes": [
3611        {
3612          "format": "/s",
3613          "logBase": 1,
3614          "show": true
3615        },
3616        {
3617          "format": "short",
3618          "logBase": 1,
3619          "show": true
3620        }
3621      ],
3622      "yaxis": {
3623        "align": false
3624      }
3625    },
3626    {
3627      "collapsed": false,
3628      "datasource": {
3629        "type": "prometheus",
3630        "uid": "000000010"
3631      },
3632      "gridPos": {
3633        "h": 1,
3634        "w": 24,
3635        "x": 0,
3636        "y": 110
3637      },
3638      "id": 111,
3639      "panels": [],
3640      "title": "Query Executor",
3641      "type": "row"
3642    },
3643    {
3644      "aliasColors": {},
3645      "bars": false,
3646      "dashLength": 10,
3647      "dashes": false,
3648      "datasource": {
3649        "type": "prometheus",
3650        "uid": "${DS_THANOS}"
3651      },
3652      "description": "The average rate per second over the selected sample period of index items scanned during queries and query-plan evaluation. This rate is driven by the same value as totalKeysExamined in the output of explain().",
3653      "fieldConfig": {
3654        "defaults": {
3655          "links": [],
3656          "unit": "/s"
3657        },
3658        "overrides": []
3659      },
3660      "fill": 1,
3661      "fillGradient": 0,
3662      "gridPos": {
3663        "h": 8,
3664        "w": 12,
3665        "x": 0,
3666        "y": 111
3667      },
3668      "hiddenSeries": false,
3669      "id": 108,
3670      "legend": {
3671        "avg": false,
3672        "current": false,
3673        "max": false,
3674        "min": false,
3675        "show": true,
3676        "total": false,
3677        "values": false
3678      },
3679      "lines": true,
3680      "linewidth": 1,
3681      "nullPointMode": "null",
3682      "options": {
3683        "alertThreshold": true,
3684        "legend": {
3685          "calcs": [],
3686          "displayMode": "list",
3687          "placement": "bottom"
3688        },
3689        "tooltip": {
3690          "mode": "single"
3691        }
3692      },
3693      "percentage": false,
3694      "pluginVersion": "8.5.6",
3695      "pointradius": 2,
3696      "points": false,
3697      "renderer": "flot",
3698      "seriesOverrides": [],
3699      "spaceLength": 10,
3700      "stack": false,
3701      "steppedLine": false,
3702      "targets": [
3703        {
3704          "exemplar": true,
3705          "expr": "label_replace(sum(irate(mongodb_metrics_queryExecutor_scanned{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3706          "interval": "",
3707          "legendFormat": "{{hostname}}:{{process_port}}",
3708          "refId": "A",
3709          "datasource": {
3710            "type": "prometheus",
3711            "uid": "${DS_THANOS}"
3712          }
3713        }
3714      ],
3715      "thresholds": [],
3716      "timeRegions": [],
3717      "title": "Query Executor - Scanned",
3718      "tooltip": {
3719        "shared": true,
3720        "sort": 0,
3721        "value_type": "individual"
3722      },
3723      "type": "graph",
3724      "xaxis": {
3725        "mode": "time",
3726        "show": true,
3727        "values": []
3728      },
3729      "yaxes": [
3730        {
3731          "format": "/s",
3732          "logBase": 1,
3733          "show": true
3734        },
3735        {
3736          "format": "short",
3737          "logBase": 1,
3738          "show": true
3739        }
3740      ],
3741      "yaxis": {
3742        "align": false
3743      }
3744    },
3745    {
3746      "aliasColors": {},
3747      "bars": false,
3748      "dashLength": 10,
3749      "dashes": false,
3750      "datasource": {
3751        "type": "prometheus",
3752        "uid": "${DS_THANOS}"
3753      },
3754      "description": "The average rate per second over the selected sample period of documents scanned during queries and query-plan evaluation. This rate is driven by the same value as totalDocsExamined in the output of explain().",
3755      "fieldConfig": {
3756        "defaults": {
3757          "links": [],
3758          "unit": "/s"
3759        },
3760        "overrides": []
3761      },
3762      "fill": 1,
3763      "fillGradient": 0,
3764      "gridPos": {
3765        "h": 8,
3766        "w": 12,
3767        "x": 12,
3768        "y": 111
3769      },
3770      "hiddenSeries": false,
3771      "id": 109,
3772      "legend": {
3773        "avg": false,
3774        "current": false,
3775        "max": false,
3776        "min": false,
3777        "show": true,
3778        "total": false,
3779        "values": false
3780      },
3781      "lines": true,
3782      "linewidth": 1,
3783      "nullPointMode": "null",
3784      "options": {
3785        "alertThreshold": true,
3786        "legend": {
3787          "calcs": [],
3788          "displayMode": "list",
3789          "placement": "bottom"
3790        },
3791        "tooltip": {
3792          "mode": "single"
3793        }
3794      },
3795      "percentage": false,
3796      "pluginVersion": "8.5.6",
3797      "pointradius": 2,
3798      "points": false,
3799      "renderer": "flot",
3800      "seriesOverrides": [],
3801      "spaceLength": 10,
3802      "stack": false,
3803      "steppedLine": false,
3804      "targets": [
3805        {
3806          "exemplar": true,
3807          "expr": "label_replace(sum(irate(mongodb_metrics_queryExecutor_scannedObjects{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3808          "interval": "",
3809          "legendFormat": "{{hostname}}:{{process_port}}",
3810          "refId": "A",
3811          "datasource": {
3812            "type": "prometheus",
3813            "uid": "${DS_THANOS}"
3814          }
3815        }
3816      ],
3817      "thresholds": [],
3818      "timeRegions": [],
3819      "title": "Query Executor - Scanned Objects",
3820      "tooltip": {
3821        "shared": true,
3822        "sort": 0,
3823        "value_type": "individual"
3824      },
3825      "type": "graph",
3826      "xaxis": {
3827        "mode": "time",
3828        "show": true,
3829        "values": []
3830      },
3831      "yaxes": [
3832        {
3833          "format": "/s",
3834          "logBase": 1,
3835          "show": true
3836        },
3837        {
3838          "format": "short",
3839          "logBase": 1,
3840          "show": true
3841        }
3842      ],
3843      "yaxis": {
3844        "align": false
3845      }
3846    },
3847    {
3848      "collapsed": false,
3849      "datasource": {
3850        "type": "prometheus",
3851        "uid": "000000010"
3852      },
3853      "gridPos": {
3854        "h": 1,
3855        "w": 24,
3856        "x": 0,
3857        "y": 119
3858      },
3859      "id": 113,
3860      "panels": [],
3861      "title": "Queues",
3862      "type": "row"
3863    },
3864    {
3865      "aliasColors": {},
3866      "bars": false,
3867      "dashLength": 10,
3868      "dashes": false,
3869      "datasource": {
3870        "type": "prometheus",
3871        "uid": "${DS_THANOS}"
3872      },
3873      "description": "The number of operations queued waiting for any lock",
3874      "fieldConfig": {
3875        "defaults": {
3876          "links": [],
3877          "unit": "none"
3878        },
3879        "overrides": []
3880      },
3881      "fill": 1,
3882      "fillGradient": 0,
3883      "gridPos": {
3884        "h": 8,
3885        "w": 8,
3886        "x": 0,
3887        "y": 120
3888      },
3889      "hiddenSeries": false,
3890      "id": 114,
3891      "legend": {
3892        "avg": false,
3893        "current": false,
3894        "max": false,
3895        "min": false,
3896        "show": true,
3897        "total": false,
3898        "values": false
3899      },
3900      "lines": true,
3901      "linewidth": 1,
3902      "nullPointMode": "null",
3903      "options": {
3904        "alertThreshold": true,
3905        "legend": {
3906          "calcs": [],
3907          "displayMode": "list",
3908          "placement": "bottom"
3909        },
3910        "tooltip": {
3911          "mode": "single"
3912        }
3913      },
3914      "percentage": false,
3915      "pluginVersion": "8.5.6",
3916      "pointradius": 2,
3917      "points": false,
3918      "renderer": "flot",
3919      "seriesOverrides": [],
3920      "spaceLength": 10,
3921      "stack": false,
3922      "steppedLine": false,
3923      "targets": [
3924        {
3925          "exemplar": true,
3926          "expr": "label_replace(sum(mongodb_globalLock_currentQueue_total{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3927          "interval": "",
3928          "legendFormat": "{{hostname}}:{{process_port}}",
3929          "refId": "A",
3930          "datasource": {
3931            "type": "prometheus",
3932            "uid": "${DS_THANOS}"
3933          }
3934        }
3935      ],
3936      "thresholds": [],
3937      "timeRegions": [],
3938      "title": "Queues - Total",
3939      "tooltip": {
3940        "shared": true,
3941        "sort": 0,
3942        "value_type": "individual"
3943      },
3944      "type": "graph",
3945      "xaxis": {
3946        "mode": "time",
3947        "show": true,
3948        "values": []
3949      },
3950      "yaxes": [
3951        {
3952          "format": "none",
3953          "logBase": 1,
3954          "show": true
3955        },
3956        {
3957          "format": "short",
3958          "logBase": 1,
3959          "show": true
3960        }
3961      ],
3962      "yaxis": {
3963        "align": false
3964      }
3965    },
3966    {
3967      "aliasColors": {},
3968      "bars": false,
3969      "dashLength": 10,
3970      "dashes": false,
3971      "datasource": {
3972        "type": "prometheus",
3973        "uid": "${DS_THANOS}"
3974      },
3975      "description": "The number of operations queued waiting for a read lock",
3976      "fieldConfig": {
3977        "defaults": {
3978          "links": [],
3979          "unit": "none"
3980        },
3981        "overrides": []
3982      },
3983      "fill": 1,
3984      "fillGradient": 0,
3985      "gridPos": {
3986        "h": 8,
3987        "w": 8,
3988        "x": 8,
3989        "y": 120
3990      },
3991      "hiddenSeries": false,
3992      "id": 115,
3993      "legend": {
3994        "avg": false,
3995        "current": false,
3996        "max": false,
3997        "min": false,
3998        "show": true,
3999        "total": false,
4000        "values": false
4001      },
4002      "lines": true,
4003      "linewidth": 1,
4004      "nullPointMode": "null",
4005      "options": {
4006        "alertThreshold": true,
4007        "legend": {
4008          "calcs": [],
4009          "displayMode": "list",
4010          "placement": "bottom"
4011        },
4012        "tooltip": {
4013          "mode": "single"
4014        }
4015      },
4016      "percentage": false,
4017      "pluginVersion": "8.5.6",
4018      "pointradius": 2,
4019      "points": false,
4020      "renderer": "flot",
4021      "seriesOverrides": [],
4022      "spaceLength": 10,
4023      "stack": false,
4024      "steppedLine": false,
4025      "targets": [
4026        {
4027          "exemplar": true,
4028          "expr": "label_replace(sum(mongodb_globalLock_currentQueue_readers{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4029          "interval": "",
4030          "legendFormat": "{{hostname}}:{{process_port}}",
4031          "refId": "A",
4032          "datasource": {
4033            "type": "prometheus",
4034            "uid": "${DS_THANOS}"
4035          }
4036        }
4037      ],
4038      "thresholds": [],
4039      "timeRegions": [],
4040      "title": "Queues - Readers",
4041      "tooltip": {
4042        "shared": true,
4043        "sort": 0,
4044        "value_type": "individual"
4045      },
4046      "type": "graph",
4047      "xaxis": {
4048        "mode": "time",
4049        "show": true,
4050        "values": []
4051      },
4052      "yaxes": [
4053        {
4054          "format": "none",
4055          "logBase": 1,
4056          "show": true
4057        },
4058        {
4059          "format": "short",
4060          "logBase": 1,
4061          "show": true
4062        }
4063      ],
4064      "yaxis": {
4065        "align": false
4066      }
4067    },
4068    {
4069      "aliasColors": {},
4070      "bars": false,
4071      "dashLength": 10,
4072      "dashes": false,
4073      "datasource": {
4074        "type": "prometheus",
4075        "uid": "${DS_THANOS}"
4076      },
4077      "description": "The number of operations queued waiting for a write lock",
4078      "fieldConfig": {
4079        "defaults": {
4080          "links": [],
4081          "unit": "none"
4082        },
4083        "overrides": []
4084      },
4085      "fill": 1,
4086      "fillGradient": 0,
4087      "gridPos": {
4088        "h": 8,
4089        "w": 8,
4090        "x": 16,
4091        "y": 120
4092      },
4093      "hiddenSeries": false,
4094      "id": 116,
4095      "legend": {
4096        "avg": false,
4097        "current": false,
4098        "max": false,
4099        "min": false,
4100        "show": true,
4101        "total": false,
4102        "values": false
4103      },
4104      "lines": true,
4105      "linewidth": 1,
4106      "nullPointMode": "null",
4107      "options": {
4108        "alertThreshold": true,
4109        "legend": {
4110          "calcs": [],
4111          "displayMode": "list",
4112          "placement": "bottom"
4113        },
4114        "tooltip": {
4115          "mode": "single"
4116        }
4117      },
4118      "percentage": false,
4119      "pluginVersion": "8.5.6",
4120      "pointradius": 2,
4121      "points": false,
4122      "renderer": "flot",
4123      "seriesOverrides": [],
4124      "spaceLength": 10,
4125      "stack": false,
4126      "steppedLine": false,
4127      "targets": [
4128        {
4129          "exemplar": true,
4130          "expr": "label_replace(sum(mongodb_globalLock_currentQueue_writers{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4131          "interval": "",
4132          "legendFormat": "{{hostname}}:{{process_port}}",
4133          "refId": "A",
4134          "datasource": {
4135            "type": "prometheus",
4136            "uid": "${DS_THANOS}"
4137          }
4138        }
4139      ],
4140      "thresholds": [],
4141      "timeRegions": [],
4142      "title": "Queues - Writers",
4143      "tooltip": {
4144        "shared": true,
4145        "sort": 0,
4146        "value_type": "individual"
4147      },
4148      "type": "graph",
4149      "xaxis": {
4150        "mode": "time",
4151        "show": true,
4152        "values": []
4153      },
4154      "yaxes": [
4155        {
4156          "format": "none",
4157          "logBase": 1,
4158          "show": true
4159        },
4160        {
4161          "format": "short",
4162          "logBase": 1,
4163          "show": true
4164        }
4165      ],
4166      "yaxis": {
4167        "align": false
4168      }
4169    },
4170    {
4171      "collapsed": false,
4172      "datasource": {
4173        "type": "prometheus",
4174        "uid": "000000010"
4175      },
4176      "gridPos": {
4177        "h": 1,
4178        "w": 24,
4179        "x": 0,
4180        "y": 128
4181      },
4182      "id": 118,
4183      "panels": [],
4184      "title": "Scan and Order",
4185      "type": "row"
4186    },
4187    {
4188      "aliasColors": {},
4189      "bars": false,
4190      "dashLength": 10,
4191      "dashes": false,
4192      "datasource": {
4193        "type": "prometheus",
4194        "uid": "${DS_THANOS}"
4195      },
4196      "description": "The average rate per second over the selected sample period of queries that return sorted results that cannot perform the sort operation using an index.",
4197      "fieldConfig": {
4198        "defaults": {
4199          "links": [],
4200          "unit": "/s"
4201        },
4202        "overrides": []
4203      },
4204      "fill": 1,
4205      "fillGradient": 0,
4206      "gridPos": {
4207        "h": 8,
4208        "w": 24,
4209        "x": 0,
4210        "y": 129
4211      },
4212      "hiddenSeries": false,
4213      "id": 119,
4214      "legend": {
4215        "avg": false,
4216        "current": false,
4217        "max": false,
4218        "min": false,
4219        "show": true,
4220        "total": false,
4221        "values": false
4222      },
4223      "lines": true,
4224      "linewidth": 1,
4225      "nullPointMode": "null",
4226      "options": {
4227        "alertThreshold": true,
4228        "legend": {
4229          "calcs": [],
4230          "displayMode": "list",
4231          "placement": "bottom"
4232        },
4233        "tooltip": {
4234          "mode": "single"
4235        }
4236      },
4237      "percentage": false,
4238      "pluginVersion": "8.5.6",
4239      "pointradius": 2,
4240      "points": false,
4241      "renderer": "flot",
4242      "seriesOverrides": [],
4243      "spaceLength": 10,
4244      "stack": false,
4245      "steppedLine": false,
4246      "targets": [
4247        {
4248          "exemplar": true,
4249          "expr": "label_replace(sum(irate(mongodb_metrics_operation_scanAndOrder{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4250          "interval": "",
4251          "legendFormat": "{{hostname}}:{{process_port}}",
4252          "refId": "A",
4253          "datasource": {
4254            "type": "prometheus",
4255            "uid": "${DS_THANOS}"
4256          }
4257        }
4258      ],
4259      "thresholds": [],
4260      "timeRegions": [],
4261      "title": "Scan and Order",
4262      "tooltip": {
4263        "shared": true,
4264        "sort": 0,
4265        "value_type": "individual"
4266      },
4267      "type": "graph",
4268      "xaxis": {
4269        "mode": "time",
4270        "show": true,
4271        "values": []
4272      },
4273      "yaxes": [
4274        {
4275          "format": "/s",
4276          "logBase": 1,
4277          "show": true
4278        },
4279        {
4280          "format": "short",
4281          "logBase": 1,
4282          "show": true
4283        }
4284      ],
4285      "yaxis": {
4286        "align": false
4287      }
4288    },
4289    {
4290      "collapsed": false,
4291      "datasource": {
4292        "type": "prometheus",
4293        "uid": "000000010"
4294      },
4295      "gridPos": {
4296        "h": 1,
4297        "w": 24,
4298        "x": 0,
4299        "y": 137
4300      },
4301      "id": 123,
4302      "panels": [],
4303      "title": "Tickets Available",
4304      "type": "row"
4305    },
4306    {
4307      "aliasColors": {},
4308      "bars": false,
4309      "dashLength": 10,
4310      "dashes": false,
4311      "datasource": {
4312        "type": "prometheus",
4313        "uid": "${DS_THANOS}"
4314      },
4315      "description": "The number of read tickets available to the WiredTiger storage engine. Read tickets represent the number of concurrent read operations allowed into the storage engine. When this value reaches zero new read requests may queue until a read ticket becomes available.",
4316      "fieldConfig": {
4317        "defaults": {
4318          "links": [],
4319          "unit": "none"
4320        },
4321        "overrides": []
4322      },
4323      "fill": 1,
4324      "fillGradient": 0,
4325      "gridPos": {
4326        "h": 8,
4327        "w": 12,
4328        "x": 0,
4329        "y": 138
4330      },
4331      "hiddenSeries": false,
4332      "id": 120,
4333      "legend": {
4334        "avg": false,
4335        "current": false,
4336        "max": false,
4337        "min": false,
4338        "show": true,
4339        "total": false,
4340        "values": false
4341      },
4342      "lines": true,
4343      "linewidth": 1,
4344      "nullPointMode": "null",
4345      "options": {
4346        "alertThreshold": true,
4347        "legend": {
4348          "calcs": [],
4349          "displayMode": "list",
4350          "placement": "bottom"
4351        },
4352        "tooltip": {
4353          "mode": "single"
4354        }
4355      },
4356      "percentage": false,
4357      "pluginVersion": "8.5.6",
4358      "pointradius": 2,
4359      "points": false,
4360      "renderer": "flot",
4361      "seriesOverrides": [],
4362      "spaceLength": 10,
4363      "stack": false,
4364      "steppedLine": false,
4365      "targets": [
4366        {
4367          "exemplar": true,
4368          "expr": "label_replace(sum(mongodb_wiredTiger_concurrentTransactions_read_available{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4369          "interval": "",
4370          "legendFormat": "{{hostname}}:{{process_port}}",
4371          "refId": "A",
4372          "datasource": {
4373            "type": "prometheus",
4374            "uid": "${DS_THANOS}"
4375          }
4376        }
4377      ],
4378      "thresholds": [],
4379      "timeRegions": [],
4380      "title": "Tickets Available - Reads",
4381      "tooltip": {
4382        "shared": true,
4383        "sort": 0,
4384        "value_type": "individual"
4385      },
4386      "type": "graph",
4387      "xaxis": {
4388        "mode": "time",
4389        "show": true,
4390        "values": []
4391      },
4392      "yaxes": [
4393        {
4394          "format": "none",
4395          "logBase": 1,
4396          "show": true
4397        },
4398        {
4399          "format": "short",
4400          "logBase": 1,
4401          "show": true
4402        }
4403      ],
4404      "yaxis": {
4405        "align": false
4406      }
4407    },
4408    {
4409      "aliasColors": {},
4410      "bars": false,
4411      "dashLength": 10,
4412      "dashes": false,
4413      "datasource": {
4414        "type": "prometheus",
4415        "uid": "${DS_THANOS}"
4416      },
4417      "description": "The number of write tickets available to the WiredTiger storage engine. Write tickets represent the number of concurrent write operations allowed into the storage engine. When this value reaches zero new write requests may queue until a write ticket becomes available.",
4418      "fieldConfig": {
4419        "defaults": {
4420          "links": [],
4421          "unit": "none"
4422        },
4423        "overrides": []
4424      },
4425      "fill": 1,
4426      "fillGradient": 0,
4427      "gridPos": {
4428        "h": 8,
4429        "w": 12,
4430        "x": 12,
4431        "y": 138
4432      },
4433      "hiddenSeries": false,
4434      "id": 121,
4435      "legend": {
4436        "avg": false,
4437        "current": false,
4438        "max": false,
4439        "min": false,
4440        "show": true,
4441        "total": false,
4442        "values": false
4443      },
4444      "lines": true,
4445      "linewidth": 1,
4446      "nullPointMode": "null",
4447      "options": {
4448        "alertThreshold": true,
4449        "legend": {
4450          "calcs": [],
4451          "displayMode": "list",
4452          "placement": "bottom"
4453        },
4454        "tooltip": {
4455          "mode": "single"
4456        }
4457      },
4458      "percentage": false,
4459      "pluginVersion": "8.5.6",
4460      "pointradius": 2,
4461      "points": false,
4462      "renderer": "flot",
4463      "seriesOverrides": [],
4464      "spaceLength": 10,
4465      "stack": false,
4466      "steppedLine": false,
4467      "targets": [
4468        {
4469          "exemplar": true,
4470          "expr": "label_replace(sum(mongodb_wiredTiger_concurrentTransactions_write_available{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4471          "interval": "",
4472          "legendFormat": "{{hostname}}:{{process_port}}",
4473          "refId": "A",
4474          "datasource": {
4475            "type": "prometheus",
4476            "uid": "${DS_THANOS}"
4477          }
4478        }
4479      ],
4480      "thresholds": [],
4481      "timeRegions": [],
4482      "title": "Tickets Available - Writes",
4483      "tooltip": {
4484        "shared": true,
4485        "sort": 0,
4486        "value_type": "individual"
4487      },
4488      "type": "graph",
4489      "xaxis": {
4490        "mode": "time",
4491        "show": true,
4492        "values": []
4493      },
4494      "yaxes": [
4495        {
4496          "format": "none",
4497          "logBase": 1,
4498          "show": true
4499        },
4500        {
4501          "format": "short",
4502          "logBase": 1,
4503          "show": true
4504        }
4505      ],
4506      "yaxis": {
4507        "align": false
4508      }
4509    }
4510  ],
4511  "schemaVersion": 36,
4512  "style": "dark",
4513  "tags": [],
4514  "templating": {
4515    "list": [
4516      {
4517        "auto": true,
4518        "auto_count": 30,
4519        "auto_min": "1m",
4520        "current": {
4521          "selected": false,
4522          "text": "1m",
4523          "value": "1m"
4524        },
4525        "hide": 0,
4526        "name": "Interval",
4527        "options": [
4528          {
4529            "selected": false,
4530            "text": "auto",
4531            "value": "$__auto_interval_Interval"
4532          },
4533          {
4534            "selected": false,
4535            "text": "30s",
4536            "value": "30s"
4537          },
4538          {
4539            "selected": true,
4540            "text": "1m",
4541            "value": "1m"
4542          },
4543          {
4544            "selected": false,
4545            "text": "5m",
4546            "value": "5m"
4547          },
4548          {
4549            "selected": false,
4550            "text": "1h",
4551            "value": "1h"
4552          },
4553          {
4554            "selected": false,
4555            "text": "1d",
4556            "value": "1d"
4557          }
4558        ],
4559        "query": "30s,1m,5m,1h,1d",
4560        "queryValue": "",
4561        "refresh": 2,
4562        "skipUrlSync": false,
4563        "type": "interval"
4564      },
4565      {
4566        "current": {
4567          "selected": false,
4568          "text": "thanos",
4569          "value": "thanos"
4570        },
4571        "hide": 0,
4572        "includeAll": false,
4573        "multi": false,
4574        "name": "Datasource",
4575        "options": [],
4576        "query": "prometheus",
4577        "queryValue": "",
4578        "refresh": 1,
4579        "regex": "/thanos.*/",
4580        "skipUrlSync": false,
4581        "type": "datasource"
4582      },
4583      {
4584        "current": {},
4585        "datasource": {
4586          "type": "prometheus",
4587          "uid": "$Datasource"
4588        },
4589        "definition": "label_values(mongodb_up, job)",
4590        "hide": 0,
4591        "includeAll": false,
4592        "multi": false,
4593        "name": "job",
4594        "options": [],
4595        "query": {
4596          "query": "label_values(mongodb_up, job)",
4597          "refId": "thanos-job-Variable-Query"
4598        },
4599        "refresh": 2,
4600        "regex": "",
4601        "skipUrlSync": false,
4602        "sort": 0,
4603        "tagValuesQuery": "",
4604        "tagsQuery": "",
4605        "type": "query",
4606        "useTags": false
4607      },
4608      {
4609        "current": {},
4610        "datasource": {
4611          "type": "prometheus",
4612          "uid": "$Datasource"
4613        },
4614        "definition": "label_values(mongodb_up{job=\"$job\"}, group_id)",
4615        "hide": 0,
4616        "includeAll": false,
4617        "label": "Group Id",
4618        "multi": false,
4619        "name": "group_id",
4620        "options": [],
4621        "query": {
4622          "query": "label_values(mongodb_up{job=\"$job\"}, group_id)",
4623          "refId": "thanos-group_id-Variable-Query"
4624        },
4625        "refresh": 1,
4626        "regex": "",
4627        "skipUrlSync": false,
4628        "sort": 5,
4629        "tagValuesQuery": "",
4630        "tagsQuery": "",
4631        "type": "query",
4632        "useTags": false
4633      },
4634      {
4635        "current": {},
4636        "datasource": {
4637          "type": "prometheus",
4638          "uid": "$Datasource"
4639        },
4640        "definition": "label_values(mongodb_up{group_id='$group_id'}, cl_name)",
4641        "hide": 0,
4642        "includeAll": false,
4643        "label": "Cluster Name",
4644        "multi": false,
4645        "name": "cl_name",
4646        "options": [],
4647        "query": {
4648          "query": "label_values(mongodb_up{group_id='$group_id'}, cl_name)",
4649          "refId": "thanos-cl_name-Variable-Query"
4650        },
4651        "refresh": 2,
4652        "regex": "",
4653        "skipUrlSync": false,
4654        "sort": 5,
4655        "tagValuesQuery": "",
4656        "tagsQuery": "",
4657        "type": "query",
4658        "useTags": false
4659      },
4660      {
4661        "current": {},
4662        "datasource": {
4663          "type": "prometheus",
4664          "uid": "$Datasource"
4665        },
4666        "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name'}, rs_nm)",
4667        "hide": 0,
4668        "includeAll": true,
4669        "label": "ReplicaSet Name",
4670        "multi": true,
4671        "name": "rs_nm",
4672        "options": [],
4673        "query": {
4674          "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name'}, rs_nm)",
4675          "refId": "thanos-rs_nm-Variable-Query"
4676        },
4677        "refresh": 1,
4678        "regex": "",
4679        "skipUrlSync": false,
4680        "sort": 5,
4681        "tagValuesQuery": "",
4682        "tagsQuery": "",
4683        "type": "query",
4684        "useTags": false
4685      },
4686      {
4687        "current": {},
4688        "datasource": {
4689          "type": "prometheus",
4690          "uid": "$Datasource"
4691        },
4692        "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},instance)",
4693        "hide": 0,
4694        "includeAll": true,
4695        "label": "Host",
4696        "multi": true,
4697        "name": "host",
4698        "options": [],
4699        "query": {
4700          "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},instance)",
4701          "refId": "thanos-host-Variable-Query"
4702        },
4703        "refresh": 2,
4704        "regex": "",
4705        "skipUrlSync": false,
4706        "sort": 5,
4707        "tagValuesQuery": "",
4708        "tagsQuery": "",
4709        "type": "query",
4710        "useTags": false
4711      },
4712      {
4713        "current": {},
4714        "datasource": {
4715          "type": "prometheus",
4716          "uid": "$Datasource"
4717        },
4718        "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},process_port)",
4719        "description": "Only applicable for process level metrics",
4720        "hide": 0,
4721        "includeAll": true,
4722        "label": "Process Port",
4723        "multi": true,
4724        "name": "process_port",
4725        "options": [],
4726        "query": {
4727          "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},process_port)",
4728          "refId": "thanos-process_port-Variable-Query"
4729        },
4730        "refresh": 1,
4731        "regex": "",
4732        "skipUrlSync": false,
4733        "sort": 5,
4734        "tagValuesQuery": "",
4735        "tagsQuery": "",
4736        "type": "query",
4737        "useTags": false
4738      }
4739    ]
4740  },
4741  "time": {
4742    "from": "now-6h",
4743    "to": "now"
4744  },
4745  "timepicker": {
4746    "refresh_intervals": [
4747      "5s",
4748      "10s",
4749      "30s",
4750      "1m",
4751      "5m",
4752      "15m",
4753      "30m",
4754      "1h",
4755      "2h",
4756      "1d"
4757    ]
4758  },
4759  "timezone": "",
4760  "title": "Dedicated Atlas Clusters - Mongo Metrics",
4761  "uid": "W0lo7Gx7z",
4762  "version": 17,
4763  "weekStart": ""
4764 }

hardware-metrics.json

1 {
2  "annotations": {
3    "list": [
4      {
5        "builtIn": 1,
6        "datasource": "-- Grafana --",
7        "enable": true,
8        "hide": true,
9        "iconColor": "rgba(0, 211, 255, 1)",
10        "name": "Annotations & Alerts",
11        "target": {
12          "limit": 100,
13          "matchAny": false,
14          "tags": [],
15          "type": "dashboard"
16        },
17        "type": "dashboard"
18      }
19    ]
20  },
21  "description": "",
22  "editable": true,
23  "fiscalYearStartMonth": 0,
24  "gnetId": null,
25  "graphTooltip": 0,
26  "id": 8,
27  "iteration": 1639495636182,
28  "links": [],
29  "liveNow": false,
30  "panels": [
31    {
32      "collapsed": false,
33      "datasource": null,
34      "gridPos": {
35        "h": 1,
36        "w": 24,
37        "x": 0,
38        "y": 0
39      },
40      "id": 10,
41      "panels": [],
42      "title": "Overview",
43      "type": "row"
44    },
45    {
46      "datasource": null,
47      "fieldConfig": {
48        "defaults": {
49          "color": {
50            "mode": "thresholds"
51          },
52          "custom": {
53            "align": "auto",
54            "displayMode": "color-text",
55            "filterable": false
56          },
57          "mappings": [],
58          "thresholds": {
59            "mode": "absolute",
60            "steps": [
61              {
62                "color": "green",
63                "value": null
64              },
65              {
66                "color": "red",
67                "value": 80
68              }
69            ]
70          }
71        },
72        "overrides": [
73          {
74            "matcher": {
75              "id": "byName",
76              "options": "instance"
77            },
78            "properties": [
79              {
80                "id": "custom.width",
81                "value": 409
82              }
83            ]
84          }
85        ]
86      },
87      "gridPos": {
88        "h": 3,
89        "w": 11,
90        "x": 0,
91        "y": 1
92      },
93      "id": 41,
94      "options": {
95        "frameIndex": 0,
96        "showHeader": true,
97        "sortBy": [
98          {
99            "desc": true,
100            "displayName": "Value #A"
101          }
102        ]
103      },
104      "pluginVersion": "8.2.2",
105      "targets": [
106        {
107          "exemplar": true,
108          "expr": "label_replace( sum(mongodb_up{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (group_name, group_id, org_id, replica_set_name, cluster_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
109          "format": "table",
110          "interval": "",
111          "legendFormat": "",
112          "refId": "A"
113        }
114      ],
115      "title": "Group Metadata",
116      "transformations": [
117        {
118          "id": "organize",
119          "options": {
120            "excludeByName": {
121              "Time": true,
122              "Value #A": true,
123              "instance": true,
124              "replica_set_name": false
125            },
126            "indexByName": {
127              "Time": 0,
128              "Value #A": 6,
129              "cluster_name": 4,
130              "group_id": 3,
131              "group_name": 2,
132              "org_id": 1,
133              "replica_set_name": 5
134            },
135            "renameByName": {
136              "Time": "",
137              "cluster_name": "Cluster Name",
138              "group_id": "Group Id",
139              "group_name": "Group Name ",
140              "hostname": "Host",
141              "instance": "",
142              "org_id": "Org Id",
143              "process_port": "Port",
144              "replica_set_name": "ReplicaSet Name",
145              "replica_state": "ReplicaSet State"
146            }
147          }
148        },
149        {
150          "id": "groupBy",
151          "options": {
152            "fields": {
153              "Cluster Name": {
154                "aggregations": [],
155                "operation": "groupby"
156              },
157              "Group Id": {
158                "aggregations": [],
159                "operation": "groupby"
160              },
161              "Group Name ": {
162                "aggregations": [],
163                "operation": "groupby"
164              },
165              "Host": {
166                "aggregations": [],
167                "operation": "groupby"
168              },
169              "Host ": {
170                "aggregations": [],
171                "operation": "groupby"
172              },
173              "Org Id": {
174                "aggregations": [],
175                "operation": "groupby"
176              },
177              "Port": {
178                "aggregations": [],
179                "operation": "groupby"
180              },
181              "Replica set state": {
182                "aggregations": [],
183                "operation": "groupby"
184              },
185              "ReplicaSet Name": {
186                "aggregations": [],
187                "operation": "groupby"
188              },
189              "ReplicaSet State": {
190                "aggregations": [],
191                "operation": "groupby"
192              },
193              "host ": {
194                "aggregations": [],
195                "operation": "groupby"
196              },
197              "hostname": {
198                "aggregations": [],
199                "operation": "groupby"
200              },
201              "instance": {
202                "aggregations": [],
203                "operation": "groupby"
204              },
205              "port": {
206                "aggregations": [],
207                "operation": "groupby"
208              },
209              "process_port": {
210                "aggregations": [],
211                "operation": "groupby"
212              },
213              "replica set": {
214                "aggregations": [],
215                "operation": "groupby"
216              },
217              "replica set state": {
218                "aggregations": [],
219                "operation": "groupby"
220              },
221              "replica_set_name": {
222                "aggregations": [],
223                "operation": "groupby"
224              },
225              "replica_state": {
226                "aggregations": [],
227                "operation": "groupby"
228              }
229            }
230          }
231        }
232      ],
233      "type": "table"
234    },
235    {
236      "datasource": null,
237      "fieldConfig": {
238        "defaults": {
239          "color": {
240            "mode": "thresholds"
241          },
242          "custom": {
243            "align": "auto",
244            "displayMode": "color-text",
245            "filterable": false
246          },
247          "mappings": [],
248          "thresholds": {
249            "mode": "absolute",
250            "steps": [
251              {
252                "color": "green",
253                "value": null
254              },
255              {
256                "color": "red",
257                "value": 80
258              }
259            ]
260          }
261        },
262        "overrides": [
263          {
264            "matcher": {
265              "id": "byName",
266              "options": "instance"
267            },
268            "properties": [
269              {
270                "id": "custom.width",
271                "value": 409
272              }
273            ]
274          },
275          {
276            "matcher": {
277              "id": "byName",
278              "options": "Port"
279            },
280            "properties": [
281              {
282                "id": "custom.width",
283                "value": 80
284              }
285            ]
286          },
287          {
288            "matcher": {
289              "id": "byName",
290              "options": "ReplicaSet State"
291            },
292            "properties": [
293              {
294                "id": "custom.width",
295                "value": 135
296              }
297            ]
298          },
299          {
300            "matcher": {
301              "id": "byName",
302              "options": "ReplicaSet Name"
303            },
304            "properties": [
305              {
306                "id": "custom.width",
307                "value": 198
308              }
309            ]
310          },
311          {
312            "matcher": {
313              "id": "byName",
314              "options": "Host"
315            },
316            "properties": [
317              {
318                "id": "custom.width",
319                "value": 356
320              }
321            ]
322          }
323        ]
324      },
325      "gridPos": {
326        "h": 5,
327        "w": 13,
328        "x": 11,
329        "y": 1
330      },
331      "id": 42,
332      "options": {
333        "frameIndex": 0,
334        "showHeader": true,
335        "sortBy": []
336      },
337      "pluginVersion": "8.2.2",
338      "targets": [
339        {
340          "exemplar": true,
341          "expr": "label_replace( sum(mongodb_up{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, replica_state, process_port, replica_set_name, process_type), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
342          "format": "table",
343          "interval": "",
344          "legendFormat": "",
345          "refId": "A"
346        }
347      ],
348      "title": "Cluster host list",
349      "transformations": [
350        {
351          "id": "organize",
352          "options": {
353            "excludeByName": {
354              "Time": true,
355              "Value #A": true,
356              "instance": true,
357              "process_type": false,
358              "replica_set_name": false
359            },
360            "indexByName": {
361              "Time": 0,
362              "Value #A": 6,
363              "hostname": 1,
364              "instance": 2,
365              "process_port": 3,
366              "replica_set_name": 5,
367              "replica_state": 4
368            },
369            "renameByName": {
370              "Time": "",
371              "hostname": "Host",
372              "instance": "",
373              "process_port": "Port",
374              "process_type": "Type",
375              "replica_set_name": "ReplicaSet Name",
376              "replica_state": "ReplicaSet State"
377            }
378          }
379        },
380        {
381          "id": "groupBy",
382          "options": {
383            "fields": {
384              "Host": {
385                "aggregations": [],
386                "operation": "groupby"
387              },
388              "Host ": {
389                "aggregations": [],
390                "operation": "groupby"
391              },
392              "Port": {
393                "aggregations": [],
394                "operation": "groupby"
395              },
396              "Replica set state": {
397                "aggregations": [],
398                "operation": "groupby"
399              },
400              "ReplicaSet Name": {
401                "aggregations": [],
402                "operation": "groupby"
403              },
404              "ReplicaSet State": {
405                "aggregations": [],
406                "operation": "groupby"
407              },
408              "Type": {
409                "aggregations": [],
410                "operation": "groupby"
411              },
412              "host ": {
413                "aggregations": [],
414                "operation": "groupby"
415              },
416              "hostname": {
417                "aggregations": [],
418                "operation": "groupby"
419              },
420              "instance": {
421                "aggregations": [],
422                "operation": "groupby"
423              },
424              "port": {
425                "aggregations": [],
426                "operation": "groupby"
427              },
428              "process_port": {
429                "aggregations": [],
430                "operation": "groupby"
431              },
432              "process_type": {
433                "aggregations": [],
434                "operation": "groupby"
435              },
436              "replica set": {
437                "aggregations": [],
438                "operation": "groupby"
439              },
440              "replica set state": {
441                "aggregations": [],
442                "operation": "groupby"
443              },
444              "replica_set_name": {
445                "aggregations": [],
446                "operation": "groupby"
447              },
448              "replica_state": {
449                "aggregations": [],
450                "operation": "groupby"
451              }
452            }
453          }
454        }
455      ],
456      "type": "table"
457    },
458    {
459      "collapsed": false,
460      "datasource": null,
461      "gridPos": {
462        "h": 1,
463        "w": 24,
464        "x": 0,
465        "y": 6
466      },
467      "id": 8,
468      "panels": [],
469      "title": "System Memory",
470      "type": "row"
471    },
472    {
473      "datasource": null,
474      "description": "The number of kilobytes of used shared memory (shared between several processes, thus including RAM disks, SYS-V-IPC and BSD like SHMEM)",
475      "fieldConfig": {
476        "defaults": {
477          "color": {
478            "mode": "palette-classic"
479          },
480          "custom": {
481            "axisLabel": "",
482            "axisPlacement": "auto",
483            "barAlignment": 0,
484            "drawStyle": "line",
485            "fillOpacity": 0,
486            "gradientMode": "none",
487            "hideFrom": {
488              "legend": false,
489              "tooltip": false,
490              "viz": false
491            },
492            "lineInterpolation": "linear",
493            "lineWidth": 1,
494            "pointSize": 5,
495            "scaleDistribution": {
496              "type": "linear"
497            },
498            "showPoints": "auto",
499            "spanNulls": false,
500            "stacking": {
501              "group": "A",
502              "mode": "none"
503            },
504            "thresholdsStyle": {
505              "mode": "off"
506            }
507          },
508          "mappings": [],
509          "thresholds": {
510            "mode": "absolute",
511            "steps": [
512              {
513                "color": "green",
514                "value": null
515              },
516              {
517                "color": "red",
518                "value": 80
519              }
520            ]
521          },
522          "unit": "deckbytes"
523        },
524        "overrides": []
525      },
526      "gridPos": {
527        "h": 8,
528        "w": 6,
529        "x": 0,
530        "y": 7
531      },
532      "id": 2,
533      "options": {
534        "legend": {
535          "calcs": [],
536          "displayMode": "list",
537          "placement": "bottom"
538        },
539        "tooltip": {
540          "mode": "single"
541        }
542      },
543      "targets": [
544        {
545          "exemplar": true,
546          "expr": "label_replace(sum(hardware_system_memory_shared_mem_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
547          "interval": "",
548          "legendFormat": "host - {{hostname}}",
549          "refId": "A"
550        }
551      ],
552      "title": "System Memory - Shared",
553      "type": "timeseries"
554    },
555    {
556      "datasource": null,
557      "description": "The number of kilobytes of buffer cache, relatively temporary storage for raw disk blocks",
558      "fieldConfig": {
559        "defaults": {
560          "color": {
561            "mode": "palette-classic"
562          },
563          "custom": {
564            "axisLabel": "",
565            "axisPlacement": "auto",
566            "barAlignment": 0,
567            "drawStyle": "line",
568            "fillOpacity": 0,
569            "gradientMode": "none",
570            "hideFrom": {
571              "legend": false,
572              "tooltip": false,
573              "viz": false
574            },
575            "lineInterpolation": "linear",
576            "lineWidth": 1,
577            "pointSize": 5,
578            "scaleDistribution": {
579              "type": "linear"
580            },
581            "showPoints": "auto",
582            "spanNulls": false,
583            "stacking": {
584              "group": "A",
585              "mode": "none"
586            },
587            "thresholdsStyle": {
588              "mode": "off"
589            }
590          },
591          "mappings": [],
592          "thresholds": {
593            "mode": "absolute",
594            "steps": [
595              {
596                "color": "green",
597                "value": null
598              },
599              {
600                "color": "red",
601                "value": 80
602              }
603            ]
604          },
605          "unit": "deckbytes"
606        },
607        "overrides": []
608      },
609      "gridPos": {
610        "h": 8,
611        "w": 6,
612        "x": 6,
613        "y": 7
614      },
615      "id": 6,
616      "options": {
617        "legend": {
618          "calcs": [],
619          "displayMode": "list",
620          "placement": "bottom"
621        },
622        "tooltip": {
623          "mode": "single"
624        }
625      },
626      "targets": [
627        {
628          "exemplar": true,
629          "expr": "label_replace( sum(hardware_system_memory_buffers_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
630          "interval": "",
631          "legendFormat": "host - {{hostname}}",
632          "refId": "A"
633        }
634      ],
635      "title": "System Memory - Buffers",
636      "type": "timeseries"
637    },
638    {
639      "datasource": null,
640      "description": "The number of kilobytes in the page cache.",
641      "fieldConfig": {
642        "defaults": {
643          "color": {
644            "mode": "palette-classic"
645          },
646          "custom": {
647            "axisLabel": "",
648            "axisPlacement": "auto",
649            "barAlignment": 0,
650            "drawStyle": "line",
651            "fillOpacity": 0,
652            "gradientMode": "none",
653            "hideFrom": {
654              "legend": false,
655              "tooltip": false,
656              "viz": false
657            },
658            "lineInterpolation": "linear",
659            "lineWidth": 1,
660            "pointSize": 5,
661            "scaleDistribution": {
662              "type": "linear"
663            },
664            "showPoints": "auto",
665            "spanNulls": false,
666            "stacking": {
667              "group": "A",
668              "mode": "none"
669            },
670            "thresholdsStyle": {
671              "mode": "off"
672            }
673          },
674          "mappings": [],
675          "thresholds": {
676            "mode": "absolute",
677            "steps": [
678              {
679                "color": "green",
680                "value": null
681              },
682              {
683                "color": "red",
684                "value": 80
685              }
686            ]
687          },
688          "unit": "deckbytes"
689        },
690        "overrides": []
691      },
692      "gridPos": {
693        "h": 8,
694        "w": 6,
695        "x": 12,
696        "y": 7
697      },
698      "id": 11,
699      "options": {
700        "legend": {
701          "calcs": [],
702          "displayMode": "list",
703          "placement": "bottom"
704        },
705        "tooltip": {
706          "mode": "single"
707        }
708      },
709      "targets": [
710        {
711          "exemplar": true,
712          "expr": "label_replace (sum(hardware_system_memory_cached_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
713          "interval": "",
714          "legendFormat": "host - {{hostname}}",
715          "refId": "A"
716        }
717      ],
718      "title": "System Memory - Cached",
719      "type": "timeseries"
720    },
721    {
722      "datasource": null,
723      "description": "The number of kilobytes of physical memory in use\n",
724      "fieldConfig": {
725        "defaults": {
726          "color": {
727            "mode": "palette-classic"
728          },
729          "custom": {
730            "axisLabel": "",
731            "axisPlacement": "auto",
732            "barAlignment": 0,
733            "drawStyle": "line",
734            "fillOpacity": 0,
735            "gradientMode": "none",
736            "hideFrom": {
737              "legend": false,
738              "tooltip": false,
739              "viz": false
740            },
741            "lineInterpolation": "linear",
742            "lineWidth": 1,
743            "pointSize": 5,
744            "scaleDistribution": {
745              "type": "linear"
746            },
747            "showPoints": "auto",
748            "spanNulls": false,
749            "stacking": {
750              "group": "A",
751              "mode": "none"
752            },
753            "thresholdsStyle": {
754              "mode": "off"
755            }
756          },
757          "mappings": [],
758          "thresholds": {
759            "mode": "absolute",
760            "steps": [
761              {
762                "color": "green",
763                "value": null
764              },
765              {
766                "color": "red",
767                "value": 80
768              }
769            ]
770          },
771          "unit": "deckbytes"
772        },
773        "overrides": []
774      },
775      "gridPos": {
776        "h": 8,
777        "w": 6,
778        "x": 0,
779        "y": 15
780      },
781      "id": 13,
782      "options": {
783        "legend": {
784          "calcs": [],
785          "displayMode": "list",
786          "placement": "bottom"
787        },
788        "tooltip": {
789          "mode": "single"
790        }
791      },
792      "targets": [
793        {
794          "exemplar": true,
795          "expr": "label_replace( sum(hardware_system_memory_mem_total_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) - sum(hardware_system_memory_mem_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
796          "interval": "",
797          "legendFormat": "host - {{hostname}}",
798          "refId": "A"
799        }
800      ],
801      "title": "System Memory - Used",
802      "type": "timeseries"
803    },
804    {
805      "datasource": null,
806      "description": "The total amount of swap space in free and used, measured in kilobytes\n",
807      "fieldConfig": {
808        "defaults": {
809          "color": {
810            "mode": "palette-classic"
811          },
812          "custom": {
813            "axisLabel": "",
814            "axisPlacement": "auto",
815            "barAlignment": 0,
816            "drawStyle": "line",
817            "fillOpacity": 0,
818            "gradientMode": "none",
819            "hideFrom": {
820              "legend": false,
821              "tooltip": false,
822              "viz": false
823            },
824            "lineInterpolation": "linear",
825            "lineWidth": 1,
826            "pointSize": 5,
827            "scaleDistribution": {
828              "type": "linear"
829            },
830            "showPoints": "auto",
831            "spanNulls": false,
832            "stacking": {
833              "group": "A",
834              "mode": "none"
835            },
836            "thresholdsStyle": {
837              "mode": "off"
838            }
839          },
840          "mappings": [],
841          "thresholds": {
842            "mode": "absolute",
843            "steps": [
844              {
845                "color": "green",
846                "value": null
847              },
848              {
849                "color": "red",
850                "value": 80
851              }
852            ]
853          },
854          "unit": "deckbytes"
855        },
856        "overrides": []
857      },
858      "gridPos": {
859        "h": 8,
860        "w": 6,
861        "x": 6,
862        "y": 15
863      },
864      "id": 37,
865      "options": {
866        "legend": {
867          "calcs": [],
868          "displayMode": "list",
869          "placement": "bottom"
870        },
871        "tooltip": {
872          "mode": "single"
873        }
874      },
875      "targets": [
876        {
877          "exemplar": true,
878          "expr": "label_replace( sum(hardware_system_memory_swap_total_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) - sum(hardware_system_memory_swap_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
879          "interval": "",
880          "legendFormat": "swap used for host - {{hostname}}",
881          "refId": "A"
882        },
883        {
884          "exemplar": true,
885          "expr": "label_replace (sum(hardware_system_memory_swap_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
886          "hide": false,
887          "interval": "",
888          "legendFormat": "swap free for host - {{hostname}}",
889          "refId": "B"
890        }
891      ],
892      "title": "System Memory - Swap",
893      "type": "timeseries"
894    },
895    {
896      "datasource": null,
897      "description": "An estimate of the number of kilobytes of system memory available for running new applications, without swapping",
898      "fieldConfig": {
899        "defaults": {
900          "color": {
901            "mode": "palette-classic"
902          },
903          "custom": {
904            "axisLabel": "",
905            "axisPlacement": "auto",
906            "barAlignment": 0,
907            "drawStyle": "line",
908            "fillOpacity": 0,
909            "gradientMode": "none",
910            "hideFrom": {
911              "legend": false,
912              "tooltip": false,
913              "viz": false
914            },
915            "lineInterpolation": "linear",
916            "lineWidth": 1,
917            "pointSize": 5,
918            "scaleDistribution": {
919              "type": "linear"
920            },
921            "showPoints": "auto",
922            "spanNulls": false,
923            "stacking": {
924              "group": "A",
925              "mode": "none"
926            },
927            "thresholdsStyle": {
928              "mode": "off"
929            }
930          },
931          "mappings": [],
932          "thresholds": {
933            "mode": "absolute",
934            "steps": [
935              {
936                "color": "green",
937                "value": null
938              },
939              {
940                "color": "red",
941                "value": 80
942              }
943            ]
944          },
945          "unit": "deckbytes"
946        },
947        "overrides": []
948      },
949      "gridPos": {
950        "h": 8,
951        "w": 6,
952        "x": 12,
953        "y": 15
954      },
955      "id": 15,
956      "options": {
957        "legend": {
958          "calcs": [],
959          "displayMode": "list",
960          "placement": "bottom"
961        },
962        "tooltip": {
963          "mode": "single"
964        }
965      },
966      "targets": [
967        {
968          "exemplar": true,
969          "expr": "label_replace( sum(hardware_system_memory_mem_available_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
970          "interval": "",
971          "legendFormat": "host - {{hostname}}",
972          "refId": "A"
973        }
974      ],
975      "title": "System Memory - Available",
976      "type": "timeseries"
977    },
978    {
979      "collapsed": false,
980      "datasource": null,
981      "gridPos": {
982        "h": 1,
983        "w": 24,
984        "x": 0,
985        "y": 23
986      },
987      "id": 17,
988      "panels": [],
989      "title": "System CPU",
990      "type": "row"
991    },
992    {
993      "datasource": null,
994      "description": "The percentage of time the CPU had something runnable, but the hypervisor chose to run something else. For servers with more than 1 CPU core, this value can exceed 100%.\n",
995      "fieldConfig": {
996        "defaults": {
997          "color": {
998            "mode": "palette-classic"
999          },
1000          "custom": {
1001            "axisLabel": "",
1002            "axisPlacement": "auto",
1003            "barAlignment": 0,
1004            "drawStyle": "line",
1005            "fillOpacity": 0,
1006            "gradientMode": "none",
1007            "hideFrom": {
1008              "legend": false,
1009              "tooltip": false,
1010              "viz": false
1011            },
1012            "lineInterpolation": "linear",
1013            "lineWidth": 1,
1014            "pointSize": 5,
1015            "scaleDistribution": {
1016              "type": "linear"
1017            },
1018            "showPoints": "auto",
1019            "spanNulls": false,
1020            "stacking": {
1021              "group": "A",
1022              "mode": "none"
1023            },
1024            "thresholdsStyle": {
1025              "mode": "off"
1026            }
1027          },
1028          "mappings": [],
1029          "thresholds": {
1030            "mode": "absolute",
1031            "steps": [
1032              {
1033                "color": "green",
1034                "value": null
1035              },
1036              {
1037                "color": "red",
1038                "value": 80
1039              }
1040            ]
1041          },
1042          "unit": "percent"
1043        },
1044        "overrides": [
1045          {
1046            "__systemRef": "hideSeriesFrom",
1047            "matcher": {
1048              "id": "byNames",
1049              "options": {
1050                "mode": "exclude",
1051                "names": [
1052                  "host - banana-shard-00-01.faplr.mmscloudteam.com"
1053                ],
1054                "prefix": "All except:",
1055                "readOnly": true
1056              }
1057            },
1058            "properties": [
1059              {
1060                "id": "custom.hideFrom",
1061                "value": {
1062                  "legend": false,
1063                  "tooltip": false,
1064                  "viz": true
1065                }
1066              }
1067            ]
1068          }
1069        ]
1070      },
1071      "gridPos": {
1072        "h": 7,
1073        "w": 5,
1074        "x": 0,
1075        "y": 24
1076      },
1077      "id": 19,
1078      "options": {
1079        "legend": {
1080          "calcs": [],
1081          "displayMode": "list",
1082          "placement": "bottom"
1083        },
1084        "tooltip": {
1085          "mode": "single"
1086        }
1087      },
1088      "targets": [
1089        {
1090          "exemplar": true,
1091          "expr": "label_replace( sum(rate(hardware_system_cpu_steal_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1092          "interval": "",
1093          "legendFormat": "host - {{hostname}}",
1094          "refId": "A"
1095        }
1096      ],
1097      "title": "System cpu - steal",
1098      "type": "timeseries"
1099    },
1100    {
1101      "datasource": null,
1102      "description": "The percentage of time the CPU spent servicing guest, which is included in user. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1103      "fieldConfig": {
1104        "defaults": {
1105          "color": {
1106            "mode": "palette-classic"
1107          },
1108          "custom": {
1109            "axisLabel": "",
1110            "axisPlacement": "auto",
1111            "barAlignment": 0,
1112            "drawStyle": "line",
1113            "fillOpacity": 0,
1114            "gradientMode": "none",
1115            "hideFrom": {
1116              "legend": false,
1117              "tooltip": false,
1118              "viz": false
1119            },
1120            "lineInterpolation": "linear",
1121            "lineWidth": 1,
1122            "pointSize": 5,
1123            "scaleDistribution": {
1124              "type": "linear"
1125            },
1126            "showPoints": "auto",
1127            "spanNulls": false,
1128            "stacking": {
1129              "group": "A",
1130              "mode": "none"
1131            },
1132            "thresholdsStyle": {
1133              "mode": "off"
1134            }
1135          },
1136          "mappings": [],
1137          "thresholds": {
1138            "mode": "absolute",
1139            "steps": [
1140              {
1141                "color": "green",
1142                "value": null
1143              },
1144              {
1145                "color": "red",
1146                "value": 80
1147              }
1148            ]
1149          },
1150          "unit": "percent"
1151        },
1152        "overrides": []
1153      },
1154      "gridPos": {
1155        "h": 7,
1156        "w": 5,
1157        "x": 5,
1158        "y": 24
1159      },
1160      "id": 20,
1161      "options": {
1162        "legend": {
1163          "calcs": [],
1164          "displayMode": "list",
1165          "placement": "bottom"
1166        },
1167        "tooltip": {
1168          "mode": "single"
1169        }
1170      },
1171      "targets": [
1172        {
1173          "exemplar": true,
1174          "expr": "label_replace( sum(rate(hardware_system_cpu_guest_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1175          "interval": "",
1176          "legendFormat": "host - {{hostname}}",
1177          "refId": "A"
1178        }
1179      ],
1180      "title": "System cpu - guest",
1181      "type": "timeseries"
1182    },
1183    {
1184      "datasource": null,
1185      "description": "The percentage of time the CPU spent performing software interrupts. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1186      "fieldConfig": {
1187        "defaults": {
1188          "color": {
1189            "mode": "palette-classic"
1190          },
1191          "custom": {
1192            "axisLabel": "",
1193            "axisPlacement": "auto",
1194            "barAlignment": 0,
1195            "drawStyle": "line",
1196            "fillOpacity": 0,
1197            "gradientMode": "none",
1198            "hideFrom": {
1199              "legend": false,
1200              "tooltip": false,
1201              "viz": false
1202            },
1203            "lineInterpolation": "linear",
1204            "lineWidth": 1,
1205            "pointSize": 5,
1206            "scaleDistribution": {
1207              "type": "linear"
1208            },
1209            "showPoints": "auto",
1210            "spanNulls": false,
1211            "stacking": {
1212              "group": "A",
1213              "mode": "none"
1214            },
1215            "thresholdsStyle": {
1216              "mode": "off"
1217            }
1218          },
1219          "mappings": [],
1220          "thresholds": {
1221            "mode": "absolute",
1222            "steps": [
1223              {
1224                "color": "green",
1225                "value": null
1226              },
1227              {
1228                "color": "red",
1229                "value": 80
1230              }
1231            ]
1232          },
1233          "unit": "percent"
1234        },
1235        "overrides": []
1236      },
1237      "gridPos": {
1238        "h": 7,
1239        "w": 5,
1240        "x": 10,
1241        "y": 24
1242      },
1243      "id": 21,
1244      "options": {
1245        "legend": {
1246          "calcs": [],
1247          "displayMode": "list",
1248          "placement": "bottom"
1249        },
1250        "tooltip": {
1251          "mode": "single"
1252        }
1253      },
1254      "targets": [
1255        {
1256          "exemplar": true,
1257          "expr": "label_replace( sum(rate(hardware_system_cpu_soft_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1258          "interval": "",
1259          "legendFormat": "host - {{hostname}}",
1260          "refId": "A"
1261        }
1262      ],
1263      "title": "System cpu - softirq",
1264      "type": "timeseries"
1265    },
1266    {
1267      "datasource": null,
1268      "description": "The percentage of time the CPU spent performing hardware interrupts. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1269      "fieldConfig": {
1270        "defaults": {
1271          "color": {
1272            "mode": "palette-classic"
1273          },
1274          "custom": {
1275            "axisLabel": "",
1276            "axisPlacement": "auto",
1277            "barAlignment": 0,
1278            "drawStyle": "line",
1279            "fillOpacity": 0,
1280            "gradientMode": "none",
1281            "hideFrom": {
1282              "legend": false,
1283              "tooltip": false,
1284              "viz": false
1285            },
1286            "lineInterpolation": "linear",
1287            "lineWidth": 1,
1288            "pointSize": 5,
1289            "scaleDistribution": {
1290              "type": "linear"
1291            },
1292            "showPoints": "auto",
1293            "spanNulls": false,
1294            "stacking": {
1295              "group": "A",
1296              "mode": "none"
1297            },
1298            "thresholdsStyle": {
1299              "mode": "off"
1300            }
1301          },
1302          "mappings": [],
1303          "thresholds": {
1304            "mode": "absolute",
1305            "steps": [
1306              {
1307                "color": "green",
1308                "value": null
1309              },
1310              {
1311                "color": "red",
1312                "value": 80
1313              }
1314            ]
1315          },
1316          "unit": "percent"
1317        },
1318        "overrides": []
1319      },
1320      "gridPos": {
1321        "h": 7,
1322        "w": 5,
1323        "x": 15,
1324        "y": 24
1325      },
1326      "id": 22,
1327      "options": {
1328        "legend": {
1329          "calcs": [],
1330          "displayMode": "list",
1331          "placement": "bottom"
1332        },
1333        "tooltip": {
1334          "mode": "single"
1335        }
1336      },
1337      "targets": [
1338        {
1339          "exemplar": true,
1340          "expr": "label_replace( sum(rate(hardware_system_cpu_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1341          "interval": "",
1342          "legendFormat": "host - {{hostname}}",
1343          "refId": "A"
1344        }
1345      ],
1346      "title": "System cpu - irq",
1347      "type": "timeseries"
1348    },
1349    {
1350      "datasource": null,
1351      "description": "The percentage of time the CPU spent waiting for IO operations to complete. For servers with more than 1 CPU core, this value can exceed 100%\n",
1352      "fieldConfig": {
1353        "defaults": {
1354          "color": {
1355            "mode": "palette-classic"
1356          },
1357          "custom": {
1358            "axisLabel": "",
1359            "axisPlacement": "auto",
1360            "barAlignment": 0,
1361            "drawStyle": "line",
1362            "fillOpacity": 0,
1363            "gradientMode": "none",
1364            "hideFrom": {
1365              "legend": false,
1366              "tooltip": false,
1367              "viz": false
1368            },
1369            "lineInterpolation": "linear",
1370            "lineWidth": 1,
1371            "pointSize": 5,
1372            "scaleDistribution": {
1373              "type": "linear"
1374            },
1375            "showPoints": "auto",
1376            "spanNulls": false,
1377            "stacking": {
1378              "group": "A",
1379              "mode": "none"
1380            },
1381            "thresholdsStyle": {
1382              "mode": "off"
1383            }
1384          },
1385          "mappings": [],
1386          "thresholds": {
1387            "mode": "absolute",
1388            "steps": [
1389              {
1390                "color": "green",
1391                "value": null
1392              },
1393              {
1394                "color": "red",
1395                "value": 80
1396              }
1397            ]
1398          },
1399          "unit": "percent"
1400        },
1401        "overrides": []
1402      },
1403      "gridPos": {
1404        "h": 7,
1405        "w": 5,
1406        "x": 0,
1407        "y": 31
1408      },
1409      "id": 23,
1410      "options": {
1411        "legend": {
1412          "calcs": [],
1413          "displayMode": "list",
1414          "placement": "bottom"
1415        },
1416        "tooltip": {
1417          "mode": "single"
1418        }
1419      },
1420      "targets": [
1421        {
1422          "exemplar": true,
1423          "expr": "label_replace(sum(rate(hardware_system_cpu_io_wait_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1424          "interval": "",
1425          "legendFormat": "host - {{hostname}}",
1426          "refId": "A"
1427        }
1428      ],
1429      "title": "System cpu - iowait",
1430      "type": "timeseries"
1431    },
1432    {
1433      "datasource": null,
1434      "description": "The percentage of time the CPU spent occupied by all processes with a positive nice value. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1435      "fieldConfig": {
1436        "defaults": {
1437          "color": {
1438            "mode": "palette-classic"
1439          },
1440          "custom": {
1441            "axisLabel": "",
1442            "axisPlacement": "auto",
1443            "barAlignment": 0,
1444            "drawStyle": "line",
1445            "fillOpacity": 0,
1446            "gradientMode": "none",
1447            "hideFrom": {
1448              "legend": false,
1449              "tooltip": false,
1450              "viz": false
1451            },
1452            "lineInterpolation": "linear",
1453            "lineWidth": 1,
1454            "pointSize": 5,
1455            "scaleDistribution": {
1456              "type": "linear"
1457            },
1458            "showPoints": "auto",
1459            "spanNulls": false,
1460            "stacking": {
1461              "group": "A",
1462              "mode": "none"
1463            },
1464            "thresholdsStyle": {
1465              "mode": "off"
1466            }
1467          },
1468          "mappings": [],
1469          "thresholds": {
1470            "mode": "absolute",
1471            "steps": [
1472              {
1473                "color": "green",
1474                "value": null
1475              },
1476              {
1477                "color": "red",
1478                "value": 80
1479              }
1480            ]
1481          },
1482          "unit": "percent"
1483        },
1484        "overrides": []
1485      },
1486      "gridPos": {
1487        "h": 7,
1488        "w": 5,
1489        "x": 5,
1490        "y": 31
1491      },
1492      "id": 24,
1493      "options": {
1494        "legend": {
1495          "calcs": [],
1496          "displayMode": "list",
1497          "placement": "bottom"
1498        },
1499        "tooltip": {
1500          "mode": "single"
1501        }
1502      },
1503      "targets": [
1504        {
1505          "exemplar": true,
1506          "expr": "label_replace( sum(rate(hardware_system_cpu_nice_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1507          "interval": "",
1508          "legendFormat": "host - {{hostname}}",
1509          "refId": "A"
1510        }
1511      ],
1512      "title": "System cpu - nice",
1513      "type": "timeseries"
1514    },
1515    {
1516      "datasource": null,
1517      "description": "The percentage of time the CPU spent servicing operating system calls from all processes. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1518      "fieldConfig": {
1519        "defaults": {
1520          "color": {
1521            "mode": "palette-classic"
1522          },
1523          "custom": {
1524            "axisLabel": "",
1525            "axisPlacement": "auto",
1526            "barAlignment": 0,
1527            "drawStyle": "line",
1528            "fillOpacity": 0,
1529            "gradientMode": "none",
1530            "hideFrom": {
1531              "legend": false,
1532              "tooltip": false,
1533              "viz": false
1534            },
1535            "lineInterpolation": "linear",
1536            "lineWidth": 1,
1537            "pointSize": 5,
1538            "scaleDistribution": {
1539              "type": "linear"
1540            },
1541            "showPoints": "auto",
1542            "spanNulls": false,
1543            "stacking": {
1544              "group": "A",
1545              "mode": "none"
1546            },
1547            "thresholdsStyle": {
1548              "mode": "off"
1549            }
1550          },
1551          "mappings": [],
1552          "thresholds": {
1553            "mode": "absolute",
1554            "steps": [
1555              {
1556                "color": "green",
1557                "value": null
1558              },
1559              {
1560                "color": "red",
1561                "value": 80
1562              }
1563            ]
1564          },
1565          "unit": "percent"
1566        },
1567        "overrides": []
1568      },
1569      "gridPos": {
1570        "h": 7,
1571        "w": 5,
1572        "x": 10,
1573        "y": 31
1574      },
1575      "id": 25,
1576      "options": {
1577        "legend": {
1578          "calcs": [],
1579          "displayMode": "list",
1580          "placement": "bottom"
1581        },
1582        "tooltip": {
1583          "mode": "single"
1584        }
1585      },
1586      "targets": [
1587        {
1588          "exemplar": true,
1589          "expr": "label_replace( sum(rate(hardware_system_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1590          "interval": "",
1591          "legendFormat": "host - {{hostname}}",
1592          "refId": "A"
1593        }
1594      ],
1595      "title": "System cpu - kernel",
1596      "type": "timeseries"
1597    },
1598    {
1599      "datasource": null,
1600      "description": "The percentage of time the CPU spent servicing all user applications (not just MongoDB processes). For servers with more than 1 CPU core, this value can exceed 100%.\n",
1601      "fieldConfig": {
1602        "defaults": {
1603          "color": {
1604            "mode": "palette-classic"
1605          },
1606          "custom": {
1607            "axisLabel": "",
1608            "axisPlacement": "auto",
1609            "barAlignment": 0,
1610            "drawStyle": "line",
1611            "fillOpacity": 0,
1612            "gradientMode": "none",
1613            "hideFrom": {
1614              "legend": false,
1615              "tooltip": false,
1616              "viz": false
1617            },
1618            "lineInterpolation": "linear",
1619            "lineWidth": 1,
1620            "pointSize": 5,
1621            "scaleDistribution": {
1622              "type": "linear"
1623            },
1624            "showPoints": "auto",
1625            "spanNulls": false,
1626            "stacking": {
1627              "group": "A",
1628              "mode": "none"
1629            },
1630            "thresholdsStyle": {
1631              "mode": "off"
1632            }
1633          },
1634          "mappings": [],
1635          "thresholds": {
1636            "mode": "absolute",
1637            "steps": [
1638              {
1639                "color": "green",
1640                "value": null
1641              },
1642              {
1643                "color": "red",
1644                "value": 80
1645              }
1646            ]
1647          },
1648          "unit": "percent"
1649        },
1650        "overrides": []
1651      },
1652      "gridPos": {
1653        "h": 7,
1654        "w": 5,
1655        "x": 15,
1656        "y": 31
1657      },
1658      "id": 26,
1659      "options": {
1660        "legend": {
1661          "calcs": [],
1662          "displayMode": "list",
1663          "placement": "bottom"
1664        },
1665        "tooltip": {
1666          "mode": "single"
1667        }
1668      },
1669      "targets": [
1670        {
1671          "exemplar": true,
1672          "expr": "label_replace( sum(rate(hardware_system_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1673          "interval": "",
1674          "legendFormat": "host - {{hostname}}",
1675          "refId": "A"
1676        }
1677      ],
1678      "title": "System cpu - user",
1679      "type": "timeseries"
1680    },
1681    {
1682      "collapsed": false,
1683      "datasource": null,
1684      "gridPos": {
1685        "h": 1,
1686        "w": 24,
1687        "x": 0,
1688        "y": 38
1689      },
1690      "id": 44,
1691      "panels": [],
1692      "title": "Normalized System Cpu",
1693      "type": "row"
1694    },
1695    {
1696      "datasource": null,
1697      "description": "The percentage of time the CPU had something runnable, but the hypervisor chose to run something else. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1698      "fieldConfig": {
1699        "defaults": {
1700          "color": {
1701            "mode": "palette-classic"
1702          },
1703          "custom": {
1704            "axisLabel": "",
1705            "axisPlacement": "auto",
1706            "barAlignment": 0,
1707            "drawStyle": "line",
1708            "fillOpacity": 0,
1709            "gradientMode": "none",
1710            "hideFrom": {
1711              "legend": false,
1712              "tooltip": false,
1713              "viz": false
1714            },
1715            "lineInterpolation": "linear",
1716            "lineWidth": 1,
1717            "pointSize": 5,
1718            "scaleDistribution": {
1719              "type": "linear"
1720            },
1721            "showPoints": "auto",
1722            "spanNulls": false,
1723            "stacking": {
1724              "group": "A",
1725              "mode": "none"
1726            },
1727            "thresholdsStyle": {
1728              "mode": "off"
1729            }
1730          },
1731          "mappings": [],
1732          "thresholds": {
1733            "mode": "absolute",
1734            "steps": [
1735              {
1736                "color": "green",
1737                "value": null
1738              },
1739              {
1740                "color": "red",
1741                "value": 80
1742              }
1743            ]
1744          },
1745          "unit": "percent"
1746        },
1747        "overrides": [
1748          {
1749            "__systemRef": "hideSeriesFrom",
1750            "matcher": {
1751              "id": "byNames",
1752              "options": {
1753                "mode": "exclude",
1754                "names": [
1755                  "host - banana-shard-00-01.faplr.mmscloudteam.com"
1756                ],
1757                "prefix": "All except:",
1758                "readOnly": true
1759              }
1760            },
1761            "properties": [
1762              {
1763                "id": "custom.hideFrom",
1764                "value": {
1765                  "legend": false,
1766                  "tooltip": false,
1767                  "viz": true
1768                }
1769              }
1770            ]
1771          }
1772        ]
1773      },
1774      "gridPos": {
1775        "h": 7,
1776        "w": 5,
1777        "x": 0,
1778        "y": 39
1779      },
1780      "id": 46,
1781      "options": {
1782        "legend": {
1783          "calcs": [],
1784          "displayMode": "list",
1785          "placement": "bottom"
1786        },
1787        "tooltip": {
1788          "mode": "single"
1789        }
1790      },
1791      "targets": [
1792        {
1793          "exemplar": true,
1794          "expr": "label_replace( sum(rate(hardware_system_cpu_steal_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1795          "interval": "",
1796          "legendFormat": "host - {{hostname}}",
1797          "refId": "A"
1798        }
1799      ],
1800      "title": "Normalized System cpu - steal",
1801      "type": "timeseries"
1802    },
1803    {
1804      "datasource": null,
1805      "description": "The percentage of time the CPU spent servicing guest, which is included in user. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1806      "fieldConfig": {
1807        "defaults": {
1808          "color": {
1809            "mode": "palette-classic"
1810          },
1811          "custom": {
1812            "axisLabel": "",
1813            "axisPlacement": "auto",
1814            "barAlignment": 0,
1815            "drawStyle": "line",
1816            "fillOpacity": 0,
1817            "gradientMode": "none",
1818            "hideFrom": {
1819              "legend": false,
1820              "tooltip": false,
1821              "viz": false
1822            },
1823            "lineInterpolation": "linear",
1824            "lineWidth": 1,
1825            "pointSize": 5,
1826            "scaleDistribution": {
1827              "type": "linear"
1828            },
1829            "showPoints": "auto",
1830            "spanNulls": false,
1831            "stacking": {
1832              "group": "A",
1833              "mode": "none"
1834            },
1835            "thresholdsStyle": {
1836              "mode": "off"
1837            }
1838          },
1839          "mappings": [],
1840          "thresholds": {
1841            "mode": "absolute",
1842            "steps": [
1843              {
1844                "color": "green",
1845                "value": null
1846              },
1847              {
1848                "color": "red",
1849                "value": 80
1850              }
1851            ]
1852          },
1853          "unit": "percent"
1854        },
1855        "overrides": []
1856      },
1857      "gridPos": {
1858        "h": 7,
1859        "w": 5,
1860        "x": 5,
1861        "y": 39
1862      },
1863      "id": 47,
1864      "options": {
1865        "legend": {
1866          "calcs": [],
1867          "displayMode": "list",
1868          "placement": "bottom"
1869        },
1870        "tooltip": {
1871          "mode": "single"
1872        }
1873      },
1874      "targets": [
1875        {
1876          "exemplar": true,
1877          "expr": "label_replace( sum(rate(hardware_system_cpu_guest_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1878          "interval": "",
1879          "legendFormat": "host - {{hostname}}",
1880          "refId": "A"
1881        }
1882      ],
1883      "title": "Normalized System cpu - guest",
1884      "type": "timeseries"
1885    },
1886    {
1887      "datasource": null,
1888      "description": "The percentage of time the CPU spent performing software interrupts. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1889      "fieldConfig": {
1890        "defaults": {
1891          "color": {
1892            "mode": "palette-classic"
1893          },
1894          "custom": {
1895            "axisLabel": "",
1896            "axisPlacement": "auto",
1897            "barAlignment": 0,
1898            "drawStyle": "line",
1899            "fillOpacity": 0,
1900            "gradientMode": "none",
1901            "hideFrom": {
1902              "legend": false,
1903              "tooltip": false,
1904              "viz": false
1905            },
1906            "lineInterpolation": "linear",
1907            "lineWidth": 1,
1908            "pointSize": 5,
1909            "scaleDistribution": {
1910              "type": "linear"
1911            },
1912            "showPoints": "auto",
1913            "spanNulls": false,
1914            "stacking": {
1915              "group": "A",
1916              "mode": "none"
1917            },
1918            "thresholdsStyle": {
1919              "mode": "off"
1920            }
1921          },
1922          "mappings": [],
1923          "thresholds": {
1924            "mode": "absolute",
1925            "steps": [
1926              {
1927                "color": "green",
1928                "value": null
1929              },
1930              {
1931                "color": "red",
1932                "value": 80
1933              }
1934            ]
1935          },
1936          "unit": "percent"
1937        },
1938        "overrides": []
1939      },
1940      "gridPos": {
1941        "h": 7,
1942        "w": 5,
1943        "x": 10,
1944        "y": 39
1945      },
1946      "id": 48,
1947      "options": {
1948        "legend": {
1949          "calcs": [],
1950          "displayMode": "list",
1951          "placement": "bottom"
1952        },
1953        "tooltip": {
1954          "mode": "single"
1955        }
1956      },
1957      "targets": [
1958        {
1959          "exemplar": true,
1960          "expr": "label_replace( sum(rate(hardware_system_cpu_soft_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1961          "interval": "",
1962          "legendFormat": "host - {{hostname}}",
1963          "refId": "A"
1964        }
1965      ],
1966      "title": "Normalized System cpu - softirq",
1967      "type": "timeseries"
1968    },
1969    {
1970      "datasource": null,
1971      "description": "The percentage of time the CPU spent performing hardware interrupts. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1972      "fieldConfig": {
1973        "defaults": {
1974          "color": {
1975            "mode": "palette-classic"
1976          },
1977          "custom": {
1978            "axisLabel": "",
1979            "axisPlacement": "auto",
1980            "barAlignment": 0,
1981            "drawStyle": "line",
1982            "fillOpacity": 0,
1983            "gradientMode": "none",
1984            "hideFrom": {
1985              "legend": false,
1986              "tooltip": false,
1987              "viz": false
1988            },
1989            "lineInterpolation": "linear",
1990            "lineWidth": 1,
1991            "pointSize": 5,
1992            "scaleDistribution": {
1993              "type": "linear"
1994            },
1995            "showPoints": "auto",
1996            "spanNulls": false,
1997            "stacking": {
1998              "group": "A",
1999              "mode": "none"
2000            },
2001            "thresholdsStyle": {
2002              "mode": "off"
2003            }
2004          },
2005          "mappings": [],
2006          "thresholds": {
2007            "mode": "absolute",
2008            "steps": [
2009              {
2010                "color": "green",
2011                "value": null
2012              },
2013              {
2014                "color": "red",
2015                "value": 80
2016              }
2017            ]
2018          },
2019          "unit": "percent"
2020        },
2021        "overrides": []
2022      },
2023      "gridPos": {
2024        "h": 7,
2025        "w": 5,
2026        "x": 15,
2027        "y": 39
2028      },
2029      "id": 49,
2030      "options": {
2031        "legend": {
2032          "calcs": [],
2033          "displayMode": "list",
2034          "placement": "bottom"
2035        },
2036        "tooltip": {
2037          "mode": "single"
2038        }
2039      },
2040      "targets": [
2041        {
2042          "exemplar": true,
2043          "expr": "label_replace( sum(rate(hardware_system_cpu_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2044          "interval": "",
2045          "legendFormat": "host - {{hostname}}",
2046          "refId": "A"
2047        }
2048      ],
2049      "title": "Normalized System cpu - irq",
2050      "type": "timeseries"
2051    },
2052    {
2053      "datasource": null,
2054      "description": "The percentage of time the CPU spent waiting for IO operations to complete. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2055      "fieldConfig": {
2056        "defaults": {
2057          "color": {
2058            "mode": "palette-classic"
2059          },
2060          "custom": {
2061            "axisLabel": "",
2062            "axisPlacement": "auto",
2063            "barAlignment": 0,
2064            "drawStyle": "line",
2065            "fillOpacity": 0,
2066            "gradientMode": "none",
2067            "hideFrom": {
2068              "legend": false,
2069              "tooltip": false,
2070              "viz": false
2071            },
2072            "lineInterpolation": "linear",
2073            "lineWidth": 1,
2074            "pointSize": 5,
2075            "scaleDistribution": {
2076              "type": "linear"
2077            },
2078            "showPoints": "auto",
2079            "spanNulls": false,
2080            "stacking": {
2081              "group": "A",
2082              "mode": "none"
2083            },
2084            "thresholdsStyle": {
2085              "mode": "off"
2086            }
2087          },
2088          "mappings": [],
2089          "thresholds": {
2090            "mode": "absolute",
2091            "steps": [
2092              {
2093                "color": "green",
2094                "value": null
2095              },
2096              {
2097                "color": "red",
2098                "value": 80
2099              }
2100            ]
2101          },
2102          "unit": "percent"
2103        },
2104        "overrides": []
2105      },
2106      "gridPos": {
2107        "h": 7,
2108        "w": 5,
2109        "x": 0,
2110        "y": 46
2111      },
2112      "id": 51,
2113      "options": {
2114        "legend": {
2115          "calcs": [],
2116          "displayMode": "list",
2117          "placement": "bottom"
2118        },
2119        "tooltip": {
2120          "mode": "single"
2121        }
2122      },
2123      "targets": [
2124        {
2125          "exemplar": true,
2126          "expr": "label_replace(sum(rate(hardware_system_cpu_io_wait_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2127          "interval": "",
2128          "legendFormat": "host - {{hostname}}",
2129          "refId": "A"
2130        }
2131      ],
2132      "title": "Normalized System cpu - iowait",
2133      "type": "timeseries"
2134    },
2135    {
2136      "datasource": null,
2137      "description": "The percentage of time the CPU spent occupied by all processes with a positive nice value. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2138      "fieldConfig": {
2139        "defaults": {
2140          "color": {
2141            "mode": "palette-classic"
2142          },
2143          "custom": {
2144            "axisLabel": "",
2145            "axisPlacement": "auto",
2146            "barAlignment": 0,
2147            "drawStyle": "line",
2148            "fillOpacity": 0,
2149            "gradientMode": "none",
2150            "hideFrom": {
2151              "legend": false,
2152              "tooltip": false,
2153              "viz": false
2154            },
2155            "lineInterpolation": "linear",
2156            "lineWidth": 1,
2157            "pointSize": 5,
2158            "scaleDistribution": {
2159              "type": "linear"
2160            },
2161            "showPoints": "auto",
2162            "spanNulls": false,
2163            "stacking": {
2164              "group": "A",
2165              "mode": "none"
2166            },
2167            "thresholdsStyle": {
2168              "mode": "off"
2169            }
2170          },
2171          "mappings": [],
2172          "thresholds": {
2173            "mode": "absolute",
2174            "steps": [
2175              {
2176                "color": "green",
2177                "value": null
2178              },
2179              {
2180                "color": "red",
2181                "value": 80
2182              }
2183            ]
2184          },
2185          "unit": "percent"
2186        },
2187        "overrides": []
2188      },
2189      "gridPos": {
2190        "h": 7,
2191        "w": 5,
2192        "x": 5,
2193        "y": 46
2194      },
2195      "id": 52,
2196      "options": {
2197        "legend": {
2198          "calcs": [],
2199          "displayMode": "list",
2200          "placement": "bottom"
2201        },
2202        "tooltip": {
2203          "mode": "single"
2204        }
2205      },
2206      "targets": [
2207        {
2208          "exemplar": true,
2209          "expr": "label_replace( sum(rate(hardware_system_cpu_nice_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2210          "interval": "",
2211          "legendFormat": "host - {{hostname}}",
2212          "refId": "A"
2213        }
2214      ],
2215      "title": "Normalized System cpu - nice",
2216      "type": "timeseries"
2217    },
2218    {
2219      "datasource": null,
2220      "description": "The percentage of time the CPU spent servicing operating system calls from all processes. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2221      "fieldConfig": {
2222        "defaults": {
2223          "color": {
2224            "mode": "palette-classic"
2225          },
2226          "custom": {
2227            "axisLabel": "",
2228            "axisPlacement": "auto",
2229            "barAlignment": 0,
2230            "drawStyle": "line",
2231            "fillOpacity": 0,
2232            "gradientMode": "none",
2233            "hideFrom": {
2234              "legend": false,
2235              "tooltip": false,
2236              "viz": false
2237            },
2238            "lineInterpolation": "linear",
2239            "lineWidth": 1,
2240            "pointSize": 5,
2241            "scaleDistribution": {
2242              "type": "linear"
2243            },
2244            "showPoints": "auto",
2245            "spanNulls": false,
2246            "stacking": {
2247              "group": "A",
2248              "mode": "none"
2249            },
2250            "thresholdsStyle": {
2251              "mode": "off"
2252            }
2253          },
2254          "mappings": [],
2255          "thresholds": {
2256            "mode": "absolute",
2257            "steps": [
2258              {
2259                "color": "green",
2260                "value": null
2261              },
2262              {
2263                "color": "red",
2264                "value": 80
2265              }
2266            ]
2267          },
2268          "unit": "percent"
2269        },
2270        "overrides": []
2271      },
2272      "gridPos": {
2273        "h": 7,
2274        "w": 5,
2275        "x": 10,
2276        "y": 46
2277      },
2278      "id": 53,
2279      "options": {
2280        "legend": {
2281          "calcs": [],
2282          "displayMode": "list",
2283          "placement": "bottom"
2284        },
2285        "tooltip": {
2286          "mode": "single"
2287        }
2288      },
2289      "targets": [
2290        {
2291          "exemplar": true,
2292          "expr": "label_replace( sum(rate(hardware_system_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2293          "interval": "",
2294          "legendFormat": "host - {{hostname}}",
2295          "refId": "A"
2296        }
2297      ],
2298      "title": "Normalized System cpu - kernel",
2299      "type": "timeseries"
2300    },
2301    {
2302      "datasource": null,
2303      "description": "The percentage of time the CPU spent servicing all user applications (not just MongoDB processes). It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2304      "fieldConfig": {
2305        "defaults": {
2306          "color": {
2307            "mode": "palette-classic"
2308          },
2309          "custom": {
2310            "axisLabel": "",
2311            "axisPlacement": "auto",
2312            "barAlignment": 0,
2313            "drawStyle": "line",
2314            "fillOpacity": 0,
2315            "gradientMode": "none",
2316            "hideFrom": {
2317              "legend": false,
2318              "tooltip": false,
2319              "viz": false
2320            },
2321            "lineInterpolation": "linear",
2322            "lineWidth": 1,
2323            "pointSize": 5,
2324            "scaleDistribution": {
2325              "type": "linear"
2326            },
2327            "showPoints": "auto",
2328            "spanNulls": false,
2329            "stacking": {
2330              "group": "A",
2331              "mode": "none"
2332            },
2333            "thresholdsStyle": {
2334              "mode": "off"
2335            }
2336          },
2337          "mappings": [],
2338          "thresholds": {
2339            "mode": "absolute",
2340            "steps": [
2341              {
2342                "color": "green",
2343                "value": null
2344              },
2345              {
2346                "color": "red",
2347                "value": 80
2348              }
2349            ]
2350          },
2351          "unit": "percent"
2352        },
2353        "overrides": []
2354      },
2355      "gridPos": {
2356        "h": 7,
2357        "w": 5,
2358        "x": 15,
2359        "y": 46
2360      },
2361      "id": 50,
2362      "options": {
2363        "legend": {
2364          "calcs": [],
2365          "displayMode": "list",
2366          "placement": "bottom"
2367        },
2368        "tooltip": {
2369          "mode": "single"
2370        }
2371      },
2372      "targets": [
2373        {
2374          "exemplar": true,
2375          "expr": "label_replace( sum(rate(hardware_system_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2376          "interval": "",
2377          "legendFormat": "host - {{hostname}}",
2378          "refId": "A"
2379        }
2380      ],
2381      "title": "Normalized System cpu - user",
2382      "type": "timeseries"
2383    },
2384    {
2385      "collapsed": false,
2386      "datasource": null,
2387      "gridPos": {
2388        "h": 1,
2389        "w": 24,
2390        "x": 0,
2391        "y": 53
2392      },
2393      "id": 28,
2394      "panels": [],
2395      "title": "System Network",
2396      "type": "row"
2397    },
2398    {
2399      "datasource": null,
2400      "description": "The average rate of physical bytes received per second by the eth0 network interface\n",
2401      "fieldConfig": {
2402        "defaults": {
2403          "color": {
2404            "mode": "palette-classic"
2405          },
2406          "custom": {
2407            "axisLabel": "",
2408            "axisPlacement": "auto",
2409            "barAlignment": 0,
2410            "drawStyle": "line",
2411            "fillOpacity": 0,
2412            "gradientMode": "none",
2413            "hideFrom": {
2414              "legend": false,
2415              "tooltip": false,
2416              "viz": false
2417            },
2418            "lineInterpolation": "linear",
2419            "lineWidth": 1,
2420            "pointSize": 5,
2421            "scaleDistribution": {
2422              "type": "linear"
2423            },
2424            "showPoints": "auto",
2425            "spanNulls": false,
2426            "stacking": {
2427              "group": "A",
2428              "mode": "none"
2429            },
2430            "thresholdsStyle": {
2431              "mode": "off"
2432            }
2433          },
2434          "mappings": [],
2435          "thresholds": {
2436            "mode": "absolute",
2437            "steps": [
2438              {
2439                "color": "green",
2440                "value": null
2441              },
2442              {
2443                "color": "red",
2444                "value": 80
2445              }
2446            ]
2447          },
2448          "unit": "Bps"
2449        },
2450        "overrides": []
2451      },
2452      "gridPos": {
2453        "h": 9,
2454        "w": 10,
2455        "x": 0,
2456        "y": 54
2457      },
2458      "id": 73,
2459      "options": {
2460        "legend": {
2461          "calcs": [],
2462          "displayMode": "list",
2463          "placement": "bottom"
2464        },
2465        "tooltip": {
2466          "mode": "single"
2467        }
2468      },
2469      "targets": [
2470        {
2471          "exemplar": true,
2472          "expr": "label_replace( sum(rate(hardware_system_network_eth0_bytes_in_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance) + sum(rate(hardware_system_network_lo_bytes_in_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2473          "interval": "",
2474          "legendFormat": "host - {{hostname}}",
2475          "refId": "A"
2476        }
2477      ],
2478      "title": "Network bytes In",
2479      "type": "timeseries"
2480    },
2481    {
2482      "datasource": null,
2483      "description": "The average rate of physical bytes transmitted per second by the eth0 network interface",
2484      "fieldConfig": {
2485        "defaults": {
2486          "color": {
2487            "mode": "palette-classic"
2488          },
2489          "custom": {
2490            "axisLabel": "",
2491            "axisPlacement": "auto",
2492            "barAlignment": 0,
2493            "drawStyle": "line",
2494            "fillOpacity": 0,
2495            "gradientMode": "none",
2496            "hideFrom": {
2497              "legend": false,
2498              "tooltip": false,
2499              "viz": false
2500            },
2501            "lineInterpolation": "linear",
2502            "lineWidth": 1,
2503            "pointSize": 5,
2504            "scaleDistribution": {
2505              "type": "linear"
2506            },
2507            "showPoints": "auto",
2508            "spanNulls": false,
2509            "stacking": {
2510              "group": "A",
2511              "mode": "none"
2512            },
2513            "thresholdsStyle": {
2514              "mode": "off"
2515            }
2516          },
2517          "mappings": [],
2518          "thresholds": {
2519            "mode": "absolute",
2520            "steps": [
2521              {
2522                "color": "green",
2523                "value": null
2524              },
2525              {
2526                "color": "red",
2527                "value": 80
2528              }
2529            ]
2530          },
2531          "unit": "Bps"
2532        },
2533        "overrides": []
2534      },
2535      "gridPos": {
2536        "h": 9,
2537        "w": 10,
2538        "x": 10,
2539        "y": 54
2540      },
2541      "id": 74,
2542      "options": {
2543        "legend": {
2544          "calcs": [],
2545          "displayMode": "list",
2546          "placement": "bottom"
2547        },
2548        "tooltip": {
2549          "mode": "single"
2550        }
2551      },
2552      "targets": [
2553        {
2554          "exemplar": true,
2555          "expr": "label_replace( sum(rate(hardware_system_network_eth0_bytes_out_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance) + sum(rate(hardware_system_network_lo_bytes_out_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2556          "interval": "",
2557          "legendFormat": "host - {{hostname}}",
2558          "refId": "A"
2559        }
2560      ],
2561      "title": "Network bytes Out",
2562      "type": "timeseries"
2563    },
2564    {
2565      "collapsed": false,
2566      "datasource": null,
2567      "gridPos": {
2568        "h": 1,
2569        "w": 24,
2570        "x": 0,
2571        "y": 63
2572      },
2573      "id": 30,
2574      "panels": [],
2575      "title": "System Disk",
2576      "type": "row"
2577    },
2578    {
2579      "datasource": null,
2580      "description": "The total bytes of free disk space on the disk partition used by MongoDB.\n",
2581      "fieldConfig": {
2582        "defaults": {
2583          "color": {
2584            "mode": "palette-classic"
2585          },
2586          "custom": {
2587            "axisLabel": "",
2588            "axisPlacement": "auto",
2589            "barAlignment": 0,
2590            "drawStyle": "line",
2591            "fillOpacity": 0,
2592            "gradientMode": "none",
2593            "hideFrom": {
2594              "legend": false,
2595              "tooltip": false,
2596              "viz": false
2597            },
2598            "lineInterpolation": "linear",
2599            "lineWidth": 1,
2600            "pointSize": 5,
2601            "scaleDistribution": {
2602              "type": "linear"
2603            },
2604            "showPoints": "auto",
2605            "spanNulls": false,
2606            "stacking": {
2607              "group": "A",
2608              "mode": "none"
2609            },
2610            "thresholdsStyle": {
2611              "mode": "off"
2612            }
2613          },
2614          "mappings": [],
2615          "thresholds": {
2616            "mode": "absolute",
2617            "steps": [
2618              {
2619                "color": "green",
2620                "value": null
2621              },
2622              {
2623                "color": "red",
2624                "value": 80
2625              }
2626            ]
2627          },
2628          "unit": "decbytes"
2629        },
2630        "overrides": []
2631      },
2632      "gridPos": {
2633        "h": 8,
2634        "w": 6,
2635        "x": 0,
2636        "y": 64
2637      },
2638      "id": 14,
2639      "options": {
2640        "legend": {
2641          "calcs": [],
2642          "displayMode": "list",
2643          "placement": "bottom"
2644        },
2645        "tooltip": {
2646          "mode": "single"
2647        }
2648      },
2649      "targets": [
2650        {
2651          "exemplar": true,
2652          "expr": "label_replace( sum(hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2653          "interval": "",
2654          "legendFormat": "disk - {{disk_name}}, host - {{hostname}} ",
2655          "refId": "A"
2656        }
2657      ],
2658      "title": "System Disk - Free",
2659      "type": "timeseries"
2660    },
2661    {
2662      "datasource": null,
2663      "description": "The percent of free disk space on the partition used by MongoDB.\n",
2664      "fieldConfig": {
2665        "defaults": {
2666          "color": {
2667            "mode": "palette-classic"
2668          },
2669          "custom": {
2670            "axisLabel": "",
2671            "axisPlacement": "auto",
2672            "barAlignment": 0,
2673            "drawStyle": "line",
2674            "fillOpacity": 0,
2675            "gradientMode": "none",
2676            "hideFrom": {
2677              "legend": false,
2678              "tooltip": false,
2679              "viz": false
2680            },
2681            "lineInterpolation": "linear",
2682            "lineWidth": 1,
2683            "pointSize": 5,
2684            "scaleDistribution": {
2685              "type": "linear"
2686            },
2687            "showPoints": "auto",
2688            "spanNulls": false,
2689            "stacking": {
2690              "group": "A",
2691              "mode": "none"
2692            },
2693            "thresholdsStyle": {
2694              "mode": "off"
2695            }
2696          },
2697          "mappings": [],
2698          "thresholds": {
2699            "mode": "absolute",
2700            "steps": [
2701              {
2702                "color": "green",
2703                "value": null
2704              },
2705              {
2706                "color": "red",
2707                "value": 80
2708              }
2709            ]
2710          },
2711          "unit": "percent"
2712        },
2713        "overrides": []
2714      },
2715      "gridPos": {
2716        "h": 8,
2717        "w": 6,
2718        "x": 6,
2719        "y": 64
2720      },
2721      "id": 71,
2722      "options": {
2723        "legend": {
2724          "calcs": [],
2725          "displayMode": "list",
2726          "placement": "bottom"
2727        },
2728        "tooltip": {
2729          "mode": "single"
2730        }
2731      },
2732      "targets": [
2733        {
2734          "exemplar": true,
2735          "expr": "label_replace( sum(hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"} / (hardware_disk_metrics_disk_space_used_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"} + hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) * 100) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2736          "interval": "",
2737          "legendFormat": "disk - {{disk_name}}, host - {{hostname}} ",
2738          "refId": "A"
2739        }
2740      ],
2741      "title": "System Disk Percent Free",
2742      "type": "timeseries"
2743    },
2744    {
2745      "datasource": null,
2746      "description": "The total bytes of used disk space on the partition that runs MongoDB.\n",
2747      "fieldConfig": {
2748        "defaults": {
2749          "color": {
2750            "mode": "palette-classic"
2751          },
2752          "custom": {
2753            "axisLabel": "",
2754            "axisPlacement": "auto",
2755            "barAlignment": 0,
2756            "drawStyle": "line",
2757            "fillOpacity": 0,
2758            "gradientMode": "none",
2759            "hideFrom": {
2760              "legend": false,
2761              "tooltip": false,
2762              "viz": false
2763            },
2764            "lineInterpolation": "linear",
2765            "lineWidth": 1,
2766            "pointSize": 5,
2767            "scaleDistribution": {
2768              "type": "linear"
2769            },
2770            "showPoints": "auto",
2771            "spanNulls": false,
2772            "stacking": {
2773              "group": "A",
2774              "mode": "none"
2775            },
2776            "thresholdsStyle": {
2777              "mode": "off"
2778            }
2779          },
2780          "mappings": [],
2781          "thresholds": {
2782            "mode": "absolute",
2783            "steps": [
2784              {
2785                "color": "green",
2786                "value": null
2787              },
2788              {
2789                "color": "red",
2790                "value": 80
2791              }
2792            ]
2793          },
2794          "unit": "decbytes"
2795        },
2796        "overrides": []
2797      },
2798      "gridPos": {
2799        "h": 8,
2800        "w": 6,
2801        "x": 12,
2802        "y": 64
2803      },
2804      "id": 36,
2805      "options": {
2806        "legend": {
2807          "calcs": [],
2808          "displayMode": "list",
2809          "placement": "bottom"
2810        },
2811        "tooltip": {
2812          "mode": "single"
2813        }
2814      },
2815      "targets": [
2816        {
2817          "exemplar": true,
2818          "expr": "label_replace( sum(hardware_disk_metrics_disk_space_used_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2819          "interval": "",
2820          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2821          "refId": "A"
2822        }
2823      ],
2824      "title": "System Disk - Used",
2825      "type": "timeseries"
2826    },
2827    {
2828      "datasource": null,
2829      "description": "The write throughput of I/O operations per second for the disk partition used for MongoDB.\n",
2830      "fieldConfig": {
2831        "defaults": {
2832          "color": {
2833            "mode": "palette-classic"
2834          },
2835          "custom": {
2836            "axisLabel": "",
2837            "axisPlacement": "auto",
2838            "barAlignment": 0,
2839            "drawStyle": "line",
2840            "fillOpacity": 0,
2841            "gradientMode": "none",
2842            "hideFrom": {
2843              "legend": false,
2844              "tooltip": false,
2845              "viz": false
2846            },
2847            "lineInterpolation": "linear",
2848            "lineWidth": 1,
2849            "pointSize": 5,
2850            "scaleDistribution": {
2851              "type": "linear"
2852            },
2853            "showPoints": "auto",
2854            "spanNulls": false,
2855            "stacking": {
2856              "group": "A",
2857              "mode": "none"
2858            },
2859            "thresholdsStyle": {
2860              "mode": "off"
2861            }
2862          },
2863          "mappings": [],
2864          "thresholds": {
2865            "mode": "absolute",
2866            "steps": [
2867              {
2868                "color": "green",
2869                "value": null
2870              },
2871              {
2872                "color": "red",
2873                "value": 80
2874              }
2875            ]
2876          },
2877          "unit": "/ sec"
2878        },
2879        "overrides": []
2880      },
2881      "gridPos": {
2882        "h": 8,
2883        "w": 6,
2884        "x": 18,
2885        "y": 64
2886      },
2887      "id": 63,
2888      "options": {
2889        "legend": {
2890          "calcs": [],
2891          "displayMode": "list",
2892          "placement": "bottom"
2893        },
2894        "tooltip": {
2895          "mode": "single"
2896        }
2897      },
2898      "targets": [
2899        {
2900          "exemplar": true,
2901          "expr": "label_replace( sum(rate(hardware_disk_metrics_write_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2902          "hide": false,
2903          "interval": "",
2904          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2905          "refId": "B"
2906        }
2907      ],
2908      "title": "System Disk Write IOPS",
2909      "type": "timeseries"
2910    },
2911    {
2912      "datasource": null,
2913      "description": "The write latency in milliseconds of the disk partition used by MongoDB.\n",
2914      "fieldConfig": {
2915        "defaults": {
2916          "color": {
2917            "mode": "palette-classic"
2918          },
2919          "custom": {
2920            "axisLabel": "",
2921            "axisPlacement": "auto",
2922            "barAlignment": 0,
2923            "drawStyle": "line",
2924            "fillOpacity": 0,
2925            "gradientMode": "none",
2926            "hideFrom": {
2927              "legend": false,
2928              "tooltip": false,
2929              "viz": false
2930            },
2931            "lineInterpolation": "linear",
2932            "lineWidth": 1,
2933            "pointSize": 5,
2934            "scaleDistribution": {
2935              "type": "linear"
2936            },
2937            "showPoints": "auto",
2938            "spanNulls": false,
2939            "stacking": {
2940              "group": "A",
2941              "mode": "none"
2942            },
2943            "thresholdsStyle": {
2944              "mode": "off"
2945            }
2946          },
2947          "mappings": [],
2948          "thresholds": {
2949            "mode": "absolute",
2950            "steps": [
2951              {
2952                "color": "green",
2953                "value": null
2954              },
2955              {
2956                "color": "red",
2957                "value": 80
2958              }
2959            ]
2960          },
2961          "unit": "ms"
2962        },
2963        "overrides": []
2964      },
2965      "gridPos": {
2966        "h": 8,
2967        "w": 6,
2968        "x": 0,
2969        "y": 72
2970      },
2971      "id": 64,
2972      "options": {
2973        "legend": {
2974          "calcs": [],
2975          "displayMode": "list",
2976          "placement": "bottom"
2977        },
2978        "tooltip": {
2979          "mode": "single"
2980        }
2981      },
2982      "targets": [
2983        {
2984          "exemplar": true,
2985          "expr": "label_replace( sum(rate(hardware_disk_metrics_write_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / rate(hardware_disk_metrics_write_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2986          "hide": false,
2987          "interval": "",
2988          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2989          "refId": "B"
2990        }
2991      ],
2992      "title": "System Disk Write Latency",
2993      "type": "timeseries"
2994    },
2995    {
2996      "datasource": null,
2997      "description": "The Read latency in milliseconds of the disk partition used by MongoDB.\n",
2998      "fieldConfig": {
2999        "defaults": {
3000          "color": {
3001            "mode": "palette-classic"
3002          },
3003          "custom": {
3004            "axisLabel": "",
3005            "axisPlacement": "auto",
3006            "barAlignment": 0,
3007            "drawStyle": "line",
3008            "fillOpacity": 0,
3009            "gradientMode": "none",
3010            "hideFrom": {
3011              "legend": false,
3012              "tooltip": false,
3013              "viz": false
3014            },
3015            "lineInterpolation": "linear",
3016            "lineWidth": 1,
3017            "pointSize": 5,
3018            "scaleDistribution": {
3019              "type": "linear"
3020            },
3021            "showPoints": "auto",
3022            "spanNulls": false,
3023            "stacking": {
3024              "group": "A",
3025              "mode": "none"
3026            },
3027            "thresholdsStyle": {
3028              "mode": "off"
3029            }
3030          },
3031          "mappings": [],
3032          "thresholds": {
3033            "mode": "absolute",
3034            "steps": [
3035              {
3036                "color": "green",
3037                "value": null
3038              },
3039              {
3040                "color": "red",
3041                "value": 80
3042              }
3043            ]
3044          },
3045          "unit": "ms"
3046        },
3047        "overrides": []
3048      },
3049      "gridPos": {
3050        "h": 8,
3051        "w": 6,
3052        "x": 6,
3053        "y": 72
3054      },
3055      "id": 65,
3056      "options": {
3057        "legend": {
3058          "calcs": [],
3059          "displayMode": "list",
3060          "placement": "bottom"
3061        },
3062        "tooltip": {
3063          "mode": "single"
3064        }
3065      },
3066      "targets": [
3067        {
3068          "exemplar": true,
3069          "expr": "label_replace( sum(rate(hardware_disk_metrics_read_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / rate(hardware_disk_metrics_read_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3070          "hide": false,
3071          "interval": "",
3072          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3073          "refId": "B"
3074        }
3075      ],
3076      "title": "System Disk Read Latency",
3077      "type": "timeseries"
3078    },
3079    {
3080      "datasource": null,
3081      "description": "The read throughput of I/O operations per second for the disk partition used for MongoDB.\n",
3082      "fieldConfig": {
3083        "defaults": {
3084          "color": {
3085            "mode": "palette-classic"
3086          },
3087          "custom": {
3088            "axisLabel": "",
3089            "axisPlacement": "auto",
3090            "barAlignment": 0,
3091            "drawStyle": "line",
3092            "fillOpacity": 0,
3093            "gradientMode": "none",
3094            "hideFrom": {
3095              "legend": false,
3096              "tooltip": false,
3097              "viz": false
3098            },
3099            "lineInterpolation": "linear",
3100            "lineWidth": 1,
3101            "pointSize": 5,
3102            "scaleDistribution": {
3103              "type": "linear"
3104            },
3105            "showPoints": "auto",
3106            "spanNulls": false,
3107            "stacking": {
3108              "group": "A",
3109              "mode": "none"
3110            },
3111            "thresholdsStyle": {
3112              "mode": "off"
3113            }
3114          },
3115          "mappings": [],
3116          "thresholds": {
3117            "mode": "absolute",
3118            "steps": [
3119              {
3120                "color": "green",
3121                "value": null
3122              },
3123              {
3124                "color": "red",
3125                "value": 80
3126              }
3127            ]
3128          },
3129          "unit": "/ sec"
3130        },
3131        "overrides": []
3132      },
3133      "gridPos": {
3134        "h": 8,
3135        "w": 6,
3136        "x": 12,
3137        "y": 72
3138      },
3139      "id": 62,
3140      "options": {
3141        "legend": {
3142          "calcs": [],
3143          "displayMode": "list",
3144          "placement": "bottom"
3145        },
3146        "tooltip": {
3147          "mode": "single"
3148        }
3149      },
3150      "targets": [
3151        {
3152          "exemplar": true,
3153          "expr": "label_replace( sum(rate(hardware_disk_metrics_read_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3154          "interval": "",
3155          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3156          "refId": "A"
3157        }
3158      ],
3159      "title": "System Disk Read IOPS",
3160      "type": "timeseries"
3161    },
3162    {
3163      "datasource": null,
3164      "description": "The percentage of time during which requests are being issued to and serviced by the partition. This includes requests from any process, not just MongoDB processes.\n",
3165      "fieldConfig": {
3166        "defaults": {
3167          "color": {
3168            "mode": "palette-classic"
3169          },
3170          "custom": {
3171            "axisLabel": "",
3172            "axisPlacement": "auto",
3173            "barAlignment": 0,
3174            "drawStyle": "line",
3175            "fillOpacity": 0,
3176            "gradientMode": "none",
3177            "hideFrom": {
3178              "legend": false,
3179              "tooltip": false,
3180              "viz": false
3181            },
3182            "lineInterpolation": "linear",
3183            "lineWidth": 1,
3184            "pointSize": 5,
3185            "scaleDistribution": {
3186              "type": "linear"
3187            },
3188            "showPoints": "auto",
3189            "spanNulls": false,
3190            "stacking": {
3191              "group": "A",
3192              "mode": "none"
3193            },
3194            "thresholdsStyle": {
3195              "mode": "off"
3196            }
3197          },
3198          "mappings": [],
3199          "thresholds": {
3200            "mode": "absolute",
3201            "steps": [
3202              {
3203                "color": "green",
3204                "value": null
3205              },
3206              {
3207                "color": "red",
3208                "value": 80
3209              }
3210            ]
3211          },
3212          "unit": "percent"
3213        },
3214        "overrides": []
3215      },
3216      "gridPos": {
3217        "h": 8,
3218        "w": 6,
3219        "x": 18,
3220        "y": 72
3221      },
3222      "id": 67,
3223      "options": {
3224        "legend": {
3225          "calcs": [],
3226          "displayMode": "list",
3227          "placement": "bottom"
3228        },
3229        "tooltip": {
3230          "mode": "single"
3231        }
3232      },
3233      "targets": [
3234        {
3235          "exemplar": true,
3236          "expr": "label_replace( sum(rate(hardware_disk_metrics_total_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) ) by (instance, disk_name) / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3237          "hide": false,
3238          "interval": "",
3239          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3240          "refId": "B"
3241        }
3242      ],
3243      "title": "System Disk Util %",
3244      "type": "timeseries"
3245    },
3246    {
3247      "datasource": null,
3248      "description": "The average length of queue of requests issued to the disk partition used by MongoDB.\n",
3249      "fieldConfig": {
3250        "defaults": {
3251          "color": {
3252            "mode": "palette-classic"
3253          },
3254          "custom": {
3255            "axisLabel": "",
3256            "axisPlacement": "auto",
3257            "barAlignment": 0,
3258            "drawStyle": "line",
3259            "fillOpacity": 0,
3260            "gradientMode": "none",
3261            "hideFrom": {
3262              "legend": false,
3263              "tooltip": false,
3264              "viz": false
3265            },
3266            "lineInterpolation": "linear",
3267            "lineWidth": 1,
3268            "pointSize": 5,
3269            "scaleDistribution": {
3270              "type": "linear"
3271            },
3272            "showPoints": "auto",
3273            "spanNulls": false,
3274            "stacking": {
3275              "group": "A",
3276              "mode": "none"
3277            },
3278            "thresholdsStyle": {
3279              "mode": "off"
3280            }
3281          },
3282          "mappings": [],
3283          "thresholds": {
3284            "mode": "absolute",
3285            "steps": [
3286              {
3287                "color": "green",
3288                "value": null
3289              },
3290              {
3291                "color": "red",
3292                "value": 80
3293              }
3294            ]
3295          },
3296          "unit": "ms"
3297        },
3298        "overrides": []
3299      },
3300      "gridPos": {
3301        "h": 8,
3302        "w": 6,
3303        "x": 0,
3304        "y": 80
3305      },
3306      "id": 66,
3307      "options": {
3308        "legend": {
3309          "calcs": [],
3310          "displayMode": "list",
3311          "placement": "bottom"
3312        },
3313        "tooltip": {
3314          "mode": "single"
3315        }
3316      },
3317      "targets": [
3318        {
3319          "exemplar": true,
3320          "expr": "label_replace( sum(rate(hardware_disk_metrics_weighted_time_io_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) ) by (instance, DiskName), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3321          "hide": false,
3322          "interval": "",
3323          "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3324          "refId": "B"
3325        }
3326      ],
3327      "title": "System Disk Queue Depth",
3328      "type": "timeseries"
3329    },
3330    {
3331      "collapsed": false,
3332      "datasource": null,
3333      "gridPos": {
3334        "h": 1,
3335        "w": 24,
3336        "x": 0,
3337        "y": 88
3338      },
3339      "id": 32,
3340      "panels": [],
3341      "title": "Process CPU",
3342      "type": "row"
3343    },
3344    {
3345      "datasource": null,
3346      "description": "The percentage of time the CPU spent servicing this MongoDB process, scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
3347      "fieldConfig": {
3348        "defaults": {
3349          "color": {
3350            "mode": "palette-classic"
3351          },
3352          "custom": {
3353            "axisLabel": "",
3354            "axisPlacement": "auto",
3355            "barAlignment": 0,
3356            "drawStyle": "line",
3357            "fillOpacity": 0,
3358            "gradientMode": "none",
3359            "hideFrom": {
3360              "legend": false,
3361              "tooltip": false,
3362              "viz": false
3363            },
3364            "lineInterpolation": "linear",
3365            "lineWidth": 1,
3366            "pointSize": 5,
3367            "scaleDistribution": {
3368              "type": "linear"
3369            },
3370            "showPoints": "auto",
3371            "spanNulls": false,
3372            "stacking": {
3373              "group": "A",
3374              "mode": "none"
3375            },
3376            "thresholdsStyle": {
3377              "mode": "off"
3378            }
3379          },
3380          "mappings": [],
3381          "thresholds": {
3382            "mode": "absolute",
3383            "steps": [
3384              {
3385                "color": "green",
3386                "value": null
3387              },
3388              {
3389                "color": "red",
3390                "value": 80
3391              }
3392            ]
3393          },
3394          "unit": "percent"
3395        },
3396        "overrides": []
3397      },
3398      "gridPos": {
3399        "h": 7,
3400        "w": 6,
3401        "x": 0,
3402        "y": 89
3403      },
3404      "id": 54,
3405      "options": {
3406        "legend": {
3407          "calcs": [],
3408          "displayMode": "list",
3409          "placement": "bottom"
3410        },
3411        "tooltip": {
3412          "mode": "single"
3413        }
3414      },
3415      "targets": [
3416        {
3417          "exemplar": true,
3418          "expr": "label_replace((sum(rate(hardware_process_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3419          "interval": "",
3420          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3421          "refId": "A"
3422        }
3423      ],
3424      "title": "Normalized Process cpu - user",
3425      "type": "timeseries"
3426    },
3427    {
3428      "datasource": null,
3429      "description": "",
3430      "fieldConfig": {
3431        "defaults": {
3432          "color": {
3433            "mode": "palette-classic"
3434          },
3435          "custom": {
3436            "axisLabel": "",
3437            "axisPlacement": "auto",
3438            "barAlignment": 0,
3439            "drawStyle": "line",
3440            "fillOpacity": 0,
3441            "gradientMode": "none",
3442            "hideFrom": {
3443              "legend": false,
3444              "tooltip": false,
3445              "viz": false
3446            },
3447            "lineInterpolation": "linear",
3448            "lineWidth": 1,
3449            "pointSize": 5,
3450            "scaleDistribution": {
3451              "type": "linear"
3452            },
3453            "showPoints": "auto",
3454            "spanNulls": false,
3455            "stacking": {
3456              "group": "A",
3457              "mode": "none"
3458            },
3459            "thresholdsStyle": {
3460              "mode": "off"
3461            }
3462          },
3463          "mappings": [],
3464          "thresholds": {
3465            "mode": "absolute",
3466            "steps": [
3467              {
3468                "color": "green",
3469                "value": null
3470              },
3471              {
3472                "color": "red",
3473                "value": 80
3474              }
3475            ]
3476          },
3477          "unit": "percent"
3478        },
3479        "overrides": []
3480      },
3481      "gridPos": {
3482        "h": 7,
3483        "w": 6,
3484        "x": 6,
3485        "y": 89
3486      },
3487      "id": 58,
3488      "options": {
3489        "legend": {
3490          "calcs": [],
3491          "displayMode": "list",
3492          "placement": "bottom"
3493        },
3494        "tooltip": {
3495          "mode": "single"
3496        }
3497      },
3498      "targets": [
3499        {
3500          "exemplar": true,
3501          "expr": "label_replace((sum(rate(hardware_process_cpu_children_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3502          "interval": "",
3503          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3504          "refId": "A"
3505        }
3506      ],
3507      "title": "Normalized Process cpu - children user",
3508      "type": "timeseries"
3509    },
3510    {
3511      "datasource": null,
3512      "description": "The percentage of time the CPU spent servicing operating system calls for this MongoDB process, scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
3513      "fieldConfig": {
3514        "defaults": {
3515          "color": {
3516            "mode": "palette-classic"
3517          },
3518          "custom": {
3519            "axisLabel": "",
3520            "axisPlacement": "auto",
3521            "barAlignment": 0,
3522            "drawStyle": "line",
3523            "fillOpacity": 0,
3524            "gradientMode": "none",
3525            "hideFrom": {
3526              "legend": false,
3527              "tooltip": false,
3528              "viz": false
3529            },
3530            "lineInterpolation": "linear",
3531            "lineWidth": 1,
3532            "pointSize": 5,
3533            "scaleDistribution": {
3534              "type": "linear"
3535            },
3536            "showPoints": "auto",
3537            "spanNulls": false,
3538            "stacking": {
3539              "group": "A",
3540              "mode": "none"
3541            },
3542            "thresholdsStyle": {
3543              "mode": "off"
3544            }
3545          },
3546          "mappings": [],
3547          "thresholds": {
3548            "mode": "absolute",
3549            "steps": [
3550              {
3551                "color": "green",
3552                "value": null
3553              },
3554              {
3555                "color": "red",
3556                "value": 80
3557              }
3558            ]
3559          },
3560          "unit": "percent"
3561        },
3562        "overrides": []
3563      },
3564      "gridPos": {
3565        "h": 7,
3566        "w": 6,
3567        "x": 12,
3568        "y": 89
3569      },
3570      "id": 55,
3571      "options": {
3572        "legend": {
3573          "calcs": [],
3574          "displayMode": "list",
3575          "placement": "bottom"
3576        },
3577        "tooltip": {
3578          "mode": "single"
3579        }
3580      },
3581      "targets": [
3582        {
3583          "exemplar": true,
3584          "expr": "label_replace((sum(rate(hardware_process_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3585          "interval": "",
3586          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3587          "refId": "A"
3588        }
3589      ],
3590      "title": "Normalized Process cpu - kernel",
3591      "type": "timeseries"
3592    },
3593    {
3594      "datasource": null,
3595      "description": "",
3596      "fieldConfig": {
3597        "defaults": {
3598          "color": {
3599            "mode": "palette-classic"
3600          },
3601          "custom": {
3602            "axisLabel": "",
3603            "axisPlacement": "auto",
3604            "barAlignment": 0,
3605            "drawStyle": "line",
3606            "fillOpacity": 0,
3607            "gradientMode": "none",
3608            "hideFrom": {
3609              "legend": false,
3610              "tooltip": false,
3611              "viz": false
3612            },
3613            "lineInterpolation": "linear",
3614            "lineWidth": 1,
3615            "pointSize": 5,
3616            "scaleDistribution": {
3617              "type": "linear"
3618            },
3619            "showPoints": "auto",
3620            "spanNulls": false,
3621            "stacking": {
3622              "group": "A",
3623              "mode": "none"
3624            },
3625            "thresholdsStyle": {
3626              "mode": "off"
3627            }
3628          },
3629          "mappings": [],
3630          "thresholds": {
3631            "mode": "absolute",
3632            "steps": [
3633              {
3634                "color": "green",
3635                "value": null
3636              },
3637              {
3638                "color": "red",
3639                "value": 80
3640              }
3641            ]
3642          },
3643          "unit": "percent"
3644        },
3645        "overrides": []
3646      },
3647      "gridPos": {
3648        "h": 7,
3649        "w": 6,
3650        "x": 18,
3651        "y": 89
3652      },
3653      "id": 57,
3654      "options": {
3655        "legend": {
3656          "calcs": [],
3657          "displayMode": "list",
3658          "placement": "bottom"
3659        },
3660        "tooltip": {
3661          "mode": "single"
3662        }
3663      },
3664      "targets": [
3665        {
3666          "exemplar": true,
3667          "expr": "label_replace((sum(rate(hardware_process_cpu_children_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3668          "interval": "",
3669          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3670          "refId": "A"
3671        }
3672      ],
3673      "title": "Normalized Process cpu - children kernel",
3674      "type": "timeseries"
3675    },
3676    {
3677      "datasource": null,
3678      "description": "The percentage of time the CPU spent servicing this MongoDB process. For servers with more than 1 CPU core, this value can exceed 100%.\n",
3679      "fieldConfig": {
3680        "defaults": {
3681          "color": {
3682            "mode": "palette-classic"
3683          },
3684          "custom": {
3685            "axisLabel": "",
3686            "axisPlacement": "auto",
3687            "barAlignment": 0,
3688            "drawStyle": "line",
3689            "fillOpacity": 0,
3690            "gradientMode": "none",
3691            "hideFrom": {
3692              "legend": false,
3693              "tooltip": false,
3694              "viz": false
3695            },
3696            "lineInterpolation": "linear",
3697            "lineWidth": 1,
3698            "pointSize": 5,
3699            "scaleDistribution": {
3700              "type": "linear"
3701            },
3702            "showPoints": "auto",
3703            "spanNulls": false,
3704            "stacking": {
3705              "group": "A",
3706              "mode": "none"
3707            },
3708            "thresholdsStyle": {
3709              "mode": "off"
3710            }
3711          },
3712          "mappings": [],
3713          "thresholds": {
3714            "mode": "absolute",
3715            "steps": [
3716              {
3717                "color": "green",
3718                "value": null
3719              },
3720              {
3721                "color": "red",
3722                "value": 80
3723              }
3724            ]
3725          },
3726          "unit": "percent"
3727        },
3728        "overrides": []
3729      },
3730      "gridPos": {
3731        "h": 7,
3732        "w": 6,
3733        "x": 0,
3734        "y": 96
3735      },
3736      "id": 56,
3737      "options": {
3738        "legend": {
3739          "calcs": [],
3740          "displayMode": "list",
3741          "placement": "bottom"
3742        },
3743        "tooltip": {
3744          "mode": "single"
3745        }
3746      },
3747      "targets": [
3748        {
3749          "exemplar": true,
3750          "expr": "label_replace(sum(rate(hardware_process_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3751          "interval": "",
3752          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3753          "refId": "A"
3754        }
3755      ],
3756      "title": "Process cpu - user",
3757      "type": "timeseries"
3758    },
3759    {
3760      "datasource": null,
3761      "description": "",
3762      "fieldConfig": {
3763        "defaults": {
3764          "color": {
3765            "mode": "palette-classic"
3766          },
3767          "custom": {
3768            "axisLabel": "",
3769            "axisPlacement": "auto",
3770            "barAlignment": 0,
3771            "drawStyle": "line",
3772            "fillOpacity": 0,
3773            "gradientMode": "none",
3774            "hideFrom": {
3775              "legend": false,
3776              "tooltip": false,
3777              "viz": false
3778            },
3779            "lineInterpolation": "linear",
3780            "lineWidth": 1,
3781            "pointSize": 5,
3782            "scaleDistribution": {
3783              "type": "linear"
3784            },
3785            "showPoints": "auto",
3786            "spanNulls": false,
3787            "stacking": {
3788              "group": "A",
3789              "mode": "none"
3790            },
3791            "thresholdsStyle": {
3792              "mode": "off"
3793            }
3794          },
3795          "mappings": [],
3796          "thresholds": {
3797            "mode": "absolute",
3798            "steps": [
3799              {
3800                "color": "green",
3801                "value": null
3802              },
3803              {
3804                "color": "red",
3805                "value": 80
3806              }
3807            ]
3808          },
3809          "unit": "percent"
3810        },
3811        "overrides": []
3812      },
3813      "gridPos": {
3814        "h": 7,
3815        "w": 6,
3816        "x": 6,
3817        "y": 96
3818      },
3819      "id": 59,
3820      "options": {
3821        "legend": {
3822          "calcs": [],
3823          "displayMode": "list",
3824          "placement": "bottom"
3825        },
3826        "tooltip": {
3827          "mode": "single"
3828        }
3829      },
3830      "targets": [
3831        {
3832          "exemplar": true,
3833          "expr": "label_replace(sum(rate(hardware_process_cpu_children_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3834          "interval": "",
3835          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3836          "refId": "A"
3837        }
3838      ],
3839      "title": "Process cpu - child user",
3840      "type": "timeseries"
3841    },
3842    {
3843      "datasource": null,
3844      "description": "The percentage of time the CPU spent servicing operating system calls for this MongoDB process. For servers with more than 1 CPU core, this value can exceed 100%.\n",
3845      "fieldConfig": {
3846        "defaults": {
3847          "color": {
3848            "mode": "palette-classic"
3849          },
3850          "custom": {
3851            "axisLabel": "",
3852            "axisPlacement": "auto",
3853            "barAlignment": 0,
3854            "drawStyle": "line",
3855            "fillOpacity": 0,
3856            "gradientMode": "none",
3857            "hideFrom": {
3858              "legend": false,
3859              "tooltip": false,
3860              "viz": false
3861            },
3862            "lineInterpolation": "linear",
3863            "lineWidth": 1,
3864            "pointSize": 5,
3865            "scaleDistribution": {
3866              "type": "linear"
3867            },
3868            "showPoints": "auto",
3869            "spanNulls": false,
3870            "stacking": {
3871              "group": "A",
3872              "mode": "none"
3873            },
3874            "thresholdsStyle": {
3875              "mode": "off"
3876            }
3877          },
3878          "mappings": [],
3879          "thresholds": {
3880            "mode": "absolute",
3881            "steps": [
3882              {
3883                "color": "green",
3884                "value": null
3885              },
3886              {
3887                "color": "red",
3888                "value": 80
3889              }
3890            ]
3891          },
3892          "unit": "percent"
3893        },
3894        "overrides": []
3895      },
3896      "gridPos": {
3897        "h": 7,
3898        "w": 6,
3899        "x": 12,
3900        "y": 96
3901      },
3902      "id": 60,
3903      "options": {
3904        "legend": {
3905          "calcs": [],
3906          "displayMode": "list",
3907          "placement": "bottom"
3908        },
3909        "tooltip": {
3910          "mode": "single"
3911        }
3912      },
3913      "targets": [
3914        {
3915          "exemplar": true,
3916          "expr": "label_replace(sum(rate(hardware_process_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3917          "interval": "",
3918          "legendFormat": "host - {{hostname}} port - {{process_port}}",
3919          "refId": "A"
3920        }
3921      ],
3922      "title": "Process cpu - kernel",
3923      "type": "timeseries"
3924    },
3925    {
3926      "datasource": null,
3927      "description": "",
3928      "fieldConfig": {
3929        "defaults": {
3930          "color": {
3931            "mode": "palette-classic"
3932          },
3933          "custom": {
3934            "axisLabel": "",
3935            "axisPlacement": "auto",
3936            "barAlignment": 0,
3937            "drawStyle": "line",
3938            "fillOpacity": 0,
3939            "gradientMode": "none",
3940            "hideFrom": {
3941              "legend": false,
3942              "tooltip": false,
3943              "viz": false
3944            },
3945            "lineInterpolation": "linear",
3946            "lineWidth": 1,
3947            "pointSize": 5,
3948            "scaleDistribution": {
3949              "type": "linear"
3950            },
3951            "showPoints": "auto",
3952            "spanNulls": false,
3953            "stacking": {
3954              "group": "A",
3955              "mode": "none"
3956            },
3957            "thresholdsStyle": {
3958              "mode": "off"
3959            }
3960          },
3961          "mappings": [],
3962          "thresholds": {
3963            "mode": "absolute",
3964            "steps": [
3965              {
3966                "color": "green",
3967                "value": null
3968              },
3969              {
3970                "color": "red",
3971                "value": 80
3972              }
3973            ]
3974          },
3975          "unit": "percent"
3976        },
3977        "overrides": []
3978      },
3979      "gridPos": {
3980        "h": 7,
3981        "w": 6,
3982        "x": 18,
3983        "y": 96
3984      },
3985      "id": 61,
3986      "options": {
3987        "legend": {
3988          "calcs": [],
3989          "displayMode": "list",
3990          "placement": "bottom"
3991        },
3992        "tooltip": {
3993          "mode": "single"
3994        }
3995      },
3996      "targets": [
3997        {
3998          "exemplar": true,
3999          "expr": "label_replace(sum(rate(hardware_process_cpu_children_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
4000          "interval": "",
4001          "legendFormat": "host - {{hostname}} port - {{process_port}}",
4002          "refId": "A"
4003        }
4004      ],
4005      "title": "Process cpu - children kernel",
4006      "type": "timeseries"
4007    }
4008  ],
4009  "refresh": false,
4010  "schemaVersion": 31,
4011  "style": "dark",
4012  "tags": [],
4013  "templating": {
4014    "list": [
4015      {
4016        "current": {
4017          "selected": false,
4018          "text": "Prometheus",
4019          "value": "Prometheus"
4020        },
4021        "description": null,
4022        "error": null,
4023        "hide": 0,
4024        "includeAll": false,
4025        "label": null,
4026        "multi": false,
4027        "name": "Datasource",
4028        "options": [],
4029        "query": "prometheus",
4030        "queryValue": "",
4031        "refresh": 1,
4032        "regex": "",
4033        "skipUrlSync": false,
4034        "type": "datasource"
4035      },
4036      {
4037        "allValue": null,
4038        "current": {
4039          "selected": false,
4040          "text": "611c15fc5851c22d37e3f351",
4041          "value": "611c15fc5851c22d37e3f351"
4042        },
4043        "datasource": null,
4044        "definition": "label_values(group_id)",
4045        "description": null,
4046        "error": null,
4047        "hide": 0,
4048        "includeAll": false,
4049        "label": "Group Id",
4050        "multi": false,
4051        "name": "group_id",
4052        "options": [],
4053        "query": {
4054          "query": "label_values(group_id)",
4055          "refId": "StandardVariableQuery"
4056        },
4057        "refresh": 1,
4058        "regex": "",
4059        "skipUrlSync": false,
4060        "sort": 0,
4061        "type": "query"
4062      },
4063      {
4064        "allValue": null,
4065        "current": {
4066          "selected": false,
4067          "text": "Cluster0",
4068          "value": "Cluster0"
4069        },
4070        "datasource": null,
4071        "definition": "label_values(mongodb_up{group_id='$group_id'}, cluster_name)",
4072        "description": null,
4073        "error": null,
4074        "hide": 0,
4075        "includeAll": false,
4076        "label": "Cluster Name",
4077        "multi": false,
4078        "name": "cluster_name",
4079        "options": [],
4080        "query": {
4081          "query": "label_values(mongodb_up{group_id='$group_id'}, cluster_name)",
4082          "refId": "StandardVariableQuery"
4083        },
4084        "refresh": 2,
4085        "regex": "",
4086        "skipUrlSync": false,
4087        "sort": 0,
4088        "type": "query"
4089      },
4090      {
4091        "allValue": null,
4092        "current": {
4093          "selected": true,
4094          "text": [
4095            "All"
4096          ],
4097          "value": [
4098            "$__all"
4099          ]
4100        },
4101        "datasource": null,
4102        "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name'}, replica_set_name)",
4103        "description": null,
4104        "error": null,
4105        "hide": 0,
4106        "includeAll": true,
4107        "label": "Replica set name",
4108        "multi": true,
4109        "name": "replica_set_name",
4110        "options": [],
4111        "query": {
4112          "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name'}, replica_set_name)",
4113          "refId": "StandardVariableQuery"
4114        },
4115        "refresh": 2,
4116        "regex": "",
4117        "skipUrlSync": false,
4118        "sort": 0,
4119        "type": "query"
4120      },
4121      {
4122        "allValue": null,
4123        "current": {
4124          "selected": true,
4125          "text": [
4126            "All"
4127          ],
4128          "value": [
4129            "$__all"
4130          ]
4131        },
4132        "datasource": null,
4133        "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},instance)",
4134        "description": null,
4135        "error": null,
4136        "hide": 0,
4137        "includeAll": true,
4138        "label": null,
4139        "multi": true,
4140        "name": "host",
4141        "options": [],
4142        "query": {
4143          "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},instance)",
4144          "refId": "StandardVariableQuery"
4145        },
4146        "refresh": 2,
4147        "regex": "(.*):.*",
4148        "skipUrlSync": false,
4149        "sort": 0,
4150        "type": "query"
4151      },
4152      {
4153        "allValue": null,
4154        "current": {
4155          "selected": true,
4156          "text": [
4157            "All"
4158          ],
4159          "value": [
4160            "$__all"
4161          ]
4162        },
4163        "datasource": null,
4164        "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},process_port)",
4165        "description": "Only applicable for process level metrics",
4166        "error": null,
4167        "hide": 0,
4168        "includeAll": true,
4169        "label": "Process Port",
4170        "multi": true,
4171        "name": "process_port",
4172        "options": [],
4173        "query": {
4174          "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},process_port)",
4175          "refId": "StandardVariableQuery"
4176        },
4177        "refresh": 1,
4178        "regex": "",
4179        "skipUrlSync": false,
4180        "sort": 0,
4181        "type": "query"
4182      },
4183      {
4184        "auto": true,
4185        "auto_count": 30,
4186        "auto_min": "10s",
4187        "current": {
4188          "selected": false,
4189          "text": "1m",
4190          "value": "1m"
4191        },
4192        "description": null,
4193        "error": null,
4194        "hide": 0,
4195        "label": "Interval",
4196        "name": "interval",
4197        "options": [
4198          {
4199            "selected": false,
4200            "text": "auto",
4201            "value": "$__auto_interval_interval"
4202          },
4203          {
4204            "selected": false,
4205            "text": "30s",
4206            "value": "30s"
4207          },
4208          {
4209            "selected": true,
4210            "text": "1m",
4211            "value": "1m"
4212          },
4213          {
4214            "selected": false,
4215            "text": "5m",
4216            "value": "5m"
4217          },
4218          {
4219            "selected": false,
4220            "text": "30m",
4221            "value": "30m"
4222          },
4223          {
4224            "selected": false,
4225            "text": "1h",
4226            "value": "1h"
4227          },
4228          {
4229            "selected": false,
4230            "text": "1d",
4231            "value": "1d"
4232          }
4233        ],
4234        "query": "30s,1m,5m,30m,1h,1d",
4235        "queryValue": "",
4236        "refresh": 2,
4237        "skipUrlSync": false,
4238        "type": "interval"
4239      }
4240    ]
4241  },
4242  "time": {
4243    "from": "now-30m",
4244    "to": "now"
4245  },
4246  "timepicker": {},
4247  "timezone": "",
4248  "title": "Hardware Metrics - Atlas - new",
4249  "uid": "7LTNNcpnzsasddsd",
4250  "version": 1
4251 }

To learn more about importing Grafana dashboards, see the Grafana documentation.

Performance Metrics Available to Prometheus

The following metrics are available when you use the Prometheus integration with your MongoDB Atlas cluster:

MongoDB Metric Labels
- serverStatus metrics
- replSetStatus metrics
Hardware Metrics

MongoDB Metric Labels

Each MongoDB metric contains the following labels:

Label	Description
`group_id`	Unique hexadecimal digit string that identifies the project.
`org_id`	Unique hexadecimal digit string that identifies the organization.
`cl_role`	Human readable label that defines the cluster role.
`cl_name`	Human-readable label that identifies the cluster.
`rs_nm`	Human-readable label that identifies the replica set.
`rs_state`	Number that indicates the replica set state.
`process_port`	Port on which the process runs.

MongoDB Information Metrics

mongodb_info is a gauge that always has the value of 1. This metric contains all the MongoDB Metric Labels and also the following labels:

Label	Description
`mongodb_version`	String that represents the major, minor, and patch versions.
`replica_state_name`	String that indicates the replica set member status.
`process_type`	String that indicates the process running. Its values can be `mongod`, `mongos`, or `config`.

Hardware Metrics

Note

You can also view descriptions of each hardware metric in the Prometheus expression browser.

Name	Operating System	Type	Description
`hardware_system_cpu_nice`	Unix, Darwin	Counter	Time spent in user mode with low priority.
`hardware_system_cpu_io_wait`	Unix	Counter	Time waiting for I/O to complete.
`hardware_system_cpu_irq`	Unix	Counter	Time spent servicing interrupts.
`hardware_system_cpu_soft_irq`	Unix	Counter	Time spent servicing softirq's.
`hardware_system_cpu_steal`	Unix	Counter	Time spent in other operating systems when running in a virtual environment.
`hardware_system_cpu_guest`	Unix	Counter	Time spent running a virtual CPU for the guest operating systems under the control of the Linux kernel.
`hardware_system_cpu_guest_nice`	Unix	Counter	Time spent running a guest with an adjusted niceness.
`hardware_system_cpu_kernel_milliseconds`	All	Counter	Time spent in system mode.
`hardware_system_cpu_user_milliseconds`	All	Counter	Time spent in user mode.
`hardware_disk_metrics_weighted_time_io`	Unix	Counter	Weighted time spent doing I/O's.
`hardware_disk_metrics_physical_write_count`	Unix	Counter	Number of physical write I/O's processed.
`hardware_disk_metrics_physical_read_count`	Unix	Counter	Number of physical read I/O's processed.
`hardware_disk_metrics_total_time`	Unix	Counter	Total time this block device is active.
`hardware_disk_metrics_idle_time`	Windows	Counter	Time spent in the idle task.
`hardware_disk_metrics_disk_space_free_bytes`	All	Gauge	Disk space available in the mounted file system.
`hardware_disk_metrics_disk_space_used_bytes`	All	Gauge	Disk space used in the mounted file system.
`hardware_disk_metrics_read_count`	All	Counter	Number of read I/O's processed.
`hardware_disk_metrics_read_time_milliseconds`	All	Counter	Total wait time for read requests.
`hardware_disk_metrics_write_count`	All	Counter	Number of write I/O's processed.
`hardware_disk_metrics_write_time_milliseconds`	All	Counter	Total wait time for write requests.
`hardware_process_cpu_children_user`	Unix	Counter	Amount of time scheduled in user mode for this process to wait for children.
`hardware_process_cpu_children_kernel`	Unix	Counter	Amount of time scheduled in kernel mode for this process to wait for children.
`hardware_process_cpu_kernel_milliseconds`	All	Counter	Amount of time scheduled in kernel mode for this process.
`hardware_process_cpu_user_milliseconds`	All	Counter	Amount of time scheduled in user mode for this process.
`hardware_system_vm_page_swap_in`	Unix	Counter	Number of pages the system has swapped in from disk.
`hardware_system_vm_page_swap_out`	Unix	Counter	Number of pages the system has swapped out to disk.
`hardware_system_memory_mem_total`	Unix	Gauge	Total usable RAM (physical RAM minus a few reserved bits and the kernel binary code).
`hardware_system_memory_mem_free`	Unix	Gauge	Sum of `LowFree` + `HighFree`.
`hardware_system_memory_mem_available`	Unix	Gauge	An estimate of how much memory is available for starting new applications, without swapping.
`hardware_system_memory_buffers`	Unix	Gauge	Temporary storage for raw disk blocks that shouldn't get tremendously large.
`hardware_system_memory_cached`	Unix	Gauge	In-memory cache for files read from the disk. This doesn't include `SwapCached`.
`hardware_system_memory_swap_total`	Unix	Gauge	Total amount of swap space available.
`hardware_system_memory_swap_free`	Unix	Gauge	Total amount of swap space unused.
`hardware_system_memory_shared_mem`	Unix	Gauge	Amount of memory consumed in file systems whose contents reside in virtual memory.
`hardware_system_memory_swap_free_kilobytes`	All	Gauge	Total amount of swap space unused.
`hardware_system_memory_swap_total_kilobytes`	All	Gauge	Total amount of swap space available.
`hardware_platform_num_logical_cpus`	All	Gauge	Number of logical CPUs usable by the current process.
`hardware_system_network_eth0_bytes_in_bytes`	All	Counter	Number of bytes of data received by the interface.
`hardware_system_network_eth0_bytes_out_bytes`	All	Counter	Number of bytes of data transmitted by the interface.
`hardware_system_network_lo_bytes_in_bytes`	All	Counter	Number of bytes of data received by the interface.
`hardware_system_network_lo_bytes_out_bytes`	All	Counter	Number of bytes of data transmitted by the interface.

Hardware Metric Labels

Each hardware metric contains the following labels:

Label	Description
`group_id`	Unique hexadecimal digit string that identifies the project.
`org_id`	Unique hexadecimal digit string that identifies the organization.
`process_port`	Port on which the process runs.
`disk_name`	Human-readable label that identifies the disk.

Back

PagerDuty

View, Retrieve, and Manage Logs

Prerequisites

Procedure

In MongoDB Cloud Manager, go to the .css-h15tq0{font-style:normal;font-weight:700;}Project Integrations page.

Click Configure for the Prometheus integration card.

Enter your preferred username and password.

Important

Enter your IP address and port.

Tip

(Optional) Encrypt all Prometheus metrics.

Select your preferred service discovery method.

Click Save.

View Your Cluster Metrics on Prometheus.

Example Configurations

HTTP Service Discovery

File Service Discovery

Import a Sample Grafana Dashboard

Navigate to the Import screen.

Click Upload JSON File.

Copy over the mongo-metrics.json or the hardware-metrics.json file to create a dashboard.

mongo-metrics.json

hardware-metrics.json

Performance Metrics Available to Prometheus

MongoDB Metric Labels

MongoDB Information Metrics

Hardware Metrics

Note

Hardware Metric Labels

In MongoDB Cloud Manager, go to the Project Integrations page.

Copy over the `mongo-metrics.json` or the `hardware-metrics.json` file to create a dashboard.