Docs Menu

Docs Home → Launch & Manage MongoDB → MongoDB Atlas

Limitations

The following limitations apply to Atlas Stream Processing:

  • Atlas Stream Processing is currently only available on AWS, in the US-EAST-1 region. This only applies to stream processing instances themselves; your stream processors can still read from and write to clusters hosted on different cloud providers, or in different regions provided they are in the same project as the stream processing instance.

  • The combined state.stateSize of all stream processing instances can't exceed 80% of the RAM available for a worker in the same SPI tier. For example, the maximum size of a stream processor in the SP30 tier which has 8GB of RAM per worker, is 6.4GB. If the state.stateSize of any of your stream processors is approaching 80% of the RAM available for a worker in the same SPI tier, move up to the next SPI tier.

    When the 80% RAM threshold has been crossed, all stream processors fail with a stream processing instance out of memeory error. You can view the state.stateSize value of each stream processor with the sp.processor.stats() command. See View Statistics of a Stream Processor to learn more.

  • A stream processing instance can use only clusters in the same project as sources or sinks.

  • An Atlas Stream Processing pipeline definition cannot exceed 16 MB.

  • Only users with the Project Owner or Atlas admin roles can use Atlas Stream Processing.

  • Atlas Stream Processing currently supports only the following connection types:

Connection Type
Usage
Apache Kafka
Source or Sink
Atlas Database
Source or Sink
Sample Connection
Source Only

  • Atlas Stream Processing currently supports only JSON-formatted data. It does not currently support alternative serializations such as Avro or Protocol Buffers.

  • For Apache Kafka connections, Atlas Stream Processing currently supports only the following security protocols:

    • PLAINTEXT

    • SASL_PLAINTEXT

    • SASL_SSL

    Atlas Stream Processing currently doesn't support custom SSL certificates.

    For SASL, Atlas Stream Processing supports the following mechanisms:

    • PLAIN

    • SCRAM-SHA-256

    • SCRAM-SHA-512

  • Atlas Stream Processing currently doesn't support VPC peering for connections to Apache Kafka. After adding a connection to a Apache Kafka cluster to your connection registry, you must add Atlas IP addresses to an access list for that cluster. For more information, see Allow Access to or from the Atlas Control Plane.

  • Atlas Stream Processing doesn't support $function JavaScript UDFs.

← $merge
Back Up, Restore, and Archive Data →