I have some good news! I brought this same issue up with Stytch and they were able to reproduce it within Mongo. They believe it is an error with the way they are formatting their JWK. They should have a fix out soon.
I was able to convert the JWK into PEM format and submit that to my app as a work around. Authentication is now working.
I appreciated the help with this issue.