Elevated API Errors
Incident Report for Baseten
For a period of 2 minutes, we experienced an elevated level of API errors due to a failure in an internal load balancer. Inference requests are retried but may have resulted in errors under high model load.
Posted Dec 01, 2023 - 12:04 PST