Elevated API Errors

Incident Report for Baseten

Resolved

For a period of 2 minutes, we experienced an elevated level of API errors due to a failure in an internal load balancer. Inference requests are retried but may have resulted in errors under high model load.

Posted Dec 01, 2023 - 12:04 PST