Higher than expected latencies for 3 minutes

Incident Report for Baseten

Resolved

From 12:01pm to 12:04pm PDT certain models experienced higher latencies. Internal retries kicked in and resolved the issues for most, but some timeouts were observed in situations where the client code had set short timeouts. The issue is now resolved.

Posted Jul 29, 2024 - 12:00 PDT