Async inference service degraded
Incident Report for Baseten
Resolved
From 2:38am to 5:42am PDT the async inference service (calls to `/async_predict`) was unavailable for certain models. Async inference requests were not created. This issue is now resolved. This did *not* affect the more common synchronous calls (`/predict`).
Posted Jul 30, 2024 - 02:30 PDT