Degraded performance for some models using A100s

Incident Report for Baseten

Resolved

A100s are fully operational again.
Posted Jan 07, 2024 - 22:27 PST

Investigating

Certain models on A100s are seeing degraded performance in inference and scaling up. We're actively investigating.
Posted Jan 07, 2024 - 22:01 PST
This incident affected: Model Inference.