Skip to main content

Drop cached model endpoint entries

POST 
/internal/cache/model-endpoint/invalidate

Forget the cached endpoint payload for the given model identifier(s).

Called by the model registry after an admin edits a model so the next inference request through the gateway fetches a fresh capability list instead of replaying the stale cache for up to the TTL.

Request​

Responses​

Successful Response