Prompt Caching in the API

T1Covered by 1 source · first reported by OpenAI News at 01 Oct 2024, 10:03 UTC

Offering automatic discounts on inputs that the model has recently seen

dev

Sources

• T1Prompt Caching in the APIOpenAI News01 Oct 2024, 10:03