Prompt Caching in the API

2 years ago 54
Offering automatic discounts on inputs that the model has recently seen
Read Entire Article