You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Allow admin to set tpm/rpm limits per model per key
Motivation, pitch
hi, i want to be able to distribute one key to each of my customer projects, each key allows them to access to a predefined list of models (associated with the key : this is already possible), but with a different tpm/rpm for each model as i don't want to globally rate limit them accross multiple model, i need a more fine grained rate limit, per key and model.
The Feature
Allow admin to set tpm/rpm limits per model per key
Motivation, pitch
Twitter / LinkedIn details
cc: @olad32
The text was updated successfully, but these errors were encountered: