litellm-config

T

kim 8630f287b4 feat: add dynamic rate limiting for Volcengine models

This commit introduces a dual-layer rate limiting system:
1. volc_limit_sync.py: A daemon that adaptively syncs Volcengine API balances to Redis based on traffic and safety margins.
2. daily_limit.py: Updated to enforce dynamic limits by checking Redis (Current Usage + Remaining Balance) and handling soft evictions.

2026-01-29 14:51:55 +08:00

.env

调整日志等级

2026-01-28 18:09:42 +08:00

config.yaml

初始化空白分支文件

2026-01-28 14:55:06 +08:00

daily_limit.py

feat: add dynamic rate limiting for Volcengine models

2026-01-29 14:51:55 +08:00

docker-compose.yml

初始化空白分支文件