Commit Graph

59 Commits

Author SHA1 Message Date
kim 16e7170643 fix(volc_sync): restrict model discovery and enhance loop logging 2026-01-29 16:57:23 +08:00
kim dd0eb2b1ad fix(volc_sync): correct GLM-4 mapping and add raw package logging 2026-01-29 16:49:14 +08:00
kim 16e233f374 fix(volc_sync): auto-start background monitor thread on module import 2026-01-29 16:43:57 +08:00
kim dffb77d720 fix(volc_sync): add loop debug logs to trace package processing 2026-01-29 16:26:22 +08:00
kim 66f69df87e fix(volc_sync): add debug logs for balance display issues 2026-01-29 16:22:39 +08:00
kim 7c8065d162 feat(volc_sync): update frequency thresholds to strict intervals 2026-01-29 16:17:57 +08:00
kim 2cdd1a3295 feat(volc_sync): optimize frequency intervals and logging 2026-01-29 16:12:26 +08:00
kim 3156bbe431 feat: merge daily_limit functionality into volc_limit_sync for single-file dynamic rate limiting
This commit merges the interception and soft-eviction logic from daily_limit.py into volc_limit_sync.py.
It enables a unified solution where:
1. Running the script directly starts the sync daemon.
2. Importing 'proxy_handler_instance' provides the LiteLLM callback handler.
The handler now respects dynamic limits synced to Redis.
2026-01-29 15:11:14 +08:00
kim 8630f287b4 feat: add dynamic rate limiting for Volcengine models
This commit introduces a dual-layer rate limiting system:
1. volc_limit_sync.py: A daemon that adaptively syncs Volcengine API balances to Redis based on traffic and safety margins.
2. daily_limit.py: Updated to enforce dynamic limits by checking Redis (Current Usage + Remaining Balance) and handling soft evictions.
2026-01-29 14:51:55 +08:00