Commit Graph

76 Commits

Author SHA1 Message Date
kim 73fe82de3b feat: enhance volcengine quota sync with hard limits and smart buffering 2026-01-29 22:21:29 +08:00
kim 0988b1fc1d optimize: increase burst traffic threshold to 300,000 tokens to handle long-context models 2026-01-29 20:54:18 +08:00
kim e6110cd9c1 optimize: adjust restore window to 07:00-13:00 Beijing time and optimize sleep logic for dead models 2026-01-29 20:27:32 +08:00
kim e21a510f0f fix: sync logic to filter non-volc models by api_base hash and add debug logs 2026-01-29 19:31:17 +08:00
kim 4a68121b3e Fix: Revert Doubao 1.6 mapping to shared list and remove hardcoded corner cases 2026-01-29 18:57:55 +08:00
kim 2d161c867e Fix: Separate Doubao 1.6 Standard and Thinking models into distinct quota keys 2026-01-29 18:52:43 +08:00
kim d66231a333 Enhance: Complete bilingual (CN/EN) log support for VolcSync 2026-01-29 18:48:03 +08:00
kim c536421410 Enhance: Format balance logs with thousands separators and add bilingual (CN/EN) descriptions 2026-01-29 18:39:55 +08:00
kim da41c569c0 Fix: Deduplicate packages based on full JSON content hash to prevent double counting 2026-01-29 18:26:38 +08:00
kim 587a005665 Fix: Remove duplicate code block causing IndentationError in process_packages_breakdown 2026-01-29 18:19:59 +08:00
kim 0e2acd85b0 Fix: Revert sync-all-models. Only sync configured VolcEngine models (Strict Whitelist) 2026-01-29 18:16:17 +08:00
kim fb77e4047c Fix: Sync ALL discovered VolcEngine models to Redis, ignoring INTERESTED_MODELS filter for cache 2026-01-29 18:11:59 +08:00
kim 2ceec7f1c6 Fix: Handle list mapping in process_packages_breakdown to resolve unhashable type error 2026-01-29 18:03:41 +08:00
kim d696c92879 Fix: Update VOLC_MODEL_MAP and suffixes to correctly normalize and map package names 2026-01-29 17:59:09 +08:00
kim ac62783fc6 Fix: Add infinite loop protection to API pagination 2026-01-29 17:32:58 +08:00
kim 76aa3d5aae Fix: config parsing logic to use upstream model names for whitelist 2026-01-29 17:13:09 +08:00
kim cc3ef9c482 fix(volc_sync): retry apply loop logging changes 2026-01-29 17:00:36 +08:00
kim 16e7170643 fix(volc_sync): restrict model discovery and enhance loop logging 2026-01-29 16:57:23 +08:00
kim dd0eb2b1ad fix(volc_sync): correct GLM-4 mapping and add raw package logging 2026-01-29 16:49:14 +08:00
kim 16e233f374 fix(volc_sync): auto-start background monitor thread on module import 2026-01-29 16:43:57 +08:00
kim dffb77d720 fix(volc_sync): add loop debug logs to trace package processing 2026-01-29 16:26:22 +08:00
kim 66f69df87e fix(volc_sync): add debug logs for balance display issues 2026-01-29 16:22:39 +08:00
kim 7c8065d162 feat(volc_sync): update frequency thresholds to strict intervals 2026-01-29 16:17:57 +08:00
kim 2cdd1a3295 feat(volc_sync): optimize frequency intervals and logging 2026-01-29 16:12:26 +08:00
kim 3156bbe431 feat: merge daily_limit functionality into volc_limit_sync for single-file dynamic rate limiting
This commit merges the interception and soft-eviction logic from daily_limit.py into volc_limit_sync.py.
It enables a unified solution where:
1. Running the script directly starts the sync daemon.
2. Importing 'proxy_handler_instance' provides the LiteLLM callback handler.
The handler now respects dynamic limits synced to Redis.
2026-01-29 15:11:14 +08:00
kim 8630f287b4 feat: add dynamic rate limiting for Volcengine models
This commit introduces a dual-layer rate limiting system:
1. volc_limit_sync.py: A daemon that adaptively syncs Volcengine API balances to Redis based on traffic and safety margins.
2. daily_limit.py: Updated to enforce dynamic limits by checking Redis (Current Usage + Remaining Balance) and handling soft evictions.
2026-01-29 14:51:55 +08:00