Commit Graph

91 Commits

Author SHA1 Message Date
kim dd8cbe5f63 revert: remove hardcoded daily limits, restoring dynamic calculation only 2026-01-30 00:05:40 +08:00
kim d5b8829265 feat: add specific hard limits and log format 2026-01-29 23:54:32 +08:00
kim cd35a193b6 feat: finalize smart pool tracking with hysteresis (handle jumps, drops, and expiry) 2026-01-29 23:17:39 +08:00
kim 2d849dc62d fix: upgrade quota logic to track Total Pool (Usage + Rem) to prevent mid-day blocking 2026-01-29 22:30:42 +08:00
kim 73fe82de3b feat: enhance volcengine quota sync with hard limits and smart buffering 2026-01-29 22:21:29 +08:00
kim 0988b1fc1d optimize: increase burst traffic threshold to 300,000 tokens to handle long-context models 2026-01-29 20:54:18 +08:00
kim be6d2ed1bd chore: update config.yaml with new model mappings 2026-01-29 20:28:48 +08:00
kim e6110cd9c1 optimize: adjust restore window to 07:00-13:00 Beijing time and optimize sleep logic for dead models 2026-01-29 20:27:32 +08:00
kim e21a510f0f fix: sync logic to filter non-volc models by api_base hash and add debug logs 2026-01-29 19:31:17 +08:00
kim 4a68121b3e Fix: Revert Doubao 1.6 mapping to shared list and remove hardcoded corner cases 2026-01-29 18:57:55 +08:00
kim 2d161c867e Fix: Separate Doubao 1.6 Standard and Thinking models into distinct quota keys 2026-01-29 18:52:43 +08:00
kim d66231a333 Enhance: Complete bilingual (CN/EN) log support for VolcSync 2026-01-29 18:48:03 +08:00
kim c536421410 Enhance: Format balance logs with thousands separators and add bilingual (CN/EN) descriptions 2026-01-29 18:39:55 +08:00
kim da41c569c0 Fix: Deduplicate packages based on full JSON content hash to prevent double counting 2026-01-29 18:26:38 +08:00
kim 587a005665 Fix: Remove duplicate code block causing IndentationError in process_packages_breakdown 2026-01-29 18:19:59 +08:00
kim 0e2acd85b0 Fix: Revert sync-all-models. Only sync configured VolcEngine models (Strict Whitelist) 2026-01-29 18:16:17 +08:00
kim fb77e4047c Fix: Sync ALL discovered VolcEngine models to Redis, ignoring INTERESTED_MODELS filter for cache 2026-01-29 18:11:59 +08:00
kim 2ceec7f1c6 Fix: Handle list mapping in process_packages_breakdown to resolve unhashable type error 2026-01-29 18:03:41 +08:00
kim d696c92879 Fix: Update VOLC_MODEL_MAP and suffixes to correctly normalize and map package names 2026-01-29 17:59:09 +08:00
kim aeb89b69a0 Fix: Add infinite loop protection to debug script pagination 2026-01-29 17:34:39 +08:00
kim ac62783fc6 Fix: Add infinite loop protection to API pagination 2026-01-29 17:32:58 +08:00
kim e64bdbe2fa Fix: Add page limit to debug script to prevent infinite loops 2026-01-29 17:30:47 +08:00
kim f9de77d7a2 测试 2026-01-29 17:26:27 +08:00
kim 82b25749fe Add manual debug script for Volcengine sync 2026-01-29 17:21:40 +08:00
kim 76aa3d5aae Fix: config parsing logic to use upstream model names for whitelist 2026-01-29 17:13:09 +08:00
kim cc3ef9c482 fix(volc_sync): retry apply loop logging changes 2026-01-29 17:00:36 +08:00
kim 16e7170643 fix(volc_sync): restrict model discovery and enhance loop logging 2026-01-29 16:57:23 +08:00
kim dd0eb2b1ad fix(volc_sync): correct GLM-4 mapping and add raw package logging 2026-01-29 16:49:14 +08:00
kim 16e233f374 fix(volc_sync): auto-start background monitor thread on module import 2026-01-29 16:43:57 +08:00
kim ca55e6bda6 chore: add debug script for volcengine sync 2026-01-29 16:31:58 +08:00
kim dffb77d720 fix(volc_sync): add loop debug logs to trace package processing 2026-01-29 16:26:22 +08:00
kim 66f69df87e fix(volc_sync): add debug logs for balance display issues 2026-01-29 16:22:39 +08:00
kim 7c8065d162 feat(volc_sync): update frequency thresholds to strict intervals 2026-01-29 16:17:57 +08:00
kim 2cdd1a3295 feat(volc_sync): optimize frequency intervals and logging 2026-01-29 16:12:26 +08:00
kim 5946147ebb chore: update config and docker-compose to use volc_limit_sync handler
Updates config.yaml to use the new volc_limit_sync.proxy_handler_instance callback.
Adds volc_limit_sync.py to docker-compose.yml volumes to ensure it is available in the container.
2026-01-29 15:12:27 +08:00
kim 3156bbe431 feat: merge daily_limit functionality into volc_limit_sync for single-file dynamic rate limiting
This commit merges the interception and soft-eviction logic from daily_limit.py into volc_limit_sync.py.
It enables a unified solution where:
1. Running the script directly starts the sync daemon.
2. Importing 'proxy_handler_instance' provides the LiteLLM callback handler.
The handler now respects dynamic limits synced to Redis.
2026-01-29 15:11:14 +08:00
kim 284b33c362 chore: revert changes to daily_limit.py as requested 2026-01-29 14:53:30 +08:00
kim 8630f287b4 feat: add dynamic rate limiting for Volcengine models
This commit introduces a dual-layer rate limiting system:
1. volc_limit_sync.py: A daemon that adaptively syncs Volcengine API balances to Redis based on traffic and safety margins.
2. daily_limit.py: Updated to enforce dynamic limits by checking Redis (Current Usage + Remaining Balance) and handling soft evictions.
2026-01-29 14:51:55 +08:00
root eb7690c0a4 调整日志等级 2026-01-28 18:09:42 +08:00
root 54eb769332 优化hash计算,只取前段,避免url路径影响 2026-01-28 15:13:57 +08:00
root f77f7ba6de 初始化空白分支文件 2026-01-28 14:55:06 +08:00