Skip to content

Commit e9e3c5c

Browse files
author
Paweł Kędzia
committed
Rename log file to llm-router.log and switch default load‑balancing strategy to first_available.
1 parent 9b4f644 commit e9e3c5c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

run-rest-api-gunicorn.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,13 +6,13 @@ LLM_ROUTER_IN_DEBUG=1 \
66
LLM_ROUTER_MINIMUM=1 \
77
LLM_ROUTER_PROMPTS_DIR="resources/prompts" \
88
LLM_ROUTER_MODELS_CONFIG="resources/configs/models-config.json" \
9-
LLM_ROUTER_LOG_FILENAME="llm-proxy-rest.log" \
9+
LLM_ROUTER_LOG_FILENAME="llm-router.log" \
1010
LLM_ROUTER_EP_PREFIX="/api" \
1111
LLM_ROUTER_DEFAULT_EP_LANGUAGE="pl" \
1212
LLM_ROUTER_SERVER_TYPE=gunicorn \
1313
LLM_ROUTER_SERVER_PORT=8080 \
1414
LLM_ROUTER_SERVER_HOST="0.0.0.0" \
15-
LLM_ROUTER_BALANCE_STRATEGY="balanced" \
15+
LLM_ROUTER_BALANCE_STRATEGY="first_available" \
1616
LLM_ROUTER_REDIS_HOST="192.168.100.67" \
1717
LLM_ROUTER_REDIS_PORT=6379 \
1818
LLM_ROUTER_SERVER_WORKERS_COUNT=4 \

0 commit comments

Comments
 (0)