Skip to content

Commit f513cee

Browse files
author
Paweł Kędzia
committed
Update README description to reflect LLM Router service and its capabilities
1 parent 21c5437 commit f513cee

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

README.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,11 @@
11
## llm‑router
22

3-
**llm‑router** – a lightweight, modular ecosystem for building and interacting with Large Language Model (LLM) services.
3+
**LLM Router** is a service that can be deployed on‑premises or in the cloud.
4+
It adds a layer between any application and the LLM provider. In real time it controls traffic,
5+
distributes a load among providers of a specific LLM, and enables analysis of outgoing requests
6+
from a security perspective (masking, anonymization, prohibited content).
7+
It is an open‑source solution (Apache 2.0) that can be launched instantly by running
8+
a ready‑made image in your own infrastructure.
49

510
- **llm_router_api** provides a unified REST proxy that can route requests to any supported LLM backend (
611
OpenAI‑compatible, Ollama, vLLM, LM Studio, etc.), with built‑in load‑balancing, health checks, streaming responses

0 commit comments

Comments
 (0)