Skip to content

Enable vLLM Semantic Router with nginx ingress #557

@nithin8702

Description

@nithin8702

Is your feature request related to a problem? Please describe.
We have nginx reverse proxy in our Kubernetes cluster and not able to deploy vLLM Semantic router without envoy ai gateway.

Describe the solution you'd like
Enable vLLM Semantic Router with just nginx ingress alone.

Additional context
We use vLLM Production stack with routerspec configured with ingress enabled for api access.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions