PoC server with fully functional router, model load/unload (multiple models in parallel)#37

ngxson wants to merge 3 commits intoxsn/split_http_server_contextngxson/llama.cpp:xsn/split_http_server_contextfrom

xsn/poc_proxy_3ngxson/llama.cpp:xsn/poc_proxy_3Copy head branch name to clipboard