Remote agentic tool calling

[magikRUKKOLA]

I had been working on a solution to loop the execution of a tool calls recenlty. See more info here: ggml-org/llama.cpp#10431 (reply in thread)

Right now I was thinking that I would be cool if I would be able to connect a certain model directly to the bash of the specified SSH session. That is, one would be able to specify a model, the tool to use (bash) and the target server. Kinda neat huh?
Imagine specifying the port of the SSH tunnel and when asking the LLM to execute some stuff like:

mods -m kt --server 10013 "update the OS and resolve the possible conflicts /root-bash"
mods -m kt --server 10014 "perform the backup, make sure everything is straight /root-bash"
mods -m kt --server 10015 "update the nvidia drivers (see /opt/open-nvidia-drivers-p2p/) /root-bash"
mods -m kt --server 20011 "install a dns-beacon from cobalt-strike /root-bash"

*[EDIT]: Are there any such solutions exists? I kinda wasn't able to find anything similar.

[EDIT 2]: In case anyone interested in testing etc. LMK so I will publish a repo with my LUA-MITM framework.