Hi,

Is there a way to create a mid-layer to serve functionary on a vanilla sglang server?

The unit I work in runs a sglang server where I can easily serve any huggingface hosted LLM. But I cannot install the functionary library on the server side and run the server_sglang.py script.

I attempted to create a middleware "server" on the client side without much success.

Thanks in advance for any tips.