A step-by-step guide to running AI on your own Linux server: Ollama kept private, LiteLLM as the only way in, a key per app, a chat UI, tracing and...
The last post in the series: what our private AI lab set out to prove, the platform we ended...
Every model call on our lab's private AI server goes through one gateway: one key per client, a token...
Categories
