AI lab

Running Local AI in Production: The Complete Series Guide

Eleven posts on what it really takes to run AI on your own hardware, from a private AI server...

Oct 27 · 11 min read >

Is Private AI Worth It? Lessons From Seven Weeks in Our Lab (Part 11 of 11)

The last post in the series: what our private AI lab set out to prove, the platform we ended...

Oct 26 · 12 min read >

Can AI Automate Business Workflows Without Sending Data Out? (Part 10 of 11)

Chatbots get the attention, but most of what businesses ask of private AI is quiet work: reading requests, turning...

Oct 19 · 13 min read >

Why Was Our Telegram AI Agent So Slow? The Hidden Prompt Cost (Part 9 of 11)

We ran a Telegram AI agent on local models in our lab. It gave bad answers, then refused to...

Oct 12 · 12 min read >

How Do You Run Several AI Models on One GPU Without Slowdowns? (Part 5 of 11)

Our first smart router made every request slower and pushed other clients' models out of memory. This is how...

Sep 14 · 13 min read >

What Happens When a Prompt Is Too Big for a Local LLM? (Part 4 of 11)

On a local AI server, a prompt too big for the model gets silently truncated, and raising the window...

Sep 7 · 12 min read >

Why Does a Local AI Server Freeze? Sizing Memory for LLMs (Part 3 of 11)

In its first month of testing, our lab AI server froze five times with no kernel error and no...

Aug 31 · 12 min read >

How Do You Control Access to Local AI Models? Use a Gateway (Part 2 of 11)

Every model call on our lab's private AI server goes through one gateway: one key per client, a token...

Aug 24 · 13 min read >

Local AI or Cloud AI? Why We Built a Private AI Server (Part 1 of 11)

We built a private AI server in our lab and ran realistic test workloads on it for seven weeks....

Aug 17 · 12 min read >