private AI

Close-up of memory chips on a computer board

How Do You Set Up Local AI? A Step-by-Step LiteLLM Guide

A step-by-step guide to running AI on your own Linux server: Ollama kept private, LiteLLM as the only way in, a key per app, a chat UI, tracing and...

Avatar photo Sajal Jain in Artificial Intelligence · 19 min read >

Running Local AI in Production: The Complete Series Guide

Eleven posts on what it really takes to run AI on your own hardware, from a private AI server...

Sajal Jain in Artificial Intelligence
Oct 27 · 11 min read >
Rows of servers in a data centre

Is Private AI Worth It? Lessons From Seven Weeks in Our Lab (Part 11 of 11)

The last post in the series: what our private AI lab set out to prove, the platform we ended...

Sajal Jain in Artificial Intelligence
Oct 26 · 12 min read >
A computer lab with workstations

How much memory does a local LLM need? A sizing guide

A local model needs memory for its weights, for a KV cache that grows with context and parallel slots,...

Sajal Jain in Artificial Intelligence
Oct 24 · 12 min read >
How much memory does a local LLM need? A sizing guide

Private AI, ChatGPT or Copilot? A decision guide for Australia

ChatGPT, Microsoft 365 Copilot and private AI on your own hardware handle your data in very different ways. This...

Catharsis in Artificial Intelligence
Oct 18 · 10 min read >
Private AI, ChatGPT or Copilot? A decision guide for Australia

Local AI or Cloud AI? Why We Built a Private AI Server (Part 1 of 11)

We built a private AI server in our lab and ran realistic test workloads on it for seven weeks....

Sajal Jain in Artificial Intelligence
Aug 17 · 12 min read >
A technician working on a server rack

Popular in
"private AI"

  1. How Do You Set Up Local AI? A Step-by-Step LiteLLM Guide
    Sajal Jain in Artificial Intelligence · Oct 29 >