Langfuse

Close-up of memory chips on a computer board

How Do You Set Up Local AI? A Step-by-Step LiteLLM Guide

A step-by-step guide to running AI on your own Linux server: Ollama kept private, LiteLLM as the only way in, a key per app, a chat UI, tracing and...

Avatar photo Sajal Jain in Artificial Intelligence · 19 min read >

What Is Your Local AI Server Actually Doing? Observability Basics (Part 7 of 11)

If nobody can see inside a private AI server, it freezes without warning. In our lab we built tracing,...

Sajal Jain in Artificial Intelligence
Sep 28 · 13 min read >
A computer lab with rows of monitors

How Do You Run Several AI Models on One GPU Without Slowdowns? (Part 5 of 11)

Our first smart router made every request slower and pushed other clients' models out of memory. This is how...

Sajal Jain in Artificial Intelligence
Sep 14 · 13 min read >
A small network switch with patch cables

How Do You Control Access to Local AI Models? Use a Gateway (Part 2 of 11)

Every model call on our lab's private AI server goes through one gateway: one key per client, a token...

Sajal Jain in Artificial Intelligence
Aug 24 · 13 min read >
Fibre optic patch cables in a network panel

Popular in
"Langfuse"

  1. How Do You Set Up Local AI? A Step-by-Step LiteLLM Guide
    Sajal Jain in Artificial Intelligence · Oct 29 >