Ollama

Why Does a Local AI Server Freeze? Sizing Memory for LLMs (Part 3 of 11)

In its first month of testing, our lab AI server froze five times with no kernel error and no...

Sajal Jain in Artificial Intelligence
Aug 31 · 12 min read >
Memory modules on a circuit board

How Do You Control Access to Local AI Models? Use a Gateway (Part 2 of 11)

Every model call on our lab's private AI server goes through one gateway: one key per client, a token...

Sajal Jain in Artificial Intelligence
Aug 24 · 13 min read >
Fibre optic patch cables in a network panel

Local AI or Cloud AI? Why We Built a Private AI Server (Part 1 of 11)

We built a private AI server in our lab and ran realistic test workloads on it for seven weeks....

Sajal Jain in Artificial Intelligence
Aug 17 · 12 min read >
A technician working on a server rack
  • 1
  • 2

    • Popular in
    "Ollama"

    1. How Do You Set Up Local AI? A Step-by-Step LiteLLM Guide
      Sajal Jain in Artificial Intelligence · Oct 29 >