Skip to content
Blog

Field notes on private AI.

Practical writing on GPU economics, model deployment and AI security, from the engineers doing the work.

ECONOMICS9 min read

When does self-hosting an LLM beat API pricing?

A worked model for finding your break-even point in tokens per month, including the costs teams usually forget.

ENGINEERING12 min read

Quantization without regret: AWQ, GPTQ and FP8 compared

What you lose, what you save, and how to test it on your own tasks before you ship.

SECURITY8 min read

Retrieval that respects permissions

Why most RAG demos leak data across teams, and the patterns that stop it.

ECONOMICS7 min read

Your GPUs are probably 30% busy

How to measure real utilization, and the five fixes that recover the most capacity.

ENGINEERING10 min read

Build your eval set before you pick a model

A practical guide to evaluation suites made from your own users' questions.

SECURITY11 min read

The OWASP LLM Top 10, in plain language

Each risk explained for engineering leaders, with the control that addresses it.

Next step

Get new articles by email.

One article a month, no marketing fluff. Email us to join the list.