INSIGHTS

Exploring the intersection of AI, SAP, and enterprise automation through research-driven perspectives and practical experience.

AI ENGINEERING
2026-08-29•10 min read

320 Billion Parameters, Two Desktops, One User at a Time

GLM-5.3-Flash is a 320B Mixture-of-Experts model quantized to NVFP4 — 598.5 GiB down to 181 GiB. It runs on two DGX Sparks under my desk, with correct reasoning and working tool calls. But the measurements tell a narrower story than the spec sheet: concurrency buys literally nothing, prefill is eleven minutes at full context, and speculative decoding fails at weight loading. LibertAI published no throughput numbers, so these are the first measured for this checkpoint.

READ MORE
AI ENGINEERING
2026-08-29•12 min read

A 51 GB Table, Two Sparks, and One Line of Code

Qwen3.8-Flash-Next is a 125B Mixture-of-Experts model with an unusual extra: a 51-billion-parameter n-gram embedding table. That table is why vLLM could not serve it on my two DGX Sparks, no matter which of eighteen community quantizations I tried. The fix was a one-line patch, and the road there produced a benchmark result I did not expect: two optimizations that each help, and cancel each other when combined.

READ MORE
AI ENGINEERING
2026-08-25•15 min read

Six Observability Lessons from a 1,500-Line Desktop Widget

I built a macOS menu-bar app to watch my two DGX Sparks. It has exactly one user, and that is why it taught me more about observability than most production dashboards: nothing was hidden behind a vendor abstraction. Six numbers on that panel were wrong, and every one of them was wrong for a reason that applies directly to monitoring AI systems in an enterprise. A CPU metric that confidently lied, a read-only connection that silently corrupted its own reading, and four more.

READ MORE
AI ENGINEERING
2026-07-26•7 min read

The Homelab Grand Prix: Racing 14 Quantized LLMs on Two DGX Sparks

I put fourteen quantized LLMs on the grid of my two-node DGX Spark cluster and timed every one, top speed measured in tokens per second. A 35B model took pole at 57.1 tok/s, but the real finding sits behind it: a 122B model lands within 29 percent of that, and speculative decoding nearly doubled a 120B into the same class. Total size predicts very little. Here is the full grid, the configuration each car ran, and what actually moves the needle.

READ MORE

Stay Informed

Follow my research and insights on AI-driven enterprise automation