Skip to content

DEV Community

InferenceKey

Open models on your own GPUs: experiments, measurements and the exact commands behind them. Full write-ups at inferencekey.com

inferencekey.com Joined on Oct 14, 2026

Nov 9

Serving a stateful video world model on one RTX 4090: memory, flags and seeds in Hy-Nomas

#ai #machinelearning #gpu #opensource

4 min read

Nov 8

Serving Sage-A1.5 on an RTX 4090: one broken flag, one queue, and a self-check mode to measure

#ai #llm #opensource #gpu

5 min read

Nov 7

Ming-3.0-tts on a 16 GB card: the GPU sat mostly idle, and why a bigger one barely helps

#ai #machinelearning #python #gpu

4 min read

Nov 6

Deploying Underdog Bark 3.0 Pro: verbatim transcripts, custom backends and the chunk setting

#ai #machinelearning #python #opensource

4 min read

Nov 5

Serving Claude Code from DeepInfer on 4x B200: the cache, the tail and the memory ceiling

#ai #llm #gpu #devops

4 min read

Nov 4

Chat memory as a 41.9 MB file: building on MemT-1.0-Nano's save and reload

#ai #llm #machinelearning #python

5 min read

Nov 3

Serving WeVisOne-VL-4B: two engines, two copies of the weights, one chess piece apart

#ai #computervision #python #gpu

5 min read

Nov 2

Shipping Ming-Image Design: size the card by its files, and check the alpha in code

#ai #machinelearning #python #gpu

4 min read

loading...