A coder on GitHub goes by T-Crypt. The coder built a tool called Berth. A post about it hit r/LocalLLaMA early Tuesday.
Berth solves a plain problem. One home GPU often runs several AI engines. A chat engine, an image engine, and a voice engine can all fight for the same card. Two of them loading at once can crash the whole machine.
Berth hands each engine a lease on the card. Each engine takes its turn on the GPU. It gives the card back when its job ends. The next engine then gets a clean turn.
The poster runs one RTX 4090 card. That card carries 24 gigabytes of memory. The poster swapped between five tools on it by hand before Berth. Now one small program handles every swap.
Berth already links up with many tools. The list spans llama.cpp, Ollama, vLLM, ComfyUI, ExLlamaV3, and more. One Go program drives the whole thing. That single file is all a user needs.
The post drew 55 comments fast. Readers swapped their own swap horror stories in reply. The code sits on GitHub, where it holds 41 stars and 3 forks already.
Why did this catch fire? Anyone who runs AI at home on one card knows this pain by heart. That crowd welcomed a clean fix fast.
What does the reach say about the people building AI? Big labs run AI on huge server farms built just for that job. Home builders share one card between many tasks instead. Small tools like Berth show how much real work still happens on modest hardware. The strong reply count shows a crowd eager to trade notes and fixes fast. Open code lets any one of them test a claim and push a fix back.