{"ok":true,"repo":{"id":379,"full_name":"IterateAI/lifeboat-releases","url":"https://github.com/IterateAI/lifeboat-releases","description":"Lifeboat — downloads for macOS, Windows and Linux, plus Docker and Kubernetes install instructions. Run language models on your own hardware behind an OpenAI-compatible API.","language":"Python","topics":[],"stars":0,"stars_delta":0,"forks":0,"first_seen":"2026-09-26T17:33:54.391897Z","last_seen":"2026-09-27T00:15:34.828424Z","mentions":1,"platforms":["hn"],"score":41.0,"summary":"Lifeboat lets you run open-weight language models on your own hardware—laptops, GPU servers, edge devices, or clusters—behind an OpenAI- and Anthropic-compatible API, with a built-in load balancer and web console. It supports pip, Docker, Kubernetes, and desktop installs, targets edge hardware like Raspberry Pi and Jetson, and claims significant throughput wins over llama.cpp and ollama. This repo is downloads and install instructions only; the source is not public.","why":"It was featured in a Show HN post claiming 2–6x more concurrent agent sessions per GPU without quantization, plus published benchmarks showing ~2x throughput vs llama.cpp and ollama on the same hardware.","audience":"Developers and teams who want to self-host LLM inference on their own machines or edge devices with an OpenAI-compatible API.","tags":["llm","self-hosted","inference","openai-api","edge","gguf"],"summarized_at":"2026-09-26T17:44:23.710081Z","summary_model":"glm-5.3-flash","fetched_at":"2026-09-27T00:52:57.540576Z","meta":{"license":null,"archived":false,"homepage":"https://iterate.ai","pushed_at":"2026-09-26T13:45:46Z","created_at":"2026-09-16T09:26:36Z","first_stars":0},"pushed_at":"2026-09-26T13:45:46Z","created_at":"2026-09-16T09:26:36Z","watchers":0,"open_issues":0,"mentions_list":[{"platform":"hn","url":"https://news.ycombinator.com/item?id=49822130","title":"Show HN: Lifeboat, 2-6x more concurrent agent sessions per GPU, no quantization","seen_at":"2026-09-27T00:15:34.828831Z"}],"snapshots":[{"captured_at":"2026-09-26T18:23:20.403351Z","stars":0,"forks":0},{"captured_at":"2026-09-26T18:23:20.845602Z","stars":0,"forks":0},{"captured_at":"2026-09-26T18:28:10.076848Z","stars":0,"forks":0},{"captured_at":"2026-09-26T18:29:46.425804Z","stars":0,"forks":0},{"captured_at":"2026-09-26T18:44:47.751898Z","stars":0,"forks":0},{"captured_at":"2026-09-26T18:57:33.585520Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:13:05.265223Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:16:26.307229Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:19:56.946475Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:21:58.591993Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:28:31.126488Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:32:07.984924Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:35:12.974337Z","stars":0,"forks":0},{"captured_at":"2026-09-26T19:50:12.350681Z","stars":0,"forks":0},{"captured_at":"2026-09-26T20:05:20.276867Z","stars":0,"forks":0},{"captured_at":"2026-09-26T20:20:16.993029Z","stars":0,"forks":0},{"captured_at":"2026-09-26T20:35:16.745712Z","stars":0,"forks":0},{"captured_at":"2026-09-26T20:50:16.615539Z","stars":0,"forks":0},{"captured_at":"2026-09-26T20:53:04.163451Z","stars":0,"forks":0},{"captured_at":"2026-09-26T21:08:03.616256Z","stars":0,"forks":0},{"captured_at":"2026-09-26T21:23:03.372444Z","stars":0,"forks":0},{"captured_at":"2026-09-26T21:37:32.476284Z","stars":0,"forks":0},{"captured_at":"2026-09-26T21:52:53.152844Z","stars":0,"forks":0},{"captured_at":"2026-09-26T22:07:57.432257Z","stars":0,"forks":0},{"captured_at":"2026-09-26T22:38:04.719550Z","stars":0,"forks":0},{"captured_at":"2026-09-26T22:53:00.019053Z","stars":0,"forks":0},{"captured_at":"2026-09-26T23:07:42.975050Z","stars":0,"forks":0},{"captured_at":"2026-09-26T23:22:54.819770Z","stars":0,"forks":0},{"captured_at":"2026-09-26T23:37:58.936389Z","stars":0,"forks":0},{"captured_at":"2026-09-26T23:52:57.121059Z","stars":0,"forks":0},{"captured_at":"2026-09-27T00:08:07.762574Z","stars":0,"forks":0},{"captured_at":"2026-09-27T00:22:38.633933Z","stars":0,"forks":0},{"captured_at":"2026-09-27T00:37:54.670771Z","stars":0,"forks":0},{"captured_at":"2026-09-27T00:52:57.541588Z","stars":0,"forks":0}]}}