{"ok":true,"repo":{"id":21969,"full_name":"Low-Zi-Hong/ESP32s3-LLM-Cluster","url":"https://github.com/Low-Zi-Hong/ESP32s3-LLM-Cluster","description":"7-node ESP32-S3 cluster running a 0.4B LLM via 1.58-bit (BitNet) ternary quantization over SPI daisy-chain","language":"C++","topics":[],"stars":134,"stars_delta":77,"forks":7,"first_seen":"2026-09-28T23:35:39.677343Z","last_seen":"2026-09-29T10:35:40.045924Z","mentions":1,"platforms":["hn"],"score":0.0,"summary":"A hobbyist hardware project that runs a ~0.5B-parameter LLM split across a cluster of seven ESP32-S3 microcontroller boards. One master board handles the tokenizer and embeddings; six compute nodes each execute several transformer layers using 1.58-bit BitNet ternary quantization, passing hidden states along a high-speed SPI daisy-chain to generate text.","why":"It was featured on Hacker News, likely because running a transformer LLM on cheap microcontrollers via BitNet quantization is a surprising and impressive demo.","audience":"Embedded and hardware hobbyists curious about extreme model quantization and running neural networks on microcontrollers.","tags":["llm","esp32","embedded","quantization","hardware","distributed"],"summarized_at":"2026-09-28T23:35:46.545940Z","summary_model":"glm-5.3-flash","fetched_at":"2026-09-29T10:36:38.441399Z","meta":{"license":"MIT","archived":false,"homepage":"","first_stars":57},"pushed_at":"2026-09-26T14:21:45Z","created_at":"2026-08-06T16:04:55Z","watchers":0,"open_issues":1,"mentions_list":[{"platform":"hn","url":"https://news.ycombinator.com/item?id=49884625","title":"ESP32S3 cluster running 1.58-bit (BitNet) Language model","seen_at":"2026-09-29T10:35:40.046375Z"}],"snapshots":[{"captured_at":"2026-09-28T23:35:41.788521Z","stars":57,"forks":5},{"captured_at":"2026-09-28T23:51:39.340371Z","stars":58,"forks":5},{"captured_at":"2026-09-29T00:06:52.640908Z","stars":61,"forks":5},{"captured_at":"2026-09-29T00:21:37.741312Z","stars":62,"forks":5},{"captured_at":"2026-09-29T00:36:36.740707Z","stars":64,"forks":5},{"captured_at":"2026-09-29T00:51:44.040218Z","stars":66,"forks":5},{"captured_at":"2026-09-29T01:06:34.558203Z","stars":68,"forks":5},{"captured_at":"2026-09-29T01:21:36.541313Z","stars":70,"forks":5},{"captured_at":"2026-09-29T01:36:36.802868Z","stars":72,"forks":5},{"captured_at":"2026-09-29T01:51:38.342407Z","stars":73,"forks":5},{"captured_at":"2026-09-29T02:06:44.214673Z","stars":75,"forks":5},{"captured_at":"2026-09-29T02:21:36.457864Z","stars":78,"forks":5},{"captured_at":"2026-09-29T02:36:37.922989Z","stars":78,"forks":5},{"captured_at":"2026-09-29T02:51:43.658734Z","stars":80,"forks":5},{"captured_at":"2026-09-29T03:06:37.600671Z","stars":82,"forks":5},{"captured_at":"2026-09-29T03:21:37.847646Z","stars":84,"forks":5},{"captured_at":"2026-09-29T03:36:37.457741Z","stars":86,"forks":5},{"captured_at":"2026-09-29T03:51:38.692709Z","stars":87,"forks":5},{"captured_at":"2026-09-29T04:06:36.668030Z","stars":87,"forks":5},{"captured_at":"2026-09-29T04:21:37.240716Z","stars":90,"forks":5},{"captured_at":"2026-09-29T04:36:36.845178Z","stars":90,"forks":6},{"captured_at":"2026-09-29T04:51:37.240408Z","stars":92,"forks":6},{"captured_at":"2026-09-29T05:06:36.640145Z","stars":93,"forks":6},{"captured_at":"2026-09-29T05:21:38.441090Z","stars":95,"forks":6},{"captured_at":"2026-09-29T05:36:38.540436Z","stars":97,"forks":6},{"captured_at":"2026-09-29T05:51:38.408111Z","stars":97,"forks":6},{"captured_at":"2026-09-29T06:06:38.140280Z","stars":98,"forks":6},{"captured_at":"2026-09-29T06:21:36.903710Z","stars":101,"forks":6},{"captured_at":"2026-09-29T06:36:38.640083Z","stars":106,"forks":6},{"captured_at":"2026-09-29T06:51:42.842444Z","stars":110,"forks":6},{"captured_at":"2026-09-29T07:06:36.815106Z","stars":110,"forks":6},{"captured_at":"2026-09-29T07:21:38.941173Z","stars":110,"forks":6},{"captured_at":"2026-09-29T07:36:37.507880Z","stars":110,"forks":6},{"captured_at":"2026-09-29T07:51:37.842418Z","stars":112,"forks":7},{"captured_at":"2026-09-29T08:06:36.902897Z","stars":116,"forks":7},{"captured_at":"2026-09-29T08:21:39.714323Z","stars":120,"forks":7},{"captured_at":"2026-09-29T08:36:45.540115Z","stars":121,"forks":7},{"captured_at":"2026-09-29T08:51:39.241835Z","stars":122,"forks":7},{"captured_at":"2026-09-29T09:06:38.629731Z","stars":123,"forks":7},{"captured_at":"2026-09-29T09:21:39.739930Z","stars":124,"forks":7},{"captured_at":"2026-09-29T09:36:41.180828Z","stars":126,"forks":7},{"captured_at":"2026-09-29T09:51:38.416793Z","stars":128,"forks":7},{"captured_at":"2026-09-29T10:06:39.940333Z","stars":130,"forks":7},{"captured_at":"2026-09-29T10:21:38.341544Z","stars":132,"forks":7},{"captured_at":"2026-09-29T10:36:38.442280Z","stars":134,"forks":7}]}}