Colyni
Pools a room of MacBooks into one LLM cluster. Each Mac adds its memory to the pool and earns credits whenever it helps serve someone else's chat, which its owner can spend on their own. I built it with Dan Nguyen on a fork of exo and demoed Qwen2.5-32B on a three-Mac setup.
distributed inference · mlx · fastapi · react