Edge0: Open-Source Framework Running 35B LLMs On-Device with 1–2.5GB RAM
An in-depth look at Edge0, an open-source on-device AI framework designed to run 35B parameter LLMs using just 1–2.5GB peak memory on Apple Silicon without clou
#Edge0
TAU HOME stories tagged Edge0.