edge AI

AI Llama.cpp's auto fit feature is quietly reshaping what local AI inference can do on consumer hardware

4 min 1K views

AI An anonymous developer claims to have trained a 235-million parameter LLM on a single consumer GPU and the AI community is not convinced

5 min 133 views

AI Australian startup Syenta raises $26 million and lands Pat Gelsinger to tackle the AI chip supply crisis

4 min 158 views

AI A low-level CPU optimization in llama.cpp is quietly reshaping how developers run large AI models on consumer hardware

4 min 287 views

AI Cloudflare open-sources Project Pipit, a lossless compression tool that could reshape how AI models are distributed

4 min 143 views

AI Meta's EUPE Packs Vision AI Into Under 100M Parameters

4 min 103 views

AI Liquid AI's 350M Parameter Model Outperforms Giants at the Edge

4 min 330 views