Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
SMRTR summary
Needle 2 is a tiny AI model designed to run directly on cheap, everyday devices like budget phones, smartwatches, and microcontrollers, without needing internet or cloud access. At just 14MB and 45 million parameters, it handles tool calling and device control tasks by matching spoken commands to device functions. It runs at 500 tokens per second on a Raspberry Pi 5, fits in 28MB of RAM, and already powers the Pebble Index Ring wearable.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article