Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
Why CEREBRO kept it
14MB agentic LLM for edge devices; lightweight agent mechanics.
The text below is an automated extraction of the article at https://cactuscompute.com/needle, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (cactuscompute.com).
Today we release Needle 2: an open 45M-parameter model for tool calling, device use and structured extraction. The whole model is a single 14MB binary that runs a full session in 28MB of RAM. It is built on our Simple Attention Network findings, compressed to CQ2-bit with Cactus Quants, and baked into its own engine. On the tool call and mobile device use benchmarks, Needle 2 trades wins with other small models like FunctionGemma 270M, LFM2.5 230M and Apple FM, at 5× to 70× smaller, and 2 bits against their f16. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, between 400–1,500 tok
Community take
Tiny models fail basic tasks (Needle2 returned confidence=0 on lock_door), raising production reliability doubts.
Backlinks
Appeared in 1 briefing
Related
Shares tags: ai/agents · ai/llm-mechanics
Also from cactuscompute.com
Only signal from cactuscompute.com so far.