All Tools
N
LLMFreeOpen Source
NEEDLE
Tiny on-device foundation model for tools and extraction
Apache-2.0
ABOUT
Cloud LLMs cannot run on phones, wearables, or microcontrollers that need offline tool use and extraction. Needle is a tiny 2-bit foundation model that fits in 8-29 MB and still does structured extraction, embeddings, and tool calls on-device.
INTEGRATION GUIDE
1. Run offline tool calling on a phone or wearable without sending data to a cloud LLM
2. Extract structured fields from on-device sensor or camera text with a 2-bit model
3. Embed local documents on a microcontroller or robot for retrieval
4. Prototype smart-home or automotive agents that must stay on-device
TAGS
edge-aion-devicellmmicrocontrollersembeddingscactusmobile