#edge-ai
Posts tagged edge-ai.
2026-02-02Running an agentic AI assistant on a Raspberry PiI ran OpenClaw on a Raspberry Pi. A look at what agentic AI assistants mean for edge AI, privacy, and latency.
2025-12-29Building Reachy Mini with on-device AIOver the holidays I built an on-device AI app for Hugging Face / Pollen Robotics' Reachy Mini, with voice-to-voice reactions running entirely on a Raspberry Pi 5.
2025-09-22Agentic AI running locally on a Raspberry Pi 5An agentic AI loop running 100% locally on an Arm-based Raspberry Pi 5, from voice to plan to act to observe to summarise to speak to remember.
2025-07-03My first week (back) at Arm!I've rejoined Arm as Senior Director, Edge AI, in Cambridge. A short note on the move and the mission.
2025-03-10Our Embedded World edge AI demo, and beating GPT-4oFor Embedded World 2025 we built a small AI that fits in any appliance, using off-the-shelf Hugging Face models, and pitted it against ChatGPT-4o.
2025-02-11Embedded AI solves a problem ChatGPT-4o can'tRunning DeepSeek R1 distill fully on-device on a Synaptics Astra board, it solves an AIME problem that ChatGPT-4o gets wrong.
2025-01-27DeepSeek and reasoning models on the edgeDeepSeek's R1 distillations bring strong reasoning to small models. I got R1 Distill Qwen 1.5B running on a Synaptics Astra board.
2025-01-07Embeddings: the foundation of our on-device assistantEmbeddings power LLMs, RAG, and our on-device voice assistant at CES 2025. Here's how we prepared the data, with an interactive visualization.
2024-12-16Building a speech-to-speech assistant with only on-device AIHow we built a speech-to-speech assistant that runs entirely on-device, using a sentence transformer for semantic search instead of a full LLM.
2024-12-11A multi-modal on-device assistant that can seeA multi-modal AI assistant running 100% on-device, using an on-chip NPU to accelerate vision, with the agent accessing it via tool calling.
2024-12-10AI now fits in your hand: LLMs got about 10x smallerLLMs are roughly 10x smaller than a year ago. Here's why that matters for device makers building on-device AI.
2024-12-062025 will be the year of on-device AIWhy I think 2025 is the year on-device AI breaks out, and the Cambrian explosion of AI into embedded electronics that follows.
2023-07-17Applying edge AI to predictive maintenance in roboticsA method to rapidly acquire industrial robot data and train a lightweight predictive-maintenance model in under an hour, using READY Robotics' Forge Edge and the Edge Impulse edge AI platform.