Google Gemma Tech Brings 28.9M LLM to ESP32 Microcontrollers

Forensic Summary

A developer has demonstrated a 28.9-million-parameter language model running entirely on an ESP32-S3 microcontroller costing approximately $8, leveraging Google's Gemma-derived Per-Layer Embeddings technique to fit the model into severely constrained hardware. This capability fundamentally shifts the threat model for embedded and IoT systems by enabling local, offline AI inference with no server-side visibility or logging. Defenders must now account for AI-driven logic executing on physically accessible, low-cost hardware that is difficult to monitor, patch, or audit at scale.

Read the full technical deep-dive on Grid the Grey: https://gridthegrey.com/posts/google-gemma-tech-brings-28-9m-llm-to-esp32-microcontrollers/