Edge LLM Benchmark Q2 2026: Llama 3.3, Phi-4, Gemma 3 on Jetson Orin
Living benchmark — Llama 3.3 8B, Phi-4 14B, and Gemma 3 9B running on Jetson Orin AGX 64GB. Tokens/sec, time-to-first-token, memory, power. Updated quarterly.
Apple On-Device AI 2026: Neural Engine, Private Cloud Compute Architecture
How Apple Intelligence works — A19 Neural Engine, Private Cloud Compute, attested ML servers, model routing, and the privacy-preserving AI architecture.
Implementing Edge AI with TensorFlow Lite Micro on ESP32: A Production How-To
Step-by-step guide to running ML models on ESP32 using TensorFlow Lite Micro — quantization, memory budgeting, ESP-NN acceleration, and deployment patterns.
Edge AI Inference at Scale: NVIDIA Jetson, Intel, and Arm NPUs (Updated 2026)
Edge AI inference at scale, updated for 2026: NVIDIA Jetson Thor, Hailo and Arm Ethos NPUs, INT4/FP8 quantization, runtimes, and how to pick edge accelerators by TOPS-per-watt.
K3s at the Edge: A Production Kubernetes Guide for 2026
A production K3s edge Kubernetes guide: lightweight control plane, datastore options, HA topologies, GitOps fleet management, GPU at the edge, and hardening K3s for remote sites.