Yocto on Jetson vs Ubuntu L4T: Building Production Edge AI Images with OE4T
NVIDIA now officially supports Yocto on Jetson via OE4T. How a Yocto image compares with Ubuntu L4T on footprint, reproducibility and attack surface.
Which Small Language Models Actually Run on CPU in 2026: 11 Models Compared
Eleven small language models compared for CPU-only inference in 2026: real Q4 file sizes, official GGUF availability, licences and the memory-bandwidth ceiling.
ExecuTorch 1.5 On-Device LLM Serving (2026): Batched Scheduling, Cancellation and Off-Graph KV Cache
ExecuTorch 1.5 shipped multi-method export, batched request scheduling, bounded cancellation and off-graph KV cache. What it changes for on-device LLM apps.
Jetson Thor vs Jetson Orin AGX: 2026 Edge AI Upgrade Guide
NVIDIA Jetson Thor vs Jetson Orin AGX in 2026: TOPS, GPU architecture, memory bandwidth, power, price and whether the Thor upgrade is worth it for edge AI.
INT4 vs INT8 vs FP8 on Edge NPUs: The 2026 Quantization Trade-off
INT4, INT8, and FP8 quantization compared on edge NPUs in 2026: accuracy loss, latency, and memory trade-offs for vision and LLM workloads.
Hailo-10H vs Jetson Orin Nano (2026): Same CV Workload Tested
Hailo-10H vs Jetson Orin Nano head-to-head on the same computer-vision workload: TOPS/W, latency, framework support, memory and price. A 2026 edge-inference pick.
On-Device LLM Runtimes (2026): llama.cpp vs MLC vs ONNX
On-device LLM runtimes compared: llama.cpp vs MLC-LLM vs ONNX Runtime on edge SoCs - backends, quantization, throughput, memory and portability. 2026 decision guide.
Jetson Thor vs Hailo-10H vs Coral (2026): Edge Inference Pick
Jetson Thor vs Hailo-10H vs Google Coral for edge AI inference: TOPS/W, framework support, memory, price and the workload each wins. 2026 hardware decision guide.
Small Language Models on Device: Edge Inference Architecture (2026)
How to run small language models (SLMs) on-device: model sizing, distillation, quantization, NPU acceleration, memory budgets, and when a 1-8B SLM beats a cloud LLM.
NVIDIA Jetson + K3s: Edge AI Cluster Tutorial (2026)
A hands-on NVIDIA Jetson and K3s edge AI cluster tutorial: provision nodes, enable GPU scheduling, deploy a vision model, and run inference at the edge.