TensorRT 11 vs TensorRT 10: Porting IPluginV2 to IPluginV3 Before Your Build Breaks
TensorRT 11 removed the entire IPluginV2 family, weak-typing builder flags, and implicit quantization. What breaks in your engine build and how to port it.
AI Inference Cost Optimization: GPU FinOps in 2026
An AI inference cost optimization decision record: continuous batching, KV-cache, quantization, speculative decoding, spot GPUs, and autoscaling the inference path.
KV Cache Optimization for LLM Inference: A Deep Dive
KV cache optimization for LLM inference — PagedAttention, quantization, prefix caching, and eviction, with the memory math behind each technique.