Skip to content
Air Automations
Blog

Engineering

28 posts

EngineeringOctober 13, 20267 min read

Google Reviews at Scale: What to Automate, What to Keep Human

A practical playbook for restaurant and hotel groups: what to automate with AI when replying to Google reviews, and what a human must still handle.

Read
EngineeringOctober 9, 20265 min read

Vercel's skipMiddlewareRequestBody Is an Agent Debugging Trap

Vercel's skipMiddlewareRequestBody saves milliseconds but strips context your agent's tool chain needs. Here's the coupling it creates — and how to debug it.

Read
EngineeringOctober 7, 20267 min read

EmbeddingGemma 2: Local RAG Usually Makes Agents Slower

EmbeddingGemma 2 makes on-device multimodal RAG real — but local embeddings quietly turn async retrieval into a sync bottleneck. Here's when it's worth it.

Read
EngineeringOctober 5, 20265 min read

Agents Can't Self-Verify: Assert External State in the Loop

Agents hallucinate task completion because they trust their own confidence. Here's how to assert external state in the loop — and architect retries that actually work.

Read
EngineeringOctober 2, 20265 min read

Synthetic Training Data Is a Latency Win and a Blindness Tax

AutoSynthData scales agent training data without annotation — but synthetic distributions hide failure modes your evals won't catch. Here's the tradeoff.

Read
EngineeringSeptember 16, 20265 min read

Your Agent Evals Need Site-Type Routing, Not One Score

Vercel's Is Agentic site-type views prove monolithic agent evals hide production failures. Here's how to route eval signal per interaction surface.

Read
EngineeringSeptember 9, 20266 min read

Vercel's 3.4ms Sandbox Routing: Why Variance Ships Agents

Vercel cut Sandbox routing from 62ms to 3.4ms. The real win isn't speed—it's variance collapse, and that's what keeps 6-tool agent chains inside SLA.

Read
EngineeringSeptember 7, 20267 min read

Alignment Is an Observability Problem Now, Not a Governance One

Pachocki's 'Alien Mind' treats alignment as governance. For teams shipping 12-hour agent loops, it's an observability problem. Here's how we engineer it.

Read
EngineeringSeptember 4, 20266 min read

WeatherNext 3 and the Specialization Fork in Agent Design

WeatherNext 3 beats generic LLMs by specializing. Here's the architecture fork every agent team faces — and how to design fallbacks that survive it.

Read
EngineeringSeptember 2, 20265 min read

BenchMIRT Confirms It: Leaderboards Don't Predict Agent Reliability

BenchMIRT shows LLM benchmarks miss what breaks agents in production. Here's the closed-loop eval harness shipping teams need instead of leaderboards.

Read
EngineeringAugust 19, 20266 min read

Vercel's Instagram Adapter Ships in a Day. Debugging It Doesn't.

Vercel's Instagram adapter for Chat SDK hides Instagram's constraint model. Here's where agent latency, state, and retries break — and how to fix them.

Read
EngineeringAugust 17, 20265 min read

ECH Won't Save Your Agent: The Side Channels Vercel Can't Hide

Vercel's ECH hides hostnames, but agent timing, token counts, and error signatures still leak your tool graph. Here's what to harden instead.

Read
EngineeringAugust 12, 20267 min read

Vercel Connect Observability Stops at the Connector. Your Agent Doesn't.

Vercel Connect now shows token lifecycles and correlation IDs — but only per connector. Here's the agent-scoped logging pattern that closes the gap.

Read
EngineeringAugust 7, 20265 min read

WeatherNext's Real Lesson: Your Agent Shouldn't Predict Time Series

DeepMind's WeatherNext replaced physics with sequence prediction. Here's when your agent should defer to a specialized time-series model instead of RAG or reasoning.

Read
EngineeringAugust 5, 20265 min read

Your Agent Eval Pipeline Is an Attack Surface. Treat It Like One.

OpenAI's cyber-eval disclosures expose a gap every agent team shares: the eval pipeline is an attack surface. Here's how to isolate it before it burns you.

Read
EngineeringAugust 3, 20268 min read

Qwen 3.8 Max Just Made Half Your Routing Layer Dead Weight

Qwen 3.8 Max collapses vision and text into one model with 1M context. Here's the routing logic you can now delete — and what still earns its keep.

Read
EngineeringJuly 29, 20269 min read

Stateful Sandboxes: Why Code Agents Fail on 12-Hour Pipelines

OpenAI's scientific computing report reveals the real ship-blocker for code agents: stateless execution loops. Here's the fork/snapshot architecture that fixes it.

Read
EngineeringJuly 22, 20266 min read

Sim-to-Real Won't Save Your Agent Stack: The Physical AI Illusion

Better simulators make physical AI look close. Here's why your LLM agent architecture, evals, and observability won't survive the jump to embodied tasks.

Read
EngineeringJuly 17, 20267 min read

Cache-Reason Logs: The Observability Pattern Your Agents Need

Vercel logs *why* a cache missed, not just that it did. Here's why agent tool calls and retrievals need the same granularity — or you're flying blind.

Read
EngineeringJuly 13, 20264 min read

Seedream 5.0 Pro Can't Ship Your Infographics Alone

Seedream 5.0 Pro's text rendering is a leap forward, but production agents still need SVG+image hybrid pipelines. Here's how we architect them.

Read
EngineeringJuly 6, 20267 min read

HuggingFace Kernels: Why Agent Teams Should Care About the Iteration Loop

HF's revamped Kernels aren't just about custom hardware. For agent teams, the real win is a faster loop from inference bottleneck to shipped optimization.

Read
EngineeringJuly 3, 20266 min read

Vercel AI Gateway Routing Rules: Necessary, Not Sufficient

Vercel's AI Gateway routing rules move failover out of code deploys. Here's what they actually solve for agents at scale—and what they don't.

Read
EngineeringJuly 1, 20266 min read

ScarfBench Is the Canary: Why Java Migrations Predict Agent Reliability

ScarfBench doesn't rank models—it exposes where agents break on real codebases. Here's why enterprise Java migration predicts your production agent's reliability.

Read
EngineeringJune 29, 20264 min read

HP + OpenAI: The Real Bet Is Agent Observability, Not the Model

HP's OpenAI Frontier partnership isn't a model story. It's an operations story. Here's the agent observability and routing infrastructure enterprises actually need.

Read
EngineeringJune 10, 20266 min read

Code-Switched ASR Breaks Voice Agents. Here's the Fix.

Frontier ASR still fails 2-3x harder on bilingual speech. The fix isn't waiting for better models — it's runtime code-switch detection and language routing.

Read
EngineeringMay 29, 20267 min read

What Endava's 'Weeks to Hours' Actually Required Under the Hood

Endava cut requirements analysis from weeks to hours with Codex. The real story isn't agents—it's the workflow engineering most teams skip.

Read
EngineeringMay 25, 20265 min read

Diffusion LLMs Are Fast. Your Agent Is Still Slow.

Nemotron-style diffusion LLMs cut decoding time, but agent latency lives in retrieval and tool calls. Here's what actually changes in production.

Read
EngineeringMay 21, 20266 min read

Your RAG Hits 0.9 Recall in Eval and Dies in Production. Here's Why.

Benchmark recall lies. Here's how we diagnose retrieval quality in production RAG systems before users start filing tickets at 2am.

Read