Synthetic benchmarks Twenty synthetic apps, one harness.
Twenty synthetic businesses make up the harness, from insurance claims and payments to energy markets and factory floors. Each scores the engine against an agent that calls an LLM on every request, with identical inputs.
4,377 of 4,377
Engine decisions right
Field test on five simulated businesses with synthetic data, October 6, 2026.
0
Wrong engine decisions
Every decision the engine made itself, on all 20 simulated businesses (synthetic data, 1,000 events each, October 9, 2026). The engine currently decides cases in 14 of them.
Milliseconds
Instead of seconds
Typical decision: 17–31 ms for the engine vs 3.3–4.2 s for an AI-only agent. Five simulated businesses, synthetic data, October 8, 2026.
0 AI calls
For the engine's own decisions
Same simulated runs, synthetic data: per 1,000 decisions, the AI-only agent made 329–1,519 AI calls; Cognitive + AI mode made 0–14. Most AI-only figures are scaled up from runs capped at 300 calls.
Drift, measured
The LLM-only baseline moved overnight. The rule held.
Same simulated factory decision, same model and prompt: the LLM-only agent scored 97% on day one and 20.5% on day two. The qualified rule decided the same 865 readings across both days, error-free.
Measured by Nxgyle in October 2026 on simulated businesses with synthetic data; “right” means agreeing with that simulated business's policy. The numbers demonstrate the method, not customer results, and zero errors on an evaluation set does not prove zero errors on future inputs.