AI recommendation reliability, 2026: the data

Stated limits

• Agreement is Jaccard overlap over canonicalised company names.
• Confidence intervals are bootstrap over questions, not pairs, because pairs inside one question are not independent.
• Any model with fewer than 5 questions carrying repeats is reported as insufficient data, not given a number.
• Several models share one inference host; a host-level effect would be common to them.
• "Retired" means a provider no longer serves that model id on the probe date. The weights may exist elsewhere.
• One estate's roster on one date. A lower bound, not a census.
• The raw store includes failed and rate-limited cells on purpose, so coverage can be recomputed independently.

Conflict of interest. Lucreya is part of the Lattice network, which sells disclosed placements on pages that AI engines cite. That is a commercial interest in this subject. These files are published so the findings can be checked against us.