Your RAG Eval Isn't Flaky. Your Retrieval Is Non-Deterministic.

RAG evaluation scores were quietly shifting between runs, not because of model randomness, but because SQL queries without tie-breakers returned equally-ranked rows in unpredictable orders. Adding a deterministic tie-breaker to both retrieval queries fixed the inconsistency, making evals trustworthy without changing retrieval quality.