Benchmark suite 2
Fallback / Reroute Visibility
Can return no issue when reroutes do not occur or every reroute is clearly disclosed.
Run steps
- Pre-register primary route, fallback candidates, and expected route metadata.
- Induce allowed fallback conditions such as missing credential, quota exhaustion, or safe mock route.
- Compare internal route attempts to user-visible disclosure and score omissions.
Required evidence
- Attempt list or route plan.
- User-visible fallback/degradation notice.
- Hash of route result and public response.
Validity controls
Total BlindingProvider names are stripped; reviewers judge whether the user was told about route change.
Apology TrapPost-incident apology text does not count unless the actual route disclosure changed in measured runs.