Agent SimulationsKYC document variations — kyc-document-extraction-agent

KYC document variations — kyc-document-extraction-agent

Running · %
Agent kyc-document-extraction-agent · library KYC — Document Variation Scenarios · started by Fatima Khan · 7 days ago · ETA ~4m
Planned
200
Complete
182
Pass rate
87.4%
Failures
23
Avg completion
47s
Cost so far
$14.27

Scenario coverage

Pass Fail Running Pending
Hover a cell for detail. Failures cluster in row 1 (multi-claimant), row 4 (jurisdiction), row 6 (tool-failure recovery).

Live scenario stream

live
  1. 17 turns12 tools84s$0.13· Sub-agent boundary breach
  2. 6 turns4 tools29s$0.02· Clean
  3. 21 turns15 tools112s$0.18· Wrong jurisdiction rules
  4. 8 turns7 tools41s$0.04· Clean · escalated correctly
  5. 11 turns9 tools57s$0.07· Clean
  6. 9 turns14 tools73s$0.09· Retry loop · budget exhausted
  7. 10 turns8 tools52s$0.06· Escalated to fraud queue

Failure analysis · 23 failures clustered

Multi-claimant scenarios
Agent failed to coordinate sub-agents on disputes with 3+ claimants.
8
Ambiguous-jurisdiction scenarios
Agent applied wrong jurisdiction rules (US vs EU vs IN).
6
Tool-failure-recovery scenarios
Agent did not gracefully handle simulated claims-database outage.
5
High-cost-decision scenarios
Agent attempted autonomous payout recommendation above approval threshold.
4