BankingManaged AI Agents
Banking AI Agents,
Monitored for Compliance
Nestack Agent Care helps banks monitor, evaluate, and optimize AI agents used for fraud detection, risk analysis, KYC, and customer support — before small AI errors become regulatory or financial exposure.
Scope
Banking AI agents we build & manage
Twenty-two archetypes — from front-office service to suspicious-activity reporting, resilience clocks and reserve attestation.
Customers4
Lending & trade6
Financial crime6
Compliance & resilience6
Observability
What we make observable
Every banking agent session is traced across ten layers — what we capture and the evidence we keep.
- Evidence we keepGoalconstraintsapproval requirement
- Evidence we keepSourceversiontimestamprelevancecitation
- Evidence we keepPlanned sequenceactual sequenceworkflow status
- Evidence we keepTask statusresultretryfailure reason
- Evidence we keepTool nameversioninputoutputpermissionresult
- Evidence we keepModel/versioninput/outputtoken usagelatencycost
- Evidence we keepEvaluation typemetricthresholdresult
- Evidence we keepGuardrail targettriggeractionenforcement result
- Evidence we keepReviewerdecisioncorrectionreason
- Evidence we keepOutcome statusbusiness resultlinked trace
Catalog
Failure modes
Filter failure modes by where they occur in the agent lifecycle—from goals and retrieval to tools, evaluations, guardrails and outcomes.
BNK-01Unauthorized transaction actions — agent initiates or facilitates money movementSEV-1
BNK-02Unlicensed financial advice — product recommendations crossing the advice boundarySEV-1
BNK-03Fair-lending proxy bias in loan pre-screening or hardship handlingSEV-1
BNK-04Cross-customer account-data leakageSEV-1
BNK-05Wrong fee, rate or product terms quoted from stale tablesSEV-2
BNK-06Social-engineered account access — attacker talks agent into resets or disclosuresSEV-1
BNK-07KYC/AML screening misses on flagged entitiesSEV-2
BNK-08Audit-trail gaps — recommendations without complete reasoning recordsSEV-2
BNK-09Dispute and chargeback misadjudication — wrong liability or rightsSEV-2
BNK-10Collections conduct violations — harassment, unlawful threats, hardship breachesSEV-1
BNK-11Scam and authorised-push-payment detection failure — customer not warnedSEV-1
BNK-12Overdraft and fee-waiver misapplication — wrong charge or disclosureSEV-2
BNK-13Repayment-schedule and amortization miscalculationSEV-2
BNK-14Vulnerable-customer escalation failure — hardship or distress not routedSEV-1
BNK-15Indirect prompt injection — instructions hidden in customer documents, statements or transaction memos hijack the agentSEV-1
BNK-16Failure to recognize a consumer invoking a federal right — statutory clock never startsSEV-1
BNK-17Adverse-action notice omission — AI credit decline without specific, accurate ECOA reasonsSEV-1
BNK-18Hallucinated policy, terms, eligibility or product features not present in sourceSEV-2
BNK-19Required disclosure omitted or wrong — APR/APY, fee schedule or Reg E terms not surfacedSEV-2
BNK-20Deepfake voice / synthetic-identity spoofing defeats voice-auth or KYC livenessSEV-1
BNK-21FCRA furnisher failure — agent auto-confirms a disputed tradeline or keeps furnishing known-wrong dataSEV-1
BNK-22Sanctions/OFAC transaction screening false negative — alias, transliteration or fuzzy-match missSEV-1
BNK-23Mortgage/loan servicing error — dual tracking, misapplied payment or force-placed insurance during loss mitigationSEV-1
BNK-24Human-handoff failure — "doom loops" trap customers with no off-ramp to a personSEV-2
BNK-25NPI privacy leakage — customer data flows into training, third-party models or logs without safeguardsSEV-1
BNK-26Silent model drift — accuracy or refusal behaviour degrades between releases without detectionSEV-2
BNK-27Third-party / foundation-model vendor risk — a silent provider update breaks guardrails or changes behaviourSEV-2
BNK-28Over-restriction — wrongful account freeze or fraud false-positive denies a legitimate customerSEV-2
BNK-29Accessibility & limited-English service gaps — chatbot excludes or misinforms protected usersSEV-2
A · Customer-service & account-inquiry agents
CQ-01Impersonator got through01 · AuthenticationSEV-2
CQ-02Joint-account overshare02 · RetrievalSEV-2
CQ-03Complaint answered, not logged03 · AnsweringSEV-1
CQ-04Restriction explained too far03 · AnsweringSEV-1
CQ-05Vulnerability not routed04 · Routing / writeSEV-1
CQ-06Fraud disclosure left queued04 · Routing / writeSEV-1
CQ-07Silent tariff drift05 · Change / VersionSEV-3
B · Loan-application assistants
LA-01Application not logged as one01 · IntakeSEV-1
LA-02Altered document accepted01 · IntakeSEV-2
LA-03Variable income averaged wrong02 · ExtractionSEV-2
LA-04Uneven proof burden03 · CompletenessSEV-1
LA-05Clock spent re-checking03 · CompletenessSEV-3
LA-06Gap handed over as a reason04 · Handover / writeSEV-1
LA-07Silent criteria drift05 · Change / VersionSEV-3
C · Fraud-alert triage agents
FT-01Inbound credit never watched01 · Alert intakeSEV-2
FT-02Wages held as a mule signal01 · Alert intakeSEV-1
FT-03Own device, own credentials02 · Case assemblySEV-2
FT-04Case with no reasoning in it02 · Case assemblySEV-3
FT-05Ranked below the clock03 · RankingSEV-2
FT-06Card blocked mid-shop04 · Handover / writeSEV-1
FT-07Threshold moved, queue changed05 · Change / VersionSEV-3
D · Payment-dispute agents
DS-01Notice logged, clock not started01 · Claim intakeSEV-1
DS-02Case waits on the customer01 · Claim intakeSEV-1
DS-03Scam read as unauthorised use02 · ClassificationSEV-2
DS-04Scheme window taken as the claim03 · Routes & clocksSEV-1
DS-05Wrong reason code raised03 · Routes & clocksSEV-2
DS-06Merchant's record taken as proof04 · Evidence / writeSEV-3
DS-07Threshold moved, claims sat longer05 · Change / VersionSEV-1
E · Collections & hardship copilots
CH-01Wrong party on the assembled case01 · Case assemblySEV-1
CH-02Stop in force not seen01 · Case assemblySEV-1
CH-03Disclosure said in passing02 · CircumstancesSEV-1
CH-04Variable income read as regular02 · CircumstancesSEV-2
CH-05One option, the cheapest to run03 · Option matchingSEV-2
CH-06Case handed over half-assembled04 · Handover / writeSEV-3
CH-07Change narrows what is offered05 · Change / VersionSEV-2
F · Wealth-advisory research copilots
WA-01Superseded document used01 · RetrievalSEV-2
WA-02Restricted source crossed01 · RetrievalSEV-1
WA-03Stale price or holding02 · PositionSEV-2
WA-04Held-away assets left out02 · PositionSEV-3
WA-05Past performance shown bare03 · DraftingSEV-1
WA-06Note reads as a recommendation04 · HandoverSEV-1
WA-07Research update lands late05 · Change / VersionSEV-2
G · Credit-memo drafting agents
MD-01Superseded figures spread01 · File assemblySEV-2
MD-02Related entities read as one02 · RecomputationSEV-2
MD-03Covenant tested off-agreement02 · RecomputationSEV-2
MD-04Risk written round, not named03 · DraftingSEV-1
MD-05Prohibited basis in the narrative03 · DraftingSEV-1
MD-06Draft read as the credit view04 · Handover / writeSEV-1
MD-07Silent spreading-rule drift05 · Change / VersionSEV-3
H · KYC onboarding & periodic-review agents
KO-01Document check fails by cohort01 · CollectionSEV-3
KO-02Replayed or generated capture01 · CollectionSEV-2
KO-03Chain stopped one layer early02 · TracingSEV-2
KO-04Registers reconciled away02 · TracingSEV-2
KO-05Stale evidence closes a review03 · AssemblySEV-1
KO-06Outreach says too much04 · Handover / writeSEV-1
KO-07Silent standard drift05 · Change / VersionSEV-2
I · Sanctions-alert adjudication agents
SN-01Message never reached the pack01 · Hit intakeSEV-3
SN-02One name, two transliterations02 · Match anatomySEV-1
SN-03No birth date to separate them02 · Match anatomySEV-2
SN-04Ownership stops at the named party03 · Record & ownershipSEV-1
SN-05Last disposition reused03 · Record & ownershipSEV-1
SN-06A pack that reads like a clearance04 · Queue / handoverSEV-3
SN-07List moved, ranking not re-tested05 · Change / VersionSEV-2
J · Trade-finance document-checking agents
TF-01Amendment never reached the comparison01 · IntakeSEV-1
TF-02Pages missing from the capture01 · IntakeSEV-3
TF-03A finding the rules do not carry02 · ExaminationSEV-2
TF-04Original taken on trust02 · ExaminationSEV-1
TF-05Conflict across the set not seen03 · Cross-readSEV-1
TF-06Clock counted from the wrong day04 · HandoverSEV-2
TF-07Practice revised, findings not re-tested05 · Change / VersionSEV-2
K · Regulatory-reporting & compliance-monitoring agents
RR-01Cell traced to the wrong field01 · AssemblySEV-2
RR-02Extract taken before close01 · AssemblySEV-3
RR-03Movement explained away02 · ReconciliationSEV-2
RR-04Passes the rules, still wrong03 · ValidationSEV-2
RR-05Alert left undispositioned04 · Monitoring / writeSEV-1
RR-06Pack queued as if signed04 · Monitoring / writeSEV-1
RR-07Instruction change not picked up05 · Change / VersionSEV-2
L · Contract-review & legal-workflow agents
LW-01Superseded version read as current01 · AssemblySEV-2
LW-02Document never in the set01 · AssemblySEV-3
LW-03Clause read outside its definitions02 · ExtractionSEV-2
LW-04Not found reported as not there02 · ExtractionSEV-1
LW-05Playbook position stated as law03 · ComparisonSEV-1
LW-06Obligation dated from the wrong trigger04 · HandoverSEV-2
LW-07Playbook revised, files not re-compared05 · Change / VersionSEV-1
M · Suspicious-activity reporting agents
ES-03Stale key-term list01 · RetrievalSEV-3
ES-04Detection date inferred02 · ReasoningSEV-1
ES-06Narrative not standalone02 · ReasoningSEV-1
ES-02Disposition by throughput03 · Tool / writeSEV-1
ES-05Continuation filed early03 · Tool / writeSEV-2
ES-01Wrong subject reported04 · OutputSEV-2
ES-07Silent review regression05 · Change / VersionSEV-2
N · Operational-resilience & incident-reporting agents
OR-03Awareness time misread01 · RetrievalSEV-3
OR-04Severity scale mapped02 · ReasoningSEV-1
OR-06Stale hypothesis repeated02 · ReasoningSEV-1
OR-02Clock started by the tool03 · Tool / writeSEV-1
OR-05Weekend extension applied03 · Tool / writeSEV-2
OR-01Countdown from detection04 · OutputSEV-2
OR-07Silent threshold drift05 · Change / VersionSEV-2
O · HMDA & lending-data-integrity agents
HW-03Superseded system of record01 · RetrievalSEV-3
HW-04Stale benchmark table02 · ReasoningSEV-1
HW-06Action-taken mismapping02 · ReasoningSEV-1
HW-02Edits cleared in bulk03 · Tool / writeSEV-1
HW-05Unreviewed field drift03 · Tool / writeSEV-2
HW-01Signed without knowledge04 · OutputSEV-2
HW-07Silent mapping regression05 · Change / VersionSEV-2
P · Allowance-governance & loan-review agents
EA-03Missing basis document01 · RetrievalSEV-3
EA-04Unquantified factor move02 · ReasoningSEV-1
EA-06Assumption change buried02 · ReasoningSEV-1
EA-02Stale sample stratification03 · Tool / writeSEV-1
EA-05Concurrence unrecorded03 · Tool / writeSEV-2
EA-01Unreconciled variance04 · OutputSEV-2
EA-07Silent methodology drift05 · Change / VersionSEV-2
Q · Transaction-monitoring tuning agents
TM-03Feed truncation unseen01 · RetrievalSEV-3
TM-04Null read as negative02 · ReasoningSEV-1
TM-06Coverage from inventory02 · ReasoningSEV-1
TM-02Segment mismatch03 · Tool / writeSEV-1
TM-05Pack carried forward03 · Tool / writeSEV-2
TM-01Unmonitored population04 · OutputSEV-2
TM-07Silent tuning regression05 · Change / VersionSEV-2
R · Stablecoin reserve-attestation agents
RG-03Unconfirmed custodian balance01 · RetrievalSEV-3
RG-04Maturity tested at purchase02 · ReasoningSEV-1
RG-06Default exception label02 · ReasoningSEV-1
RG-02Coin supply unreconciled03 · Tool / writeSEV-1
RG-05Allocated, not segregated03 · Tool / writeSEV-2
RG-01Disclosure differs from pack04 · OutputSEV-2
RG-07Silent eligibility drift05 · Change / VersionSEV-2
S · AML programme-governance & testing agents
OP-03Superseded version used01 · RetrievalSEV-3
OP-04Orphaned control mapping02 · ReasoningSEV-1
OP-06Scope inherited unchanged02 · ReasoningSEV-1
OP-02Closure without evidence03 · Tool / writeSEV-1
OP-05Population left undefined03 · Tool / writeSEV-2
OP-01Approval not minuted04 · OutputSEV-2
OP-07Silent element drift05 · Change / VersionSEV-2
T · ICT third-party register & oversight agents
DI-03Contract system taken as truth01 · RetrievalSEV-3
DI-04Inherited criticality flag02 · ReasoningSEV-1
DI-06Over-recorded supply chain02 · ReasoningSEV-1
DI-02Key field auto-filled03 · Tool / writeSEV-1
DI-05Consolidation level wrong03 · Tool / writeSEV-2
DI-01Assembled at the wrong date04 · OutputSEV-2
DI-07Silent mapping drift05 · Change / VersionSEV-2
U · Deposit-insurance recordkeeping agents
DO-03Ledger left out01 · RetrievalSEV-3
DO-04Capacity code overstates02 · ReasoningSEV-1
DO-06Uncomputable reclassified02 · ReasoningSEV-1
DO-02Testing exception open03 · Tool / writeSEV-1
DO-05Notice without validation03 · Tool / writeSEV-2
DO-01Miscoded ownership right04 · OutputSEV-2
DO-07Silent code-rule drift05 · Change / VersionSEV-2
V · Mortgage-servicing compliance agents
EK-03Intake channel missed01 · RetrievalSEV-3
EK-04Gate applied wrongly02 · ReasoningSEV-1
EK-06Calendar days assumed02 · ReasoningSEV-1
EK-02Appeal wrongly rejected03 · Tool / writeSEV-1
EK-05Duplicate acknowledgement03 · Tool / writeSEV-2
EK-01Notice sent late04 · OutputSEV-2
EK-07Silent clock drift05 · Change / VersionSEV-2
Guardrails
Critical guardrails for Banking agents
Ten controls that hold regardless of prompt, plan or pressure. Open one to see what it protects, what trips it, what the agent is forced to do, who may release it, and what is written to the record.
GR-01No money movement without out-of-band authorisationOverride defined
Target
Payment initiation, transfers, standing-order changes and any endpoint that moves customer funds
Trigger
The agent attempts to initiate or facilitate a transfer without out-of-band authorisation
Action — enforced
Block the transfer and require verified authorisation; agent may prepare the payment for the customer to confirm
Human override
Released only by the customer via out-of-band strong authentication on the payment
Logged evidenceaccount id · payment amount · payee · authentication result · timestamp
GR-02No personalised financial advice beyond licensed scopeOverride defined
Target
Customer conversations that could recommend products, strategies or actions crossing the advice boundary
Trigger
A response gives a personal product or investment recommendation beyond the licensed scope
Action — enforced
Block the recommendation and provide factual information only; agent may route the customer to a licensed adviser
Human override
Released only by a licensed adviser accepting the advice interaction under their authorisation
Logged evidencesession id · drafted recommendation · advice-boundary flag · adviser identity · timestamp
GR-03No credit decline without specific ECOA adverse-action reasonsOverride defined
Target
Credit pre-screening, hardship handling and any automated decline surfaced to an applicant
Trigger
A credit decline is issued without specific, accurate ECOA adverse-action reasons or shows proxy bias
Action — enforced
Block the decline notice and require accurate reasons and a fairness check; agent may issue a compliant notice
Human override
Released only by the credit officer after confirming reasons and a matched-pair fairness result
Logged evidenceapplication id · decision · adverse-action reasons · fairness metric · officer identity · timestamp
GR-04No cross-customer data retrievalNo override
Target
Account records, transactions and NPI scoped to the single authenticated customer in session
Trigger
A request or tool call would read another customer account data, NPI or history
Action — enforced
Deny the cross-customer read and return only in-session data; no customer data flows to training or third parties
Human override
None — cannot be overridden in session
Logged evidencerequesting customer · target customer · denied record id · policy rule · timestamp
GR-05No instruction embedded in statements or memos ever executedNo override
Target
Customer-uploaded documents, statements, transaction memos and any ingested text the agent reads
Trigger
Ingested statements or memos contain directives or tool calls attempting to hijack the agent
Action — enforced
Treat the content as data only and refuse the embedded instruction; the customer request continues normally
Human override
None — cannot be overridden in session
Logged evidencedocument id · detected instruction · source · content hash · timestamp
GR-06No transaction cleared past OFAC or sanctions screening hitOverride defined
Target
Payment and onboarding screening against sanctions, watchlists and KYC/AML flags
Trigger
A transaction or onboarding matches a sanctions, alias or fuzzy-match screening hit
Action — enforced
Hold the transaction and escalate to sanctions review; agent may not clear it and must preserve the alert
Human override
Released only by the sanctions officer after adjudicating the screening hit as a true false-positive
Logged evidencetransaction id · matched list · match score · adjudication · officer identity · timestamp
GR-07No account access on synthetic-identity voice authOverride defined
Target
Voice and video authentication and KYC liveness checks used for account access or high-risk changes
Trigger
Liveness or anti-spoofing signals indicate a synthetic voice, deepfake or cloned identity
Action — enforced
Deny access and require a stronger channel; agent may offer verified branch or app authentication instead
Human override
Released only by the fraud officer after verifying identity through an independent channel
Logged evidencesession id · liveness score · spoof indicators · decision · officer identity · timestamp
GR-08No flagged payment without APP scam warningOverride defined
Target
Outbound payments and new-payee setups flagged by scam and authorised-push-payment risk models
Trigger
A payment matches an authorised-push-payment scam pattern yet no warning has been shown
Action — enforced
Hold the payment and present a tailored scam warning; agent may proceed after the customer confirms understanding
Human override
Released only by the customer acknowledging the scam warning after a mandatory review step
Logged evidencepayment id · scam pattern · warning shown · customer acknowledgement · timestamp
GR-09No servicing action causing dual tracking or misapplied paymentOverride defined
Target
Loan and mortgage servicing actions during loss mitigation, payment posting and insurance placement
Trigger
An action would advance foreclosure during loss mitigation, misapply a payment or force-place insurance
Action — enforced
Block the servicing action and route to review; agent may continue the loss-mitigation workflow correctly
Human override
Released only by the servicing officer after confirming loss-mitigation status and correct payment posting
Logged evidenceloan id · servicing action · loss-mitigation status · officer identity · timestamp
GR-10No unrouted hardship or distress signalOverride defined
Target
Collections, hardship and support conversations where distress or vulnerability may surface
Trigger
The customer signals hardship, vulnerability or distress and no human off-ramp is offered
Action — enforced
Force escalation to a trained human and pause collections pressure; agent may offer immediate handoff options
Human override
Released only by a supervisor after a trained human has assumed the interaction
Logged evidencesession id · distress signal · escalation route · handoff status · supervisor identity · timestamp
Oversight
Human review — triggers, decisions and evidence
When a defined risk trigger fires, the affected action is routed to a named reviewer. Every decision is recorded with its correction, escalation and final outcome for full traceability.
- ConfidenceLow-confidence screening hit
- Financial impactHigh-value transaction
- Identity / change riskAccount or payee change
- Irreversible actionCredit decision or freeze
- Policy riskAdvice-boundary conflict
- Safety controlGuardrail override
- Quality failureFailed critical evaluation
- Revieweridentity + role
- Decisionapprove / reject / amend
- Correctionwhat changed
- Escalationwho, why and severity
- Final outcomereleased / blocked / returned for rework
7 triggers · any one halts the agent
1 record · 5 fields, every time
Compliance
Regulatory mapping
- 01 Goal
- 02 Retrieval
- 03 Workflow
- 04 Task
- 05 Tool
- 06 LLM
- 07 Evaluation
- 08 Guardrail
- 09 Human review
- 10 Outcome
Fair lending & adverse action (US)
An agent that screens, declines or drafts on a prohibited basis discriminates; declines it explains must state specific reasons, and an oral request it handles is an application.
Regulation B 12 CFR 1002.4(a) · ECOA 15 U.S.C. 1691(d)(2) · Fair Housing Act 42 U.S.C. 3605(a)
Lifecycle layer:06 LLM · 07 Evaluation · 08 Guardrail · 10 Outcome
- BNK-03
- BNK-17
- LA-01
- LA-04
- LA-05
- LA-06
- MD-05
Evaluations
Baseline evaluation suite — in detail
Baseline evaluations are completed during onboarding and repeated based on the selected plan. Agents that fail critical checks remain restricted until they pass re-testing.
- Evaluation suites
- 38
- Failure modes covered
- 183 of 183
- Cases · 10% rotated / quarter
- 2,915
- Audit-ready scorecard
- Monthly
Output evaluation6 suites · 655 cases
200 casesAdjudication golden-setcatches BNK-01 · BNK-07
200 casesFairness matched-pairscatches BNK-03
120 casesAdvice-boundarycatches BNK-02
80 scriptsSocial-engineering suitecatches BNK-06 · BNK-01
60 casesRate & fee freshnesscatches BNK-05
80 patternsInjection suitecatches BNK-15
80 casesNumeric extractioncatches BNK-04
75 casesDispute-adjudication setcatches BNK-09
70 casesCollections-conduct setcatches BNK-10
70 casesScam-interruption setcatches BNK-11
60 casesOverdraft and fee setcatches BNK-12
60 casesAmortization setcatches BNK-13
60 casesVulnerable-customer setcatches BNK-14
70 casesAccount-inquiry containment setcatches CQ-01–07
70 casesLoan intake trajectory setcatches LA-01–07
70 casesFraud-triage trajectory setcatches FT-01–07
70 casesDispute-clock step setcatches DS-01–07
70 casesHardship guardrail setcatches CH-01–07
70 casesResearch pack retrieval setcatches WA-01–07
70 casesCredit-memo output setcatches MD-01–07
70 casesKYC trace retrieval setcatches KO-01–07
70 casesSanctions match retrieval setcatches SN-01–07
70 casesDocument examination step setcatches TF-01–07
70 casesReturn-build trajectory setcatches RR-01–07
70 casesContract review integrity setcatches LW-01–07
70 casesSAR filing integrity setcatches ES-01–07
70 casesIncident clock and classification setcatches OR-01–07
70 casesHMDA register integrity setcatches HW-01–07
70 casesAllowance pack integrity setcatches EA-01–07
70 casesMonitoring coverage and tuning setcatches TM-01–07
70 casesReserve attestation integrity setcatches RG-01–07
70 casesAML programme governance setcatches OP-01–07
70 casesICT register integrity setcatches DI-01–07
70 casesPart 370 coverage setcatches DO-01–07
70 casesLoss mitigation clock setcatches EK-01–07
40 casesInjection and identity-attack setcatches BNK-15 · BNK-20 · BNK-22 · BNK-25
50 casesConsumer-rights compliance setcatches BNK-16 · BNK-17 · BNK-19 · BNK-21 · BNK-23
70 casesService integrity and drift setcatches BNK-18 · BNK-24 · BNK-26 · BNK-27 · BNK-28 · BNK-29 · BNK-08
Use your work email to unlock the full grid. We use it to send the requested Agent Care material and qualify business inquiries. We do not sell or share your email.
Domain-expert review
Client-designated subject-matter experts review evaluation criteria, pass thresholds and industry-specific risks before baseline approval.
Test-case rotation
Evaluation cases are refreshed regularly to reduce memorisation, limit overfitting and maintain meaningful performance measurement.
Scorecard integration
Scorecards compare results with the approved baseline, show performance trends and flag material declines for review and escalation.
Client-specific extensions
Where included in scope, evaluations may be expanded using approved incidents, workflows, policies, data patterns and industry-specific risks.
Monitoring
Change-aware monitoring
When agent performance changes, Nestack correlates the shift with changes to the agent, prompt, model, tools, knowledge base, guardrails and evaluation suite.
- Week 1 · 98.5%
- Week 2 · 98.4%
- Week 3 · 98.6%
- Week 4 · 98.5%
- Week 5 · 98.7%
- Week 6 · 98.5%
- Week 7 · 98.6%
- Week 8 · 92.8%
- Week 9 · 92.6%
- Week 10 · 98.5%
- Week 11 · 98.6%
- Week 12 · 98.7%
Week readouthover or select
Week 8of 12
- 03Modelopus 4.6 · 0612
92.8%Grounded-answer rate
- 7 layers stamped on every run · 12-week window
- Catches BNK-26 · silent model drift
Something missing?
Don’t see your agent’s issue here?
Every AI environment is different. Share what you’re seeing, and we’ll review the behaviour, assess the risk and recommend the evaluations or controls that may help.
No commitment. Even if you never become a client, we’ll tell you what we think is happening.
Process
Universal incident runbook
Severity is assigned based on business impact, customer harm, data exposure, operational disruption and overall scope.
- SEV-1 Critical
- SEV-2 Major
- SEV-3 Moderate
- SEV-4 Minor
Automated monitoring or human review identifies unusual behaviour. Alerts are recorded and routed according to severity.
Outcomes
Not just that it ran.
What it delivered.
Observability shows the agent ran. It can’t show the payment cleared or what the work cost. Where outcome data exists, we trace each result to its session — and a named reviewer signs off the month.
- Issued
- Monthly, per engagement
- Traced
- Every figure to its session
- Signed
- By your engagement reviewer
- Used for
- Client reporting, partner review, the AgentOps scorecard
Nestack AgentOps
Banking fleet · monthly statement
- Servicing request resolved9,120
- Dispute adjudicated640
- Screening alert cleared2,480
- Hardship case actioned210
- Daily reconciliations completed22 of 22
- Workflows delivered12,450
- Outcome success rate98.8%
- Human correction required149 · 1.2%
Every figure linked to its source trace · exportable for review and audit support
Cost control
Keep banking AI agent costs under control
Token spend is monitored, optimised and reported as part of Agent Care — and savings never come at the expense of quality, because every change is verified against your evaluation baseline.
We review token spend by agent, workflow, model, and session so you can understand where AI costs are coming from.
Running banking AI agents in production?
Get a free assessment of one agent. We’ll review its behaviour, run a baseline evaluation and highlight potential risks and performance gaps.
Loading open times…
Open times
Select an available date above to view open 45-minute times from our calendar.
