Transportation & LogisticsManaged AI Agents
Transportation & Logistics AI Agents,
Monitored for Compliance
Nestack Agent Care helps transportation and logistics companies monitor, evaluate, and optimize AI agents used for route optimization, fleet tracking, scheduling, and delivery automation — before small AI errors become safety or compliance failures.
Scope
Transportation & Logistics AI agents we build & manage
Twenty-four archetypes across brokerage, fleet, forwarding, parcel and yard operations — if it moves freight or files its paperwork, we run it under care.
Customers & carriers5
Dispatch & tracking5
Drivers & fleet5
Paperwork & compliance9
Observability
What we make observable
Every transportation and logistics agent session is traced across ten layers — what we capture and the evidence we keep.
- Evidence we keepGoalconstraintsapproval requirement
- Evidence we keepSourceversiontimestamprelevancecitation
- Evidence we keepPlanned sequenceactual sequenceworkflow status
- Evidence we keepTask statusresultretryfailure reason
- Evidence we keepTool nameversioninputoutputpermissionresult
- Evidence we keepModel/versioninput/outputtoken usagelatencycost
- Evidence we keepEvaluation typemetricthresholdresult
- Evidence we keepGuardrail targettriggeractionenforcement result
- Evidence we keepReviewerdecisioncorrectionreason
- Evidence we keepOutcome statusbusiness resultlinked trace
Catalog
Failure modes
Filter failure modes by where they occur in the agent lifecycle—from goals and retrieval to tools, evaluations, guardrails and outcomes.
TRN-01Schedules violating hours-of-service / fatigue rulesSEV-1
TRN-02Dangerous-goods misclassification or segregation errorsSEV-1
TRN-03Wrong customs codes or incomplete documentationSEV-2
TRN-04Quote errors — dimensional weight, surcharges, currencySEV-2
TRN-05Stale route restrictions — bridges, curfews, permitsSEV-2
TRN-06Unrealistic ETA promisesSEV-3
TRN-07Location-privacy leaks — driver or shipment tracking exposedSEV-1
TRN-08Injection via shipping documents and booking notesSEV-1
TRN-09Maintenance-deferral errors — safety-critical defects scheduled past compliance datesSEV-1
TRN-10Load-plan errors — axle weights, restraint, oversize limitsSEV-1
TRN-11Carrier-capability hallucination — invented lanes, transit times, equipmentSEV-2
TRN-12Claims mishandling — liability admissions and settlements beyond authoritySEV-2
TRN-13Cross-shipper data leakage — rates, volumes, lanes between competing shippersSEV-1
TRN-14Cold-chain guidance errors — setpoints, excursion response, rejection criteriaSEV-2
Fraud, identity & security
TRN-15Denied-party / sanctions screening bypass — agent books blocked parties, vessels or aircraftSEV-1
TRN-16Carrier-vetting bypass — AI-forged credentials onboard fictitious / chameleon carriersSEV-1
TRN-17Rate-confirmation / BEC thread hijack — spoofed remittance or reroute auto-ingestedSEV-1
TRN-18Deepfake-voice / synthetic-caller impersonation defeats agent identity checksSEV-1
TRN-19Compromised-account / phishing trust inheritance — agent transacts on a hijacked login or opens a malicious linkSEV-1
TRN-28Autonomous rate-negotiation agent manipulated into systematic overpay / off-policy termsSEV-2
Regulatory & financial compliance
TRN-20Algorithmic coercion / forced dispatch — pressure to accept a load that requires a safety violationSEV-1
TRN-21ELD log auto-“correction” crossing into record falsificationSEV-2
TRN-22Demurrage & detention invoicing non-compliance (OSRA / 46 CFR 541)SEV-2
TRN-23Auto-payment of invalid D&D / accessorial invoices — dispute window forfeitedSEV-2
TRN-24Duplicate / wrong-party freight payment in audit-and-pay automationSEV-2
Customer-facing agents & commitments
TRN-25Hallucinated policy becomes a binding commitment (refunds, credits, guarantees)SEV-2
TRN-26Customer-facing chatbot jailbreak — profane / brand-damaging output goes viralSEV-2
TRN-27Escalation dead-end — bot can neither resolve nor hand off to a humanSEV-3
Operations, workforce & safety
TRN-29Brittle optimizer collapse under cascading disruption — no graceful fallbackSEV-1
TRN-30Algorithmic worker deactivation / termination with no meaningful appealSEV-2
TRN-31Safety-scoring / AI-dashcam false positives driving wrongful disciplineSEV-2
TRN-32Algorithmic pay / wage miscalculation — opaque tip-offset or base-rate manipulationSEV-2
TRN-33Robotics / automation orchestration failure causing worker injurySEV-1
TRN-34Coverage / service-area algorithm reproducing redlining (disparate impact)SEV-2
Data quality & technical reliability
TRN-35Multi-agent coordination collapse — negotiation loops, role duplication, deadlockSEV-2
TRN-36EDI / API data-quality cascade — 204/214/990 mismatches propagated silentlySEV-2
TRN-37LLM numeric / solver unreliability in routing & load-matching mathSEV-2
TRN-38Geocoding false-confidence — wrong coordinates trusted as ground truthSEV-3
TRN-39Adversarial attacks on CV / OCR — container-ID and plate misreads driving auto-actionsSEV-2
TRN-40GPS spoofing feeding falsified telemetry to auto-dispatch / auto-clearingSEV-1
TRN-41Automation bias — humans rubber-stamp agent output, removing the backstopSEV-2
A · Dispatch & routing agents
AB-03Stale hours record01 · RetrievalSEV-3
AB-01Plan that cannot be driven02 · ReasoningSEV-1
AB-06Relief used as planning slack02 · ReasoningSEV-1
AB-02Load sent without a dispatcher03 · Tool / writeSEV-1
AB-05Refusal re-planned around03 · Tool / writeSEV-2
AB-04ETA without its basis04 · OutputSEV-2
AB-07Silent constraint regression05 · Change / VersionSEV-2
B · Freight-quoting assistants
AH-03Stale rate source01 · RetrievalSEV-3
AH-04Plausible-but-wrong rate02 · ReasoningSEV-1
AH-06Carrier-like wording02 · ReasoningSEV-1
AH-02Quote sent without a person03 · Tool / writeSEV-1
AH-05Expired quote re-sent03 · Tool / writeSEV-2
AH-01Rate without its sources04 · OutputSEV-2
AH-07Silent bound regression05 · Change / VersionSEV-2
C · Driver-support copilots
AI-03Superseded policy read01 · RetrievalSEV-3
AI-04Clock read as permission02 · ReasoningSEV-1
AI-06Consequence in the reply02 · ReasoningSEV-1
AI-02Reply sent without a person03 · Tool / writeSEV-1
AI-05Refused request, put again03 · Tool / writeSEV-2
AI-01Answer without its policy04 · OutputSEV-2
AI-07Silent gate regression05 · Change / VersionSEV-2
D · Customs-documentation agents
AJ-03Superseded document read01 · RetrievalSEV-3
AJ-04Candidate past the cap02 · ReasoningSEV-1
AJ-06Assertion carried as fact02 · ReasoningSEV-1
AJ-02Package released early03 · Tool / writeSEV-1
AJ-05Duplicate entry data set03 · Tool / writeSEV-2
AJ-01Missing statutory element04 · OutputSEV-2
AJ-07Silent scope regression05 · Change / VersionSEV-2
E · Fleet-maintenance planners
AM-03Stale service record01 · RetrievalSEV-3
AM-04Alert without precision02 · ReasoningSEV-1
AM-06Interval quietly deferred02 · ReasoningSEV-1
AM-02Job released without a person03 · Tool / writeSEV-1
AM-05Repeat alert on one unit03 · Tool / writeSEV-2
AM-01Open defect not held04 · OutputSEV-2
AM-07Silent threshold regression05 · Change / VersionSEV-2
F · Carrier voice agents — check calls & tracking
AN-03Stale consent record01 · RetrievalSEV-3
AN-04Disclosure out of order02 · ReasoningSEV-1
AN-06Mobile read as a desk line02 · ReasoningSEV-1
AN-02Call placed without a person03 · Tool / writeSEV-1
AN-05Moving driver asked anyway03 · Tool / writeSEV-2
AN-01Recording before disclosure04 · OutputSEV-2
AN-07Silent disclosure regression05 · Change / VersionSEV-2
G · Autonomous rate-negotiation agents
AO-03Stale rate basis01 · RetrievalSEV-3
AO-04Ceiling read as a target02 · ReasoningSEV-1
AO-06Asymmetric movement02 · ReasoningSEV-1
AO-02Offer sent without a person03 · Tool / writeSEV-1
AO-05Duplicate counter03 · Tool / writeSEV-2
AO-01Cross-tenant rate leak04 · OutputSEV-2
AO-07Silent limit regression05 · Change / VersionSEV-2
H · Load-matching & tender agents
AQ-03Onboarding check reused01 · RetrievalSEV-3
AQ-04Standard applied loosely02 · ReasoningSEV-1
AQ-06Ranking read as decision02 · ReasoningSEV-1
AQ-02Tender sent without a person03 · Tool / writeSEV-1
AQ-05Duplicate tender03 · Tool / writeSEV-2
AQ-01Carrier-supplied certificate04 · OutputSEV-2
AQ-07Silent standard regression05 · Change / VersionSEV-2
I · Appointment & dock-scheduling agents
AW-03Stale capacity read01 · RetrievalSEV-3
AW-04Constraint read as soft02 · ReasoningSEV-1
AW-06Unavailability not logged02 · ReasoningSEV-1
AW-02Booking held without a person03 · Tool / writeSEV-1
AW-05Duplicate booking03 · Tool / writeSEV-2
AW-01Wrong contract terms read04 · OutputSEV-2
AW-07Silent capacity regression05 · Change / VersionSEV-2
J · Carrier-onboarding & fraud-vetting agents
AX-03Stale registry read01 · RetrievalSEV-3
AX-04Signal read as verification02 · ReasoningSEV-1
AX-06Reconstruction read as a rating02 · ReasoningSEV-1
AX-02Callback to a supplied number03 · Tool / writeSEV-1
AX-05Onboarding check not repeated03 · Tool / writeSEV-2
AX-01Captured identity passes clean04 · OutputSEV-2
AX-07Silent standard regression05 · Change / VersionSEV-2
K · Track-and-trace & exception agents
AY-03Stale ping read as current01 · RetrievalSEV-3
AY-04Inference read as fact02 · ReasoningSEV-1
AY-06Silence filled in02 · ReasoningSEV-1
AY-02Status out without a person03 · Tool / writeSEV-1
AY-05Duplicate exception03 · Tool / writeSEV-2
AY-01Personal conveyance misread04 · OutputSEV-2
AY-07Silent threshold regression05 · Change / VersionSEV-2
L · Customer-facing delivery / WISMO chatbots
BA-03Stale shipment record01 · RetrievalSEV-3
BA-04Estimate stated as a date02 · ReasoningSEV-1
BA-06Policy written, not quoted02 · ReasoningSEV-1
BA-02Remedy granted in chat03 · Tool / writeSEV-1
BA-05Duplicate case raised03 · Tool / writeSEV-2
BA-01Disclosure arrives late04 · OutputSEV-2
BA-07Silent policy regression05 · Change / VersionSEV-2
M · Freight audit, pay & D&D dispute agents
BB-03Superseded rate document01 · RetrievalSEV-3
BB-04Authority misread02 · ReasoningSEV-1
BB-06Finding read as entitlement02 · ReasoningSEV-1
BB-02Contest window missed03 · Tool / writeSEV-1
BB-05Duplicate finding03 · Tool / writeSEV-2
BB-01Evidence not attached04 · OutputSEV-2
BB-07Silent rule regression05 · Change / VersionSEV-2
N · Sanctions & denied-party screening agents
BC-03Clean screen, later listing01 · RetrievalSEV-3
BC-04Ownership blindness02 · ReasoningSEV-1
BC-06Regime not configured02 · ReasoningSEV-1
BC-02Threshold tuned for quiet03 · Tool / writeSEV-1
BC-05Re-screening not repeated03 · Tool / writeSEV-2
BC-01Hit cleared without evidence04 · OutputSEV-2
BC-07Silent threshold regression05 · Change / VersionSEV-2
O · Freight-document processing agents (rate cons, BOLs, invoices)
BD-03Wrong copy read01 · RetrievalSEV-3
BD-04Document type misread02 · ReasoningSEV-1
BD-06Ambiguity settled silently02 · ReasoningSEV-1
BD-02Absence supplied03 · Tool / writeSEV-1
BD-05Derived copy unmarked03 · Tool / writeSEV-2
BD-01Page reference lost04 · OutputSEV-2
BD-07Silent extraction regression05 · Change / VersionSEV-2
P · Yard & gate computer-vision agents
BE-03Fouled or occluded surface01 · RetrievalSEV-3
BE-04Letter collision passed02 · ReasoningSEV-1
BE-06Read taken as identity02 · ReasoningSEV-1
BE-02Plate read over-trusted03 · Tool / writeSEV-1
BE-05Damage missed on capture03 · Tool / writeSEV-2
BE-01Frame reference lost04 · OutputSEV-2
BE-07Silent lane regression05 · Change / VersionSEV-2
Q · Safety-coaching & driver-workforce agents
BF-03Record not retrieved01 · RetrievalSEV-3
BF-04Exposure dropped02 · ReasoningSEV-1
BF-06Protected activity flagged02 · ReasoningSEV-1
BF-02Score reaches employment03 · Tool / writeSEV-1
BF-05Duplicate event raised03 · Tool / writeSEV-2
BF-01Event without its record04 · OutputSEV-2
BF-07Silent threshold regression05 · Change / VersionSEV-2
R · Driver-qualification & Clearinghouse agents
JE-03Stale licensing record read01 · RetrievalSEV-3
JE-04File asserted, not shown02 · ReasoningSEV-1
JE-06Proposed rule read as live02 · ReasoningSEV-1
JE-02Thin file passed forward03 · Tool / writeSEV-1
JE-05Document bound to wrong driver03 · Tool / writeSEV-2
JE-01Reviewed, name unrecorded04 · OutputSEV-2
JE-07Silent clock regression05 · Change / VersionSEV-2
S · Hours-of-service records agents
JG-03Stale log read01 · RetrievalSEV-3
JG-04Day asserted, not corroborated02 · ReasoningSEV-1
JG-06Proposed rule read as live02 · ReasoningSEV-1
JG-02Thin day passed forward03 · Tool / writeSEV-1
JG-05Document bound to wrong day03 · Tool / writeSEV-2
JG-01Retained, corroboration unrecorded04 · OutputSEV-2
JG-07Silent retention drift05 · Change / VersionSEV-2
T · Broker financial-responsibility agents
JF-03Stale filing read01 · RetrievalSEV-3
JF-04Record asserted, not shown02 · ReasoningSEV-1
JF-06Superseded date read as live02 · ReasoningSEV-1
JF-02Thin record passed forward03 · Tool / writeSEV-1
JF-05Claim bound to wrong instrument03 · Tool / writeSEV-2
JF-01Answered, evidence unrecorded04 · OutputSEV-2
JF-07Silent window regression05 · Change / VersionSEV-2
U · Carrier-registration & fuel-tax agents
JI-03Stale distance read01 · RetrievalSEV-3
JI-04Distance asserted, not traced02 · ReasoningSEV-1
JI-06Proposed fee read as law02 · ReasoningSEV-1
JI-02Thin draft passed forward03 · Tool / writeSEV-1
JI-05Distance bound to wrong unit03 · Tool / writeSEV-2
JI-01Signed, provenance unrecorded04 · OutputSEV-2
JI-07Silent retention regression05 · Change / VersionSEV-2
V · Hazmat programme & records agents
JJ-03Stale plan revision read01 · RetrievalSEV-3
JJ-04Record asserted, not shown02 · ReasoningSEV-1
JJ-06Proposed rule read as live02 · ReasoningSEV-1
JJ-02Thin record passed forward03 · Tool / writeSEV-1
JJ-05Element bound to wrong employee03 · Tool / writeSEV-2
JJ-01Certified, elements unrecorded04 · OutputSEV-2
JJ-07Silent cycle regression05 · Change / VersionSEV-2
W · Vessel-emissions compliance agents
JH-03Stale consumption read01 · RetrievalSEV-3
JH-04Report asserted, not shown02 · ReasoningSEV-1
JH-06Unadopted framework read as live02 · ReasoningSEV-1
JH-02Thin report passed forward03 · Tool / writeSEV-1
JH-05Consumption bound to wrong leg03 · Tool / writeSEV-2
JH-01Submitted, provenance unrecorded04 · OutputSEV-2
JH-07Silent scope regression05 · Change / VersionSEV-2
X · EU driver-posting & tachograph agents
JL-03Stale journey read01 · RetrievalSEV-3
JL-04Status asserted, not shown02 · ReasoningSEV-1
JL-06Extension read as retrofit02 · ReasoningSEV-1
JL-02Thin journey passed forward03 · Tool / writeSEV-1
JL-05Leg bound to wrong vehicle03 · Tool / writeSEV-2
JL-01Lodged, leg unrecorded04 · OutputSEV-2
JL-07Silent status regression05 · Change / VersionSEV-2
Guardrails
Critical guardrails for Transportation & logistics agents
Ten controls that hold regardless of prompt, plan or pressure. Open one to see what it protects, what trips it, what the agent is forced to do, who may release it, and what is written to the record.
GR-01No dispatch that breaches hours-of-service limitsOverride defined
Target
Load assignment, routing and schedule generation for drivers under FMCSA or HVNL rules
Trigger
A proposed assignment requires driving beyond remaining legal hours or mandated rest
Action — enforced
Platform blocks the assignment and recalculates with compliant capacity; agent may offer relay, repower or later windows
Human override
Compliance manager approves an exemption-based plan citing the applicable regulatory provision
Logged evidenceload id · driver id · remaining hours snapshot · rule set version · alternative plan id · UTC timestamp
GR-02No dangerous-goods load without validated classification and segregationOverride defined
Target
Bookings and load plans containing declared or detected dangerous-goods line items
Trigger
UN number, class, packing group or segregation check is missing or fails validation
Action — enforced
Platform blocks tender and stowage until a qualified DG check passes; agent may request corrected shipper declarations
Human override
Certified DG specialist approves the load in the DG desk queue
Logged evidencebooking id · UN number and class · segregation result · validator identity · declaration document hash · UTC timestamp
GR-03No load plan exceeding axle or restraint limitsOverride defined
Target
Load plans, axle-weight distributions and restraint schemes generated for road and rail moves
Trigger
Computed axle weight, gross mass or restraint capacity breaches the equipment’s certified limits
Action — enforced
Platform rejects the plan and re-optimises within certified limits; agent may propose a split across additional equipment
Human override
Load-planning supervisor approves a permit-backed oversize plan with engineering sign-off
Logged evidenceplan id · equipment id · computed vs certified values · solver version · permit reference · UTC timestamp
GR-04No safety-critical defect deferred past compliance dateOverride defined
Target
Maintenance scheduling for brakes, steering, tyres and other safety-critical defect categories
Trigger
A reschedule pushes a safety-critical work order beyond its regulatory due date
Action — enforced
Platform pins the work order and grounds the asset at the deadline; agent may rebook other jobs around it
Human override
Fleet engineering manager extends only with a documented regulator-recognised deferral
Logged evidencework order id · asset id · defect code · due date vs requested date · deferral authority · UTC timestamp
GR-05No cross-shipper retrieval of rates, lanes or volumesNo override
Target
Rates, contract terms, lane histories and volume data across competing shipper tenants
Trigger
A retrieval or context assembly references a shipper outside the authenticated tenant scope
Action — enforced
Platform denies the query and drops the foreign record; agent may answer only from the requesting tenant’s data
Human override
None — cannot be overridden in session
Logged evidencesession id · tenant id · blocked identifier · query hash · isolation policy version · UTC timestamp
GR-06No instruction embedded in waybills or booking notes executedNo override
Target
Waybills, BOLs, booking notes, rate confirmations and emailed shipping documents entering context
Trigger
Ingested document text contains imperative phrasing, tool syntax or reroute and payment redirections
Action — enforced
Platform quarantines the document and treats it as inert data; agent may extract fields but never follow instructions
Human override
None — cannot be overridden in session
Logged evidencedocument id · source channel · matched pattern class · content hash · session id · UTC timestamp
GR-07No booking released without a denied-party screening passOverride defined
Target
Bookings, manifests and charter arrangements naming shippers, consignees, vessels or aircraft
Trigger
Any named party, vessel or aircraft lacks a current clear screening result
Action — enforced
Platform blocks release and refers the match to trade compliance; agent may gather clarifying party details meanwhile
Human override
Trade-compliance officer clears a false positive in the screening console with rationale
Logged evidencebooking id · screened party list · list versions · match details · clearing officer · UTC timestamp
GR-08No remittance or reroute change without out-of-band confirmationOverride defined
Target
Bank-detail updates, remittance addresses and delivery reroutes requested through email or chat threads
Trigger
A thread or call requests changed payment details or destination for an active shipment
Action — enforced
Platform freezes the change until a registered contact confirms independently; agent may prepare the amendment for release
Human override
Finance controller releases after documented callback to the contact of record
Logged evidencerequest id · thread hash · old and new details · callback record id · releasing identity · UTC timestamp
GR-09No carrier onboarded without verified operating authorityOverride defined
Target
Carrier onboarding, load tendering and re-brokering across the partner carrier network
Trigger
Submitted authority, insurance or identity evidence fails registry checks or shows synthetic-document markers
Action — enforced
Platform blocks onboarding and tendering to the entity; agent may request originals and schedule manual vetting
Human override
Carrier-compliance manager approves after direct registry and insurer confirmation
Logged evidencecarrier id · DOT/MC number · registry response hash · document forensics result · approver · UTC timestamp
GR-10No customs filing with unvalidated tariff codesOverride defined
Target
Customs entries, HS classifications and export documentation prepared for cross-border shipments
Trigger
HS code, valuation or document set fails validation against the current tariff schedule
Action — enforced
Platform holds the filing for broker review before lodgement; agent may assemble drafts and flag discrepancies
Human override
Licensed customs broker lodges after documented classification review
Logged evidenceentry id · HS code and tariff schedule version · validation failures · broker identity · document set hash · UTC timestamp
Oversight
Human review — triggers, decisions and evidence
When a defined risk trigger fires, the affected action is routed to a named reviewer. Every decision is recorded with its correction, escalation and final outcome for full traceability.
- ConfidenceLow-confidence document read
- Financial impactHigh-value invoice or claim
- Identity / change riskCarrier or remittance change
- Irreversible actionDispatch or release action
- Policy riskFatigue or dangerous-goods flag
- Safety controlGuardrail override
- Quality failureFailed critical evaluation
- Revieweridentity + role
- Decisionapprove / reject / amend
- Correctionwhat changed
- Escalationwho, why and severity
- Final outcomereleased / blocked / returned for rework
7 triggers · any one halts the agent
1 record · 5 fields, every time
Compliance
Regulatory mapping
- 01 Goal
- 02 Retrieval
- 03 Workflow
- 04 Task
- 05 Tool
- 06 LLM
- 07 Evaluation
- 08 Guardrail
- 09 Human review
- 10 Outcome
Hours of service & ELD records
Driving is capped at 11 hours in a 14-hour window, false duty-status reports are barred, and a carrier ELD edit takes effect only when the driver confirms it. A plan past that is a paper violation.
49 CFR 395.3 · 49 CFR 395.8 · 49 CFR 395.30
Lifecycle layer:04 Task · 06 LLM · 08 Guardrail · 10 Outcome
- TRN-01
- TRN-21
- AB-01
- AB-03
- AB-06
- AI-04
- AY-02
- JG-03
- JG-04
Evaluations
Baseline evaluation suite — in detail
Baseline evaluations are completed during onboarding and repeated based on the selected plan. Agents that fail critical checks remain restricted until they pass re-testing.
- Detailed case sets
- 39
- Failure modes covered
- 41
- Retired & rotated / quarter
- 10%
- Audit-ready scorecard
- Monthly
Output evaluation3 suites · 280 cases
100 casesHOS-compliance schedulingcatches TRN-01
120 casesDG classification golden-setcatches TRN-02
100 casesTariff & documentationcatches TRN-03
100 casesQuote accuracycatches TRN-04
60 casesETA realismcatches TRN-06
40 casesLocation privacycatches TRN-07
60 patternsDocument injectioncatches TRN-08
60 casesDefect-scheduling setcatches TRN-09
60 casesLoad-plan compliancecatches TRN-10
50 casesCarrier-grounding setcatches TRN-11
40 casesClaims-authority setcatches TRN-12
40 casesShipper-isolation probescatches TRN-13
40 casesCold-chain setcatches TRN-14
40 casesRoute-restriction freshnesscatches TRN-05
Use your work email to unlock the full grid. We use it to send the requested Agent Care material and qualify business inquiries. We do not sell or share your email.
Domain-expert review
Client-designated subject-matter experts review evaluation criteria, pass thresholds and industry-specific risks before baseline approval.
Test-case rotation
Evaluation cases are refreshed regularly to reduce memorisation, limit overfitting and maintain meaningful performance measurement.
Scorecard integration
Scorecards compare results with the approved baseline, show performance trends and flag material declines for review and escalation.
Client-specific extensions
Where included in scope, evaluations may be expanded using approved incidents, workflows, policies, data patterns and industry-specific risks.
Monitoring
Change-aware monitoring
When agent performance changes, Nestack correlates the shift with changes to the agent, prompt, model, tools, knowledge base, guardrails and evaluation suite.
- Week 1 · 97.9%
- Week 2 · 97.8%
- Week 3 · 98.0%
- Week 4 · 97.9%
- Week 5 · 98.1%
- Week 6 · 97.9%
- Week 7 · 98.0%
- Week 8 · 94.3%
- Week 9 · 94.1%
- Week 10 · 97.9%
- Week 11 · 98.0%
- Week 12 · 98.1%
Week readouthover or select
Week 8of 12
- 05Knowledge-basekb 2026.07
94.3%Grounded-answer rate
- 7 layers stamped on every run · 12-week window
- Catches TRN-05 · stale route restrictions
Something missing?
Don’t see your agent’s issue here?
Every AI environment is different. Share what you’re seeing, and we’ll review the behaviour, assess the risk and recommend the evaluations or controls that may help.
No commitment. Even if you never become a client, we’ll tell you what we think is happening.
Process
Universal incident runbook
Severity is assigned based on business impact, customer harm, data exposure, operational disruption and overall scope.
- SEV-1 Critical
- SEV-2 Major
- SEV-3 Moderate
- SEV-4 Minor
Automated monitoring or human review identifies unusual behaviour. Alerts are recorded and routed according to severity.
Outcomes
Not just that it ran.
What it delivered.
Observability shows the agent ran. It can’t show the load was compliant or what the work cost. Where outcome data exists, we trace each result to its session — and a named reviewer signs off the month.
- Issued
- Monthly, per engagement
- Traced
- Every figure to its session
- Signed
- By your engagement reviewer
- Used for
- Client reporting, partner review, the AgentOps scorecard
Nestack AgentOps
Transport & logistics fleet · monthly statement
- Booking completed6,480
- Customs document lodged2,140
- Load plan verified3,920
- Claim assessed380
- Hours-of-service audits passed30 of 30
- Workflows delivered12,920
- Outcome success rate98.4%
- Human correction required207 · 1.6%
Every figure linked to its source trace · exportable for review and audit support
Cost control
Keep transportation & logistics AI agent costs under control
Token spend is monitored, optimised and reported as part of Agent Care — and savings never come at the expense of quality, because every change is verified against your evaluation baseline.
We review token spend by agent, workflow, model, and session so you can understand where AI costs are coming from.
Running transportation & logistics AI agents in production?
Get a free assessment of one agent. We’ll review its behaviour, run a baseline evaluation and highlight potential risks and performance gaps.
Loading open times…
Open times
Select an available date above to view open 45-minute times from our calendar.
