Transportation & LogisticsManaged AI Agents

Transportation & Logistics AI Agents,
Monitored for Compliance

Nestack Agent Care helps transportation and logistics companies monitor, evaluate, and optimize AI agents used for route optimization, fleet tracking, scheduling, and delivery automation — before small AI errors become safety or compliance failures.

209failure modes
88SEV-1 failure modes
910+baseline eval cases
24/7Agent Monitoring

Scope

Transportation & Logistics AI agents we build & manage

Twenty-four archetypes across brokerage, fleet, forwarding, parcel and yard operations — if it moves freight or files its paperwork, we run it under care.

Observability

What we make observable

Every transportation and logistics agent session is traced across ten layers — what we capture and the evidence we keep.

  1. Evidence we keep
    Goalconstraintsapproval requirement
  2. Evidence we keep
    Sourceversiontimestamprelevancecitation
  3. Evidence we keep
    Planned sequenceactual sequenceworkflow status
  4. Evidence we keep
    Task statusresultretryfailure reason
  5. Evidence we keep
    Tool nameversioninputoutputpermissionresult
  6. Evidence we keep
    Model/versioninput/outputtoken usagelatencycost
  7. Evidence we keep
    Evaluation typemetricthresholdresult
  8. Evidence we keep
    Guardrail targettriggeractionenforcement result
  9. Evidence we keep
    Reviewerdecisioncorrectionreason
  10. Evidence we keep
    Outcome statusbusiness resultlinked trace

Catalog

Failure modes

Filter failure modes by where they occur in the agent lifecycle—from goals and retrieval to tools, evaluations, guardrails and outcomes.

Nothing on this page matches that. Try a layer (tool, retrieval, guardrail), a code, or a severity.

0 documented↑↓ move · ↵ open · ⌘↵ filter matrix
209 documented · select a cell to filter
20
66
61
50
53
71
84
72
34
119
TRN-01Schedules violating hours-of-service / fatigue rulesSEV-1
TRN-02Dangerous-goods misclassification or segregation errorsSEV-1
TRN-03Wrong customs codes or incomplete documentationSEV-2
TRN-04Quote errors — dimensional weight, surcharges, currencySEV-2
TRN-05Stale route restrictions — bridges, curfews, permitsSEV-2
TRN-06Unrealistic ETA promisesSEV-3
TRN-07Location-privacy leaks — driver or shipment tracking exposedSEV-1
TRN-08Injection via shipping documents and booking notesSEV-1
TRN-09Maintenance-deferral errors — safety-critical defects scheduled past compliance datesSEV-1
TRN-10Load-plan errors — axle weights, restraint, oversize limitsSEV-1
TRN-11Carrier-capability hallucination — invented lanes, transit times, equipmentSEV-2
TRN-12Claims mishandling — liability admissions and settlements beyond authoritySEV-2
TRN-13Cross-shipper data leakage — rates, volumes, lanes between competing shippersSEV-1
TRN-14Cold-chain guidance errors — setpoints, excursion response, rejection criteriaSEV-2

Fraud, identity & security

TRN-15Denied-party / sanctions screening bypass — agent books blocked parties, vessels or aircraftSEV-1
TRN-16Carrier-vetting bypass — AI-forged credentials onboard fictitious / chameleon carriersSEV-1
TRN-17Rate-confirmation / BEC thread hijack — spoofed remittance or reroute auto-ingestedSEV-1
TRN-18Deepfake-voice / synthetic-caller impersonation defeats agent identity checksSEV-1
TRN-19Compromised-account / phishing trust inheritance — agent transacts on a hijacked login or opens a malicious linkSEV-1
TRN-28Autonomous rate-negotiation agent manipulated into systematic overpay / off-policy termsSEV-2

Regulatory & financial compliance

TRN-20Algorithmic coercion / forced dispatch — pressure to accept a load that requires a safety violationSEV-1
TRN-21ELD log auto-“correction” crossing into record falsificationSEV-2
TRN-22Demurrage & detention invoicing non-compliance (OSRA / 46 CFR 541)SEV-2
TRN-23Auto-payment of invalid D&D / accessorial invoices — dispute window forfeitedSEV-2
TRN-24Duplicate / wrong-party freight payment in audit-and-pay automationSEV-2

Customer-facing agents & commitments

TRN-25Hallucinated policy becomes a binding commitment (refunds, credits, guarantees)SEV-2
TRN-26Customer-facing chatbot jailbreak — profane / brand-damaging output goes viralSEV-2
TRN-27Escalation dead-end — bot can neither resolve nor hand off to a humanSEV-3

Operations, workforce & safety

TRN-29Brittle optimizer collapse under cascading disruption — no graceful fallbackSEV-1
TRN-30Algorithmic worker deactivation / termination with no meaningful appealSEV-2
TRN-31Safety-scoring / AI-dashcam false positives driving wrongful disciplineSEV-2
TRN-32Algorithmic pay / wage miscalculation — opaque tip-offset or base-rate manipulationSEV-2
TRN-33Robotics / automation orchestration failure causing worker injurySEV-1
TRN-34Coverage / service-area algorithm reproducing redlining (disparate impact)SEV-2

Data quality & technical reliability

TRN-35Multi-agent coordination collapse — negotiation loops, role duplication, deadlockSEV-2
TRN-36EDI / API data-quality cascade — 204/214/990 mismatches propagated silentlySEV-2
TRN-37LLM numeric / solver unreliability in routing & load-matching mathSEV-2
TRN-38Geocoding false-confidence — wrong coordinates trusted as ground truthSEV-3
TRN-39Adversarial attacks on CV / OCR — container-ID and plate misreads driving auto-actionsSEV-2
TRN-40GPS spoofing feeding falsified telemetry to auto-dispatch / auto-clearingSEV-1
TRN-41Automation bias — humans rubber-stamp agent output, removing the backstopSEV-2

A · Dispatch & routing agents

AB-03Stale hours record01 · RetrievalSEV-3
AB-01Plan that cannot be driven02 · ReasoningSEV-1
AB-06Relief used as planning slack02 · ReasoningSEV-1
AB-02Load sent without a dispatcher03 · Tool / writeSEV-1
AB-05Refusal re-planned around03 · Tool / writeSEV-2
AB-04ETA without its basis04 · OutputSEV-2
AB-07Silent constraint regression05 · Change / VersionSEV-2

B · Freight-quoting assistants

AH-03Stale rate source01 · RetrievalSEV-3
AH-04Plausible-but-wrong rate02 · ReasoningSEV-1
AH-06Carrier-like wording02 · ReasoningSEV-1
AH-02Quote sent without a person03 · Tool / writeSEV-1
AH-05Expired quote re-sent03 · Tool / writeSEV-2
AH-01Rate without its sources04 · OutputSEV-2
AH-07Silent bound regression05 · Change / VersionSEV-2

C · Driver-support copilots

AI-03Superseded policy read01 · RetrievalSEV-3
AI-04Clock read as permission02 · ReasoningSEV-1
AI-06Consequence in the reply02 · ReasoningSEV-1
AI-02Reply sent without a person03 · Tool / writeSEV-1
AI-05Refused request, put again03 · Tool / writeSEV-2
AI-01Answer without its policy04 · OutputSEV-2
AI-07Silent gate regression05 · Change / VersionSEV-2

D · Customs-documentation agents

AJ-03Superseded document read01 · RetrievalSEV-3
AJ-04Candidate past the cap02 · ReasoningSEV-1
AJ-06Assertion carried as fact02 · ReasoningSEV-1
AJ-02Package released early03 · Tool / writeSEV-1
AJ-05Duplicate entry data set03 · Tool / writeSEV-2
AJ-01Missing statutory element04 · OutputSEV-2
AJ-07Silent scope regression05 · Change / VersionSEV-2

E · Fleet-maintenance planners

AM-03Stale service record01 · RetrievalSEV-3
AM-04Alert without precision02 · ReasoningSEV-1
AM-06Interval quietly deferred02 · ReasoningSEV-1
AM-02Job released without a person03 · Tool / writeSEV-1
AM-05Repeat alert on one unit03 · Tool / writeSEV-2
AM-01Open defect not held04 · OutputSEV-2
AM-07Silent threshold regression05 · Change / VersionSEV-2

F · Carrier voice agents — check calls & tracking

AN-03Stale consent record01 · RetrievalSEV-3
AN-04Disclosure out of order02 · ReasoningSEV-1
AN-06Mobile read as a desk line02 · ReasoningSEV-1
AN-02Call placed without a person03 · Tool / writeSEV-1
AN-05Moving driver asked anyway03 · Tool / writeSEV-2
AN-01Recording before disclosure04 · OutputSEV-2
AN-07Silent disclosure regression05 · Change / VersionSEV-2

G · Autonomous rate-negotiation agents

AO-03Stale rate basis01 · RetrievalSEV-3
AO-04Ceiling read as a target02 · ReasoningSEV-1
AO-06Asymmetric movement02 · ReasoningSEV-1
AO-02Offer sent without a person03 · Tool / writeSEV-1
AO-05Duplicate counter03 · Tool / writeSEV-2
AO-01Cross-tenant rate leak04 · OutputSEV-2
AO-07Silent limit regression05 · Change / VersionSEV-2

H · Load-matching & tender agents

AQ-03Onboarding check reused01 · RetrievalSEV-3
AQ-04Standard applied loosely02 · ReasoningSEV-1
AQ-06Ranking read as decision02 · ReasoningSEV-1
AQ-02Tender sent without a person03 · Tool / writeSEV-1
AQ-05Duplicate tender03 · Tool / writeSEV-2
AQ-01Carrier-supplied certificate04 · OutputSEV-2
AQ-07Silent standard regression05 · Change / VersionSEV-2

I · Appointment & dock-scheduling agents

AW-03Stale capacity read01 · RetrievalSEV-3
AW-04Constraint read as soft02 · ReasoningSEV-1
AW-06Unavailability not logged02 · ReasoningSEV-1
AW-02Booking held without a person03 · Tool / writeSEV-1
AW-05Duplicate booking03 · Tool / writeSEV-2
AW-01Wrong contract terms read04 · OutputSEV-2
AW-07Silent capacity regression05 · Change / VersionSEV-2

J · Carrier-onboarding & fraud-vetting agents

AX-03Stale registry read01 · RetrievalSEV-3
AX-04Signal read as verification02 · ReasoningSEV-1
AX-06Reconstruction read as a rating02 · ReasoningSEV-1
AX-02Callback to a supplied number03 · Tool / writeSEV-1
AX-05Onboarding check not repeated03 · Tool / writeSEV-2
AX-01Captured identity passes clean04 · OutputSEV-2
AX-07Silent standard regression05 · Change / VersionSEV-2

K · Track-and-trace & exception agents

AY-03Stale ping read as current01 · RetrievalSEV-3
AY-04Inference read as fact02 · ReasoningSEV-1
AY-06Silence filled in02 · ReasoningSEV-1
AY-02Status out without a person03 · Tool / writeSEV-1
AY-05Duplicate exception03 · Tool / writeSEV-2
AY-01Personal conveyance misread04 · OutputSEV-2
AY-07Silent threshold regression05 · Change / VersionSEV-2

L · Customer-facing delivery / WISMO chatbots

BA-03Stale shipment record01 · RetrievalSEV-3
BA-04Estimate stated as a date02 · ReasoningSEV-1
BA-06Policy written, not quoted02 · ReasoningSEV-1
BA-02Remedy granted in chat03 · Tool / writeSEV-1
BA-05Duplicate case raised03 · Tool / writeSEV-2
BA-01Disclosure arrives late04 · OutputSEV-2
BA-07Silent policy regression05 · Change / VersionSEV-2

M · Freight audit, pay & D&D dispute agents

BB-03Superseded rate document01 · RetrievalSEV-3
BB-04Authority misread02 · ReasoningSEV-1
BB-06Finding read as entitlement02 · ReasoningSEV-1
BB-02Contest window missed03 · Tool / writeSEV-1
BB-05Duplicate finding03 · Tool / writeSEV-2
BB-01Evidence not attached04 · OutputSEV-2
BB-07Silent rule regression05 · Change / VersionSEV-2

N · Sanctions & denied-party screening agents

BC-03Clean screen, later listing01 · RetrievalSEV-3
BC-04Ownership blindness02 · ReasoningSEV-1
BC-06Regime not configured02 · ReasoningSEV-1
BC-02Threshold tuned for quiet03 · Tool / writeSEV-1
BC-05Re-screening not repeated03 · Tool / writeSEV-2
BC-01Hit cleared without evidence04 · OutputSEV-2
BC-07Silent threshold regression05 · Change / VersionSEV-2

O · Freight-document processing agents (rate cons, BOLs, invoices)

BD-03Wrong copy read01 · RetrievalSEV-3
BD-04Document type misread02 · ReasoningSEV-1
BD-06Ambiguity settled silently02 · ReasoningSEV-1
BD-02Absence supplied03 · Tool / writeSEV-1
BD-05Derived copy unmarked03 · Tool / writeSEV-2
BD-01Page reference lost04 · OutputSEV-2
BD-07Silent extraction regression05 · Change / VersionSEV-2

P · Yard & gate computer-vision agents

BE-03Fouled or occluded surface01 · RetrievalSEV-3
BE-04Letter collision passed02 · ReasoningSEV-1
BE-06Read taken as identity02 · ReasoningSEV-1
BE-02Plate read over-trusted03 · Tool / writeSEV-1
BE-05Damage missed on capture03 · Tool / writeSEV-2
BE-01Frame reference lost04 · OutputSEV-2
BE-07Silent lane regression05 · Change / VersionSEV-2

Q · Safety-coaching & driver-workforce agents

BF-03Record not retrieved01 · RetrievalSEV-3
BF-04Exposure dropped02 · ReasoningSEV-1
BF-06Protected activity flagged02 · ReasoningSEV-1
BF-02Score reaches employment03 · Tool / writeSEV-1
BF-05Duplicate event raised03 · Tool / writeSEV-2
BF-01Event without its record04 · OutputSEV-2
BF-07Silent threshold regression05 · Change / VersionSEV-2

R · Driver-qualification & Clearinghouse agents

JE-03Stale licensing record read01 · RetrievalSEV-3
JE-04File asserted, not shown02 · ReasoningSEV-1
JE-06Proposed rule read as live02 · ReasoningSEV-1
JE-02Thin file passed forward03 · Tool / writeSEV-1
JE-05Document bound to wrong driver03 · Tool / writeSEV-2
JE-01Reviewed, name unrecorded04 · OutputSEV-2
JE-07Silent clock regression05 · Change / VersionSEV-2

S · Hours-of-service records agents

JG-03Stale log read01 · RetrievalSEV-3
JG-04Day asserted, not corroborated02 · ReasoningSEV-1
JG-06Proposed rule read as live02 · ReasoningSEV-1
JG-02Thin day passed forward03 · Tool / writeSEV-1
JG-05Document bound to wrong day03 · Tool / writeSEV-2
JG-01Retained, corroboration unrecorded04 · OutputSEV-2
JG-07Silent retention drift05 · Change / VersionSEV-2

T · Broker financial-responsibility agents

JF-03Stale filing read01 · RetrievalSEV-3
JF-04Record asserted, not shown02 · ReasoningSEV-1
JF-06Superseded date read as live02 · ReasoningSEV-1
JF-02Thin record passed forward03 · Tool / writeSEV-1
JF-05Claim bound to wrong instrument03 · Tool / writeSEV-2
JF-01Answered, evidence unrecorded04 · OutputSEV-2
JF-07Silent window regression05 · Change / VersionSEV-2

U · Carrier-registration & fuel-tax agents

JI-03Stale distance read01 · RetrievalSEV-3
JI-04Distance asserted, not traced02 · ReasoningSEV-1
JI-06Proposed fee read as law02 · ReasoningSEV-1
JI-02Thin draft passed forward03 · Tool / writeSEV-1
JI-05Distance bound to wrong unit03 · Tool / writeSEV-2
JI-01Signed, provenance unrecorded04 · OutputSEV-2
JI-07Silent retention regression05 · Change / VersionSEV-2

V · Hazmat programme & records agents

JJ-03Stale plan revision read01 · RetrievalSEV-3
JJ-04Record asserted, not shown02 · ReasoningSEV-1
JJ-06Proposed rule read as live02 · ReasoningSEV-1
JJ-02Thin record passed forward03 · Tool / writeSEV-1
JJ-05Element bound to wrong employee03 · Tool / writeSEV-2
JJ-01Certified, elements unrecorded04 · OutputSEV-2
JJ-07Silent cycle regression05 · Change / VersionSEV-2

W · Vessel-emissions compliance agents

JH-03Stale consumption read01 · RetrievalSEV-3
JH-04Report asserted, not shown02 · ReasoningSEV-1
JH-06Unadopted framework read as live02 · ReasoningSEV-1
JH-02Thin report passed forward03 · Tool / writeSEV-1
JH-05Consumption bound to wrong leg03 · Tool / writeSEV-2
JH-01Submitted, provenance unrecorded04 · OutputSEV-2
JH-07Silent scope regression05 · Change / VersionSEV-2

X · EU driver-posting & tachograph agents

JL-03Stale journey read01 · RetrievalSEV-3
JL-04Status asserted, not shown02 · ReasoningSEV-1
JL-06Extension read as retrofit02 · ReasoningSEV-1
JL-02Thin journey passed forward03 · Tool / writeSEV-1
JL-05Leg bound to wrong vehicle03 · Tool / writeSEV-2
JL-01Lodged, leg unrecorded04 · OutputSEV-2
JL-07Silent status regression05 · Change / VersionSEV-2

Guardrails

Critical guardrails for Transportation & logistics agents

Ten controls that hold regardless of prompt, plan or pressure. Open one to see what it protects, what trips it, what the agent is forced to do, who may release it, and what is written to the record.

GR-01No dispatch that breaches hours-of-service limitsOverride defined
  1. Target

    Load assignment, routing and schedule generation for drivers under FMCSA or HVNL rules

  2. Trigger

    A proposed assignment requires driving beyond remaining legal hours or mandated rest

  3. Action — enforced

    Platform blocks the assignment and recalculates with compliant capacity; agent may offer relay, repower or later windows

  4. Human override

    Compliance manager approves an exemption-based plan citing the applicable regulatory provision

Logged evidenceload id · driver id · remaining hours snapshot · rule set version · alternative plan id · UTC timestamp

GR-02No dangerous-goods load without validated classification and segregationOverride defined
  1. Target

    Bookings and load plans containing declared or detected dangerous-goods line items

  2. Trigger

    UN number, class, packing group or segregation check is missing or fails validation

  3. Action — enforced

    Platform blocks tender and stowage until a qualified DG check passes; agent may request corrected shipper declarations

  4. Human override

    Certified DG specialist approves the load in the DG desk queue

Logged evidencebooking id · UN number and class · segregation result · validator identity · declaration document hash · UTC timestamp

GR-03No load plan exceeding axle or restraint limitsOverride defined
  1. Target

    Load plans, axle-weight distributions and restraint schemes generated for road and rail moves

  2. Trigger

    Computed axle weight, gross mass or restraint capacity breaches the equipment’s certified limits

  3. Action — enforced

    Platform rejects the plan and re-optimises within certified limits; agent may propose a split across additional equipment

  4. Human override

    Load-planning supervisor approves a permit-backed oversize plan with engineering sign-off

Logged evidenceplan id · equipment id · computed vs certified values · solver version · permit reference · UTC timestamp

GR-04No safety-critical defect deferred past compliance dateOverride defined
  1. Target

    Maintenance scheduling for brakes, steering, tyres and other safety-critical defect categories

  2. Trigger

    A reschedule pushes a safety-critical work order beyond its regulatory due date

  3. Action — enforced

    Platform pins the work order and grounds the asset at the deadline; agent may rebook other jobs around it

  4. Human override

    Fleet engineering manager extends only with a documented regulator-recognised deferral

Logged evidencework order id · asset id · defect code · due date vs requested date · deferral authority · UTC timestamp

GR-05No cross-shipper retrieval of rates, lanes or volumesNo override
  1. Target

    Rates, contract terms, lane histories and volume data across competing shipper tenants

  2. Trigger

    A retrieval or context assembly references a shipper outside the authenticated tenant scope

  3. Action — enforced

    Platform denies the query and drops the foreign record; agent may answer only from the requesting tenant’s data

  4. Human override

    None — cannot be overridden in session

Logged evidencesession id · tenant id · blocked identifier · query hash · isolation policy version · UTC timestamp

GR-06No instruction embedded in waybills or booking notes executedNo override
  1. Target

    Waybills, BOLs, booking notes, rate confirmations and emailed shipping documents entering context

  2. Trigger

    Ingested document text contains imperative phrasing, tool syntax or reroute and payment redirections

  3. Action — enforced

    Platform quarantines the document and treats it as inert data; agent may extract fields but never follow instructions

  4. Human override

    None — cannot be overridden in session

Logged evidencedocument id · source channel · matched pattern class · content hash · session id · UTC timestamp

GR-07No booking released without a denied-party screening passOverride defined
  1. Target

    Bookings, manifests and charter arrangements naming shippers, consignees, vessels or aircraft

  2. Trigger

    Any named party, vessel or aircraft lacks a current clear screening result

  3. Action — enforced

    Platform blocks release and refers the match to trade compliance; agent may gather clarifying party details meanwhile

  4. Human override

    Trade-compliance officer clears a false positive in the screening console with rationale

Logged evidencebooking id · screened party list · list versions · match details · clearing officer · UTC timestamp

GR-08No remittance or reroute change without out-of-band confirmationOverride defined
  1. Target

    Bank-detail updates, remittance addresses and delivery reroutes requested through email or chat threads

  2. Trigger

    A thread or call requests changed payment details or destination for an active shipment

  3. Action — enforced

    Platform freezes the change until a registered contact confirms independently; agent may prepare the amendment for release

  4. Human override

    Finance controller releases after documented callback to the contact of record

Logged evidencerequest id · thread hash · old and new details · callback record id · releasing identity · UTC timestamp

GR-09No carrier onboarded without verified operating authorityOverride defined
  1. Target

    Carrier onboarding, load tendering and re-brokering across the partner carrier network

  2. Trigger

    Submitted authority, insurance or identity evidence fails registry checks or shows synthetic-document markers

  3. Action — enforced

    Platform blocks onboarding and tendering to the entity; agent may request originals and schedule manual vetting

  4. Human override

    Carrier-compliance manager approves after direct registry and insurer confirmation

Logged evidencecarrier id · DOT/MC number · registry response hash · document forensics result · approver · UTC timestamp

GR-10No customs filing with unvalidated tariff codesOverride defined
  1. Target

    Customs entries, HS classifications and export documentation prepared for cross-border shipments

  2. Trigger

    HS code, valuation or document set fails validation against the current tariff schedule

  3. Action — enforced

    Platform holds the filing for broker review before lodgement; agent may assemble drafts and flag discrepancies

  4. Human override

    Licensed customs broker lodges after documented classification review

Logged evidenceentry id · HS code and tariff schedule version · validation failures · broker identity · document set hash · UTC timestamp

Oversight

Human review — triggers, decisions and evidence

When a defined risk trigger fires, the affected action is routed to a named reviewer. Every decision is recorded with its correction, escalation and final outcome for full traceability.

  • ConfidenceLow-confidence document read
  • Financial impactHigh-value invoice or claim
  • Identity / change riskCarrier or remittance change
  • Irreversible actionDispatch or release action
  • Policy riskFatigue or dangerous-goods flag
  • Safety controlGuardrail override
  • Quality failureFailed critical evaluation
Humanreviewnamed reviewer
  • Revieweridentity + role
  • Decisionapprove / reject / amend
  • Correctionwhat changed
  • Escalationwho, why and severity
  • Final outcomereleased / blocked / returned for rework

7 triggers · any one halts the agent

1 record · 5 fields, every time

Compliance

Regulatory mapping

  • 01 Goal
  • 02 Retrieval
  • 03 Workflow
  • 04 Task
  • 05 Tool
  • 06 LLM
  • 07 Evaluation
  • 08 Guardrail
  • 09 Human review
  • 10 Outcome

Hours of service & ELD records

Driving is capped at 11 hours in a 14-hour window, false duty-status reports are barred, and a carrier ELD edit takes effect only when the driver confirms it. A plan past that is a paper violation.

49 CFR 395.3 · 49 CFR 395.8 · 49 CFR 395.30

Lifecycle layer:04 Task · 06 LLM · 08 Guardrail · 10 Outcome

  • TRN-01
  • TRN-21
  • AB-01
  • AB-03
  • AB-06
  • AI-04
  • AY-02
  • JG-03
  • JG-04

Evaluations

Baseline evaluation suite — in detail

Baseline evaluations are completed during onboarding and repeated based on the selected plan. Agents that fail critical checks remain restricted until they pass re-testing.

Detailed case sets
39
Failure modes covered
41
Retired & rotated / quarter
10%
Audit-ready scorecard
Monthly

Output evaluation3 suites · 280 cases

120 casesDG classification golden-setcatches TRN-02
100 casesTariff & documentationcatches TRN-03
60 casesETA realismcatches TRN-06

Use your work email to unlock the full grid. We use it to send the requested Agent Care material and qualify business inquiries. We do not sell or share your email.

  1. Domain-expert review

    Client-designated subject-matter experts review evaluation criteria, pass thresholds and industry-specific risks before baseline approval.

  2. Test-case rotation

    Evaluation cases are refreshed regularly to reduce memorisation, limit overfitting and maintain meaningful performance measurement.

  3. Scorecard integration

    Scorecards compare results with the approved baseline, show performance trends and flag material declines for review and escalation.

  4. Client-specific extensions

    Where included in scope, evaluations may be expanded using approved incidents, workflows, policies, data patterns and industry-specific risks.

Monitoring

Change-aware monitoring

When agent performance changes, Nestack correlates the shift with changes to the agent, prompt, model, tools, knowledge base, guardrails and evaluation suite.

Version changes by layer
01AgentAgent changed in week 5
02PromptPrompt changed in week 3Prompt changed in week 9
03ModelModel changed in week 7Model changed in week 12
04ToolTool changed in week 4
05Knowledge-baseKnowledge-base changed in week 8Knowledge-base changed in week 10
06GuardrailGuardrail changed in week 6
07Eval-suiteEval-suite changed in week 11
Grounded-answer rate92–100%
  • Week 1 · 97.9%
  • Week 2 · 97.8%
  • Week 3 · 98.0%
  • Week 4 · 97.9%
  • Week 5 · 98.1%
  • Week 6 · 97.9%
  • Week 7 · 98.0%
  • Week 8 · 94.3%
  • Week 9 · 94.1%
  • Week 10 · 97.9%
  • Week 11 · 98.0%
  • Week 12 · 98.1%

Week readouthover or select

Week 8of 12

  • 05Knowledge-basekb 2026.07

94.3%Grounded-answer rate

  • 7 layers stamped on every run · 12-week window
  • Catches TRN-05 · stale route restrictions

Something missing?

Don’t see your agent’s issue here?

Every AI environment is different. Share what you’re seeing, and we’ll review the behaviour, assess the risk and recommend the evaluations or controls that may help.

Report an agent issue

Tell us what you’re seeing

The more specific, the faster we can reproduce it. Playbook: Transportation & Logistics

We reply within one business day.

See pricing

No commitment. Even if you never become a client, we’ll tell you what we think is happening.

Process

Universal incident runbook

Severity is assigned based on business impact, customer harm, data exposure, operational disruption and overall scope.

  • SEV-1 Critical
  • SEV-2 Major
  • SEV-3 Moderate
  • SEV-4 Minor
STEP 01

Automated monitoring or human review identifies unusual behaviour. Alerts are recorded and routed according to severity.

Outcomes

Not just that it ran.
What it delivered.

Observability shows the agent ran. It can’t show the load was compliant or what the work cost. Where outcome data exists, we trace each result to its session — and a named reviewer signs off the month.

Issued
Monthly, per engagement
Traced
Every figure to its session
Signed
By your engagement reviewer
Used for
Client reporting, partner review, the AgentOps scorecard

Nestack AgentOps

Transport & logistics fleet · monthly statement

  • Booking completed6,480
  • Customs document lodged2,140
  • Load plan verified3,920
  • Claim assessed380
  • Hours-of-service audits passed30 of 30
  • Workflows delivered12,920
  • Outcome success rate98.4%
  • Human correction required207 · 1.6%
Average AI cost per successful workflow$0.33

Every figure linked to its source trace · exportable for review and audit support

Cost control

Keep transportation & logistics AI agent costs under control

Token spend is monitored, optimised and reported as part of Agent Care — and savings never come at the expense of quality, because every change is verified against your evaluation baseline.

We review token spend by agent, workflow, model, and session so you can understand where AI costs are coming from.

Running transportation & logistics AI agents in production?

Get a free assessment of one agent. We’ll review its behaviour, run a baseline evaluation and highlight potential risks and performance gaps.

Loading open times…

Open times

Select an available date above to view open 45-minute times from our calendar.