Energy, Utilities & EnvironmentManaged AI Agents

Energy, Utilities & Environment AI Agents,
Monitored for Reliability

Nestack Agent Care helps energy and utility operators monitor, evaluate, and optimize AI agents used for grid monitoring, demand forecasting, outage response, and compliance reporting — before small AI errors become reliability or safety incidents.

142failure modes
59SEV-1 failure modes
905+baseline eval cases
24/7Agent Monitoring

Scope

Energy, Utilities & Environment AI agents we build & manage

Observability

What we make observable

Every energy and utilities agent session is traced across ten layers — what we capture and the evidence we keep.

  1. Evidence we keep
    Goalconstraintsapproval requirement
  2. Evidence we keep
    Sourceversiontimestamprelevancecitation
  3. Evidence we keep
    Planned sequenceactual sequenceworkflow status
  4. Evidence we keep
    Task statusresultretryfailure reason
  5. Evidence we keep
    Tool nameversioninputoutputpermissionresult
  6. Evidence we keep
    Model/versioninput/outputtoken usagelatencycost
  7. Evidence we keep
    Evaluation typemetricthresholdresult
  8. Evidence we keep
    Guardrail targettriggeractionenforcement result
  9. Evidence we keep
    Reviewerdecisioncorrectionreason
  10. Evidence we keep
    Outcome statusbusiness resultlinked trace

Catalog

Failure modes

Filter failure modes by where they occur in the agent lifecycle—from goals and retrieval to tools, evaluations, guardrails and outcomes.

Nothing on this page matches that. Try a layer (tool, retrieval, guardrail), a code, or a severity.

0 documented↑↓ move · ↵ open · ⌘↵ filter matrix
142 documented · select a cell to filter
5
44
33
49
36
22
64
47
28
98
ENE-01Unsafe guidance on life-safety hazards — downed lines, gas leaks, contaminationSEV-1
ENE-02Outage misinformation — wrong status, scope, restoration timesSEV-2
ENE-03Billing and tariff errors — TOU rates, solar feed-in, concessionsSEV-2
ENE-04Environmental-reporting errors — emissions, discharge, waste figuresSEV-1
ENE-05Critical-infrastructure data leakage — topology, SCADA, asset locationsSEV-1
ENE-06Stale market/regulatory rules — NEM procedures, interconnection rulesSEV-2
ENE-07Demand-forecast errorsSEV-3
ENE-08Injection via customer messages and smart-meter data fieldsSEV-2
ENE-09Solar and battery connection errors — export limits, inverter settings, standardsSEV-2
ENE-10Life-support customer errors — priority registration missed or overriddenSEV-1
ENE-11Disconnection and hardship-protection breaches — protected customers cut offSEV-1
ENE-12Switching and isolation instruction errors for field crewsSEV-1
ENE-13Meter-read and estimation true-up errorsSEV-2
ENE-14Rebate and concession eligibility errors — schemes and feed-in creditsSEV-3
ENE-15Autonomous trading agents — spoofing, layering and market-manipulation exposureSEV-1
ENE-16Algorithmic tacit collusion — bidding agents converging on supra-competitive pricesSEV-2
ENE-17Demand-response and VPP fleet dispatch errors — wrong device control, consent breachesSEV-2
ENE-18Grid-service capability silently broken by software updates — asset bids while unable to deliverSEV-1
ENE-19Tariff-synchronized fleet herding — lockstep charging/dispatch creating secondary peaksSEV-3
ENE-20Renewable generation and ramp forecast misses — wind/solar down-ramps caught lateSEV-2
ENE-21Control-room automation bias — unverified AI recommendations adopted by operatorsSEV-2
ENE-22Autonomous OT actuation and excessive agent permissions — state changes from hallucinated reasoningSEV-1
ENE-23Adversarial input attacks on grid ML — forecast evasion and false-data injection blinding detectorsSEV-2
ENE-24Model, memory and supply-chain poisoning — training data, RAG stores, pretrained artifactsSEV-1
ENE-25AI impersonation of the utility — deepfake payment scams on customers, cloned-voice requests to staffSEV-2
ENE-26Smart-meter privacy inference — occupancy and behavior derived from agent AMI queriesSEV-2
ENE-27Asset-health false negatives — predictive maintenance and AI inspection clearing failing assetsSEV-1
ENE-28Wildfire decision-model errors — mitigation mis-prioritization, PSPS scope wrong in either directionSEV-1
ENE-29Hazard-detection false alarms and misses — smoke cameras, leak detectors, alert fatigueSEV-2
ENE-30Storm-response mobilization forecast errors — damage models under/over-calling crew needsSEV-2
ENE-31Water-safety analytics errors — quality forecasts and advisories giving false reassuranceSEV-2
ENE-32ML emissions-monitoring drift — predictive systems masking exceedances after fuel/process changesSEV-1
ENE-33Carbon-accounting and green-claims errors — wrong emission factors, REC double counting, unsubstantiated claimsSEV-2
ENE-34Discriminatory credit and collections scoring — harsher terms for protected groupsSEV-2
ENE-35Language and accessibility failures in safety communications — meaning-inverting translations, no human escape hatchSEV-1
ENE-36Fabricated citations in regulatory filings, permits and impact assessmentsSEV-2
ENE-37Unauditable agent decisions — compliance-evidence gaps discovered at audit timeSEV-3

A · Outage-support agents

GJ-03Stale outage record01 · RetrievalSEV-3
GJ-04Premature estimate02 · ReasoningSEV-1
GJ-06Estimate without its basis02 · ReasoningSEV-1
GJ-02Register account broadcast03 · Tool / writeSEV-1
GJ-05Hazard report closed03 · Tool / writeSEV-2
GJ-01Restoration implied04 · OutputSEV-2
GJ-07Silent scope regression05 · Change / VersionSEV-2

B · Grid / asset maintenance copilots

HB-03Frame the pass never took01 · RetrievalSEV-3
HB-04Condition read from one frame02 · ReasoningSEV-1
HB-06Criteria run on the wrong class02 · ReasoningSEV-1
HB-02Coverage cut by risk score03 · Tool / writeSEV-1
HB-05Detection loses its frame03 · Tool / writeSEV-2
HB-01Small fitting missed04 · OutputSEV-2
HB-07Silent criteria drift05 · Change / VersionSEV-2

C · Billing & tariff support agents

JK-03Superseded tariff sheet01 · RetrievalSEV-3
JK-04Rate stated from memory02 · ReasoningSEV-1
JK-06Escalation discouraged02 · ReasoningSEV-1
JK-02Arrangement implied03 · Tool / writeSEV-1
JK-05Dispute logged as an enquiry03 · Tool / writeSEV-2
JK-01Rate not on the filed sheet04 · OutputSEV-2
JK-07Silent tariff regression05 · Change / VersionSEV-2

D · Compliance-reporting assistants

KM-03Superseded source record01 · RetrievalSEV-3
KM-04Unsourced figure02 · ReasoningSEV-1
KM-06Method drift02 · ReasoningSEV-1
KM-02Missed filing window03 · Tool / writeSEV-1
KM-05Stale register entry03 · Tool / writeSEV-2
KM-01Outstanding item unmarked04 · OutputSEV-2
KM-07Silent method regression05 · Change / VersionSEV-2

E · Sustainability-reporting copilots

LQ-03Superseded factor set01 · RetrievalSEV-3
LQ-04Untraceable figure02 · ReasoningSEV-1
LQ-06Silent method drift02 · ReasoningSEV-1
LQ-02Unsupported explanation03 · Tool / writeSEV-1
LQ-05Unretired instrument03 · Tool / writeSEV-2
LQ-01Marketing claim in the draft04 · OutputSEV-2
LQ-07Silent factor regression05 · Change / VersionSEV-2

F · Trading & bidding agents

MQ-03Cross-tenant data leakage01 · RetrievalSEV-3
MQ-04Learned manipulation pattern02 · ReasoningSEV-1
MQ-06Cross-book loss leg02 · ReasoningSEV-1
MQ-02Price-driven unavailability03 · Tool / writeSEV-1
MQ-05Repeated machine footprint03 · Tool / writeSEV-2
MQ-01Reason that will not hold04 · OutputSEV-2
MQ-07Silent limit regression05 · Change / VersionSEV-2

G · DR / VPP fleet-control agents

NQ-03Stale enrolment record01 · RetrievalSEV-3
NQ-04Overstated capability02 · ReasoningSEV-1
NQ-06Baseline-affecting action02 · ReasoningSEV-1
NQ-02Dispatch outside the instruction03 · Tool / writeSEV-1
NQ-05Double-counted resource03 · Tool / writeSEV-2
NQ-01Authority not evidenced04 · OutputSEV-2
NQ-07Silent rule regression05 · Change / VersionSEV-2

H · Control-room decision-support copilots

QM-03Stale input taken as live01 · RetrievalSEV-3
QM-04Option outside the range02 · ReasoningSEV-1
QM-06Procedure text paraphrased02 · ReasoningSEV-1
QM-02Reads as an instruction03 · Tool / writeSEV-1
QM-05Deference not raised03 · Tool / writeSEV-2
QM-01Falsifier omitted04 · OutputSEV-2
QM-07Silent version regression05 · Change / VersionSEV-2

I · Wildfire, storm & water analytics

JX-03Stale reading taken as current01 · RetrievalSEV-3
JX-04Spread footprint under-called02 · ReasoningSEV-1
JX-06Score read as a duty check02 · ReasoningSEV-1
JX-02Unreviewed de-energisation03 · Tool / writeSEV-1
JX-05Score kept outside the rule03 · Tool / writeSEV-2
JX-01Error direction dropped04 · OutputSEV-2
JX-07Silent threshold drift05 · Change / VersionSEV-2

J · NERC CIP compliance-evidence agents

IX-03Stale interval read01 · RetrievalSEV-3
IX-04Interval asserted, not shown02 · ReasoningSEV-1
IX-06Future standard read as live02 · ReasoningSEV-1
IX-02Thin set passed forward03 · Tool / writeSEV-1
IX-05Evidence bound to wrong asset03 · Tool / writeSEV-2
IX-01Approved, evidence unrecorded04 · OutputSEV-2
IX-07Silent interval regression05 · Change / VersionSEV-2

K · FERC forms & EQR filing agents

IY-03Stale ledger read01 · RetrievalSEV-3
IY-04Figure asserted, not sourced02 · ReasoningSEV-1
IY-06Scraped calendar read as rule02 · ReasoningSEV-1
IY-02Thin draft passed forward03 · Tool / writeSEV-1
IY-05Figure bound to wrong account03 · Tool / writeSEV-2
IY-01Filed, provenance unrecorded04 · OutputSEV-2
IY-07Silent taxonomy regression05 · Change / VersionSEV-2

L · Dam safety-programme agents

IZ-03Stale programme read01 · RetrievalSEV-3
IZ-04Role currency assumed02 · ReasoningSEV-1
IZ-06Guideline read as rule02 · ReasoningSEV-1
IZ-02Thin set passed forward03 · Tool / writeSEV-1
IZ-05Record bound to wrong project03 · Tool / writeSEV-2
IZ-01Signed, cycle unrecorded04 · OutputSEV-2
IZ-07Silent cycle regression05 · Change / VersionSEV-2

M · Emissions data-certification agents

JA-03Stale factor read01 · RetrievalSEV-3
JA-04Value asserted, not sourced02 · ReasoningSEV-1
JA-06Proposed repeal read as final02 · ReasoningSEV-1
JA-02Thin report passed forward03 · Tool / writeSEV-1
JA-05Value bound to wrong unit03 · Tool / writeSEV-2
JA-01Certified, provenance unrecorded04 · OutputSEV-2
JA-07Silent factor regression05 · Change / VersionSEV-2

N · Pipeline integrity-records agents

JB-03Stale interval read01 · RetrievalSEV-3
JB-04Deadline asserted, not shown02 · ReasoningSEV-1
JB-06Superseded rule read as live02 · ReasoningSEV-1
JB-02Thin set passed forward03 · Tool / writeSEV-1
JB-05Record bound to wrong segment03 · Tool / writeSEV-2
JB-01Released, record unkept04 · OutputSEV-2
JB-07Silent interval regression05 · Change / VersionSEV-2

O · Drinking-water compliance agents

JC-03Stale schedule read01 · RetrievalSEV-3
JC-04Result judged on wrong basis02 · ReasoningSEV-1
JC-06Proposal read as final rule02 · ReasoningSEV-1
JC-02Thin record passed forward03 · Tool / writeSEV-1
JC-05Result bound to wrong system03 · Tool / writeSEV-2
JC-01Certified, method unrecorded04 · OutputSEV-2
JC-07Silent version regression05 · Change / VersionSEV-2

Guardrails

Critical guardrails for Energy & utilities agents

Ten controls that hold regardless of prompt, plan or pressure. Open one to see what it protects, what trips it, what the agent is forced to do, who may release it, and what is written to the record.

GR-01No network topology or asset data in any responseNo override
  1. Target

    Grid topology, SCADA references, substation coordinates and asset registers under NERC CIP and SOCI classification

  2. Trigger

    Output or tool call would carry security-classified infrastructure detail to any channel

  3. Action — enforced

    Platform blocks the response, strips the classified span, and reports the attempt to the security operations centre

  4. Human override

    None — cannot be overridden in session

Logged evidenceResponse id · classification tags · blocked span hash · SOC ticket id · timestamp

GR-02No instruction embedded in smart-meter fields ever executedNo override
  1. Target

    Customer messages, meter data fields and telemetry streams ingested by service and grid agents

  2. Trigger

    Directive-shaped content detected in inbound customer or AMI data during parsing

  3. Action — enforced

    Platform neutralizes the content, quarantines the record, and continues from trusted operational sources only

  4. Human override

    None — cannot be overridden in session

Logged evidenceRecord hash · detection pattern · quarantine id · parser version · timestamp

GR-03No OT write action without human-confirmed commitOverride defined
  1. Target

    Every agent write path into SCADA, DERMS, switching and plant control systems

  2. Trigger

    Agent proposes a state change to operational technology, whatever the stated confidence

  3. Action — enforced

    Platform holds the command, requires a named operator commit per NERC CIP and CISA guidance, and executes only least-privilege actions

  4. Human override

    Control-room operator — commit via two-person console confirmation

Logged evidenceCommand id · asset id · operator identities · permission scope · commit timestamp

GR-04No in-channel troubleshooting of life-safety hazardsOverride defined
  1. Target

    Reports of downed lines, gas odours, water contamination and shock incidents in any channel

  2. Trigger

    Hazard classifier matches a life-safety pattern in customer contact, any language

  3. Action — enforced

    Platform stops the dialogue, issues the emergency-pathway script, and pages the emergency desk immediately

  4. Human override

    Emergency operations supervisor — stand down after confirmed false alarm logged

Logged evidenceContact id · hazard class · script version · page id · language · timestamp

GR-05No disconnection touching life-support premisesOverride defined
  1. Target

    Disconnection, restriction and collections workflows across billing and field-work order systems

  2. Trigger

    Action targets a premise with life-support registration or an open hardship protection

  3. Action — enforced

    Platform blocks the order, preserves supply, and routes the account to the hardship team

  4. Human override

    Hardship team manager — proceed only after regulator-compliant checklist completion

Logged evidenceAccount id · premise flag state · blocked order id · routing record · timestamp

GR-06No market bid without pre-trade conduct screeningOverride defined
  1. Target

    Autonomous bidding and trading agents operating in wholesale energy and ancillary-service markets

  2. Trigger

    Order pattern resembles spoofing, layering or coordination, or bypasses the screening service

  3. Action — enforced

    Platform blocks submission, cancels resting orders under REMIT and FERC anti-manipulation rules, and alerts compliance

  4. Human override

    Market compliance officer — release after documented conduct review

Logged evidenceOrder ids · screen verdict · strategy version · cancellation record · compliance alert id · timestamp

GR-07No regulator-bound emissions figure without source reconciliationOverride defined
  1. Target

    Emissions, discharge and waste numbers destined for compliance reports and permits

  2. Trigger

    Figure cannot be traced to reconciled sensor or ledger sources, or monitoring drift is unresolved

  3. Action — enforced

    Platform holds the filing, attaches the reconciliation gap, and requires environmental-team sign-off before release

  4. Human override

    Environmental compliance manager — sign off in the reporting system of record

Logged evidenceFigure · source ids · reconciliation diff · drift status · signer identity · timestamp

GR-08No switching or isolation instruction from generative outputOverride defined
  1. Target

    Field-crew switching, isolation and permit-to-work instructions in every crew-facing channel

  2. Trigger

    Instruction text not sourced verbatim from the authorized switching-program system

  3. Action — enforced

    Platform refuses to compose the steps and serves only the issued switching program by reference

  4. Human override

    Switching coordinator — issue a new program through the authorized system

Logged evidenceRequest id · program reference · refusal code · coordinator id · timestamp

GR-09No PSPS scope decision on model output aloneOverride defined
  1. Target

    Wildfire mitigation ranking and public-safety power-shutoff scoping recommendations

  2. Trigger

    Model proposes shutoff scope or mitigation priority without operator concurrence recorded

  3. Action — enforced

    Platform labels output advisory-only, blocks downstream execution, and requires documented operator concurrence to proceed

  4. Human override

    Wildfire operations commander — concurrence recorded in the event log

Logged evidenceRecommendation id · model version · inputs snapshot · concurrence record · timestamp

GR-10No payment-detail change via voice request aloneOverride defined
  1. Target

    Customer payment channels and staff-facing requests for account or banking changes

  2. Trigger

    Voice or chat contact requests payment redirection or urgent transfer, cloned-voice risk unresolved

  3. Action — enforced

    Platform refuses in-channel change, forces verification through the authenticated portal, and alerts fraud operations

  4. Human override

    Fraud operations lead — approve after callback to the number on file

Logged evidenceContact id · request summary · verification path · fraud alert id · timestamp

Oversight

Human review — triggers, decisions and evidence

When a defined risk trigger fires, the affected action is routed to a named reviewer. Every decision is recorded with its correction, escalation and final outcome for full traceability.

  • ConfidenceLow-confidence asset alert
  • Financial impactHigh-value market bid
  • Identity / change riskLife-support status change
  • Irreversible actionDisconnection or switching
  • Policy riskHardship-protection conflict
  • Safety controlGuardrail override
  • Quality failureFailed critical evaluation
Humanreviewnamed reviewer
  • Revieweridentity + role
  • Decisionapprove / reject / amend
  • Correctionwhat changed
  • Escalationwho, why and severity
  • Final outcomereleased / blocked / returned for rework

7 triggers · any one halts the agent

1 record · 5 fields, every time

Compliance

Regulatory mapping

  • 02 Retrieval
  • 03 Workflow
  • 04 Task
  • 05 Tool
  • 06 LLM
  • 07 Evaluation
  • 08 Guardrail
  • 09 Human review
  • 10 Outcome

Life safety & outage communications

Hazard notices need written classification and prompt response; DOE reports keep duration distinct from estimate; GB restoration clocks run from the assessed storm category. In-channel troubleshooting, or a guess stated as fact, breaks each.

49 CFR 192.615(a) · 10 CFR 205.351–.352 · SI 2015/699 reg 7

Lifecycle layer:06 LLM · 07 Evaluation · 08 Guardrail · 10 Outcome

  • ENE-01
  • ENE-02
  • ENE-29
  • GJ-01
  • GJ-03
  • GJ-04
  • GJ-05
  • GJ-06
  • GJ-07

Evaluations

Baseline evaluation suite — in detail

Baseline evaluations are completed during onboarding and repeated based on the selected plan. Agents that fail critical checks remain restricted until they pass re-testing.

Evaluation suites
34
Failure modes covered
142 of 142
Cases · 10% rotated / quarter
2,185
Audit-ready scorecard
Monthly

Output evaluation4 suites · 275 cases

100 casesTariff & billing accuracycatches ENE-03
55 casesDemand-forecast sanitycatches ENE-07
70 casesDisclosure substantiation setcatches LQ-01–07
50 casesAsset health, hazard and emergency analytics setcatches ENE-27 · ENE-28 · ENE-29 · ENE-30 · ENE-31

Use your work email to unlock the full grid. We use it to send the requested Agent Care material and qualify business inquiries. We do not sell or share your email.

  1. Domain-expert review

    Client-designated subject-matter experts review evaluation criteria, pass thresholds and industry-specific risks before baseline approval.

  2. Test-case rotation

    Evaluation cases are refreshed regularly to reduce memorisation, limit overfitting and maintain meaningful performance measurement.

  3. Scorecard integration

    Scorecards compare results with the approved baseline, show performance trends and flag material declines for review and escalation.

  4. Client-specific extensions

    Where included in scope, evaluations may be expanded using approved incidents, workflows, policies, data patterns and industry-specific risks.

Monitoring

Change-aware monitoring

When agent performance changes, Nestack correlates the shift with changes to the agent, prompt, model, tools, knowledge base, guardrails and evaluation suite.

Version changes by layer
01AgentAgent changed in week 5
02PromptPrompt changed in week 3Prompt changed in week 9
03ModelModel changed in week 7Model changed in week 12
04ToolTool changed in week 8Tool changed in week 10
05Knowledge-baseKnowledge-base changed in week 4
06GuardrailGuardrail changed in week 6
07Eval-suiteEval-suite changed in week 11
Grounded-answer rate92–100%
  • Week 1 · 98.5%
  • Week 2 · 98.4%
  • Week 3 · 98.6%
  • Week 4 · 98.5%
  • Week 5 · 98.7%
  • Week 6 · 98.5%
  • Week 7 · 98.6%
  • Week 8 · 94.9%
  • Week 9 · 94.7%
  • Week 10 · 98.5%
  • Week 11 · 98.6%
  • Week 12 · 98.7%

Week readouthover or select

Week 8of 12

  • 04Tooltools 11.3

94.9%Grounded-answer rate

  • 7 layers stamped on every run · 12-week window
  • Catches ENE-18 · capability broken by a software update

Something missing?

Don’t see your agent’s issue here?

Every AI environment is different. Share what you’re seeing, and we’ll review the behaviour, assess the risk and recommend the evaluations or controls that may help.

Report an agent issue

Tell us what you’re seeing

The more specific, the faster we can reproduce it. Playbook: Energy, Utilities & Environment

We reply within one business day.

See pricing

No commitment. Even if you never become a client, we’ll tell you what we think is happening.

Process

Universal incident runbook

Severity is assigned based on business impact, customer harm, data exposure, operational disruption and overall scope.

  • SEV-1 Critical
  • SEV-2 Major
  • SEV-3 Moderate
  • SEV-4 Minor
STEP 01

Automated monitoring or human review identifies unusual behaviour. Alerts are recorded and routed according to severity.

Outcomes

Not just that it ran.
What it delivered.

Observability shows the agent ran. It can’t show the outage was restored or what the work cost. Where outcome data exists, we trace each result to its session — and a named reviewer signs off the month.

Issued
Monthly, per engagement
Traced
Every figure to its session
Signed
By your engagement reviewer
Used for
Client reporting, partner review, the AgentOps scorecard

Nestack AgentOps

Energy & utilities fleet · monthly statement

  • Customer enquiry resolved11,200
  • Connection application processed1,480
  • Meter exception cleared3,260
  • Field job dispatched2,040
  • Regulatory reports filed8 of 8
  • Workflows delivered17,980
  • Outcome success rate98.7%
  • Human correction required234 · 1.3%
Average AI cost per successful workflow$0.31

Every figure linked to its source trace · exportable for review and audit support

Cost control

Keep energy, utilities & environment AI agent costs under control

Token spend is monitored, optimised and reported as part of Agent Care — and savings never come at the expense of quality, because every change is verified against your evaluation baseline.

We review token spend by agent, workflow, model, and session so you can understand where AI costs are coming from.

Running energy, utilities & environment AI agents in production?

Get a free assessment of one agent. We’ll review its behaviour, run a baseline evaluation and highlight potential risks and performance gaps.

Loading open times…

Open times

Select an available date above to view open 45-minute times from our calendar.