Back to Intelligence

Agentic AI Is Years Away — Your Disk Fills Up Tonight: Self-Healing IT You Can Deploy Now

SA
AlertMonitor Team
October 1, 2026
9 min read

The Register recently summed up where the AI hype cycle actually stands: the tech industry is hot for shopping bots, but they are years away, because what works for human shoppers does not work with probabilistic AI agents. That sentence should be taped to every IT manager's monitor. Vendors are pitching autonomous agents that will browse, decide, and act on your behalf — someday. Meanwhile, the print spooler on your terminal server just crashed for the fourth time this month, your monitoring tool emailed about a disk at 92% that nobody read for eleven days, and a technician is about to be paged at 2am to perform a restart a script could have executed at 2:00:04.

The lesson for IT operations is not that AI is useless. It is that autonomous, probabilistic decision-making is the wrong tool for remediation — today. Remediation needs determinism: a known trigger, a known action, a verified outcome, and an escalation path if the action fails. That is a runbook, not a chatbot with shell access. And unlike agentic AI, deterministic self-healing is not years away. You can deploy it this week.

The Problem: You Have a Detection Engine Bolted to a Human

Walk through what happens in most IT shops right now, whether you run an internal team on Nagios and a shared inbox or an MSP stack of ConnectWise Manage, Automate, and a NOC dashboard:

  1. Monitoring detects something: Disk C: on FILE01 is at 91%.
  2. An alert fires into a channel or inbox that may or may not be watched.
  3. A human eventually sees it, RDPs in, pokes around, finds the IIS logs grew unchecked, deletes them, and documents it in a ticket — if they remember to create one.
  4. Six weeks later the same alert fires on a different server, and step 3 happens again with a different technician.

The monitoring saw the problem. The RMM could have fixed it. The helpdesk recorded that a human did it manually. None of these systems talked to each other, because they were never designed to. Monitoring tools were built to observe. Ticketing systems were built to record. RMM platforms were built to execute scripts a technician triggers by hand. The loop between detection and resolution was always going to be closed by a human — until the tooling makes it deterministic.

The costs are not abstract:

  • Time: A routine service restart is five minutes of actual work. With paging, VPN, ticketing, and documentation overhead, it becomes 30–45 minutes of a technician's night. Do the math across the 30–40 recurring incidents a typical 500-endpoint environment generates each week, and you are burning five to ten tech-hours weekly on toil a runbook could absorb.
  • Alert fatigue: When 80% of alerts result in a human performing the same three steps, technicians start swiping them away. That is how the disk alert that fired for eleven days before the database store dismounted got missed.
  • SLA reporting fiction: When monitoring data lives in one system and ticket data lives in another, your MTTR numbers are built on whatever technicians remembered to type. Good luck proving SLA compliance to your biggest client with that.
  • Burnout: Nobody leaves IT because they restarted the Spooler once. They leave because they did it at 2am, four times in a month, on servers they flagged for a permanent fix last year.

This is the gap the agentic AI vendors claim they will eventually close. But as The Register's shopping-bot analysis points out, a probabilistic agent that is right 95% of the time is fine for recommending sneakers and genuinely dangerous when the 5% means restarting a domain controller, deleting the wrong folder, or pushing a broken script to 400 endpoints. You do not want creativity in your remediation path. You want the same correct action every time, with a hard stop when verification fails.

How AlertMonitor Closes the Loop

AlertMonitor treats self-healing as a first-class workflow, not a scripting bolt-on:

Runbooks attached to alert conditions. When an alert fires — service stopped, disk free below 15%, log directory over a size threshold — a runbook runs automatically. It restarts the service, clears temp files, rotates logs, or triggers a webhook. If verification passes, the incident self-resolves and no human is paged. If verification fails, escalation fires with full context: what alerted, what ran, what the output was.

Verification and exit codes as escalation logic. A runbook that fires a script and declares success is how you get silent failures. Every AlertMonitor runbook verifies the outcome — is the service actually running, is there actually free space now — and escalates only when the fix did not stick.

Automatic ticket correlation. Because monitoring, RMM, helpdesk, and patching share one data model, every automated remediation writes a ticket entry: trigger, action, output, result. Your 2am restart now has an audit trail, your SLA reports are real, and nobody reconstructs what happened from memory three weeks later.

Canary deployment monitoring. Automation itself can cause outages — ask anyone who pushed a cleanup script with a wrong path to an entire fleet. AlertMonitor validates script and agent rollouts against a test group first, with a soak period, before promotion to the full estate. The bad script breaks five pilot machines, not 400 endpoints at your largest client.

The workflow difference is not subtle. Old way: alert at 01:58, page at 01:59, tech wakes at 02:10, VPN and RDP by 02:20, root cause at 02:35, fixed at 02:45, ticket at 02:55. AlertMonitor way: alert at 01:58, runbook executes at 01:58:10, verification passes at 01:59, ticket auto-documented, tech keeps sleeping. Forty-five minutes of human toil becomes ninety seconds of automation — and escalation activates only when the situation genuinely needs a human.

Practical Steps: Build Your First Self-Healing Loop This Week

Step 1: Find your repeat offenders

Pull the last 90 days of tickets and alerts and count recurrences. In nearly every environment the top five are identical: disk space, crashed services, growing logs, stuck print queues, hung application pools. Start with whichever one pages your team most often.

Step 2: Write remediation scripts with guardrails

A remediation script needs four parts: check the condition, act, verify, and exit with a code that tells the platform whether to escalate. Here is a disk space check you can run across your Windows servers today:

PowerShell
$servers = @("SQL01", "FILE01", "RDS01", "APP01")
Get-CimInstance -ComputerName $servers -ClassName Win32_LogicalDisk -Filter "DriveType=3" |
    Select-Object SystemName, DeviceName,
        @{N='SizeGB';E={[math]::Round($_.Size/1GB,1)}},
        @{N='FreeGB';E={[math]::Round($_.FreeSpace/1GB,1)}},
        @{N='FreePercent';E={[math]::Round($_.FreeSpace/$_.Size*100,1)}} |
    Where-Object { $_.FreePercent -lt 15 } |
    Sort-Object FreePercent

And a service watchdog that restarts, verifies, and escalates if the restart did not hold — the exact pattern an AlertMonitor runbook expects:

PowerShell
$services = @("Spooler", "W3SVC")
foreach ($name in $services) {
    $svc = Get-Service -Name $name -ErrorAction SilentlyContinue
    if ($svc -and $svc.StartType -ne 'Disabled' -and $svc.Status -ne 'Running') {
        Start-Service -Name $name
        Start-Sleep -Seconds 15
        if ((Get-Service -Name $name).Status -ne 'Running') {
            Write-Output "ESCALATE: $name failed to start on $env:COMPUTERNAME"
            exit 2
        }
        Write-Output "RECOVERED: $name restarted on $env:COMPUTERNAME"
    }
}
Write-Output "OK: all target services running"

For the Linux estate, the same deterministic loop applied to a filling /var:

Bash / Shell
#!/bin/bash
THRESHOLD=90
USAGE=$(df /var | awk 'NR==2 {gsub("%",""); print $5}')
if [ "$USAGE" -ge "$THRESHOLD" ]; then
    journalctl --vacuum-time=7d
    find /var/log -name "*.gz" -mtime +14 -delete
    NEW_USAGE=$(df /var | awk 'NR==2 {gsub("%",""); print $5}')
    if [ "$NEW_USAGE" -ge "$THRESHOLD" ]; then
        echo "ESCALATE: /var still at ${NEW_USAGE}% after cleanup"
        exit 2
    fi
    echo "RECOVERED: /var down to ${NEW_USAGE}%"
fi

The exit code is the contract: 0 means self-healed, anything else means page a human with the output attached. That is the whole trick — no AI judgment, no probability, just a deterministic loop with a human fallback.

Step 3: Attach runbooks to alert conditions in AlertMonitor

In AlertMonitor, attach the script to the alert condition itself rather than leaving it in a script library a technician has to remember at 2am. Set the verification window (wait 30 seconds after a service restart before checking status), map exit code 2 to your escalation policy, and let the platform handle ticket creation. A runbook definition looks like this conceptually:

YAML
runbook: spooler-watchdog
trigger:
  alert: service-stopped
  conditions:
    - service: Spooler
      host_role: terminal-server
actions:
  - name: restart-and-verify
    script: service-watchdog.ps1
    verify_after_seconds: 30
on_failure:
  - create_ticket:
      priority: high
      queue: tier2
  - notify: after-hours-oncall

Step 4: Canary every rollout

Never push a new remediation script or agent update to the whole fleet at once. Define a pilot group — a handful of non-critical servers, ideally in a test OU or lab domain — and let AlertMonitor soak the change there before promotion:

YAML
rollout: cleanup-script-v2
canary:
  test_group: pilot-servers
  soak_time: 30m
  promote_if: success_rate >= 99%
  rollback_on: any_failure

This is the shopping-bot lesson translated into IT ops: an agent — or an untested script — doing the wrong thing at fleet scale is not an efficiency gain, it is an incident generator. Canary first, promote on evidence.

Step 5: Measure the loop

After 30 days, check three numbers: the percentage of incidents remediated before a human was involved, MTTR for runbook-handled alert types versus manual ones, and after-hours page volume. Teams running this pattern typically watch page load drop by half within the first quarter, because recurring noise stops reaching humans at all.

The Bottom Line

Agentic AI that autonomously operates your infrastructure is a demo today and a roadmap item for years from now. You do not need it to stop getting paged at 2am. You need detection wired directly to deterministic remediation with verification, escalation, and canary-tested rollouts. That exists now, it is auditable, and it makes your SLA reports honest. Build the loop — let the probabilistic agents finish maturing. Your spooler cannot wait.

Related Resources

AlertMonitor Self-Healing & Proactive IT AlertMonitor Platform Overview Book a Demo Self-Healing & Proactive IT Resources

self-healingauto-remediationproactive-itrunbook-automationalertmonitoragentic-airmm

Is your security operations ready?

Get a free SOC assessment or see how AlertMonitor cuts through alert noise with automated triage.