"Vienna": The Vanishing Process
Scenario: "Vienna": The Vanishing Process
Level: Medium
Type: Fix
Tags: systemd
Access: Email
Description: Our monitoring agent monagent keeps "crashing" — or at least that's what it looks like. Every few minutes it seems to disappear, but:
- systemctl status monagent always reports it as active (running)
- journalctl -u monagent shows no errors, panics, or OOM kills
- CPU and memory usage are completely normal
- Restarting the service "fixes" it, but only for a few minutes
Find out what is actually happening and correct /usr/local/bin/monagent-watchdog.sh so it tracks the running process correctly, without disabling the watchdog..
Root (sudo) Access: True
Test: The watchdog unit is still active and, after a monagent restart, it does not kill/restart the newly started worker due to stale PID tracking.
We also always add:
The "Check My Solution" button runs the script /home/admin/agent/check.sh, which you can read and execute.
Time to Solve: 15 minutes.