I have Arch Linux running on Dell PowerEdge R210. It is not high loaded, only few scripts are running. There is no any software like web services -- only base system. The server has been running fine for a long time before and no changes have been made but it began shutting down at random times about once every few days. The server is protected by trusted UPS, but it keeps shutting down even beeing plugged directly without UPS so this is not a power problem. I have monitored temperature by executing sensors utility every minute until the server shuts down -- nothing wrong, all sensors keep showing something near 30 deegrees. So this is not a heat problem. The chassis has ipmi enabled so I can execute "power on" ipmi command every time after shutdown and the server boots and run normally.
There is nothing in "restart_cause":
$ ipmitool -H 10.5.5.32 -U root -I lanplus chassis restart_cause System restart cause: unknown
There is nothing in chassis logs:
$ ipmitool -H 10.5.5.32 -U root -I lanplus sel list 1 | 07/23/2019 | 06:33:43 | Event Logging Disabled #0x72 | Log area reset/cleared | Asserted 2 | 07/24/2019 | 09:51:50 | Physical Security #0x73 | General Chassis intrusion () | Asserted 3 | Pre-Init |0000000032| Physical Security #0x73 | General Chassis intrusion () | Asserted 4 | Pre-Init |0000000037| Physical Security #0x73 | General Chassis intrusion () | Deasserted 5 | 07/24/2019 | 11:29:10 | Physical Security #0x73 | General Chassis intrusion () | Asserted 6 | 07/24/2019 | 11:29:15 | Physical Security #0x73 | General Chassis intrusion () | Deasserted
Here is "last" command output:
$ last -x user pts/0 10.5.5.25 Wed Jul 31 08:31 - 09:38 (01:07) root ttyS1 Wed Jul 31 08:23 - 09:38 (01:14) reboot system boot 5.2.1-arch1-1-AR Wed Jul 31 08:23 - 09:38 (01:15) shutdown system down 5.2.1-arch1-1-AR Tue Jul 30 20:17 - 08:23 (12:06)
There is nothing in system journal.
I have set kernel log level to debug level but only one message appears in console output just before shutting down:
reboot: Power down
Can anybody explain me what does "reboot: Power down" exactly mean? Who or what caused shutting down? Does anyone have any ideas how can I debug this very strange issue?