Munin plugins for Dell IPMI fan speeds and temperatures

Remco — Tue, 20 Oct 2009 15:22:26 +0000

It is possible to monitor fan speeds and temperatures on Dell Poweredge servers under Linux. You can achieve this by reading out the IPMI data that is available on the system.
I used the steps on this website to buffer the data gathered by IPMI to use in Cacti.

However, in addition to Cacti I also use Munin to monitor various system parameters. Wouldn’t it be nice to incorporate graphs for fan speeds and temperatures in Munin? I thought so, so I developed a way to do this.

In this case the solution consists out of 2 munin plugins and a PHP script that formats the IPMI values for graphing use. This could also be done directly in the plugins, but since I’m not such an awk and sed expert I chose to let a PHP script handle the transformation, so I’d be done sooner (time is money my friends!).

First up, the PHP script:

/usr/bin/ipmi.php

#!/usr/bin/php

$handle = fopen("/dev/shm/dell.ipmi","r");
while(!feof($handle)) {
  $line = fgets($handle);
  if(preg_match("/AmbientTemp/",$line)) echo "tambi.value ".fgets($handle);
  if(preg_match("/CPU1Temp/",$line)) echo "tcpu1.value ".fgets($handle);
  if(preg_match("/CPU2Temp/",$line)) echo "tcpu2.value ".fgets($handle);
  if(preg_match("/Fan1/",$line)) echo "fan1.value ".fgets($handle);
  if(preg_match("/Fan2/",$line)) echo "fan2.value ".fgets($handle);
  if(preg_match("/Fan3/",$line)) echo "fan3.value ".fgets($handle);
  if(preg_match("/Fan4/",$line)) echo "fan4.value ".fgets($handle);
  if(preg_match("/Fan5/",$line)) echo "fan5.value ".fgets($handle);
  if(preg_match("/Fan6/",$line)) echo "fan6.value ".fgets($handle);
  if(preg_match("/PlanarTemp/",$line)) echo "tplan.value ".fgets($handle);
  if(preg_match("/RiserTemp/",$line)) echo "trise.value ".fgets($handle);
}
fclose($handle);
?>

With the SHM values now being prefixed with matching Munin values, we can graph them in 2 plugins:

/etc/munin/plugins/ipmitemps

#!/bin/sh
 
if [ "$1" = "autoconf" ]; then
        if [ -r /dev/shm/dell.ipmi ]; then
                echo yes
                exit 0
        else
                echo no
                exit 1
        fi
fi
 
if [ "$1" = "config" ]; then
 
        echo 'graph_title Dell 2850 IPMI Temperatures'
        echo 'graph_order tcpu1 tcpu2 tambi tplan trise'
        echo 'graph_vlabel Temperature (Deg C)'
        echo 'graph_scale yes'
        echo 'graph_info This graph shows sensor temperatures'
        echo 'graph_category system'
        echo 'tcpu1.label CPU1'
        echo 'tcpu1.warning 80'
        echo 'tcpu1.critical 90'
        echo 'tcpu1.info XEON CPU 1 Temperature'
        echo 'tcpu2.label CPU2'
        echo 'tcpu2.warning 80'
        echo 'tcpu2.critical 90'
        echo 'tcpu2.info XEON CPU 2 Temperature'
        echo 'tambi.label Ambient'
        echo 'tambi.warning 80'
        echo 'tambi.critical 90'
        echo 'tambi.info Ambient Temperature'
        echo 'tplan.label Planar'
        echo 'tplan.warning 80'
        echo 'tplan.critical 90'
        echo 'tplan.info Planar Temperature'
        echo 'trise.label Riser'
        echo 'trise.warning 80'
        echo 'trise.critical 90'
        echo 'trise.info Riser Temperature'
        exit 0
fi
/usr/bin/ipmi.php

and

/etc/munin/plugins/ipmifans

#!/bin/sh
 
if [ "$1" = "autoconf" ]; then
        if [ -r /dev/shm/dell.ipmi ]; then
                echo yes
                exit 0
        else
                echo no
                exit 1
        fi
fi
 
if [ "$1" = "config" ]; then
 
        echo 'graph_title Dell 2850 IPMI Fanspeeds'
        echo 'graph_order fan1 fan2 fan3 fan4 fan5 fan6'
        echo 'graph_vlabel Fanspeed (RPM)'
        echo 'graph_scale yes'
        echo 'graph_info This graph shows fanspeeds'
        echo 'graph_category system'
        echo 'fan1.label Fan1'
        echo 'fan1.info Fan1 speed'
        echo 'fan2.label Fan2'
        echo 'fan2.info Fan2 speed'
        echo 'fan3.label Fan3'
        echo 'fan3.info Fan3 speed'
        echo 'fan4.label Fan4'
        echo 'fan4.info Fan4 speed'
        echo 'fan5.label Fan5'
        echo 'fan5.info Fan5 speed'
        echo 'fan6.label Fan6'
        echo 'fan6.info Fan6 speed'
        exit 0
fi
/usr/bin/ipmi.php

restart your munin-node, run the munin crons, and voila, graphs!
With these settings they will look like this:

Dell IPMI Temperatures

Dell IPMI Fan Speeds

You can modify the params to change the graphs ofcourse.

DRAC? Why?

Remco — Fri, 29 May 2009 13:06:06 +0000

This is why, right here:

Gentoo kernel panic while emering courier-imap which triggered PaX
Oh well, the little card saved me a trip to Amsterdam, and the system appears to boot without any troubles after a hardpanic, so I guess that test is out of the way

remz.nl gaat live; fotoblogje!

Remco — Wed, 06 May 2009 23:13:56 +0000

Na enkele weken voorbereiding was vandaag dan toch eindelijk het moment daar! Mijn nieuwe servertje die eerst de liefkozende naam ’sletje’ mee had gekregen maar uiteindelijk omgedoopt is tot het iets toepasselijkere ‘greppeldell’ was eindelijk klaar, en kon richting Amsterdam waar ‘ze’ nu in een rack op telecity2 haar dagen mag slijten.
Hoewel greppeldelletje voornamelijk een shellmachientje is, maar daarnaast ook als platform voor het betere web test&prutswerk dient, kon een FQDN niet ontbreken, en bij een nieuwe server hoort eigenlijk ook een nieuwe domeinnaam natuurlijk.. en daarom kan ik met trots presenteren… greppeldell.remz.nl!

Kort wat specs van het beestje:
Dell Poweredge 2850
2x Intel Xeon 3.40Ghz
8GB DDR2 ECC/Registered
6x Seagate Cheetah 76GB U320 15k rpm SCSI disks aan een PERC4/DC controller (in 2x 3disk RAID5 arrays)
2 PSU’s en een DRAC4/I aanwezig
OS: Gentoo (Linux greppeldell 2.6.28-hardened-r7 #5 SMP x86_64) met PaX, PIE/SSP, grsecurity, SELinux en de gebruikelijke reutemeteut.

Mijn vrienden bij MaxServ waren zo aardig om wat rackruimte en wat plekken om de stekkertjes in te steken ter beschikking te stellen, en zodoende konden we vandaag op pad om de boel in de hangen. Een kort fotoverslag van het feestelijke moment:

Dell PowerEdge 2850 PERC4/DC SCSI controller in Linux Kernel

Remco — Sun, 12 Apr 2009 23:29:22 +0000

When you are building a non-generic linux kernel (e.g. when using ‘make menuconfig’), be sure to include the Device Driver for “megaraid_mbox”, otherwise your kernel won’t be able to locate your /dev/sda device!

PSEiBlog » dell

Munin plugins for Dell IPMI fan speeds and temperatures

DRAC? Why?

remz.nl gaat live; fotoblogje!

Dell PowerEdge 2850 PERC4/DC SCSI controller in Linux Kernel