===== HP hardware monitoring ===== ==== Install HP management tools ==== {{:servers:c00223285.pdf|Managing Proliant servers with Linux}} - Install HP repo, add ''deb http://downloads.linux.hp.com/SDR/downloads/MCP/ubuntu precise/current non-free'' to ''/etc/apt/sources.list''. \\ Note: for Ubuntu 14.04: \\ deb http://downloads.linux.hp.com/SDR/repo/mcp/Ubuntu trusty/current non-free Enroll keys for DEB-based systems. Issue the following commands to enroll the keys on your deb-based system: curl http://downloads.linux.hp.com/SDR/hpPublicKey1024.pub | apt-key add - curl http://downloads.linux.hp.com/SDR/hpPublicKey2048.pub | apt-key add - curl http://downloads.linux.hp.com/SDR/hpPublicKey2048_key1.pub | apt-key add - - Update the Ubuntu sources with ''apt-get update'' - Install required packages with ''aptitude install hp-health hp-snmp-agents hpsmh hp-smh-templates ''\\ Note: for Ubuntu 14.04:\\ apt-get install hp-health hp-snmp-agents hpsmh \\ The seems to have changed again to ''deb http://downloads.linux.hpe.com/SDR/repo/mcp trusty/current non-free'' \\ - Configure SNMPd with ''/sbin/hpsnmpconfig'' - Probably wise to restart all the HP agents in /etc/init.d Web page is located at [[https://kvm01.bhm.company.int:2381/]] and [[https://kvm02.bhm.company.int:2381/]], use system credentials to log in with, this should be root's user and password. Status LED:- root@kvm01:~# hpuid usage: hpuid [options] -d = Disable the UID (Blue) Light -e = Enable the UID (Blue) Light -s = Status of the UID (Blue) Light root@kvm01:~# hpuid -s OFF root@kvm01:~# Sensor display with hplog:- root@kvm01:~# hplog -t ID TYPE LOCATION STATUS CURRENT THRESHOLD 1 Basic Sensor I/O Zone Normal 104F/ 40C 149F/ 65C 2 Basic Sensor Ambient Normal 60F/ 16C 104F/ 40C 3 Basic Sensor CPU (1) Normal 86F/ 30C 203F/ 95C 4 Basic Sensor CPU (1) Normal 86F/ 30C 203F/ 95C 5 Basic Sensor Pwr. Supply Bay Normal 73F/ 23C 140F/ 60C 6 Basic Sensor CPU (2) Normal ---F/---C 203F/ 95C 7 Basic Sensor CPU (2) Normal ---F/---C 203F/ 95C By default snmpd only listens on 127.0.0.1, edit /etc/snmp/snmpd.conf:- # AGENT BEHAVIOUR # # Listen for connections from the local system only #agentAddress udp:127.0.0.1:161 <--------------comment this line # Listen for connections on all interfaces (both IPv4 *and* IPv6) agentAddress udp:161,udp6:[::1]:161 <--------------uncomment this line If the IML log has old entries in, it can be cleared:- root@fmc-enf-nctl-1:~# hpasmcli HP management CLI for Linux (v2.0) Copyright 2008 Hewlett-Packard Development Group, L.P. -------------------------------------------------------------------------- NOTE: Some hpasmcli commands may not be supported on all Proliant servers. Type 'help' to get a list of all top level commands. -------------------------------------------------------------------------- hpasmcli> CLEAR IML IML Log successfully cleared. hpasmcli> ==== Install HP Proliant Support Pack or Management Component Pack ==== for Ubuntu 14.04 and more recent: apt-get install hpsmh hp-snmp-agents hp-smh-templates hponcfg hp-health hpssacli For Ubuntu 12.04 and previous: root@enf-assetstore01:~# apt-get install hpsmh hp-snmp-agents hp-smh-templates hponcfg hp-health hpacucli ... edited ... Setting up hpacucli (9.40.1-1.) ... root@enf-assetstore01:~# root@enf-assetstore01:~# hpacucli ctrl all show config Smart Array P400i in Slot 0 (Embedded) (sn: PH84MR7762 ) array A (SAS, Unused Space: 0 MB) logicaldrive 1 (136.7 GB, RAID 1, OK) physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 146 GB, OK) physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 146 GB, OK) root@enf-assetstore01:~# ==== ILO Login ==== Default username is ''Administrator'', Default password is ''hpinvent''. ==== Configure ILO from OS ==== root@enf-assetstore01:~# hponcfg -g HP Lights-Out Online Configuration utility Version 4.2.0 Date 6/10/2013 (c) Hewlett-Packard Company, 2013 Firmware Revision = 1.50 Device type = iLO 2 Driver name = hpilo Host Information: Server Name: enf-assetstore01 Server Number: 000000000 root@enf-assetstore01:~# === Export config as xml === root@enf-assetstore01:~# hponcfg -a -w iloconfig.cfg HP Lights-Out Online Configuration utility Version 4.2.0 Date 6/10/2013 (c) Hewlett-Packard Company, 2013 Firmware Revision = 1.50 Device type = iLO 2 Driver name = hpilo Management Processor configuration is successfully written to file "iloconfig.cfg" root@enf-assetstore01:~# ls -l total 8 -rw-r--r-- 1 root root 5131 Dec 18 17:11 iloconfig.cfg root@enf-assetstore01:~# Edit this file to reflect the needed config and import it back:- root@enf-assetstore01:~# hponcfg -f iloconfig.cfg -v HP Lights-Out Online Configuration utility Version 4.2.0 Date 6/10/2013 (c) Hewlett-Packard Company, 2013 Firmware Revision = 1.50 Device type = iLO 2 Driver name = hpilo ... Please wait while the firmware is reset. This might take a minute Script succeeded Note, if any error like 'Cannot add user. The login/ user name already exists', the Ilo settings can be reset first and then imported the configurations. root@kvm03:/etc/network# hponcfg -r HP Lights-Out Online Configuration utility Version 4.4.0 Date 06/13/2014 (c) Hewlett-Packard Company, 2014 Firmware Revision = 1.61 Device type = iLO 2 Driver name = hpilo Resetting to Factory Defaults...This takes upto 60 seconds. The Management Processor has been rebooted. root@kvm03:/etc/network# hponcfg -f iloconfig.cfg -v HP Lights-Out Online Configuration utility Version 4.4.0 Date 06/13/2014 (c) Hewlett-Packard Company, 2014 Firmware Revision = 1.61 Device type = iLO 2 Driver name = hpilo ... Please wait while the firmware is reset. This might take a minute Script succeeded ===== Restart the snmpd agents ===== Periodically on the HP dl360 servers, the HP snmp agent seems to fail and monitoring will report a whole series of errors at the same time. This script is installed in /root which restarts the snmp system every night at 1am. # cat /root/restart-hp-snmpagent.sh #!/bin/bash #Written Andrew Stringer 07/06/2016 #Purpose is to restart the HP snmp agents as they tend to crash and require a restart of the agent. #This is intended to run from cron. echo `/bin/date` /etc/init.d/hp-snmp-agents restart /etc/init.d/snmpd restart exit 0 # This is run from cron with:- #restart the HP snmp agent. 0 1 * * * /root/restart-hp-snmpagent.sh > /root/restart-hp-snmpagent.log