superMaru

  • Home
  • About

Tag Archives: kernel

Debugging ESX boot medium issues

01/13/15 / / Leave a comment / ESXi, tips and tricks, VMware / cli, kernel, vmware

With a lot of servers in my lab, I run into my fair share of ESX boot medium issues in the lab. Typically this exhibits weird issues where the ESX host is online, VMs are incredibly slow or completely hung and ping-able. The quickest way I would determine of the boot media (USB, SD card, etc) is bad is trying to read any log file and get an I/O error.

~ # less /var/log/vmkernel.log
/var/log/vmkernel.log: Input/output error

If you want to go further down the rabbit hole, you can verify this by looking at SCSI error commands. Since the boot media was spewing all over the logs, it was quite easy to find it.  You can refer here for a list of SCSI commands

~ # dmesg  | grep Cmd | awk '{print $5}' | sort -u | grep -v ,
0x1a -> Mode sense. Can ignore this.
0x28 -> Read errors. 
0x2a -> Write errors. 
0x85 -> ATA passthru. Can ignore this as well.

You can also look at the stats of the adapters by droping into VMware’s vsish utility (VMKernel Sys Info Shell)

/storage/scsifw/adapters/vmhba0/> cat stats
Statistics {
   Successful Commands:3190786
   Failed Commands:7025
   Blocks Read:147564437
   Failed Blocks Read:13112
   Blocks Written:138151007
   Failed Blocks Written:162368
   Read Operations:1707621
   Failed Read Operations:631
   Write Operations:1440350
   Failed Write Operations:5539
   Reserve Operations:1406
   Failed Reserve Operatiosn:0
   reservationConflicts:0

I’ll probably post more about finding slow iSCSI/NAS datastores sometime later.

Recent Posts

  • Ethical Hacking Final – Fall 2018 (Mission College)
  • Hackthissite.org – Basic 2 and 3
  • New YouTube Channel!
  • Ethical Hacking Midterm – Fall 2018 (Mission College)
  • Windows Subsystem for Linux – Ubuntu GUI with xfce

Categories

  • data center
  • ESXi
  • Home DIY
  • linux
  • Networking
  • Raspberry Pi
  • security
  • tips and tricks
  • Uncategorized
  • VMware
  • vSphere
  • Wireless

Archives

  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • October 2017
  • August 2017
  • July 2017
  • May 2017
  • March 2017
  • February 2017
  • November 2016
  • October 2016
  • October 2015
  • July 2015
  • May 2015
  • April 2015
  • January 2015
  • September 2014
  • August 2014

Tags

authentication bind bootable image cit016 cli console cooling dcui dns DOS esxi freenas hackthissite.org html kernel linux mssh networking ova ovf preview build raspberry pi RDP security serial sha1sum spotify ssh storage telnet temperature tips and tricks tradeshows two factor ubuntu vCenter virtualization vm vmware vmworld vmworld2014 vmx vulnerability Windows zfs
© superMaru 2017
TwitterLinkedIn