[Faccus] SERVICE ALERT - 2015-04-08 VMware cluster, MS SQL Cluster - vc-primary issues requiring a reinstall of software

jbgorrie at uwaterloo.ca jbgorrie at uwaterloo.ca
Thu Apr 9 10:53:25 EDT 2015

Description:     vc-primary issues requiring a reinstall of software

Date: (YYYY-MM-DD)     2015-04-08

Start Time:              10:00

End Time:	08:00	(2015-04-09)

Impact:           Unable to administer VM's


Submitted By: jbgorrie at uwaterloo.ca

Comment:        While doing certificate maintenance on a vmware central server a couple of the underlying  services had issues.  Vendor got involved and part of the process was to reinstall components of the VMware stack.

Clusters were re-attached after things brought back up however in some cases HA (the product that restarts things after a failure) was more aggressive and assumed there was a failure.  Some machines were then incorrectly restarted, but all were returned to service before 08:00 on April 09, 2015.  The DEV MS SQL cluster had one member server be restarted, which caused issues if the DB was on that node.

During the remainder of the window the VMs remained available however no changes could be made to the environment.  The exact same process worked on the backup server less than a week earlier.

Notice Submitted:    Thu Apr 9 10:53:25 EDT 2015

Follow us on twitter https://twitter.com/UWNetworkAlert

Note:   If you have any questions or concerns please contact the IST Service Desk at ext: 44357 or helpdesk at uwaterloo.ca

More information about the Faccus mailing list