We help IT Professionals succeed at work.
Troubleshooting Question

Unable to Update my ESXI hosts

Thomas Grassi
on
35 Views
Last Modified: 2020-10-09
Built two new ESXI Hosts and a VCSA

Unable to update them it fails every time


My VCSA is up to date I am able to update that appliance with no problem.

Product:
VMware vCenter Server Appliance

Version:
6.7.0.44000

Build number
16046470


My two ESXI hosts will not update.

I I have another question open about domain joining and that is failing also I believe it may be because it will not update.


Any ideas or suggestions

Thanks





Comment
Watch Question

Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
Possibly conflicting vib.

Check VMware Update Manager logs, and also tail the esxupdate.log on update.

Remove the conflicting vib.
Thomas GrassiSystems Administrator

Author

Commented:
Andrew
I saw that when I first researched this.    do not which MIB to remove 
This is my esxupate.log  I did not see anything wrong I could have missed something thing maybe you can see it.

esxupdate.txt

also what is the name and location of the other log cant find that on the esxi host


[root@TGCSESXI-19:~] ls /var/log
Xorg.log              ddecomd.log           esxupdate.log         hostd.log             jumpstart-stdout.log  rabbitmqproxy.log     storagerm.log         upitd.log             vmauthd.log           vmkwarning.log        vsanmgmt.log
auth.log              dhclient.log          fdm.log               hostdCgiServer.log    kickstart.log         rhttpproxy.log        swapobjd.log          usb.log               vmkdevmgr.log         vmware                vsansystem.log
boot.gz               epd.log               firstboot.log         hostprofiletrace.log  lacp.log              sdrsinjector.log      sysboot.log           vitd.log              vmkernel.log          vobd.log              vsanvpd.log
clomd.log             esxcli-software.log   hbrca.log             iofilter-init.log     nfcd.log              shell.log             syslog.log            vlf                   vmkeventd.log         vprobe.log            vvold.log
configRP.log          esxi_install.log      hostd-probe.log       iofiltervpd.log       osfsd.log             smbios.bin            tallylog              vlf-ts                vmksummary.log        vpxa.log
[root@TGCSESXI-19:~]

Thanks
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
I've just looked very quickly, and it looks like, it updated.

have you restarted the hosts since?

the other method is to actually tail the log, whilst it's updating.

this is via VUM ?

have you tried manual update ?
Thomas GrassiSystems Administrator

Author

Commented:
Andrew,

I am logged on to vcenter to view all my hosts and then i select a host and choose update that the only way I know how
If their are other methods would be glad to learn how.


When doing the updates thru the gui it automatically places the host in maintmode then you can reboot when ready.

I saw it go into maint mode but then went out right away.

I will restart the host but I believe the updates will still show as non compliant.





Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
like this..written by me of course!

HOW TO: Update VMware ESXi 6.7 GA to ESXi 6.7U3(a) in 5 easy steps.

HOW TO: Update VMware ESXi 6.7 GA to ESXi 6.7U3(a) direct from VMware.  

often the above method, shows what goes wrong for debugging.
Thomas GrassiSystems Administrator

Author

Commented:
Andrew

My ESXI hosts are 6.5 not 6.7
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
The procedure is EXACTLY the same, the only difference is the filenames!

which version are you updating 6.5 to ....

latest patch update to 6.5

esxcli software profile update -p ESXi-6.5.0-20200704001-standard -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml

Open in new window


substitute that line in the article!

That is ESXi-6.5.0-20200704001-standard (Build 16576891) Published at the End of July 2020!

it will either work or fail, and give you a message as to why..
Thomas GrassiSystems Administrator

Author

Commented:
Both ESXI hosts are same level need to update to latest these are both new hosts and have many updates to apply

Is it possible to get a more current iso for ESXI 6.5 then I would not need to apply 500 plus updates?



ESXi Version6.5.0
HypervisorVMware ESXi
Build4887370
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
You just apply the last patch, patches are cumulative.

So you can try and go from 4887370 to 16576891.

However sometimes, you may have to update a few times, because that is very old.

Last iso is VMware-VMvisor-Installer-201908001-14320405.x86_64.iso, available from VMware.
Thomas GrassiSystems Administrator

Author

Commented:
Andrew running from the command line now the update lets see how it goes host is in maint mode now
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
it will update (reboot required) or fail.

often we tail -f /var/esxupdate.log from another SSH session

to watch the update, but if you've not been on top of your updates, often older builds struggle with updating..
Thomas GrassiSystems Administrator

Author

Commented:
2020-10-09T15:26:53Z esxupdate: 70245: downloader: DEBUG: Downloading https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/esx/vmw/vib20/i40en/VMW_bootbank_i40en_1.8.1.9-2vmw.650.3.96.13932383.vib to /tmp/vibdownload/VMW_bootbank_i40en_1.8.1.9-2vmw.650.3.96.13932383.vib...
2020-10-09T15:29:28Z esxupdate: 70245: HostImage: INFO: Unable to download from https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/esx/vmw/vib20/i40en/VMW_bootbank_i40en_1.8.1.9-2vmw.650.3.96.13932383.vib, error [('https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/esx/vmw/vib20/i40en/VMW_bootbank_i40en_1.8.1.9-2vmw.650.3.96.13932383.vib', '/tmp/vibdownload/VMW_bootbank_i40en_1.8.1.9-2vmw.650.3.96.13932383.vib', '[Errno 14] curl#7 - "SSL read: error:00000000:lib(0):func(0):reason(0), errno 110"')]. Trying next url...
2020-10-09T15:29:28Z esxupdate: 70245: vmware.runcommand: INFO: runcommand called with: args = 'localcli system visorfs ramdisk list | grep /stagebootbank && localcli system visorfs ramdisk remove -t /tmp/stagebootbank', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2020-10-09T15:29:28Z esxupdate: 70245: vmware.runcommand: INFO: runcommand called with: args = 'localcli system visorfs ramdisk list | grep /vibdownload && localcli system visorfs ramdisk remove -t /tmp/vibdownload', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2020-10-09T15:29:28Z esxupdate: 70245: HostImage: ERROR: Failed to send vob install.stage.error: [Errno 28] No space left on device
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR: Traceback (most recent call last):
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/usr/lib/vmware/esxcli-software", line 468, in <module>
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:     main()
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/usr/lib/vmware/esxcli-software", line 459, in main
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:     ret = CMDTABLE[command](options)
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/usr/lib/vmware/esxcli-software", line 214, in ProfileUpdateCmd
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:     allowDowngrades=opts.downgrade)
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/build/mts/release/bora-4887370/bora/build/esx/release/vmvisor/sys-boot/lib64/python3.5/site-packages/vmware/esximage/Transaction.py", line 675, in InstallVibsFromProfile
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/build/mts/release/bora-4887370/bora/build/esx/release/vmvisor/sys-boot/lib64/python3.5/site-packages/vmware/esximage/Transaction.py", line 382, in _installVibs
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/build/mts/release/bora-4887370/bora/build/esx/release/vmvisor/sys-boot/lib64/python3.5/site-packages/vmware/esximage/Transaction.py", line 442, in _validateAndInstallProfile
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/build/mts/release/bora-4887370/bora/build/esx/release/vmvisor/sys-boot/lib64/python3.5/site-packages/vmware/esximage/HostImage.py", line 801, in Stage
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR:   File "/build/mts/release/bora-4887370/bora/build/esx/release/vmvisor/sys-boot/lib64/python3.5/site-packages/vmware/esximage/HostImage.py", line 488, in _download_and_stage
2020-10-09T15:29:28Z esxupdate: 70245: root: ERROR: AttributeError: 'NoneType' object has no attribute 'close'

been tailing the log from another ssh session and it failed 
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
Errno 28] No space left on device

Very common, and troublesome.

I would proceed, with using the ISO. (unless you really want to spend hours fixing this!)
Thomas GrassiSystems Administrator

Author

Commented:
which ISO?
Thomas GrassiSystems Administrator

Author

Commented:
Andrew

I created an ISO file and burned it onto a CD

How do I use this on and ESXI host?

I can insert the CD on the host no problem

Then what is next 
Thomas GrassiSystems Administrator

Author

Commented:
Andrew

I just uploaded the iso image to a shared datastore.

[root@TGCSESXI-19:~] esxcli software profile update -p ESXi-6.5.0-2020007001-standard -d /vmfs/volumes/NFS01/ESXi650-202007001.zip
 [MetadataDownloadError]
 Could not download from depot at zip:/vmfs/volumes/NFS01/ESXi650-202007001.zip?index.xml, skipping (('zip:/vmfs/volumes/NFS01/ESXi650-202007001.zip?index.xml', '', "Error extracting index.xml from /vmfs/volumes/NFS01/ESXi650-202007001.zip: [Errno 2] No such file or directory: '/vmfs/volumes/NFS01/ESXi650-202007001.zip'"))
        url = zip:/vmfs/volumes/NFS01/ESXi650-202007001.zip?index.xml
 Please refer to the log file for more details.


Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
VMware-VMvisor-Installer-201908001-14320405.x86_64.iso

this iso.

Insert into CDROM boot and follow instructions.

does the file exist ?

ESXi650-202007001.zip
Thomas GrassiSystems Administrator

Author

Commented:
andrew
I forgot to mount the shared datastores on this host I just rebuilt it this AM

now getting this

[root@TGCSESXI-19:~] esxcli software profile update -p ESXi-6.5.0-2020007001-standard -d /vmfs/volumes/NFS01/ISO Images/Vmware/ESXi650-202007001.zip
Error: Invalid option Images/Vmware/ESXi650-202007001.zip

Usage: esxcli software profile update [cmd options]

Description:
  update                Updates the host with VIBs from an image profile in a depot. Installed VIBs may be upgraded (or downgraded if --allow-downgrades is specified), but they will not be removed. Any VIBs in the image profile which
                        are not related to any installed VIBs will be added to the host. WARNING: If your installation requires a reboot, you need to disable HA first.

Cmd options:
  --allow-downgrades    If this option is specified, then the VIBs from the image profile which update, downgrade, or are new to the host will be installed. If the option is not specified, then the VIBs which update or are new to the
                        host will be installed.
  -d|--depot=[ <str> ... ]
                        Specifies full remote URLs of the depot index.xml or server file path pointing to an offline bundle .zip file. (required)
  --dry-run             Performs a dry-run only. Report the VIB-level operations that would be performed, but do not change anything in the system.
  -f|--force            Bypasses checks for package dependencies, conflicts, obsolescence, and acceptance levels. Really not recommended unless you know what you are doing. Use of this option will result in a warning being displayed in
                        the vSphere Client.  Use this option only when instructed to do so by VMware Technical Support.
  --maintenance-mode    Pretends that maintenance mode is in effect. Otherwise, installation will stop for live installs that require maintenance mode. This flag has no effect for reboot required remediations.
  --no-live-install     Forces an install to /altbootbank even if the VIBs are eligible for live installation or removal. Will cause installation to be skipped on PXE-booted hosts.
  --no-sig-check        Bypasses acceptance level verification, including signing. Use of this option poses a large security risk and will result in a SECURITY ALERT warning being displayed in the vSphere Client.
  -p|--profile=<str>    Specifies the name of the image profile to update the host with. (required)
  --proxy=<str>         Specifies a proxy server to use for HTTP, FTP, and HTTPS connections. The format is proxy-url:port.
[root@TGCSESXI-19:~] esxcli software profile update -p ESXi-6.5.0-2020007001-standard -d /vmfs/volumes/NFS01/ISO-Images/Vmware/ESXi650-202007001.zip
 [NoMatchError]
 No image profile found with name 'ESXi-6.5.0-2020007001-standard'
         id = ESXi-6.5.0-2020007001-standard
 Please refer to the log file for more details.


Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
what are you trying to do...

1. update from iso.
2. update from internet.
3. update from patch
Thomas GrassiSystems Administrator

Author

Commented:
 ESXI host console I can get to the file[root@TGCSESXI-19:~] ls /vmfs/volumes/NFS01/ISO-Images/Vmware
ESXi650-202007001.iso                                           ESXi650-202007001.zip                                           vRealize-Operations-Manager-Appliance-7.5.0.13165949_OVF10.ova
[root@TGCSESXI-19:~]

Thomas GrassiSystems Administrator

Author

Commented:
trying to update from the datastore zip file
Thomas GrassiSystems Administrator

Author

Commented:
Had wrong syntex on command line

[root@TGCSESXI-19:~] esxcli software profile update -p ESXi-6.5.0-20200704001-standard -d /vmfs/volumes/NFS01/ISO-Images/Vmware/ESXi650-202007001.zip
 [InstallationError]
 ('VMware_bootbank_esx-tboot_6.5.0-3.138.16576891', 'Could not find a trusted signer.')
       vibs = VMware_bootbank_esx-tboot_6.5.0-3.138.16576891
 Please refer to the log file for more details.
[root@TGCSESXI-19:~]

getting further.
VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
Thomas GrassiSystems Administrator

Author

Commented:
found this

Download Product


Select Version6.5.0U3
Documentation
Release Date2019-10-24
TypeProduct Binaries


Will reinstall the host with this and see what happens be a few hours be back later with updates.
Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
But only use that if non-vendor server.
Thomas GrassiSystems Administrator

Author

Commented:
Andrew Good news

it worked with the latest version of the ISO for ESXI 6.5 U3

I also updated the host after the install and that worked as expected.


Andrew Hancock (VMware vExpert PRO / EE Fellow)VMware and Virtualization Consultant
CERTIFIED EXPERT
Fellow
Expert of the Year 2017

Commented:
great stuff
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.