asked on

Windows Backup is failing to backup one VM; The writer experienced a non-transient error

I have Windows Hyper-V machine. Have three virtual instance installed in this physical host.

Using windows backup I am backing up full server to the USB 3.0 external drive.
This was working well a few days back.

Now one VM is not getting back-up when I am trying to backup in the online state causing the backup fail.

Please find the errors:

Status when backup is failing:

VSSadmin status at the VM which is failing before the start of the backup:

Microsoft Windows [Version 6.3.9600]
(c) 2013 Microsoft Corporation. All rights reserved.

C:\Windows\system32>vssadmin list writers
vssadmin 1.1 - Volume Shadow Copy Service administrative command-line
(C) Copyright 2001-2013 Microsoft Corp.

Waiting for responses.
These may be delayed if a shadow copy is being prepared.

Writer name: 'Task Scheduler Writer'
Writer Id: {d61d61c8-d73a-4eee-8cdd-f6f9786b7124}
Writer Instance Id: {1bddd48e-5052-49db-9b07-b96f96727e6b}
State: [1] Stable
Last error: No error

Writer name: 'VSS Metadata Store Writer'
Writer Id: {75dfb225-e2e4-4d39-9ac9-ffaff65ddf06}
Writer Instance Id: {088e7a7d-09a8-4cc6-a609-ad90e75ddc93}
State: [1] Stable
Last error: No error

Writer name: 'Performance Counters Writer'
Writer Id: {0bada1de-01a9-4625-8278-69e735f39dd2}
Writer Instance Id: {f0086dda-9efc-47c5-8eb6-a944c3d09381}
State: [1] Stable
Last error: No error

Writer name: 'System Writer'
Writer Id: {e8132975-6f93-4464-a53e-1050253ae220}
Writer Instance Id: {c816260c-df53-415e-afc3-445389cdc4c6}
State: [1] Stable
Last error: No error

Writer name: 'ASR Writer'
Writer Id: {be000cbe-11fe-4426-9c58-531aa6355fc4}
Writer Instance Id: {e45ae561-2f23-4acb-93aa-1662e5e5dd32}
State: [1] Stable
Last error: No error

Writer name: 'Registry Writer'
Writer Id: {afbab4a2-367d-4d15-a586-71dbb18f8485}
Writer Instance Id: {6a8a2437-7868-4e39-a6df-c4820c75719c}
State: [1] Stable
Last error: No error

Writer name: 'Microsoft Exchange Writer'
Writer Id: {76fe1ac4-15f7-4bcd-987e-8e1acb462fb7}
Writer Instance Id: {775f6408-e870-4e5e-810b-17ca157a9c9c}
State: [1] Stable
Last error: No error

Writer name: 'IIS Config Writer'
Writer Id: {2a40fd15-dfca-4aa8-a654-1f8c654603f6}
Writer Instance Id: {3dd7e1e9-50be-4cc6-8730-13ccaa4ba08c}
State: [1] Stable
Last error: No error

Writer name: 'Shadow Copy Optimization Writer'
Writer Id: {4dc3bdd4-ab48-4d07-adb0-3bee2926fd7f}
Writer Instance Id: {245ccecd-b493-4369-b417-c1e91b8948e6}
State: [1] Stable
Last error: No error

Writer name: 'COM+ REGDB Writer'
Writer Id: {542da469-d3e1-473c-9f4f-7847f01fc64f}
Writer Instance Id: {ca09e615-6c26-4df4-8af5-38b7c59b4cd3}
State: [1] Stable
Last error: No error

Writer name: 'MSMQ Writer (MSMQ)'
Writer Id: {7e47b561-971a-46e6-96b9-696eeaa53b2a}
Writer Instance Id: {ed260973-5fd7-4656-97b5-f7d9583ea752}
State: [1] Stable
Last error: No error

Writer name: 'BITS Writer'
Writer Id: {4969d978-be47-48b0-b100-f328f07ac1e0}
Writer Instance Id: {7da7b402-cef9-4ef3-95ad-ab34ec23c38b}
State: [1] Stable
Last error: No error

Writer name: 'IIS Metabase Writer'
Writer Id: {59b1f0cf-90ef-465f-9609-6ca8b2938366}
Writer Instance Id: {743b1baa-89ba-4915-99c2-82363dc59c27}
State: [1] Stable
Last error: No error

Writer name: 'WMI Writer'
Writer Id: {a6ad56c2-b509-4e6c-bb19-49d8f43532f0}
Writer Instance Id: {0904f3e8-e0d3-4fee-ade2-125f3fa442fd}
State: [1] Stable
Last error: No error

Backup failed screenshots:

VSSadmin status from inside the VM after the backup failed:

Microsoft Windows [Version 6.3.9600]
(c) 2013 Microsoft Corporation. All rights reserved.

C:\Windows\system32>vssadmin list writers
vssadmin 1.1 - Volume Shadow Copy Service administrative command-line t
(C) Copyright 2001-2013 Microsoft Corp.

Writer name: 'Task Scheduler Writer'
Writer Id: {d61d61c8-d73a-4eee-8cdd-f6f9786b7124}
Writer Instance Id: {1bddd48e-5052-49db-9b07-b96f96727e6b}
State: [1] Stable
Last error: No error

Writer name: 'VSS Metadata Store Writer'
Writer Id: {75dfb225-e2e4-4d39-9ac9-ffaff65ddf06}
Writer Instance Id: {088e7a7d-09a8-4cc6-a609-ad90e75ddc93}
State: [1] Stable
Last error: No error

Writer name: 'Performance Counters Writer'
Writer Id: {0bada1de-01a9-4625-8278-69e735f39dd2}
Writer Instance Id: {f0086dda-9efc-47c5-8eb6-a944c3d09381}
State: [1] Stable
Last error: No error

Writer name: 'System Writer'
Writer Id: {e8132975-6f93-4464-a53e-1050253ae220}
Writer Instance Id: {c816260c-df53-415e-afc3-445389cdc4c6}
State: [1] Stable
Last error: No error

Writer name: 'ASR Writer'
Writer Id: {be000cbe-11fe-4426-9c58-531aa6355fc4}
Writer Instance Id: {e45ae561-2f23-4acb-93aa-1662e5e5dd32}
State: [1] Stable
Last error: No error

Writer name: 'Microsoft Exchange Writer'
Writer Id: {76fe1ac4-15f7-4bcd-987e-8e1acb462fb7}
Writer Instance Id: {775f6408-e870-4e5e-810b-17ca157a9c9c}
State: [10] Failed
Last error: Timed out

Writer name: 'Shadow Copy Optimization Writer'
Writer Id: {4dc3bdd4-ab48-4d07-adb0-3bee2926fd7f}
Writer Instance Id: {245ccecd-b493-4369-b417-c1e91b8948e6}
State: [10] Failed
Last error: Timed out

Writer name: 'MSMQ Writer (MSMQ)'
Writer Id: {7e47b561-971a-46e6-96b9-696eeaa53b2a}
Writer Instance Id: {ed260973-5fd7-4656-97b5-f7d9583ea752}
State: [10] Failed
Last error: Timed out

Writer name: 'BITS Writer'
Writer Id: {4969d978-be47-48b0-b100-f328f07ac1e0}
Writer Instance Id: {7da7b402-cef9-4ef3-95ad-ab34ec23c38b}
State: [1] Stable
Last error: No error

Writer name: 'COM+ REGDB Writer'
Writer Id: {542da469-d3e1-473c-9f4f-7847f01fc64f}
Writer Instance Id: {ca09e615-6c26-4df4-8af5-38b7c59b4cd3}
State: [10] Failed
Last error: Timed out

Writer name: 'Registry Writer'
Writer Id: {afbab4a2-367d-4d15-a586-71dbb18f8485}
Writer Instance Id: {6a8a2437-7868-4e39-a6df-c4820c75719c}
State: [1] Stable
Last error: No error

Writer name: 'WMI Writer'
Writer Id: {a6ad56c2-b509-4e6c-bb19-49d8f43532f0}
Writer Instance Id: {0904f3e8-e0d3-4fee-ade2-125f3fa442fd}
State: [10] Failed
Last error: Timed out

Writer name: 'IIS Metabase Writer'
Writer Id: {59b1f0cf-90ef-465f-9609-6ca8b2938366}
Writer Instance Id: {743b1baa-89ba-4915-99c2-82363dc59c27}
State: [10] Failed
Last error: Timed out

Writer name: 'IIS Config Writer'
Writer Id: {2a40fd15-dfca-4aa8-a654-1f8c654603f6}
Writer Instance Id: {3dd7e1e9-50be-4cc6-8730-13ccaa4ba08c}
State: [10] Failed
Last error: Timed out

C:\Windows\system32>

Successful backup when VM were offline:

At the host vssadmin status before the backup starts:

C:\Users\Administrator>vssadmin list writers
vssadmin 1.1 - Volume Shadow Copy Service administrative command-line too
(C) Copyright 2001-2013 Microsoft Corp.

Writer name: 'Task Scheduler Writer'
Writer Id: {d61d61c8-d73a-4eee-8cdd-f6f9786b7124}
Writer Instance Id: {1bddd48e-5052-49db-9b07-b96f96727e6b}
State: [1] Stable
Last error: No error

Writer name: 'VSS Metadata Store Writer'
Writer Id: {75dfb225-e2e4-4d39-9ac9-ffaff65ddf06}
Writer Instance Id: {088e7a7d-09a8-4cc6-a609-ad90e75ddc93}
State: [1] Stable
Last error: No error

Writer name: 'Performance Counters Writer'
Writer Id: {0bada1de-01a9-4625-8278-69e735f39dd2}
Writer Instance Id: {f0086dda-9efc-47c5-8eb6-a944c3d09381}
State: [1] Stable
Last error: No error

Writer name: 'ASR Writer'
Writer Id: {be000cbe-11fe-4426-9c58-531aa6355fc4}
Writer Instance Id: {791f4daa-ee20-42fd-8c01-15f4a0b44bc5}
State: [1] Stable
Last error: No error

Writer name: 'System Writer'
Writer Id: {e8132975-6f93-4464-a53e-1050253ae220}
Writer Instance Id: {69024309-bf78-427a-a5ff-b91a26e3c863}
State: [1] Stable
Last error: No error

Writer name: 'Microsoft Hyper-V VSS Writer'
Writer Id: {66841cd4-6ded-4f4b-8f17-fd23f8ddc3de}
Writer Instance Id: {94acbb56-f49b-4e06-a6f3-2f86dc4dfeb6}
State: [1] Stable
Last error: No error

Writer name: 'BITS Writer'
Writer Id: {4969d978-be47-48b0-b100-f328f07ac1e0}
Writer Instance Id: {5de8d052-1d2c-49cd-a7d7-73368e931c33}
State: [1] Stable
Last error: No error

Writer name: 'Shadow Copy Optimization Writer'
Writer Id: {4dc3bdd4-ab48-4d07-adb0-3bee2926fd7f}
Writer Instance Id: {3f78f981-6bbe-4187-8d41-7e3272f6618c}
State: [1] Stable
Last error: No error

Writer name: 'Registry Writer'
Writer Id: {afbab4a2-367d-4d15-a586-71dbb18f8485}
Writer Instance Id: {2f5e2ce9-1632-43f4-8ad8-0c5cfd33f7ca}
State: [1] Stable
Last error: No error

Writer name: 'WMI Writer'
Writer Id: {a6ad56c2-b509-4e6c-bb19-49d8f43532f0}
Writer Instance Id: {013b0657-11e8-4754-9534-2f247f357a04}
State: [1] Stable
Last error: No error

Writer name: 'COM+ REGDB Writer'
Writer Id: {542da469-d3e1-473c-9f4f-7847f01fc64f}
Writer Instance Id: {b30d4448-d41f-4970-8bc9-d4ca78e26141}
State: [1] Stable
Last error: No error

I have done chkdsk inside the VM & host.
DId SFC /scannow
Restarted all the instances & host.

Run the attached script as per https://www.experts-exchange.com/questions/28930911/Backup-is-failing-at-Hyper-V-windows-2012-R2-machine-Backup-is-failing-for-one-VM-out-of-four.html
backup-fix-script.txt
backup-fix-script-result.txt

Akash Bansal

ASKER

Writer Failures
Writer Id: {66841CD4-6DED-4F4B-8F17-FD23F8DDC3DE}
Instance Id: {94ACBB56-F49B-4E06-A6F3-2F86DC4DFEB6}
Writer Name: Microsoft Hyper-V VSS Writer
Writer State: 5
Failure Result: 80042336
Application Result: 80004005
Application Message: (null)
Component: C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0
Logical Path: (null)
Component Result: 800423F4
Component Message:
File Spec: C:\AnandVmail\Hyper-V\Virtual Machines\\C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0.xml Recursive: 0
File Spec: C:\AnandVmail\Hyper-V\Virtual Hard Disks\\AnandVmail.vhdx Recursive: 0
File Spec: C:\AnandVmail\Hyper-V\ChkPoint\Snapshots\0CF221CB-7F9D-49F4-B57C-FB4B9981FBB1.xml Recursive: 0
File Spec: C:\AnandVmail\Hyper-V\Virtual Hard Disks\AnandVmail-AutoRecovery.avhdx Recursive: 0
*-----------------------------*

Application backup
Writer Id: {66841CD4-6DED-4F4B-8F17-FD23F8DDC3DE}
Component: C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0
Caption : Online\AnandVMail
Logical Path:
Error : 80780175
Error Message : Component was skipped from volume shadow copy.

Detailed Error : 800423F4
Detailed Error Message : The writer experienced a non-transient error. If the backup process is retried,
the error is likely to reoccur.

*-----------------------------*

Backup of volume \\?\GLOBALROOT\Device\HarddiskVolume2\ succeeded.

Backup of volume C: succeeded.

Backup of volume \\?\Volume{6c973c9a-1a2d-4c49-838e-8c852a7e0614}\ succeeded.

Application backup
Writer Id: {66841CD4-6DED-4F4B-8F17-FD23F8DDC3DE}
Component: 0C69D790-B3ED-435D-BF41-B23DF356430C
Caption : Online\AnandVDC
Logical Path:

Writer Id: {66841CD4-6DED-4F4B-8F17-FD23F8DDC3DE}
Component: FAA54CA7-84C4-48A6-8D62-C5FB058CACC1
Caption : Offline\AnandWin2008
Logical Path:

Writer Id: {66841CD4-6DED-4F4B-8F17-FD23F8DDC3DE}
Component: Host Component
Caption : Host Component
Logical Path:

Akash Bansal

ASKER

As per http://backupchain.com/en/vssdiag/ diagnostic tool, the result:

Checkpoint operation for 'AnandVMail' failed. (Virtual machine ID C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0)

<Event xmlns='http://schemas.microsoft.com/win/2004/08/events/event'><System><Provider Name='Microsoft-Windows-Hyper-V-VMMS' Guid='{6066F867-7CA1-4418-85FD-36E3F9C0600C}'/><EventID>18012</EventID><Version>0</Version><Level>2</Level><Task>0</Task><Opcode>0</Opcode><Keywords>0x8000000000000000</Keywords><TimeCreated SystemTime='2016-11-27T14:46:00.629213900Z'/><EventRecordID>1409</EventRecordID><Correlation/><Execution ProcessID='4528' ThreadID='2920'/><Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel><Computer>AnandHost</Computer><Security UserID='S-1-5-18'/></System><UserData><VmlEventLog xmlns:auto-ns2='http://schemas.microsoft.com/win/2004/08/events' xmlns='http://www.microsoft.com/Windows/Virtualization/Events'><VmName>AnandVMail</VmName><VmId>C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0</VmId></VmlEventLog></UserData></Event>

<Event xmlns='http://schemas.microsoft.com/win/2004/08/events/event'><System><Provider Name='Microsoft-Windows-Hyper-V-VMMS' Guid='{6066F867-7CA1-4418-85FD-36E3F9C0600C}'/><EventID>10150</EventID><Version>0</Version><Level>2</Level><Task>0</Task><Opcode>0</Opcode><Keywords>0x8000000000000000</Keywords><TimeCreated SystemTime='2016-11-27T14:46:00.629213900Z'/><EventRecordID>1410</EventRecordID><Correlation/><Execution ProcessID='4528' ThreadID='2060'/><Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel><Computer>AnandHost</Computer><Security UserID='S-1-5-18'/></System><UserData><VmlEventLog xmlns:auto-ns2='http://schemas.microsoft.com/win/2004/08/events' xmlns='http://www.microsoft.com/Windows/Virtualization/Events'><VmName>AnandVMail</VmName><VmId>C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0</VmId><Parameter0>%%2147942480</Parameter0><Parameter1>0x80070050</Parameter1></VmlEventLog></UserData></Event>

<Event xmlns='http://schemas.microsoft.com/win/2004/08/events/event'><System><Provider Name='Microsoft-Windows-Hyper-V-VMMS' Guid='{6066F867-7CA1-4418-85FD-36E3F9C0600C}'/><EventID>10172</EventID><Version>0</Version><Level>2</Level><Task>0</Task><Opcode>0</Opcode><Keywords>0x8000000000000000</Keywords><TimeCreated SystemTime='2016-11-27T14:48:00.693856600Z'/><EventRecordID>1411</EventRecordID><Correlation/><Execution ProcessID='4528' ThreadID='2272'/><Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel><Computer>AnandHost</Computer><Security UserID='S-1-5-18'/></System><UserData><VmlEventLog xmlns:auto-ns2='http://schemas.microsoft.com/win/2004/08/events' xmlns='http://www.microsoft.com/Windows/Virtualization/Events'><VmName>AnandVMail</VmName><VmId>C7B3B885-A7D6-46BC-8BB5-8F3E20FCD1C0</VmId><ErrorMessage>%%2147754753</ErrorMessage><ErrorCode>0x80042301</ErrorCode></VmlEventLog></UserData></Event>

<Event xmlns='http://schemas.microsoft.com/win/2004/08/events/event'><System><Provider Name='Microsoft-Windows-Hyper-V-VMMS' Guid='{6066F867-7CA1-4418-85FD-36E3F9C0600C}'/><EventID>16010</EventID><Version>0</Version><Level>2</Level><Task>0</Task><Opcode>0</Opcode><Keywords>0x8000000000000000</Keywords><TimeCreated SystemTime='2016-11-27T14:48:00.708852200Z'/><EventRecordID>1412</EventRecordID><Correlation/><Execution ProcessID='4528' ThreadID='2272'/><Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel><Computer>AnandHost</Computer><Security UserID='S-1-5-18'/></System><UserData><VmlEventLog xmlns:auto-ns2='http://schemas.microsoft.com/win/2004/08/events' xmlns='http://www.microsoft.com/Windows/Virtualization/Events'><Parameter0>AnandVMail</Parameter0></VmlEventLog></UserData></Event>

ASKER CERTIFIED SOLUTION

Akash Bansal

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

Akash Bansal

ASKER

Update: The backup was successful after we manually created a checkpoint for the VM for which the backup was failing. After a successful backup I deleted the checkpoint & to my surprise the backup was successful again.

I could not understand the logic behind it but the issue got resolved.