Hi All,
We have a VM of 1.5TB, iDA: Virtual Server, Vendor: VMware.
While we are restoring the VM with out of place to same destination as source, we are getting low throughput i.e., ~29GB/hr where our network is 10GB/s.
This VM is a Windows 2019 machine with latest VMware Tools installed and we have a VSA in same cluster of VM & a physical Linux server as a Media Agent in the same LAN.
While backup, it was taking HotAdd mode and the throughput was 137GB/hr and elapsed time was about 6hrs for backup, but for restoring it taking NBD mode and throughput is too low & time taking restore was more than 24hrs.
Can someone please let me know, is this restore was slow because the speed of writes on the datastores & disks was low? and also no.of files can affect the speed?
If yes, how can we increase the speed of this restore?
If not, how can we find the cause of the slowness, any logs to check or any tool to use like CvDiskPerf tool or CvNetworkTestTool?
Is there any additional setting that can help me to do faster restore?
Below are my findings as per my knowledge,
Job log:
10460 554 07/07 20:11:49 4682894 VSRstWorker::UpdateRestoreProgress() - VM Test_VMRestore] Restored 694488 of 757508 extents 91%
10460 554 07/07 20:10:13 4682894 stat- ID awritedisk - Test_RS_2_4.vmdk], Bytes 497151901696], Time ,51718.153326] Sec(s), Average Speed 9.167400] MB/Sec
10460 554 07/07 20:10:45 4682894 stat- ID treadmedia], Bytes ,722762550223], Time ]18309.236606] Sec(s), Average Speed e37.646577] MB/Sec
10460 554 07/07 20:10:45 4682894 stat- ID sDatastore Write /VxRail-Datastore01]], Bytes ]727869030400], Time 082336.959808] Sec(s), Average Speed g8.430600] MB/Sec
CVD.log of Media Agent:
2593503 b8cb7 07/06 21:37:34 4682894 3FSRESTHEAD ] 1668180256-# SendCtrlBuf: Sending Ctrl Msg 0x14C
2593503 b8cb8 07/06 21:45:44 4682894 :FSRESTHEAD ] 1668180256-# Stats: AppTy 106, AF 6, Seeks 3536/3553/68983, WrkItms 56952, MxRdr (Bsy-Tot: 1-3, Pnd 0), MsgsRcvd 2185, QLen 2046, LstMsg CLOSE_ARCHIVE
2593503 b8cb8 07/06 21:45:44 4682894 5FSRESTHEAD ] 1668180256-# Stats: 2AllocBuf Time] Exp Avg i0.00], Total Avg ]0.02], Total Time ,1640.94], Total Count 96120]
2593503 b8cb8 07/06 21:45:44 4682894 4FSRESTHEAD ] 1668180256-# Stats: 0AllocBuf Speed] Curr Avg e5.02] MB/Sec, Bytes M3163522296]; Total Avg 63.66] MB/Sec, Bytes M6295475520]
2593503 b8cb8 07/06 21:45:44 4682894 :FSRESTHEAD ] 1668180256-# Stats: 8MediaRead Time] Exp Avg 0.00], Total Avg 00.00], Total Time 03.20], Total Count ]96120]
2593503 b8cb8 07/06 21:45:44 4682894 1FSRESTHEAD ] 1668180256-# Stats: 1MediaRead Speed] Curr Avg S731.07] MB/Sec, Bytes ]940240258]; Total Avg 2581.90] MB/Sec, Bytes ]1952738661]
Thanks in advance.
Warm Regards,
Sravan Kondeti
