Hi We are getting this error message after completing almost 99% of the restore. This is a vcloud director vm backup.
Kindly help us to figure the root cause and way to solve this..
Please find the errors found in job logs..
13064 5f8b 12/10 09:38:56 ###### CPipelayer::SendPipelineBuffer() - Tail has reported error [98][Services on the tail side of the SDT pipe are going down.]. Cannot continue.
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Error in flushing the current buffer.
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# FinishRestore: Restore completed. StopCode [0x1]-[Destroy recvd from client], StopCodeClnt [1]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: AppTy 106, Total AF 5, Seeks 11636/247967/247967, WrkItms 2975366, MxRdr (Bsy-Tot: 2-6, Pnd 0), MsgsRcvd 7795, QLen 0, LstMsg FSR_MSG_DESTROY
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [CtrlCh Idle Time] Exp Avg [2.73], Total Avg [2.73], Total Time [40.98], Total Count [15]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [Seek Time] Exp Avg [0.00], Total Avg [0.00], Total Time [23.98], Total Count [247967]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [AllocBuf Time] Exp Avg [0.01], Total Avg [0.00], Total Time [8847.32], Total Count [4958746]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [AllocBuf Speed] Curr Avg [9.30] MB/Sec, Bytes [4750817856]; Total Avg [35.01] MB/Sec, Bytes [324778028016]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [MediaRead Time] Exp Avg [0.00], Total Avg [0.00], Total Time [381.98], Total Count [4958746]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: [MediaRead Speed] Curr Avg [330.78] MB/Sec, Bytes [771158009]; Total Avg [381.35] MB/Sec, Bytes [152741332305]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Stats: Total links [0], Blks Size Avg/Total [0/0] bytes; TagData [4462763], TagDataSize [152214450410] bytes
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# SendCtrlBuf: Sending Ctrl Msg 0x14C
13064 5f8b 12/10 09:38:56 ###### SdtNetLink::recvMsgPacket() - Received SDT_LINK_FIN packet.
13064 5f8b 12/10 09:38:56 480256 Closing all sockets. RCId [6]
13064 5f8b 12/10 09:38:56 ###### SdtNetLink::recvMsgPacket() - The other side has closed the network connection gracefully
13064 5f8b 12/10 09:38:56 480256 SdtBase::setLastErr: Setting last err [92][The other side has closed the network connection gracefully] RCId [6]
13064 5f8b 12/10 09:38:56 ###### CPipelayer::SendPipelineBuffer() - Cannot peek for message. Error [92][The other side has closed the network connection gracefully]
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Error in flushing the current buffer.
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# SendCtrlBuf: Could not allocate pipeline buf
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Removing all SEEK msgs from queue. QLen = 0
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# Removed 0 SEEK msgs from queue. QLen = 0
13064 5f8b 12/10 09:38:56 ###### [FSRESTHEAD ] SCtrlSess::RelRef: Deleting CtrlSess obj [0x7f85c800eee0] as ref. count is 0. Listener [0], JobId [480256], SockFd: (32/-1)
13064 5f8b 12/10 09:38:56 480256 [FSRESTHEAD ] 13-# RelRef: Deleting restore head as ref. count is 0.
13064 5f8b 12/10 09:38:56 480256 SdtBase::relRef: Going to delete SdtBase as ref count is down to 0. RCId [6]
13064 5f8b 12/10 09:38:56 480256 SdtBase is being destroyed. RCId [6]
13064 5f8b 12/10 09:38:56 480256 Name [Head], Start Delay [31010.36 Secs], Avg [0.006254 Sec/Sample], Procsng Time [431.27 Secs], Avg [0.000087 Sec/Sample], Bytes [152940896606], Speed [338.20 MB/Sec], Samples [4958784] RCId [6]
13064 5f8b 12/10 09:38:56 480256 Name [Head CRC32], Start Delay [436.34 Secs], Avg [0.000088 Sec/Sample], Procsng Time [237.99 Secs], Avg [0.000048 Sec/Sample], Bytes [152940896606], Speed [612.86 MB/Sec], Samples [4958784] RCId [6]
13064 5f8b 12/10 09:38:56 480256 Name [Head Network], Start Delay [828381.12 Secs], Avg [0.167053 Sec/Sample], Procsng Time [9494.46 Secs], Avg [0.001915 Sec/Sample], Bytes [152940896606], Speed [15.36 MB/Sec], Samples [4958784] RCId [6]
