Solved

Exchange online backup fails. possible Corrupt index?


Badge +1

Hello,

 

I have a problem with our exchange online backup.  

When i start a new backup job, the job get an error:

Error Code: [82:229]
Description: The job is pending because: The remote end hi-back-ms02 has closed network connection unexpectedly
Source: hi-back-ma06, Process: cvd

 

This job is still running, but the streams stops one by one with error: 

Agent [hi-back-ms01_Remote4] ended prematurely due to [].

 

Some relevant parts from the job log:

5300  4760  05/07 14:08:25 1679359 Servant    Remote Stream Allocation request for [14] streams of type [1] received. Request Identifier [Global\1679359_3048_1715083746_WAIT$Global\1679359_3048_1715102172_SHM]. Client [hi-back-ms01]
5300  2fec  05/07 14:08:37 1679359 Resource Alloc Obj Sending resource allocation response. Successfully allocated [14] of [14] streams. Request Identifier [Global\1679359_3048_1715083746_WAIT$Global\1679359_3048_1715102172_SHM].
5300  24c0  05/07 14:09:04 1679359 Scheduler  Set pending cause [The job is pending because: The remote end hi-back-ms02 has closed network connection unexpectedly]::Client [hi-back-ma06] Application [cvd] Message Id [1375731870] Error code [82:158] RCID [0] ReservationId [0].  Level [0] flags [0] id [0] overwrite [0] append [0] CustId[1375731941].
5300  3ce4  05/07 14:09:04 1679359 Servant    Remote free streams request received for rcid [6980419]
5300  42a8  05/07 14:09:14 1679359 Scheduler  Ignored pending cause [The job is pending because: The remote end hi-back-ms01 has closed network connection unexpectedly]::Client [hi-back-ma06] Application [cvd] Message Id [1375731870] RCID [0] Reservation Id [0].  Level [0] flags [0] id [0] overwrite [0] append [0] CustId[1375731941].
5300  4a3c  05/07 14:09:14 1679359 Servant    Remote free streams request received for rcid [6980428]

 

96345 18658 05/07 14:09:04 1679359 SdtBase::setLastErr: Setting last err [93][The remote end hi-back-ms02 has closed network connection unexpectedly] RCId [6980419]
96345 18658 05/07 14:09:04 1679359 SdtTail::onIncomingData: Client [SDTPipe_hi-back-ms02_hi-back-ma06_1679359_1715083726_14776_10452_0000019A73FAD010]. Id [90]. Cannot recv message from the tail. Error [The remote end hi-back-ms02 has closed network connection unexpectedly][93] RCId [6980419]
96345 564f3 05/07 14:09:04 1679359 SdtTailSrv::DropClientWorker: Removing Client [SDTPipe_hi-back-ms02_hi-back-ma06_1679359_1715083726_14776_10452_0000019A73FAD010], Id [90] from the list. RCId [6980419]
96345 564f3 05/07 14:09:04 1679359 SdtTailSrv::DropClientWorker: Size of selected list [2] RCId [6980419]
96345 564f3 05/07 14:09:04 1679359 SdtTailSrv::DropClientWorker: Not draining away incoming data because the socket was closed. Graceful [0] RCId [6980419]
96345 564f3 05/07 14:09:04 1679359 [DSBACKUP   ] 6980419-5936161 CVMABackup object destroyed..

 

6792  1838  05/07 14:08:58 1679359 Corrupt data file, Failed to get marker 0x02 at location 70
6792  1838  05/07 14:08:58 1679359 Corrupt data file, Failed to get marker 0x02 at location 70
6792  1838  05/07 14:08:58 1679359 Corrupt data file, Failed to get marker 0x02 at location 70
6792  1838  05/07 14:08:58 1679359 Corrupt data file, Failed to get marker 0x02 at location 70
6792  1838  05/07 14:08:58 1679359 unhandled conversion case in fetchPropertyValue(): 0xa000d00
6792  1838  05/07 14:08:58 1679359 Failed to capture metedata for data file [C]

6792  6     05/07 14:08:58 1679359 ### myDelegate - Mailbox: [xx@xx.no], potentially problematic email. Details: File path [C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\2\1679359\28CA6C19X19B7X431AX85B3X29384F8AC388\3_6_6792], itemid [AAMkADQzN2M1YjM2LWI5ZjMtNDY2NC1hNzgzLWRjZTliMDI5YTA2ZgBGAAAAAADX0SMRKm7LT4finj3QYrIoBwBtIwDhJJl0Sajxri+BZ4ZmAAAAAAEMAADi+8Qv8d9BSrjUmYnInRZ9AAB/+AURAAA=]
6792  6     05/07 14:08:58 1679359 ### myDelegate - This item will be skipped from backup, remove the item from this mailbox using the itemid.

 

I have been searching for a solution, and found this post: 

https://kb.commvault.com/article/53856 

I guess this might be related to the same problem as i got, but this article describes …\ContentStore\iDataAgent\jobResults\CV_CLDB. and that is not the correct folder for Exchange online index? 

 

What is the best solution for this problem?   Should i restore the Index as described in this article:

https://documentation.commvault.com/11.24/expert/restoring_index_server_to_same_location.html

Or is there a better way to resolve this? 

 

Best regards,

Magnus Frøyseth

 

icon

Best answer by Mike H 7 May 2024, 21:00

View original

4 replies

Userlevel 3
Badge +6

Hi Magnus,

What version of CV are you running?

 

This issue should be resolved in the latest available MR for 11.28, 11.32, and 11.34.

Badge +1

Hello Mike,   

I am running version 11.32.45 at the moment.   But i can try to upgrade to 11.32.49 to see if that resolves the problem. 

I can give an update after the update, if the problem is resolved or not. 

 

Regards,

Magnus Frøyseth

Badge +1

Hello,

I have upgraded to version 11.32.49, and after the upgrade, the Exchange Online backup completed with no errors.   Thank you so much for the help. 

 

Best regards,

 

Magnus Frøyseth

Badge

Same here, upgraded to 11.32.49 (from 11.32.45) and seems to work fine. 

Reply