CommserveDR failed to gather log files error 35:284

Hi @FrozBoz 

Thank you for the question and welcome to the Community!

Please would you confirm the version your Commserve is running and if possible any error messages being seen in CommserveDR.log?

Thanks,

Stuart

Hi @Stuart Painter ,

we are running Simpana 11 SP 19.23

It appears to be an old legacy server SCCBKP02 but I cannot find an association with the commserveDR Job.

What is the best way to remove it from the DR job?

See the log extract below.

Thanks for the reply  James

5340  1aec  01/15 17:00:43 600318 EvLogs::send() - Gathering log files...

5340  1aec  01/15 17:00:43 600318 Thread pool monitor interval [300] seconds, Refresh interval [60] seconds

5340  e38   01/15 17:00:43 600318 ERROR: CvFwClient::connect(): Unable to resolve remote host sccbkp02.shellharbour.nsw.gov.au to any IP family: 0x80072AF9:{CQiIPAddr::GetAllByName(216)/W32.11001.(No such host is known. (11001))}

5340  e38   01/15 17:00:46 600318 ERROR: CvFwClient::connect(): Failed to find tunnel for dcsvcvcsv=>sccbkp02:8400/8400

5340  e38   01/15 17:00:46 600318 AttemptSessionAttach() - attach failed with Error [0xE8090010:{CCvNetwork::Attach_RemoteDLL(1420)} + {CCvNetwork::Attach_RemotePort(1294)} + {CCvNetwork::GetConnection(3130)} + {CSessionConnectionSocket::GetConnection(189)/EventMessage.0x09000010.9:16.(Remote machine [sccbkp02.shellharbour.nsw.gov.au]. The socket connect failed. Error returned [-1=Failed to find tunnel for dcsvcvcsv=>sccbkp02:8400/8400]. Check Network Connectivity.)}] srcClientId=[179]

5340  e38   01/15 17:00:46 600318 ::getRemoteLogs() - AttemptSessionAttach failed for clientId[179], netHostName[sccbkp02.shellharbour.nsw.gov.au]

5340  e38   01/15 17:00:46 600318 EvLogs::collectLogsForClients() - gatherLogs for remote machine [sccbkp02.shellharbour.nsw.gov.au] failed

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-Hyper-V-VMMS-Admin], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-Hyper-V-VMMS-Networking], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-Hyper-V-VMMS-Operational], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-Hyper-V-VMMS-Storage], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-Hyper-V-Worker-Admin], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-VHDMP/Operational], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 getWindowsEventLogs() - Error getting windows event logs for [Microsoft-Windows-FailoverClustering-Manager/Admin], Error [The specified channel could not be found. Check channel configuration]

5340  bc4   01/15 17:00:50 600318 EvLogs::collectLogsForClients() - Failed to gather Hyper V event logs logs for [dcsvcvcsv].

5340  bc4   01/15 17:00:50 600318 Win7ZWrapper::compress() - Connecting to host (dcsvcvcsv.shellharbour.nsw.gov.au*dcsvcvcsv*8400) with timeout seconds:(300)

5340  bc4   01/15 17:00:50 600318 Win7ZWrapper::compress() - Waiting for compression status response from host (dcsvcvcsv.shellharbour.nsw.gov.au*dcsvcvcsv*8400) with timeout seconds:(7200)

5340  bc4   01/15 17:00:50 600318 Win7ZWrapper::compress() - Process executed with return code : [0], output:[Scanning the drive:

3 files, 194761 bytes (191 KiB)

@FrozBoz , to confirm, is 600318 the CommserveDR backup job?

You’re getting resolution errors here:

5340  e38   01/15 17:00:43 600318 ERROR: CvFwClient::connect(): Unable to resolve remote host sccbkp02.shellharbour.nsw.gov.au to any IP family: 0x80072AF9:{CQiIPAddr::GetAllByName(216)/W32.11001.(No such host is known. (11001))}

What is/was sccbkp02?  Was that an old Media Agent or Commserve?  Check the DR settings in Control Panel and see if you’re sending the job to a network share (perhaps that legacy server).  then check the DR Storage Policy and see what library it is using (or if there are multiple data paths).

Another consideration is the hostname in the configuration of the servers involved, though I would expect more failures if that was the case.

One more question: how long has this been failing?  Were CS DR jobs running just fine until recently?  My concern is that you may not have a recent valid backup.

Thanks Mike,

SCCBKP02 was an old media agent .

The DR is set to a network share on one of our remote servers not SCCBKP02.

The error started awhile ago, checked the DR config is using the correct storage path

The server sccbkp01 does not exist in the current VM server and has been decommissioned a while ago.

still looking for references for SCCBKP02 in the system. This extract below is from the daiyl commvault report.

cheers and thanks James

Hi @FrozBoz 

Do by any chance use a proxy client for uploading send logs files jobs?

To clarify, in Control Panel, please would you check: Internet Options: Internet Gateway: Use client | Enable for Send Log File: [client_name].

I would like to know if your client sccbkp02 is configured as the send log files proxy client and if so, please try changing to another valid client - or removing this setting if it’s not required.

I’m tracking another issue internally that has some similarities with the experience you are describing.

Thanks,

Stuart

Hi Stuart,

 can see no gateway enabled.

cheers

Hi @FrozBoz 

Please would you double check the options selected in Control Panel > DR Backup and ensure the sccbkp02 isn’t mentioned anywhere.

If everything appears as it should, the next step is raise a support case so that we can check why your DR backups are reporting these errors. As @Mike Struening mentions, it’s essential you have good DR backups for Commserve database as this will be critical in any disaster situation if the Commseve is also affected.

If you do raise a support case, please do PM me the case number so that I can track internally.

Thanks,

Stuart

Hi Stuart, basically identical and no mention of sccbkp02

cheers James

Hi @FrozBoz 

Ok, so the next step is review a full Commserve log set and stage the database to investigate further.

At that point, I would like to suggest to raise a support ticket , but I would like track progress of the case internally.

Thanks,

Stuart

Hi Stuart,

Incident Update: 210726-97 | The error is CommserveDR failed to gather log files error :35:284

still in progress cheers James

Thanks!  Looks like you’ve been making progress, though I’ll wait until the resolution is confirmed before posting anything.

Hey @FrozBoz , I see that the issue was replicated in our staging environment:

I have addressed it on the stage environment by fully deleting the already decomissioned MA

Were you able to perform and confirm the same?

You as well!!!