cvd logs attached 

Hi @Allan0105 

Does the job report any job pending reason in the job controller ?

Could you attach SF.log & SFEngine.log and the job ID’s.

Regards,

Gowri Shankar

logs from MA 

Hi Gowri, 

Appreciate your response! 

sure. attached sf and sfengine logs. job id#19409830

The backup is failing with following error -

sf.log

32726 7fd6 04/05 08:42:23 19409803 CVDC_SalesForce::CBackup::OnComplete(2457) - Backup failed for Phase; Not adding JobManager refTime
32726 7fd6 04/05 08:42:23 19409803 DistributedIDA::CMaster::handleEventError(1119) - 0x8007065B:{DistributedIDA::CMaster::initialize(475)} + {CVDC_SalesForce::CBackup::initialize(987)/W32.1627.(Function failed during execution. (ERROR_FUNCTION_FAILED.1627))-Java Engine init response indicated major error -3110|Failed to send request to https://cookmedical--uat.my.salesforce.com/services/Soap/u/53.0 UnknownHostException: cookmedical--uat.my.salesforce.com}
32726 7fd6 04/05 08:42:23 19409803 DistributedIDA::CMaster::endPhaseTasks(3962) - Make sure all streams are released now.
32726 7fd6 04/05 08:42:23 19409803 DistributedIDA::CMaster::endPhaseTasks(3984) - m_jsStatus:2 m_jsStatusFor:1 m_jsPendingCause:4
32726 7fd6 04/05 08:42:23 19409803 BKP CALLED COMPLETE (PHASE Status::FAIL), 19409803. Token n19409803:4:2:0:0:8497]

To resolve this issue, please follow the KB → https://kb.commvault.com/article/54770

Let me know in case of any other questions.

Regards,

Gowri Shankar 

Thanks Gowri, let me check on it and update! 

Hi Gowri, 

nslookup went fine but still backup is getting failed. 

this is were it is getting failed. any help will be appreciated. 

31252 7bcd 04/13 11:30:09 19500925 DistributedIDA::CMaster::checkAdditionalStreams(1287) - for type 1 required streams:2 tasks:2 streams available:2
31252 7a14 04/13 11:30:29 19500925 ERROR: CvFwClient::connect(): Connect to 10.0.0.24:62523 failed: Connection timed out
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::CMaster::StreamComplete(3070) - msg.RCID:45045124 stream.RCID:45045124 status:FAILED_REUSABLE
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::ICoordinator::updateNodeWithStream(481) - will update node css-dprapp1-p1 counters accourding to new state 5
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::CMaster::markStreamFailureAndTasksAccordingly(3292) - Total 1 streams have failed on node fcss-dprapp1-p1]
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::ICoordinator::updateNodeWithStream(465) - called with empty node name for stream RCID:45045124 new state 0
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::CMaster::StreamComplete(3098) - controller requested to close the reservation
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::CMaster::releaseStreamReservation(3771) - release stream 45045124
31252 7a14 04/13 11:33:23 19500925 JM Client  Freeing rcid 45045124]
31252 7a14 04/13 11:33:23 19500925 DistributedIDA::ICoordinator::updateNodeWithStream(481) - will update node css-dprapp1-p1 counters accourding to new state 6
31252 7bcc 04/13 11:34:23 19500925 DistributedIDA::CCoordinatorReportsPrivate::printReport(388) -
REPORT:--- Progress Report ----------------------------------------------------------------------------------------
REPORT:                            |Status  |Rst| Objects | Success | Failed  | Skipped | Data GB |  GB/h
REPORT:  Node:css-dprapp1-p1       |Running |  0|         |         |         |         |         |
REPORT:Stream:4 RcID:45045124      |Failed  |  0|         |         |         |         |         |
REPORT: Stream:45045124|Running:0 Failed:0 Complete:0
REPORT:-----------------------------------------------------------------------------------------------------------
REPORT:                            |TOTAL   |  0|         |         |         |         |         |
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::CMaster::StreamComplete(3070) - msg.RCID:45045125 stream.RCID:45045124 status:FAILED_REUSABLE
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::CMaster::StreamComplete(3070) - msg.RCID:45045125 stream.RCID:45045125 status:FAILED_REUSABLE
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::ICoordinator::updateNodeWithStream(481) - will update node css-dprapp1-p1 counters accourding to new state 5
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::CMaster::markStreamFailureAndTasksAccordingly(3292) - Total 2 streams have failed on node :css-dprapp1-p1]
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::ICoordinator::updateNodeWithStream(465) - called with empty node name for stream RCID:45045125 new state 0
31252 7a14 04/13 11:35:31 19500925 DistributedIDA::CMaster::StreamComplete(3098) - controller requested to close the reservation
31252 7bcd 04/13 11:36:09 19500925 ERROR: CvFwClient::connect(): Connect to 10.0.0.24:62523 timed-out.
31252 7bcd 04/13 11:36:09 19500925 DistributedIDA::CMaster::checkAdditionalStreams(1287) - for type 1 required streams:2 tasks:2 streams available:2
31252 7bcc 04/13 11:39:31 19500925 DistributedIDA::CCoordinatorReportsPrivate::printReport(388) -

Hi @Allan0105

CvFwClient::connect(): Connect to 10.0.0.24:62523 timed-out. 

Does this ip belongs to a Media agent or a CS ? 

You may have to configure commvault network route.

Please open a support incident and one of us could assist with it.

Regards,

Gowri Shankar

Thanks Gowri for the update. it is for CS. we opened the port 62523 for it and it was working fine. backup are running. i thought to add a network route to add 8403 as a port to use but as network team agreed to open 62523 which made the job easier but i was wondering why this port was used ? but all good now. 

Really appreciate your help. 

Thank you for the update.

Glad to know that the backup is working now.

By default tunnel port is CVD+3. Also check the port requirements 

https://documentation.commvault.com/2022e/essential/7102_port_requirements_for_commvault.html

Addition info → https://documentation.commvault.com/2022e/expert/7200_updating_incoming_ports_on_client_computers.html

You can change the default incoming port that receives tunnel connections from the client. The default tunnel port is the Commvault Communications (CVD) service port plus 3 (for example, 8403).

Procedure

1. From the CommCell Browser, expand Client Computers, right-click the client computer, and then click Properties.

   The Client Computer Properties dialog box appears.

2. Click Network.

   The Network Properties for Client dialog box appears.

3. On the Network Route Configuration tab, select the Configure Network Route Settings check box.

4. On the Incoming Ports tab, select the Override default tunnel port check box, enter the port number for incoming tunnel connections, and then click OK.

   The default tunnel port is the Commvault Communications (CVD) service port plus 3 (for example, 8403).

5. In the CommCell Browser, right-click the client computer, and then click All Tasks > Push Network Configuration.

6. Read the warning, click Continue, and then click OK.

7. Verify that your network configuration was pushed successfully by checking the Event Viewer window.

   Note: You can also repeat the same steps on a client group if you want to change the tunnel port at the client group level.

Regards,

Gowri Shankar

Thanks Again i was reading the same document. will configure the same.