Skip to main content
Question

Restoring DB taking way to long


Forum|alt.badge.img+14

Hello,

 

I have some issue with restoring of 4TB from one client to another. It's taking about 9hrs to restore database from one client to another compare of 2 hrs of local restore.

The backup of database using 10 streams so 10 streams will be used for the restore. The source and destination clients are on the same vcenter.

 

Where should i take a look to find the issue of the restore ? 

10 replies

Forum|alt.badge.img+7
  • Vaulter
  • 86 replies
  • December 3, 2024

Hi ​@Egor Skepko,

Good day.

Will you please check the CVPERFMGR log from the MA to understand in which layer (Read from the library\Network between MA and the destination client\Write to the destination client) there is a slowness?

Regards,

Wasim


Forum|alt.badge.img+14
  • Author
  • Byte
  • 164 replies
  • December 3, 2024

@Wasim This wil be hard to see because the restore job to old to check. I can only see the logs of the job. This is from the job logs. 

 

11844 20a0  10/08 18:33:00 5117611 stat- ID [SQL Data Write Timer], Bytes [274802909184], Time [292.835241] Sec(s), Average Speed [894.948559] MB/Sec
11844 2ff0  10/08 18:33:00 5117611 stat- ID [SQL Data Write Timer], Bytes [365975543808], Time [585.011822] Sec(s), Average Speed [596.605852] MB/Sec
11844 974   10/08 18:33:00 5117611 stat- ID [SQL Data Write Timer], Bytes [413514059776], Time [421.000838] Sec(s), Average Speed [936.714854] MB/Sec
11844 21d8  10/08 18:33:00 5117611 stat- ID [SQL Data Write Timer], Bytes [337028117504], Time [347.200732] Sec(s), Average Speed [925.732668] MB/Sec
11844 2978  10/08 18:33:00 5117611 stat- ID [SQL Data Write Timer], Bytes [338166009856], Time [578.961646] Sec(s), Average Speed [557.032129] MB/Sec
11844 28c0  10/08 18:33:01 5117611 TPool [SdtTail]. Tot [3788360], Pend [0], Comp [3788360], Max Par [16], Avg Work Time [271.84 us], Avg Wait Time [159.27 us]
11844 2d70  10/08 18:33:03 5117611 stat- ID [SQL Data Write Timer], Bytes [392735752192], Time [603.042626] Sec(s), Average Speed [621.087107] MB/Sec
11844 2594  10/08 18:33:04 5117611 stat- ID [SQL Data Write Timer], Bytes [259446076416], Time [492.464526] Sec(s), Average Speed [502.426158] MB/Sec
11844 1fa0  10/08 18:33:04 5117611 stat- ID [SQL Data Write Timer], Bytes [358044576768], Time [573.823525] Sec(s), Average Speed [595.057369] MB/Sec
11844 2e30  10/08 18:33:10 5117611 stat- ID [SQL Data Write Timer], Bytes [260370309120], Time [495.571189] Sec(s), Average Speed [501.055110] MB/Sec
11844 f0c   10/08 18:34:17 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [63650/4758277]; Time - Procsg/NwRecv/Total [133/23346/23479] secs, Bytes recvd [134732636412] RCId [7]
11844 f0c   10/08 18:34:17 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [54428/6339243]; Time - Procsg/NwRecv/Total [347/23130/23477] secs, Bytes recvd [178947899728] RCId [1]
11844 149c  10/08 18:34:18 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [40031/4513821]; Time - Procsg/NwRecv/Total [331/23149/23480] secs, Bytes recvd [127533943093] RCId [10]
11844 149c  10/08 18:34:18 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [52310/4496440]; Time - Procsg/NwRecv/Total [334/23145/23479] secs, Bytes recvd [127025020241] RCId [4]
11844 29f0  10/08 18:34:19 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [50349/7174111]; Time - Procsg/NwRecv/Total [1221/22260/23481] secs, Bytes recvd [197654988460] RCId [8]


Forum|alt.badge.img+7
  • Vaulter
  • 86 replies
  • December 4, 2024

Hi ​@Egor Skepko,

  • It seems the Write speed is good.

11844 2594  10/08 18:33:04 5117611 stat- ID [SQL Data Write Timer], Bytes [259446076416], Time [492.464526] Sec(s), Average Speed [502.426158] MB/Sec

11844 1fa0  10/08 18:33:04 5117611 stat- ID [SQL Data Write Timer], Bytes [358044576768], Time [573.823525] Sec(s), Average Speed [595.057369] MB/Sec

11844 2e30  10/08 18:33:10 5117611 stat- ID [SQL Data Write Timer], Bytes [260370309120], Time [495.571189] Sec(s), Average Speed [501.055110] MB/Sec

 

  • As per the below logs, the “Procsg time is good compared to the “NwRecv time”.

11844 f0c   10/08 18:34:17 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [63650/4758277]; Time - Procsg/NwRecv/Total [133/23346/23479] secs, Bytes recvd [134732636412] RCId [7]

11844 f0c   10/08 18:34:17 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [54428/6339243]; Time - Procsg/NwRecv/Total [347/23130/23477] secs, Bytes recvd [178947899728] RCId [1]

11844 149c  10/08 18:34:18 5117611 SdtTail::logStats: Clnt [xxxxx], PId [11844], Cnt - BsyProcsg/Allocs [40031/4513821]; Time - Procsg/NwRecv/Total [331/23149/23480] secs, Bytes recvd [127533943093] RCId [10]

 

Next Action Plan:

Please check the network bandwidth between the MA and the destination client.

https://documentation.commvault.com/2024e/expert/checking_network_connectivity_using_network_test_tool.html

 

Regards,

Wasim


Forum|alt.badge.img+14
  • Author
  • Byte
  • 164 replies
  • December 6, 2024

@Wasim On the network test i am getting Status: Success en Networking Status: Passed.


Forum|alt.badge.img+7
  • Vaulter
  • 86 replies
  • December 7, 2024

Hi ​@Egor Skepko,

 

This tool will help us understand the network connectivity between two client computers and to measure the bandwidth utilization for data transfer.

 

Will you please share the output.

 

Regards,

Wasim


Forum|alt.badge.img+14
  • Author
  • Byte
  • 164 replies
  • December 9, 2024

@Wasim is that Verifying Network Connectivity in Client Mode Using? And as SrvHostName i am put MA  and at SrvClientName destination client? 


Forum|alt.badge.img+7
  • Vaulter
  • 86 replies
  • December 9, 2024

@Egor Skepko ,

Yes, Verifying Network Connectivity in Client Mode Using the Network Test Tool.

 

Verifying Network Connectivity in Client Mode Using the Network Test Tool

Regards,

Wasim

 

 


Forum|alt.badge.img+14
  • Author
  • Byte
  • 164 replies
  • December 10, 2024

@Wasim I am hoping i use the tool correct 

 


C:\Program Files\HDS\Backup and Recovery\Base>CVNetworkTestTool.exe -client -SrvHostname MA-SrvPort 25000 -log c:\TEMP\client.log
--------------------------------------------------
                Initialization Result
--------------------------------------------------
Client Host Names                  :xxxxx.xxxx.xxxx
Client Names                    :xxxxx
CommServeHostName               :xxxxx.xxxx.xxxx
Configuration                   :The machine is Client
IP Configured                   :Both
Instance Name                   :Instance001
Networking Status               :Passed
--------------------------------------------------
                  CLIENT STARTED  ****
--------------------------------------------------
Attempting connection to server MA:25000
Connect failed, please contact support, error=0x8007274C:{CQiSocket::Connect(358)/W32.10060.(A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. (10060))}
       RESULTS
       -------
 Configured IP  : IPv4 / IPv6
 Throughput     : Not Calculated
 Status         : Fail
__________________________________________________
                    END
__________________________________________________


Forum|alt.badge.img+7
  • Vaulter
  • 86 replies
  • December 10, 2024

Hi ​@Egor Skepko ,

 

Please open the port 25000 between the servers and then perform the test,

 

Regards,

Wasim


Forum|alt.badge.img+14
  • Author
  • Byte
  • 164 replies
  • December 10, 2024

@Wasim Well for communication we are using poorts 8400 - 8403 and 8408 the same output i am getting when i use those poorts with the test

 

C:\Program Files\HDS\Backup and Recovery\Base>CVNetworkTestTool.exe -client -SrvHostname xxxxx -SrvPort 8400
2796 12/10/24 11:30:05 --------------------------------------------------
 2796 12/10/24 11:30:05                INITIALISING NETWORK PARAMETERS
 2796 12/10/24 11:30:05 --------------------------------------------------
 2796 12/10/24 11:30:05 Current Executable directory is C:\Program Files\HDS\Backup and Recovery\Base
 2796 12/10/24 11:30:05 Checking dBaseHome in the Registry for Instance001
 2796 12/10/24 11:30:05 C:\Program Files\HDS\Backup and Recovery\Base
 2796 12/10/24 11:30:05      Network Parameters
 2796 12/10/24 11:30:05     --------------------
 2796 12/10/24 11:30:05 Host Name              : xxxxx
 2796 12/10/24 11:30:05 Domain Name            : xxxxx
 2796 12/10/24 11:30:05 DNS Server IP          : xxxxx
 2796 12/10/24 11:30:05 DNS Server IP          : xxxx
 2796 12/10/24 11:30:05 Machine uses Dynamic Host configuration Protocol
 2796 12/10/24 11:30:05 No of Interfaces : 5
 2796 12/10/24 11:30:05  Initialization Completed
 --------------------------------------------------
                Initialization Result
--------------------------------------------------
Client Host Names               :xxxxxxx
Client Names                    :xxxxxx
CommServeHostName               :xxxxxx
Configuration                   :The machine is Client
IP Configured                   :Both
Instance Name                   :Instance001
Networking Status               :Passed
--------------------------------------------------
                  CLIENT STARTED  ****
--------------------------------------------------
Attempting connection to server sv1758:8400
Connected with server xxxxxx (xxxxxx) at port 8400
Sending request to initialize Server
Error while sending data to server, error=0x80072746:{CQiSocket::Send(526)/W32.10054.(An existing connection was forcibly closed by the remote host. (10054))}
--------------------------------------------------
                     CLIENT ENDED
--------------------------------------------------
       RESULTS
       -------
 Configured IP  : IPv4 / IPv6
 Throughput     : Not Calculated
 Status         : Fail
__________________________________________________
                    END
__________________________________________________
 

 

At  -SrvHostname i need to put MA hostname ? 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings