Solved

Problem backing up sql - Error Please check the log files for this job for more details.

  • 23 September 2021
  • 6 replies
  • 11282 views

Badge +1

Hey,
I’m trying to backup a SQL server instance but  I'm getting the following error when trying.
Error Code: [19:1109]
Description: Please check the log files for this job for more details.
Source: XXXXXX, Process: JobManager
 

-Also installed is a FS agent on the machinetobackup
-credentials are correct,I’m able to connect from SSMS
-I have similar/almost identical machine with the same setup and SQL server.working great


Also checked the logs for this job and i’m getting the following

5360  2124  09/23 08:58:45 181838 Service     -> SYS RESUMED <- Automatically resumed
5360  1538  09/23 08:58:50 181838 Scheduler  Phase [4-Database Backup] (0,0) started on [machinetobackup] in [1] second(s) - SQLBackup.exe BACKUP -j 181838 -a 2:506 -t 1 -d agentmachine.domain*agentmachine*8400 -data  -jt 181838:4:4:0:44604  -idxma agentmachine.domain*agentmachine*8400  
5360  30dc  09/23 08:58:51 181838 Servant    Reg [Control] received. Client [machinetobackup] plattype = 4. Token [181838:4:4:0:44604]
5360  30dc  09/23 08:58:52 181838 Scheduler  Phase [Failed] message received from [machinetobackup] Module [SQLiDA] Token [181838:4:4:0:44604] restartPhase [0]
5360  30dc  09/23 08:58:52 181838 Delay Msg  successfully deleteSavedJMJobUpdateMsgByJob
5360  30dc  09/23 08:58:52 181838 JobSvr Obj Phase [4-Database Backup] for Backup Job Failed. Backup will continue with phase [Database Backup].
5360  30dc  09/23 08:58:52 181838 ArchiveMgr JMArMgr::releaseAllJobStreams() Calling CvResourceManager::releaseJobStreams(jobType=1,appType=81,logicalRelease=true)


If needed I will provide more information

Thanks guys

icon

Best answer by Mike Struening RETIRED 23 September 2021, 16:10

View original

6 replies

Userlevel 7
Badge +23

@Netanelp , did you get an incident opened for this?  Let me know as I’d like to send this up to dev to improve the error code.

If you did, share the case number with me so I can pursue accordingly.

Thanks!

Badge +1

Hi @Netanelp ! 

I see 2 things of note:

The first is that the databases in the content are not seen:

8072  1324  09/23 13:34:19 181848 CSQLClientDll::lookupSpContentDBbyClientId(6132): -Warn--: Empty database list received from server.. 8072  1324  09/23 13:34:19 181848 CSQLBackup::CreateCollectFileForSQLBackup(13979): -Warn--: List of databases for collect file is empty.

The second error is that the Account configured for the SQL backup lacks rights to the Job Results directory.
8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile(1456): -Error-: Failed to write to the collect file[C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\FullDBList.cvf]. Please check the permissions for user configured at the SQL instance.

Can you confirm the content for this subclient and verify the databases in the list are online?  also, see which account you have configured in the SQL iDA and give them rights to write to the Job Results folder.

Thanks

I went over the permissions and reinstalled the SQL completely.This time inputting the credentials for the SQL while the installation is happening.
 

Userlevel 7
Badge +23

To add to what @Stuart Painter mentioned, that error code is very generic, and I’d like to investigate the case so we can create a better error code and message.  Would you be able to open a support incident and share the case number with me?

Userlevel 7
Badge +23

Hi @Netanelp ! 

I see 2 things of note:

The first is that the databases in the content are not seen:

8072  1324  09/23 13:34:19 181848 CSQLClientDll::lookupSpContentDBbyClientId(6132): -Warn--: Empty database list received from server..

8072  1324  09/23 13:34:19 181848 CSQLBackup::CreateCollectFileForSQLBackup(13979): -Warn--: List of databases for collect file is empty.

The second error is that the Account configured for the SQL backup lacks rights to the Job Results directory.
8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile(1456): -Error-: Failed to write to the collect file[C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\FullDBList.cvf]. Please check the permissions for user configured at the SQL instance.

Can you confirm the content for this subclient and verify the databases in the list are online?  also, see which account you have configured in the SQL iDA and give them rights to write to the Job Results folder.

Badge +1

Hi @Netanelp 

Thanks for the question, it looks like you’ve posted JobManager.log entries, are you able to check SQLiDA.log on the client or perhaps cvd.log on the client for errors.

Error 19:1109 is a generic error and could be caused by a number of different factors, we would need to check the agent specific logs to narrow this one further.

Thanks,

Stuart

Thanks you for the response.

I cant find the SQLiDA.log file under <installation location>/contentstore/log files
Is that the right location?


Edit: 
found it. I wasn’t looking in the right location 

I uploaded this log,I didnt quite understand if that a permissions problem.
I was following this guide for permissions
https://sqlbak.com/blog/backup-permissions

8072  1324  09/23 13:34:17 181848 ProxyOptionsParser::ProxyOptionsParser(45): -Debug-: Command line: SQLBackup.exe -j 181848 -a 2:506 -t -d -data -jt 181848:4:2:0:39101 -idxma -cn SQLSERVER -vm Instance001 1 COMMCELLAGENT.*COMMCELLAGENT*8400 BACKUP COMMCELLAGENT.*COMMCELLAGENT*8400

8072  1324  09/23 13:34:17 181848 main(136): -Debug-: === Job Id [181848] =============

8072  1324  09/23 13:34:17 181848 CSQLCommon::getServerTypeForBackup(2405): -Debug-:  App ID [506] Commcell Id [2]

8072  1324  09/23 13:34:17 181848 isCCSDbEnabled() - Use CCSDb Enabled [0] IsCloudLaptop [0] IsFSCoreLaptop [0]

8072  1324  09/23 13:34:18 181848 Cvcl::init() - CVCL: Running in FIPS Mode

8072  1324  09/23 13:34:18 181848 CSQLCommon::getServerTypeForBackup(2418): -Debug-: Server type : [DataBase Engine]

8072  1324  09/23 13:34:18 181848 main(147): -Debug-: The SERVER TYPE OF THE SQL INSTANCE IS = DataBase Engine.

8072  1324  09/23 13:34:18 181848 main() - Running CSQLBackup.

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup(635): -Debug-: Checking registry key bEnableRBSJob to see if RBS needs to be enabled.

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup(646): -Debug-: This is not a RBS JOB.

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Job Phase Number = [4] attempt Number = [2]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup(723): -Debug-: Generic options [0].

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup(742): -Debug-: VDI Timeout retry count is [3].

8072  1324  09/23 13:34:18 181848 Init() - Initializing job control [token=181848:4:2:0:39101,cn=SQLSERVER], serverName [COMMCELLCONSOLE.], ControlFlag [1], Job Id [181848]

8072  1324  09/23 13:34:18 181848 CVJobCtrlLog::registerProcess(): successfully created file [C:\Program Files\Commvault\ContentStore\Base\JobControl\8.072]

8072  1324  09/23 13:34:18 181848 JM Client  CVBkpJobClient::init(): Initializing job object with token [181848:4:2:0:39101].

8072  1324  09/23 13:34:18 181848 JOBRESCACHEDIR: opened index cache [C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Job Manager initialized.

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Time taken to register Job with job manager = 0.127461

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Buffer Size is set to [2048]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - BufferCount is set to [20]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Block Size is set to [65536]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Disable Log Consistency Check [No]

8072  1324  09/23 13:34:18 181848 CSQLCommon::initializeBackup() - Max transfer size [2097152]

8072  1324  09/23 13:34:18 181848 CSQLCommon::cvImpersonateUser() - Username = [xxxxx], Domain = [xxxxx]

8072  1324  09/23 13:34:18 181848 CVImpersonateLoggedOnUser() - caching user sid [S-1-5-21-1665695062-xxxxxxxx-xxxxxxxx-45628] for optimizing subsequent impersonate operations for this user

8072  1324  09/23 13:34:18 181848 CSQLCommon::getServiceStatus() - Opening Service : [MSSQL$PRI]

8072  1324  09/23 13:34:18 181848 CSQLCommon::isSqlServerRunning() - SQL Service status for [MSSQL$PRI] [4]

8072  1324  09/23 13:34:18 181848 CsqlDMO::InitializeCOM() - <COM> - Already initialized.

8072  1     09/23 13:34:18 181848  ManagedLogger::SetCLRThreadPoolMaxThreads - CLR ThreadPool's maxWorkerThreads = [32767], maxIOThreads = [1000], PID [8072], ProcessName = [SQLBackup].

8072  1     09/23 13:34:18 181848  ManagedLogger::SetCLRThreadPoolMaxThreads - Setting CLR ThreadPool's maxWorkerThreads = [1000], maxIOThreads = [1000] PID = [8072], ProcessName = [SQLBackup].

8072  1324  09/23 13:34:18 181848 CvSQLErrorControl::ParseXMLRulesFromXMLString(113): -Warn--: No IDA specific rules set and parsed here.

8072  1324  09/23 13:34:18 181848 CvSQLErrorControl::Initialize(95): -Warn--: Rules parsing failed for ClientId [89] AppType [81].

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup() - DDR RepsetId = [0].

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup(3086): -Debug-: Using [300] as VDI TIMEOUT

8072  1324  09/23 13:34:18 181848 CsqlDMO::InitializeCOM() - <COM> - Already initialized.

8072  1324  09/23 13:34:18 181848 CsqlDMO::getInstanceMajorVersion() - Server [SQLSERVER\PRI]: Major Version : [11].

8072  1324  09/23 13:34:18 181848 CsqlDMO::isSqlInstanceClustered() - Instance Name (1) (PRI).

8072  1324  09/23 13:34:18 181848 CsqlDMO::isSqlInstanceClustered() - Failed to open[SOFTWARE\Microsoft\Microsoft SQL Server\MSSQL11.PRI\cluster]

8072  1324  09/23 13:34:18 181848 CsqlDMO::InitializeCOM() - <COM> - Already initialized.

8072  1324  09/23 13:34:18 181848 CsqlDMO::getInstanceMajorVersion() - Server [SQLSERVER\PRI]: Major Version : [11].

8072  1324  09/23 13:34:18 181848 CsqlDMO::InitializeCOM() - <COM> - Already initialized.

8072  1324  09/23 13:34:18 181848 CsqlDMO::getInstanceVersion() - Instance version = [11.0.2100.60] [rtm] [Standard Edition (64-bit)]

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup(3175): -Debug-: [Not protecting] sharepoint dbs.

8072  1324  09/23 13:34:18 181848 Block level enabled - [0]

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup() - !!!! STARTING Backup JobId [181848] AppId [506] !!!!

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup(3389): -Debug-: Log backup from file system is [Disabled]. Log consistency check is [Disabled].

8072  1324  09/23 13:34:18 181848 CSQLBackup::startBackup() - Time taken to setup the environment before backup starts = 0.000000

8072  1324  09/23 13:34:18 181848 CSQLBackup::generateCollectFile(574): -Debug-: collectFilePath [C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\FullDBList.cvf] m_bkyType [1] m_bkpPhase [1].

8072  1324  09/23 13:34:19 181848 CSQLClientDll::getSqlJobInfo(4452): -Debug-: Received response from CS [No data found for job [181848].].

8072  1324  09/23 13:34:19 181848 CSQLBackup::GenerateStreamInfoFile(518): -Debug-: Added stream count [2] to stream info file [C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\CVSQLStreamInfo_FULL.info].

8072  1324  09/23 13:34:19 181848 CSQLBackup::isJobInitiatedFromPlugin(11778): -Debug-: Job [is not] initiated from SQL Plugin.

8072  1324  09/23 13:34:19 181848 CSQLBackup::isJobInitiatedFromOSC(11792): -Warn--: Job is not initiated from OSC [1].

8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile() - Time taken to auto-discover databases = 0.000001

8072  1324  09/23 13:34:19 181848 CSQLBackup::GenerateStreamInfoFile(518): -Debug-: Added stream count [2] to stream info file [C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\CVSQLStreamInfo_FULL.info].

8072  1324  09/23 13:34:19 181848 CsqlDMO::InitializeCOM() - <COM> - Already initialized.

8072  1324  09/23 13:34:19 181848 CSQLBackup::getOnDemandFilePath() - Cant get the value of SQLSERVER\PRI_default_OnDemandFilePath On Demand reg value under key  MSSQLAgent Performing normal backup!

8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile(1225): -Debug-: Pseudo AG Client is not configured.

8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile(1236): -Debug-: Backup availability databases is enabled.

8072  1324  09/23 13:34:19 181848 CSQLCommon::isSkipSharepointContentDB(2564): -Debug-: Register key [nSkipRBSdb] NOT found, by default, skipping sharepoint content database.

8072  1324  09/23 13:34:19 181848 CSQLClientDll::lookupSpContentDBbyClientId(6118): -Debug-: Using Client id [89] to get list of databases being protected using SPiDA.

8072  1324  09/23 13:34:19 181848 CSQLClientDll::lookupSpContentDBbyClientId(6132): -Warn--: Empty database list received from server..

8072  1324  09/23 13:34:19 181848 CSQLBackup::CreateCollectFileForSQLBackup(13979): -Warn--: List of databases for collect file is empty.

8072  1324  09/23 13:34:19 181848 CSQLBackup::generateSQLCollectFile(1456): -Error-: Failed to write to the collect file[C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848\FullDBList.cvf]. Please check the permissions for user configured at the SQL instance.

8072  1324  09/23 13:34:19 181848 CSQLBackup::backup() - Failed to create collect file.

8072  1324  09/23 13:34:19 181848 BKP CALLED COMPLETE (PHASE Status::FAIL), 181848. Token [181848:4:2:0:39101]

8072  838   09/23 13:34:19 181848 CVJobCtrlLog::unregisterProcess(): successfully removed file [C:\Program Files\Commvault\ContentStore\Base\JobControl\8.072]

8072  1324  09/23 13:34:19 181848 JOBRESULTSTABLE(C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\1818 removing copy 'C:\Program Files\Commvault\ContentStore\iDataAgent\JobResults\CV_JobResults\2\0\181848'

Userlevel 7
Badge +15

Hi @Netanelp 

Thanks for the question, it looks like you’ve posted JobManager.log entries, are you able to check SQLiDA.log on the client or perhaps cvd.log on the client for errors.

Error 19:1109 is a generic error and could be caused by a number of different factors, we would need to check the agent specific logs to narrow this one further.

Thanks,

Stuart

Reply