Skip to main content
commvault.com commvault.com

i am seeing the same type of errors and i am running 11.23.47. we use the same rman backup script across 60+ clients without an issue.  only one client continues to get this error.  however, it will run successfully sometimes.  for example, yesterday it ran fine in the am but always fails during the backup window at 6pm.

 

these are some of the errors logged:

 

3303:RMAN-03009: failure of backup command on ORA_SBT_TAPE_1 channel at 03/30/2022 18:03:02
3304:ORA-19506: failed to create sequential file, name="040pn4gb_4_1_1", parms=""
3305:ORA-27028: skgfqcre: sbtbackup returned error
3306:ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
 

Starting backup at 30-mar-2022 18:01:41
released channel: ORA_DISK_1
allocated channel: ORA_SBT_TAPE_1
channel ORA_SBT_TAPE_1: SID=2613 device type=SBT_TAPE
channel ORA_SBT_TAPE_1: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
allocated channel: ORA_SBT_TAPE_2
channel ORA_SBT_TAPE_2: SID=1340 device type=SBT_TAPE
channel ORA_SBT_TAPE_2: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
allocated channel: ORA_SBT_TAPE_3
channel ORA_SBT_TAPE_3: SID=2603 device type=SBT_TAPE
channel ORA_SBT_TAPE_3: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
allocated channel: ORA_SBT_TAPE_4
channel ORA_SBT_TAPE_4: SID=3870 device type=SBT_TAPE
channel ORA_SBT_TAPE_4: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
allocated channel: ORA_SBT_TAPE_5
channel ORA_SBT_TAPE_5: SID=108 device type=SBT_TAPE
channel ORA_SBT_TAPE_5: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
allocated channel: ORA_SBT_TAPE_6
channel ORA_SBT_TAPE_6: SID=1353 device type=SBT_TAPE
channel ORA_SBT_TAPE_6: CommVault Systems for Oracle: Version 11.0.0(BUILD80)
channel ORA_SBT_TAPE_1: starting full datafile backup set
channel ORA_SBT_TAPE_1: specifying datafile(s) in backup set
input datafile file number=00265 name=/oracle/oradata/ebsupg8/APPS_TS_MEDIA08.dbf
channel ORA_SBT_TAPE_1: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_2: starting full datafile backup set
channel ORA_SBT_TAPE_2: specifying datafile(s) in backup set
input datafile file number=00285 name=/oracle/oradata/ebsupg8/APPS_TS_TX_DATA12.dbf
channel ORA_SBT_TAPE_2: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_2: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_3: starting full datafile backup set
channel ORA_SBT_TAPE_3: specifying datafile(s) in backup set
input datafile file number=00286 name=/oracle/oradata/ebsupg8/APPS_TS_TX_DATA13.dbf
channel ORA_SBT_TAPE_3: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_4: starting full datafile backup set
channel ORA_SBT_TAPE_4: specifying datafile(s) in backup set
input datafile file number=00287 name=/oracle/oradata/ebsupg8/APPS_TS_TX_DATA14.dbf
channel ORA_SBT_TAPE_4: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_5: starting full datafile backup set
channel ORA_SBT_TAPE_5: specifying datafile(s) in backup set
input datafile file number=00288 name=/oracle/oradata/ebsupg8/APPS_TS_TX_DATA15.dbf
channel ORA_SBT_TAPE_5: starting piece 1 at 30-mar-2022 18:01:47
channel ORA_SBT_TAPE_6: starting full datafile backup set
channel ORA_SBT_TAPE_6: specifying datafile(s) in backup set
input datafile file number=00289 name=/oracle/oradata/ebsupg8/APPS_TS_TX_DATA16.dbf
channel ORA_SBT_TAPE_6: starting piece 1 at 30-mar-2022 18:01:47
RMAN-03009: failure of backup command on ORA_SBT_TAPE_1 channel at 03/30/2022 18:03:02
ORA-19506: failed to create sequential file, name="040pn4gb_4_1_1", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   CreateOraObject20: Jobc2469445] thread556654]: Failed to get response from JobManager.
channel ORA_SBT_TAPE_1 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ORA_SBT_TAPE_2 channel at 03/30/2022 18:03:02
ORA-19506: failed to create sequential file, name="050pn4gb_5_1_1", parms=""
ORA-27028: skgfqcre: sbtbackup returned error
 

then it drops all the channels and doesnt restart any.  it just finishes the job and commvault reports it completed successful.  

 i do have a case open on this.  things we have tried so far - i checked the group =dba and we rebooted the client, moved a bunch of backups to different backup window.  i watch the job kick off in the job controller and i see it get active streams then they just die for no apparent reason.  there were a few other db backups running at the same time that use the same backup script and they all ran fine.

 

the job does report this error:

Error Code: r19:1335]
Description: Oracle Backup iJob 2469455] threadJ56654]: RemoveJobUnit() failed.]
Source: , Process: ORASBT

 

any help is appreciated.

Jayme

 

 

@jayme , I moved this to its own thread.

I’ll get the same resources to come assist!

@jayme , is this issue the same as case 220325-392?

Let me know and I’ll track its solution.

Sharing case resolution (if this incident is not the same issue, please let me know!):

Finding Details:

6 channels configured for control file backup at the beginning and script run within single block.
DEV confirmed that we wait for 2 mins after backup completion before closing job for new channels.
At 6PM the crosscheck archivelog finishes quickly within 2 minutes and backup channel came up with same PID hence trying to reuse the same job to allocation streams however the jobs is completing hence causing the new stream allocation failure.
At other time there are 2 minutes separation between control file backup and data backup hence the backups are accommodated in 2 jobs without error.

Solution:

Changing RMAN run block number and use of additional setting sSKIPSINGLEJOBID to let each backup stream request to connect with its own job make backup work without issue at 6PM.

Terms & ConditionsCookie settings