commvault.com commvault.com
Solved

Stubbing no longer works

  • 4 October 2023
  • 15 replies
  • 377 views
T
Rank
Badge +3

Since a few months we have the problem that the archiving function does not work anymore. Files that were previously stubbed without any problems are suddenly no longer stubbed. Also files that had a recall are not stubbed again. In the logs it says "Reason: [Skipping as file has recall on data access or open attribute ON]". Files are for example jpg and bak. We are already in contact with the support but they don't get any further.

icon

Best answer by Amulya 4 October 2023, 18:38

View original

15 replies

Rajiv
Rank
Userlevel 4
Badge +11

Hello @turbo1781 

Apologies for the inconvenience caused to you. 

Could you please share the ticket number with us? Also, I believe you are already aware that if the files have extended attributes, it will not be archived: https://documentation.commvault.com/2022e/expert/25799_windows_file_system_archiving.html

Best,

Rajiv Singal

 

T
Rank
Badge +3

@Rajiv Ok, but why doesn't the restubbing work anymore? Files are not changed, only opened. Does it have something to do with this setting?

 

https://documentation.commvault.com/additionalsetting/details?name=%22GXHSMSERVICEONEPASSRESTUB%22&id=2374

T
Rank
Badge +3

@Rajiv What extended attributes are these supposed to be? I have analyzed the files with different tools and found nothing. Simple photos are no longer archived. Support always blames it on the attributes or on Crowdstrike.

Rajiv
Rank
Userlevel 4
Badge +11

Hello @turbo1781 you can try to add the additional setting and check if the files are getting replaced with stubs.

Also, you can add one more additional setting: https://documentation.commvault.com/additionalsetting/details?name=%22GXHSM_DEBUG_LOGGING_ON%22&id=234 that helps to debug and help us understand why the file is not getting stubbed. After adding the debug setting, you can change  GxHSMStub log debug level to 6 -- fileSize 15 -- FileVersions 100 on client, run a job against the file that should be stubbed and check the log GxHSMStub for the reason. 

More information on extended attributes is here: https://learn.microsoft.com/en-us/windows/win32/fileio/reparse-points

Best,

Rajiv Singal

T
Rank
Badge +3

@Rajiv 

2552  1b80  10/04 10:08:33 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\Infor\tfgld482_202302.bak], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:33 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\Infor\tfgld482_202301.bak], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:33 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\Infor\tfgld482_202212.bak], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:33 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\Infor\tfgld482_202303.bak], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:33 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\Infor\tfgld482_202212.zip], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:34 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\ITBS-Archiv\CRM\2021 01 11 Spesendaten.txt], Action:[NotArchivingCandidate], Reason:[Skipping based on disk rules]

2552  1b80  10/04 10:08:29 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\Commvault Archive Test\test1.jpg], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:29 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\Commvault Archive Test\test2.jpg], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:29 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\Commvault Archive Test\test3.jpg], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]
2552  1b80  10/04 10:08:30 2419654 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\Commvault Archive Test\test4.jpg], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]

P
Rank
Badge

Hi @turbo1781 ,

did you upgrade to sp25 or later few days back?

and can you please check what all attributes are marked for file D:\ITBS-Archiv\Infor\tfgld482_202303.bak , D:\Commvault Archive Test\test3.jpg. 

Check if any of the below attributes are marked on the files, FILE_ATTRIBUTE_RECALL_ON_DATA_ACCESS AND FILE_ATTRIBUTE_RECALL_ON_OPEN, if so this is expected behavior. 

the skipping message suggests stubbing is skipped as the file is not present completely on the disk as per the attributes.

 

T
Rank
Badge +3

@Purva No, no upgrade. The stubbing hasn't been running for about 3 months. What is the best way to check the attributes?

P
Rank
Badge

Can you please let us know current commvault version on the client machine?

You may use thirdparty tools to list the file attributes. 

 

T
Rank
Badge +3

@Purva  Version 11.28.86

1 Attachment
P
Rank
Badge

We will check this and update you. 

T
Rank
Badge +3

I copy a fresh file (100MB.bin) to the server. This show the log file after the first backup job has run.

 

8088  49c   10/04 14:19:12 2419950 CStatsLogWriter::Log(85) - [ ] Process:[FileScan], File:[D:\100MB.bin], Action:[NotArchivingCandidate], Reason:[Skipping as file has recall on data access or open attribute ON]

 

This is not normal

2 Attachments
A
Rank
Badge

Hi @turbo1781 , Seems Extended attribute is et on these files. So we are not stubbing them.

Could you please check if crowdstrike AV is installed on this server. If yes, please exclude this subclient content path from crowdstrike. In one customer case we noticed crowdstrike AV is setting EA attribute.

T
Rank
Badge +3

@Amulya we will now uninstall crowdstrike for a week and continue testing. I will remove the attributes by moving the files to a ReFS drive. we will then see if crowdstrike is the cause here as suspected by support.

B
Rank
Badge

@turbo1781 Were you able to figure out the problem? We are experiencing this as well and so far it is a CV and crowdstrike throwing the ball at each other. This has also started happening in the 2 months.

T
Rank
Badge +3

@BrkDwn Hello, the fact is the problem wasn't Crowdstrike. We are now using disks with the ReFS file system and since then the stubbing has been working perfectly again. Unfortunately, we were unable to determine where the extended attributes come from.

Reply


Terms & ConditionsCookie settings