Intellinsnap NDMP Backup copy failing with error : Socket error

Customer made some changes to the Tipping point IPS device at their end; and all of a sudden the netapp intellisnap backup copies have started failing.  As per the customer, they do not see anything on the logs.  

There are two netapp filers on the same network; backup copy on 1 is working while on another one it is failing.  The Logs just say “3880  924   08/18 11:34:52 5974838 NDMP ERROR[TSCNACLUSTER01] 9: DUMP: Error: Write to socket failed”

and the NetApp vendor says they do not see any error at their end as well

“

I can see in the logs from the NetApp that the connection is made at 11:09am

<LR d="18Aug2022 11:09:49" n="HSCNANODE01" t="1660777789" id="0/155572305395713" p="1" s="Ok" o="ndmpdc" vf="" type="1" seq="1964418" supp="1" >

<ndmp_ctrl_on_e0m_1

        lif_addr="192.168.0.54"

        lif_port="e0M"/>

But after this, there are no entries in the event log of the Netapp. This is the same on cluster 02 which is succeeding in backups.

“

Commvault Logs :

3880  924   08/18 11:31:24 5974838 UPDATEJM: Stream Restart FileCountDelta:[29001] FileCount:[5007677]

3880  924   08/18 11:31:24 5974838 RESTART STRING is [<?xml version="1.0" encoding="UTF-8" standalone="no" ?><NAS_NasBackup_XMLRestartString MultiStreamPathAttemptCount="0" indexRestartCount="0" lastMAClientId="1243" type="NODE" ver="RS_v2.0"><ValidRestartString chunkCount="49" context="32623038396564342d316438352d313165642d393339632d303061303938666462626333" contextLength="36" estimatedBytes="4585028256768" fhInfo="3780727459840" fileCount="5007677" fileNode="7524753" lastAfileBytes="75464769536" lastAfileChunks="1" lastAfileCopyID="443" lastAfileID="13224512" pathName="/svm-hsc-cifs/SharedDrives" pathNum="0" recNum="0" recSize="65536" restartByteOffset="3780728510464"/></NAS_NasBackup_XMLRestartString>]

3880  924   08/18 11:32:01 5974838 NDMP INFO[TSCNACLUSTER01] 8: DUMP: Thu Aug 18 11:31:24 2022 : We have written 3699027528 KB.

3880  924   08/18 11:34:52 5974838 NDMP ERROR[TSCNACLUSTER01] 9: DUMP: Error: Write to socket failed

3880  924   08/18 11:34:52 5974838 NDMP ERROR[TSCNACLUSTER01] 10: DUMP: Error: DUMP IS ABORTED

3880  924   08/18 11:34:52 5974838 NDMP ERROR[TSCNACLUSTER01] 11: DATA: Operation terminated: EVENT: INTERNAL ERROR (for /svm-hsc-cifs/SharedDrives/.snapshot/SP_2_5956286_1659729787)

3880  924   08/18 11:34:52 5974838 DATA HALT with reason [NDMP_DATA_HALT_INTERNAL_ERROR]