Thanks, @thomas.S !
I checked a few of the stream counters and it looks like the network is the cause.
If you check the column for ‘Time(seconds), that is the time the stream/pipe had to wait for data. In some cases, we’re waiting a minute or two.
The one below has some high wait times, though there are several pipes per MA.
3996 6720 05/05 15:03:02 2996475
|*5852487*|*Perf*|2996475| =======================================================================================
|*5852487*|*Perf*|2996475| Job-ID: 2996475 [Pipe-ID: 5852487] [App-Type: 0] [Data-Type: 1]
|*5852487*|*Perf*|2996475| Stream Source: cvmapapp01
|*5852487*|*Perf*|2996475| Network medium: SDT
|*5852487*|*Perf*|2996475| Head duration (Local): [05,May,21 15:01:01 ~ 05,May,21 15:03:02] 00:02:01 (121)
|*5852487*|*Perf*|2996475| Tail duration (Local): [05,May,21 15:01:01 ~ 05,May,21 15:03:02] 00:02:01 (121)
|*5852487*|*Perf*|2996475| -----------------------------------------------------------------------------------------------------
|*5852487*|*Perf*|2996475| Perf-Counter Time(seconds) Size
|*5852487*|*Perf*|2996475| -----------------------------------------------------------------------------------------------------
|*5852487*|*Perf*|2996475|
|*5852487*|*Perf*|2996475| Replicator DashCopy
|*5852487*|*Perf*|2996475| |_Buffer allocation............................ 81 [Samples - 21079] [Avg - 0.003843]
|*5852487*|*Perf*|2996475| |_Media Open................................... 6 [Samples - 15] [Avg - 0.400000]
|*5852487*|*Perf*|2996475| |_Chunk Recv................................... 5 [Samples - 3] [Avg - 1.666667]
|*5852487*|*Perf*|2996475| |_Reader....................................... 7 1110032163 [1.03 GB] [531.67 GBPH]
|*5852487*|*Perf*|2996475|
|*5852487*|*Perf*|2996475| Reader Pipeline Modules[Client]
|*5852487*|*Perf*|2996475| |_CVA Wait to received data from reader........ 119
|*5852487*|*Perf*|2996475| |_CVA Buffer allocation........................ -
|*5852487*|*Perf*|2996475| |_SDT: Receive Data............................ 7 1111164840 [1.03 GB] [Samples - 21113] [Avg - 0.000332] [532.21 GBPH]
|*5852487*|*Perf*|2996475| |_SDT-Head: CRC32 update....................... 1 1111107304 [1.03 GB] [Samples - 21112] [Avg - 0.000000]
|*5852487*|*Perf*|2996475| |_SDT-Head: Network transfer................... 93 1111107304 [1.03 GB] [Samples - 21112] [Avg - 0.004405] [40.06 GBPH]
|*5852487*|*Perf*|2996475|
|*5852487*|*Perf*|2996475| Writer Pipeline Modules[MediaAgent]
|*5852487*|*Perf*|2996475| |_SDT-Tail: Wait to receive data from source.... 120 1111164840 [1.03 GB] [Samples - 21113] [Avg - 0.005684] [31.05 GBPH]
|*5852487*|*Perf*|2996475| |_SDT-Tail: Writer Tasks....................... 28 1111107304 [1.03 GB] [Samples - 21112] [Avg - 0.001326] [133.05 GBPH]
|*5852487*|*Perf*|2996475| |_DSBackup: Media Write...................... 8 1110192223 [1.03 GB] [465.28 GBPH]
|*5852487*|*Perf*|2996475|
|*5852487*|*Perf*|2996475| ----------------------------------------------------------------------------------------------------