Hi team,
I’m conducting a PoC for MongoDB sharded cluster.
Customer runs two shards and each shard has 3nodes. (1 primary and 2 secondary)
We’ve installed plug-in on all 6 nodes and all configuration went well.
For 1st shard,
we performed the initial full backup without any option.
For second shard,
we performed the initial full backup with some option for better performance.
...
…
Backup performance is not bad in the beginning. (100-150MB/sec)
Backup size of shard is 5TB and should be able to complete the job within 20hrs.
So performance need to be higher than 80-100MB/sec at least.
Backup server and Mongodb nodes spec is enough and resources are always available.
But backup peformance is gradually degraded as time goes by and comes to 5-6MB/sec.
We’ve never completed the initial backup due to this unexpected performance degradation.
Mongodb data is on SSD and connected with 10Gb network for backup.
CVLT version is 11.28 and also tried 11.26 but the same result.
I’m sure that installation and settings for backup is perfect and LVM snap works well.
Have you guys experienced this symptom?
Could you give me an input need to look into again?
Thanks.