Hi TolgaAsik,
Do you have verified the counters on your Virtual Connect / Flex Fabric modules?
Can you see there anything related to the issue?
We are running the same configuration like you in a vSAN Stretched Cluster design spanned over multiple Synergy Frames...
BR/JO!