Hello Moaz,
"Can we use 4x vSAN Standard per socket licenses + 1x vCenter Foundation for 2 node vSAN cluster?"
Yes - vSAN licensing is separate from ESXi licensing. Additionally, it is only vCenter Essentials edition that has the limitation of being able to only manage 'Essentials' licensed hosts - Foundations does not have this limitation.
Your sizing seems a little on the big side:
- If by "Swap space" you mean for .vswp Objects then you shouldn't need much for this as these can be set to thin (and are default thin in 6.7) and if you have the host memory sizing done correctly then your VMs shouldn't be swapping.
- vSAN Filesystem overhead is only going to take about 1-2% of disk capacity.
- Not sure what you mean by "Adding Disc Overhead" but if you are referring to space for temporary snapshots (e.g. during backups) this likely won't be huge unless you have VMs with rapid data-change and/or slow backup.
6TB per node should be fine but do consider adding for growth and also whether you are basing this on current thin-provisioned VMs that will grow or actual full allocated size.
Other recommendations would be:
- Aim for 'sweet-spot' sized devices which in my opinion is ~1.6-2TB - much smaller and component placement for large Objects can get messy, much larger and performance will go down due to less IO paths aswell as bigger resyncs if a disk fails (potentially causing a node to run out of space and not be able to repair all data to FTT=1).
- Go SAS over SATA if you can, bigger queue-depth and better de-stage rates.
- Size your Cache-tier devices accordingly - if it is a cluster that doesn't require huge write-intensive IOPS then smaller caches (e.g. ~2-400GB) will *likely* suffice but do take the workload profile into account - again this can also depend on the device e.g. I have seen 400GB optanes NVMes do twice the work (and better) than 800GB SAS SSDs. Cache-sizing also varies depending on Hybrid vs All-Flash:
Design Considerations for Flash Caching Devices in vSAN
Designing vSAN Disk groups - All Flash Cache Ratio Update - Virtual Blocks
Bob