Found a solution but this might not be the proper way to do it but it works. (Vcenter esxi host added over openvpn site to site connection Nat problem.)
Solution:
In the Pfsense boxes, i put up 2 new outbound rule for the "vpn adapters" on both sites and told pfsense to nat source ip to Nat address.
For site A
interface vpn 192.168.1.115/32 Nat address 192.168.1.115/32
For Site B
interface vpn 192.168.10.115/32 Nat address 192.168.10.115/32
Now when i add the host in vcenter and add the ip of the esxi host 192.168.10.115 the ip stays after 60 seconds and do not change to the vpntun ip so is 10.0.10.2
Not sure if it matters but i did read on some forum somewhere that outbound ports had to be static and not random so i set pfsense not randomize outbound ports on the nated address. (Static)
If any have an input on how to do this the proper way I'm glad to hear about it.