If you used thick provisioning when installing this is the default VMware behaviour.
Ran into the exact problem when installing dsm with 1TB hdd thick provisioned.
I created another, smaller volume, added to the XPE and moved my files over and deleted the bigger one afterwards.
I did not use raid mode inside XPE as my NAS is already on a HW raid but from what I read you also just use a single drive.