You would just need to transfer the gravity code from the virtual world to the virtual castle part if its not there, then castles could. Plus you could consider letting castles have dungeons, and if they fall into disrepair, rather than becoming removed from the world, something moves in and takes up residence.