The Royal Family’s home that King Charles was banned from living in