King Charles 'feared the influence of The Crown'