Queen Camilla's Buckingham Palace aides "almost never discussed" Prince Harry and Meghan Markle, according to a royal source.