King Charles and Prince William are reportedly on the same page when it comes to Prince Harry and Meghan Markle’s return to the U.K.

Royal author Russell Myers told PEOPLE that the King and his eldest son are “completely united” on one point: Harry and Meghan will not represent the royal family.

The comments come as the Duke and Duchess of Sussex settle back in Britain after moving there with their two children, Prince Archie and Princess Lilibet, following six years in the U.S.

King Charles recently made the couple’s status clear in a letter sent to senior British officials. The letter confirmed that Harry and Meghan are no longer working members of the royal family and remain private citizens, following their decision to step back from official duties in 2020.

Harry and Meghan’s side has pushed back on the “private citizens” description, saying they remain public figures because of their high profile.

While William and Harry remain estranged, William reportedly accepts that his father can maintain his own relationship with Harry. However, PEOPLE reports that William does not plan to have a personal or working relationship with Harry and Meghan.

Charles, meanwhile, has remained in contact with his younger son since Harry returned to the U.K. Their relationship appears to be different from the one between Harry and William, who have not reconnected.

Harry and Meghan’s return has also brought fresh attention to the family divide. Their children recently changed schools just two days into the new term because of security concerns involving the journey between the school and the family’s home.

For now, Harry and Meghan are living in Britain as non-working royals, while King Charles and Prince William continue with their own royal duties and family responsibilities.