King Charles has “no time in the diary” to see Prince Harry, a palace insider told the Mail on Sunday.

Harry is due in the U.K. this week to attend the annual WellChild Awards, a charity of which he is the patron. Prince William won’t see his brother either, the paper says—as The Daily Beast reported last week, when plans for a meeting were mooted by some outlets.

Now that Harry and Meghan have given up Frogmore Cottage, it is still unclear, the Mail on Sunday says, whether the royals will offer Harry somewhere to stay on his U.K. trip.

Earlier this week, Prince Harry said he turned to therapy after serving in Afghanistan triggered memories of losing his mother at a young age, a trauma he said was “not discussed” at the time, in an apparent swipe at his father.

He said serving on the front lines in Afghanistan prompted an “unraveling,” in the course of which he found himself “lying on the floor in the fetal position.”

He added: “The biggest struggle for me was no one around me really could help. I didn’t have that support structure, that network, or that expert advice to identify what was actually going on with me.”

Harry made the comments in his new documentary series, Heart of Invictus, which tracks the progress of six competitors as they prepare for the 2016 Invictus Games, the Paralympics-style event for wounded veterans that he founded—the 2023 iteration of which gets underway in Dusseldorf later this week.

Harry is due to give a speech at the WellChild Awards on Thursday, the day before the anniversary of Queen Elizabeth’s death, the prospect of which—royal sources told The Daily Beast—was making William and Kate Middleton “nervous,” lest Harry have an “outburst” which will detract from the anniversary itself (which William and Kate are set to take a lead position in).

Charles, sources said, was proud of Harry’s Invictus-related achievements, and added of the media hullabaloo around the documentary, “The idea that Harry has used the series to attack Charles is a total exaggeration; he hasn’t.”