Welcome to the forum.
Normally I would expect the talking about therapy to be optional.
There is alot more to your relationship than sone of the others you mention, therefore could be more affected by stress.
Also things can become divisive he may feel claustrophobic rather than invited to share time with you, not your fault it's just difficult to know what interaction he is open to, and what needes more time.
But also what might be difficult is that there may be somethings that he would like, but that he is embarrassed to ask for, but don't jump on him.