I got to say, this is only true if interaction is actually better in person. For me I'm not sure that is the case. I also do not participate in all social calls that my company set up, but I am always available for 1v1 video calls with my colleagues.
I was at the office 3 times last year and that is plenty enough for me and my team.
I started in defense, but I would now after 15+ years not do any work in defense or gambling or trading. It was a good experience for me though, taught me a lot, but I wouldn't do it again now.