What has gender got to do with how physical a game is? He wasn't stating "look its a game of football and men are playing" he was saying "now it's a man's game because it's got more physical"
The 2 things aren't linked, that's the point. It's an old fashioned way of expressing something that doesn't help the legacy of sexism and toxic masculinity in this country. I suspect he didn't mean anything by it, but it should be called out. Things move on, like I no longer use the word 'gay' as an insult or light hearted way to describe something I don't like. Do I feel like my free speech has been suppressed? Has it adversely affected my life? No. I just accept that things move on and part of the world is a slightly better place thanks to increased tolerance and inclusivity.