Tons of factors influence hormone levels. There's nothing strange about thinking widespread social patterns and physical changes in the environment (diet, air pollution, etc) could lead to widespread hormonal changes within a population.

You seem to assume testosterone levels are only a function of genetics, which they are not.