Evolutionary processes don't care about wealth and power. The most intelligent people aren't exactly known for being prolific baby makers. So while the 150 IQ couple run an empire, win chess tournaments, and euphorically post at /r/atheism, people of average intelligence are doing things more likely to lead to babies.

For adaptations to spread there must be pressures for it, and there does tend to be trade offs. Certainly we could see those pressures ramp up as societies become more reliant on knowledge and intelligence.