It's mostly from devastating wars and cultural shifts. Greek civilization never recovered from the diadochi wars and were eventually conquered by the romans. The romans decayed in power over the centuries due to their own wars of succession, corruption and innumerous barbarian invasions. Baghdad was thoroughly devastated by the mongols to such an extraordinary degree that one might say that in some ways it hasn't recovered from it to this day.