We have to give them credit for holding society together, but it must be kept in mind that human civilization has been lessening since the War of Power - the White Tower has always been in a position where it's influence has been lessening as humanity dwindles. With Tarmon Gaidon around the corner, it is a fragment of it's former self, and even in the greatest days of the White Tower, the feats and successes of it's Aes Sedai paled in comparison to those of the full assembly of Servants during the Age of Legends.