I'm pretty sure this was just a figure of speech--Rand's way of saying, "Listen, I don't know EVERYTHING--but I'm pretty damn sure I'm the only male Aes Sedai who hasn't turned to the Shadow."

The only people that survive today from the AoL are those trapped in SG, those potentially trapped in Stasis, and the odd few souls that are somehow connected with their past lives. As far as we know, Rand is the only soul whose memory extends as far back as the AoL (Birgitte being the only other, and hers only extends back a thousand years or so, and she's rapidly losing those memories anyhow).

While yes, it is possible, I find it highly unlikely.