I believe that some people think the end of the first age is time when channeling was first discovered. Just because our age doesn't have magic, it doesn't necessarily mean that it won't be discovered in the future.

I don't remember reading that the Ogier were present in the first age. They aren't genetic mutations and they are implied to have come from another plane/dimension. They may not have been present in the first age and come to the world only in the second. Portal Stones are the only things explicitly told to be from the first age.

I do think that RJ implied very much that our age is the first age. For instance in the first appearance of Thom, he mentions stories of the First Age such has how Mosc and Merk fought with spears of fire and how Lenn flew to the moon.

I think the First Age probably covered pre-historic human history to the first discovery of channeling.