But it isn't a silly argument at all. We are the result of our history, and we are generally exceptionally proud of that. Trying to pretend it doesn't exist when it doesn't work for us is a lie.
The most important point is that nobody is claiming history absolves a criminal of the crime; that point is separate from the point the OP raised - that it is acceptable to decide people may be criminals before they even so much as steal a candy-bar.
If you disagree with any particular point I've made, please single it out and explain it to me. I'm afraid I just don't get the "yes, let's racially profile people; sounds fair" argument. If I'm wrong in saying that is exactly what will happen if you try to profile based on religion, someone also needs to explain that to me.