And by exactly I mean exactly. I manage by being honest about it with my gf. It worked perfectly with my last one, where we had an open relationship and still works pretty great with my current one, even though I will admit it's certainly not easy for her at all times. I told her two weeks into the relationship (4 years ago) that this is how I am, how I always have been and she knows I love only her. So I believe you when you say you love your wife and still feel the need to do this.
Don't let anyone tell you you don't love her because you enjoy flirting with others. That's rubbish.
But your wife deserves to know that this is how you function and maybe she's up for alternatives like roleplaying, threesomes, maybe even an open relationship. Otherwise there'll always be a level of dishonesty and that is not okay. Good luck!

Oh and I, too, am so sick of people pretending monogamy is the only or even natural way of having relationships and their judgmental attitude towards anyone who doesn't work that way.

You shouldn't get so defensive in your Edit, though.