It certainly wouldn't be unheard of, although a woman would be hazarding a great deal more than a man (they were perceived as lacking self control and thus sexual indiscretion was less tolerated. The issue is that we have few female Roman sources, and even fewer that touch on sexuality.

But even in the more austere Republican era women like Claudia Metelli had a reputation for affairs, so we have to assume it took place.