Depends on how much crap you are willing to look past, in a nutshell. Personally, I would not be able to tolerate knowing that my partner was sleeping with other people while we were apart. Or that I am now being confronted on a daily basis with the evidence of that (kids) I know that I would struggle with feelings of betrayal and resentment every time the children were brought up. That's just me though. If you are really willing to put that aside because you love him soooo much, more power to you. Just don't sell yourself short and put more obstacles in your life than what is necessary. Children are forever.