The actor was wed to the Hollywood beauty from 2000 to 2003, during which time he filmed Monsters Ball - featuring explicit scenes with Halle Berry - which put pressure on them both.
He told The Sun newspaper: "If you are an actor, even doing a Disney movie or cartoon voices, you could still be away from each other for six months.
"Look how it applied to me. I go away and do a film like Monster's Ball with a very explicit sex scene with Halle Berry. She is one of the most beautiful women in the world and I am talking on the phone to my wife, and she says, 'What have you been doing today?'
And I say, 'Oh, I did that sex scene with Halle Berry.' You are then asked if you actually touch her. I say, 'I had to - it's in the scene'
"Other people's situations are hard, with areas of doubt. But if you are a thousand miles from home on a film set simulating sex with a beautiful woman, it's even tougher."
Billy, 58, says he messed up his marriage to Angelina, his fifth wife, because he wasn't sure of himself.
He added: "I blew my marriage to Angelina. I thought I was not good enough for her and I was too insecure. We are still friends."
Billy has been with his current partner, Connie Angland, for ten years, and they have a seven-year-old daughter, Bella, together, but he isn't sure if they should tie the knot.
He added: "Another marriage for me? I am not saying I will and I am not saying I won't. It's funny that people talk so much about me marrying five times. But if an actor who is known as a playboy goes out and fucks every girl who walks in to a bar, then that's OK. That's hip."