If it gets you off don't worry about it. As long as its just a fantasy you don't have to feel guilty. What your partner doesn't know won't hurt them. However, if you still have feelings for your ex then maybe you should think about breaking things off with your current partner. Lying to yourself and them is only going to cause pain. Wasting their time and yours is just plain wrong.