As a super sex positive person, no it's not bad. Your fantacies and desires are perfectly fine as long as you keep it to yourself. I'd go as far as to say you can masturbate to them. It's important you keep yourself in check, though. Do not risk making them uncomfortable by telling them. Keep it for yourself and no one gets hurt.
