Go for it and don't let any "ethical" concerns stop you. I slept with and then dated one of my college professors for three years. We have no real regrets about it. People can be a bit uptight about these things imo.
As you say, the worst case scenario is that you'll get some healthy socialization in.