Was love an illusion?

I was dating a guy that was a total control freak. He wouldn't let me have any friends. Near the end of this relationship, I had a friend I had known for a while that was comforting me and more or less protecting me from him. Then when I broke up with the control freak, the friend asked me out. I said yes and we're dating. But lately it seems like we've grown apart.. We've excanged I love yous and yada yada, but it seems he's down sometimes and I ask and he won't tell me.. I thought about it and I'm wondering if the love I thought I had was just me admiring him for what he did for me?.. He's selfish, but he thinks of me a lot.. But I can't find any reason other than he can be sweet to stay with him. He's been pressuring me into doin "stuff" with him and i say no.. And it let's him down... What am I supposed to do?should I move on so we can be happier? I just don't know what to do.....