You aren't being selfish at all. It is a desire of yours to see him there and experience that time with him.
My husband and I started going to church together when we got married, and then something happened with him, spiritually, and he quit going. He was on the verge of totally walking away from the Lord. (this was an 8 year span) I prayed and prayed for him and encouraged him. I didn't beg him to come to church. I would read my Bible in our room when he was busy doing other things, and he would come in from time to time and see me reading. (Later, he said that he admired that in me) On many nights, I cried out to the Lord to grab a hold of his heart. One day, I visited a different church (the one that we are going to now) and kept telling him about how awesome the services were. I still wasn't asking him to go (well, one or 2 times I did, but I didn't nag him). He decided to go with me and the whole service, God ministered to him. God answered my prayers that Sunday morning. From then on out, he has been a different man.
Pray for your husband. Let him be who he is, but keep on doing what you are doing in your walk with the Lord and that will encourage him, even if he doesn't say anything or maybe he might talk down to you for it. In his heart, will admire your faith in the Lord. Keep on going to church and the daily change in your (that occures in every believer as we walk with the Lord) will effect him.
I don't know your situation, but God does and He will do what He can to get your husband's attention.