I think it is VERY important, that you express to him, in a calm manner, that you are not interested in doing this alone, and his actions are causing you to dislike him.
I think he needs to hear the seriousness of what his actions mean. Then decide on a compromise. If when he comes home from work he is allowed to take 30m to himself to relax after work (after his shower), then he has to take the baby for 1 hour with no TV or computer. Ask him if he thinks this is reasonable, and if he thinks he can manage.
I agree with a PP that a night out is not a bad thing, and if you don't let him do this stuff he will resent you. He needs an outlet just like you do.
If he won't listen, tell him flat out that your marriage is in trouble and that you want to go for counselling. If he refuses, go alone.