Help, what should I do?

I've been seeing this guy. I've hung out with him 6 times so far over the period of 3 weeks. I've developed feelings for him. The problem is, we honly hang out at his house in his room. Last night I asked him "Do you even like me? We only hang out at night." And he said it's because he's at work a lot and he has to hang out with his cousin after work (they're really close). I know he hasn't known me that long, but I can' t help how I feel. Sometimes we hook up, and last night that was our intention of hanging out, but he said he was too tired and we ended up just talking/teasing/cuddling all night until he fell asleep on me. He's always talking about how hot certain woman celebrities are and stuff, and recently he told me he was in a shitty mood because his ex was getting engaged but he didn't want to date her but he still cares about her and doesnt want her to do something stupid. Is it too early to tell him that I wanna be with him? I mean, we act like a couple when we're together.