I met a guy at a party, wondering if it's too soon to talk to him?

Keep on talking, this could lead to something. Make sure that this is genuine and he seems like a nice guy, so go for it.