My boyfriend totally gave me the silent treatment when i confessed falling in love with him?

I've known my boyfriend for four 5years, ive liked him ever since highschool im 19 but i never had the chance to be with him because he was in a relationship. When him and his last girlfriend broke up like in sophmore year i waited for a long time so that he could get over her. I knew it wouldnt be that easy. Eventually we re-connected and he started lyking me and so did I. It took almost 6months of us talking untill we finally ended up together. He was my first and i had alot of feelings for him. One night i stayed over at his house and i really wanted to confess how i was feeling because i couldnt hold it in any longer i told him i was falling in love with him?!? and he stayed quiet for a while and when i finally got him to talk he told me that he didnt lyk that i was falling to fast for him because he knows no matter what hes going to hurt me? should i be concerned in anyway? should we not be together? what was his motive on being quiet?