Quick questions about cals/protein

[Inagren]

I added up all of the stuff I consume in a day(appox) and the calories came out to a lot lower than I had hoped. Basically I'm just asking do the calories have to be very high to put on a lot of muscle, or does it really come down to the protein? I'm aware that you have to intake more calories than you burn to add weight, but how much of it is fat and what not? Hopefully this makes sense because I'm pretty tired, lol. Here's the basic stats of a day:

2500 Cals -- 96.5 G's Fats -- 193 G's Carbs -- 321 G's of Protein

Idk if it matters, but yea:

Weight: 168-171 depending on the day =/. I weigh myself when I wake up in the morning
Height: 5'10-11
BF: anywhere from 12-14%

If you need any things else to help answer the question I can try to answer the best I can.