I'd keep offering him hay and water. Keep checking his activity levels too. I'd also call the vet for an appointment to make sure there aren't any internal damages or broken bones.
Also, try to refrain from carrying your rabbit unless necessary. Rabbits are prey animals and do not like to be...