You may have to clean the cage more than once per week if you want to be able to keep him, at least until he is litter trained and his hormones have settled after the neuter.
Also, if you are cleaning with vinegar which is good then you may want to wipe down the cage with some damp paper towels or rag using just water after first cleaning with the vinegar. I can't stand the smell of vinegar and doing this helps to dissipate the vinegar smell yet the vinegar still was able to break down any urine, etc smells first.
What kind of cage do you have and what is in the cage besides your bun?