Being conservative with numbers, a single female rabbit that starts having babies (and then those babies start also having babies), by the end of year two, you could have almost 3000 rabbits!!! (that's counting males & females)
You can see those stats here:
http://www.bio.miami.edu/hare/scary.html
Hence the phrase "breed like rabbits"!
It isn't healthy for your female to keep having back to back litters. It is very stressful on her body. Please separate your male from the momma.
The babies will need to be separated (males from females) by no later than 10 weeks of age.
Once those babies are 12 weeks, they may also start needing to be separated into individual cages -- 1 rabbit per cage -- or their hormones could start making them fight each other causing serious injury (think vet bills and stitches).