yes its completely normal. If the rabbit is housed indoors then she will only go in the box to feed the babies which is only once to twice a day. Rabbits are prey animals and do not like to hang around the babies because in the wild this would lead predators right to them. Unlimited pellets and hay are fine. If you are not feeding alfalfa pellets I would recommend supplementing with maybe a handful of alfalfa hay once a day or every other day. This is especially if your food is under 16% protein. A lactating mother should be getting alot richer feed than just a house pet.
First thing to do is go in the nest (take it out if its in a box is the best thing to do) and count all the babies. This allows you to make sure none are dead and also allows you to check their bellies. A well fed baby should not be wrinkly (unless its a large breed rabbit). The belly should be well rounded. Since I said before that does may only feed one to two times a day you will need to check the babies multiple times in a day to figure out when mom feeds them. Chances are thats her magic hour and she will stick to it throughout the nursing period.
Babies will grow fur in about 3 days and start opening eyes and ears around 10-14 days. If by day 15 the babies have not opened their eyes they may need some encouragement. Just take a warm wet paper towel and gently rub across the eyes and try to open them. Once the babies have opened their eyes they will become much more active and come out of the box. If they start coming out early figure out someway to keep them contained (we usually move the nesting material away from the front to make the front seem higher. If a baby is out of the nest it could risk death by lack of feeding (why its important to count daily) or chilled (by being away from the warmth of siblings).