Do you have pictures of the baby? I could help you figure it out if you get a few clear pictures.
Aside from that, all four of these rabbits should be separate. Unaltered males that have reached sexual maturity should be separated immediately, I often have to separate them by 8 or 10 weeks! Otherwise, they'll constantly be mounting each other, which can quickly snowball into fights...to the death.
In addition, babies should not be housed with unaltered males either, for the same reason. The buck could pin the kit to the ground, which can be terrifying. The kit will either fight back or quickly become a really frightened, skittish rabbit. Neither of which you want to happen!