If I remember correctly, antlers are made of the same thing bones are, in contrast to horns which are made of the same protein as fingernails and hair (keratin).
I imagine it would be "safe" and maybe wild rabbits do chew on them, but I don't know how it would affect them nutritionally, since...