you could try giving the bunny some time alone (or free roam) with you for about an hour (or however long you wish to be in the room) and then do the same with your cat. just to distribute even quality time that they spend with you but while also keeping them apart
if it's real wool, it could possibly still smell like the animal it came from. i'm not an expert, but my bunnies go crazy when they smell another species' (such as a cat or dog) scents.