Any chance you'd be able to find a quieter fan, maybe a box fan? I had a relatively quiet fan that my late lionhead mix adored. He'd stand on his hind legs in front of it and let it ruffle his mane and belly fur. I might try to make his associate turning the fan on and/or you entering the kitchen as a good thing. Maybe offer a treat every time you come through the door or turn the fan on?
I click my tongue whenever I'm feeding treats. The bunnies both come whenever I make that sound and calm down when I do it because they know it means something good is coming.