Yes, yes you should.
From experience lethargy is a very serious thing. My rabbit, Winter, passed away because I didn't take the lethargy seriously. When it got worse enough, she died within 10 minutes. You can never be sure, even if your rabbit will turn out okay you should go to a rabbit vet.