I've asked this one a lot myself on my LJ, lol. And yes, I've seen the inverse relationship between how much you like the story/how good you think it is, and the review count. I had a look at your profile and I think you're doing pretty damned well.
There are certain variables I've discovered (lol, listen to me, variables!) but one of the most important is which fandom you're writing for. KKM and HP are pretty big fandoms (HP the biggest - I know, I've written for it XD). The bigger the fandom, the more likely your fic is to get swamped and lost on the first page within ten minutes. There's nothing you can really do about that one, unfortunately.
Another one is that the story is really good - and it seems bad to say this, but I know it's true because I've felt it myself many a time - sometimes it's so good that the reader feels too awestruck or lost in the story moment to leave a review right away. So they fave or do something else. I get round this one by always sending a PM to say thanks for the fave, or something like that. Quite often, I get a reply saying, thanks for the message, I really liked your story, and end up getting a short review, lol!
So it's not a reflection on the quality of your work, or the work of others. And, again, I think you're doing really well. Getting fifty-three reviews for a one-shot in this day and age is fantastic! :D