We realize that we’re not professional literature critics — we’re just a group of readers who love to read and write about speculative fiction — but we started this site to help SFF readers decide what to read and most consumers, whether of fine dining, vacuum cleaners, or fantasy novels, seem to like some sort of quantification. Thus, we assign “ratings,” even though a few of us find the notion disagreeable. We challenged ourselves to come up with a standardized rating system. Though Marion and Ryan a couple of us are notoriously stingy with our stars, we still managed to come up with a scheme that we could agree on:
I loved pretty much all aspects of this book: story, style, and characters. It will be one of the best books I read this year. Perhaps it blew my mind or changed how I view the world. A 5-star book is distinguished from just a really good book by the level of depth, emotional impact, and style. This book is awesome, so go out and get it today even if it means wading through a horde of orcs.
This is a really good book which I completely enjoyed. It was definitely entertaining, but didn’t blow me away. Maybe it doesn’t quite have the intellectual or emotional wallop of a 5-star book, or maybe I was hoping for something transcendent and it just didn’t quite deliver that. But still, I strongly recommended that you let the orcs pass by, then get the book, even if you have to deal with a straggler or two.
This book was enjoyable and there were qualities that I admired about the work, but it was marred by one or more noticeable flaws that kept it from being “really good.” Still, the good outweighs the bad, so pick this up if you have a long wait while the orc horde goes by.
I didn’t like it and I don’t recommend it. I had to force myself to read it (and it’s possible I skimmed parts). Perhaps the author’s goals are interesting or ambitious but the result is disappointing. Or it might have been boring or had major plot holes or mechanical problems. Or maybe I recognize that I am not the right audience for this book, so it gave me no enjoyment. I think you’re better off counting the orcs in the passing horde than reading this book.
This novel was dreadful in all respects, or was so impossibly poor in one area that no more positive qualities it might have could pull it out of the mire, or it was on a wavelength I just couldn’t tune into. It might have been an act of self-flagellation, but I finished it (possibly skimming) maybe just to see how bad it could get, and maybe just to generate a snarky review if it was written by a popular author. I’d recommend that you throw yourself into the midst of the orc horde instead of reading this book.
I couldn’t finish this book, maybe because it was horrible or boring, or maybe because it was just totally not my thing and I wanted to move on. Give this book to the orc horde. Life’s too short to read bad books!
Of course, we didn’t come to this without a lot of discussion. Here’s what Ryan and Tim had to say:
Ryan: When assigning ratings, I can’t help wondering about the dedication it would take to devote months, perhaps years, on a story or a character or a journey. It must take a lot of time to create a character like Neal Stephenson’s Hiro Protagonist. How odd it must be to devote one’s creative spirit to a story, only to have random strangers represent the entirety of their response to that story in just a few stars. (Preferably 4 or 5.) I imagine it must be disappointing for the author, if only because as someone who writes reviews, I sometimes find it irritating that I might spend an hour or so writing a review only to have readers glance at the number of stars I use to summarize the impact a work made on me. It may not make a lot of sense, but the number of stars associated with a novel or a number followed by a % is more likely to convince readers to move to a city like China Miéville’s New Crobuzon than anything I write about it. Which is why I give out 5 stars sparingly.
Tim: There are a lot of issues with assigning stars to novels. Of course we need a bit of a concrete rating system, but how are we to manage all the factors? Is it ‘good’ according to me and only me, the reviewer, that fiend who secretly (gasp) doesn’t much care for Terry Pratchett novels yet has the temerity to rather like confusing, oddball curiosities like Lud-in-the-Mist? Or is it ‘good’ in relation to other books in the same series, or in relation to the genre as a whole? I personally tend to rate books in relation to what I believe their position is in the subgenre from which they hail. I’m far less a fan of romantic fantasy than I am of epic fantasy, but if a good romantic fantasy dances hopefully by in its best dress, I’m not going to scoff, turn up my nose, and send it over there with the other riff-raff. Subjective I may be, but there are all sorts of fantasy readers, and whether or not I am the target of a novel is something I try to keep separate from my review. If I think a novel is a good example of urban fantasy, it gets a high ranking. Thus when I’m reviewing an IRON DRUID novel, for instance, I’m reviewing it in relation to other novels in the subgenre of urban fantasy. There’s something to be said for the purely subjective experience, I suppose, but I do tend to find this way of doing things more fair to viewers. At least if I’m forcing myself to contextualize the novel I’m not rating it a star lower simply because I happened to be suffering from indigestion most of the way through chapters 32-56.
Ryan: If I assign a novel 3 stars, there were likely things that I admired about the work. For example, although I am a big fan of William Gibson, I was not very impressed with Spook Country. Still, Gibson is an outstanding writer and the mood of the novel stood out to me. I do not regret having read Spook Country, and would consider reading it again to see if I might enjoy it more now that I’m older. Although some might refer to the 2 star rating as “mediocre,” I tend to have more in mind than “mediocrity” when assigning 2 stars. In my opinion, there is an audience for the 2 star novel. However, the novel did not speak to me. When reading SFF, I find that I often assign 2 stars to works within a series. There is certainly an audience for Robert Jordan’s WHEEL OF TIME series, but some entries are far weaker than others. (Oddly, I’m inclined to rate the series 5 stars, though I’d likely not rate any work within that series a 5). At other times, I might rate a novel 2 stars if I find the author’s goals to be interesting or ambitious but the result disappointing.
Tim: For me, 2 stars is a failing grade, the point at which the novel’s issues have swallowed up the reading experience to some extent, but it has some good points remaining. 1 star is something I’d use very sparingly, indicating that the novel was simply dreadful in all respects, or was so impossibly poor in one area that no more positive qualities it might have could pull it out of the mire.
Ryan: Assigning stars to novel is a ridiculous pastime. The only thing I can say in its defense is that it sometimes leads to an interesting discussion. “Really? Just three stars? Justify your rating!” In other words, the imperfection of star ratings is often what makes them so fun. It’s just unfortunate when counting takes priority over thinking. So readers are right to be wary of star ratings. Fortunately, they can read the entire review. Or better yet, they can read the book and consider their own response to the story. Like everyone else, I’ll be interested to see how many stars they assign it.
Tim: I like to think this is a fairly just way of dealing with the necessity of assigning rankings to these texts. I admit freely, however, that I often go back and forth on rankings quite a bit, and I often try to give positives and negatives for various types of readers. I encourage anyone who wants clarification on my opinions to ask me via a comment.
So, readers, how do you feel about ratings for books? Is the rating more or less important than the review? Do you prefer to have a quantification scheme or would you rather read a review to help you decide whether to read a book? How do you use (or not use) ratings? If you rate books on your blog, at Amazon, or at Goodreads, what is your rating scheme like?
I don’t rate books because I’m also a writer, so something about it makes me feel like I’m eating my own young. As a reader who has a limited amount of time though, I love when other people review a book, and I give a lot of weight to the reviews I read.
I’d call ratings a necessary evil. It gives us as readers a way to distill down the review given in an easily understandable way. I might read a review where the reviewer was harsh on a certain aspect of a book and write the book off without realizing that, despite that particular flaw, the reviewer loved the book and still recommends it. The rating feels more objective and concrete.
That said, if a book receives 5 stars, I’ll still read the review to find out if it’s something that would particularly appeal to me. I don’t like vampires. No slight intended against someone who writes urban fantasy starring vampires. I’m just not into any creature that sucks blood. I also have a real pet peeve about books where the internal rules are violated. We all have preferences about happy ending vs. ambiguous ending, level of violence/language/sex, POV violations, etc. that only a review can reveal about a book. A rating without a review is useless to me.
Very nice breakdown. I’d say my stars match…but a 3 star from me is usually a pretty darn good book. I RARELY finish anything that isn’t at least 3 stars and only then because I was fooled into thinking it was going to get better (in other words a compelling story is hidden underneath and there’s enough action or I like the characters enough to continue…but woe to the book that fails me after convincing me to finish only to disappoint! It happens!)
Totally loved Ryan’s comments about spending all that time writing a review to have it dashed by readers glancing at the stars. Yes, you have the right of it–years or months on a novel to entertain the readers for mere moments by comparison…and then toss a couple of stars on it. It’s ironic for sure.
Yes, I sometimes review & rate books on Amazon. On the whole, it’s because I really liked a book and want to share it, or really hated a book and wish someone had warned *me* off. So I avoid the subtle rating problems in the tricky middle!
There are a few things I especially hate: the Idiot Plot is one, especially when the person who triggers the events is female — short road to a D.N.F. for me. Excessive violence or what’s politely called grittiness doesn’t do much for me, and I also dislike authorial unfairness.
I also have a fairly short fuse in regard to sloppy editing, especially where details don’t match or the text doesn’t communicate its meaning because the language is so idiosyncratic. (At this point you can probably tell I’ve been reading some of Amazon’s slush pile.)
I’d probably not attempt to review an audio book because the performance is so crucial; for some readers, the telephone book would do; for others, even a favourite author wouldn’t cut it.
This site’s reviews were my original reason for bookmarking it and reading all the five stars; they continue to be my reason for popping back every day (I do read other review sites as well; there are interesting differences sometimes, indeed today is one of those days.) Meantime, I’m fairly familiar with the reviewers’ tastes and know whose ***** will suit me just fine!
I pretty much agree with how you’ve laid out your star ratings. For me a three star book would be one that I enjoyed and might read again sometime. Two stars means I read it but it’s not a book I’d ever re-read. One star means I’ve probably had to skim to get through it and wouldn’t recommend the book to anyone.
I do look at star ratings but I want to read reviews too since what may bother a reviewer about a book may not be a problem for me. I’ve passed several of my DNF books on to a friend and he’s loved them because his reading preferences are different from mine.
As a new author myself, I feel uncomfortable slamming someone if I really didn’t like their book. I will give positive reviews though, especially when I find a work that was really fun to read. For me, the entertainment factor is most important. I don’t need it to be a literary masterpiece and I don’t expect most novels to “change my life.” But I do like a story to immerse me in another world and let me experience some wild and powerful characters.
I think that the star reviews are sometimes more helpful than the written review because, frankly, I don’t want to know too much about the story before I read it and I also don’t want to be swayed by someone else’s interpretation of the book before I get there.
I like ratings because it gives me a quick way to see if someone enjoyed a novel. I don’t like spoilers, so I tend to not read the majority of a review unless I’ve already read the book. I only look at the rating and the main reason why it was given the rating. Whether a blogger used 1-5 stars, A-F, or different shelves (such as pre-order, buy, borrow), I just like to see a quick glance. There are some bloggers that I often agree with, and others that I tend to disagree with, so even just the rating will give me an idea of whether or not the book is for me.
My personal rating system is:
5 Stars: Wanna make babies w/it.
4 Stars: Loved it.
3 Stars: Liked it.
2 Stars: Meh.
1 Star: Not for me.
DNF: Did not finish.
I think that the stars are helpful once you get to know the reviewer. There are some five star books on this list that may be great books, but I know based on the reviewer that they are probably not for me. Not that they are wrong in their assessment, just different reading tastes. I still read those reviews though, because I do enjoy reading other peoples thoughts on books. If I know it’s a book I’m going to read I will usually wait until after I’ve formed an opinion to read the reviews.
My personal rating system is similar to yours. I give 3 stars to anything I liked but wouldn’t read again. I keep my 5 stars for books I will definitely re-read or that just captivated me to where I couldn’t put it down. On this site I look at the stars first but do read the reviews. When I’m checking out a book I’ve never heard of before (like on Goodreads) and the syopsis itself doesn’t draw me in, I will usually read 1 or 2 of the 4 or 5 star reviews and then read 1 or 2 of the 1 or 2 star reviews. That usually gives me a good feel for if I want to read it or not.
Even though I can see a downside, I like having rating systems. Even with just the “good” books out there, I never have enough time to read everythin I want. :)
Just to say that I have linked to your blog and also publicised it:
http://wp.me/p4T72p-aF Essential SFF Blogs
Keep up the good work!
Dr. Arnell, now retired, reviewed a book some time ago. A new book has been released in the series and I was wondering if it’s possible to get a review for it?