How we rate

The object of this article is to point out and perhaps instill the concept of consistency to how we score our articles. It is meant as a guideline and re-enforcement of common sense. We currently rate six areas on a 1 to 10 scale. The largest misconception of our rating system is the difference of importance between each integer.

The 1 and 10 scores are both extremes and should be used as such. For any single area to rate a 1, it must truly be horrible. If a title has graphic bugs that make playing it neigh on impossible, then that may warrant a score of a 1. The likelihood of such a situation with a released title, even a poor one, is not much at all. A score of a 10 should be just as rare. To actually deserve a 10, a game must be perfect in every respect and truly redefine the industry standard. If this sounds unattainable, then you are thinking about it correctly. There will always be something wrong with a title and it is our responsibility to find those flaws and point them out for you.

Scores 2, 3 and 4 are ‘poor’ scores. For a title to receive such a score, it must truly be in a sad state and a complete disappointment. Unlike the extreme score of a 1, a score of a 2 or 3 means that the game is playable, as painful as it may have been. Extremely dated graphics and sound, persistent bugs, terrible or incorrect voice/text work are examples.

The popular misconception is that 5 is a bad score. This isn’t possible as it sits pretty much in the center between 1 and 10 and represents the average. If a title is satisfactory in all areas, it will at least qualify for a 5 or better rating. It would require the reviewed game to be ‘no frills’ yet functional.

Scores 6 and 7 are ‘good’ scores. These scores reflect a great deal of effort and care was taken in developing the game. An example of this, using graphics again, can be seen in a title that offers smooth and flowing visuals, but perhaps it is using an out of date graphics engine, something that has been around forever already. A ‘good’ score means the game is pleasing.

Score of an 8 or 9 is an ‘Outstanding’ score. This score is given when a game far exceeds expectations and/or offers something brand new or ground breaking to the genre. It has become common to see titles with high scores because common perception has elevated the 7s and 8s to ‘average’ scores. We work hard at not following that path and will award these scores only when the title deserves an outstanding.

The final facet of scoring revolves around personal opinion. As stated earlier, personal opinion will and should weigh into the final calculation of how you want to score a title. This adds the unpredictable dynamic to all game reviews. The best advice to govern this wild card is just common sense.

If we review “Jimmbo’s Mutant Turkey Shoot” and reward mediocre scores of:

• Graphics: 6
• Sound: 7 (real turkeys)
• Interface: 5
• Replay: 5
• Gameplay: 7
• Stability: 6

With scores such as these, it would be reasonable to state that an Overall score of a 6 would be fair.

As a site, we do not average our scores. It would take away certain freedoms when it came to review scores. Since we do not average scores, we add our personal preference to the final score. If I felt that “Jimmbo’s Mutant Turkey Shoot” was a ridicules game that should have never been made, I could let it sit at a final score of 6 or bump it down to a 5, with justification. We won’t just say “this game sucks” and leave it at that. Why does it suck? Why does poor “Jimmbo’s Mutant Turkey Shoot” deserve not to exist? We have a full review to voice our opinion and will attempt to do so to the best of our ability.

If the title earned a 7 in sound because it used real turkeys for the effects, then it deserves a 7 whether you like the title or not. The opposite is also true; If we genuinely enjoyed chasing around those poor orange and green five legged turkeys, then perhaps we may bump that final 6 to a 7 instead.

Reviewing is emotional and will provoke reactions from friend and foe alike. We are not afraid to maul a game if it deserves it even when we are sure to piss some people off. It is our responsibility to tell it like it is, even when there are some who don’t want to hear it.

Individually, we all look for different things while reviewing a title. The art of reviewing anything is solely based on the opinion and preferences of the reviewer. Think of a title from the past you absolutely hated. Imagine doing a review on that title now. It is likely that the review would not be very positive. If you were to do a review on a title you absolutely loved, the review will likely be very positive, even to the point of being more forgiving then perhaps you should have been. Bias plays a role in game reviewing, even if the reviewer will always try to remain as objective as possible. It is ok to be excited about a title, but we try not to allow your inner ‘Fanboy’ to take control and influence the outcome of the article. You, our readers, come to us for information about a title you are interested in purchasing, not to hear over-caffeinated ranting about how awesome the game is. People want to hear the good, but then need to hear the bad.