How are story ratings calculated?
Story ratings are based on our member’s answers to the rating questions in our review forms. Reviewers can choose to answer between one and 19 rating questions regarding the journalistic quality of a particular story. Each question is evaluated on a scale of 1 to 5 (e.g., Fairness: 1 = not fair at all >> 5 = very fair). All questions answered by a reviewer are first weighted based on the importance of each question for that type of news (see weight values at the bottom of story rating pages). That first weighted average is then weighted again, taking into account each reviewer’s own member weight, to determine a final, double-weighted rating for the reviewed story. All story ratings during this beta stage are PRELIMINARY, as explained in our disclaimer above.
