Might there be clever strategies for a user to usually answer skill-testing questions right even though he doesn know the answer?
Skill-testing questions that can be answered easily, whether because they are inherently easy or are subject to some clever answering strategy, will be rated as lower quality and/or easy and will thus have less effect on the answering user’s skill points, and likewise on statistics. A user following some clever answering strategy in hopes of often getting right answers without mental effort will only succeed in answering these “easy” questions moderately well and still fail to correctly answer the more difficult questions which have more effect on his competency. That user will either contribute to the low end of the competency curve in a scatter plot (simply making its slope more obvious), or be eliminated as an outlier in analysis.
