Rating missions... psychology in action


BeyondReach

 

Posted

Generally, any time you have a range of options, people have a strong tendency to veer toward the middle. For example, if you have a 1-5 spread centered at 3 being 'average' feelings about something, I would guess the percent of folks answering 2-4 is much higher than the 60% it should be.

Similarly, a lot of folks are seeing '5 star' as meaning in the top 99th percentile or something. Why? There are 5 stars, and no indication you should be grading on a curve.

If you think an arc is better than 80% of the arcs out there... go on. Give it 5 stars.


 

Posted

Quite a few folks rate with a binary No rating or 5-stars too, viewing using the full range of options as worthless. I'm no statistician, but I'd love to know what effect that has versus sb who does use the full range.

Eco.


MArcs:

The Echo, Arc ID 1688 (5mish, easy, drama)
The Audition, Arc ID 221240 (6 mish, complex mech, comedy)
Storming Citadel, Arc ID 379488 (lowbie, 1mish, 10-min timed)

Quote:
Originally Posted by Samuel_Tow View Post
[The Incarnate System is] Jack Emmert all over again, only this time it's not "1 hero = 3 white minions" it's "1 hero = 3 white rocks."

 

Posted

But that isn't how I see it, and I'm not educated enough to say whether this arc is 80% better than the rest of the arcs out there. Therefore I have to develop my own opinion. Usually, I am quite generous in my view of an arc as 5 Stars. Or maybe I just happen to come across a lot of 5 Star arcs, regardless, I rarely rate them 5 stars. Why? Because I feel I can't rate an arc 5 Stars if it has errors in it. Depending how good an arc is, the amount of errors it can get away with increases for me, but it does get to a point where I say there are too many errors for me to in good conscience, almost deem it 'Final' by giving it 5 Stars. It just annoys me so much when I see errors in Dev's Choice arcs especially. Sabrina's Tale is riddled with them! Although when it comes down to it I would say it is a 5-Star arc - although I would actually describe it as scraping into 5 at much lower than non Dev's Choice arcs I've played - the errors...just...rawr.



Bad Voodoo by @Beyond Reach. Arc ID #373659. Level 20-24. Mr. Bocor has fallen victim to a group of hooded vigilantes who have been plaguing Port Oakes, interfering with illegal operations and pacifying villain's powers. He demands that revenge is taken on these miscreants and his powers are returned! You look like just the villain for the job. Challenging.

 

Posted

Quote:
Originally Posted by Doc_Wormwood View Post
Generally, any time you have a range of options, people have a strong tendency to veer toward the middle. For example, if you have a 1-5 spread centered at 3 being 'average' feelings about something, I would guess the percent of folks answering 2-4 is much higher than the 60% it should be.

Similarly, a lot of folks are seeing '5 star' as meaning in the top 99th percentile or something. Why? There are 5 stars, and no indication you should be grading on a curve.

If you think an arc is better than 80% of the arcs out there... go on. Give it 5 stars.
Like MrCaptainMan said, quite a lot of people actually either give it 5 or nothing due to the innate incentives the MA search window gives to peoples' arcs to have a high rating by making it so 5 star arcs are always listed before 4 star arcs, regardless of number of ratings or number of plays. So I'd guess that the number of 2-4 ratings are actually quite lower than the 60% of the rating scale they represent.

I personally give 4 or 5 stars to any arc that I had fun playing, 1 or 2 for any arc that was frustrating or I really hated, and 3 for missions that are pretty average. I find myself giving out pretty varied ratings overall.