I really appreciate your sincere questions as well as the heartfelt answers you have already received from others catchers, all of which are basically correct.
The first thing I want to say is THANK YOU - for your tremendous contributions to Stall Catchers. And a big thank you as well to all who responded so far, including some of our most active catchers as well as Nozomi Nishimura, who is one of the key biomedical researchers on the Cornell team that is generating all of our data.
Next, I will do my best to clarify what is going on with Stall Catchers and how we intend to handle the "Maybes". So the first thing to explain is that the better you are at catching stalls, the higher that blue bar will go, indicating your sensitivity. When your sensitivity is higher, you will get more points for ANY kind of answer.
When your sensitivity is high, that means you are providing expert-like answers so we don't need to train or check up on you as much. In that case, you will see more vessel movies where we really don't know the answer - in other words, the "maybes". What it really means is that we are leaning more heavily on you for the research. But at the same time, we want to ensure you are properly rewarded for your efforts and that your score reflects this level of contribution. So when you are seeing lots of maybes, we give you additional bonuses on the calibration movies to make up for it (perhaps you have noticed this). In other words, even if you are seeing more maybes that before, your score will still go up faster overall than if you were seeing fewer maybes.
That said, because we are sampling randomly, there are time when you might see a long string of maybes, just by chance, before you see a calibration movie, which could certainly be discouraging. When you are working that hard and your answer seems to be in agreement with the consensus, to get so few points is frustrating.
We have a plan for this. We were keeping it as a surprise, but implementing this plan has taken a bit longer than we expected so I will let the cat out of the bag. We are building a new feature we call "REDEEM". The basic idea is this: whenever you annotate one of the "maybes", instead of giving you a small number of points for your good faith effort, we will instead hold off on giving you any points until we can turn the "maybe" into a "yes" or a "no". Once we accumulate enough answers from other people to come up with an expert-like "crowd answer", if your answer agrees with the crowd answer you will get as many points as if it had been a calibration movie! But if your answer doesn't agree, you will get no points. Whenever one or more of the vessel movies you have answered is assigned a crowd answer, you will be notified, at which time you can click to redeem all your points.
Please keep in mind that when we first roll this out, it may take a while for your maybe answers to reach maturity. But once they do, you will start to see big points rolling in for all of your correct maybes. Indeed, some days you may log in and get more points by redeeming your correct "maybes" than by annotating new vessels.
So how long must you continue to tolerate the low-point "maybes"? I can't give an exact time frame, but I can tell you it is now under active development, and we think it will be ready in a few weeks.
We thank you all for your patience and loyalty to Stall Catchers, and we have many plans in store to make this into an increasingly engaging and enjoyable pursuit. Naturally, we will continue to rely on the catcher community for candid feedback to ensure that we remain on the right track.
I hope this addresses your concerns, but if I have created more confusion than I've resolved, please let me know and I will do my best to explain. In the meantime, we will do our best to get the "redeem" feature rolled out as soon as possible. Frankly, I'm counting on it as a way to climb my own way back up the leaderboard. I may never catch up to all you high flyers, but my mother keeps sending me emails saying she has passed me on the leaderboard and, well, I just can't let that go on for too long
All the best,