ABOUT 5 HOURS AGO • 4 MIN READ

Friday Finds — Your learners scored 87%. So what?

profile

Friday Finds

Spend 10 minutes. Walk away with actionable ideas you can use Monday morning in your L&D program.

Friday Finds

Fresh ideas, practical tools, and marketing-inspired thinking for people who design learning.

Well, my Via Ferrata adventure last week was a total blast. So naturally, I’ve decided the sensible next step is to upgrade to a bigger version in West Virginia next week. More height. More exposure. More opportunities to question my life choices halfway across a rock face. (Wish me luck!) And oddly enough, that idea of “bigger compared to what?” connects pretty well to this week’s newsletter.

Thanks for reading!

🎵 Today I'm listening to Arrested Development

Supported by iSpring

Create Better Learning. Spend Less Time Doing It.

iSpring LMS uses AI to help you create content faster, personalize learning, and take some of the tedious admin work off your plate; all without adding more complexity to your workflow. If you want the benefits of AI without another complicated tool to manage, it’s worth a look.

See iSpring LMS with AI in action →


A Score Without Context Is Just a Number

You finish a course and score 87%. Pretty good, right? Maybe. What if everyone else scored 96%? Suddenly, that exact same 87% feels very different.

That’s the problem with a lot of training feedback. We give people a number, but we don’t always give them enough context to know what that number means.

What happens when you add a benchmark?

A recent field experiment published in Management Science looked at employees taking a voluntary online training program on agile project management and OKRs. One group saw only its own test scores. The other saw its scores plus how its performance compared with other employees, displayed anonymously in deciles.

The difference got my attention. Among employees eligible to continue, the odds of starting the next module were 4.35 times higher for those who received the relative performance information. Even more striking, just 17.5% of the score-only group finished all four modules compared with 66.7% of the comparison group.

Same training. Same tests. The big difference was that one group had a meaningful reference point.

A number needs something to push against

Think about the difference between these two messages:

You scored 87%.

You scored 87%. That puts you in the top 20% of participants.

Same number. Very different signal.

The study builds on social comparison theory: when objective standards are fuzzy, people often look to others to help judge their own ability. An 87% score tells you what happened. Knowing where 87% sits relative to a useful benchmark helps tell you what it means.

That distinction matters in L&D because we throw isolated numbers at people all the time. Quiz scores. Assessment results. Completion times. Practice scores. Then we assume the learner knows how to interpret them.

Often, they don’t.

Also supported by Neovation

Most planning starts with where you want to be. This session starts with where you are: whether your leadership team is aligned and whether there's enough trust in the room to disagree and still move forward. You'll be able to decide whether to plan now or shore up the foundation first. It's "Strategy Readiness" on September 23, at 1 pm ET / 12 pm CT / 10 am PT.

Last chance to register →

Please don’t turn this into another leaderboard

The takeaway here is not, “Excellent! Let’s rank everyone.”

In this experiment, the comparison was private. Employees knew where they stood, but they couldn’t see anyone else’s individual score. The researchers also used deciles rather than a winner-take-all ranking, giving participants a clearer sense of their position and potentially a realistic next level to aim for.

That suggests a much more useful design question: Could we give learners a meaningful benchmark without turning the experience into a competition?

You might tell someone that most first attempts land between 70–80%, that their result is higher than 75% of participants, or that people in similar roles usually complete a task within a certain range. You’re not creating winners and losers. You’re simply making the feedback easier to interpret.

There’s an interesting wrinkle here, too. The effect was stronger among people who were more competitive, which probably won’t come as a surprise. But the researchers didn’t find evidence that the effect depended on whether people had previously performed particularly well or poorly. In this setting, comparative feedback didn’t appear to chase off the people at the bottom or cause the people at the top to stop trying.

Try this

Pick one piece of feedback from something you’re designing right now—a quiz score, simulation result, practice activity, whatever—and ask one question:

Does this number actually mean anything to the learner?

If the answer is “not really,” experiment with adding a useful reference point. Not everywhere. Not publicly. And not as some giant gamification initiative. Just enough context to help someone answer the question they actually care about: How am I doing?

One important caveat: this was one field experiment with only 79 employees at one company in one voluntary training program. The researchers also couldn’t observe exactly how participants interacted with the learning content itself. So this isn’t a universal rule. It’s a promising finding worth testing in your own context.

The Bottom Line

Feedback without context is often just a number. If you want learners to know how they’re doing, and perhaps give them another reason to keep going, don’t only tell them their score. Help them understand what that score means.

Sometimes the benchmark is the part that makes the feedback useful.


Go Deeper

The Impact of Relative Performance Information on Employees’ Persistence in Voluntary Training

The research behind this week’s issue. A real-world experiment tests what happened when employees could see not just their scores, but where those scores stood relative to others.

Less Information, More Comparison, and Better Performance

A fascinating companion study from professional sports. In this field experiment, providing only relative performance information produced stronger performance effects than showing people both absolute and relative measures. An intriguing reminder that more feedback isn’t automatically better feedback.

Relative Performance Feedback: Effective or Dismaying?

Here’s the useful counterpoint. Comparative feedback didn’t help everyone equally, and some lower-ability participants actually performed worse depending on how the comparison was designed. The benchmark matters.


📍Where I'll be next

P.S. Know someone who would find this helpful?

The best way to support Friday Finds is to pass it on. Forward this email to a friend and invite them to join 3,000+ other readers at miketaylor.kit.com

(Already subscribed? You can grab my book, buy me a coffee, or book me to speak at your company.)

600 1st Ave, Ste 330 PMB 92768, Seattle, WA 98104-2246
Unsubscribe · Preferences

Friday Finds

Spend 10 minutes. Walk away with actionable ideas you can use Monday morning in your L&D program.