League of Legends League players could earn in-game currency for judging

It might seem a bit odd that players with a seven-day ban saw less improvement than

those with a three-day ban, but the player reform team has their own theories on that

result. “When you have a three-day ban you can probably be like, ‘Oh, it’s in the

middle of the week, whatever, three days is not a big deal,’” said Kwoh. “Whereas

seven days you’re almost…”
League of Legends Image
“You’re almost guaranteed to have your actual play interrupted,” Lin interjected.

“Over a weekend, over your main playing period, I think [a seven-day ban] hits the

sweet spot where people [become] a little bit more frustrated, a little bit less

receptive to reform, unfortunately,” said Kwoh.

This would suggest that players with 14-day bans should be even less receptive and

more likely to still be angry at their punishment once the ban is lifted, but the

data shows otherwise. The player behavior team doesn’t have any hard data about why

this is, but they do have some educated guesses. “I think that one 14-day [ban] is

widely known as your last chance,” said Kwoh. “Being away from the game for that

long a time—I think you sort of get the point.”

When the Tribunal was first launched, League players could earn in-game currency for

judging cases as long as their judgments were sound. Some players were concerned that

this provided the wrong kind of motivation for those who might judge cases, though.

So the player behavior team decided to remove the currency rewards for 30 days,

resulting in a 10 percent drop in active Tribunal judges. Then the team introduced a

public “Justice Reviews” profile page showing personal judging metrics like the

number of players someone has perma-banned and the number of “toxic days” they’ve

helped prevent.

The result? “We saw a 100 percent increase in active Tribunal judges that was

sustained after [the Justice Reviews profiles] launched,” Lin said. “We also saw

that Tribunal judges completed 10 percent more cases daily after the launch of

Justice Reviews.”

This experiment went further to prove that League players have a vested interest in

working as partners with Riot to improve the quality of their community. Riot has

heard the message and now has enough faith in the Tribunal system to let players

enact some punishments directly without staffer involvement. “We’re at a point in

the Tribunal’s lifespan where we are confident with the accuracy and rate of false

positives and trust our players to make the right decisions in the vast majority of

cases,” said Lin.