I had previously posted my UX Designer interview challenge. I just wrote a new version, so I figured I could post the one I was using here. It is a continuation of the previous challenge.
A famous comedian is the sponsor of the project. He is working with 4 other comedians to rate and categorize a large set of jokes. Each comedian works on different jokes, but they work at the same time and talk to each other via video conferencing.
Challenge Part I
Brainstorm an gamification strategies for this UI to help keep the comedians working without getting bored.
The game should not fundamentally change this UI, although minor modifications are acceptable. It should be competitive and fun and encourage them to keep working.
IMPORTANT: the game cannot significantly sacrifice productivity or quality.
- Total Score. The first thing people jumped to was a total score of how many jokes were categorized. This is just short-sighted. Total score actually DE-MOTIVATES the players once someone is winning. The thought bubble is “Well, I am getting my ass kicked, so what is the point?” Plus, once the winning person is in the lead, they let up because it’s over.
Lesson: Games need to always be close. The loser needs to become a winner soon. Parity is important. This is why baseball is stupid (see chart).
- Failure to come up with ideas. I didn’t think this was that hard, however, most candidates just failed to come up with anything after that.
- Sacrificing productivity or rating quality. It says it’s important, but people miss it 90% of the time. If you set up a game which is a race to do N jokes in the shortest amount of time, then the outcome will be a significant decrease in quality. In other words, people will rush though the jokes. I hate it when candidates deny this reality. Games = incentives. Incentives work in unexpected ways. Read Practical Wisdom by Barry Schwartz for more detail.
Challenge Part II
After brainstorming for 10 minutes, I gave them a possible answer and asked them to do the interaction design for it. Here is the text I hand them:
Game requirements: (not complete)
- There should be several different games that can be started by any player. (One game at a time) Games include:
- Best joke
- Biggest groaner
- Most intellectual
- Darkest joke
- The system picks 25 random jokes and assigns them to each player.
- The players need to categorize and rate their jokes.
- During the game, they pick out 1 joke to “play”.
- When they are all finished, the jokes of the four players are presented to the group.
- They all rate 1-10 for how well suited the joke is to the game chosen. (Best, darkest, intellectual, etc)
- The highest combined rating wins that game.
Sketch it on the whiteboard. You can modify the base admin UI, but only minimally to make room for your game. No functionality can be removed. Don’t spend time re-designing the base UI. Focus on the game. Reminder: This UI is on a modern iPad.
- Failure to leverage gestures. iPad interfaces should work differently than browser interfaces. Only once have I designed something for an iPad, but my thinking immediately jumped to gestures. A keyboard and mouse is just really different and people kept designing mouse UIs when hand gestures were more appropriate. Don’t say click when you mean tap or swipe.
- Failure to understand the situation. I didn’t think it was that hard, but apparently it was. People couldn’t grok the idea that a player starts a game and the others need to respond. I thought it was obvious to use the video area on the right to show the status of people, but zero candidates utilized that area.
- Failure to use screen real estate dynamically. For some reason the idea that information can be pulled on and off the screen was lost. Almost all candidates botched using the screen real estate effectively.
It’s frustrating to me because this didn’t seem hard at first, but it clearly stymied the candidates. Once of the problems is that there is only 30 minutes to do the exercise. Maybe it’s just too much for someone. I might be losing good people by having too hard of a test.
I’m changing the design exercise again. I think I can continue to use the comedian, but I need to change the situation to make it easier to understand. Clearly, I want to continue to test collaboration systems and interaction design.
If you read this and are going to an interview with me, keep in mind, I will be posing an interaction design challenge. Stay calm. Be creative and think out of the box. Don’t just get task completion. Make it fun. Be confident. I believe in you.