IA Summit 12: Crowdsourced Unmoderated Usability Testing
I choose to attend a couple of the 20 minute dual session blocks to see what I thought about the smaller sessions. I have to admin I was impressed with the amount of information people were able to fit in 20 minutes. The first one I attended was Crowdsourced Unmoderated Usability Testing by Inge De Bleecker. This was a nice overview of some of the tools currently available, and some of the pro’s and con’s of outsourced recruitment and unmoderated testing.
Crowdsourcing is how we go about…
- …outsourcing to a large group of people in an open call.
- …enabling convenient on demand access to a pool of human workers .
- Screenshot click tests.
- Screenshot timed tests.
- Tasked based usability study with online survey.
- Personal device use.
- Testing in their own environment.
- Fast turnaround.
- Cheap(er) testing.
- Observing your users while completing tasks.
- Asking ad hoc questions.
- Subject video recordings.
- Participants can’t get blocked or they won’t be able to continue.
- You only get one shot with each participant.
- You have to guide them to the right task without influencing them.
- All questions need to be required, so you’ll need to omit the extras, and be sure to add an “other” option.
- Be sure to encourage participants to write down their thoughts at the end.
- Remember that the task and questions types will depend on the tool being used.
“If you pay peanuts, you will get monkeys”