[Coda]

My main problem with surveys and reviews is the selection bias.

Reviews tend to be posted by people who Have Something To Say. This means that problems will be amplified while the satisfied people will either stay quiet or will just say "great product" or something because there's no specific point worth talking about.

Likewise, survey participation favors people who like filling out surveys or who have a vested interest in the subject matter. So I can't really trust the results unless they're carried out with a properly controlled setup.

But when you try to do a properly controlled setup on reviews, you end up with really, really stupid stuff like Amazon Q&A responses that are just "I don't know" because people feel like they're obligated to respond.