Most software review and analyst sites miss the mark for me. There is a fundamental reason why…I want to see the software in action! Why can’t these sites follow this basic formula:
- Standard Use Cases in clear language. Reviewer comes up these. I would even ask the software companies to come up with their own use cases. Some will benefit one vendor, some will benefit another.
- Screencasts accomplishing the case. Each vendor can add whatever audio track they want, but the video has to actually show the product and each step of the use.
- Replacement screencasts should be allowed at any time. Submitted to the reviewer, to make sure they are acceptable.
It’s the job of the reviewer to provide a place where people can make informed decisions and to editorialize. This formula above would do exactly that. What better way to choose a vendor than to actually look at how it’s used in identical business cases?
Of course, some vendors won’t want to participate. They will say, “We don’t want to just show the product out in the open like that.” I would absolutely include those vendors in the review and call the vendor out saying, “Vendor could not prove they could do this case”. Any vendor is going to feel the pressure to provide the data. Making screencasts is pretty easy.
It’s not a billion dollar idea, but it’s needed in the marketplace. If I ran the Better Business Bureau or the Consumer Protection Agency, this is the kind of thing I would build.