Wisdom of WA Crowd Experiment
A year ago Forrester Research Inc. published The Forrester Wave(tm): Web Analytics, Q3 2007 report which included a bubble chart depicting the Web Analytics vendor’s landscape.

The vertical axis represents the vendors Current Offering. In a scale value of 0 (weak) to 5 (strong) accounting for the following factors:
- Data handling: How well does the vendor handle data?
- Reliability: How reliable is the vendor’s hosted/ASP platform?
- Metrics, dimensions and correlations: How robust is the product’s set of metrics, dimensions and correlations?
- Reporting and analysis: How robust is the platform’s support for reporting and analysis?
- Integration: How well does the product integrate with the client’s technology ecosystem?
- Usability : How well does the product conform to software usability best practices?
- Service and support: How robust are the vendor’s service and support offering?
The horizontal axis represents the vendors Strategy in a scale value of 0 (weak) to 5 (strong) accounting the following factors:
- Product direction: How strong is the vendor’s product strategy?
- Commitment: How many employees does the vendor have dedicated to this product?
- Reference client strength: How strongly do reference clients endorse this vendor?
The size of the bubles represents the vendors Market Presence in a scale value of 0 (weak) to 5 (strong) accounting the following factors:
- Installed base: How large is the vendor’s installed base of customers for this product?
- Industry presence: Does the vendor have a significant presence (15 or more enterprise-class clients in the following industries? (Banking & Financial services, Leisure & Travel, Entertainment, Retail and Publishers)
- International presence: How suitable is the vendor’s product for use worldwide?
I hope their 2008 Q3 report comes out soon! While I waited for it, inspired on James Surowiecki’s The Wisdom of Crowds, I set-up the following Experiment.
Why not pick up the brains of Web Analytics Demystified Forum members to build the same chart and afterwards compare it with Forrester’s Reserch updated report.
The experiment is over. See the results here.
It’s really simple
Could you value these 3 dimensions (Current Offering, Strategy and Market Presence) for the following vendors Omniture/HBX, Coremetrics, Webtrends, Google Analytics and Yahoo Analytics?
Answer based on your experience as a Web Analyst and WA market knowledge. Take the survey now
Hi Andres,
Very interesting subjective experiment…I’m eager to see your findings.
Cheers,
John
John Lovett
31 Dec 08 at 4:33 pm
I Don’t think i can take this survey as I’m not into all the Web Analytics tools. But will forward for the survey results
krishna
1 Jan 09 at 2:44 pm
Tried to take the survey, but I’m not familiar with all of the tools, particularly in their current incarndations. If you remove the “required” or offer a Don’t Know/NA, you will get more respondents and a more knowledgable set of responses.
Terry
3 Jan 09 at 3:15 am
Thanks to those that have taken the survey so far.
Terry, I have removed the required status on the questions so that anyone that will like to take the survey and express their opinion on only some vendors can do so.
If you choose to answer for one vendor please answer the 3 questions for it. Thanks!
I will not post individual answers and I won’t publish the aggregated data of any vendor with less than 30 answers. It’s all about the crowd! Please help reach that threshold.
Andrés
7 Jan 09 at 1:00 am
Hi Andrés:
Thanks for the invitation to take part into your survey.
I believe you probably will discover some interesting findings with your experiment.
Most remarkable, I guess, is most of Web Analyst are only familiars with one maybe two tools and actually ignore everything about the others, besides their product name.
By the way what happened with “the most austral blog on Web Analytics” I want to discuss this since you are most of the time on BCN
Regards from Baires,
Justo
19 Feb 09 at 6:22 pm
Justo, you’re right I dropped “the most austral blog on Web Analytics” tagline. It didn’t feel quite right with me here on Bcn as you pointed out. I still kept a wink to Chile.
How are things going in Baires? I was hoping to travel to Chile in the next months. I even thought of organizing a seminar or workshop but so far I haven’t decided anything.
take care,
Andrés
Andrés
24 Feb 09 at 11:35 pm