Seeing the bigger picture
What has Botticelli’s The Birth of Venus got to do with market research? Well, note the crop. But as nice as it is, it’s only the bigger picture that tells us the actual story.
This is at the heart of the next issue for discussion; the ‘new’ (?!) practice of listening online.
Of course ‘listening’ itself, as a method of research inquiry, is pretty obvious and hardly new. What is new* for market research however, is;
- the online location per se,
- some of the online listening technologies, and
- in some cases, the actual content generated online.
But new or not, you still need to know exactly who it is that you’re listening to. And you also need to think about the context.
For example…
If you’re undertaking a market research listening exercise for a client, let’s assume, quite reasonably, that your focus will be on listening to their customers or potential customers.
Is the Internet a good place to listen?
Well, of course it is! But there are some very important questions to ask before you begin;
Of all your client’s customers/potential customers, how many have access to the Internet?
And of all your client’s customers/potential customers who have access to the Internet, how many are confident enough in a) their opinions and b) their writing (or video editing) skills, to express those opinions publicly online?
And of all your client’s customers/potential customers who have access to the Internet, and who are confident enough in a) their opinions and b) their writing (or video editing) skills to express their opinions publicly online, how many bother?
And of all your client’s customers/potential customers who have access to the Internet, who are confident enough about a) their opinions and b) their writing (or video editing) skills to express their opinions publicly online, and who bother, how many express those opinions in an articulate way (ie in a way that a marketer or market researcher might find of use)?
The skews are breaking my brain.
Defining your sample in terms of exactly who it is that you want to get feedback from is absolutely key in terms of determining where and how you should collect your data.
Notably, if your client’s target market comprises a wider group of people than the customers or potential customers who fit the very narrow profile described above, then – and critically – collecting useful data to generate useful output will mean going well beyond the insights you glean from your ‘new’ online listening endeavours.
*relatively speaking and/or as the hype would suggest
Filed under: market research | 2 Comments






This reminds me of some of the debates that occurred as quant research increasingly shifted to online panels (debates which are largely now forgotten as clients save time and money doing things online) – the question being, even if you can represent the target group demographically, aren’t all these guys online going to be radically different attitudinally – what with being super-techsavvy earlier adopters and all?
There’s no doubt that the skews online are different from the skews offline – but I don’t believe there are any less of them. Just as there is only a certain proportion of people within a target demographic who will express their opinions online in a useful and erudite way, there is a similar (if not smaller) proportion of that target group who would agree to take part in focus groups/interviews/completing questionnaires giving us useful insight in the old fashioned way. It is a particular type of person who is willing to sit in a room with 7 strangers and talk about soap powder for an hour, just as it is a particular type of person who might tweet about how rubbish/great their soap powder is. We can identify and listen to either of those people – but you client’s target will always be wider than who they are.
I agree that anyone who undertakes an online “listening” research project needs to understand the general composition of the group to whom they are listening. However, I do not see the potential skew as a reason to avoid the method generally. Another commenter very correctly pointed out that every other method of data collection comes with its own bias issues. I don’t see the practice of listening online to be any better or worse in that respect – just (possibly) different.
It really comes down to this – it is the researcher’s responsibility to understand the objectives and the market, and then to select an appropriate methodology. There is no universal right or wrong research method – there is just a proper match of methodology to the objectives and the market or not.
Is listening online the right way to measure satisfaction with a company’s product? Almost certainly not. Is it a good way to get a feel for the zeitgeist of the group of customers likely to be labeled “opinion leaders” or “influencers.” I’d argue that it is.