headermask image

header image

Regarding the Quest for Communication Statistics…

(UPDATE FEB. 15: Read the followup to this article.)

As you might imagine, in my work as a content and communication consultant I often get asked for research and statistics on various topics in my field.

I’ve gotta admit, I dread those questions. First of all, research and statistics are practically useless when it comes to demonstrating the value of good communication practices – since that value is generally realized in ways which, while significant, is not easily quantifiable or traceable. Secondly, most of the research and statistics I see getting tossed around in this realm are of specious quality or relevance, once examined closely.

Today I had an exchange with my colleague Toby Bloomberg of Diva Marketing that touched on this issue.

Here’s what she asked me…

Toby wrote (via e-mail, published here with permission): “Wondered if in researching your post on Handling Online Vermin series (excellent!) if you came across any research, case studies, specific examples regarding the risk of negative/unwanted feedback – and the administrative costs to monitor corporate blog posts.”

I responded:

Nope. My intent was to give general advice on communication based on my own extensive experience, so this series isn’t a research piece.

I find myself generally disenchanted with quantitative research about communication issues. I understand why organizations want statistics and cost figures. I don’t blame them for asking. However when it comes to communications it seems to me that the most significant benefits and costs are rarely quantifiable or direct.

Also, not all interactions are equal. For instance, a blog post might attract 100 comments, but only two of those might be significant for whatever reason – and they might be VERY significant indeed.

I think statistics in the aggregate sense end up confusing the field of communication and distorting the cost/benefit considerations more than anything else. Anecdotes, real-world experience, case-specific analysis, and common sense are far more useful to business decisions about communication channels and strategies. Just my opinion.

That said, I do think that costs, evidence, and numbers matter – especially in business. However, I don’t think with most types of communication you can draw a direct line from the cost to do something (such as monitor responses to blog posts) with the true results of that effort, positive or negative.

To relate this back to your query more directly, I think that if organizations offer a blog and decide to allow comments, they should read those comments and respond appropriately as their time and resources permit. In other words, they should do what they can to monitor and respond to posts, and use that experience to hone their ability to zero in on which comments are most significant and warrant a response. That’s something you only learn by doing. When that ability gets honed, the return on investment (tangible and intangible) for that effort increases steadily.

I know that there is an awful lot of research being done into communication, and the economics of different communication channels and strategies. I should delve into that again to see whether there are any jewels in the latest findings.

But in the meantime, for those of you who are struggling to find a quantifiable justification for improving or changing how your organization communicates – I challenge you to set your faith in numbers aside and think about this peculiarly human issue in human terms first.

…Many thanks to Toby Bloomberg for asking a question that triggered me to say something I’ve been meaning to say for a long time.

If you liked my post, feel free to subscribe to my rss feeds

2 Comments so far (Add 1 more)

  1. Having worked as a consumer research analyst in both advertising and consumer products, I can understand your skepticism about stats related to communication. It’s the million dollar question in marketing and advertising: if I run this ad/article/promotion etc. what return will I get on my investment. The organizations I worked for spent enormous amounts of money to answer those questions and I would say the results were interpretive at best.

    So here’s my two-cents. I view communications effectiveness stats as directional but by no means conclusive. Any smart consumer of these statistics takes the same view. We’re talking about human behavior for heavens sake!! There are so many variables that affect what someone might do. It might have been the ad or it might have been whether they had lunch, an argument they had with the boss. Who knows. Not unlike the “bit of potato” in the Christmas Carol where Ebenizer Scrooge attributes a ghost’s appearance to indigestion.

    So, when asked this question, you can say “when we published this blog we had x hits y of which were strongly stated.” This gives you not only the stats but an indication of the intensity of the response.

    My other suggestion is to always look at the desired action or state of mind you want people to have as a result of reading your article. Effectiveness is usually a measure of how close did you come to your desired objective?

    All in all these might not be the hard stats potential employers want to hear, but you’re providing them with your knowledge and experience. You can always say something like, “Yes, company Z can provide statistics, however, those statistics are measuring something very narrow and not necessarily something that will contribute to your bottom line. Here’s why…” and you explain why the stats are not as rock solid as they seem (showing great empathy for your client’s concerns of course ;-)

    Hope this is helpful.

    Judy

    1. Judy Murdoch on February 26th, 2005 at 2:24 pm
  2. Research and Stats - practically useless ?
    Amy Gahran on measurement:First of all, research and statistics are practically useless when it comes to demonstrating the value of good communication practices – since that value is generally realized in ways which, while significant, is not easily …

    2. scale|free on February 15th, 2005 at 5:10 am