K.D.Paine's Measurement Standard, the international newsletter of public relations measurement
The international newsletter of public relations measurement
Public relations research and measurement is easy with the DIY Dashboard from KDPaine & Partners

Social Media Measurement

 

Notes from the Influence Scorecard Summit
Mapping the future of social media measurement.

by Katie Delahaye Paine

The Influence Scorecard Summit was billed as a meeting about the Influence Scorecard, a concept pulled together by Philip Sheldrake, author of The Social Web Analytics eBook 2008.

influence scorecard meeting Diane Meier,
Marshall Sponder,
and Harish Rao at the Influence Summit

The goal was to add a bit of sanity into the nonsense currently surrounding social media measurement. Specifically, to agree on some terminology and maybe even methodology to serve as a foundation for a future standard. (Think the early days of IAB trying to define ad banner standards.) My personal goal in being there was to put to rest some all-too-pervasive myths, like the difference between tools and metrics, monitoring and measurement, and counting stuff and evaluating results.

The Summit drew a nice mix of vendors, agency types, and all-around smart people, including:

  • Marshall Sponder, author of www.webmetricsguru.com;
  • Ted Shelton, Co-Founder and Partner, The Conversation Group,
  • Jay Krall, Global Product Management, Cision;
  • Aubrey Podolsky, Manager of Client Relations, Sysomos;
  • Harish Rao, Founder, The Rao Group, and former Director of Information Technology, Dean for America;
  • Diane Meier, Founder and CEO, MEIER, a NYC-based ad agency
  • Connie Bensen, Director of Social Media and Community Strategy, Alterian

For the record, several other monitoring companies, including Crimson Hexagon and MediaTenor, were invited but declined to attend.

We all agreed at the outset that the conversation would be open, that we would encourage participation, and that I would publish a digest in The Measurement Standard. See also the excellent summary and discussion by Marshall Sponder at webmetricsguru.com. Also see the Influence Scorecard wiki: http://influencescorecard.wikispaces.com/. Everyone is invited to respond. Look for more summaries and progress in the next few months.

So here goes:

To start, some definitions

We quickly realized that without some definitions, we would continuously be getting lost in the weeds, so we agreed to the following:

  • Influence: the power or ability to affect someone's actions
  • Engagement: some action beyond zero
  • Advocacy: engagement driven by an agenda
  • Sentiment: contextual expression of opinion, regardless of tone
  • ROI: Return On Investment, no more and no less, end of discussion
  • Transparency: the default state is to disclose all information
  • Authentic: not false, genuine, real
  • Trust: competence, integrity/honesty, reliability and authenticity

In terms of defining influence, there was a lot of discussion on the science of social networking, led by Harish. We agreed that it wasn't necessary to reinvent the wheel; we could rely on some of his research to help us define influence. However, we also agreed that influence was specific to specific demographics and psychographics.

And the same rule applies to reach. In social media reach is subordinate to relevance. No matter how big the reach of a particular blog or Twitterer or YouTube video, if it is not relevant to your audience, reach doesn't matter. So all reach must be calibrated to the market at hand.

We agreed that compound reach, or amplification, or the extended network effect, might be best calculated via social network science. We also agreed that historic amplification is more important than potential amplification.

Ideally we'd love to have an influence score, which would be some combination of reach, relevance and credibility, but agreed that that was a longer term challenge. In the interim we defined those elements as follows:

  • Reach -- is straightforward: The number of followers, with some percentage of amplification
  • Credibility -- either outcome or opinion based; either implicit or explicit
  • Relevance -- is a qualitative judgment and includes topics, values, demographic and psychographic values and context

We then tackled the issue of defining "engagement"

Everyone in the room was well informed of what prominent thinkers in social media had been writing, so for the purposes of our discussion we borrowed liberally from what we considered the best. Such as "35 social media KPIs to help measure engagement" from econsultancy. Which led us to a great discussion as to whether or not you can classify or grade engagement on a scale of 0 to 5, with 0 being completely totally passive, to 5 being "addicted." (See my discussion in "Toward a Definition of Engagement.")

As we defined engagement, we agreed that the critical difference was between a spectator and someone who is truly engaged in the brand. Part of engagement is the choice one makes to pass along something valuable to the rest of one's network. One can be a spectator and have influence, and give advice, but not be engaged. An example is a tea drinker who is asked, "Where should I get coffee?" Even though he or she doesn't drink coffee, they might be engaged enough with a brand to recommend a particular coffee.

We then debated the difference or level of passion vs. engagement. There is not mutual exclusivity between passion and engagement. You can be engaged without being passionate. But it is unlikely that you would be passionate without being engaged.

What are goals for social media?

Finally we agreed that our first methodological step might be to help people define their goals for social media. Essentially all goals for social media fall into one of two categories:

  • Revenue – As a driver of sales, cost savings, increased profitability, and/or increased market share.
  • Communications/education – To get the word out, spread public safety messages, etc. For instance, the way the government, CDC, and the Red Cross use social media.

There was some debate about a third goal of "improving/changing relationships or reputation," but we generally agreed that that fell under the first goal of profit/revenue/cost savings or sales.

We plan to meet again in mid 2010.


Search The Measurement Standard here



Visit the current issue's contents page

Visit the contents page of the issue that this article appeared in

Visit The Measurement Standard Blog Edition

Visit the Blog Feed Page

Visit the Twitter Feed Page


Recent new articles:

JENNY SCHADE'S MAKING IT COUNT
How to Bulletproof Your Career
1,000 interviews reveal the secrets of The Invincibles

THE MEASUREMENT MAVEN AND MENACE OF THE MONTH AWARDS
Measurement Maven of the Month:
Philip Sheldrake

The Measurement Menaces of the Month:
Everyone Who Confuses Measurement with Counting, and ROI with Success

MAKING A LIST, CHECKING IT TWICE
Dear Santa...
All I want for Christmas is a better way to measure engagement. And world peace.

CONSUMER ENGAGEMENT
Measuring Extreme Brand Engagement
or, "Why we named our firstborn 'Mopar.'"

CONSUMER ENGAGEMENT
Toward a Definition of Engagement
Who is a lurker, who is engaged, and who is addicted?

CONSUMER ENGAGEMENT
How to Sort Out the Lurkers?
Any engagement scale will have to deal with a vast predominance of people who are not very engaged at all.

SOCIAL MEDIA MEASUREMENT
Notes from the Influence Scorecard Summit

DAPHNE GRAY-GRANT'S RAPID WRITING
The Devil Makes You Do It

THE PAINE OF MEASUREMENT
Five Insights from a Social Media Road Trip

THE MEASUREMENT MAVEN AND MENACE OF THE MONTH AWARDS
The Measurement Maven of the Month:
Nora Barnes
The Measurement Menaces of the Month:
Organizations that Use Social Media But Aren’t Measuring

SOCIAL MEDIA MEASUREMENT
The Value of Lurkers in Social Media Communities

SOCIAL MEDIA MEASUREMENT
3rd Annual UMass Dartmouth Survey of Social Media Usage

CAN THIS REPUTATION BE SAVED?
The Banking and Health Insurance Industries

BOOK REVIEW
Twitterville

JIM MACNAMARA'S MEASURING UP
The Rise of the Phoenix

DAPHNE GRAY-GRANT'S RAPID WRITING
Doomed like Sisyphus?

 


Here is the book that gets people hired!

"I had 2 share: Had an interview & I started talking about measurement & I got very excited talking about it & your book. I was hired on t/spot!"
--Alma / AmericanLatina

Measuring Public Relationships
The Indispensable How-To Guide, Just $29.95
Click here to buy it now.
This 228-page paperback is the must-have practical guide to hands-on PR measurement. Emphasizing the role and evaluation of relationships, measurement guru Katie Delahaye Paine provides every public relations professional with step-by-step research procedures for measuring programs, improving results, and managing relationships. To place your order, call Sheila at the KDPaine & Partners office: 603.319.1047. More information here. Click here to buy it now.



 

 

 

 

 

 

|Contents | To The Editor

Copyright 2009, all rights reserved.
Reprint information is here.

177 Main Street, Berlin, NH 03570
603-369-6098, 603-326-4940 (fax) www.kdpaine.com