K.D.Paine's Measurement Standard, the international newsletter of public relations measurement
The international newsletter of public relations measurement
Public relations research and measurement is easy with the DIY Dashboard from KDPaine & Partners

Social Media Measurement: Twitter

*

Which Twitter Profile Analysis Tool
Rules the Nest?
5 online Twitter profile analysis services compared: Twinfluence, TwitterAnalyzer, Twitter Grader, Twitterholic, and TwitterScore.

by Chris Near, Director of Research, KDPaine & Partners

Don't miss Chris Near's other article on measuring Twitter, also in this issue of The Measurement Standard: "5 Twitter Sentiment Analyzers Reviewed." The Twitter analysis tools in the article on this page rank a person's entire Twitter profile in terms of popularity and engagement, while the sentiment analysis tools of the other article look specifically at the tone of individual tweets.

So you want to measure Twitter... The good news is that you have several online Twitter profile analysis/ranking services to choose from. The bad news is that you will probably find that none of them offer all the metrics that you really need or want. Especially if you are looking to do the kind of between-client comparisons that we at KDPaine & Partners are usually interested in.

To do very accurate measurement of Twitter, you typically have to use human readers. It's the only way to really understand the language. But, to have human eyes read and rate every tweet often takes a lot of time and money. For fast and free measurement, the online profile analysis tools are the way to go.

Automated analysis has accuracy problems, especially when it comes to the subtle language iinvolved in measuring sentiment. (See "5 Twitter Sentiment Analyzers Reviewed.") If we had a way to combine all the tools reviewed below, then we might have something really useful. Until then, we'll have to weigh the pros and cons of each and make the best decision.

So here's my report on five of the Twitter profile analyzers. I'm sure there are more out there, and I'd love to hear about them. (And if you think what I have to say here needs some clarification, please let me know).

Twinfluence offers interesting statistics (social capital, velocity, centralization) as well as a percent ranking system that compares the twitterer you analyze to other people. The catch is that it only compares you to other people that have previously been analyzed on Twinfluence. Their website says: "The #XXX score is your overall rank compared to all other twitterers that have been analyzed by Twinfluence. If your rank is #400, that means there are 399 other twitterers in the system who have higher reach scores than you."

To date, there have been less than 100,000 profiles analyzed on Twinfluence (that number is going up every day). So you can't rank anyone against the other 5 or 6 million twitterers out there (and that number is really going up every day, see Mashable). That makes the Twinfluence ranking pretty useless until more people get analyzed on their site.

TwitterAnalyzer is good for getting graphs that show your past month's message volume, your tweeting habits, the subjects you discuss, the links you use, and pretty much everything you would ever want to know. Which is great. But it lacks what is sometimes the most important thing: a ranking or scoring system that compares different Twitter pages. Without that you can't make competitive comparisons.

Twitter Grader sounds excellent, in theory. It takes the follow/follower ratio and combines measures of engagement to come up with a final grade of 0 to 100. It gives a score based on a large population (2,158,455). However, a recent hubspot Twitter grading blog post implies that their algorithm is still a work in progress.

And I do have problems with it. Consider the following results:

How can Vocus have relatively few followers, zero updates and still get a score of 87? Even if there were 10,000 people following Vocus, there are no updates so there is no communication or engagement between Vocus and its followers. Why does it get any score at all?

I also looked at Twitterholic and TwitterScore, but found them too problematic to take seriously. On the day I tested Twitterholic over half of my searches resulted in page errors. (Since then, I've tested it with a little more success.) The site gives a ranking for your Twitter page, but it is based entirely on the number of your followers. It doesn't calculate anything like updates or other forms of engagement. It's good for popularity, but not activity or interaction.

TwitterScore gives you a rank comparing you to all the other people that have previously been ranked on their site. Right now the rank is only out of 43,048 users. They also give you a score on a 10 point scale, but there is no information on how they come up with that score or what their ranking is based on.

Which service rules the nest?

If your goal is to give the clients a final score or ranking that compares one Twitter page with others, then I would recommend Twitter Grader. (But look out for anomalous scores, as noted above.) If your goal is to track clients' competitors and how they use Twitter and what topics they discuss and who follows them, then I would recommend TwitterAnalyzer. I also recommend that you keep looking: None of these is perfect, and newer and better tools will come along quickly.

Don't miss Chris Near's other article on measuring Twitter, also in this issue of The Measurement Standard: "5 Twitter Sentiment Analyzers Reviewed"

Chris Near is Director of Research for KDPaine & Partners. Chris recently graduated with his master's in communications and currently devotes most of his time to measuring PR and developing social media methodologies. That is, of course, when he's not at home tending to his lovely wife, Valerie, or chasing around his tireless two year-old son, Brendan.

* Thanks for the Twitter icon, DesignReviver.


Visit the current issue's contents page

Visit the contents page of the issue that this article appeared in

Visit The Measurement Standard Blog Edition


Recent new articles:

SOCIAL MEDIA MEASUREMENT: TWITTER
5 Twitter Sentiment Analyzers Reviewed
Twitter Search, Social Mention, Twendz, Twitter Sentiment, and Twitrratr

SOCIAL MEDIA MEASUREMENT
7 Steps to Measurable Social Media Success
How to get started in social media -- and how to know if it's working for you.

MEASURING THE MEASUREMENT STANDARD
The Very Best of The Measurement Standard
The top 10 most popular articles.

DAPHNE GRAY-GRANT'S RAPID WRITING
William Shakespeare's 5 Best PR Writing Tips
"Words without thoughts never to heaven go."

SOCIAL MEDIA MEASUREMENT: TWITTER
Which Twitter Analysis Rules the Nest?
5 online Twitter analysis services compared: Twinfluence, TwitterAnalyzer, Twitter Grader, Twitterholic, and TwitterScore.

PR MEASUREMENT SURVEY
What Are Your Thoughts About PR Measurement?
Please take this public relations measurement survey.

THE PAINE OF MEASUREMENT
The Trust Issue

TRUST MEASUREMENT
Measuring Trust and Mistrust
Chapter 6 of Measuring Public Relationships: The Data-Driven Communicator's Guide to Success

YOUR MEASUREMENT READING LIST
The Speed of Trust:
A Book for Times of Distrust

How to build and rebuild trust.

A LITTLE SALES MUSIC, PLEASE...
KDPaine & Partners Wants To Solve
Your Measurement Problems

KDPaine & Partners has designed hundreds of measurement programs. And we'll design one for you, too.

SOCIAL MEDIA BRAINSTORM
15 Ideas for Low-Cost Social Media
KDPaine & Partners advises MADD on starting conversations without breaking the bank.

DAPHNE GRAY-GRANT'S RAPID WRITING
How Many Drafts Should You Write?
Five keys to help you decide. (Hint: Once is not enough.)

JIM MACNAMARA'S "MEASURING UP"
Where's the Conversation in PR?
Is PR just monologue disguised as dialogue?

BASEBALL MEASUREMENT
Baseball Wisdom
Two words which should rarely, if ever, be used consecutively.


Search The Measurement Standard here



Here is the book that gets people hired!

"I had 2 share: Had an interview & I started talking about measurement & I got very excited talking about it & your book. I was hired on t/spot!"
--Alma / AmericanLatina

Measuring Public Relationships
The Indispensable How-To Guide, Just $29.95
Click here to buy it now.
This 228-page paperback is the must-have practical guide to hands-on PR measurement. Emphasizing the role and evaluation of relationships, measurement guru Katie Delahaye Paine provides every public relations professional with step-by-step research procedures for measuring programs, improving results, and managing relationships. To place your order, call Sheila at the KDPaine & Partners office: 603.319.1047. More information here. Click here to buy it now.



 

 

 

 

 

 

|Contents | To The Editor

Copyright 2009, all rights reserved.
Reprint information is here.

177 Main Street, Berlin, NH 03570
603-369-6098, 603-326-4940 (fax) www.kdpaine.com