Can Klout Really Measure Influence?

by | Dec 6, 2010

When I first met Joe Fernandez (@JoeFernandez), CEO and Cofounder of Klout, I thought little more of Klout than a new Twitter score. And to be honest, that is what they were for some time. A few minutes with Joe and you gain a lot of confidence in what they are trying to accomplish. To reach their goal of becoming “the standard for influence”, they had to start somewhere and Twitter, the realtime back channel of the internet, was an obvious choice. Now they have added Facebook and have plans to add LinkedIn, Foursquare, and maybe Myspace very soon. Additionally, several other online metrics and social networks are on their radar to improve the scope of Klout. They are trying to build an algorithm (or more accurately a set of algorithms) that will measure ability of someone to drive people to action online. In an attempt to provide insight, let’s break down how Klout produces their main influence score. Currently Klout measures 30+ variables on Facebook and Twitter to give you a 1 to 100 score “with higher scores representing a wider and stronger sphere of influence”. Having only a Twitter account or Facebook account will not negatively affect your score, but will shift the weight of your score to that network’s variables only. What are these variables? Well they fall into 3 separate categories.

1. Making People Act

They are pretty much anything that can be determined as an “action” in to response to something you have done. Klout calles this “Amplification Probability” and describes it as the likelihood that your content will be acted upon.
  1. Unique Retweeters
  2. Unique Messages Retweeted
  3. Likes Per Post
  4. Comments Per Post
  5. Follower Retweet %
  6. Unique @ Senders
  7. Follower Mention %
  8. Inbound Messages Per Outbound Message
  9. Update Count

2. Network Size

Next, Klout looks at the size of your network. Think of this as the potential size of the audience that may be exposed to your audience. Consider several circles here. First are your direct followers, friends, people following your lists or lists your on, etc. Then consider retweets and replies and comments as they may expand your potential audience greatly. Then consider the meta data of this potential audience. How many are you following? And how many are unique interactions, compared to one person interacting multiple times. Klout refers to this as “True Reach” and describes it as the size of your engaged audience. The official list from their website of variables that control this score are:
  1. Followers
  2. Mutual Follows
  3. Friends
  4. Total Retweets
  5. Unique Commenters
  6. Unique Likers
  7. Follower/Follow Ratio
  8. Followed Back %
  9. @ Mention Count
  10. List Count
  11. List Followers Count

3. Network Quality

Lastly, Klout looks deeper than just the size of your potential audience and more closely at who makes up that audience. Basically answering the question, how influential are the people you are engaging? They call this “Network Influence” and describe it simply as the influence of your engaged audience. Variables measured here include:
  1. List inclusions
  2. Follower/Follow Ratio
  3. Followed Back %
  4. Unique Senders
  5. Unique Retweeters
  6. Unique Commenters
  7. Unique Likers
  8. Influence of Followers
  9. Influence of Retweeters and Mentioners
  10. Influence of Friends
  11. Influence of Likers and Commenters

The Secret Sauce

With all these variables to consider, you might start to get a sense of how complicated a task it is to try and measure online influence. Above all the variables and data points is another secret sauce. Klout then has to attach a weight to each variable. This is the part that is not public. How much a retweet affects a score verses a Facebook comment and so on. If you are a doubter, this is likely where a lot of your distrust might creep in. Who is Klout to determine how much a retweet or a new Facebook friend should count toward your influence score? “One thing we really want to avoid is trying to tell people how to use Twitter or Facebook” said Fernandez. When you talk to Joe about the algorithm, it is clear that he is all about the data. About taking clear measurable results and weighing them against other results.

Testing For Accuracy

Another item they consider a sample of is click through rates.
We perform significant testing to ensure that the average click-through rate on links shared is highly correlated with a person’s Klout Score. (http://klout.com/kscore)
To do this they access publicly available click through data via Bit.ly. In fact they do a lot of this “testing” at Klout. At one point, of 22 employees at Klout (likely more now), 18 of their staff were engineers. That is a huge emphasis on the science behind their algorithm and how seriously they take the responsibility measuring influence. When you talk to Fernandez he will emphasize that the engineers working on the algorithm hunt for outliers a lot. They try to find people that have abnormally high or low scores and see if their algorithm has a loophole that are missing these accounts and correct it accordingly.

How Klout Changes

They update the algorithm monthly right now, and have to account for a constantly changing online landscape. For instance, when Twitter implemented their oficial retweet button, retweets became a lot more common and therefore had to be devalued. Just as Google is constantly tweaking and improving their massive search result algorithm, Klout has to constantly adjust for changing technology and human behavior. It is confirmed that Klout will add Foursquare and LinkedIn to the algorithm very soon. And last I spoke to them they were still considering Myspace. They have also looked into measure more click through data, website traffic, and commenting activity through services like Disqus and Intense Debate among others. Even measuring things like book sales on Amazon for authors or Google Search trends to see who is being talked about are possibilities for Klout. It is clear that the Klout team understands the vastness of the challenge of measuring influence. And they understand that influence is not only online. They have a few ideas of how they can ultimately begin to take into account offline activity as well.

Context Of Influence

Klout scores are calculated on a rolling 30 day timeline. As of last month, the score is calculated and updated nightly. Klout also lists topics on every profile it scores as the categories that they think a person has the most influence in. Expect this to play a much larger roll in the future as Klout emphasizes niche influence. Can Klout measure influence? Who knows. From everything I have seen, yes. But is it perfect? By no means. The biggest miss right now is that there are plenty of influencers out there with scores that are not so high. It all comes down to context and making human decisions based on the scores they are creating. What Klout has done is put a massive amount of data together in a very smart way. And a lot of that data is highly desirable for marketing situations. I think anyone marketing products online should be paying attention to Klout and looking for an opportunity to use their data.]]>

PSSST…

Our email newsletter is the industry’s best-kept secret.

Fast-track your audience building in just 5 minutes a week.