msgbartop
Social media analytics for decision-making
msgbarbottom

03 Feb 09 Twitter is a chorus, not a bunch of solos

I have struggled with language to describe the people whose web page citations appear on Tweetsnet.  I started with a simple illustration about influence, the idea that people whose followers have more followers are potentially more influential, that influence is at least a second-order phenomenon.  But that doesn’t really describe what I’m doing.  I also experimented with the word “perceptive,” thinking that people who regularly are among the first to cite web pages that become popular may not be influential, they might just be good at seeing where things are headed.  But that’s not the whole story.

I think I finally found the right phrase when I updated Tweetsnet’s “About” page to say that it looks for people who are “in tune” with what becomes popular.  I see Twitter as a platform where people constantly organize themselves into choruses, amplifying the most pleasing melodies, generating and discovering harmonious ideas.  As with flocking behavior, these choruses have no single leader, but unlike a flock (as far as I know), some people are clearly more “in tune” than others.  Those are the people Tweetsnet seeks to identify – those who most frequently cite web pages that become popular.

I suspect there is a great opportunity in reporting what the choruses, known and discovered, are singing about.  In other words, monitoring the buzz in sections of an ecosystem of interacting, overlapping shared-interest communities.  This is where I want to take Tweetsnet, generating verticals, starting with known popular subject areas such as social media.  I’m sure there’s a lot of thinking and experimentation to be done about the ways we could define the intertwined borders of such choruses.  One thing I’m sure about – we need to change the way we tend think about redundancy.

Our left brains tend to think that duplicated effort is inherently wasteful, but the fact is that we are creatures of community.   But here’s the most important idea to take away from the “chorus” metaphor: when a bunch of people act similarly in social media (e.g., post the same URL), it is not redundant, it usually adds value.  That is deeply contrary to the one-to-many 20th century idea of information distribution, in which achieving stardom, not harmony, was the goal.  We still have room for stars, but some of them will be choruses.

Here are some thoughts on features that contribute to Twitter’s “choral value.”

  • Retweeting has very choral  high value, as it strengthens the “melody” – people’s deliberate arrangement of information into tweets – and the “harmony” – the commonality among Twitter users that goes beyond simply posting the same information.
  • UI design that makes retweeting easy is good, as long as it doesn’t encourage people to spew everything.
  • Excessive tweeting and retweeting becomes noise – witness the efforts I’ve had to make to remove aggregators from Tweetsnet.  The greatest value is added by the “jazz” tweeters, who have a melody and know how to harmonize, but aren’t afraid to improvise.  In other words, have a focus, but don’t be a robot about it.
  • Anything that shows how much human energy and thought went into a tweet adds value.  Anything that makes it easy to tweet will eventually diminish the value.  This is why the 140-character limit has added value – even headlines often are bigger, forcing people to think about how to squeeze information.
  • Hashtags reduce Twitter’s choral value as  ”solos” they do more to discourage than encourage retweeting.  If a tweet is already tagged, I think people tend to assume there’s no need to retweet because interested people should be monitoring the hashtag.
  • Followering somebody only matters if you take action; the main visible action is retweeting.  Blogging about something you found on Twitter would add “choral” value if there were an easy way to discover it.
  • Twitter’s APIs make it fairly easy to track user, URL and word usage, which is good data not just for Twitter’s basic features, but for discovering things we didn’t know to look for.  It’s great that everything is open by default, unlike most other social networking platforms.

What’s the “choral value” you see in Twitter?  What could the company do to further encourage it?

P.S. I’m going to change Tweetsnet’s name to TwURLedNews.

Tags: ,

30 Jan 09 Tweetsnet tags: Surprisingly useful

I suppose it is a cliche to say that many useful things have been created unexpectedly, even accidentally.  Here in Silicon Valley, that principle often becomes a problem, as highly creative people see a thousand products or services in their creations, but fail to focus enough to create a viable business.  I know that disease well because I have to fight it constantly.  Right now, however, with Tweetsnet, I’m still in the brainstorming and experimentation phase, when the point is to explore the possibilities.  If it gives rise to a business of some sort, that’ll be just fine, but that’s not the point yet.

The bit of unexpected goodness I’ve noticed in Tweetsnet over the last few days is in the tagging.  The tags and the tag cloud achieve one of my goals – self-organization – even though I didn’t really plan on it.  If I had stopped to think about it, I guess I would have realized it would happen.  It all started when I realized that since I’m fetching page titles from popular Twittered URLs, I could also extract any keywords found on those pages.  I had to hack a Python WordPress RPC-XML library to support tags, but that was no big deal. 

Once those tags were working, I realized that I could treat Twitter hashtags as a special case of tagging.  In the Tweetsnet database, tags are identified by source – HTML meta keywords or hashtags.  On the Tweetsnet pages, they all look the same.

When that was working, I found myself staring at the “phrases” that I’m capturing from Twitter.  Those are two-word phrases extracted via some very simple rules – end of sentence detection, a stopwords list, hashtags and user names excluded and so forth.  I noticed that when the same word showed up in more than one of those phrases, it often would be an appropriate tag.  And I noticed that existing tag words often showed up in the phrases, so those get added no matter how frequent they occur.  Any word that show up in at least three of the phrases is also added as a tag, although I’m not storing them in the database, since they are sometimes a bit odd.

The result is a set of tags and a tag cloud that do a pretty good job of finding articles related to a particular topic.  For example, when an article about the rumored GDrive showed up, it was tagged “gdrive,” which I clicked and found two more articles.  Cool.  That’s why I recently increased the size of the Tweetsnet tag cloud widget.

As you may have noticed, I have added links to sites that are doing things similar to Tweetsnet.  One of those, Twitscoop, offers a tag cloud widget, which gave me the idea that perhaps Tweetsnet should do the same.  Soon, I hope.  That would be in keeping with my idea that one of the secrets to success is to notice when you’ve invented something useful, then package it well.

I would be remiss if I didn’t point out that all this would not have happened if I wasn’t using WordPress as my platform.  Although it gets in the way sometimes, the features that come for free, including all the third-party themes and widgets, are terrific.  Ditto for Python and all the libraries people write for it.

Tags: , ,

29 Jan 09 My robot is more popular than I am

I knew this day was coming.  Sometime in the last few hours, Tweetsnet acquired more Twitter followers than my personal Twitter account.  I have 232 and Tweetsnet is now at 256 – and climbing faster than I am.  

I’m happy that there’s increasing evidence that Tweetsnet is useful.  On the other hand, what a strange world this is, in which I can create an automated information source that seems, by one metric, to be more popular than I am.  It seems impersonal and perhaps just plain silly… until I consider that we are creating a world in which increasingly intelligent robots will interact not just with us, but with each other, which will make them (a) stupider, because they will have to deal with rapidly increasing amounts of data and (b) smarter, because we will figure out how to make them take advantage of all that data.

If you’ve been following Tweetsnet or this blog for the last few days, you know that my No. 1 strategic problem (as opposed to various little bugs) is the fact that aggregators – other robots – tend to score quite high in the rankings.  An idealistic part of me wants every Twitter account to self-identify as robot or human… but I know that there’s no hope of compliance with anything like that.  I’m actually more intrigued by the notion that value will arise from writing code that guesses whether or not a user is a robot.  Web analytics has the same problem because some web robots and spiders masquerade as ordinary web browsers.  I spent a lot of time on this problem at LiveWorld, where some of our customers were not too eager to pay for robot page views at the same rate as human page views.

The cool thing about the challenge of distinguishing bots from humans is that we’re essentially collaborating and competing on Turing tests.  People are designing bots to gain influence in the Internet’s social networks, in competition with people who want to filter them out.  As long as bots are dumber than people (and they will be for a long time), this competition will persist and it will drive collaborations that make software smarter.  When we reach the singularity, it will stop mattering… or perhaps it will completely flip, so that the people who were trying to decrease the influence of stupid bots will focus on decreasing the influence of those stupid humans.  Or perhaps it will be a happy collaboration.

Tweetsnet gained its first bunch of followers by following everybody who cited a URL that made it into the feed.  A lot of those people automatically followed it in return.  The recent big spike appears to be driven by the fact that a few Twitter users are now retweeting Tweetsnet items.   That’s a kindness, really, because there’s no reason for them to do so.  They could retweet one of the original tweets.  

I imagine that one reason they give Tweetsnet the credit, so to speak, is that Tweetsnet doesn’t try to drive traffic to itself.  When it posts a tweet, the links in that tweet point directly to the original site, not back to the posting on Tweetsnet.  I get annoyed by tweets that point me to somebody’s site that does nothing more (for me) than provide a link to the site the tweet was really about.  

Meanwhile, today’s project is to keep other peoples’ robots out of the Tweetsnet scoring – because they are stupid.  The robots, I mean, the robots.

Tags: , , ,