Wolfram Alpha and Social Networks

Stephen Wolfram posted recently on an update to Wolfram Alpha.  You can now type in ‘facebook report’ at the Wolfram Alpha prompt.  The new command displays a whole host of interesting data mining from the information you’ve placed on Facebook over the years. My favorite tidbit?  The clustered network graph of my friends.  Nothing shocking here, but […]

Data mining OKCupid

I’ve been thinking quite a bit about natural language processing lately.  This started with my series on text message analysis and looking at gender specific twitter usage.  Lately I’ve been pointed at the Natural Language Toolkit (NLTK), a library in python, to make this analysis more robust.  I want to apply this toolkit on a […]

Gender differences, Twitter and Videogames

I was recently introduced to Tweet-o-Life via the quite amazing Nathan Yau over at Flowing Data.  The Tweet-o-Life project was a study by Amaç Herdağdelen and Marco Baroni of habits on Twitter.  They looked at millions of tweets to identify behaviors of two kinds, ones based on gender and ones based on time of day.  They’ve since made […]

Text Message Analysis, Chapter 3

So far in our exploration text messaging, we’ve analyzed the time of day each message arrives and the structure of each message.  We’ve been able to pick out typical behaviors like timing of sleep cycles and life events like a trip to Switzerland.  We’ve found a relationship between the structure of messages and the kind […]

Text message analysis, chapter 2

Let’s continue with our analysis of text message behavior by shifting over into content.  One of the first things to understand is the form of each message.  What’s the length of each message? As a function of length, how does the content of the message change?  To begin with…

Text message analysis, chapter 1

A couple of months ago I read Stephen Wolfram’s article about analyzing his emails and saved files.  If you’ve not seen it yet, it’s definitely worth a read.  I was intrigued and wanted to apply a few of these analysis ideas to my own life.  I don’t have 30 years of saved email (yet), but […]