Half a millennium ago in blogger time, back on Dec. 4, 2004, a Kossack with the moniker jotter took a moment to applaud another Kossack named Newsie8200 for putting together The Week's Best Diaries You Didn't Read. Jotter, who arrived with the first wave of Daily Kos registrants in November 2003, also put together his own list of the hundred most recommended diaries from the previous week. And he ran a poll asking if he should do it again. In one way or another, 96 percent of the 33 respondents said yes.
Thus began one of the most valued and long-running features at Daily Kos.
Jotter initially focused on "most recommended," posting reports about the Top 25 recommended diaries. But it soon became apparent to him that this didn't really cover the diary universe effectively. So he added "notables" – a report about diaries that had received a lot comments but hadn't made the Recommended List.
But that wasn't quite satisfactory either. So, on April 10, 2005, he announced an "experimental list, using a combined measure of recommendations and comments that I'm calling (for now) impact. The unit of diary impact is, naturally, the C&J, or as I prefer to call it, the bharns. One bharns is supposed to be the equivalent of the impact of one Industry Standard C&J diary." Those were the days before Bill in Portland Maine slipped over to the Front Page.
Jotter's experiment engendered what today are still known as High Impact Diaries, both a daily feature and a weekly wrap-up of the diaries that collectively catch the most recommendations, most comments and most eyeballs.
From time to time, jotter also takes a deeper look, the first of which was Comparing Kosmopolitans 2004-2005, the impact of the Downing Street Memos on Daily Kos, the impact of diaries over a year, the effect of networks on recommending diaries and On cliques and cabals (and peer review).
Just how much many of us have come to rely on jotter was made clear this past June when a team of volunteers took over for him while he enjoyed some time away from the digital world. That was followed by Jotter Appreciation Day (see comments).
Jotter is 58 and hails originally from Nashville, Tenn., which is why he prefers "y'all" to "you people," even though he has lived in the San Francisco Bay Area since 1980. He's employed in biotech/pharma, using computational tools to analyze experimental results. He's not sure whether Bioinformatics or Computational Biology is the most direct academic counterpart.
What follow are excerpts from my interview with him earlier this year. But, first, let him answer a question that has been asked at least 63,000 times since Daily Kos introduced diaries to the political blogosphere nearly seven years ago: What is the best time to post?
There is no "best time" ... Do your best, cast your bread upon the waters, preferably every day.
How did this project come about?
Jotter says he's been keenly interested in blogging since the early days, for instance, Dave Winer's Userland circa 1998 or so). But ...
I didn't find friendly blogging soil until I came across Daily Kos, a lifeline back to reality in weird times. I think I may have come there from Atrios, or was it the other way around? Anyway, I was searching the internet for friendly political discussions. In 2003 I watched as Daily Kos switched over to Scoop, and finally signed up Nov. 20, 2003.
My first diary appeared July 2004 garnering only two comments. One from MaryScott O'Connor, one from Malacandra. Well, it was high impact for me!"
MB: What spurred you to take this on in the first place?
jotter: It was a bit of a roundabout journey. I originally set up the page scraping code to test an idea I had for avoiding the dreaded "duplicate diary," which was the scourge of early days at Daily Kos. I published a diary about that in November of 2004, in the aftermath of that crushing election. Once I had that system in place it was a relatively simple extension to use it to download an entire days worth of diaries unattended, and construct a summary. This was something I wanted for myself because there was otherwise no way I could keep up with the action otherwise.
I am not a speed demon. I always felt that other people must have some intuitive sense of what was happening, but I needed a little help. So, with a system that was working pretty well for me, the next step was recognizing that others would benefit from the lists, then finding a way to publish them.
MB: How much effort did it take to set up the programming?
jotter: A reasonable amount. More than a couple of days, but not all at once. I had the time, it was an interesting challenge to get it to work reliably and I knew it would be useful. Did I mention I was unemployed?
After I installed full text search for Daily Kos (an entirely different story), I was given read-access to parts of the Daily Kos "back end" database. I rewrote everything to take advantage of that access and dropped the more error-prone page scraping. That was a big job. The result was (I hope) a much more robust and useful report.
MB: What have you learned about the process since you began the most influential diary round-up?
jotter: That rankings have a dual nature: good and evil. There is the "worthy" community benefit of providing access and history to a group which is temporally discontinuous, and the "tawdry" Top 10 contest aspect. I've learned, I hope, to embrace both. We can do good AND have fun. People seem to love top 10 lists and "friendly" competition.
MB: What kind of changes have you seen in diary list since you began? Have early changes subsequently changed themselves?
jotter: The final form of the list took place rather gradually, with a lot of help and input from community about nearly all aspects - how many diaries to post, how to sort them, how to make a good looking table, etc. The biggest change resulting from access to the database was the invention and adoption of a measure of how much notice a diary got, combining number of people who either recommended the diary or commented in the diary.
Using this "impact" measure as a cutoff score, followed by sorting by number of recommendations, allows the list to contain the diaries that showed up on the front page rec list, the "midlist" diaries that are candidates for rescue and contain many many gems, and, at the bottom of the list, those diaries that while unrecommended, garnered many comments, aka train wrecks. Here you will find many an amusing or maddening diary. The ones that everyone seems to know about, but I never did until I started the lists! The "one year ago" and "two years ago" features were good community suggestions that I adopted.
MB: And the diarists themselves?
jotter: Although there are many recognizable steady contributors, a surprisingly large proportion of the Rec List is occupied by the occasional diarist with something to say about a particular area, often from personal experience. Daily Kos is the only place I know where someone with detailed knowledge of an otherwise obscure area or event that suddenly comes to attention has a very good chance of writing about it and being heard.
MB: Other thoughts about this project you've been running for nearly six years?
jotter: I consider myself very fortunate to have found something I can do with what skills I have that seems to make a difference to many, and I look forward to whatever comes next for high impact diaries.
A word to steady readers, recommenders, and commenters. You make my day, every day. Thanks for dropping by.
A final shout out to Markos for running a singular shop. I can say for certain that there were few other web sites where the lists could have been developed (for technical reasons) and fewer still that would have encouraged them.
For the latest installment of High Impact Diaries, go here. See another interview with jotter by LaughingPlanet here. (h/t smileycreek.)
[photo of jotter trying out his metrics in Las Vegas at Netroots Nation 2010 taken by navajo]