Flickr and Yahoo!

Congratulations to Stewart, Caterina and all. Well done on selling a company with bottom-up tagging in it's DNA to a company with "Hierarchically Organized Ontology" in it's name.

The long tail of tags

Sitting in the folksonomy session at etech, I thought I'd look at the distribution of tags, and guess what, it's a power law, oh sorry 'it has a Long Tail'.



Tom says we should use the word fauxonomy...

Bloggers and diversity

Steven Levy picks up on Halley & Rebecca's discussion of the lack of diversity seen at Harvard conferences about blogging and media, but doesn't link to either of them.

Now, we do track Millions of blogs at Technorati, and all human life is there. Steven describes our top 100 as 'a list dominated by bigmouths of the white-male variety', but there are Japanese, Brazilian and Iraqi men and women there too.

The blogosphere is big enough now that my 'Caliban's Mirror' rule applies - what you see in it is what you go looking for; it reflects you and your interests.

While I am reading Jeneane, Shelley, Dorothea, Suw, Halley, Liz, danah, Denise, Megan, Stephanie and others regularly, you might not be (and it is your loss).

If you look at which bloggers the mainstream media have picked up on, the men tend to talk about politics, and the women talk about sex.

This superficiality is pointed out by Brian Micklethwait but he holds out hope as we can and do discuss ideas at length online, cross-linking, interjecting and, as Shelley does masterfully, satirizing.

San Jose Young People's Theatre updates

Rosie has been very busy collecting signatures and letters in support of San Jose Young People's Theatre, so we set up a new blog just for the letters:
Letters supporting San Jose Young People's Theatre

Rosie also put up the showtimes and ticket availability for Peter Pan

Here are links to the 3 video interviews with the children so far:

YPT: friendships that last
How YPT changed my life
What if YPT were closed?

And we are setting up a YPT young writers competition too, with support from Councillor Ken Yeager.

San Jose Young People's Theatre

I don't usually blog about family events here, but sometimes it is important.
My children have been attending and performing at the San Jose Young People's Theatre for four years now, and it has deeply impressed me.
Carole Ferris-Greer, the program director, has created something very special in a quiet corner of the San Jose Parks and Recreation department. For 22 years she has been bringing together a fresh cast of a hundred children every few months, and building them into a performance powerhouse.

These are not simple children's pageants, but properly staged, costumed, choreographed performances with complex sets and original staging. Each show is adjusted in rehearsal to fit the children cast in their roles, and every child in the chorus is given a moment to shine.

Carole is a master of what Larry Lessig calls 'Walt Disney creativity' - taking classic folk tales, and remixing them with contemporary cultural references to bring them alive for a new generation. Whether it is sly references to reality dating shows in Cinderella, with the stepsisters singing 'Material Girl', the apes singing Louie Louie in Jungle Book, or the replacement of the Indian song in Peter Pan with 'Colors of the Wind', each story is refreshed and updated.

So why am I writing about it now?

Despite its track record, its huge local support, the 100,000 cans of food it has generated in donations to the homeless, and the thousands of children whose lives have been improved by being part of it, the Young People's Theatre is under attack by the Parks and Recreation Department of San Jose city council.

Accordingly we have set up a support site at yptsupport.blogspot.com. We're seeing if the citizen journalism publishing tools of photos, weblogs and videos can make a difference.
Do please visit it, link to it and spread the word. Help us hold the local council to account.

And help make sure that future generations of children can experience this too.

Weinberger's interesting checklist

David's list of things to create looks like a lot of things I've worked on:

• Use the existing tools to invent new forms of digital story-telling


• True Internet video


• Distributed revenue infrastructure


• Discover which bloggers are saying interesting things


• Let us tag your articles


• Encourage voice


• Get on the right side of the copyright fight


• Open your archives because that's where the common good is

I wonder if I have a curled ladder in there somewhere.

self policing and spam

Peggy Noonan in the WSJ:

It is not true that there are no controls. It is not true that the blogosphere is the Wild West. What governs members of the blogosphere is what governs to some degree members of the MSM, and that is the desire for status and respect. In the blogosphere you lose both if you put forward as fact information that is incorrect, specious or cooked. You lose status and respect if your take on a story that is patently stupid. You lose status and respect if you are unprofessional or deliberately misleading. And once you've lost a sufficient amount of status and respect, none of the other bloggers link to you anymore or raise your name in their arguments. And you're over. The great correcting mechanism for people on the Web is people on the Web.

Which brings me to the Spam Squashing Summit, next Thursday at Yahoo. Looking forward to it.

Links and Votes

The rel="nofollow" has caused a lot of impassioned debate, particularly regarding using it to link to things you disagree with or disapprove of.

I like this, as I am in favour of people adding more user-created metadata to their pages. It is a defence against a publicity attack — saying something outrageous to get a reaction — and that is why I prefer the Vote Link categories of vote-for, vote-against and vote-abstain to the explicitly search-engine directed nofollow.

Google's PageRank explanation has long said:

PageRank interprets a link from Page A to Page B as a vote for Page B by Page A. PageRank then assesses a page's importance by the number of votes it receives.

I just think we should be able to link without voting, or link and vote against too.

Tagging is for posts

Over the past few days I've seen a lot of reaction to Technorati's new tags feature. I hope to deal with the wider social networking, spam and ontological issues at a future date, but I'd like to have another go at clarifying the details of rel="tag" again, as if Tim Bray, Roland Tanglao and Kevin Burton are all puzzled by it, we're obviously not conveying the idea clearly enough.

It is not for tagging a URL.

The new rel="tag" syntax we have proposed and adopted is attempting to solve a particular problem — how to tag web pages or blog posts.

It seem that there is demand for a general decentralised syntax for tagging URLs, and that is certainly something to think about, but this is not meant for that.

Tags do not require Technorati-proprietary URLs.

The tag help pages on the Technorati site can be read in that way, but they are focused around linking to the pages themselves; the underlying specification is clear that the url is to a 'tagspace' - a place that collates or defines tags.
I think this is an elegant way for the 'namespace' discussion to be resolved - if there are colliding meanings for a tag, you can link to a disambiguating tagspace, just as Tim describes.

Tags are not invisible metadata.

They are meant to be visible links on your page and in your posts. The 'this is just like meta keywords and will suffer the same death' argument misses this point.

Part of the Google insight was that visible data is more trustworthy than invisible metadata - the links that people make visible on their pages are more part of their work than those they hide away for robots alone. Of course it doesn't make them immune to gaming, but it does make the gaming rather more obvious to human readers, especially to authors, who may not always be aware what invisible metadata is being generated on their behalf.

Thus, the <link rel="tag" href="..." /> syntax is not read by the Technorati spider.

This point is also behind some of the problems people have had with having their links picked up by the Technorati spiders - they sequester the tags away between posts, and omit them from their feeds. We're working hard on improving our tag detection (and many thanks to people who have spent time going back and forth on this with us, especially Stephanie), but we do expect them to be part of the post body.

I hope this makes more sense now; we'll continue updating the formal spec and discussion pages in the light of this feedback.

Why not sell News?

Dan says:

One of these days, a newspaper currently charging a premium for access to its article archives will do something bold: It will open the archives to the public -- free of charge but with keyword-based advertising at the margins.

Why can't newspapers give away the Olds and sell the News?
Online subscription for fresh news, free access to day-old archives, when the paper version is fishwrap.

Welcome, Google. Seriously.

The rel="nofollow" initiative spearheaded by Matt and Jason at Google is a welcome step in helping webpage authors give semantic hints to search engines.
I first wrote about this in March 2003, suggesting a way to link while expressing endorsement, neutrality or approval, and cited some previous suggestions there. This became the Vote Links specification later, which has been supported by Technorati for a while, and it is great to see Google, Yahoo and MSN picking up on this idea.

Since Wednesday morning, the Technorati spiders have been respecting the rel="nofollow" attribute on links, along with rel="vote-abstain" and rel="vote-against", excluding these links from Authority counts, and Cosmos searches (we've seen just over a thousand nofollows so far).

I've taken the liberty of drafting a more formal specification for the nofollow rel attribute, and I trust we can submit this to a suitable standards body in future.

I'd also like to second Dave's call for a Spam Squashing Summit, as there are many other sources of spam in blogs and elsewhere on the web.

Tag spec published

Following on from the last post, we have published a formal specification for the rel="tag" HTML extension, and it will be submitted to GMPG.

Clarifying tags

Dave said:

tell us how you support open protocols and we'll figure out how to plug you in. 

We use the existing HTML standard rel attribute for link relationships and add a new link type "tag".

Niall said:

Adding rel="tag" to any link should be enough to build a tag library for links off the link text. Technorati instead grabs the last part of the URL after the "/" and treats it as a post tag. I was hoping for a decentralized del.icio.us implementation.

This is a misunderstanding of what rel on a link means. It defines a relationship between the page containing the link and the linked page. We have defined a new value "tag" which means 'treat the linked page as a category tag'. It is the link itself that has meaning here, not the link text you use.

If you use the pages at http://technorati.com/tag/ as your destination, we know what this means. You could also use another domain that has tag-specific urls, like flickr, del.icio.us, or wikipedia. The assumption the technorati spider makes is that the last path component of the url is the tag, so http://apple.com/ipod would even work.

We think that linking to our tag collator is a useful thing to do here, but they are your links and you can do as you wish.

This was never meant to be a replacement for delicious, but a complement to it. del.icio.us is a great way to label links with tags. The new rel="tag" enables you to label your own blog posts with tags.

Can I have an inclusive?

The CBS memos case known as 'Rathergate' has been picked over for months in the blog world, so it was a bit of a surprise to me that only now have CBS issued their report.

When told that the memos were fake, Rather said "If the documents are not what we were led to believe, I'd like to break that story." He is thinking of a story he can put EXCLUSIVE on. But whom would he be excluding? Presumably other big media organisations.

More reflective journalists, such as Dan Gillmor, are instead thinking how they can put INCLUSIVE on their stories - they are measuring success by how many people they bring into the conversation, and they recognise it doesn't necessarily start with them.

Tags: Big Media, Citizen Journalist

Silly names department

A taxonomy is designed for putting things in a single place. They work for libraries where there is one copy of a book. Tags are designed to mark things you want later, without moving them. But, as if by magic, you can call "Accio" later and bring them to you.

So how about we call it a 'Tagsonomy' ?