The Delicious debacle

It’s been an emotional week for me and my fellow Delicious lovers. The hysteria began with a slide leaked from an internal presentation at Yahoo, Delicious’ corporate parent, saying the service was among the ones slated to be “sunsetted.”

After Techcrunch published the slide, the web lit up with the rumor that Delicious would be shut down. It took Yahoo a full twenty-four hours to respond, an eternity in internet time, and when their official statement did finally come, it didn’t exactly put anyone’s mind at ease. They’re keeping Delicious live for the time being, but they plan to… do what? Sell it? The language is vague.

I’ve loved Delicious since I started using it — here’s my full-length rhapsody on why it’s so valuable to me. Watching Yahoo neglect it has been painful, since there’s a lot of untapped potential. For example, two months before Twitter launched, Delicious rolled its Network feature, which lets you subscribe to other users’ bookmarks. It’s basically a more tightly curated and better annotated version of Twitter. I started going back through my bookmarks to see who else was saving them and following everyone who was coming up with interesting tags and notes. The result is my list of a hundred or so Delicious users who consistently post interesting, useful and entertaining links. I look at my Delicious network feed first thing in the morning, before any news site, or Twitter or anything, because its signal to noise ratio is superb. Yahoo had an opportunity to create a robust social network around the Network feature, and they blew it.

If you’ve invested a lot of effort in curating your Delicious bookmarks, at least you don’t have to worry about losing them. It’s easy to download a backup of them and there are plenty of other services you can upload them to. But having Delicious shut down or just atrophy would be a huge loss because of the accumulated mass of everyone else’s curated bookmarks. Yahoo lets you grab your own data but not everyone else’s, and everyone else’s data is what gives Delicious its value. ReadWriteWeb compares Yahoo’s data policy to “setting a museum on fire.”

Where else are you going to find a reading list of the best collected written works and other multimedia about almost any given topic? Unfortunately, automated extraction is blocked by the site and the rickety, antiquated API appears focused on returning you little more than your own bookmarks. If there’s a clear way to accomplish export of not just my bookmarks, but all bookmarks with one or more tags, from all users – I haven’t been able to find it yet.Yahoo blocks all automated extraction of data from Delicious. The company apparently is going to let this unique cross between a museum, a library and a crazy old collector’s attic burn to the ground. I’d like to take a few things with me before that happens, please. One community of non-profit technologists has been bookmarking links with the tag “NPTech” for years – they have 24,028 links categorized as relevant for organizations seeking to change the world and peoples’ lives using technology. Wouldn’t it be good to have that body of data, metadata and curated resources available elsewhere once Delicious is gone?

What someone probably ought to do, as Karl Long said to me on Twitter today, is scrape all the public bookmarks and data and put it on Bittorrent. That would be against the rules, though.

Please, please Yahoo! let us save some of what you’ve got, before it goes to waste.

I’ve heard the argument that we’ve been using Delicious for free all these years, so why should we feel entitled to anything? I for one would have appreciated the opportunity to pay for it. I quite happily pay for Flickr, I pay for web hosting, I’d pay for Twitter too. Yahoo never even attempted to monetize Delicious, aside from a little advertising on the popular bookmarks page, which I don’t think I’ve ever used. Yahoo’s focus on the popular bookmarks page misses the point. I don’t care what everyone has been bookmarking. I care what specific smart people who I trust are bookmarking. Mass trends are occasionally interesting, but only occasionally.

With the future of Delicious still in doubt, I followed the example of a bunch of geeks I trust and joined Pinboard. I’m using it to mirror my Delicious bookmarks, and if worse comes to worse, I’ll just move over there completely. There’s much to like about Pinboard. It’s not free, which inspires confidence in me that it won’t just vanish. I like its zany pricing scheme, where they charge a tenth of a cent times the current number of users. (I paid $7.65.) I can also set Pinboard to archive all my tweets if I want, though I haven’t taken them up on this because my tweets aren’t that interesting to me. If I have a profound thought I’ll put it on this blog.

So far, Pinboard seems fine and dandy for my own bookmarks, but it’s missing the social component. Delicious has over five million users, Pinboard (as of this writing) has nine thousand. Those nine thousand are mostly power users, but even so, that’s not the glorious emergent hive-mind that Delicious offers. If my entire network were to migrate over en masse, I guess it wouldn’t be such a big loss, but so far I don’t see that happening.

So what’s to become of my favorite thing on the social web? Former Delicious engineer Stephen Hood runs through the most plausible options on his blog:

Selling Delicious to a third-party

is not a straightforward proposition. As mentioned above, most of the team is now gone. Last week’s leak (and the subsequent fallout) also did unfortunate damage to the Delicious brand, sending panicked users to competing products.

But ultimately the real challenge here will be the technology. During my time at Delicious we rebuilt the entire infrastructure to deeply leverage a number of internal Yahoo technologies. It’s all great stuff but not exactly easy to remove or replace.  Yahoo may have to license some of this technology to the buyer. I’m not sure they’ve done that before.

Open sourcing Delicious

This is a seductive concept but doesn’t make much sense.  As in the case of a sale, they would need to unwind a bunch of proprietary technologies before this could happen.  And open sourcing a complex product isn’t as simple as switching your GitHub repository from private to public.  It involves a lot of work to clean up and document the source.  For Delicious this would add up to a huge effort that would be hard to justify purely on a financial basis. Even then, it’s not clear how an open source social bookmarking system would work, given that much of its value comes from being centralized.

Donating Delicious to the Library of Congress or the Smithsonian

Now we’re getting closer.  While it is folly to assume either of these institutions could take over Delicious and keep it running as a viable service, it does seem like they would be interested in preserving the Delicious corpus and making it available for research.

I love Delicious for many reasons, but chief among them is that it is the Internet’s memory storage device.  In the 7+ years of its existence it has recorded the collective online journeys of millions of users during a time when the Web was evolving dramatically.  Those memories are irreplaceable and have enormous value both to their owners (the users) and to society.

For now, I continue to post to Delicious, mirror in Pinboard, watch and wait. Whoever winds up owning Delicious, I hope they value it properly and show it some love.