by Hey Paul
Why article tagging doesn’t work:
[Via Bench Marks]
Reading William Gunn’s recent blog posting, Could this be the Science Social Networking killer app? got me thinking more about the many online scientific reference list repositories like Connotea, CiteULike and 2Collab, and why they are failing to catch on. William is suggesting a Pandora-like system of expert reviewers tagging papers to set up a recommendation system. I’m not sure this would be really helpful–what you get from a scientific paper is very different from what you get from listening to a song, and their interconnectedness works in very different ways. And it brings to mind the failings of organizing your references by tags.
If you’ve ever dealt with any of these social bookmarking sites, you know how incredibly tedious they are to use. Even for journals like CSH Protocols, where we have buttons on every article to add it directly to these sites, you still end up jumping through hoops, filling out forms, writing summaries, adding tags. You’re on the spot at that moment to come up with a list of tags that will remind you about the content of that paper. As your worldview changes over time, and with it your research priorities, you’re probably going to want to revisit many papers and add additional tags. Even with all this time-consuming work, you still may not have added an appropriate tag to let you find what you want to find at a given moment. Did you add a tag for every method used in the paper? Every conclusion, every subject referenced? That band on the gel in figure 3 that you’re ignoring today might be very important to you tomorrow. How are you going to tag the paper in case you need to find it again?
[More]
I totally agree with David. There are two kinds of list-making people in the world – those that make lists and those that don’t. Applying tags to articles works well for the list-makers but many, many scientists are just too time-deprived to fill in boxes or check off squares.
But the real problem, as notes, is that in research the semantics change very rapidly. A paper that was really useful for a its description of a new cell surface marker may, at a later date, become important for a particular technique. How are you supposed to know beforehand which tags to use.
And in many cases since the research is at the cutting edge, there are no appropriate tags. So I make up one – call it IL-99. But someone else working on the same protein, adds a new tag called EDFWR. How in the world to the tags properly link these papers?
And, finally, no researcher gets any credit for really annotating a paper. Taking the time to do this, or to recommend a paper, is time they can be focussing on getting tenure, getting a grant in or writing a paper. Where is the payoff to the individual scientist?
Tagging research is not an easy problem to fix. We may all agree that it is worthwhile but we are a long way from any reasonable solution.