[Corpora-List] why LREC2012 NOT blind-reviewed?

Tue Oct 18 10:29:02 UTC 2011

Thanks Ted - a very interesting article, and an interesting suggestion... :)

I know that some journals are now starting to publish 'the best of' compilations,
based on number of downloads...:

http://top25.sciencedirect.com/subject/arts-and-humanities/2/journal/journal-of-pragmatics/03782166/archive/30

http://www.educationarena.com/journalPromotions/mostDownloaded/classof2011/

Why not publish all submitted articles, ranked by reviewers/editors/committees/publishers perhaps

(rather like the 'recommended reading lists' that we issue to students?),

but all equally available for public attention and discussion?
best
Ramesh Krishnamurthy
Visiting Academic Fellow, School of Languages and Social Sciences, Aston University, Birmingham B4 7ET
Room: NX01. Tel: 0121-204-3812.
Director, ACORN (Aston Corpus Network project): http://acorn.aston.ac.uk/
Corpus Analyst:
(a) GeWiss (Volkswagen Foundation) project: http://www1.aston.ac.uk/lss/research/research-projects/gewiss-spoken-academic-discourse/
(b) Discourse of Climate Change: http://www1.aston.ac.uk/lss/research/research-projects/discourse-of-climate-change-project/
(c) Feminism: http://acorn.aston.ac.uk/projects.html
(d) COMENEGO (Corpus Multilingüe de Economía y Negocios) - Multilingual Corpus of Business and Economics: http://dti.ua.es/comenego
(e) European Phraseology Project: http://labidiomas3.ua.es/phraseology/login/login.php
---------------

Date: Sat, 15 Oct 2011 12:12:38 -0500

From: Ted Pedersen <tpederse at d.umn.edu<mailto:tpederse at d.umn.edu>>

Subject: Re: [Corpora-List] why LREC2012 NOT blind-reviewed?

To: "corpora at uib.no<mailto:corpora at uib.no>" <corpora at uib.no<mailto:corpora at uib.no>>

Greetings all,

Another alternative that might not have been mentioned in this far ranging discussion is the idea of crowd sourcing peer review. As a community we are now coming to rely (somewhat) on crowd sourced data, so why not crowd sourced reviewing? ;) I say that somewhat tongue in cheek, although if it's good enough for our data...

In any case, here's a NYT article discussing this a bit with respect to the humanities...

http://www.nytimes.com/2010/08/24/arts/24peer.html?_r=1

A related model, I think, is simply to have a pre-print archive where everyone uploads their latest and greatest work, and then let world decide impact and merit via downloads and subsequent citations. That may not work well for folks who need tenure committees to evaluate them, but it does cut out the very expensive and time consuming review process that often results in quite a few papers in a distinguished proceedings (like ACL, etc.) that are relatively uncited and have fairly low impact despite the rigorous review process they survived.

My understanding is that the physics community operates a bit like this with http://arxiv.org/ In fact there was a time when I submitted papers to arxiv but that was usually after acceptance at a conference.

In some sense you could think of our current publication model as a sort of controlled upload to a pre-print archive (the ACL Anthology).

This represents a kind of safety net for authors, where a paper that is accepted at ACL etc. will be impressive to a tenure committee whether or not it is cited much and has much impact. If the only papers that "counted" for tenure or promotion were those that had a lot of downloads or citations...well, that would probably change things quite a bit. I suspect we'd write fewer papers and maybe be a bit less incremental. That sounds good, although I'm sure there are many other side effects I'm not considering.

Cordially,

Ted

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20111018/dc49b06e/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora