[Corpora-List] RepLab 2014: Call for Participation

Wed Feb 19 11:30:04 UTC 2014

*************************************************************************
CALL FOR PARTICIPATION
REPLAB 2014 @ CLEF 2014

*************************************************************************

RepLab is a competitive evaluation exercise for Online Reputation
Management systems. As in previous two years, the third RepLab campaign is
an activity of CLEF, and the results of the exercise will be discussed at
the CLEF 2014 conference in Sheffield, on the 15-18th September (see
http://clef2014.clef-initiative.eu/ for details).

TASKS:
------
RepLab 2014 will focus on Reputation Monitoring on Twitter, targeting two
new tasks: (1) the categorization of tweets with respect to standard
reputation dimensions provided by the Reputation Institute (
http://www.reputationinstitute.com/about-reputation-institute/the-reptrak-framework)
and (2) the characterization of Twitter profiles related to a certain
activity domain by classifying them by type (as journalists, professionals,
etc.) and finding influential authors.

Participants are welcome to present systems that attempt one or both tasks
(please refer to http://nlp.uned.es/replab2014/ for details).

Note that Twitter profile classification forms part of the shared
PAN-RepLab author profiling task. Besides the characterization of profiles
from a reputation analysis perspective, participants can also attempt the
classification of authors by gender and age, which is the focus of PAN 2014
(
http://www.uni-weimar.de/medien/webis/research/events/pan-14/pan14-web/author-profiling.html).

In addition to the two tasks mentioned above, RepLab 2014 will include a
track with peer-reviewed papers, TORM (Track for Online Reputation
Monitoring) which will present research progress in tasks addressed by
RepLab 2013 (http://www.limosine-project.eu/events/replab2013,
http://nlp.uned.es/replab2013/).

DATA SETS:
----------
For the reputation dimensions task, part of the RepLab 2013 data set will
be used. It will contain around 70,000 tweets annotated according to their
reputational dimension and belonging to the automotive and banking domains.

For the user profiling task, the data set consists of over 8,000 Twitter
profiles (all with at least 1,000 followers) related to the automotive and
banking domains. Each profile is represented by (i) profile name; (ii)
profile URL and (iii) the last 600 tweets published by the author at
crawling time. The opinion makers (i.e. authors with reputational
influence) have been manually identified by reputation experts and are
annotated as "Influencer".

Each opinion maker is categorized as journalist, professional, authority,
activist, investor, company or celebrity. The data set will be split into
training and test subsets. The estimatated proportion is 30% and 70%
respectively, although the exact splits will be given later.

HOW TO PARTICIPATE:
-------------------
Register for RepLab at the CLEF 2014 web page (http://clef2014.org) and
contact the lab organizers (enrique at lsi.uned.es and jcalbornoz at lsi.uned.es)
for further instructions.

IMPORTANT DATES:
----------------
    March 1: Release of training data

    March 17: Release of test data

    May5: System results due

    May 19: Official results released

    June 7: Deadline for paper submissions

    September 15-18: CLEF 2014 Conference in Sheffield

A call for papers for TORM (Track for Online Reputation Monitoring) will be
released shortly.

IMPORTANT LINKS:
----------------

- RepLab 2014 guidelines:   http://nlp.uned.es/replab2014/

- CLEF conference web page: http://clef2014.clef-initiative.eu/

- Facebook event (On this forum, you can share your impressions
  and resolve doubts that might arise during the development):
  https://www.facebook.com/events/593775794030878/

ORGANIZERS:
-----------
RepLab is an activity sponsored by EU project LiMoSINe (
http://limosine-project.eu). Lab organizers are:

Adolfo Corujo, Llorente & Cuenca
Julio Gonzalo, UNED
Maarten de Rijke, University of Amsterdam
Edgar Meij, Yahoo Labs
Enrique Amigó, UNED,
Jorge Carrillo de Albornoz, UNED
Damiano Spina, UNED
Irina Chugur, UNED
Vanessa Álvarez, Llorente & Cuenca
Ana Pitart, Llorente & Cuenca

STEERING COMMITTEE:
-------------------

Eugene Agichtein, Emory University, USA
Alexandra Balahur, JRC, Italy
Krisztian Balog, U. Stavanger, Norway
Donna Harman, NIST, USA
Eduard Hovy, Carnegy Mellon University, USA
Radu Jurca, Google, Switzerland
Jussi Karlgren, Gavagai/SICS, Sweden
Mounia Lalmas, Yahoo Research, Spain
Jochen Leidner, Thomson Reuters, Switzerland
Bing Liu, U. Illinois at Chicago, USA
Alessandro Moschitti, U. Trento, Italy
Miles Osborne, U. Edinburgh, UK
Hans Uszkoreit, U. Saarbrucken, Germany
James Shanahan, Boston U., USA
Belle Tseng, Apple, Inc.
Julio Villena, Daedalus/U. Carlos III, Spain

-- 

-----------------------------------------------

*Jorge Carrillo de Albornoz, MSc, PhD.*
NLP & IR Group at UNED (http://nlp.uned.es)
Dept. Lenguajes y Sistemas Informáticos
E.T.S. Informática UNED
C/ Juan del Rosal, 16
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20140219/fb3942f7/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora