21.2315, FYI: Machine Textual Entailment Recognition Challenge

[linguist at LINGUISTLIST.ORG]

LINGUIST List: Vol-21-2315. Fri May 21 2010. ISSN: 1068 - 4875.

Subject: 21.2315, FYI: Machine Textual Entailment Recognition Challenge

Moderators: Anthony Aristar, Eastern Michigan U <aristar at linguistlist.org>
            Helen Aristar-Dry, Eastern Michigan U <hdry at linguistlist.org>
 
Reviews: Monica Macaulay, U of Wisconsin-Madison  
Eric Raimy, U of Wisconsin-Madison  
Joseph Salmons, U of Wisconsin-Madison  
Anja Wanner, U of Wisconsin-Madison  
       <reviews at linguistlist.org> 

Homepage: http://linguistlist.org/

The LINGUIST List is funded by Eastern Michigan University, 
and donations from subscribers and publishers.

Editor for this issue: Rachelle Felzien <rachelle at linguistlist.org>
================================================================  

To post to LINGUIST, use our convenient web form at
http://linguistlist.org/LL/posttolinguist.cfm.

===========================Directory==============================  

1)
Date: 19-May-2010
From: Danilo Giampiccolo < giampiccolo at celct.it >
Subject: Machine Textual Entailment Recognition Challenge
 

	
-------------------------Message 1 ---------------------------------- 
Date: Fri, 21 May 2010 22:50:12
From: Danilo Giampiccolo [giampiccolo at celct.it]
Subject: Machine Textual Entailment Recognition Challenge

E-mail this message to a friend:
http://linguistlist.org/issues/emailmessage/verification.cfm?iss=21-2315.html&submissionid=2634996&topicid=6&msgnumber=1
  


Sixth Recognising Textual Entailment Challenge at the 2010 Text Analysis
Conference:

http://www.nist.gov/tac/2010/RTE/

Knowledge base population (KBP) validation pilot guidelines now available

The deadline for the Text Analysis Conference 2010 track registration is
May 21, although late submissions will be considered.  Fore more
information, contact tac-manager at nist.gov.

The Recognizing Textual Entailment (RTE) task consists of developing a
system that, given two text fragments, can determine whether the meaning of
one text is entailed, i.e. can be inferred, from the other text.

Since its inception in 2005, RTE has enjoyed a constantly growing
popularity in the NLP community. After the first three highly successful
PASCAL RTE Challenges campaigns held in Europe, in 2008 RTE became a track
at the Text Analysis Conference (TAC), bringing it together with
communities working on NLP applications. The interaction has provided the
opportunity to apply RTE to specific application settings and move it
towards more realistic scenarios. In particular, the RTE-5 Pilot Search
Task represented a step forward, as for the first time textual entailment
recognition was performed on a corpus, instead of isolated H-T pairs, and
on a real NLP application, namely Summarization.

Organizations interested in participating in the RTE-6 Challenge are
invited to submit a track registration form by May 21, 2010, at the TAC
2010 web site:

http://www.nist.gov/tac/2010/

FINAL SCHEDULE

April 30        Main Task: Release of Development Set
May 10          KBP Validation Pilot: Release of Development Set
May 21      Deadline for TAC 2010 track registration
August 17       KBP Validation Pilot: Release of Test Set
August 30       Main Task: Release of Test Set
September 9     Main Task: Deadline for task submissions
September 16    Main Task: Release of individual evaluated results
September 17    KBP Validation Pilot: Deadline for task submissions
September 24    KBP Validation Pilot: Release of individual evaluated results
September 26    Deadline for TAC 2010 workshop presentation proposals
September 30    Main Task: Deadline for ablation tests submissions
October 7       Main Task: Release of individual ablation test results
October 20      Deadline for systems' reports

TRACK COORDINATORS AND ORGANIZERS:

Luisa Bentivogli    , CELCT and FBK, Italy (Track coordinator, bentivo at fbk.eu)
Danilo Giampiccolo, CELCT, Italy (Track coordinator, giampiccolo at celct.it)
Hoa Trang Dang, NIST, USA
Ido Dagan    , Bar Ilan University, Israel
Peter Clark, Boeing, USA 



Linguistic Field(s): Cognitive Science
                     Computational Linguistics
                     Philosophy of Language
                     Semantics
                     Text/Corpus Linguistics





 




-----------------------------------------------------------
LINGUIST List: Vol-21-2315