24.423, Confs: Computational Linguistics/USA

Wed Jan 23 18:29:13 UTC 2013

LINGUIST List: Vol-24-423. Wed Jan 23 2013. ISSN: 1069 - 4875.

Subject: 24.423, Confs: Computational Linguistics/USA

Moderators: Anthony Aristar, Eastern Michigan U <aristar at linguistlist.org>
            Helen Aristar-Dry, Eastern Michigan U <hdry at linguistlist.org>

Reviews: Veronika Drake, U of Wisconsin Madison
Monica Macaulay, U of Wisconsin Madison
Rajiv Rao, U of Wisconsin Madison
Joseph Salmons, U of Wisconsin Madison
Anja Wanner, U of Wisconsin Madison
       <reviews at linguistlist.org>

Homepage: http://linguistlist.org

Do you want to donate to LINGUIST without spending an extra penny? Bookmark
the Amazon link for your country below; then use it whenever you buy from
Amazon!

USA: http://www.amazon.com/?_encoding=UTF8&tag=linguistlist-20
Britain: http://www.amazon.co.uk/?_encoding=UTF8&tag=linguistlist-21
Germany: http://www.amazon.de/?_encoding=UTF8&tag=linguistlistd-21
Japan: http://www.amazon.co.jp/?_encoding=UTF8&tag=linguistlist-22
Canada: http://www.amazon.ca/?_encoding=UTF8&tag=linguistlistc-20
France: http://www.amazon.fr/?_encoding=UTF8&tag=linguistlistf-21

For more information on the LINGUIST Amazon store please visit our
FAQ at http://linguistlist.org/amazon-faq.cfm.

Editor for this issue: Xiyan Wang <xiyan at linguistlist.org>
================================================================  

Date: Wed, 23 Jan 2013 13:28:00
From: Myroslava Dzikovska [m.dzikovska at ed.ac.uk]
Subject: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge

E-mail this message to a friend:
http://linguistlist.org/issues/emailmessage/verification.cfm?iss=24-423.html&submissionid=7307025&topicid=4&msgnumber=1

The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge 

Date: 25-Feb-2013 - 15-Mar-2013 
Location: Atlanta, USA 
Contact: Myroslava Dzikovska 
Contact Email: m.dzikovska at ed.ac.uk 
Meeting URL: http://bit.ly/10nQTGJ 

Linguistic Field(s): Computational Linguistics 

Meeting Description: 

Second Call for Participation

The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge (SemEval-2013 Task 7)

Highlights:

- Task Registration Deadline: February 15, 2013, at http://bit.ly/XUcQ0v
- Challenge Duration: from February 25, 2013 to MARCH 15, 2013
- Joint Challenge Email Discussion Group: http://bit.ly/XwcwCR
- Detailed Task Description: http://bit.ly/10nQTGJ
- Updated Evaluation Code and Baselines: http://bit.ly/140DHMH
- SemEval Workshop: June 13-14, 2013, co-located with NAACL
  (http://bit.ly/140uIuN) & *Sem (http://bit.ly/WknhYY),
  Atlanta, Georgia, USA

Introduction:

We are pleased to invite participants to the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge at SemEval 2013, a common effort of both educational technology and textual inference communities in order to present a unified scientific challenge addressing researchers in both fields. It will be run together with the SEMEVAL-2013 Semantic Evaluation Exercise, co-located with the *SEM and NAACL-2013 conferences.

The goal of the task is to produce an assessment of student answers to explanation and definition questions typically asked in practice exercises, tests or tutorial dialogue.  It is linked to the tasks of semantic analysis and recognizing textual entailment in the textual inference community, and essay grading and short answer assessment in the educational NLP community.

Specifically, given a question, a known correct ‘reference answer’ and a 1- or 2-sentence ‘student answer’, the Main task consists of assessing the correctness of a student’s answer at different levels of granularity - either 5-way (correct, partially correct, contradictory, irrelevant, not in the domain), 3-way task (correct, contradictory, incorrect), or 2-way task (correct, incorrect). Participants can opt to carry out the task at any level of granularity.

More detail is available at the task website, http://bit.ly/10nQTGJ

Schedule:

- February 15, 2013 	Registration Deadline

Challenge:

- MAIN TASK test set release: Feb. 25
- MAIN TASK submissions: March 4
- PILOT TASK test set release: March 5
- PILOT TASK submissions: March 12
- Results to participants: March 15

- April 9, 2013 	Paper submission deadline [TBC]
- April 23, 2013 	Reviews Due [TBC]
- May 4, 2013 		Camera ready Due [TBC]

SemEval Workshop:

- June 13-14, 2013, co-located with NAACL & *Sem, Atlanta, Georgia, USA

Participating in the Challenge:

More details on the Main and Pilot tasks are available at the SEMEVAL 2013 website: http://bit.ly/10nQTGJ

Future updates will be distributed through the Joint Challenge Google Discussion Group, please join to ensure that you will receive announcements and status updates, at http://bit.ly/XwcwCR

To help us with forward planning, please register now at SemEval 2013 website if you are intending to enter the challenge (http://bit.ly/XUcQ0v). All teams are required to register by 15 February 2013. 

----------------------------------------------------------
LINGUIST List: Vol-24-423	
----------------------------------------------------------