31.1552, Confs: Italian; Comp Ling, Ling Theories, Neuroling, Semantics, Syntax/Italy

[The LINGUIST List]

LINGUIST List: Vol-31-1552. Thu May 07 2020. ISSN: 1069 - 4875.

Subject: 31.1552, Confs: Italian; Comp Ling, Ling Theories, Neuroling, Semantics, Syntax/Italy

Moderator: Malgorzata E. Cavar (linguist at linguistlist.org)
Student Moderator: Jeremy Coburn
Managing Editor: Becca Morris
Team: Helen Aristar-Dry, Everett Green, Sarah Robinson, Lauren Perkins, Nils Hjortnaes, Yiwen Zhang, Joshua Sims
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           https://funddrive.linguistlist.org/donate/

Editor for this issue: Lauren Perkins <lauren at linguistlist.org>
================================================================


Date: Thu, 07 May 2020 19:52:55
From: Cristiano Chesi [cristiano.chesi at iusspavia.it]
Subject: Acceptability & Complexity evaluation task for Italian (AcCompl-it) for EVALITA 2020

 
Acceptability & Complexity evaluation task for Italian (AcCompl-it) for EVALITA 2020 
Short Title: AcCompl-it 

Date: 30-Nov-2020 - 03-Dec-2020 
Location: Bologna, Italy 
Contact: Cristiano Chesi 
Contact Email: cristiano.chesi at iusspavia.it 
Meeting URL: https://sites.google.com/view/accompl-it/ 

Linguistic Field(s): Computational Linguistics; Linguistic Theories; Neurolinguistics; Semantics; Syntax 

Subject Language(s): Italian (ita)

Meeting Description: 

AcCompl-It is a task aimed at developing and evaluating methods to classify
Italian sentences according to their degree of Acceptability and Complexity
and/or to model specific phenomena related to linguistic complexity and/or
acceptability. The task is of interest for different communities focusing on
psycholinguistics and theoretical linguistics as well as NLP-based
applications such as natural language generation and complexity assessment.

 

Program Information: 

Participants are invited to develop computational models capable of predicting
Acceptability and/or Complexity scores for a set of sentences extracted both
from naturalistic and synthetic corpora and also including classic
morphosyntactic manipulations tested in psycholinguistics and formal
linguistics literature. 
The task is articulated into the following subtasks:
1. ACCEPT Subtask: providing an acceptability score on a 1-7 Likert scale for
each sentence in the test set, along with an estimation of its standard error;
2. COMPL Subtask: providing a complexity score on a 1-7 Likert scale for each
sentence in the test set, along with an estimate of its standard error;
3. OPEN Subtask: modeling linguistic phenomena correlated with the human
ratings of sentence acceptability and/or complexity in the datasets provided. 

The three subtasks are independent. Participants can decide to participate in
just one of them, though we encourage participation in multiple subtasks,
since the complexity metrics might be influenced by the grammatical status of
an expression, and vice versa. A full specification of the tasks, data and
acceptability/complexity definitions will be provided in the web site. 
In the first two subtasks, the reference metrics will be 7-points Likert scale
scores, 1 = lowest, 7 = highest. 
In the open subtask, the linguistic phenomena to be modelled will be freely
chosen by each participant, who will build the model on the basis of the data
in the training sets provided for the ACCEPT and COMPL Subtasks.
Participants are free to use external resources, but  every resource used has
to be described in detail in the final report.

All details about the task, data, and evaluation can be found in the website
https://sites.google.com/view/accompl-it/ 

Important Dates: 
- 29 May 2020: development and distribution (on the Task Web Page) of datasets
for training and development
- 4 September 2020: development and distribution (on the Task Web Page) of
datasets
for testing
- 4 - 24 September 2020: evaluation window and collection of participants'
results
- 2 October 2020: assessment returned to participants
- 6 November 2020: technical reports due to organizers (camera-ready)
- 2-3 December 2020: final workshop in Bologna

Updates will be made available in the Evalita 2020 website
(http://www.evalita.it/2020), check it often.

Organizers: 
Pauli Brattico*
Dominique Brunato**
Cristiano Chesi*
Felice Dell'Orletta**
Simonetta Montemagni**
Giulia Venturi**
Roberto Zamparelli***

* NETS - IUSS Center for NEurocognition and Theoretical Syntax, IUSS Pavia,
Italy
** Istituto di Linguistica Computazionale ''A. Zampolli'' (CNR), Pisa, Italy
*** Centro Interdipartimentale MEnte/Cervello - Dipartimento di Psicologia e
Scienze Cognitive - Università di Trento, Italy

Contacts: 
Join the google group:
https://groups.google.com/forum/#!forum/accompl-it-evalita2020

And contact the organizers: 
accomplit.evalita2020 at gmail.com





------------------------------------------------------------------------------

***************************    LINGUIST List Support    ***************************
 The 2019 Fund Drive is under way! Please visit https://funddrive.linguistlist.org
  to find out how to donate and check how your university, country or discipline
     ranks in the fund drive challenges. Or go directly to the donation site:
               https://iufoundation.fundly.com/the-linguist-list-2019

                        Let's make this a short fund drive!
                Please feel free to share the link to our campaign:
                    https://funddrive.linguistlist.org/donate/
 


----------------------------------------------------------
LINGUIST List: Vol-31-1552	
----------------------------------------------------------