34.1064, Calls: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP

[The LINGUIST List]

LINGUIST List: Vol-34-1064. Thu Mar 30 2023. ISSN: 1069 - 4875.

Subject: 34.1064, Calls: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP

Moderator: Malgorzata E. Cavar, Francis Tyers (linguist at linguistlist.org)
Managing Editor: Lauren Perkins
Team: Helen Aristar-Dry, Steven Franks, Everett Green, Joshua Sims, Daniel Swanson, Matthew Fort, Maria Lucero Guillen Puon, Zackary Leech, Lynzie Coburn
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           https://funddrive.linguistlist.org/donate/

Editor for this issue: Everett Green <everett at linguistlist.org>
================================================================


Date: 
From: Simona Frenda [simona.frenda at unito.it]
Subject: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP


Full Title: 2nd Workshop on Perspectivist Approaches to Disagreement
in NLP: First Call for Papers
Short Title: NLPerspectives

Date: 30-Sep-2023 - 01-Oct-2023
Location: Kraków, Poland
Contact Person: Gavin Abercrombie
Meeting Email: g.abercrombie at hw.ac.uk
Web Site: https://nlperspectives.di.unito.it/w/2nd-workshop-on-perspec
tivist-approaches-to-nlp/

Linguistic Field(s): Computational Linguistics

Call Deadline: 23-Jun-2023

Meeting Description:

2nd Workshop on Perspectivist Approaches to Disagreement in NLP (and
Beyond)

Until recently, the dominant paradigm in natural language processing
(and other areas of artificial intelligence) has been to resolve
observed label disagreement into a single “ground truth” or “gold
standard” via aggregation, adjudication, or statistical means.
However, in recent years, the field has increasingly focused on
subjective tasks, such as abuse detection or quality estimation, in
which multiple points of view may be equally valid, and a unique
‘ground truth’ label may not exist (Plank, 2022). At the same time, as
concerns have been raised about bias and fairness in AI, it has become
increasingly apparent that an approach which assumes a single “ground
truth” can erase minority voices.

Strong perspectivism in NLP (Cabitza et al., 2023) pursues the spirit
of recent initiatives such as Data Statements (Bender and Friedman,
2018), extending their scope to the full NLP pipeline, including the
aspects related to modelling, evaluation and explanation.

In line with the first edition, the NLPerspectives (Perspectivist
Approaches to Disagreement in NLP)  workshop will explore current and
ongoing work on: the collection and labelling of non-aggregated
datasets; and approaches to modelling and including these
perspectives, as well as evaluation and applications of
multi-perspective Machine Learning models. We also welcome opinion
pieces and literature reviews, e.g., in the context of fairness and
inclusion.

A key outcome of this second edition will be to build on the work
begun at https://pdai.info/ to create a repository of perspectivist
datasets with non-aggregated labels for use by researchers in
perspectivist NLP modelling.

Authors are, therefore, invited to share their LRs (data, tools,
services, etc.) and provide  essential information about resources
(i.e., also technologies, standards, evaluation kits, etc.) that have
been used for the work or are a result of their research. In addition,
authors will be required to adhere to ethical research policies on AI
and may include an ethics statement in their papers.

The NLPerspectives workshop will be hosted in person during the 26th
edition of ECAI 2023 in Kraków, Poland, on 30 September or 1 October
2023.

Call for Papers:

Submissions:
The contributions cannot exceed 7 pages (4 for research
communications, see below) not including references, and as
established by ECAI 2023 conference, the over length submissions will
be rejected without review.

The papers should be submitted as a PDF document, conforming to the
formatting guidelines provided in the call for papers of ECAI 2023
conference: https://ecai2023.eu/ECAI2023

We accept three types of submissions:
Regular research papers;
Non-archival submissions: like research papers, but will not be
included in the proceedings;
Research communications: 4-page abstracts summarising relevant
research published elsewhere.

Topics:
We invite original research papers from a wide range of topics,
including but not limited to:
Non-aggregated data collection and annotation frameworks
Descriptions of corpora collected under the perspectivist paradigm
Multi-perspective Modelling and Machine Learning
Evaluation of multi-perspective models/ models of disagreement
Multi-perspective disagreement as applied to NLP evaluation
Fairness and inclusive modelling
Perspectivist approaches for social good
Applications of multi-perspective modelling
Computing with (dis)agreement
Perspectivist Natural Language Generation
Foundational aspects of perspectivism
Opinion pieces and reviews on perspectivist approaches to NLP

Important Dates:
* Friday June 23, 2023: Paper submission
* Friday August 4, 2023: Notification of acceptance
* Friday September 1, 2023: Camera-ready papers due
* Saturday September 30 or Sunday October 1, 2023: Workshop

Submissions are open to all, and are to be submitted anonymously (and
must conform to the instructions for double-blind review). All papers
will be refereed through a double-blind peer review process by at
least three reviewers, with final acceptance decisions made by the
workshop organisers. Scientific papers will be evaluated based on
relevance, significance of contribution, impact, technical quality,
scholarship, and quality of presentation.

More information about the submission, publication of proceedings and
date of the workshop will be provided soon. We are seeking sponsors in
order to provide financial support for conference registration,
travel, and accommodation for participants.

Attendance:
At least one author of each accepted paper is required to participate
in the conference and present the work.

Workshop organisers:
- Gavin Abercrombie, Heriot-Watt University
- Valerio Basile, University of Turin
- Davide Bernardi, Amazon Alexa
- Shiran Dudy, University of Colorado, Boulder
- Simona Frenda,  University of Turin
- Lucy Havens, University of Edinburgh
- Elisa Leonardelli, Fondazione Bruno Kessler
- Sara Tonelli, Fondazione Bruno Kessler

Contact us at g.abercrombie at hw.ac.uk if you have any questions.
Website: https://nlperspectives.di.unito.it/



------------------------------------------------------------------------------


LINGUIST List is supported by the following publishers:

American Dialect Society/Duke University Press http://dukeupress.edu

Bloomsbury Publishing (formerly The Continuum International Publishing Group) http://www.bloomsbury.com/uk/

Brill http://www.brill.com

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

De Gruyter Mouton https://cloud.newsletter.degruyter.com/mouton

Dictionary Society of North America http://dictionarysociety.com/

Edinburgh University Press www.edinburghuniversitypress.com

European Language Resources Association (ELRA) http://www.elra.info

Georgetown University Press http://www.press.georgetown.edu

John Benjamins http://www.benjamins.com/

Lincom GmbH https://lincom-shop.eu/

Linguistic Association of Finland http://www.ling.helsinki.fi/sky/

Multilingual Matters http://www.multilingual-matters.com/

Narr Francke Attempto Verlag GmbH + Co. KG http://www.narr.de/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Oxford University Press http://www.oup.com/us

Springer Nature http://www.springer.com

Wiley http://www.wiley.com


----------------------------------------------------------
LINGUIST List: Vol-34-1064
----------------------------------------------------------