34.1710, Calls: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP

[The LINGUIST List]

LINGUIST List: Vol-34-1710. Wed May 31 2023. ISSN: 1069 - 4875.

Subject: 34.1710, Calls: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP

Moderator: Malgorzata E. Cavar, Francis Tyers (linguist at linguistlist.org)
Managing Editor: Lauren Perkins
Team: Helen Aristar-Dry, Steven Franks, Everett Green, Joshua Sims, Daniel Swanson, Matthew Fort, Maria Lucero Guillen Puon, Zackary Leech, Lynzie Coburn
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           https://funddrive.linguistlist.org/donate/

Editor for this issue: Everett Green <everett at linguistlist.org>
================================================================


Date: 31-May-2023
From: Simona Frenda [simona.frenda at gmail.com]
Subject: 2nd Workshop on Perspectivist Approaches to Disagreement in NLP


Full Title: 2nd Workshop on Perspectivist Approaches to Disagreement
in NLP
Short Title: NLPerspectives

Date: 30-Sep-2023 - 01-Oct-2023
Location: Kraków, Poland
Contact Person: Simona Frenda
Meeting Email: simona.frenda at unito.it
Web Site: https://nlperspectives.di.unito.it/w/2nd-workshop-on-perspec
tivist-approaches-to-nlp/

Linguistic Field(s): Computational Linguistics

Call Deadline: 23-Jun-2023

Meeting Description:

2nd Workshop on Perspectivist Approaches to Disagreement in NLP (and
Beyond) (NLPerspectives)

Until recently, the dominant paradigm in natural language processing
(and other areas of artificial intelligence) has been to resolve
observed label disagreement into a single “ground truth” or “gold
standard” via aggregation, adjudication, or statistical means.
However, in recent years, the field has increasingly focused on
subjective tasks, such as abuse detection or quality estimation, in
which multiple points of view may be equally valid, and a unique
‘ground truth’ label may not exist (Plank, 2022). At the same time, as
concerns have been raised about bias and fairness in AI, it has become
increasingly apparent that an approach which assumes a single “ground
truth” can erase minority voices.

Strong perspectivism in NLP (Cabitza et al., 2023) pursues the spirit
of recent initiatives such as Data Statements (Bender and Friedman,
2018), extending their scope to the full NLP pipeline, including the
aspects related to modelling, evaluation and explanation.

In line with the first edition, the NLPerspectives (Perspectivist
Approaches to Disagreement in NLP)  workshop will explore current and
ongoing work on: the collection and labelling of non-aggregated
datasets; and approaches to modelling and including these
perspectives, as well as evaluation and applications of
multi-perspective Machine Learning models. We also welcome opinion
pieces and literature reviews, e.g., in the context of fairness and
inclusion.

A key outcome of this second edition will be to build on the work
begun at https://pdai.info/ to create a repository of perspectivist
datasets with non-aggregated labels for use by researchers in
perspectivist NLP modelling.

Authors are, therefore, invited to share their LRs (data, tools,
services, etc.) and provide  essential information about resources
(i.e., also technologies, standards, evaluation kits, etc.) that have
been used for the work or are a result of their research. In addition,
authors will be required to adhere to ethical research policies on AI
and may include an ethics statement in their papers.

The NLPerspectives workshop will be hosted in person during the 26th
edition of ECAI 2023 in Kraków, Poland, on 30 September or 1 October
2023.

2nd Call for Papers:

Submissions

The papers should be submitted as a PDF document, conforming to the
formatting guidelines provided in the call for papers of ECAI 2023
conference: https://ecai2023.eu/ECAI2023

We accept three types of submissions:
Regular research papers;
Non-archival submissions: like research papers, but will not be
included in the proceedings;
Research communications: 4-page abstracts summarizing relevant
research published elsewhere.

Research papers (archival or non-archival) may consist of up to 7
pages of content, plus 1 page for references. Research communications
may consist of up to 4 pages of content. Submissions should be sent in
electronic forms, using the Softconf START conference management
system at this URL:

https://softconf.com/n/NLPerspectives/user/scmd.cgi?scmd=submitNew

Topics

We invite original research papers from a wide range of topics,
including but not limited to:
Non-aggregated data collection and annotation frameworks
Descriptions of corpora collected under the perspectivist paradigm
Multi-perspective Modelling and Machine Learning
Evaluation of multi-perspective models/ models of disagreement
Multi-perspective disagreement as applied to NLP evaluation
Fairness and inclusive modelling
Perspectivist approaches for social good
Applications of multi-perspective modelling
Computing with (dis)agreement
Perspectivist Natural Language Generation
Foundational aspects of perspectivism
Opinion pieces and reviews on perspectivist approaches to NLP

Submissions are open to all, and are to be submitted anonymously (and
must conform to the instructions for double-blind review). All papers
will be refereed through a double-blind peer review process by at
least three reviewers, with final acceptance decisions made by the
workshop organizers. Scientific papers will be evaluated based on
relevance, significance of contribution, impact, technical quality,
scholarship, and quality of presentation.

Attendance

At least one author of each accepted paper is required to participate
in the conference and present the work.

Important Dates

* Friday June 23, 2023: Paper submission
* Friday August 4, 2023: Notification of acceptance
* Friday September 1, 2023: Camera-ready papers due
* Saturday September 30 or Sunday October 1, 2023: Workshop


Workshop organisers:

Gavin Abercrombie, Heriot-Watt University
Valerio Basile, University of Turin
Davide Bernardi, Amazon Alexa
Shiran Dudy, University of Colorado, Boulder
Simona Frenda,  University of Turin
Lucy Havens, University of Edinburgh
Elisa Leonardelli, Fondazione Bruno Kessler
Sara Tonelli, Fondazione Bruno Kessler

Contact us at g.abercrombie at hw.ac.uk if you have any questions.
Website: https://nlperspectives.di.unito.it/



------------------------------------------------------------------------------

Please consider donating to the Linguist List https://give.myiu.org/iu-bloomington/I320011968.html


LINGUIST List is supported by the following publishers:

American Dialect Society/Duke University Press http://dukeupress.edu

Bloomsbury Publishing (formerly The Continuum International Publishing Group) http://www.bloomsbury.com/uk/

Brill http://www.brill.com

Cambridge Scholars Publishing http://www.cambridgescholars.com/

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

De Gruyter Mouton https://cloud.newsletter.degruyter.com/mouton

Dictionary Society of North America http://dictionarysociety.com/

Edinburgh University Press www.edinburghuniversitypress.com

Equinox Publishing Ltd http://www.equinoxpub.com/

European Language Resources Association (ELRA) http://www.elra.info

Georgetown University Press http://www.press.georgetown.edu

John Benjamins http://www.benjamins.com/

Lincom GmbH https://lincom-shop.eu/

Linguistic Association of Finland http://www.ling.helsinki.fi/sky/

MIT Press http://mitpress.mit.edu/

Multilingual Matters http://www.multilingual-matters.com/

Narr Francke Attempto Verlag GmbH + Co. KG http://www.narr.de/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Oxford University Press http://www.oup.com/us

SIL International Publications http://www.sil.org/resources/publications

Springer Nature http://www.springer.com

Wiley http://www.wiley.com


----------------------------------------------------------
LINGUIST List: Vol-34-1710
----------------------------------------------------------