34.3726, Calls: The 18th Linguistic Annotation Workshop

[The LINGUIST List]

LINGUIST List: Vol-34-3726. Sun Dec 10 2023. ISSN: 1069 - 4875.

Subject: 34.3726, Calls: The 18th Linguistic Annotation Workshop

Moderators: Malgorzata E. Cavar, Francis Tyers (linguist at linguistlist.org)
Managing Editor: Justin Fuller
Team: Helen Aristar-Dry, Steven Franks, Everett Green, Daniel Swanson, Maria Lucero Guillen Puon, Zackary Leech, Lynzie Coburn, Natasha Singh, Erin Steitz
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           https://funddrive.linguistlist.org/donate/

Editor for this issue: Zackary Leech <zleech at linguistlist.org>
================================================================


Date: 10-Dec-2023
From: Sophie Henning [sophie.e.henning at gmail.com]
Subject: The 18th Linguistic Annotation Workshop


Full Title: The 18th Linguistic Annotation Workshop
Short Title: LAW XVIII

Date: 21-Mar-2024 - 22-Mar-2024
Location: St. Julians, Malta
Contact Person: Sophie Henning
Meeting Email: law-xviii-2024 at googlegroups.com
Web Site: https://sigann.github.io/LAW-XVIII-2024/

Linguistic Field(s): Computational Linguistics; Text/Corpus
Linguistics
Subject Language(s): English (eng)

Meeting Description:

This workshop is the 18th annual meeting sponsored by the ACL Special
Interest Group on Annotation (SIGANN).

Linguistic annotation of natural language corpora is the backbone of
supervised methods of statistical natural language processing and a
supporting source of information for unsupervised methods, multitask
learning, and evaluation of both NLP tools and theories about natural
language within and outside of Linguistics.
The LAW-XVIII will provide a forum for presentation and discussion of
innovative research on all aspects of linguistic annotation, including
creation/evaluation of annotation schemes, methods for automatic and
manual annotation, use and evaluation of annotation software and
frameworks, representation of linguistic data and annotations,
semi-supervised “human in the loop” methods of annotation, as well as
crowd-sourcing approaches.
The workshop will also provide a forum for annotation researchers to
work towards standardization, best practices, and interoperability of
annotation information and software.

Call for Papers:

*Overview*
- Due to space limitations, this is a *shortened* version of the call
for papers. For the complete call for papers, see
https://sigann.github.io/LAW-XVIII-2024/cfp.html
- Submission of long and short papers: December 18, 2023 (no deadline
extension possible)
- Submission page: https://softconf.com/eacl2024/LAW-XVIII/
- Website: https://sigann.github.io/LAW-XVIII-2024/

*Special Theme*
The special theme of LAW-XVIII is “Annotation in the Age of Large
Language Models (LLMs).” In addition to LAW’s general topics, we
specifically invite submissions on the following topics:
- Comparison of linguistically annotated datasets vs. datasets created
using large language models. Potential topics include:
   - Comparison of models that have been trained on the respective
datasets
   - Impact of data size of manually annotated resources already
available prior to dataset creation with LLMs
   - Is synthetic dataset creation a viable option for non-standard
domains, e.g., the medical domain, where expert knowledge is required?
- Non-performance-related considerations of manual vs. synthetic
dataset creation (e.g., explainability)
- Impact and prevention of test dataset contamination in LLM training
- Usefulness of LLMs for linguistic research (in relation to
annotation).
- Any other topics related to the special theme.

*Submissions*
We accept both direct submissions and commitments from ACL Rolling
Review (ARR).

We welcome submissions of long and short papers, posters, and
demonstrations relating to the special theme or any aspect of
linguistic annotation, including:
- Annotation procedures
- Innovative automated and manual strategies for annotation
- Machine learning and knowledge-based methods for automation of
corpus annotation
- Creation, maintenance, and interactive exploration of annotation
structures and annotated data
- Annotation evaluation
- Inter-annotator agreement and other evaluation metrics and
strategies
- Qualitative evaluation of linguistic representations
- Innovative means to evaluate annotation quality
- Annotation access and use
- Representation formats/structures for annotations of different
phenomena, especially annotations at multiple levels, and means to
explore/manipulate them
- Linguistic considerations for merging annotations of distinct
phenomena
- Annotation schemes, guidelines and standards
- New and innovative annotation schemes, comparison of annotation
schemes
- Methodologies and resources for annotation scheme development
- Best practices for annotation procedures and/or development and
documentation of annotation schemes
- Interoperability of annotation formats and/or frameworks among
different systems as well as different tasks, frameworks, modalities,
and languages
- Results from the application and evaluation of standards for
linguistic annotation
- Annotation software and frameworks
- Development, evaluation and/or innovative use of annotation software
frameworks

*Dates*
(All submission deadlines are 11:59 p.m. UTC-12:00 “anywhere on Earth”
and will not be extended)
Anonymity period starts: November 18, 2023
Submission of long and short papers: December 18, 2023
ARR Commitment deadline: January 17, 2024
Notification of acceptance: January 20, 2024
Camera-ready papers due: January 30, 2024
Workshop: March 21 or 22, 2024

*Workshop Organizers*
Manfred Stede (Program Co-Chair)
Sophie Henning (Program Co-Chair)
Amir Zeldes (ACL SIGANN President)
Ines Rehbein (ACL SIGANN Secretary)



------------------------------------------------------------------------------

Please consider donating to the Linguist List https://give.myiu.org/iu-bloomington/I320011968.html


LINGUIST List is supported by the following publishers:

American Dialect Society/Duke University Press http://dukeupress.edu

Bloomsbury Publishing (formerly The Continuum International Publishing Group) http://www.bloomsbury.com/uk/

Brill http://www.brill.com

Cambridge Scholars Publishing http://www.cambridgescholars.com/

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

De Gruyter Mouton https://cloud.newsletter.degruyter.com/mouton

Dictionary Society of North America http://dictionarysociety.com/

Edinburgh University Press www.edinburghuniversitypress.com

Elsevier Ltd http://www.elsevier.com/linguistics

Equinox Publishing Ltd http://www.equinoxpub.com/

European Language Resources Association (ELRA) http://www.elra.info

Georgetown University Press http://www.press.georgetown.edu

John Benjamins http://www.benjamins.com/

Lincom GmbH https://lincom-shop.eu/

Linguistic Association of Finland http://www.ling.helsinki.fi/sky/

MIT Press http://mitpress.mit.edu/

Multilingual Matters http://www.multilingual-matters.com/

Narr Francke Attempto Verlag GmbH + Co. KG http://www.narr.de/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Oxford University Press http://www.oup.com/us

SIL International Publications http://www.sil.org/resources/publications

Springer Nature http://www.springer.com

Wiley http://www.wiley.com


----------------------------------------------------------
LINGUIST List: Vol-34-3726
----------------------------------------------------------