36.3154, Confs: 1st Workshop on Multilingual Multicultural Evaluation (Morocco)

[The LINGUIST List]

LINGUIST List: Vol-36-3154. Mon Oct 20 2025. ISSN: 1069 - 4875.

Subject: 36.3154, Confs: 1st Workshop on Multilingual Multicultural Evaluation (Morocco)

Moderator: Steven Moran (linguist at linguistlist.org)
Managing Editor: Valeriia Vyshnevetska
Team: Helen Aristar-Dry, Mara Baccaro, Daniel Swanson
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Editor for this issue: Valeriia Vyshnevetska <valeriia at linguistlist.org>

================================================================


Date: 17-Oct-2025
From: Pinzhen Chen [pinzhen.chen at ed.ac.uk]
Subject: 1st Workshop on Multilingual Multicultural Evaluation


1st Workshop on Multilingual Multicultural Evaluation
Short Title: MME

Date: 24-Mar-2026 - 29-Mar-2026
Location: Rabat, Morocco
Contact: MME organizers
Contact Email: mme-workshop at googlegroups.com
Meeting URL: https://multilingual-multicultural-evaluation.github.io/

Linguistic Field(s): Computational Linguistics

Submission Deadline: 19-Dec-2025

Built an LLM for so many languages, but how could you evaluate it?
This workshop brings together the community to answer this question
through three goals:
- Establish a dedicated venue for multilingual evaluation, including
resources, metrics, and methodologies;
- Advance and standardize evaluation practices to enhance accuracy,
scalability, fairness, and cross-system comparability;
- Integrate cultural and social dimensions into multilingual
evaluation.
Call for Papers:
We invite archival (ACL Anthology) or non-archival submissions, in
ACL's short or long format. We accept both direct and ARR-reviewed
submissions. Topics include but are not limited to:
- Evaluation resources beyond English or Western-centric perspectives
and materials;
- Annotation methodology and procedures;
- Standardised reporting and scientific comparison of multilingual
performance;
- Evaluation protocols: ranking vs direct assessment, rubric-based vs
reference-based vs reference-free, prompt variations, etc;
- Metrics, LLM judges, and reward models;
- Complex tasks: multimodality, fairness, long I/O, tool using,
code-switching, literary, etc;
- Sociocultural and cognitive variation affecting the use and
evaluation across languages;
- Scalable evaluation of cultural and factual knowledge;
- Efficient evaluation of a massive number of languages and tasks;
- AI-assisted evaluation: data, methods, metrics, and standards;
- Other position, application-, or theory-focused contributions.
Dates (tentative, all dates are 23:59 AoE):
- Direct submission deadline: 19 Dec 2025
- Pre-reviewed ARR submission deadline: 02 Jan 2026
- Notification of acceptance: 23 Jan 2026
- Camera-ready version due: 03 Feb 2026
- Workshop date: 28 or 29 Mar 2026
Website: https://multilingual-multicultural-evaluation.github.io/
Email: mme-workshop at googlegroups.com
Submission: OpenReview, link TBD



------------------------------------------------------------------------------

********************** LINGUIST List Support ***********************
Please consider donating to the Linguist List, a U.S. 501(c)(3) not for profit organization:

https://www.paypal.com/donate/?hosted_button_id=87C2AXTVC4PP8

LINGUIST List is supported by the following publishers:

Bloomsbury Publishing http://www.bloomsbury.com/uk/

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

De Gruyter Brill https://www.degruyterbrill.com/?changeLang=en

Edinburgh University Press http://www.edinburghuniversitypress.com

John Benjamins http://www.benjamins.com/

Language Science Press http://langsci-press.org

Lincom GmbH https://lincom-shop.eu/

MIT Press http://mitpress.mit.edu/

Multilingual Matters http://www.multilingual-matters.com/

Narr Francke Attempto Verlag GmbH + Co. KG http://www.narr.de/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Peter Lang AG http://www.peterlang.com


----------------------------------------------------------
LINGUIST List: Vol-36-3154
----------------------------------------------------------