36.392, FYI: Call for Participation: MultimodalReasoning Task at CLEF 2025!

[The LINGUIST List]

LINGUIST List: Vol-36-392. Thu Jan 30 2025. ISSN: 1069 - 4875.

Subject: 36.392, FYI: Call for Participation: MultimodalReasoning Task at CLEF 2025!

Moderator: Steven Moran (linguist at linguistlist.org)
Managing Editor: Justin Fuller
Team: Helen Aristar-Dry, Steven Franks, Joel Jenkins, Daniel Swanson, Erin Steitz
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Editor for this issue: Joel Jenkins <joel at linguistlist.org>

================================================================


Date: 30-Jan-2025
From: Dimitar Dimitrov [mitko.bg.ss at gmail.com]
Subject: Call for Participation: MultimodalReasoning Task at CLEF 2025!


We’re excited to announce the MultimodalReasoning shared task as part
of CLEF 2025, focusing on the reasoning capabilities of
Vision-Language Models (VLMs).
Motivation:
While VLMs excel at basic tasks like image captioning and simple
visual question answering, they struggle with complex reasoning. This
task challenges participants to explore and improve their models'
ability to reason through multilingual, multimodal inputs.
Task Description:
Participants will address Multilingual Visual Question Answering (VQA)
by identifying the correct answer from multiple options, given an
image.
Evaluation Metric:
Accuracy will determine the model's performance.
Why Participate?
Advance the field of multimodal AI reasoning.
Benchmark your systems on challenging multilingual data.
Share your insights at CLEF 2025 in Madrid, Spain!
Key Dates:
Registration Opens: 20 Dec 2024
Registration Closes: 25 Apr 2025
Test Data Release: 24 Mar 2025
Submission Deadline: 10 May 2025
We invite you to register and join this exciting challenge!
📍 More Info & Registration Details:
https://www.imageclef.org/2025/multimodalreasoning
Let’s shape the future of reasoning in AI together!
Best regards,
Task Organizing Team, MultimodalReasoning

Linguistic Field(s): Computational Linguistics

Subject Language(s): English (eng)




------------------------------------------------------------------------------

********************** LINGUIST List Support ***********************
Please consider donating to the Linguist List to support the student editors:

https://www.paypal.com/donate/?hosted_button_id=87C2AXTVC4PP8

LINGUIST List is supported by the following publishers:

Bloomsbury Publishing http://www.bloomsbury.com/uk/

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

De Gruyter Mouton https://cloud.newsletter.degruyter.com/mouton

Elsevier Ltd http://www.elsevier.com/linguistics

John Benjamins http://www.benjamins.com/

Language Science Press http://langsci-press.org

Multilingual Matters http://www.multilingual-matters.com/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Wiley http://www.wiley.com


----------------------------------------------------------
LINGUIST List: Vol-36-392
----------------------------------------------------------