36.2182, Software: LingJudge – A Platform for Collecting Linguistic Judgment Data

[The LINGUIST List]

LINGUIST List: Vol-36-2182. Wed Jul 16 2025. ISSN: 1069 - 4875.

Subject: 36.2182, Software: LingJudge – A Platform for Collecting Linguistic Judgment Data

Moderator: Steven Moran (linguist at linguistlist.org)
Managing Editor: Valeriia Vyshnevetska
Team: Helen Aristar-Dry, Mara Baccaro, Daniel Swanson
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Editor for this issue: Daniel Swanson <daniel at linguistlist.org>

================================================================


Date: 15-Jul-2025
From: Tommaso Sgrizzi [tommaso.sgrizzi at iusspavia.it]
Subject: LingJudge – A Platform for Collecting Linguistic Judgment Data


LingJudge (www.lingjudge.eu) is a free-to-use, MIT-licensed,
Django-based platform designed for collecting linguistic judgments
from native speakers, created to support experimental and exploratory
research in linguistics. It offers a clean, intuitive interface for
both researchers and participants, streamlining the workflow of
designing, distributing, and collecting structured judgment tasks.
Key Features
Supported Task Types:
* Likert Scale: Sentence ratings on a customizable scale (2–10
points), with researcher-defined endpoints (e.g., "ungrammatical" ↔
"grammatical").
* Forced Choice: Participants choose between two sentences (with or
without context), allowing fine-grained grammaticality contrasts or
pragmatic judgments.
Task Creation:
* Create tasks via a simple web form.
* Add items individually or upload in bulk using CSV.
* Include task instructions, set the target language, randomize item
order, and preview the task before publishing.
Participant Experience:
* Native Language Filtering: The task feed is
personalized—participants only see tasks matching their registered
native language(s).
* Item-by-Item Flow: Tasks are presented one item at a time, with a
progress bar and simple navigation.
* Completion Time Tracking: Response times are logged for each
participant.
Results & Data:
* Researchers can download results as CSV files, including metadata
such as user ID, native languages, response times, and timestamps.
* Results are grouped by participant and include all relevant task and
item details.
User Profiles & Access:
* Registration includes native language(s), date of birth, and
optional affiliation.
* Authenticated users have access to a personal dashboard for task
creation, participation, results management, and profile editing.
* Users cannot view or participate in their own tasks, and cannot
repeat tasks they have already completed.
Privacy & Participation:
* Only authenticated users can create or complete tasks.
* No personal data is shown publicly—user IDs are stored internally
for result tracking.
* The platform is free to use for both researchers and participants.
Email Alerts:
* When a new task is published, all users with a matching native
language receive an email notification informing them that a new task
is available.
* Notifications can be easily disabled from the user’s profile
settings.
LingJudge is now fully operational and available at www.lingjudge.eu.
It's open for anyone to explore it, use it in their research or
teaching, and share it with students and colleagues.
Feedback on features, bugs, or new use cases is always welcome!

Linguistic Field(s): Applied Linguistics
                     General Linguistics
                     Psycholinguistics
                     Syntax




------------------------------------------------------------------------------

********************** LINGUIST List Support ***********************
Please consider donating to the Linguist List to support the student editors:

https://www.paypal.com/donate/?hosted_button_id=87C2AXTVC4PP8

LINGUIST List is supported by the following publishers:

Cascadilla Press http://www.cascadilla.com/

Language Science Press http://langsci-press.org

MIT Press http://mitpress.mit.edu/

Multilingual Matters http://www.multilingual-matters.com/


----------------------------------------------------------
LINGUIST List: Vol-36-2182
----------------------------------------------------------