27.2042, FYI: Deadline Extended: Low Resource HLT Evaluation

[The LINGUIST List via LINGUIST]

LINGUIST List: Vol-27-2042. Wed May 04 2016. ISSN: 1069 - 4875.

Subject: 27.2042, FYI: Deadline Extended: Low Resource HLT Evaluation

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Anthony Aristar, Helen Aristar-Dry, Robert Coté, Sara Couture)
Homepage: http://linguistlist.org

*****************    LINGUIST List Support    *****************
                       Fund Drive 2016
                   25 years of LINGUIST List!
Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Ashley Parker <ashley at linguistlist.org>
================================================================


Date: Wed, 04 May 2016 10:07:26
From: Shudong Huang [shudong.huang at nist.gov]
Subject: Deadline Extended: Low Resource HLT Evaluation

 
National Institute of Standards and Technology (NIST) is pleased to announce a
new evaluation series aimed to advance human language technologies that
provide rapid and effective response to emerging incidents where the language
resources are very limited. This evaluation series is called Low Resource HLT
Evaluation (LoReHLT). LoReHLT16 plans to
offer three evaluation tasks: machine translation (MT), named entity
recognition (NER), and situation frames (SF).

Highlights:

- Three evaluation tasks: MT, NER, and SF
- Two training conditions: constrained (required) and unconstrained
- Surprise language evaluation
- Three evaluation checkpoints to gauge performance based on training
resources given

2016 Schedule:

Feb 19 - May 16: Registration period (deadline extended)
Jun 2 - 8: Dry run period
Jun 29: Encrypted evaluation data released
Jul 6: Surprise language announced and evaluation begins
Jul 13: Checkpoint 1 due
Jul 20: Checkpoint 2 due
Aug 3: Checkpoint 3 due
Aug 28 – 29: Post evaluation workshop (Nashua, New Hampshire, US)

For more information about the LoReHLT16 evaluation, please see the evaluation
plan at  http://www.nist.gov/itl/iad/mig/lorehlt16.cfm. If you have any
questions, contact us at lorehlt_poc at nist.gov.

Feel free to forward this message to your colleagues who may find the
evaluation of interest.

Best Regards,
NIST LoReHLT team
 



Linguistic Field(s): Computational Linguistics





 



------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
                       Fund Drive 2016
Please support the LL editors and operation with a donation at:
            http://funddrive.linguistlist.org/donate/

This year the LINGUIST List hopes to raise $79,000. This money 
will go to help keep the List running by supporting all of our 
Student Editors for the coming year.

Don't forget to check out Fund Drive 2016 site!

http://funddrive.linguistlist.org/

For all information on donating, including information on how to 
donate by check, money order, PayPal or wire transfer, please visit:
http://funddrive.linguistlist.org/donate/

The LINGUIST List is under the umbrella of Indiana University and 
as such can receive donations through the eLinguistics Foundation, 
which is a registered 501(c) Non Profit organization. Our Federal 
Tax number is 45-4211155. These donations can be offset against 
your federal and sometimes your state tax return (U.S. tax payers only). 
For more information visit the IRS Web-Site, or contact your financial 
advisor.

Many companies also offer a gift matching program, such that 
they will match any gift you make to a non-profit organization. 
Normally this entails your contacting your human resources department 
and sending us a form that the eLinguistics Foundation fills in and 
returns to your employer. This is generally a simple administrative 
procedure that doubles the value of your gift to LINGUIST, without 
costing you an extra penny. Please take a moment to check if 
your company operates such a program.

Thank you very much for your support of LINGUIST!
 


----------------------------------------------------------
LINGUIST List: Vol-27-2042	
----------------------------------------------------------