<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoPlainText">(apologies for cross-posting)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"> SECOND CALL FOR PAPERS<o:p></o:p></p>
<p class="MsoPlainText"> <o:p></o:p></p>
<p class="MsoPlainText"> The 8th Workshop on the Innovative Use of NLP for Building<o:p></o:p></p>
<p class="MsoPlainText"> Educational Applications (BEA8)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"> Atlanta, Georgia, USA; June 13, 2013 <o:p>
</o:p></p>
<p class="MsoPlainText"> (co-located with NAACL-HLT)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"> http://www.cs.rochester.edu/~tetreaul/naacl-bea8.html<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"> Submission Deadline: March 11, 2013 <o:p>
</o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">WORKSHOP DESCRIPTION<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Research in NLP applications for education continues to progress using innovative NLP techniques - statistical, rule-based, or most commonly, a combination of the two. New technologies have made it possible to include speech in both
assessment and Intelligent Tutoring Systems (ITS). NLP techniques are also being used to generate assessments, and tools for curriculum development of reading materials, as well as tools to support assessment and test development. As a community, we continue
to improve existing capabilities and to identify and generate innovative and creative ways to use NLP in applications for writing, reading, speaking, critical thinking, and assessment.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">In 2012, the use of NLP in educational contexts took two major steps forward. First, outside of the computational linguistics community, the Hewlett Foundation reached out to both the public and private sectors and sponsored two competitions:
one on automated essay scoring (Automated Student Assessment Prize: ASAP, Phase 1:http://www.kaggle.com/c/asap-aes), and a second on short-answer scoring (Phase 2: http://www.kaggle.com/c/asap-sas). The motivation driving these competitions was to engage
the larger scientific community in this enterprise. The two competitions were inspired by the Common Core State Initiative (http://www.corestandards.org/), an influential set of standards adopted by 45 states in the U.S. The Initiative describes what K-12
students should be learning with regard to Reading, Writing, Speaking, Listening, and Media and Technology. Another breakthrough for educational applications within the computational linguistics community was the second edition of the “Helping Our Own”
grammatical error detection/correction competition at last year’s BEA workshop – where 14 systems competed. In 2013, independent of the BEA workshop, there will be two shared task competitions. This year’s CoNLL Shared Task is on grammatical error correction
and there is a SemEval Shared Task on Student Response Analysis (http://www.cs.york.ac.uk/semeval-2013/task7/). Both of these competitions will increase the visibility of the educational problem space in the NLP community.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">In this year’s BEA workshop, we are soliciting papers across a broad range of educational applications, including: intelligent tutoring, learner cognition, use of corpora, grammatical error detection, tools for teachers and test developers,
and automated scoring and evaluation of open-ended responses. Since the first workshop in 1997, “Innovative Use of NLP in Building Educational Applications” has continued to bring together all NLP subfields to foster interaction and collaboration among researchers
in both academic institutions and industry. The workshop offers a venue for researchers to present and discuss their work in these areas. Each year, we see steady growth in workshop submissions and attendance, and the research has become more innovative and
advanced. In 2013, we expect that the workshop (consistent with previous workshops at ACL 1997, NAACL/HLT 2003, ACL 2005, ACL 2008, NAACL HLT 2009, NAACL HLT 2010, ACL 2011, NAACL HLT 2012), will continue to expose the NLP research community to technologies
that identify novel opportunities for the use of NLP techniques and tools in educational applications. At NAACL HLT 2012, the workshop coordinated with the HOO shared task for grammatical error detection, generating a much larger poster session that was lively
and well-attended. In 2013, the workshop will host the first Native Language Identification Shared Task, described in detail later in this cfp.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">The workshop will solicit both full papers and short papers for either oral or poster presentation. Given the broad scope of the workshop, we organize the workshop around three central themes in the educational infrastructure:<o:p></o:p></p>
<p class="MsoPlainText"><o:p></o:p></p>
<p class="MsoPlainText">1. Development of curriculum and assessment (e.g., applications that help teachers develop reading materials)<o:p></o:p></p>
<p class="MsoPlainText">2. Delivery of curriculum and assessments (e.g., applications where the student receives instruction and interacts with the system);
<o:p></o:p></p>
<p class="MsoPlainText">3. Reporting of assessment outcomes (e.g., automated scoring of open-ended responses)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Topics will include, but will not be limited to, the following:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Automated scoring/evaluation for oral and written student responses
<o:p></o:p></p>
<p class="MsoPlainText">* Content analysis for scoring/assessment <o:p>
</o:p></p>
<p class="MsoPlainText">* Analysis of the structure of argumentation<o:p></o:p></p>
<p class="MsoPlainText">* Grammatical error detection and correction <o:p>
</o:p></p>
<p class="MsoPlainText">* Discourse and stylistic analysis <o:p></o:p></p>
<p class="MsoPlainText">* Plagiarism detection <o:p></o:p></p>
<p class="MsoPlainText">* Machine translation for assessment, instruction and curriculum development
<o:p></o:p></p>
<p class="MsoPlainText">* Detection of non-literal language (e.g., metaphor)<o:p></o:p></p>
<p class="MsoPlainText">* Sentiment analysis<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Intelligent Tutoring (IT) that incorporates state-of-the-art NLP methods
<o:p></o:p></p>
<p class="MsoPlainText">* Dialogue systems in education <o:p></o:p></p>
<p class="MsoPlainText">* Hypothesis formation and testing <o:p></o:p></p>
<p class="MsoPlainText">* Multi-modal communication between students and computers
<o:p></o:p></p>
<p class="MsoPlainText">* Generation of tutorial responses <o:p></o:p></p>
<p class="MsoPlainText">* Knowledge representation in learning systems
<o:p></o:p></p>
<p class="MsoPlainText">* Concept visualization in learning systems <o:p>
</o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Learner cognition <o:p></o:p></p>
<p class="MsoPlainText">* Assessment of learners' language and cognitive skill levels
<o:p></o:p></p>
<p class="MsoPlainText">* Systems that detect and adapt to learners' cognitive or emotional states
<o:p></o:p></p>
<p class="MsoPlainText">* Tools for learners with special needs <o:p>
</o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Use of corpora in educational tools <o:p></o:p></p>
<p class="MsoPlainText">* Data mining of learner and other corpora for tool building
<o:p></o:p></p>
<p class="MsoPlainText">* Annotation standards and schemas / annotator agreement
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Tools and applications for classroom teachers and/or test developers
<o:p></o:p></p>
<p class="MsoPlainText">* NLP tools for second and foreign language learners
<o:p></o:p></p>
<p class="MsoPlainText">* Semantic-based access to instructional materials to identify appropriate texts
<o:p></o:p></p>
<p class="MsoPlainText">* Tools that automatically generate test questions
<o:p></o:p></p>
<p class="MsoPlainText">* Processing of and access to lecture materials across topics and genres
<o:p></o:p></p>
<p class="MsoPlainText">* Adaptation of instructional text to individual learners’ grade levels
<o:p></o:p></p>
<p class="MsoPlainText">* Tools for text-based curriculum development
<o:p></o:p></p>
<p class="MsoPlainText">* E-learning tools for personalized course content
<o:p></o:p></p>
<p class="MsoPlainText">* Language-based educational games <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Issues concerning the evaluation of NLP-based educational tools<o:p></o:p></p>
<p class="MsoPlainText"><o:p></o:p></p>
<p class="MsoPlainText">Descriptions of implemented systems <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Descriptions and proposals for shared tasks<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">SUBMISSION INFORMATION<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">We will be using the NAACL-HLT 2013 Submission Guidelines for the BEA-8 Workshop this year. Authors are invited to submit a full paper of up to 8 pages in electronic, PDF format, with up to 2 additional pages for references. We also
invite short papers of up to 4 pages, including 2 additional pages for references. Papers which describe systems are also invited to give a demo of their system.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Previously published papers cannot be accepted. The submissions will be reviewed by the program committee. As reviewing will be blind, please ensure that papers are anonymous. Self-references that reveal the author's identity, e.g.,
"We previously showed (Smith, 1991) ...", should be avoided. Instead, use citations such as "Smith previously showed (Smith, 1991) ...".<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">We will be using the START conference system to manage submissions: https://www.softconf.com/naacl2013/BEA8/<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Please use the 2013 NAACL-HLT style sheet for composing your paper: http://naacl2013.naacl.org/CFP.aspx (see Format section for style files).<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">IMPORTANT DATES<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Submission Deadline: March 11 <o:p></o:p></p>
<p class="MsoPlainText">Notification of Acceptance: March 29 <o:p></o:p></p>
<p class="MsoPlainText">Camera-ready papers Due: May 04<o:p></o:p></p>
<p class="MsoPlainText">Workshop: June 13 or 14<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">WORKSHOP CHAIRS<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Joel Tetreault, ETS, USA (principal contact: bea8.workshop@gmail.com)
<o:p></o:p></p>
<p class="MsoPlainText">Jill Burstein, ETS, USA <o:p></o:p></p>
<p class="MsoPlainText">Claudia Leacock, CTB McGraw-Hill, USA<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">NATIVE LANGUAGE IDENTIFICATION SHARED TASK<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">We are pleased to host the first edition of a shared task on Native Language Identification (NLI). The shared task will be organized by Joel Tetreault, Aoife Cahill (ETS) and Daniel Blanchard (ETS). NLI is the task of identifying the
native language (L1) of a writer based solely on a sample of their writing. The task is typically framed as a classification problem where the set of L1s is known a priori. Most work has focused on identifying the native language of writers learning English
as a second language. To date this topic has motivated several ACL and EMNLP papers, as well as a master’s thesis.<o:p></o:p></p>
<p class="MsoPlainText"><o:p></o:p></p>
<p class="MsoPlainText">Native Language Identification (NLI) can be useful for a number of applications. In educational settings, NLI can be used to provide more targeted feedback to language learners about their errors. It is well known that learners of different
languages make different errors depending on their L1s. A writing tutor system which can detect the native language of the learner will be able to tailor the feedback about the error and contrast it with common properties of the learner’s language. In addition,
native language is often used as a feature that goes into authorship profiling, which is frequently used in forensic linguistics.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Details on the shared task can be found on the website: https://sites.google.com/site/nlisharedtask2013/home
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">PROGRAM COMMITTEE<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Andrea Abel, EURAC, Italy<o:p></o:p></p>
<p class="MsoPlainText">Sumit Basu, Microsoft Research, USA<o:p></o:p></p>
<p class="MsoPlainText">Lee Becker, Avaya Labs, USA<o:p></o:p></p>
<p class="MsoPlainText">Beata Beigman Klebanov, Educational Testing Service, USA <o:p>
</o:p></p>
<p class="MsoPlainText">Delphine Bernhard, Université de Strasbourg, France <o:p>
</o:p></p>
<p class="MsoPlainText">Jared Bernstein, Pearson, USA <o:p></o:p></p>
<p class="MsoPlainText">Kristy Boyer, North Carolina State University, USA <o:p></o:p></p>
<p class="MsoPlainText">Chris Brew, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Ted Briscoe, University of Cambridge, UK <o:p></o:p></p>
<p class="MsoPlainText">Chris Brockett, MSR, USA <o:p></o:p></p>
<p class="MsoPlainText">Aoife Cahill, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Martin Chodorow, Hunter College, CUNY, USA <o:p></o:p></p>
<p class="MsoPlainText">Mark Core, USC Institute for Creative Technologies, USA <o:p>
</o:p></p>
<p class="MsoPlainText">Daniel Dahlmeier, National University of Singapore, Singapore
<o:p></o:p></p>
<p class="MsoPlainText">Markus Dickinson, Indiana University, USA<o:p></o:p></p>
<p class="MsoPlainText">Bill Dolan, Microsoft, USA <o:p></o:p></p>
<p class="MsoPlainText">Myrosia Dzikovska, University of Edinburgh, UK <o:p></o:p></p>
<p class="MsoPlainText">Keelan Evanini, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Michael Flor, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Peter Foltz, Pearson Knowledge Technologies, USA <o:p></o:p></p>
<p class="MsoPlainText">Jennifer Foster, Dublin City University, Ireland <o:p></o:p></p>
<p class="MsoPlainText">Horacio Franco, SRI, USA <o:p></o:p></p>
<p class="MsoPlainText">Michael Gamon, Microsoft, USA <o:p></o:p></p>
<p class="MsoPlainText">Caroline Gasperin, SwiftKey, UK <o:p></o:p></p>
<p class="MsoPlainText">Kallirroi Georgila, USC Institute for Creative Technologies, USA
<o:p></o:p></p>
<p class="MsoPlainText">Iryna Gurevych, University of Darmstadt, Germany <o:p></o:p></p>
<p class="MsoPlainText">Kadri Hacioglu, Rossetta Stone, USA <o:p></o:p></p>
<p class="MsoPlainText">Na-Rae Han, University of Pittsburgh, USA <o:p></o:p></p>
<p class="MsoPlainText">Trude Heift, Simon Frasier University, Canada <o:p></o:p></p>
<p class="MsoPlainText">Michael Heilman, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Derrick Higgins, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Ross Israel, Indiana University, USA <o:p></o:p></p>
<p class="MsoPlainText">Heng Ji, Queens College, USA <o:p></o:p></p>
<p class="MsoPlainText">Pamela Jordan, University of Pittsburgh, USA <o:p></o:p></p>
<p class="MsoPlainText">Ola Knutsson, KTH Nada, Sweden <o:p></o:p></p>
<p class="MsoPlainText">John Lee, City University of Hong Kong, China <o:p></o:p></p>
<p class="MsoPlainText">Jackson Liscombe, Nuance Communications, USA <o:p></o:p></p>
<p class="MsoPlainText">Diane Litman, University of Pittsburgh, USA <o:p></o:p></p>
<p class="MsoPlainText">Annie Louis, University of Pennsylvania, USA <o:p></o:p></p>
<p class="MsoPlainText">Xiaofei Lu, Penn State University, USA <o:p></o:p></p>
<p class="MsoPlainText">Nitin Madnani, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Montse Maritxalar, University of the Basque Country, Spain
<o:p></o:p></p>
<p class="MsoPlainText">James Martin, University of Colorado, USA <o:p></o:p></p>
<p class="MsoPlainText">Aurélien Max, LIMSI-CNRS, France <o:p></o:p></p>
<p class="MsoPlainText">Detmar Meurers, University of Tübingen, Germany <o:p></o:p></p>
<p class="MsoPlainText">Lisa Michaud, Merrimack College, USA <o:p></o:p></p>
<p class="MsoPlainText">Michael Mohler, University of North Texas <o:p></o:p></p>
<p class="MsoPlainText">Smaranda Muresan, Rutgers University, USA <o:p></o:p></p>
<p class="MsoPlainText">Ani Nenkova, University of Pennsylvania, USA <o:p></o:p></p>
<p class="MsoPlainText">Hwee Tou Ng, National University of Singapore, Singapore <o:p>
</o:p></p>
<p class="MsoPlainText">Rodney Nielsen, University of North Texas, USA <o:p></o:p></p>
<p class="MsoPlainText">Ted Pedersen, University of Minnesota, USA <o:p></o:p></p>
<p class="MsoPlainText">Bryan Pellom, Rossetta Stone, USA <o:p></o:p></p>
<p class="MsoPlainText">Patti Price, PPRICE Speech and Language Technology, USA <o:p>
</o:p></p>
<p class="MsoPlainText">Andrew Rosenberg, Queens College, CUNY, USA <o:p></o:p></p>
<p class="MsoPlainText">Mihai Rotaru, TextKernel, The Netherlands <o:p></o:p></p>
<p class="MsoPlainText">Dan Roth, UIUC, USA <o:p></o:p></p>
<p class="MsoPlainText">Alla Rozovskaya, UIUC, USA <o:p></o:p></p>
<p class="MsoPlainText">Izhak Shafran, Oregon Health & Science University, USA <o:p>
</o:p></p>
<p class="MsoPlainText">Serge Sharoff, University of Leeds, UK <o:p></o:p></p>
<p class="MsoPlainText">Richard Sproat, Google, USA <o:p></o:p></p>
<p class="MsoPlainText">Svetlana Stenchikova, Columbia University, USA <o:p></o:p></p>
<p class="MsoPlainText">Helmer Strik, Radboud University Nijmegen, The Netherlands
<o:p></o:p></p>
<p class="MsoPlainText">Joseph Tepperman, Rosetta Stone, USA <o:p></o:p></p>
<p class="MsoPlainText">Nai-Lung Tsao, National Central University, Taiwan <o:p></o:p></p>
<p class="MsoPlainText">Monica Ward, Dublin City University, Ireland <o:p></o:p></p>
<p class="MsoPlainText">Pete Whitelock, Oxford University Press, UK <o:p></o:p></p>
<p class="MsoPlainText">David Wible, National Central University, Taiwan <o:p></o:p></p>
<p class="MsoPlainText">Peter Wood, University of Saskatchewan in Saskatoon, Canada
<o:p></o:p></p>
<p class="MsoPlainText">Klaus Zechner, Educational Testing Service, USA <o:p></o:p></p>
<p class="MsoPlainText">Torsten Zesch, University of Darmstadt, Germany<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>