<div dir="ltr"><div dir="ltr">Hi Brian, <div><br></div><div>Thank you for your help! Yes we have noted that for Spanish that the taggers are quite good in terms of the break down. In our own review of a couple of transcripts we've also noted about 95% accuracy for part of speech and lemma each and even a higher percentage if you consider accuracy of the lemma alone, so we are pretty happy with how we can automate such a complicated step. </div><div><br></div><div>Our version of the SPA MOR was downloaded in 2018, so we will download the newer version. </div><div><br></div><div>For the prepost rules, I am not familiar with how to incorporate these. How would I include this in the SPA MOR?</div><div><br></div><div>Janet</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jan 16, 2020 at 6:16 PM Brian MacWhinney <<a href="mailto:macw@andrew.cmu.edu">macw@andrew.cmu.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;">Dear Janet,<div> Typically, automatic taggers get about 95% of the words right. The best for adult written English are up to 97%. For CHILDES English, we can hit about 97%. For Spanish, we are probably down around 95%, although sometimes it seems better. </div><div><br></div><div>In the case of ratito, you must be using some much earlier version of SPA MOR. The current version doesn't have this problem. The case of bonita is different. It created a few test sentences and it seems that this problem arises when bonita is the last word in the sentences, as in "es una niña bonita". The problem is that the association of "co" with final position is so strong that it overrides the association of an adjective with the preceding noun. This can be corrected with a couple of prepost rules that take words that can be either co or adj and force them to be adj when they follow a noun. Here are the rules:</div><div><br></div><div><div><div># es una gata bonita</div><div>n|* co:voc|*^adj|* => n|* adj|*</div><div># es una niña bonita</div><div>co:voc|*^n|* co:voc|*^adj|* => n|* adj|*</div></div><div><br></div><div>These work for these cases, but (1) you may have other cases I don't know about, and (2) prepost rules can also mess up other things. So, please give this a try.</div><div><br></div><div>--Brian</div><div><br><blockquote type="cite"><div>On Jan 16, 2020, at 8:47 PM, Janet Y Bang <<a href="mailto:jbang@stanford.edu" target="_blank">jbang@stanford.edu</a>> wrote:</div><br><div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">Hello, </div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt"><br></div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">We are working with the Spanish MOR and noticed a few errors in the MOR line: </div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt"><br></div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt"><ol><li><span style="font-family:Arial,Helvetica,sans-serif;font-size:12pt">bonita oftentimes gets broken d</span><span style="font-family:Arial,Helvetica,sans-serif;font-size:12pt">own into </span><span style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:12pt;text-align:start;background-color:rgb(255,255,255);display:inline">co:voc|bonita=pretty in cases where the word "bonita" is being used to modify a noun, e.g., utterance is "niña bonita. </span></li><li><span style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:12pt;text-align:start;background-color:rgb(255,255,255);display:inline"><span style="font-family:Arial,Helvetica,sans-serif;font-size:12pt;background-color:rgb(255,255,255);display:inline">In cases were "rato" or "ratito" is used to indicate a period of time, oftentimes the breakdown is </span></span><span style="font-family:Arial,Helvetica,sans-serif;font-size:12pt">n|rato&m-DIM=rat OR<span> </span></span><span style="font-family:Arial,Helvetica,sans-serif;font-size:12pt">n|rato-m=rat. <br></span></li></ol><div>What would be the most efficient way to fix these errors? We have a lab-internal .cut file where we are adding new words to our internal mor dictionary that were not in the downloaded dictionary (so that we can keep track of differences between our lab lexical items and the downloaded dictionary), but we weren't sure how to override words that were already in the dictionary? Would it be best to fix these in the relevant cut files in the lex folder (i.e., adj.cut, n.cut, respectively)? </div><div><br></div><div>Thank you,</div><div>Janet</div></div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt"><br></div><div id="gmail-m_2602130432882164764Signature" style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><div id="gmail-m_2602130432882164764divtagdefaultwrapper" dir="ltr" style="font-size:12pt;font-family:Calibri,Helvetica,sans-serif"><div style="margin-top:0px;margin-bottom:0px">--</div><div style="margin-top:0px;margin-bottom:0px"><span style="font-size:10pt">Janet Y. Bang, Ph.D.</span></div><span style="font-size:10pt"></span><div style="margin-top:0px;margin-bottom:0px"><span style="font-size:10pt">Postdoctoral Fellow</span></div><span style="font-size:10pt"></span><div style="margin-top:0px;margin-bottom:0px"><span style="font-size:10pt">Department of </span><span style="font-size:10pt">Psychology</span></div><span style="font-size:10pt"></span><div style="margin-top:0px;margin-bottom:0px"><span style="font-size:10pt">Stanford University</span></div><span style="font-size:10pt"></span><div style="margin-top:0px;margin-bottom:0px"><br><span style="font-size:10pt"></span></div><span style="font-size:10pt"></span><div style="margin-top:0px;margin-bottom:0px"><span style="font-size:10pt"><a href="mailto:jbang@stanford.edu" target="_blank">jbang@stanford.edu</a></span></div><p style="margin-top:0px;margin-bottom:0px"></p><div style="margin-top:0px;margin-bottom:0px"><br></div><div style="margin-top:0px;margin-bottom:0px"><br></div><div style="margin-top:0px;margin-bottom:0px"><br></div><div style="margin-top:0px;margin-bottom:0px"><br></div></div></div><p style="margin-top:0px;margin-bottom:0px;font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"></p><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">--<span> </span></span><br style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">You received this message because you are subscribed to the Google Groups "chibolts" group.</span><br style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">To unsubscribe from this group and stop receiving emails from it, send an email to<span> </span></span><a href="mailto:chibolts+unsubscribe@googlegroups.com" style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" target="_blank">chibolts+unsubscribe@googlegroups.com</a><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">.</span><br style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">To view this discussion on the web visit<span> </span></span><a href="https://groups.google.com/d/msgid/chibolts/DM5PR02MB3275154B3A345DAA4BD9B5A2D7310%40DM5PR02MB3275.namprd02.prod.outlook.com?utm_medium=email&utm_source=footer" style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" target="_blank">https://groups.google.com/d/msgid/chibolts/DM5PR02MB3275154B3A345DAA4BD9B5A2D7310%40DM5PR02MB3275.namprd02.prod.outlook.com</a><span style="font-family:Helvetica;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">.</span></div></blockquote></div><br></div></div>
<p></p>
-- <br>
You received this message because you are subscribed to the Google Groups "chibolts" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" target="_blank">chibolts+unsubscribe@googlegroups.com</a>.<br>
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/ECE843B9-F0F4-4D19-920D-BE7D4DD5F425%40andrew.cmu.edu?utm_medium=email&utm_source=footer" target="_blank">https://groups.google.com/d/msgid/chibolts/ECE843B9-F0F4-4D19-920D-BE7D4DD5F425%40andrew.cmu.edu</a>.<br>
</blockquote></div></div>
<p></p>
-- <br />
You received this message because you are subscribed to the Google Groups "chibolts" group.<br />
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com">chibolts+unsubscribe@googlegroups.com</a>.<br />
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/CAC5V4hjo%3DopXfGrbh3r1mPBRhJyubDVkD2nCP7f9a_7wBwmEfw%40mail.gmail.com?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/chibolts/CAC5V4hjo%3DopXfGrbh3r1mPBRhJyubDVkD2nCP7f9a_7wBwmEfw%40mail.gmail.com</a>.<br />