<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hello Leonid,<div class=""><br class=""></div><div class="">Thank you for responding! I had done all of this but it was still counting singular and plural form of the same word as two different types. </div><div class=""><br class=""></div><div class="">This is what the output looks like when I run <b class="">freq +d7 +s*@z:* +sm;*,o% </b></div><div class=""><br class=""></div><div class=""><div class=""><div class=""> 1 circle </div><div class=""> 1 circle@z:shp</div><div class=""> 1 circles </div><div class=""> 1 circles@z:shp</div><div class=""> 1 square </div><div class=""> 1 square@z:shp</div><div class=""> 1 squares </div><div class=""> 1 squares@z:shp</div></div><div class=""><div class="">------------------------------</div><div class=""> 4 Total number of different item types used</div><div class=""> 4 Total number of items (tokens)</div><div class="">1.000 Type/Token ratio</div></div><div class=""><br class=""></div><div class=""><b class="">Any idea of how to get Type and Token info for the lemmas? So that the above output indicates 2 types and 2 tokens?</b></div><div class=""><br class=""></div><div class="">Thank you!</div><div class="">LaTreese</div><div class=""><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On Apr 30, 2021, at 2:08 PM, Leonid Spektor <<a href="mailto:spektor@andrew.cmu.edu" class="">spektor@andrew.cmu.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Hi,</span><div class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="Apple-tab-span" style="white-space: pre;"> </span>The plain command <b class="">freq +s*@z:*</b><span class=""> will not work, because words </span><b class="">square<span class="Apple-converted-space"> </span></b><span class="">and </span><b class="">squares</b> have different spelling. If you want both of those words counted as one type, then you need to run lemmas, i.e. stems only, search on %mor tier. To create %mor tier in your data files you need to get appropriate language grammar from the web first. It looks like you are working with English language data files, so to get the English grammar you need to start CLAN and to select menu "<font color="#ff2600" class="">File->Get MOR Grammar->English - eng</font>". This will download the grammar to your computer. After that you need to run<span class="Apple-converted-space"> </span><b class="">MOR</b><span class="Apple-converted-space"> </span>command on your data files. In "Commands" window type command<span class="Apple-converted-space"> </span><b class="">mor *.cha</b>.<b class=""> </b>This assumes your data filenames end with<span class="Apple-converted-space"> </span><b class="">.cha</b> file extension. When<span class="Apple-converted-space"> </span><b class="">MOR</b><span class="Apple-converted-space"> </span>command is finished and doesn't find any words that it can not identify, then you can use the following command to find what you want:</div><div class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Lucida Grande";"><b class="">freq +d7 +s*@z:* +sm;*,o%</b></div></div><div class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div class=""><br class=""></div><div class=""><br class="">Leonid.</div><div class=""><br class=""><blockquote type="cite" class=""><div class="">On Apr 30, 2021, at 12:12, LaTreese <<a href="mailto:lhall046@fiu.edu" class="">lhall046@fiu.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class="">Hello there!<div class=""><br class=""></div><div class="">This may be an easy issue to solve, but I cannot figure it out. I have relatively little experience with CLAN so please be gentle.</div><div class=""><br class=""><div class="">I have several different tags in my transcripts (e.g., @z:shp to denote shape words). So, in the transcript, "square" and "squares" would be coded as<span class="Apple-converted-space"> </span><b class="">square@z:shp</b> and<span class="Apple-converted-space"> </span><b class="">squares@z:shp</b> , respectively. However when I try to analyze them for types and tokens, different forms of the same stem are being counted as two different types (e.g., square and squares counted as 2 types). </div><div class=""><br class=""></div><div class="">I am currently using this command to get types and tokens of all of my different categories:</div><div class=""><b class="">freq +s*@z:* </b><br class=""></div><div class=""><br class=""></div><div class="">I read in the manual that I should create a MOR line to be able to run types and tokens on lemmas so that "square" and "squares" are counted as one type. I did this, but now my tags are not available on the MOR line.</div><div class=""><br class=""></div><div class="">Is there a way to get the lemmatized type and token counts for specific tags?</div><div class=""><br class=""></div><div class="">Thank you so much!</div><div class=""><br class=""></div><div class="">LaTreese Hall</div><div class="">Florida International University</div></div><div class=""><br class="webkit-block-placeholder"></div>--<span class="Apple-converted-space"> </span><br class="">You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">To unsubscribe from this group and stop receiving emails from it, send an email to<span class="Apple-converted-space"> </span><a href="mailto:chibolts+unsubscribe@googlegroups.com" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">To view this discussion on the web visit<span class="Apple-converted-space"> </span><a href="https://groups.google.com/d/msgid/chibolts/628a167c-ada8-4df7-8c91-19b0933f0743n%40googlegroups.com?utm_medium=email&utm_source=footer" class="">https://groups.google.com/d/msgid/chibolts/628a167c-ada8-4df7-8c91-19b0933f0743n%40googlegroups.com</a>.<br class=""></div></blockquote></div><br class=""></div><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="webkit-block-placeholder"></div><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">--<span class="Apple-converted-space"> </span></span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">You received this message because you are subscribed to a topic in the Google Groups "chibolts" group.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">To unsubscribe from this topic, visit<span class="Apple-converted-space"> </span></span><a href="https://groups.google.com/d/topic/chibolts/2lAUOxAbURA/unsubscribe" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://groups.google.com/d/topic/chibolts/2lAUOxAbURA/unsubscribe</a><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">To unsubscribe from this group and all its topics, send an email to<span class="Apple-converted-space"> </span></span><a href="mailto:chibolts+unsubscribe@googlegroups.com" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">chibolts+unsubscribe@googlegroups.com</a><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">To view this discussion on the web visit<span class="Apple-converted-space"> </span></span><a href="https://groups.google.com/d/msgid/chibolts/958FB752-CD6D-4128-B9F9-2BB9C35E43C3%40andrew.cmu.edu?utm_medium=email&utm_source=footer" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://groups.google.com/d/msgid/chibolts/958FB752-CD6D-4128-B9F9-2BB9C35E43C3%40andrew.cmu.edu</a><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">.</span></div></blockquote></div><br class=""></div></div></body></html>
<p></p>
-- <br />
You received this message because you are subscribed to the Google Groups "chibolts" group.<br />
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com">chibolts+unsubscribe@googlegroups.com</a>.<br />
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/6163D3AB-5688-439C-BC19-D6A1FB9302F9%40fiu.edu?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/chibolts/6163D3AB-5688-439C-BC19-D6A1FB9302F9%40fiu.edu</a>.<br />