Lemmatized types and tokens for specific tags?
Leonid Spektor
spektor at andrew.cmu.edu
Fri Apr 30 19:08:53 UTC 2021
Hi,
The plain command freq +s*@z:* will not work, because words square and squares have different spelling. If you want both of those words counted as one type, then you need to run lemmas, i.e. stems only, search on %mor tier. To create %mor tier in your data files you need to get appropriate language grammar from the web first. It looks like you are working with English language data files, so to get the English grammar you need to start CLAN and to select menu "File->Get MOR Grammar->English - eng". This will download the grammar to your computer. After that you need to run MOR command on your data files. In "Commands" window type command mor *.cha. This assumes your data filenames end with .cha file extension. When MOR command is finished and doesn't find any words that it can not identify, then you can use the following command to find what you want:
freq +d7 +s*@z:* +sm;*,o%
Leonid.
> On Apr 30, 2021, at 12:12, LaTreese <lhall046 at fiu.edu> wrote:
>
> Hello there!
>
> This may be an easy issue to solve, but I cannot figure it out. I have relatively little experience with CLAN so please be gentle.
>
> I have several different tags in my transcripts (e.g., @z:shp to denote shape words). So, in the transcript, "square" and "squares" would be coded as square at z:shp and squares at z:shp , respectively. However when I try to analyze them for types and tokens, different forms of the same stem are being counted as two different types (e.g., square and squares counted as 2 types).
>
> I am currently using this command to get types and tokens of all of my different categories:
> freq +s*@z:*
>
> I read in the manual that I should create a MOR line to be able to run types and tokens on lemmas so that "square" and "squares" are counted as one type. I did this, but now my tags are not available on the MOR line.
>
> Is there a way to get the lemmatized type and token counts for specific tags?
>
> Thank you so much!
>
> LaTreese Hall
> Florida International University
>
> --
> You received this message because you are subscribed to the Google Groups "chibolts" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com <mailto:chibolts+unsubscribe at googlegroups.com>.
> To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/628a167c-ada8-4df7-8c91-19b0933f0743n%40googlegroups.com <https://groups.google.com/d/msgid/chibolts/628a167c-ada8-4df7-8c91-19b0933f0743n%40googlegroups.com?utm_medium=email&utm_source=footer>.
--
You received this message because you are subscribed to the Google Groups "chibolts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/958FB752-CD6D-4128-B9F9-2BB9C35E43C3%40andrew.cmu.edu.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/chibolts/attachments/20210430/0d319cc9/attachment.htm>
More information about the Chibolts
mailing list