Inter-Rater Agreement with just the words we are coding for

[Anya Montgomery]

Good Afternoon, 

We are currently coding transcripts and there are two
different students coding these transcripts. We would like to achieve
80% conformity by our transcripts. We previously running the RELY +d 
command, however we realized that the program was accounting for all of the 
words in the transcript as opposed to checking for conformity between only 
the words that we coded for. Does anybody know of a way that we can run a 
test that tells use the inter-rater agreement or percentage of reliability 
based on the words that are coded for? 

thank you for your help,

Anya Montgomery 

-- 
You received this message because you are subscribed to the Google Groups "chibolts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/chibolts/attachments/20190828/092fd59c/attachment.htm>