Inter-Rater Agreement with just the words we are coding for

[Leonid Spektor]

Anya,

	If your students are coding on specific dependent tier only, then you can use +t option to tell RELY to look at that dependent tier only. You might try adding +c option too.


Leonid.

> On Aug 28, 2019, at 14:25, Anya Montgomery <amont165 at fiu.edu> wrote:
> 
> Good Afternoon,
> 
> We are currently coding transcripts and there are two
> different students coding these transcripts. We would like to achieve
> 80% conformity by our transcripts. We previously running the RELY +d command, however we realized that the program was accounting for all of the words in the transcript as opposed to checking for conformity between only the words that we coded for. Does anybody know of a way that we can run a test that tells use the inter-rater agreement or percentage of reliability based on the words that are coded for?
> 
> thank you for your help,
> 
> 
> Anya Montgomery 
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups "chibolts" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com <mailto:chibolts+unsubscribe at googlegroups.com>.
> To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com <https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com?utm_medium=email&utm_source=footer>.

-- 
You received this message because you are subscribed to the Google Groups "chibolts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/8324EE14-9E86-48B8-A5E2-F8E9FC803CA9%40andrew.cmu.edu.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/chibolts/attachments/20190828/317933cf/attachment.htm>