Inter-Rater Agreement with just the words we are coding for

[Anya Montgomery]

Thank you so much, Leonid, for responding. We attempted to use the +t 
option and the +c option but we were unable to determine inter-rater 
agreement. What specific command should I run? 

On Wednesday, August 28, 2019 at 2:36:29 PM UTC-4, Leonid Spektor wrote:
>
> Anya,
>
> If your students are coding on specific dependent tier only, then you can 
> use +t option to tell RELY to look at that dependent tier only. You might 
> try adding +c option too.
>
>
> Leonid. 
>
> On Aug 28, 2019, at 14:25, Anya Montgomery <amon... at fiu.edu <javascript:>> 
> wrote:
>
> Good Afternoon, 
>
> We are currently coding transcripts and there are two
> different students coding these transcripts. We would like to achieve
> 80% conformity by our transcripts. We previously running the RELY +d 
> command, however we realized that the program was accounting for all of the 
> words in the transcript as opposed to checking for conformity between only 
> the words that we coded for. Does anybody know of a way that we can run a 
> test that tells use the inter-rater agreement or percentage of reliability 
> based on the words that are coded for? 
>
> thank you for your help,
>
> Anya Montgomery 
>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "chibolts" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to chib... at googlegroups.com <javascript:>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com 
> <https://groups.google.com/d/msgid/chibolts/f92bed6c-25fc-4075-ad56-b3890b4e17ea%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
>
>

-- 
You received this message because you are subscribed to the Google Groups "chibolts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chibolts+unsubscribe at googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/chibolts/2ff0386e-a5a1-45cc-9a4a-6b263d0413ee%40googlegroups.com.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/chibolts/attachments/20190828/511429b1/attachment.htm>