<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Jun 13, 2020, at 6:34 AM, Karin Edlund <<a href="mailto:karin.eva.edlund@gmail.com" class="">karin.eva.edlund@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi Brian,<div class="">Thank you for your input on the RELY function.</div><div class="">What I would like to do is the following:</div><div class=""><br class=""></div><div class="">1) Check reliability on percentage agreement for word and utterance level on each of 15 transcriptions comprising 5 min each.</div><div class="">I was thinking of using the third function of RELY - the overall match on the main line between two transcripts - rely +d sample.cha samplea.cha</div><div class="">This would be only to check the transcription, not the coding. </div><div class="">I would say the two transcribers are on the same level regarding transcribing, thus perhaps it is not a case of checking correctness of a student against a master transcript. </div><div class="">Or is the relation master-student more at matter of what data counts as the primary data?</div></div></div></blockquote><div><br class=""></div>Yes, that will work for that comparison.<br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><br class=""></div><div class="">2) Compute Cohen's kappa for the coding. Two coders. I have five different categories for coding. I am not using %spa, but %cod.</div><div class="">Would this be the right code for that:</div><div class="">rely +d5 sample.cha samplea.cha +t%cod </div><div class=""><br class=""></div><div class="">what does dm1 stand for in the RELY code you suggested?</div></div></div></blockquote><div><br class=""></div>You still need +dm1 to tell CLAN that you consider the first file as the master. </div><div><br class=""></div><div>--Brian<br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><br class=""></div><div class="">Perhaps I am mixing things up, but overall I am trying to check percentage agreement for word and utterance level in the transcriptions between two transcribers and secondly I am computing cohen's kappa for the coding. </div><div class="">Seeking for the best RELY function and its respective code to do this. </div><div class=""><br class=""></div><div class="">Best Regards,</div><div class="">Karin Edlund</div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Den tors 11 juni 2020 kl 18:41 skrev Brian MacWhinney <<a href="mailto:macw@andrew.cmu.edu" class="">macw@andrew.cmu.edu</a>>:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;" class="">Dear Karin,<div class=""> You need to provide a number for N, based on the number of categories in your coding system. I am assuming that you are using RELY as described in the second function in the section on RELY in the CLAN manual. In the manual, the suggested command uses +d1 which doesn't make sense. If you have two categories, you need +d2. Then, for that example in the manual. you get Cohen's kappa of 0.92. Of course, all of this depends on the actual shape of your coding system, and this little example can't illustrate that. However, I will at least fix that error in the manual.</div><div class=""><br class=""></div><div class="">--Brian MacWhinney<br class=""><div class=""><br class=""><blockquote type="cite" class=""><div class="">On Jun 11, 2020, at 5:17 AM, Karin Edlund <<a href="mailto:karin.eva.edlund@gmail.com" target="_blank" class="">karin.eva.edlund@gmail.com</a>> wrote:</div><br class=""><div class=""><div dir="ltr" class="">Hi,<div class="">What is the accurate command for RELY and computing percentage agreement on a dependant tier (i.e. %cod)?</div><div class="">I have tried </div><div class="">rely +d sample.cha samplea.cha +t%cod -t*</div><div class=""><br class=""></div><div class="">Also, what is the command for calculating Cohen's kappa on %cod tier?</div><div class="">I have tried with +dN, but I can't get it to work unfortunately.</div><div class=""><br class=""></div><div class="">Happy to receive advice on how to solve this.</div><div class=""><br class=""></div><div class="">Best Regards,</div><div class="">Karin Edlund</div></div><div class=""><br class=""></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" target="_blank" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/CANkUE2xW3-jbmfqNXyCVLAwZOh8dpCccdTeEWqujDsJQqTgH%3DQ%40mail.gmail.com?utm_medium=email&utm_source=footer" target="_blank" class="">https://groups.google.com/d/msgid/chibolts/CANkUE2xW3-jbmfqNXyCVLAwZOh8dpCccdTeEWqujDsJQqTgH%3DQ%40mail.gmail.com</a>.<br class="">
</div></blockquote></div><br class=""></div></div><div class=""><br class="webkit-block-placeholder"></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" target="_blank" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/C233654B-250D-4B81-B2DC-F2005E936177%40andrew.cmu.edu?utm_medium=email&utm_source=footer" target="_blank" class="">https://groups.google.com/d/msgid/chibolts/C233654B-250D-4B81-B2DC-F2005E936177%40andrew.cmu.edu</a>.<br class="">
</blockquote></div><div class=""><br class="webkit-block-placeholder"></div>
-- <br class="">
You received this message because you are subscribed to the Google Groups "chibolts" group.<br class="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com" class="">chibolts+unsubscribe@googlegroups.com</a>.<br class="">
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/CANkUE2y-xD6aGFLzh26e%2Bvx185OJwvSKdAnB4j_%2BTGfmTVSJ_w%40mail.gmail.com?utm_medium=email&utm_source=footer" class="">https://groups.google.com/d/msgid/chibolts/CANkUE2y-xD6aGFLzh26e%2Bvx185OJwvSKdAnB4j_%2BTGfmTVSJ_w%40mail.gmail.com</a>.<br class="">
</div></blockquote></div><br class=""></div></body></html>
<p></p>
-- <br />
You received this message because you are subscribed to the Google Groups "chibolts" group.<br />
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:chibolts+unsubscribe@googlegroups.com">chibolts+unsubscribe@googlegroups.com</a>.<br />
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/chibolts/116DA890-299A-4EBA-B7C1-DFFB5C22AD1D%40andrew.cmu.edu?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/chibolts/116DA890-299A-4EBA-B7C1-DFFB5C22AD1D%40andrew.cmu.edu</a>.<br />