<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:st1="urn:schemas-microsoft-com:office:smarttags" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="country-region"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="City"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="PlaceName"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="PlaceType"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="place"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="address"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="Street"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="PersonName"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
@page Section1
{size:612.0pt 792.0pt;
margin:72.0pt 77.95pt 72.0pt 77.95pt;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Dear Elizabeth,<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Inter-rater reliability is vital, of course. But <i><span
style='font-style:italic'>intra</span></i>-rater reliability comes first. I
wonder how consistent your transcribers are being from one transcript to the
next? A simple way to check for this is to have your researchers transcribe the
same recording on two occasions – with a decent interval between to dilute
the effects of memory.<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>If there is still a problem, perhaps your transcribers
could be given some form of ear-training to enhance their ability to analyse
speech in purely phonological terms – in effect, reducing the (lexical) bias
introduced by hearing what you expect to hear. Even if you don’t require
a high degree of phonological detail, this kind of focus might be helpful in
overriding the dialect effects you talk about.<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Regards,<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Matthew.<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>*********************************************************************<o:p></o:p></span></font></p>
<p class=MsoPlainText><st1:PersonName w:st="on"><font size=2 face="Courier New"><span
lang=EN-GB style='font-size:10.0pt'>Matthew Saxton</span></font></st1:PersonName><span
lang=EN-GB> MA, MSc, DPhil<o:p></o:p></span></p>
<p class=MsoPlainText><st1:place w:st="on"><st1:PlaceType w:st="on"><font
size=2 face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>School</span></font></st1:PlaceType><span
lang=EN-GB> of <st1:PlaceName w:st="on">Psychology</st1:PlaceName></span></st1:place><span
lang=EN-GB> and Human Development,<o:p></o:p></span></p>
<p class=MsoPlainText><st1:place w:st="on"><st1:PlaceType w:st="on"><font
size=2 face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>Institute</span></font></st1:PlaceType><span
lang=EN-GB> of <st1:PlaceName w:st="on">Education</st1:PlaceName></span></st1:place><span
lang=EN-GB>,<o:p></o:p></span></p>
<p class=MsoPlainText><st1:Street w:st="on"><st1:address w:st="on"><font
size=2 face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>25 Woburn
Square</span></font></st1:address></st1:Street><span lang=EN-GB>,<o:p></o:p></span></p>
<p class=MsoPlainText><st1:City w:st="on"><st1:place w:st="on"><font size=2
face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>London</span></font></st1:place></st1:City><span
lang=EN-GB>,<o:p></o:p></span></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>WC1H 0AA.<o:p></o:p></span></font></p>
<p class=MsoPlainText><st1:country-region w:st="on"><st1:place w:st="on"><font
size=2 face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>U.K.</span></font></st1:place></st1:country-region><span
lang=EN-GB><o:p></o:p></span></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'> <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Tel: +44 (0) 20 7612 6509<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Fax: +44 (0) 20 7612 6304<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'> <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>http://ioewebserver.ioe.ac.uk/ioe/cms/get.asp?cid=4578&4578_0=10248<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>www.ioe.ac.uk<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span style='font-size:
10.0pt'>-----Original Message-----<br>
From: info-childes@mail.talkbank.org [mailto:info-childes@mail.talkbank.org] On
Behalf Of Elizabeth Prado<br>
Sent: 03 September 2007 09:16<br>
To: info-childes@mail.talkbank.org<br>
Subject: transcript validation</span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>I am working on transcribing children’s speech
on the Indonesian island <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>of <st1:place w:st="on">Lombok</st1:place>, where the
local language is Sasak. I’m working with 6 <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>transcribers, all of whom are native speakers of
Sasak. 10% of every <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>transcript is being re-transcribed by another transcriber
for validation <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>and we’re having difficulty getting high levels
of agreement. I think <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>there are two possible reasons for this: one is that
Sasak is rarely <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>written since all education from elementary school to
university is <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>couducted in Indonesian (the national language). The
other is that there <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>is significant dialect variation across the island. We
are trying to <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>give recordings of children to transcribers from the
same dialect (same <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>general area of the island) but this is difficult
since dialect <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>variation can occur from village to village.<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>The main purpose of the transcriptions is to validate
a parent-report <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>sentence complexity measure that we have developed to
evaluate the <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>language development of children whose mothers
received micronutrient <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>supplements during pregnancy.<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>I was wondering if anyone has transcribed any
non-written languages and <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>if you have any advice about how to increase agreement
between <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>transcribers. Even when we don’t count spelling
differences as <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>differences between the transcriptions, we’re
still getting agreement <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><80%. Any advice would be appreciated!<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>-- <o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>*******************************************<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Elizabeth Prado<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Psychology Department<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Fylde C Floor<o:p></o:p></span></font></p>
<p class=MsoPlainText><st1:City w:st="on"><st1:place w:st="on"><font size=2
face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>Lancaster</span></font></st1:place></st1:City><span
lang=EN-GB> LA14YF<o:p></o:p></span></p>
<p class=MsoPlainText><st1:country-region w:st="on"><st1:place w:st="on"><font
size=2 face="Courier New"><span lang=EN-GB style='font-size:10.0pt'>UK</span></font></st1:place></st1:country-region><span
lang=EN-GB><o:p></o:p></span></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Tel: 01524 592947<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'>Website:
http://www.psych.lancs.ac.uk/people/BethPrado.html<o:p></o:p></span></font></p>
<p class=MsoPlainText><font size=2 face="Courier New"><span lang=EN-GB
style='font-size:10.0pt'><o:p> </o:p></span></font></p>
</div>
</body>
</html>