Reliability of Transcription Procedures for Brain-Computer Interface Language Samples
50 likes | 173 Vues
This study assesses the reliability of transcribing language samples from brain-computer interface (BCI) communication recorded through language activity monitoring (LAM) logfiles. Veterans with amyotrophic lateral sclerosis utilized a P300-based BCI for augmentative communication, allowing us to analyze 345 daily logfile samples. Our findings revealed an excellent interrater reliability, with 97.6% accuracy for total words and 93.5% for utterances, confirming the fidelity of the transcription process. The use of LAM data facilitated the transcription of numerous samples that would be challenging with traditional audio and video methods.
Reliability of Transcription Procedures for Brain-Computer Interface Language Samples
E N D
Presentation Transcript
Reliability of brain-computer interface language sample transcriptionprocedures Katya Hill, PhD, CCC-SLP; Thomas Kovacs, MA; Sangeun Shin
Aim • Test reliability of transcribing language samples of daily brain-computer interface (BCI) communication recorded as language activity monitoring (LAM) logfiles. • Relevance • Establishing reliable transcription procedures is important for reporting valid measures as study results and evaluating overall effectiveness of expressive communication.
Method • Veterans with amyotrophic lateral sclerosis used P300-based BCI as augmentative and alternative communication system. • KeyLAM software recorded logfiles in universal logfile format during use of BCI-controlled email and word processing applications. • These logfiles were encrypted and sent to our laboratory for decryption, transcription, and analysis.
Results • Results on transcription of 345 daily logfile samples. • Procedure was accurate across transcribers/ raters. • Interrater reliability (frequency of agreement ratio) • Total number of words: 97.6%. • Total utterances: 93.5% . • Interjudge agreement • 100% for both measures.
Conclusion • Transcribing language samples using LAM data is highly reliable and fidelity of process can be maintained. • LAM data supported transcription of large number of samples that could not have been completed using audio and video recordings.