1 / 158

Effect of synchronous vs. non-synchronous recordings

Effect of synchronous vs. non-synchronous recordings Show movie then say that is an average and show a movie based on activity from a single trial (NOISY) Then say noise could look worse if correlated noise is bad. Compare shifted and unshifted population performance Compare IC vs. A1.

gaurav
Télécharger la présentation

Effect of synchronous vs. non-synchronous recordings

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Effect of synchronous vs. non-synchronous recordings Show movie then say that is an average and show a movie based on activity from a single trial (NOISY) Then say noise could look worse if correlated noise is bad. Compare shifted and unshifted population performance Compare IC vs. A1

  2. Effect of Neural Correlations on Speech Discrimination Mike Kilgard Associate Professor University of Texas at Dallas Cosyne08 Workshop: Real-Time Processing and the Processing of Time

  3. Pad Bad Fad Vad Mad Wad Tad Dad Sad Zad Chad Jad Nad Lad Kad Gad Shad Had Yad Rad 30 kHz 20 10 0 200 400 600 ms

  4. Pad Bad Fad Vad Mad Wad Tad Dad Sad Zad Chad Jad Nad Lad Kad Gad Shad Had Yad Rad 30 kHz 20 10 0 200 400 600 ms

  5. Rats can discriminate most human speech sounds. Data from 5 or 6 rats after ten days of training on a Go/No Go task.

  6. Observation: Rats can discriminate most speech sounds. Question: How are these sounds represented in the central auditory system?

  7. Neurograms of 445 multi-unit recordings from anesthetized A1, 20 repeats

  8. Neurograms of 445 multi-unit recordings from anesthetized A1, 20 repeats

  9. Movie of A1 responses from one rat N = 63 A1 multi-unit recording sites, average of 20 repeats

  10. Observation: Most speech sounds evoke unique spatiotemporal activity patterns in A1. Question: What is the relationship between neural responses and speech discrimination ability?

  11. Euclidean distance between neurograms is well correlated with behavior only when 1 ms bins are used. N=445 A1 multi-unit recording sites

  12. Observation: Sounds that evoke dissimilar spatiotemporal activity patterns are readily discriminable. Question: Can A1 neurons discriminate speech sounds in a single trial?

  13. Single Trial N = 63 A1 multi-unit recording sites

  14. 95% correct 100% correct 80% correct 75% correct Average PSTH’s Dad Bad PSTH-based Classifier (Foffani & Moxon, 2004; Schnupp et al., 2006) Single trials matched to mean PSTH templates using Euclidean distance. Triangles indicate classification errors. Dad Single Trial PSTH’s Bad

  15. Classifier Performance using Spike Timing 95% correct 100% correct 80% correct 75% correct Average PSTH’s Dad Bad Dad Single Trial PSTH’s Bad Mean of 445 sites was 90±3% when 1-10 ms bins were used.

  16. Classifier Performance using Spike Number 68% correct 63% correct 60% correct 63% correct Average PSTH’s Dad Bad Dad Single Trial PSTH’s Bad Mean of 445 sites was 90±3% when 1-10 ms bins were used.

  17. Neural discrimination using one sweep of activity from individual multi-unit clusters recorded in A1 N=445 A1 multi-unit recording sites

  18. Observation: A single trial of onset activity from A1 neurons recorded at a single site can discriminate speech sounds as well as rats. Question: Is this true in awake rats?

  19. Awake Auditory Cortex N = 41 A1 multi-unit recording sites

  20. Observation: A single trial of onset activity from awake A1 neurons recorded at a single site can discriminate speech sounds as well as rats. Question: How good is speech discrimination if more or fewer A1 sites are used?

  21. Neural Discrimination of English Consonants d/s d/b d/g d/t sh/f sh/j sh/h sh/ch sh/s r/l m/n Percent Correct

  22. Observation: A single trial of activity from several hundred A1 neurons can discriminate between pairs of English consonants with 100% accuracy. Question: Can A1 activity distinguish speech sounds from a larger set?

  23. Neural Discrimination of 20 English Consonants Percent Correct

  24. Observation: A single trial of activity from a set of ~400 A1 neurons can discriminate between 20 English consonants with 100% accuracy. Question: Is this an artifact of serial recordings?

  25. 95 % correct 100% correct 80% correct 75% correct Average PSTH’s Dad Bad Dad Single Trial PSTH’s Bad Mean of 445 sites was 90±3% when 1-10 ms bins were used.

  26. 95 % correct Average PSTH’s Dad Bad Dad Single Trial PSTH’s Bad

  27. Neural Discrimination of 20 English Consonants

  28. Observation: A single trial of activity from a set of four simultaneously recorded A1 multi-unit clusters can discriminate between 20 English consonants almost as well as serially recorded sites. Question: Is this true in awake rats?

  29. Check duration/bins

  30. Observation: A single trial of activity from a set of four simultaneously recorded A1 multi-unit clusters can discriminate between 20 English consonants almost as well as serially recorded sites. Possible Explanation: The readout mechanisms are optimized for categorization, not identification.

  31. Pad Bad Fad Vad Mad Wad Tad Dad Sad Zad Chad Jad Nad Lad Kad Gad Shad Had Yad Rad 30 kHz 20 10 0 200 400 600 ms

  32. Image reconstructions using only temporal order of the first spike of Retinal Ganglion Cell populations .05% .5% 1% 5% 50% Van Rullen & Thorpe, 2001

  33. Speech Conclusions Rats are able to accurately discriminate most speech sounds. Consonants appear to be represented by onset firing patterns. A single sweep of activity is sufficient to discriminate most sounds. Responses in A1 are highly correlated with behavioral discrimination. Tomorrow at ‘Linking Auditory Neurophysiology to Perception’ Speech in Noise Non-Primary Auditory Cortex and Inferior Colliculus Vowel coding Categorization Plasticity

  34. National Institute for Deafness and Other Communicative Disorders Acknowledgements: Crystal Engineer - Speech Training and A1 physiology Claudia Perez - Speech Training and Inferior Colliculus Jai Shetake - Awake A1 Speech Physiology

  35. a) b) One Single Unit Sixteen Single Units One Multi- Unit Sixteen Multi- Units One Single Unit Sixteen Single Units One Multi- Unit Sixteen Multi- Units Figure 7

  36. Supplementary Figure 2

  37. Neural Activity Patterns Predict Speech Discrimination Ability in Rats Mike Kilgard University of Texas at Dallas

  38. What is the relationship between neural responses and speech discrimination ability?

  39. Sad Mean IC PSTH N=187 sites, 6 rats 40 Frequency (kHz) Firing Rate (Hz) 30 20 10 0 100 200 300 400 500 600 0 100 200 300 400 500 600 Time (msec) Time (msec)

  40. Sad Mean IC PSTH’s N=187 sites, 6 rats High 40 Frequency (kHz) 30 Medium 20 Low 10 0 100 200 300 400 500 600 0 100 200 300 400 500 600 Time (msec) Time (msec)

  41. Inferior Colliculus Neurograms N=187 sites, 6 rats

  42. A1 Neurograms N=441 sites, 11 rats Spatial Temporal

  43. A1 Neurograms N=441 sites, 11 rats

  44. Sad vs. Dad High Medium Low Time (milliseconds)

  45. Speech Discrimination by Rats Dad or Sad Easy!

  46. Rad vs. Lad High Impossible Medium Low Time (milliseconds)

  47. Bad vs. Dad High Impossible using mean rate or Easy using spike timing? Medium Low

  48. Rat Consonant Discrimination N=11 rats

  49. Onset Neurograms N=441 A1 sites, 6 rats

More Related