1 / 62

PSY 369: Psycholinguistics

PSY 369: Psycholinguistics. Language Comprehension: Sentence comprehension. The Human Eye. At its center is the fovea, a pit that is most sensitive to light and is responsible for our sharp central vision. The central retina is cone-dominated and the peripheral retina is rod-dominated.

antoniomartin
Télécharger la présentation

PSY 369: Psycholinguistics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension

  2. The Human Eye • At its center is the fovea, a pit that is most sensitive to light and is responsible for our sharp central vision. • The central retina is cone-dominated and the peripheral retina is rod-dominated.

  3. Retinal Sampling

  4. Retinal Sampling

  5. Eye Movements • Within the visual field, eye movements serve two major functions • Saccades to Fixations – Position target objects of interest on the fovea • Tracking – Keep fixated objects on the fovea despite movements of the object or head

  6. Fixations • The eye is (almost) still – perceptions are gathered during fixations • The most important of eye “movements” • 90% of the time the eye is fixated • duration: 150ms - 600ms

  7. Saccades • Saccades are used to move the fovea to the next object/region of interest. • Connect fixations • Duration 10ms - 120ms • Very fast (up to 700 degrees/second) • No visual perception during saccades • Vision is suppressed • Evidence that some cognitive processing may also be suppressed during eye-movements (Irwin, 1998)

  8. Saccades Move to here

  9. Saccade w/o suppression

  10. Saccades Move to here

  11. Saccades

  12. Saccades • Saccades are used to move the fovea to the next object/region of interest. • Connect fixations • Duration 10ms - 120ms • Very fast (up to 700 degrees/second) • No visual perception during saccades • Vision is suppressed • Ballistic movements (pre-programmed) • About 150,000 saccades per day

  13. Smooth Pursuit • Smooth movement of the eyes for visually tracking a moving object • Cannot be performed in static scenes (fixation/saccade behavior instead)

  14. Saccades Jerky No correction Up to 700 degrees/sec Background is not blurred (saccadic suppression) Smooth pursuit Smooth and continuous Constantly corrected by visual feedback Up to 100 degrees/sec Background is blurred Smooth Pursuit versus Saccades

  15. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  16. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  17. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  18. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  19. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  20. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  21. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  22. Eye-movements in reading • Eye-movements in reading are saccadic rather than smooth Clothes make the man. Naked people have little or no influence on society.

  23. Eye-movements in reading • Limitations of the visual field • 130 degrees vertically, 180 degrees horizontally (including peripheral vision • Perceptual span for reading: 7-12 spaces Clothes make the man. Naked people have little or no influence on society.

  24. Measuring Eye Movements Purkinje Eye Tracker • Laser is aimed at the eye. • Laser light is reflected by cornea and lens • Pattern of reflected light is received by an array of light-sensitive elements. • Very precise • Also measures pupil accomodation • No head movements

  25. Measuring Eye Movements Video-Based Systems • Infrared camera directed at eye • Image processing hardware determines pupil position and size (and possibly corneal reflection) • Good spatial precision (0.5 degrees) for head-mounted systems • Good temporal resolution (up to 500 Hz) possible

  26. dog The man hit the with the leash. S NP det N The man

  27. dog The man hit the with the leash. S NP VP V det N The man hit

  28. dog The man hit the with the leash. S NP VP V NP NP det N det N The man hit the dog

  29. PP with the leash dog The man hit the with the leash. S NP VP V NP NP Modifier det N det N The man hit the dog

  30. PP with the leash dog The man hit the with the leash. S NP VP V NP Instrument NP det N det N The man hit the dog

  31. dog The man hit the with the leash. • How do we know which structure to build?

  32. Parsing • The syntactic analyser or “parser” • Main task: To construct a syntactic structure from the words of the sentence as they arrive

  33. Different approaches • Serial Analysis (Modular): Build just one based on syntactic information and continue to try to add to it as long as this is still possible • Interactive Analysis: Use multiple levels (both syntax and semantics) of information to build the “best” structure • Parallel Analysis: Build both alternative structures at the same time • Minimal Commitment: Stop building - and wait until later material clarifies which analysis is the correct one.

  34. Sentence Comprehension • Modular

  35. Interactive models Sentence Comprehension • Modular

  36. Sentence Comprehension • Garden path sentences • A garden path sentence invites the listener to consider one possible parse, and then at the end forces him to abandon this parse in favor of another.

  37. Real Headlines • Juvenile Court to Try Shooting Defendant • Red tape holds up new bridge • Miners Refuse to Work after Death • Retired priest may marry Springsteen • Local High School Dropouts Cut in Half • Panda Mating Fails; Veterinarian Takes Over • Kids Make Nutritious Snacks • Squad Helps Dog Bite Victim • Hospitals are Sued by 7 Foot Doctors

  38. S NP VP The horse Sentence Comprehension • Garden path sentences • The horse raced past the barn fell.

  39. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. S NP VP V The horse raced

  40. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. S NP VP V PP P NP The horse raced past

  41. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. S NP VP V PP P NP The horse raced past the barn

  42. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. S NP VP V PP P NP The horse raced past the barn fell

  43. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. • raced is initially treated as a past tense verb S NP VP V PP P NP The horse raced past the barn

  44. Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. • raced is initially treated as a past tense verb • This analysis fails when the verb fell is encountered S NP VP V PP P NP The horse raced past the barn fell

  45. S VP NP V NP RR PP V P NP The horse raced past the barn fell Sentence Comprehension • Garden path sentences • The horse raced past the barn fell. • raced is initially treated as a past tense verb • This analysis fails when the verb fell is encountered • raced can be re-analyzed as a past participle. S NP VP V PP P NP The horse raced past the barn fell

  46. A serial model • Formulated by Lyn Frazier (1978, 1987) • Build trees using syntactic cues: • phrase structure rules • plus two parsing principles • Minimal Attachment • Late Closure

  47. A serial model • Minimal Attachment • Prefer the interpretation that is accompanied by the simplest structure. • simplest = fewest branchings (tree metaphor!) • Count the number of nodes = branching points The girl hit the man with the umbrella.

  48. Minimal attachment S 8 Nodes NP VP the girl V NP Preferred S hit NP PP NP VP the man P NP the girl V NP PP with the umbrella hit the man P NP with the umbrella 9 nodes The girl hit the man with the umbrella.

  49. A serial model • Late Closure • Incorporate incoming material into the phrase or clause currently being processed. OR • Associate incoming material with the most recent material possible. She said he tickled her yesterday

  50. Parsing Preferences .. late closure S Preferred S np vp np vp she v S' adv she v S' said np vp yesterday said np vp he v np he v np adv tickled her tickled her yesterday (Both have 10 nodes, so use LC not MA) She said he tickled her yesterday

More Related