McGurk effect

The McGurk effect is an experiment that clearly indicates the power of integration by mixing visual and auditory cues [210]. A video of a person speaking is shown with the audio track dubbed so that the spoken sounds do not match the video. Two types of illusions were then observed. If ``ba'' is heard and ``ga'' is shown, then most subjects perceive ``da'' being said. This corresponds to a plausible fusion of sounds that explains the mismatch, but does not correspond to either original cue. Alternatively, the sounds may combine to produce a perceived ``bga'' in the case of ``ga'' on the sound track and ``ba'' on the visual track.

Steven M LaValle 2020-01-06