Perception and the senses a!!
Mwahahahah
AAAAAAAAAAAH ! Not more senso ry cues!!!
Perception and the senses Based on the bbc 4 radio programme ‘in our time’ edited and illustrated by Louisa Hadjipetrou
Indroduction “Barry Stein’s laboratory at Wake Forest University in the United States found that the shape of a right angle drawn on the hand of a chimpanzee starts the visual part of the brain working, even when the shape has not been seen. It has also been discovered that babies learn by touch before they can properly make sense of visual data, and that the senses of smell and taste chemically combine to give us fLavour. Perception is a tangled web of processes and so much of what we see, hear and touch is determined by our own expectations that it raises the question of whether we ever truly perceive what others do. What governs our perception of the world? And are we correct to distinguish between sight, sound, smell, touch and taste when they appear to infLuence each other so very much?”
1
2
I think there’s something in my eye...
3
“we call that perception, meaning that the brain is adding a vast amount of information to the information received by the senses, it’s enriched tremendously and if you think about it the eyes have little tiny pictures like postage stamps...”
“and from those tiny pictures only the centers of which have any sort of sharpness to them anyway, we see this incredible richness of the world.”
4
“we see objects as solid, as useful, as frightening, as beautiful, as sexy, all these rich qualities which come from our knowledge of the world which are projected into the world from the brain.�
5
“So we sort of project into the world perceptually as we receive signals through the senses, the eyes, the ears, which are then transmitted to the brain and I think the essential point about perception is that even directly it is related to the external world.”
So what’s this FIlm about then?
6
“we seem to be directly aware of things around us or both in the world continuously, actually the brain is locked away in this little black box not of course receiving any light. Although we see light, light never enters into the brain.�
7
Hey! It’s dark in here...
8
Errrrr...?? .--. . .-. -.-. . .--. - .. --- -. / .- -. -.. / - .... . / ... . -. ... . ..
9
“All the brain gets are signals like Morse code, dots and dashes from the senses which it has to decode. It has to interpret, it has to read from knowledge with lots of rules and it constructs the world around us. It’s really constructed by an active brain.�
10
“well in the eye itself we have of course the retina which has 120 million receptors which are like little tiny photoelectric cells which accept photons and then produce signals- we call these transducers it’s an engineering term, it converts the photons energy entering the eye into signals which are little pulses of electricity.�
11
“so it receives these pulses of electricity which are essentially the same for all the senses. Also, incredibly, very much the same as any sort of signal working the muscles, these are called action potential. Discovered at the beginning of the 19th century by lord Adrian. He discovered wonderful coding of the nervous system.�
ever l c a m I’ am! chap i
12
u see! o y t a h w I can see nimal my arse! fa o m r o f t s Highe
I wish I
had my g
lasses...
13
“it starts of with these separate kinds of processing for different kinds of creatures of the world and yet we experience one homogenous world of objects from all this mish-mash…”
14
“the brain creates hypothesis of the external world which are rather like hypothesis in science. It’s got bits and pieces of data coming in, pretty inadequate actually, vast amounts of knowledge stored from the past and then its got those rules by which it handles the data, very much how science works and then it creates stories...”
hypothesis, predictive hypothesis of the external world and that is our inner reality.”
15
If the size of t he molecules is related to the rate of diffusion as the y pass through a membr ane, then small er molecules will flow through at a higher ra te.
16
We’re so aw
esome!
Oh I know...
17
“but the difference between the senses actually starts at the outer part, in the eye and the ear. So whereas we have photons stimulating the retina, in the auditory system we have energy, mechanical transformations in the air which then set up mechanical changes in the ear...”
“and then the same process of transduction takes place within the inner ear leading to the generation of nerve impulses.”
18
“in reality we’re not just simply looking at a single auditory cue like a tone and a fLash of light and the brain has to decide whether those things arise from the same object or not, but the more usual cases are as you walk through your environment your brain is bombarded by multiple sensory cues arising from lots of different objects. So its had to evolve some rules by which it can decide whether more than one sensory cue arises from one object or multiple ones and two cues it has learned that give us information about where these signals are coming from are proximity in time and space. So by and large we know when things occur in time and are arising from the same location they tend to be coming from the same object.�
19
a!!
Mwahahahah
AAAAAAAAAAAH ! Not more senso ry cues!!!
20
issed k e b d l u You sho n and by e and oft nows how. ho k w e n o e som
“when you’re looking at a movie, when you’re in the cinema looking at a movie, looking at people talking we think: yes they are talking, that person is saying those words before my very eyes and it’s happening on the screen in front of me on the little moon of my existence in the universe… but we know the sound is coming from the sides, sometimes from the back, sometimes from the ceiling …” “typically when you have multiple senses they sense which is the most easily localizable in this case for us humans that’s vision, the other sense will be misallocated towards the visual cue because it’s the most persuasive…”
21
Where ’s the coming sound from?
22
... and this is my good friend vincent! Say hello vincent...
! p u t u h s h A
23
“so this is the basis, not only of you sitting in the cinema and perceiving that the sound is actually coming from the speakers on the screen in front of you even though it’s not it’s in the surround sound at the back but also on the basis of the ventriloquist illusion which has less to do with the ventriloquists ability to throw his voice...”
“and more to do with the fact that the persuasiveness of the time course of the dummy’s lips and mouth movements that he moves in time with his speech shifts your perception of the sound and speech away from the ventriloquist and towards the dummy.”
24
“the same cells which recognize correspondence between different senses are also able to detect incongruence so things which are just slightly slicked out of time perhaps are spatially disparate or perhaps even the content doesn’t match...”
“for example if you’ve watched a foreign movie and they dub English over the natural language that the speakers are mouthing it will actually hamper your ability to hear what’s being said.”
25
A toast
to the q
“Mἱα φρυγανἱα γιἀ τἠν βασἰλισσα!”
A piece of toast for the queen! 26
ueen!
“I think in a way when studying the mind, illusions are like test tubes in a chemistry set, isolated from the physical world because perception has departed from the physics, departed from the actual world of objects and you either get distortions or complete fIctions.”
27
eeelf, e e e s ll y my All b anna be a re... w o don’t eelf anym see by my
28
“the brain is quite capable of creating ghosts, completely fIctional objects which do not exist and there are rules and laws for producing ghosts, it’s not just unlawful, it’s not just random and roughly what’s happening is that the brain adopts all sorts of strategies for making effective use of rather limited information on the basis of past experience ...”
“so when you’ve got a situation which in some way is similar to the past but in another subtle was different, it’ll process it as though it’s a typical situation. It’ll then produce artifacts, errors.”
29
BOO!! AAAAAAAA AAAH!! A Oh wait t Ghost!! hey don’t exist... m y bad!
30
ollow, ?! h y l l a I’m actu t now did you now tha didn’t k
31
“a very nice example is looking at a hollow face, a hollow mask and you see it just sticking out, the nose sticking out although it’s really sticking in simply because all the faces ones seen in ones life have had sticking out noses...”
“and its got your information, it is a face, the shape of the eyes and nose and so on. It might be a cartoon indeed illustrating your face and then the brain FIlls in all sorts of information from past experience which happens to be down right wrong.”
32
NOW YOU DON’T
...
OU
Y NOW
S ES E U
33
“now I fInd illustrations incredibly interesting, I think there are many kinds of distortions, complete fIctions and there are also ambiguities which are terribly interesting when perception FLips from one thing to another although the input is fIxed, is the same with no change whatsoever, it’ll entertain if you like, different hypothesis and so you see the activity of the brain trying out possibilities actively even from the same input, for example there’s a famous illustration again involving faces where you draw a vase and the outside of the vase forms two faces looking at each other and sometimes you see the vase and other times you see the two faces with no change whatsoever in the object or the drawing.”
34
??
oa
nd a s t
g e e r Th
35
a
... l l o tr
WE GO
TO SCHO
OL
“lip reading which is very important for people who are hard of hearing but what’s less well recognized is that it’s also very important for people who hear normally and we’re consciously lip reading all the time when we’re watching somebody talk particularly this can be benefIcial in a situation where the auditory signal is degraded in some way and we can sort of use the lip reading to FIll in the missing auditory signal.”
36
“a fascinating illusion in hearing, well it’s a cross modal illusion, is the so called mcgurk effect and I fIrst witnessed this at a large convention center, there were 5000 people in the audience and the speaker asked us to close our eyes and she played a syllable which was pa and everyone heard pa and then she asked us to open our eyes and there on the screen in front of us was a huge picture of somebody’s face and the visual stimulus was saying KA and immediately on the fIrst presentation of this everybody got the perception of either ka or ta but not pa and this huge gasp went up in the audience, it was incredibly dramatic. So this shows the power of how vision can actually infLuence what we hear.”
“probably the more common example of the mcgurk effect is with the syllables ba and da; the auditory is the ba and the visual is the da but what you actually hear is ga, a blend of the two neither one nor the other but a fusion. This demonstrates the infLuence of lip reading on your auditory perception.”
37
I be tter paid be ge for tting this ...
Ba Ba Ba Ga Ga Ga Da Da Da
38
So we deduce that as an object falls, its speed increases because it’s being pulled on by gravity!
39
“this is a characteristic of children, I think children when they’re in a high chair throwing a mug on the fLoor and all the rest of it, they’re actually carrying out experiments, they’re relating the signals coming to their brains to their eyes to the world of tangible objects which can hurt them or reward them because they’re experimenting with the world actively and these experiments which you do in childhood which are such a pain to everyone except the mother are really a child being a scientist discovering the world.”
40
“hearing does begin in utero at about the 26th week or so of pregnancy and there’s been some reports that children when they’re born can recognize their mothers voices so there is some sort of learning going on in there apparently.”
41
Oh pl ease mumm stop kic y’s ut k erus ing me, is footb all... n’t a
Oi!
you
42
talk
in’ a
bout
me?!
O! D I T A H W JUST DO
woah...
43
“learning by natural selection, that is there is a change in the genetic code according to what has been successful behavior, tends to get inherited by natural selection and so knowledge gets inherited not directly by the brain but by the genetic code and this is what we mean by innate knowledge… it is in fact knowledge gained by experience but it’s experience through millions of generations so we actually start with knowledge acquired by previous species.”
“if you talk to a behavioral geneticist they will say that behavior is more inherited than physical attributes in some senses, that it has a higher degree of heritability.”
44
AAAAAAH!! WHY GOD WHY!!
“there is a whole science in psychology about intuitive physics, babies innate assumptions about the world, experiments have been done on how babies experience falling objects and if they don’t fall vertically they get a bit upset they sort of intuitively know that objects should fall down vertically… there’s a lot of evidence in the way babies look, in the way they move their eyes that they immediately respond to people and that people are very special. They don’t of course recognize their mother at fIrst go but they do recognize a face, that is they prefer a picture of a simple cartoon face to the same feature jumbled up…”
45
46
The End
A humorous accompaniment to the bbc 4 radio programme ‘IN OUR Time’. This edition focuses on perception and the senses and is hosted by Melvin Bragg. Guest speakers are Richard Gregory, Senior Research Fellow in the Department of Experimental Psychology, Bristol University; David Moore, Director of the Medical Research Council Institute of Hearing Research, University of Nottingham and Gemma Calvert, Reader in Cognitive Neuroscience, University of Bath.
edited and illustrated by Louisa Hadjipetrou