Does the Chinese room understand?
Can following formal rules ever add up to real understanding?
I
Searle is right
Running a program, however sophisticated, is not sufficient for understanding. Minds need more than formal symbol manipulation.
- Best argument
- The thought experiment shows that one can run the program without understanding. The person in the room is doing everything a computer does. If they do not understand, nothing in the program does. Understanding requires the causal powers of brains, or something equivalent, not just the right input-output behaviour. Searle did not say machines could never think; brains are machines. He said programs alone could not.
- Strongest objection
- Critics say Searle never explains which causal powers brains have that computers lack, or why those powers could not be implemented in silicon. The claim that meaning requires biology looks like an unsupported assumption.
- Defended by
- John Searle, Hubert Dreyfus
II
The systems reply
The person does not understand Chinese, but the whole system (person, rulebook, room) does.
- Best argument
- The person is like a single neuron, or the central processor in a computer. No neuron understands English, but you do. The understanding belongs to the system as a whole, not to any one component. Searle's argument asks whether a part understands and concludes that the whole does not, which is a fallacy.
- Strongest objection
- Searle answered that he could memorise the entire rulebook and do all the work in his head, walking around outside. Now he is the whole system, and he still understands no Chinese.
- The reply
- Systems theorists reply that, if Searle memorised the rules, there would be two systems running on one brain: Searle, who speaks English, and a Chinese-speaking system that Searle has no access to, much as in some cases of dissociation.
- Defended by
- Daniel Dennett, Ned Block, Jack Copeland
III
The robot reply
Put the program in a robot with cameras and arms, so its symbols connect to the world, and it would understand.
- Best argument
- Understanding requires that symbols be grounded in perception and action: 'tree' means something because it connects to seeing and touching trees. Stevan Harnad called this the symbol grounding problem problem. The room is sealed off from the world. A robot that learned words by interacting with things would not be.
- Strongest objection
- Searle answered that sensor inputs are just more symbols in the slot, and motor outputs just more symbols out of it. The man in the room would still be manipulating shapes without knowing they came from cameras.
- Defended by
- Stevan Harnad, Jerry Fodor
IV
The intuition is unreliable
The thought experiment pumps a misleading intuition. A system complex enough to pass the test would be so vast and fast that our intuitions about a man shuffling cards do not apply.
- Best argument
- Paul and Patricia Churchland compared Searle's argument to saying that waving a magnet in a dark room produces no visible light, so light is not electromagnetic radiation. The slowness and scale of the imagined system mislead us. Real understanding may emerge from enormous numbers of simple operations, as it does in brains.
- Strongest objection
- Searle's defenders reply that speed and scale are irrelevant to the logical point: symbol manipulation by shape, however fast, does not involve meaning.
- Defended by
- Paul Churchland, Patricia Churchland, Daniel Dennett
For the full background, variations and open questions, read the entry: The Chinese room.