There have always been kind of two schools of thought in artificial intelligence. One of them is kind of the emergent intelligent idea, of, for instance, neural networks. The idea that you'd have some system that was a fundamentally simple system of replicated parts that had in it the inherent ability to organise. And that by some method of interaction with the world or training or something like that, that would form into something that could do intelligence. So neural networks are the perfect example of that. They have some structure, they have layers, they have not complete connectivity, but you're able to train them, for instance, on pictures and have them determine different categories of things. And so that idea was a very early idea in artificial intelligence. And in fact, Marvin [Minsky] worked first on that idea. And he built little electronic neurons out of tubes, and that's what he did when he was a Harvard fellow. The problem with that idea was that it really needed a lot of neurons, and so you had to get up to very, very large numbers before you got that kind of emergence happening. And so while in principle people had very good ideas about how to train the networks and so on, going back to McCulloch and Pitts, and people like Jerry Lettvin and Marvin Ashby. You know, they definitely had notions of how to do this. They, in practice, couldn't do it very much.

So part of why I built the Connection Machine was to try to get the number of neurons up much higher so that you could do those kinds of things. Now, as it turns out, even though I increased it maybe by a factor of 10,000 of what you could do before, I was still another factor of a thousand or a million off of what was actually required. So in fact, recently people have built big enough machines so that they've actually gotten enough to get this emergent behaviour. They've got enough data to train it on it. And in fact, it works very well, pretty much with exactly the algorithms that people imagined in the 1950s and 1960s. It just required more neurons.

So that certainly works, and something like that is certainly a part of intelligence. So that's the sort of... I would say, the kind of mysterious subconscious intelligence of... certainly recognition seems to work like that. And that's the kind of intelligence that takes lots and lots of weak information and puts it together and somehow comes to a conclusion, like I'm looking at George Dyson right now, from lots of little tiny clues.

So that kind of intelligence is very easy for us. We do it without much effort, but it's probably actually most of the computation that goes on in our minds. And it's probably the kind of intelligence that we have in common with animals.