It was somewhere around 1988. For various reasons, I became interested in trying to understand learning. I already new from my own experience at growing up, that human children can be excellent learners. And my experience as an educator (university professor) supported this view.
I also knew, as a practicing computer scientist, that machine learning did not work at all well. The kind of machine learning that worked best was reinforcement learning. But the difficulty was you had to give a direction to the learning system, and come up with a reward system for the reinforcement. So it was hard to judge how much of the learning was due to the programmer, rather than to the software.
My starting assumptions
When I started this project, I did not expect to succeed. I knew it was a difficult problem. I did better than I had expected. And that is probably because of my starting assumptions. However, my starting assumptions were apparently quite different from those of epistemology (the branch of philosophy that studies knowledge). So I guess my starting assumptions were the start of my philosophical heresy.
What was obvious, was that some children grow up in places where cats and dogs are commonplace. Others grow up in places where kangaroos and koalas are more common. And still others grow up in places where you are more likely to see polar bears and seals.
In short, we are a diverse species. Children grow up in a wide variety of environments. And they seem to do well and learn well in any of those environments.
It seemed very unlikely that knowledge of all of those environments could be in our genes. The size of the genome seems too small to encode that much. So the alternative was that, instead of being born with innate knowledge of the environment, it must be that we are born with innate abilities to discover what kind of environment we are in and to discover how to cope with that environment.
And I guess that made me some kind of empiricist.
Empiricism
There’s an long standing argument within philosophy, between empiricism and rationalism. According to the rationalists, we already have a lot of innate knowledge at birth. According to the empiricists, we are not born with innate knowledge, but instead acquire that knowledge by learning.
Looked at, in those broad terms, I was some kind of empiricist.
When I later looked at the literature on empiricism, it didn’t fit. John Locke, one of the founders of British empiricism, did seem to be talking about acquiring concepts. But he did not provide a persuasive account of how those concepts are acquired.
When I go past Locke, and look at Hume, then his empiricism is mostly about acquiring beliefs. And that idea of empiricism as acquiring beliefs seems to be the main theme of empiricism. I don’t see how that could work. As I’ve already mentioned, my view of the problem faced by a child, is that the child must form suitable concepts for the environment in which he finds himself. And it is that acquiring of concepts that is at the core of the learning that we see in children. Acquiring beliefs, once you already have the concepts, is a simpler problem. But, by itself, belief acquisition cannot account for a child’s learning.
So I was already a heretic at that point.
The tabula rasa
In later readings, I came upon this, from Margaret Boden (in “Computer Models of Mind: Computational approaches in theoretical psychology”):
Presumably the child brain is something like a notebook as one buys it from the stationer’s. Rather little mechanism and lots of blank sheets. …
Our hope is that there is so little mechanism in the child brain that something like it can be easily programmed.
Boden is criticizing the idea of a tabula rasa.
It must be that my understanding of tabular rasa is very different from Boden’s. I have taken it to mean that the child comes knowing nothing about his world. But that requires that the child comes with a lot of innate abilities to find ways of making sense of the world. Boden seems to think that the tabula rasa implies no knowledge of the world and no innate abilities.
Apparently my ideas on the problem of learning are very different from what philosophers see as the problem of knowledge.
Ontology
Philosophers study ontology separately, as part of metaphysics. They seem to take ontology as a starting point. The see ontology as a prerequisite to acquiring knowledge. Ontology is what you can talk about, and knowledge is taken to be the beliefs that are the content of your knowledge.
With my way of looking at learning, this does not make sense to me. What we talk about is something that is up to us to decide. It isn’t given as a prerequisite to having knowledge. If anything, knowing what we want to talk about is a central part of our knowledge. And it doesn’t really matter what exists. We can talk about unicorns, even if they don’t exist. As a mathematician, I can talk about numbers, and whether numbers actually exist does not seem important.
Summary
So there you see some of my heresies. What I see as empiricism is very different from what is discussed in the literature. How I see the tabula rasa appears to be different from the way that philosophers and psychologists see it. And I don’t see the point of separating out ontology from the problem of knowledge.
The Heretical Philosopher 