Errors in Thinking: Cognitive Errors, Wishful Thinking and Sacred TruthsWhy Question Beliefs? Dangers of Placing Ideas Beyond Doubt, and Advantages of FreethoughtThe False and Conflicting Experiences of Mankind: How Other Peoples' Experience Contradict Our Own BeliefsWhat is Science and the Scientific Method?
Pareidolia - Seeing False Patterns in Random Data: Faces in Toast, Bible Codes and Conspiracy TheoriesMass Belief: Everyone Believes It So It Must Be True!Selection Bias and Confirmation BiasWhy are Our Memories Unreliable?The Forer (or Barnum) Effect
What Causes Religion and Superstitions?Experiences of God are Illusions, Derived from Malfunctioning Psychological ProcessesHallucinations, Sensory Deprivation and Fasting: The Physiological Causes of Religious and Mystical ExperiencesScience and ReligionReligion and Intelligence
Cognitive errors are those types of systematic mistakes which our brains make when presenting ideas and correlations to our conscious selves. They result from us applying evolutionarily developed rules of thumb to the complexities of life without taking due heed of the need for critical and cautious evaluation of our own thought processes. Human errors in general thinking can lead individuals, or whole communities, to come to explain types of events and experiences in fantastical ways. Before we can comprehensively guard against such cumulative errors, we need to learn the ways in which our brains can misguide us. They are divided into three areas: the internal errors of thinking, errors with our actual perceptions, and social errors that result from the way we communicate ideas and the effects of traditions and dogmas.
Many errors in thinking do not come from the fact that we don't know enough. Sometimes, we do. But most the time our brains fill in the gaps, and unfortunately the way our brains put together partial evidence results in potentially false conclusions. These systematic problems with the way we think are called cognitive errors, and they occur below the level of consciousness. Much research has been done in this area, and continues. "The research is painting a broad new understanding of how the mind works. Contrary to the conventional notion that people absorb information in a deliberate manner, the studies show that the brain uses subconscious "rules of thumb" that can bias it into thinking that false information is true"1. These cognitive errors and rules of thumb are discussed on this page. Thomas Gilovich published a book concentrating on the subtle mistakes made in everyday thinking, and introduces the subject like this:
“People do not hold questionable beliefs simply because they have not been exposed to the relevant evidence [...] nor do people hold questionable beliefs simply because they are stupid or gullible. [... They] derive primarily from the misapplication or overutilization of generally valid and effective strategies for knowing. [... Many] have purely cognitive origins, and can be traced to imperfections in our capacities to process information and draw conclusions. [...] They are the products, not of irrationality, but of flawed rationality.”
"How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life"
Thomas Gilovich (1991)2
“The cognitive process of seeing patterns and drawing conclusions from random patterns and ambiguous data is called pareidolia. It is a highly common 'thinking error'. A part of our brain, the fusiform face area, actively looks for any shapes, lines or features that might possibly be a human face. It does so devoid of context, and reports with urgency and confidence when it thinks it has results. That's why most pareidolia is involved with the perception of human forms in messy visual data. It "explains why some people see a face on Mars or the man in the moon [... or] the image of Mother Teresa in a cinnamon bun, or the Virgin Mary in the bark of a tree"3. Auditory pareidolia is responsible for the way that all of sometimes mistake a whistling breeze for a whispering human voice. When people listen with expectation of hearing a voice they will hear spoken words in pure noise4. We often misperceive random events in a way that supports our own already-existing beliefs or hunches5. Some patterns seem and feel so natural and real that it goes against common-sense to deny them. But against all expectations and against our judgements, many perceived objects turn out to be illusions. Psychologist Jonah Lehrer says "the world is more random than we can imagine. That's what our emotions can't understand"6. The tendency for people to see more order in nature than there is was noted as long ago as the thirteenth century by Roger Bacon - he called such errors due to human nature the 'idols of the tribe'7. To study pareidolia sociologists have presented true sets of random results and analysed subject's responses to them. Coin flips, dice throws and card deals have all revealed that we are naturally prone to spotting non-random trends exist when in fact they don't8. Pareidolia results in superstitions, magical thinking, ghost and alien sightings, 'Bible codes', pseudo-science and beliefs in all kinds of religious, nonsensical and magical things8,9,10.11”
“It is the peculiar and perpetual error of the human understanding to be more moved and excited by affirmatives than negatives.”
Francis Bacon (1620)12
Selection Bias is the result of poor sampling techniques13 whereby we use partial and skewed data in order to back up our beliefs. It includes confirmation bias which is the unfortunate way in which us Humans tend to notice evidence that supports our ideas and we tend to ignore evidence that contradictions it14,15. We are all pretty hard-working when it comes to finding arguments that support us, and when we find opposing views, we work hard to discredit them. But we don't work hard to discredit those who agree with us. In other words, we work at undermining sources of information that sit uncomfortably with what we believe, and we idly accept those who agree with us.
All of this is predictable enough for an individual, but another form of Selection Bias occurs in mass media publications too. Cheap tabloid newspapers publish every report that shows foreigners in a bad light, or shows that crime is bad, or that something-or-other is eroding proper morality. And they mostly avoid any reports that say the opposite, because such assuring results do not sell as well. Newspapers as a whole simply never report anything boring - therefore they constantly support world-views that are divorced from everyday reality. Sometimes commercial interests skew the evidence that we are exposed to - drugs companies conduct many pseudo-scientific trials of their products but their choice of what to publish is manipulative - studies in 2001 and 2002 shows that "those with positive outcomes were nearly five times as likely to be published as those that were negative"16. Interested companies just have to keep paying for studies to be done, waiting for a misleading positive result, and then publish it and make it the basis of an advertising campaign. The public have few resources to overcome this kind of orchestrated Selection Bias.
RationalWiki uses mentions that "a website devoted to preventing harassment of women unsurprisingly concluded that nearly all women were victims of harassment at some point"17. And another example - a statistic that is most famous for being wrong, is that one in ten males is homosexual. This was based on a poll done on the community surrounding a gay-friendly publication - the sample of respondents was skewed away from the true average, hence, misleading data was observed.
The only solution for these problems is the proper and balanced statistical analysis, after actively and methodically gathering data. Alongside raising awareness of Selection Bias, Confirmation Bias, and other thinking errors. This level of critical thinking is quite a rare endeavour in anyone's personal life - we don't have time, the inclination, the confidence, or the skill, to properly evaluate subjective data. Unfortunately just fact-checking is also rare in mass media publications. Hence why personal opinions (including your own) and news outlets ought to be given little trust.
The above text is an extract from "Selection Bias and Confirmation Bias" by Vexen Crabtree (2014).
“A psychologist [Dr Hecke] argues that much what we label "stupidity" can be better explained as blind spots. She draws on research in creativity, cognitive psychology, critical thinking, child development, education, and philosophy to show how we (all of us, including the smartest people) create the very blind spots that become our worst liabilities. She devotes a chapter to each of ten blind spots, among them: not stopping to think, my-side bias, jumping to conclusions, fuzzy evidence, and missing the big picture.”
Much of what Hecke argues is from the way we examine the data surrounding events. We tend to concentrate on the coincidences and specifics of the case in question, and miss out all the surrounding facts and figures. Without taking disconfirmation (as seen above) into account, the coincidences that we notice can become misleading.
“The Forer effect is the seeing of a personality statement as "valid even though it could apply to anyone", and is named after the psychologist who famously demonstrated it20. In 1949, Bertram Forer conducted a personality test, and then gave all of his students exactly the same personality profile, which he constructed from random horoscopes. The students rated the accuracy of their profile at over 80% on average21! This was occasionally previously known as the Barnum effect after a popularist entertainer. Extensive studies have found that this effect applies well to horoscopes, other astrological readings, messages given from the dead by spiritualists, various cold reading tricks and other profiling endeavours22. It is often mistaken for being a product of magical or supernatural means.”
People tend to prefer arguments and evidence that backs up what they currently believe and are poor at objectively interpreting opposing arguments and counter-evidence. Social psychologist David Myers summarizes much of the research that has been done on this topic. "Self-created" justifications for their own beliefs are often imaginative and occur after beliefs have been solidified and such "belief perseverance" feels urgent even when it is more productive to consider beliefs' worth more rationally and calmly. The result is a "cognitive inertia" that opposes changes in belief - especially when such changes can be noticed by other people. We often deny that any change has occurred, and we often believe we haven't changed our minds too!23
“One of the greatest challenges for scientists and educators is persuading people to give up beliefs they hold dear when the evidence clearly indicates that they should. Why aren't most people grateful for the data? [...] The motivational mechanism underlying the reluctance to be wrong, change our minds, admit serious mistakes, and accept unwelcome findings is cognitive dissonance. The theory of cognitive dissonance was invented fifty years ago by Leon Festinger, who defined dissonance as a state of tension that occurs whenever a person holds two cognitions that are psychologically inconsistent. [...] One of the most effective ways the mind maintains constant beliefs is through the confirmation bias - the fact that we tend to notice and remember information that confirms what we believe and ignore or forget information that disconfirms it.”
Tavris & Araonson (2007)24
In short, we suffer mental distress when perceived evidence, our own actions, or counter-arguments threaten beliefs and opinions we already hold. This cognitive dissonance and its effects have gone by many names, and been discovered in extensive studies. It is a status quo bias towards what we already believe. We have belief perseverance25, which is especially strong if previous a person has constructed rational arguments in favour of their belief or if they have emotional attachments to the belief26. When changes of mind do occur, subjects then refuse to admit that they have had changes in beliefs over time. As we invest mental time on a belief, we become less likely to notice evidence against it, and less likely to change our mind even when we do see evidence. In total, our beliefs work sometimes against us, preventing us from accepting new evidence or counter arguments. This is why peer review is a fundamental part of the scientific process.
The recognition of this inertia is not a new discovery to the academic world, Aristotle pondered over it almost 2400 years ago and concluded that people invest much time and effort in their opinions and beliefs, and are therefore unlikely to easily abandon them:
“All people value most what has cost them much labour in the production; for instance, people who have themselves made their money are fonder of it than those who have inherited it: and receiving kindness is, it seems, unlaborious, but doing it is laborious. And this is the reason why the female parents are most fond of their offspring; for their part in producing them is attended with most labour, and they know more certainly that they are theirs. This feeling would seem also to belong to benefactors.”
If our biochemical brains and physiology sometimes go haywire but we are not aware of a dysfunction, we are apt to misinterpret the events. So, our expectations, culture and abstract thinking all conspire to present to us a false experience. Some medical conditions can cause these to be recurring and frequent occurrences. Through studying these science has come to understand such experiences as out of body experiences, possession, night time terrors, and through more simple biological knowledge have understood the Incubus and Succubus, and many other superstitious beliefs. Physical problems with the eyes can cause wild effects such as seeing blood run up walls, dust storms, clouds, and haloes that are not really there28. Isolated fits and seizures can cause bizarre effects such as odd lights, feelings, smells, auras and déjá vu that can be mild and subtle29.
“Sleep paralysis, or more properly, sleep paralysis with hypnagogic and hypnopompic hallucinations have been singled out as a particularly likely source of beliefs concerning not only alien abductions, but all manner of beliefs in alternative realities and otherworldly creatures. Sleep paralysis is a condition in which someone, most often lying in a supine position, about to drop off to sleep, or just upon waking from sleep realizes that s/he is unable to move, or speak, or cry out. This may last a few seconds or several moments, occasionally longer. People frequently report feeling a "presence" that is often described as malevolent, threatening, or evil. An intense sense of dread and terror is very common. The presence is likely to be vaguely felt or sensed just out of sight but thought to be watching or monitoring, often with intense interest, sometimes standing by, or sitting on, the bed. On some occasions the presence may attack, strangling and exerting crushing pressure on the chest. People also report auditory, visual, proprioceptive, and tactile hallucinations, as well as floating sensations and out-of-body experiences (Hufford, 1982). These various sensory experiences have been referred to collectively as hypnagogic and hypnopompic experiences (HHEs). People frequently try, unsuccessfully, to cry out. After seconds or minutes one feels suddenly released from the paralysis, but may be left with a lingering anxiety. Extreme effort to move may even produce phantom movements in which there is proprioceptive feedback of movement that conflicts with visual disconfirmation of any movement of the limb. People may also report severe pain in the limbs when trying to move them. [...] A few people may have very elaborate experiences almost nightly (or many times in a night) for years. Aside from many of the very disturbing features of the experience itself (described in succeeding sections) the phenomenon is quite benign.”
There are many other physiological causes of strange experiences of course, and recent experiments and investigations have allowed exciting results to shed light on the inner working of the Human brain. In particular, a series of experiments have resulted in a deeper understanding of why people experience the idea of god, and these I have put on a separate page: "Experiences of God are Illusions, Derived from Malfunctioning Psychological Processes" by Vexen Crabtree (2002).
“Where we have strong emotions, we're liable to fool ourselves.”
In one hand, we all acknowledge the role of emotions in underlying our choices, beliefs and behaviours. We allow whole certain areas of our lives to be governed by emotions. But in the other hand is everyone's hidden secret: emotions also underlie many of the opinions that we pretend to hold for rational, intellectualized reasons. That's right - the psychologists are on to everyone. Human beings are just not cut out for careful rational thought. It takes dedication, (self-)training and pigheadedness to approach things purely rationally. Every when we think we have our emotions under lock and key, or we think we are in an area of thought that is emotionless, there is often a worrying doubt: Am I deluding myself for some subconscious emotional reason? We will never be like Data, the android from Star Trek, who struggles to show emotion. We will always struggle against it, hiding it and suspecting its influence in all our decisions.
But that isn't the whole story and it is not as simple as trying to suppress and override emotion. The theme of the book "The Decisive Moment: How the Brain Makes Up Its Mind" by Jonah Lehrer (2009) is that our emotions have evolved in order to aid rapid decision-making, taking account of all kinds of subtle stimulus and as a result, when it comes to making quick decisions, it is often important to trust our emotions sometimes. Especially when gauging other people, their behaviour, and their motives. The key is a balance, and knowing when to trust emotions, and when to trust the intellect.
You should not trust your emotions or instincts when it comes to statistics, trends, raw data, and analysis of anything which does not form part of our daily lives, because our emotions evolved for social interpretation and rapid decision-making, therefore, that is where they work best. Science, philosophy and rationalism ought to be done instead in a cool, methodical and systematic manner.
The very things we see and hear, clear as daylight and right in front of our eyes, can be falsehoods caused not by physiological dysfunctions but by brainal expectations. This "top-down" effect on perception became a hot-topic in cognitive research from the 1970s, according to two cognitive psychologists, Eysenck and Keane:
“Towards the end of the 1970s, theorists argued that virtually all cognitive activity consists of interactive bottom-up and top-down processes occurring at the same time. Perception and remembering might seem to be exceptions, because perception obviously depends heavily on the precise stimuli presented (and thus on bottom-up processing), and remembering depends crucially on stored information (and thus on top-down processing). However perception is also much affected by the perceiver's expectations about to-be-presented stimuli, and remembering depends far more on the exact nature of the environmental cues provided to facilitate recollection than was thought at one time.”
It is not just random events, confusing correlations or data processing where our expectations cause us to have certain experiences in place of others. Our mental thoughts can influence the very objects that we see before us, overriding what is real or merging reality with fantasy. Donald D. Hoffman, cognitive psychologist, affirms that "vision is not merely a matter of passive perception, it is an intelligent process of active construction"31. After citing some more experiments and examples, Eysenck and Keane report on a particularly colourful demonstration of it:
“Another illustration [...] comes in a classic study by Bruner, Postman, and Rodrigues (1951). Their subjects expected to see conventional playing cards, but some of the cards used were incongruous (e.g. black hearts). When these incongruous cards were presented briefly, subjects sometimes reported seeing brown or purple hearts. Here we have an almost literal blending of stimulus information (bottom-up processing) and stored information (top-down processing).”
Visual illusions betray the fact that what we think we perceive in the world is actually a result of subjective construction. We are given a representation of the world that looks to us to be coherent, but is in reality a hodge-podge of bits of evidence and guesswork. The real problem is that we trust what we think we see, without realizing that most of it is assumption intermingled with reality.
“The brain seems to make a 'best guess' of a plausible filler and normally we notice nothing unusual. [...] There are numerous other illusions which suggest that what we are conscious of can be a distortion of what is actually there. [...] Some important parts of our conscious experience may be underpinned by the brain 'jumping to conclusions' or applying rules of thumb.”
Saroj Datta (2004) in "From Cells to Consciousness" by Toates, Romero and Datta (2004)33
These types of effects are well-known, not just amongst academics but in industry. Marketing practices routinely abuse our subconscious thinking errors. Take the example of wines, or fizzy drinks, as reported on by a neurologist in "The Decisive Moment: How the Brain Makes Up Its Mind" by Jonah Lehrer (2009)34: During blind trials when people don't know which one they are drinking, the cheapest wines came out as the favourite, according to smell, taste and texture. When packaging was added to coke, wine or energy drinks, the brands with the best reputations, and the more expensive ones, were the immediate favourites. If you put a Coca Cola sticker on cheap coke, everyone rates that coke much better from its taste. Our experiences are deeply tied to our rational brain; our sensory inputs are not driven purely by the outside world, rather our conscious awareness is largely constructed out of expectation. Lehrer notes that we can often make better decisions (more realistic ones!) when we have less information! This is because our rational brain tricks us with a distorted awareness of the world.
“Our memories change over time and frequently they are simply wrong35,36. But most of us tend to think of memories as accurate accounts36. Extensive studies have shown that our memories of events are active interpretations of the past rather than picture-perfect records of it37,38. The best way to avoid errors is to write things down as early as possible36. Our recall of the past is affected by our present expectations and by our current knowledge and state of mind39. We tend to suppress and alter memories that damage our self-esteem36. Psychologists such as Elizabeth Loftus have shown through repeated experiments that simply by asking people questions about what they think they saw or heard previously, you make their subconscious whir into a creative drive in order to answer the question, even if it means making up details, and allowing assumptions and feelings to silently trick our minds into inventing elements of memories. Memories that are full of details give us a great sense of confidence, but, such memories are just as likely to contain accidental fabrications, many errors, and a great number of "filled-in" details which we simply subconsciously invented.”
In "How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life" by Thomas Gilovich (1991) chapter six is devoted to the problems with second-hand information and the way that story-telling is the cause of much error; I do not know if this is good or bad, but, much of the exaggeration and error is subconscious and comes from the way that we tell stories rather than from any intention to lie. I say I don't know if this is good or bad because: it is good that we know it is not intentional because we would otherwise call most people liars, but, it is bad because as a subconscious side-effect of our social instincts, it is very hard to prevent. Anyway, Gilovich gives a brilliant examination of the subject and it is not worth trying to replicate his efforts here.
Roger Bacon (1214-1294) was concerned with science and the gathering of knowledge but he suffered many restrictions and punishments from his Church, and the world had to wait another few hundred years before Francis Bacon could exert a greater influence in the same direction. In Opus Majus Roger Bacon says there are four general causes of human ignorance. All of them are social in nature.
“First, the example of frail and unsuited authority. [...] Second, the influence of custom. Third, the opinion of the unlearned crowd. [...] Fourth, the concealment of one's ignorance in a display of apparent wisdom. From these plagues, of which the fourth is the worst, spring all human evils.”
Although I doubt that all human evils stem from ignorance (let alone just one of its causes), it is certainly worth thinking carefully about these four sources of misinformation. As social animals, our beliefs are often functions of our communities, and our belief-forming and belief-espousing mechanisms are deeply tied to the instinctual politics of social positions and consensus rather than evidence-based analysis.
As a species, we experienced the world as flat. So sure was everyone, that those who thought otherwise were declared insane! Yet the common-sense view was wrong, and the common consensus was eventually changed. The consensus was harming the search for truth. Proof by consensus is no proof at all. We do not have any consistent or absolute way of approaching what we consider true, however we are capable of telling with certainty when something is false. The Earth is not flat, the Northern Lights are not spiritual in basis, neither are rainbows, the stars or the sun and the moon. Earthquakes are not gods moving underneath the Earth, nor can volcanoes or the weather (probably) be influenced by spirit or totem worship. We are not sure if science has "disproved" souls or God, but it certainly seem less likely that they exist than they used to.
We often rely on traditional explanations for events because we simply do not have time to investigate everything ourselves, and, most of the time the pronouncements and findings of experts do not filter down to the general populace. The result is a mixture of messy mass beliefs battling against the top-down conclusions of proper investigations. Status-quo bias and other social factors frequently cause resistance against the conclusions of scientists. For this reason, even such major theories as evolution were sometimes discovered by scientists (in this case, in around the 4th century BCE), and then rejected by society and forgotten until they were re-discovered in a world where society was more ready to accept it.
Skeptical and rational thinking is pitted, socially, against the subconscious, sub-literate and sub-intellectual world of mass belief.
Anthropologists find that the particular elements experienced by people change over time and from culture to culture the elements are experienced differently. With UFOology, different decades and countries have sighted completely different UFOs. A period of time in the UK saw that UFO reportings were generally furry/fuzzy aliens. Modern UFO reports are "grays", thin child-like bodies with enlarged eyes and heads. Different countries report different types of aliens, due to culture. As culture changes, so does the phenomenon. What does that say about the phenomenon?
Such large scale change over time casts doubt on the basis of the experience and has been presented (especially in the case of UFOs and demons) as evidence that the phenomenon is self-generated, not real, so is a function of a the aspirations and expectations of the experiencer.
It seems that the chances of us discovering the truth escape most rapidly from us when it comes to the religious truths (dogmas) put forward by organized religious bodies. Here, authority, tradition and psychology all combine to present a formidable wall against the acceptance of new evidence and truths.
“Tell a devout Christian that his wife is cheating on him, or that frozen yogurt can make a man invisible, and he is likely to require as much evidence as anyone else, and will be persuaded only to the extent to which that you give it. Tell him that the book he keeps by his bed was written by an invisible deity who will punish him with fire for eternity if he fails to accept every incredible claim about the universe, and he seems to require no evidence whatsoever.”
"The End of Faith: Religion, Terror and the Future of Reason" by Sam Harris (2006)42
The issue isn't evidence par se, it's the lack of application of critical thinking to religious received truths, because society has placed religious theories into a sacred zone where they cannot be criticized. You can rationally apply physics to debate the pros and cons of string theory and be praised for your diligence in your search for truth, but if you rationally apply the truths of biology against religion, then, many feel you are being not only impolite, but immoral.
That such religion-inspired truths are due more to social factors than to reality can be seen by the highly culture-dependent interpretation of religious experiences.
“Religious experiences tend to conform closely to cultural and religious expectations. Village girls in Portugal have visions of the Virgin Mary - not of the Indian goddess Kali. Native Americans on their vision quest see visions of North American animals not of African ones. Thus it would seem that religious experiences, no matter how intense and all-consuming, are subject to constraint by the cultural and religious norms of the person to whom they occur. Another way of looking at this is to say that there can be no such thing as a pure experience. An experience always happens to a person, and that person already has an interpretive framework through which he or she views the world. Thus, experience and interpretation always combine and interpenetrate.”
“People have all kinds of weird beliefs. Some of these come about because of experiences the person has had. A person who experiences God and believes in demons has an explanation for the occurrence of night terrors, when people feel a 'force' holding them down terrifyingly on to the bed, making it hard for them to believe. But those who believe in UFOs have a completely different explanation, and say that the 'God' of the theists is merely the effects of advanced civilisation (aliens) on early Humanity. Both explanations are foiled however by neuroscientists who understanding that the cause of these experiences is biochemical in nature. Weird beliefs and experiences can be caused by neurological and physiological problems, like tiny seizures in the brains causing visions. Cultural expectations play a large part in the interpretation of personal events. We all find rational arguments to explain away those who experience things that contradict our own interpretation of reality. The Christian Pentecostals have a saying, "the man with an experience is never at the mercy of the man with a doctrine", meaning that rationality subverts itself to experience. In total, we cannot entirely trust our experiences nor those of others.”
Francis Bacon's four idols of the mind is one of the most influential parts of his work7. In the words of Bertrand Russell, these idols are the "bad habits of mind that cause people to fall into error". E O Wilson describes them as being the causes of fallacy "into which undisciplined thinkers most easily fall"44. To view the world as it truthfully is, said Bacon, you must avoid these errors. Although they are categorized somewhat different nowadays they have been affirmed time and time again by modern cognitive psychologists as the causes of human errors:
Idols of the tribe: "are those that are inherent in human nature"7 so this includes much of what is discussed on this page as the cognitive sources of errors in human thinking. Bacon mentions in particular the habit of expecting more order in natural phenomena than is actually to be found. This is called pareidolia, discussed above. I suspect Bacon calls this error a 'tribal' one because of the preponderance of magical rituals and beliefs that are based around controlling nature through specific actions; when in reality there is no cause and effect between them. Hence, pareidolia: the seeing of patterns in random, complex or ambiguous data where there are no patterns, and that these misperceived correlations form the basis of superstitious, magical and religious behaviour.
Idols of the marketplace: "the power of mere words to induce belief in nonexistent things"44. Charisma, confidence and enthusiasm are three things that lead us to believe what someone is telling us, even though word of mouth is the poorest method to propagate fact.
Idols of the theatre: "unquestioning acceptance of philosophical beliefs and misleading demonstrations"44. The lack of doubt we have in our own opinions; something I broadly address in "Why Question Beliefs? Dangers of Placing Ideas Beyond Doubt, and Advantages of Freethought" by Vexen Crabtree (2009) and "Satan Represents Doubt: Satanic Epistemology" by Vexen Crabtree (2002).
Francis Bacon is cited by many as one of the important founders of the general idea of the scientific method, which is largely concerned with overcoming errors in human thought and perception.
“Unless we recognize these sources of systematic distortion and make sufficient adjustments for them, we will surely end up believing some things that just aren't so.”
Thomas Gilovich (1991)45
The awesome scientist and public educator, Carl Sagan, defends the general American public by explaining that they are not lacking in intelligence but in the correct ways of applying it. Although general thinking errors lead to false conclusions about reality, the fact that people construct viable-seeming internal theories to explain events is itself a sign of intelligence. What is missing are the methods of telling good theories from bad ones. Sagan says:
“Both Barnum and H.L. Mencken are said to have made the depressing observation that no one ever lost money by underestimating the intelligence of the American public. The remark has worldwide application. But the lack is not intelligence, which is in plentiful supply; rather, the scarce commodity is systematic training in critical thinking.”
Carl Sagan (1979)46
Prof. Bono47 who we saw earlier commenting on the negative effects of complexity on accurate thought, produced a book that endeavoured to offer some training in how to think in a structured and methodical way. He named the critical aspect black hat thinking. He found that even with a little training, people's abilities in brainstorming and analysis increase manifold. Likewise in "Thinking, Fast and Slow" by Daniel Kahneman (2011)48 the author explains how slow, deliberate and organized thinking on a subject is one of the greatest ways to overcome the errors introduced by the instinctual fast thinking which has given us great evolutionary advantage, but, which of course introduces many errors to how we perceive and rationalize things. Finally, psychologist Jonah Lehrer in The Decisive Moment: How the Brain Makes Up Its Mind teaches that we must encourage ourselves to face "inner dissonance" and think about the information we don't want to think about, and "pay attention to the data that disturbs our entrenched beliefs"49.
Unfortunately, we do not have time to analyse every one of our beliefs with a careful skeptical analysis. It is practically impossible. We have instincts to only analyse new information critically, but re-training our thoughts on existing data is very hard. Also, because knowledge is highly specialized, we simply can never know enough to skeptically analyze everything that perhaps we should. An article in Skeptical Inquirer bemourns these facts:
“We all have limitations and built-in biases that hinder our ability to apply the methods of skepticism objectively and consistently. Nonskeptics and professed skeptics alike are equally vulnerable to developing beliefs that have not been subjected to rigorous skeptical inquiry. [...] This is because (a) we do not have time to evaluate every claim that becomes part of our belief system and may rely upon what is commonly believed or what we would like to be true ; (b) we are more likely to perform a skeptical evaluation for claims that are inconsistent with our current belief systems [...] while simply accepting claims consistent with our beliefs [...]; (c) many beliefs are already formed and reinforced prior to learning how to think skeptically; (d) some beliefs are formed based primarily upon an emotional evaluation; and (e) skeptics have limited areas of expertise (.e.g., a biologist may know little about economics), which restricts our ability to skeptically evaluate all potential claims because knowledge is extremely specialized.”
Todd C. Riniolo & Lee Nisbet (2007)50
To overcome these personal difficulties, we need to reach rational conclusions in groups. So, scientific institutions that specialize in specific subjects are trusted in their pronouncements on those subjects, and authority is granted to subject matter experts who have proven qualifications in those fields, as long as their assertions are not being accepted for peer review. You will see that creates a requirement for a whole arena of checks, publications, verifications and a technical management of papers. This careful and cautious process by which we, in groups, formulate theories about the world and put them to the test, in order to minimize human error, is called science, and as formulated technically, as the scientific method, about which I have a separate text:
“Thankfully, the scientific method is all about eliminating human errors. Most of us like to learn from the things that other people tell us (anecdotes), but this isn't good enough for science, "even if the anecdotes number in the millions and even if the storytellers are Nobel Prize-winning anointed saints"51. Ideas have to be tested statistically and in a way where systemic human error can be controlled for and eliminated. The procedures of peer review and independent verification both ensure that mistakes in theory, application or analysis of data are spotted when other scientists examine and repeat the experiment. Competing theories will have proponents that actively do not want new information threatening their own theory, so will actively seek out weakspots in new experiments. Many scientific publications report on the failures of data and experiments, and in the face of this, science self-regulates in a very efficient and detailed manner. "The essence of science is that it is self-correcting" says the eminent scientist Carl Sagan, "new experimental results and novel ideas are continually resolving old mysteries" (1995)52.
Sometimes, then, individual experiments are found to be faulty. Sometimes, the conclusions of the scientist are questioned even if the data is good. And sometimes, rarest of all, entire scientific paradigms are questioned such as when Newtonian physics gave way to Einstein. New evidence can cause entire theoretical frameworks to be undermined, resulting in a scientific revolution in understanding.”
Although we have arrived at sensible mechanisms for overcoming individual cognitive bias, science, a new problem thus emerges. Multiple institutions and organisations all clamour for space in trying to sell their truths. It is not just that the specialisation of knowledge requires the existence professional organisations to pronounce on technical matters, but, all non-specialists still need to know which specialists to trust on which subjects. Given that scientific English can be hard to comprehend too, many rely on news services and mass media products for their information. We end up with a situation where the main obstacle for the discovery of truth is in the politics and sociology of the passage of accurate information, in a globalised world full to the brim with broadcasters and public conversations.
Researchers who have examined which sciences and disciplines best prepare people for the interpretation of everyday evidence have found that teaching and working in the social sciences best fosters reasonable-thinking.
“It appears that the probabilistic sciences of psychology and medicine teach their students to apply statistical and methodological rules to both scientific and everyday-life problems, whereas the nonprobabalistic science of chemistry and the nonscientific discipline of the law do not affect their students in these respects. [Lehman, Lempert & Nibett]
It seems, then, that social scientists may have a special opportunity to impart some wisdom about how to properly evaluate the evidence of everyday experience. The authors of the study just described argue that there are certain formal properties of the subject matter of social science (e.g., considerable irregularity and uncertainty, the relative lack of necessary and sufficient causal relations) that make it particularly effective for teaching some important principles of sound reasoning.
Social scientists are generally more familiar than those in other fields with how easy it is to be misled by the evidence of everyday experience, and they are more aware of the methodological controls that are necessary before one can draw firm conclusions from a set of data.”
"How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life"
Thomas Gilovich (1991)53
We all suffer from systematic cognitive dysfunctions; they infuse the very way we notice and analyse data, and distort our forming of conclusions. Emotional and societal factors influence our thinking much more than we like to admit. Our expectations and recent experiences change the way we recall memories. Even our very perceptions are effected by pre-conscious cognitive factors; what we see, feel, taste and hear are all subject to interpretation before we are even aware of them. Our brains were never meant to be the cool, rational, mathematical-logical computers that we like to sometimes pretend them to be.
We can take preventative steps. Learning to think skeptically and carefully and to recognize that our very experiences and perceptions can be coloured by societal and subconscious factors should help us to maintain our cool. Beliefs should not be taken lightly, and evidence should be cross-checked. This especially applies to "common-sense" facts that we learn from others by word of mouth and traditional knowledge. Above all, however, our most important tool is knowing what types of cognitive errors we, as a species, are prone to making.
The Economist. Published by The Economist Group, Ltd. A weekly newspaper in magazine format, famed for its accuracy, wide scope and intelligent content. See vexen.co.uk/references.html#Economist for some commentary on this source.
Skeptical Inquirer. Pro-science magazine published bimonthly by the Committee for Skeptical Inquiry, New York, USA.
Anderson & Kellam
(1992). In Riniolo & Nisbet Skeptical Inquirer (2007 May/Jun p49-53). Todd C. Riniolo is Associate Professor of Psychology at Medaille College (Buffalo, New York). Lee Nisbet is Professor of Philosophy at Medaille College and a founding member and Fellow of the Committee for Skeptical Inquiry.
Carroll, Robert Todd. Taught philosophy at Sacramento City College from 1977 until retirement in 2007. Created The Skeptic's Dictionary in 1994.
(2003) The Skeptic's Dictionary. Published by John Wiley & Sons, New Jersey, USA.
(2011) Unnatural Acts: Critical Thinking, Skepticism, and Science Exposed!. Kindle edition. Published by the James Randi Educational Foundation.
(2004) Research Methods and Statistics in Psychology. Fourth edition. Published by Hodder Headline, London, UK.
(2002) "Experiences of God are Illusions, Derived from Malfunctioning Psychological Processes" (2002). Accessed 2016 Sep 12.
(2008) "The False and Conflicting Experiences of Mankind: How Other Peoples' Experience Contradict Our Own Beliefs" (2008). Accessed 2016 Sep 12.
(2009) "General Neophobia in Everyday Life: Humankind's Fear of Progress and Change" (2009). Accessed 2016 Sep 12.
(2013) "What Causes Religion and Superstitions?" (2013). Accessed 2016 Sep 12.
(2014) "What is Science and the Scientific Method?" (2014). Accessed 2016 Sep 12.
D. R. Lehman, R. O. Lempert, & R. E. Nisbett
(1988) The effects of graduate training on reasoning: Formal discipline and thinking about everyday-life events. American Psychologist, 43, 431-42. In Gilovich (1991) p191-192.
(1990) The interplay of affect and cognition in attitude formation and change. Journal of Personality and Social Psychology 59: 202-216. In Riniolo & Nisbet Skeptical Inquirer (2007 May/Jun p49-53). Todd C. Riniolo is Associate Professor of Psychology at Medaille College (Buffalo, New York). Lee Nisbet is Professor of Philosophy at Medaille College and a founding member and Fellow of the Committee for Skeptical Inquiry.
Eysenck, Michael and Keane, Mark
(1995) Cognitive Psychology. 3rd edition. Published by Psychology Press, Hove, UK.
(1991) How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life. 1993 paperback edition published by The Free Press, NY, USA.
(1996) Psychology: The Science of Mind and Behaviour. 3rd edition. Published by Hodder & Stoughton, London UK.
(2006) The End of Faith: Religion, Terror and the Future of Reason. 2006 edition. Published in UK by The Great Free Press, 2005.
(2011) Thinking, Fast and Slow. Published by Farrar, Strauss and Giroux; New York, USA.
(2009) The Decisive Moment: How the Brain Makes Up Its Mind. Hardback. Published by Canongate Books, Edinburgh.
(1999) Social Psychology. 6th 'international' edition. First edition 1983. Published by McGraw Hill.
Russell, Bertrand. (1872-1970)
(1946) History of Western Philosophy. Quotes from 2000 edition published by Routledge, London, UK.
(1995) Cosmos. Originally published 1981 by McDonald & Co. This edition published by Abacus.
Sharps, Matthew J.
(2012) "Eyewitness to the Paranormal: The Experimental Psychology of the 'Unexplained'" in Skeptical Inquirer (2012 Jul/Aug) p39.
Toates, Romero & Datta
(2004) From Cells to Consciousness. A neurology textbook by Frederick Toates, Ignacio Romero and Saroj Datta. Published by The Open University, Milton Keynes, UK.