The Human Truth Foundation

To Turn a Hypothesis Into a Theory, It Must Be Tested

By Vexen Crabtree 2018


Comments:
FB, LJ

#knowledge #science #scientific_method

Science begins with evaluations of what might be true, given the existing evidence1 (a hypothesis)2. The implications of this idea are then compared to our existing knowledge, to see how well it fits3. Then, tests are devised to see if the new idea's predictions will match experimental results. If a hypothesis cannot be tested, then, it is not scientific4,5,6. If the hypothesis fails, then, it is wrong6. If it passes, then, it becomes (or supports) a theory. All science, no matter how durable, remains a theory until proven wrong2. This way, science comprises of a continual series of adjustments and improvements to theories as they are adapted to fit new evidence. Theories that cannot be adjusted are replaced by theories that fit the evidence better.


1. What is Science and the Scientific Method?

#epistemology #knowledge #science #truth

The "Scientific Method" is a set of steps taken to ensure that conclusions are reached sensibly, experiments designed carefully, data is interpreted in accordance with the results of tests, and that procedures can be verified independently. The system is designed to reduce as much Human error and bias as possible7. Ideas and theories must be subject to criticism, and counter-evidence must be taken into account in order to produce new and more accurate theories. Everything should be questioned. Most people cannot "do" science and do not have the skills to analyse data in an adequate manner8. The Scientific Method is hard and demanding, with high standards of ethical conduct expected - Daniel C. Dennett wrote that "good intentions and inspiration are simply not enough" (2007)9. The effects of science can impact on all human development, changing entire societies10. Science has been responsible for a staggering increase in human knowledge, human technology and human capabilities over the last few centuries.11

2. The Hypothesis

#knowledge #science #scientific_method

Science begins with evaluations of what might be true, given the existing evidence1. These evaluations are called hypotheses1 (plural). The implications of a new idea (a hypothesis) is then compared to our existing knowledge, to see how well it fits - E. O. Wilson describes this as the theory's consilience with our existing body of knowledge3. If it disagrees with multiple theories, especially long-standing ones, then it is very likely to be wrong and will be avoided by most scientists.

Often, a new hypothesis comes about as a result of anomalies or oddities discovered inadvertently during experiments or observations.

Book CoverScience starts, not from large assumptions but from particular facts discovered by observation or experiment. From a number of such facts a general rule is arrived at, of which, if it is true, the facts in questions are instances. This rule is not positively asserted, but is accepted, to begin with, as a working hypothesis. If it is correct, certain hitherto unobserved phenomenon will take place in certain circumstances. If it is found that they do take place, that so far confirms the hypothesis; if they do not, the hypothesis must be discarded and a new one must be invented.

"Religion and Science" by Bertrand Russell (1935)2

Richard Feynman, a Nobel-prize winning scientist, said:

In general, we look for a new law by the following process: First we guess it; then we compute the consequences of the guess to the result of the computation to nature, with experiment or experience [observation of the world], compare it directly with observation, to see if it works. If it disagrees with experiment, it is wrong.

Richard Feynman6

A hypothesis becomes a theory when it is tested experimentally without being falsified12 and it feeds into a larger logical framework. It can also gain support by making concrete predictions about the future, more accurately and more succinctly than other competing theories. If a hypothesis fails its tests, then, it is often rescued by making modifications and adjustments, and is then subjected to new tests.

The astrophysicist John Gribbin tells the story of the Big Bang Theory to illustrate this:

The weight of evidence tilted dramatically in favour of the Big Bang model in the mid-1960s, when the American astronomers Arno Penzias and Robert Wilson, testing a new radio telescope at Holmdel, New Jersey, discovered a weak hiss of radio noise, with a temperature just under 3 K, coming from all directions in space. They had no idea what it was, but it was quickly explained by theorists working at nearby Princeton University as leftover radiation from the Big Bang. And only then did everyone involved discover that this radiation had been predicted, two decades earlier, by Alpher and Herman. Nevertheless, in spite of the roundabout route, the story provides an almost perfect example of the scientific method at work. An idea, the Big Bang model, predicts a property of the Universe that has never been seen, and measurements then show that the Universe does have that property. So we can pinpoint 1965, the year the discovery of the background radiation was published, as the moment when the Big Bang model became elevated to the status of a theory – the best theory we have of how the Universe began.

"Before the Big Bang" by John Gribbin (2015)13

3. Falsification: All Hypotheses Must be Testable

#knowledge #questioning_beliefs #science #scientific_method

Theories, tested through particular hypotheses, must be disprovable. A theory must make it clear exactly what criteria would falsify it, and therefore, the theory must be testable4. Richard Dawkins defines all of science in terms of its testability: science is, he says, "defined as the set of practices which submit themselves to the ordeal of being tested"14.

The academic Karl Popper, is often cited as being the source of this requirement and it has become one of the most well-known 'rules' of scientific methodology. Karl Popper proclaimed the principal in Logik der Forschung in 1934, published in Vienna. He translated it into English as The Logic of Scientific Discovery in 1959, published in London. Professor Victor Stenger points out that Popper and Rudolf Carnap explored the same idea, Carnap in "Testability and Meaning" in Philosophy of Science (1936)15, therefore it appears that Popper is given undue credence as the sole purveyor of the idea by academics. However the science historian Patricia Fara states that Popper first voiced his falsification criteria as long ago as 1919 after observing a lecture by Einstein16. No matter the history, it is now a very well-established principal.

Falsification [is] the demarcation criterion proposed [...] as a means for distinguishable legitimate scientific models from nonscientific conjectures. [...] While failure to pass a required test is sufficient to falsify a model, the passing of the test is not sufficient to verify the model. This is because we have no way of knowing a priori that other, competing models might be found someday that lead to the same empirical consequences as the one tested.

"God, the Failed Hypothesis: How Science Shows That God Does Not Exist"
Prof. Victor J. Stenger (2007)5

Imagine a game of hangman, where a person must guess what word is being revealed but can only see so many of the word's letters. With the evidence available, the person can guess a word - this is his theory. The criteria by which he can be affirmed or proven wrong is through the revealing of new evidence. If a letter is revealed that does not fit his theory then the theory must instantly be discarded. So in science (where the world is almost infinitely complex), theories are much easier to deny than to ultimately confirm. To say that a theory is true you must wait until the very end of the game, until every letter is revealed. The only problem is, as new facts are continually discovered, it is hard to be sure that any future evidence won't suddenly falsify the theory; this is why some hold that all scientific models will always remain theories. To abandon this concept is to try to stop the flow of new discoveries!

4. How to Deal With Ideas that Go Against Scientific Knowledge

#pseudoscience #science #skepticism #thinking_errors

There is a well-established rule for hypotheses that contradict existing theories; the more of our existing knowledge it goes against, the more extra-ordinary the hypothesis is.

"Extraordinary claims require extraordinary evidence" was a phrase made popular by Carl Sagan [in the 1980s]. Its roots are much older, however, with the French mathematician Laplace stating that: "The weight of evidence for an extraordinary claim must be proportioned to its strangeness". Also, David Hume wrote in 1748: "A wise man ... proportions his belief to the evidence", and "No testimony is sufficient to establish a miracle, unless the testimony be of such a kind, that its falsehood would be more miraculous than the fact which it endeavors to establish".

RationalWiki (accessed2018 Dec 17)

Such radical hypotheses will need to be repeatedly proven, over and over, in front of various audiences, will need to pass independent verifications by independent groups, just the same as other hypotheses must. The exception is that in order displace existing theories, a new idea must be provably better, when tested. It is very rare that radically new and unexpected ideas manage to do this - in reality, most ideas that contradict a bulk of existing scientific knowledge are not only wrong, but misguided.

Because science thrives on new ideas, nonetheless, even crazy ideas are subjected to critical analysis and testing; the body of academics that engages most readily with such ideas are the skeptics, who are still willing to publicly engage in debating the craziest of ideas.

5. The Theory: The Building Block of Science

#knowledge #science #scientific_method

The building-block of science is the theory. New data results in new theories, and theories inspire experiments which are designed to test them... resulting in new data, which may then require new theories. This cyclic process propels science forwards. Any new theory must displace an old one, and each new theory therefore needs abundant evidence in its favour. No-one will abandon the standing theory without good reason.

New theories are first of all necessary when we encounter new facts which cannot be "explained" by existing theories.

"Ideas and Opinions" by Albert Einstein (1950)17

Richard Gross opens his prominent book "Psychology: The Science of Mind and Behaviour18" (1996), with some chapters on science, and offers the following as two major steps in scientific theory:

  1. Theory Construction, "an attempt to explain observed phenomena".
  2. Hypothesis Testing, involving "making specific predictions about behaviour under certain specified conditions".

The best thing about theories is that when new evidence comes to light, new theories arise to replace or modify the old ones.

You might notice that the theory is king: data without a supporting theory is all but useless. It can even be dangerous: If data leads a researcher to claim some radical new element of cause and effect, then, there has to be a valid underlying theoretical framework in addition to the data19. The lack of good theory can lead people far 'down the garden path', i.e., to false conclusions, and to have undue confidence in the data and their own interpretation of it.

6. Only a Theory?

A common criticism of the theories of evolution and of the big bang is that "they are only theories". However, many people misunderstand what the word "theory" means20. A scientific theory that explains the facts well is accepted; whereas one that doesn't is rejected. That something "is only a theory" does not affect whether it is accurate or not - a theory is not easy to dismiss20 unless it makes untrue predictions. The Theory of Gravity is "only a theory", as is the heliocentric theory of our solar system (i.e., that we all orbit the sun). A hypothesis supports a theory by passing particular tests, and a theory remains a theory until it comes to disagree with evidence. Then it is a failed theory.

However many facts are found to fit the hypothesis, that does not make it certain, although in the end it may come to be thought of in a high degree probable; in that case, it is called a theory rather than a hypothesis.

"Religion and Science" by Bertrand Russell (1935)2

7. How to Test a Hypothesis

"Science is nothing without experimentation"6. But how do you test a hypothesis? Using the scientific method. The steps of the testing process, such as peer review and independent verification, are fundamental parts of how you take a serious and careful approach to truth. Every stage is designed to spot errors so that the original hypothesis can be altered.

  1. To Turn a Hypothesis Into a Theory, It Must Be Tested
  2. Systematic Literature Review and Meta-Analysis - Overcoming Selection Bias
  3. Peer Review - Overcoming Poor Design and Poor Argumentation
  4. Reproducibility and Independent Verification of Results
  5. Occam's Razor: Simplicity & Fewer Assumptions are Better
  6. Randomized Double-Blind Trials
  7. Be Open to Criticism and Make Way for New Evidence

When test results are negative and theories are undermined by evidence, then, they must be improved or replaced.

See:

Current edition: 2018 Dec 18
Last Modified: 2019 Feb 01
http://www.humantruth.info/hypothesis_to_theory.html
Parent page: What is Science and the Scientific Method?

All #tags used on this page - click for more:

#epistemology #knowledge #pseudoscience #questioning_beliefs #science #scientific_method #skepticism #thinking_errors #truth

Social Media

References: (What's this?)

Book Cover

Book Cover

Book Cover

Book Cover

Book Cover

Book Cover

Skeptical Inquirer magazine. Published by Committee for Skeptical Inquiry, NY, USA. Pro-science magazine published bimonthly.

Bloom, Clive
(2001) Literature, Politics and Intellectual Crises in Britain Today. Published by Palgrave.

Coolican, Hugh
(2004) Research Methods and Statistics in Psychology. 4th edition. Published by Hodder Headline, London, UK.

Dawkins, Prof. Richard
(2004) A Devil's Chaplain. Originally published 2003 by Weidenfeld & Nicolson. Current version published by Phoenix of Orion Books Ltd, London UK. A paperback book.

Einstein, Albert. (1879-1955)
(1954) Ideas and Opinions. Published in 1954 by Crown Publishers, New York, USA and in 1982 by Three Rivers Press. A collection of Einstein's writings and texts. A paperback book.

Fara, Patricia
(2009) Science: A Four Thousand Year History. Published by Oxford University Press. Fara has a PhD in History of Science from London University. A hardback book.

Goldacre, Ben. MD.
(2008) Bad Science. Published by Fourth Estate, an imprint of HarperCollins Publishers, London, UK.

Gribbin, John
(2015) Before the Big Bang. Kindle Single. An e-book.

Gribbin, John and Gribbin, Mary
(2016) Science: A History in 100 Experiments. Published by William Collins Books, London, UK.. A hardback book.

Gross, Richard
(1996) Psychology: The Science of Mind and Behaviour. 3rd edition. Published by Hodder & Stoughton, London UK. A paperback book.

Hall, Harriet
(2009 May/Jun) Playing by the Rules. An Article in the magazine Skeptical Inquirer.

Russell, Bertrand. (1872-1970)
(1935) Religion and Science. 1997 edition. Published by Oxford University Press, Oxford, UK. Introduction by Michael Ruse. A paperback book.

Stenger, Prof. Victor J.
(2007) God, the Failed Hypothesis: How Science Shows That God Does Not Exist. Published by Prometheus Books, NY, USA. Stenger is a Nobel-prize winning physicist, and a skeptical philosopher whose research is strictly rational and evidence-based.

Wilson, E. O.
(1998) Consilience: The Unity of Knowledge. Published by Little, Brown and Company, London, UK. Professor Wilson is a groundbreaking sociobiologist. A hardback book.

Footnotes

  1. Gribbon & Gribbin (2016). Chapter "Introduction" p15.^^
  2. Russell (1935). p13-14.^^^
  3. Wilson (1998). p57.^^
  4. Coolican (2004). p15.^^
  5. Stenger (2007). p26.^^
  6. Gribbon & Gribbin (2016). Chapter "Introduction" p10.^^^
  7. Goldacre (2008). Chapter 13 "Why Clever People Believe Stupid Things" digital location 3570.^
  8. Ben Goldacre's Bad Evidence, BBC Radio 4 programme aired on 2013 Jan 01 at 2000hrs.^
  9. Dennett, Daniel C. from an essay that will be published 'later this year' in "Philosophers Without God" , preview in Skeptical Inquirer (2007 Mar/Apr) p44.^
  10. Bloom (2001). p165. He says 'Whilst the intellectual may work in a specific field, it is in the nature of his or her work to have implications for the whole field of knowledge'.^
  11. Hall (2009 May/Jun). p42-44.^
  12. Gribbon & Gribbin (2016). Chapter "Introduction" p12.^
  13. Gribbin (2015). Digital location 108.^
  14. Dawkins (2004). p210.^
  15. Stenger (2007). p26. He cites Philosophy of Science B 3 (1936): 19-21; B 4 (1937): 1-40.^
  16. Fara (2009). p301.^
  17. Einstein (1950) Scientific American Vol. 182, No. (1950 Apr 04). In Einstein (1954) p342.^
  18. Gross (1996) .^
  19. Coolican (2004). p333. Coolican adds that 'Researchers mostly have a background of theoretical argument and previous research findings that leads them to a reasonable argument for the effect they are expecting'.^
  20. Gribbon & Gribbin (2016). Chapter "Introduction" p13.^

©2019 Vexen Crabtree all rights reserved.
This site uses the HTF Disclaimer (as linked here)