When Does a Hit Become Proof?

Introduction

A recurring claim in the remote-viewing debate is that some experiments produce results that are statistically better than chance. That observation is important, but it is not the same as proving that information travelled by paranormal means. Statistics can show that a pattern is unlikely to have arisen from random guessing under a particular experimental design, yet they cannot, on their own, identify the mechanism responsible for that pattern. This distinction explains why the same data can leave believers encouraged, sceptics unconvinced, and many researchers somewhere in between. The central question is therefore not whether above-chance results exist, but whether those results rule out ordinary explanations strongly enough to justify concluding that remote viewing has been demonstrated.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

What above-chance results actually show

When researchers report that remote-viewing performance is “above chance”, they are making a statistical claim rather than a paranormal one. In a typical experiment, participants attempt to describe a hidden target, and independent judging methods are used to compare those descriptions with several possible targets. If participants consistently score better than expected under random guessing, statistical tests can estimate how unlikely that outcome would be if chance alone were operating.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

This is precisely the point made by statistician Jessica Utts during the 1995 review of the U.S. government’s remote-viewing programme. She argued that later experiments showed statistically significant deviations from chance and that the evidence justified taking the phenomenon seriously. Importantly, however, even her position distinguished between detecting an unexplained statistical effect and fully explaining its cause.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

More recently, a 2023 systematic review and meta-analysis reported an overall positive effect across dozens of studies, estimating average performance above chance and arguing that publication bias did not fully explain the findings. From the perspective of proponents, these analyses suggest that the statistical signal deserves continued investigation rather than dismissal.[ResearchGate]researchgate.net369604750 Remote Viewing a 1974 2022 systematic review and meta analysisResearchGate(PDF) Remote Viewing: a 1974-2022 systematic review…March 20, 2023 — This is the first meta-analysis of all studies relate…Published: March 20, 2023

Why small effects need stronger explanations

A modest statistical effect does not automatically establish a paranormal mechanism because many different processes can produce small departures from chance.

One issue is that statistical significance says little about practical importance. An experiment can produce a mathematically significant result while the actual improvement over guessing remains too small or inconsistent to support dependable real-world use. This became a major issue in evaluating the U.S. government’s operational programme: even reviewers who acknowledged interesting research findings concluded that the evidence had not demonstrated intelligence value sufficient for operational decision-making.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

Another problem is that statistical analyses cannot distinguish among competing explanations without additional evidence. Even if fraud and obvious sensory leakage are ruled out, researchers must still consider possibilities such as:

Each possibility may contribute only a small amount, yet several small biases acting together can create an apparent effect that no single flaw would explain on its own. This is why methodological scrutiny often continues long after a statistically significant result has been reported.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

Replication also matters. A genuine phenomenon should produce predictable results across different laboratories, investigators and protocols. Remote-viewing research contains positive studies, null studies and varying experimental designs, making it difficult to determine whether the observed effects reflect a stable underlying phenomenon or context-dependent influences. Even supportive researchers increasingly recommend preregistration, open data and independent replication to reduce uncertainty.[ResearchGate]researchgate.net369604750 Remote Viewing a 1974 2022 systematic review and meta analysisResearchGate(PDF) Remote Viewing: a 1974-2022 systematic review…March 20, 2023 — This is the first meta-analysis of all studies relate…Published: March 20, 2023

How believers and sceptics read the same numbers

One reason the debate has endured is that both sides often accept the numerical results while disagreeing about what those numbers mean.

Believers tend to argue that persistent above-chance outcomes are exactly how a weak but genuine human ability would appear. They note that later studies introduced stronger controls than many early experiments and argue that the remaining statistical signal cannot easily be dismissed as poor methodology. From this perspective, the burden shifts towards explaining the anomaly rather than denying it exists.[ResearchGate]researchgate.net369604750 Remote Viewing a 1974 2022 systematic review and meta analysisResearchGate(PDF) Remote Viewing: a 1974-2022 systematic review…March 20, 2023 — This is the first meta-analysis of all studies relate…Published: March 20, 2023

Sceptics reach a different conclusion. Ray Hyman accepted that some later studies appeared methodologically stronger than earlier work but argued that statistical significance alone could not justify concluding that extrasensory perception had been established. He emphasised that extraordinary claims require explanations capable of excluding ordinary sources of error, subjective interpretation and hidden bias with exceptional confidence.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

This disagreement illustrates an important principle of scientific reasoning: identical statistical evidence can support different conclusions depending on how much weight researchers assign to prior plausibility, methodological uncertainty and the possibility of unknown sources of bias.

When does a statistical hit become convincing?

Most areas of science demand more than a single statistically significant result before accepting an unexpected claim. Researchers typically look for several reinforcing forms of evidence:

Remote viewing has accumulated some evidence in the first category—reported statistical deviations from chance—but has struggled to satisfy all of these criteria simultaneously. That imbalance explains why the literature continues to generate debate rather than consensus.[National Security Archive]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

The middle position

The most cautious interpretation neither dismisses every positive result nor treats statistical significance as proof of paranormal information transfer.

Above-chance performance can reasonably be viewed as an empirical observation worthy of investigation. However, observations alone do not establish the mechanism producing them. In remote viewing, the leap from “there appears to be a statistical anomaly” to “people can obtain information through psychic means” remains the disputed step. Until that gap is bridged by consistently replicated evidence that excludes ordinary explanations to the satisfaction of the wider scientific community, statistical hits will remain intriguing but insufficient to settle the question.[National Security Archive+2CIA]nsarchive2.gwu.eduIn her position paper "Replication and meta-analysis.Read moreNational Security ArchiveAn Evaluation of Remote Viewing: Research and…March 13, 2015 — by MD Mumford · 1995 · Cited by 76 — Utts and…Published: March 13, 2015

Amazon book picks

Further Reading

Books and field guides related to When Does a Hit Become Proof?. Use these as the next step if you want deeper reading beyond the article.

Book

The Demon-Haunted World

By Carl Sagan

Directly supports the distinction between unusual results and justified extraordinary conclusions.

See on Amazon

Book

Thinking, Fast and Slow

By Daniel Kahneman

Explains judgment under uncertainty and why people read the same numbers differently.

See on Amazon

Book

Phenomena

By Annie Jacobsen

Connects laboratory findings, official programmes and disputes over what the evidence proves.

See on Amazon

Book

How We Know What Isn't So

By Thomas Gilovich

Rating: 4.0/5 from 6 Google Books ratings

Covers chance, patterns and reasoning mistakes central to assessing statistical hits.

See on Amazon

Browse more on Amazon:The Demon Haunted WorldThinking, Fast and SlowPhenomena

As an Amazon Associate I earn from qualifying purchases.

eBay marketplace picks

Marketplace Samples

Live-tested eBay searches with available results related to this page.

Shop location

UsingUSA USA USAUKCanadaAustraliaIreland

Example eBay listing

CCTV Camera Outdoor Home Security System Wired 8MP 4K DVR CCTV Kit Remote View

SearcheBay.co.uk: remote viewing kit

Browse similar oneBay.co.uk

Example eBay listing

JOINLGO 10" Touch Screen 4CH GPS WIFI Truck DVR Mini Camera Kit APP Remote View

SearcheBay.co.uk: remote viewing kit

Browse similar oneBay.co.uk

Example eBay listing

Tevion Vision Digital Satelite Kit Free View Remote Control

SearcheBay.co.uk: remote viewing kit

Browse similar oneBay.co.uk

Browse more oneBay.co.uk

Example items shown for inspiration; availability and pricing can change. Branchoria may earn a commission if you purchase through outbound eBay links.

Endnotes

1. Source: cia.gov
Link:https://www.cia.gov/readingroom/docs/CIA-RDP96-00791R000200180005-5.pdf

2. Source: researchgate.net
Title: 369604750 Remote Viewing a 1974 2022 systematic review and meta analysis
Link:https://www.researchgate.net/publication/369604750_Remote_Viewing_a_1974-2022_systematic_review_and_meta-analysis

Published: March 20, 2023

3. Source: researchgate.net
Title: An Assessment of the Evidence for Psychic Functioning
Link:https://www.researchgate.net/publication/333228024_An_Assessment_of_the_Evidence_for_Psychic_Functioning

4. Source: nsarchive2.gwu.edu
Title: “ In her position paper “Replication and meta-analysis.Read more
Link:https://nsarchive2.gwu.edu/NSAEBB/NSAEBB438/docs/doc_57.pdf

Published: March 13, 2015

5. Source: ics.uci.edu
Link:https://www.ics.uci.edu/~jutts/may.pdf

6. Source: academia.edu
Title: Remote Viewing A 1974 2022 Systematic Review and Meta Analysis
Link:https://www.academia.edu/108445581/Remote_Viewing_A_1974_2022_Systematic_Review_and_Meta_Analysis

Additional References

7. Source: reddit.com
Link:https://www.reddit.com/r/remoteviewing/comments/1dazs09/creation_of_study_on_statistical_evidence_of/

8. Source: youtube.com
Title: [Stargate]({{ ‘stargate/’ | relative_url }}) Project: How Did the CIA Turn the Human Mind into a Weapon?
Link:https://www.youtube.com/watch?v=IDPlEXpzRoQ

9. Source: pmc.ncbi.nlm.nih.gov
Title: PMCFollow‐up on the U.S
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC10275521/

10. Source: psi-encyclopedia.spr.ac.uk
Title: Psi Encyclopedia Remote Viewing
Link:https://psi-encyclopedia.spr.ac.uk/articles/remote-viewing/

11. Source: arxiv.org
Link:https://arxiv.org/abs/1702.00556

12. Source: youtube.com
Title: Video Nugget: Skeptics of Remote Viewing with Lyn Buchanan
Link:https://www.youtube.com/watch?v=c4p4OS-LBm8

13. Source: youtube.com
Title: The Remote Viewing SCIENCE Nobody Talks About | Sean Hazlett
Link:https://www.youtube.com/watch?v=olNuOZKCdRQ

14. Source: youtube.com
Title: Statistics in Parapsychology with Jessica Utts
Link:https://www.youtube.com/watch?v=WmYGtKB9EEA

15. Source: youtube.com
Title: Remote Viewing and Statistical Validation
Link:https://www.youtube.com/watch?v=YrwAiU2g5RU