Within Utts Review
When Significant Numbers Still Fall Short
A significant result can flag an unusual pattern without proving that remote viewing caused it.
On this page
- What statistical significance actually says
- Why Utts treated the pattern as evidence
- Why critics said the cause remained unproven
Page outline Jump by section
Introduction
One of the most persistent misunderstandings in the remote-viewing debate is the assumption that a statistically significant result automatically proves psychic ability. It does not. Statistical significance answers a much narrower question: whether an observed pattern is unlikely to have arisen by chance under a specified statistical model. It does not identify the cause of that pattern, nor does it eliminate every alternative explanation.
This distinction lay at the heart of the disagreement between statistician Jessica Utts and psychologist Ray Hyman during the 1995 American Institutes for Research (AIR) review of the U.S. government’s remote-viewing programme. Both accepted that some later laboratory experiments produced results above chance. Their disagreement centred on what those results meant. Utts regarded the repeated statistical departures from chance as evidence that an unexplained information-gathering process existed. Hyman argued that the same numbers did not justify concluding that psychic functioning had been demonstrated because statistical evidence alone cannot establish causation.[National Security Archive]nsarchive2.gwu.edudoc 57Jessica Utts. Division of Statistics. University of California, Davis. Ray Hyman's report…Read more…
What Statistical Significance Actually Says
Statistical significance is often expressed through a p-value. In simple terms, it estimates how surprising the observed results would be if there were genuinely no effect. A small p-value suggests that random chance alone is an unlikely explanation.
That conclusion, however, is limited. A statistically significant outcome does not mean:
- the proposed explanation is true;
- competing explanations have been eliminated;
- the effect is practically useful;
- future experiments will necessarily obtain the same result.
Instead, statistical significance merely indicates that the observed data deserve explanation.
This distinction is routine across science. A significant association between smoking and disease, for example, did not by itself prove biological causation; researchers also required mechanistic evidence, dose-response relationships, replication across populations, and the exclusion of plausible confounding factors. Likewise, a statistically significant laboratory result in remote-viewing research would require additional evidence before supporting the much stronger claim that information had been acquired through paranormal means.[National Security Archive]nsarchive2.gwu.edudoc 57Jessica Utts. Division of Statistics. University of California, Davis. Ray Hyman's report…Read more…
Why Utts Treated the Pattern as Evidence
Jessica Utts approached the remote-viewing database primarily as a statistician rather than as someone expecting spectacular individual demonstrations.
Her reasoning was cumulative. She argued that repeated above-chance performance across multiple experiments, particularly the later SAIC studies with stronger controls, reduced the likelihood that random variation alone explained the findings. She emphasised average performance across many trials rather than judging the phenomenon by dramatic individual successes or failures.
Crucially, Utts did not argue that every session succeeded or that remote viewing had become an operational intelligence tool. Instead, she maintained that the statistical evidence supported the existence of an anomalous effect whose mechanism remained unknown. In her view, science often accepts weak but consistent effects before fully understanding their underlying causes.[National Security Archive]nsarchive2.gwu.edudoc 57Jessica Utts. Division of Statistics. University of California, Davis. Ray Hyman's report…Read more…
This reasoning reflects a familiar statistical principle: a noisy phenomenon may still produce a detectable average effect when enough properly controlled observations are combined. Utts believed the remote-viewing database had crossed that evidential threshold.
Why Critics Said the Cause Remained Unproven
Ray Hyman’s disagreement was not primarily about arithmetic. He largely accepted that the later experiments deserved serious attention and that many earlier methodological flaws had been reduced.
His objection concerned inference.
From Hyman’s perspective, demonstrating an unusual statistical pattern is fundamentally different from demonstrating psychic perception. Between those two conclusions lie several possibilities:
- subtle experimental artefacts;
- unconscious information leakage;
- judging biases;
- selective reporting;
- unknown methodological weaknesses;
- ordinary psychological processes not fully recognised by investigators.
Because no accepted theory explained how psychic information transfer would occur, Hyman argued that researchers could not confidently specify which alternative explanations had truly been excluded. A statistically significant deviation from chance therefore remained evidence requiring explanation rather than proof of paranormal functioning.[UC Irvine Bren School]ics.uci.eduUC Irvine Bren SchoolEvaluation of Program on Anomalous Mental PhenomenaToday, the parapsychologists offer us the ganzfeld experiments an…
This reflects a broader scientific principle: rejecting one hypothesis does not automatically confirm another. Showing that “chance alone” is unlikely is not equivalent to proving that “psychic ability” is the correct explanation.
Why Statistical Evidence and Causal Proof Are Different
The disagreement illustrates a common confusion between detecting an effect and identifying its cause.
A statistically significant result establishes that a model based solely on chance may fit the data poorly. It does not specify why.
To move from statistical anomaly to causal claim, scientists normally look for converging lines of evidence, including:
- successful independent replication across multiple laboratories;
- rigorous elimination of conventional explanations;
- stable effects under varying experimental conditions;
- theoretical coherence with established scientific knowledge, or exceptionally strong evidence if existing theory must be revised.
Remote-viewing research has struggled particularly with the last three criteria. Even researchers sympathetic to anomalous cognition have acknowledged that effect sizes tend to be modest, experimental outcomes vary, and proposed mechanisms remain speculative. Critics argue that these limitations prevent statistical findings from carrying the much larger burden of proving psychic functioning.[PMC+2Frontiers]pmc.ncbi.nlm.nih.govPMCFollow‐up on the U.SCentral Intelligence Agency's (CIA…by Á Escolà‐Gascón · 2023 · Cited by 10 — Numerous experiments on anomalous cognitions have yielded…
Why This Distinction Still Shapes the Debate
The AIR review did not produce a simple disagreement over numbers. Instead, it highlighted two different philosophies of scientific inference.
Utts interpreted the accumulated statistical evidence as sufficiently consistent to infer that an anomalous phenomenon probably existed, even if its mechanism remained unknown. Hyman maintained that extraordinary causal claims require more than repeated statistical deviations from chance, especially when no independently established mechanism exists and alternative explanations remain plausible.[National Security Archive]nsarchive2.gwu.edudoc 57Jessica Utts. Division of Statistics. University of California, Davis. Ray Hyman's report…Read more…
That distinction explains why discussions of remote viewing often appear to reach opposite conclusions while relying on many of the same experimental results. The dispute has rarely been over whether certain laboratory studies produced statistically significant findings. It has been over whether those findings justify the far stronger conclusion that psychic perception has been demonstrated.
Amazon book picks
Further Reading
Books and field guides related to When Significant Numbers Still Fall Short. Use these as the next step if you want deeper reading beyond the article.
Statistics Done Wrong
Explains why statistical significance does not establish causation or proof.
The Men Who Stare At Goats
Rating: 3.5/5 from 11 Google Books ratings
Provides broader military context.
The cult of statistical significance
First published 2008. Subjects: Statistical methods, Statistical hypothesis testing, Social aspects, Economics, Social aspects of Statist...
eBay marketplace picks
Marketplace Samples
Live-tested eBay searches with available results related to this page.
Endnotes
1.
Source: nsarchive2.gwu.edu
Title: doc 57
Link:https://nsarchive2.gwu.edu/NSAEBB/NSAEBB438/docs/doc_57.pdf
Source snippet
Jessica Utts. Division of [Statistics]({{ 'statistics/' | relative_url }}). University of California, Davis. Ray Hyman's report...Read more...
2.
Source: ics.uci.edu
Link:https://www.ics.uci.edu/~jutts/hyman.html
Source snippet
UC Irvine Bren SchoolEvaluation of Program on Anomalous Mental PhenomenaToday, the parapsychologists offer us the [ganzfeld]({{ 'ganzfeld/' | relative_url }}) experiments an...
3.
Source: pmc.ncbi.nlm.nih.gov
Title: PMCFollow‐up on the U.S
Link:https://pmc.ncbi.nlm.nih.gov/articles/PMC10275521/
Source snippet
Central Intelligence Agency's (CIA...by Á Escolà‐Gascón · 2023 · Cited by 10 — Numerous experiments on anomalous cognitions have yielded...
4.
Source: frontiersin.org
Link:https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2020.562992/pdf
Source snippet
The Replicability Crisis, the Psi Paradox and the Myth of...by T Rabeyron · 2020 · Cited by 58 — The replicability crisis in psychology...
5.
Source: psi-encyclopedia.spr.ac.uk
Title: spr.ac.uk Remote Viewing
Link:https://psi-encyclopedia.spr.ac.uk/articles/remote-viewing/
Source snippet
Viewing - Psi Encyclopedia13 Jan 2017 — Jessica Utts judged the evidence persuasive, and even Ray Hyman conceded methodological criticism...
6.
Source: Wikipedia
Title: Remote viewing
Link:https://en.wikipedia.org/wiki/Remote_viewing
Source snippet
Remote viewingReviewers included Ray Hyman and Jessica Utts. Utts maintained that there had been a statistically significant positive...
7.
Source: youtube.com
Title: Statistics in Parapsychology with Jessica Utts
Link:https://www.youtube.com/watch?v=WmYGtKB9EEA
Source snippet
Ray Hyman - The Life of an Expert Skeptic, Part 1...
8.
Source: youtube.com
Title: Ray Hyman
Link:https://www.youtube.com/watch?v=-8VAOzcXGc4
Source snippet
Feeling The Future: Is ESP real (according to science)?...
Additional References
9.
Source: cia.gov
Link:https://www.cia.gov/readingroom/docs/CIA-RDP96-00791R000200180006-4.pdf
Source snippet
AN EVALUATION OF REMOTE VIEWINGJessica Utis, a Professor of. Statistics at the University of California/Davis, and Dr. Raymond Hyman, a P...
10.
Source: reddit.com
Link:https://www.reddit.com/r/HighStrangeness/comments/vv3020/dr_jessica_utts_is_convinced_that_psychic/
Source snippet
Dr Jessica Utts is convinced that psychic abilities are realDr Jessica Utts is a well-respected statistician who is convinced that psychi...
11.
Source: cia.gov
Link:https://www.cia.gov/readingroom/docs/CIA-RDP96-00791R000200180005-5.pdf
Source snippet
profit, private research organization, consisted of two main...Read more...
12.
Source: researchgate.net
Title: An Assessment of the Evidence for Psychic Functioning
Link:https://www.researchgate.net/publication/333228024_An_Assessment_of_the_Evidence_for_Psychic_Functioning
Source snippet
Besides the ganzfield, the most prominent psi [protocol]({{ 'protocol/' | relative_url }}) is "remote viewing." As described by Utts (2019) -in a 1995 report for the US Cong...
13.
Source: slideshare.net
Link:https://www.slideshare.net/slideshow/an-evaluation-of-remote-viewing-research-and-applications-air1995pdf/257460594
Source snippet
atory research, it was unclear if this was due to paranormal ability.Read more...
14.
Source: ucdavis.edu
Title: [psychic spying]({{ ‘psychic-spying/’ | relative_url }}) research produces credible evidence
Link:https://www.ucdavis.edu/news/psychic-spying-research-produces-credible-evidence
Source snippet
'Psychic Spying' Research Produces Credible Evidence28 Nov 1995 — Hyman thinks the research should be designed to offer unequivocal proof...
15.
Source: reddit.com
Title: the complete skeptics guide to remote viewing how
Link:https://www.reddit.com/r/remoteviewing/comments/1501do7/the_complete_skeptics_guide_to_remote_viewing_how/
Source snippet
The Complete Skeptic's Guide to Remote Viewing (How...The 1995 report on remote viewing and its application for intelligence agencies ne...
16.
Source: researchgate.net
Link:https://www.researchgate.net/publication/267978941Evaluation_of_Program_on%27Anomalous_Mental_Phenomena%27
Source snippet
g and related phenomena which was carried out at Stanford Re-search...
17.
Source: e-space.mmu.ac.uk
Title: Manuscript Symplectic system Explore
Link:https://e-space.mmu.ac.uk/632411/3/Manuscript_Symplectic_system_Explore.pdf
Source snippet
on Escolà-Gascón et al.'s (2023) remote viewing...by Á Escolà-Gascón · 2024 · Cited by 1 — In both reports the researchers reached diffe...
18.
Source: jeksite.org
Title: Why is Psi so Elusive?
Link:https://jeksite.org/psi/jp01.htm
Source snippet
A Review and Proposed Modelby JE Kennedy · Cited by 69 — The usual argument that the low reliability of psi results is due to poor statis...
Topic Tree