Why the published record is skewed
Not every study that is run ends up in a journal. Trials that find a positive, exciting result are more likely to be written up, submitted, and accepted than trials that find nothing. This is publication bias (sometimes called the file-drawer problem), and it means the studies you can easily find tend to overstate how well something works [1].
Funding and sponsorship bias
Who pays for a study can shape its design, analysis, and reporting. Across many fields, industry-funded trials are more likely to report conclusions that favor the sponsor's product than independently funded ones. That does not make every sponsored study wrong — but it is a reason to read the funding disclosure and weigh independent replication more heavily [1].
How these biases inflate supplement claims
- A brand can fund several small studies and publicize only the flattering one.
- A meta-analysis built only on published trials inherits their optimism.
- 'Statistically significant' subgroup results are easier to publish than honest null findings.
The net effect is that early enthusiasm often fades as larger, independent, pre-registered trials arrive — a pattern researchers see again and again.
How to protect yourself
- Check who funded it. Look for a funding/conflict-of-interest statement.
- Prefer independent replication. One company-funded study is weaker than several independent ones that agree.
- Value systematic reviews that look for missing data. Good reviews test for publication bias (for example, with funnel plots) and search trial registries for unpublished results.
- Be skeptical of 'too clean' stories. Real evidence is usually mixed; a flawless run of positive press is a flag, not a guarantee.
NCCIH's research-literacy guidance emphasizes exactly this: judge the whole body of evidence, including what might be missing, rather than the single study in front of you [2].