Is your data a fluke or a fact? The math of 'unlikely'.
In short: In statistics, we often start by assuming nothing interesting is happening. This is the Null Hypothesis. To prove otherwise, we use a p-value—a mathematical threshold that determines if our results are a genuine discovery or just a random coincidence. It is the gatekeeper of scientific certainty.
Null Hypothesis Significance Testing (NHST) is a framework where we begin by assuming there is no difference between two sets of information. We then calculate a p-value to see if our observed data is sufficiently rare to justify rejecting that initial assumption. A p-value represents the probability of observing a test statistic as extreme as, or more extreme than, the one we found, assuming the null hypothesis is actually true.
To make a decision, researchers set a significance level, known as alpha (α). This represents the maximum risk they are willing to take of making a Type I error—falsely rejecting a true null hypothesis. For example, if α is set at 0.05, we only reject the null hypothesis if the p-value is less than 0.05. In a study of 15 mathematics students where the test statistic was 2.5, a p-value of 0.0127 would be considered statistically significant at the 0.05 level, but not at the stricter 0.01 level.
The interpretation changes based on the 'tails' of the test. A right-tailed test looks for values greater than a mean, while a two-tailed test accounts for differences in either direction. In a two-tailed test, the p-value is exactly double the p-value of a one-tailed test because it accounts for both extremes. Crucially, a p-value tells us if a result is statistically significant, but it does not automatically mean the finding is practically meaningful or important in a real-world context.
Opens the Intellect+ feed with this card first. Swipe up for the next one.
Sources
- Summary by Intellect · source: How P-Values Help Us Test Hypotheses: Crash Course Statistics #21
- Also: S.3.2 Hypothesis Testing (P-Value Approach) | STAT ONLINE
To cite this card, link to https://intellectplus.co.uk/app/ideas-how-p-values-help-us-test-hypotheses.
How we source, check and correct cards: Editorial standards.
General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.
Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?
Related
More in Statistics · More in Ideas & Philosophy · Latest · A–Z · All topics
