Statistics and probability
180 cards. Each one is a 40-second story with a five-minute read behind it. Page 2 of 3.
How a simple grid of dots became the foundation of modern statistical analysisA scatter plot is more than just a collection of dots on a graph. By mapping two variables against Cartesian coordinates, this deceptively simple tool reveals hidden correlations,…
Statistical inference is the art of translating real-world problems into mathematical models.We often mistake data for truth, but statistical inference is the bridge between a small sample and the wider population. It is not just about crunching numbers; it is about the c…
Why this vintage statistical tool is still a masterclass in data transparencyBefore modern software rendered graphics effortless, statisticians relied on the stem-and-leaf display to visualize data distributions. Unlike histograms that bin information into…
Why your data might be lying to you if it follows a timelineA time series is more than just data in order; it is a sequence where the past dictates the present. While these patterns are essential for forecasting everything from stock marke…
Why perfect statistical certainty is impossible and how we manage the inevitable errorsIn statistics, every test carries a risk of being wrong. You either reject a true hypothesis, creating a false positive, or accept a false one, creating a false negative. Because …
How to uncover hidden truths from a sequence of noisy, observable data pointsWe often see the effects of events without witnessing the events themselves. The Viterbi algorithm is a mathematical powerhouse that reconstructs the most likely sequence of hidde…
The Wiener process is the invisible mathematical engine powering everything from finance to physics.Named after Norbert Wiener, this continuous-time stochastic process models random motion with uncanny precision. It is the backbone of the Black-Scholes option pricing model, quan…
Why testing one variable at a time might be a mistakeMost researchers test one factor at a time to see how it affects an outcome. However, this approach often misses the most critical discovery: how different factors interact with o…
Why some mathematical models cannot be solved in a single stepIn linear regression, we can often find the perfect answer instantly. But when relationships become non-linear, the math breaks. To find the truth, we must abandon the search for …
Stout began as a simple descriptor for strong beer before becoming a distinct style.The term stout once meant proud or brave, eventually evolving to signify strength in any beer. While today we associate it with dark, roasted flavours, the line between stout and …
Why Julia is the high-performance language that bridges scripting and systems programmingJulia emerged from a quest to combine the ease of high-level scripting with the raw speed of C. By utilizing multiple dispatch and just-in-time compilation, it allows developers t…
How Google Sheets evolved from a simple web test into an AI-powered powerhouseBorn from a small startup project called XL2Web, Google Sheets transformed from a limited test into a collaborative giant. Today, it leverages machine learning and large language …
The gamma distribution is the versatile engine behind waiting times and Bayesian inferenceIn probability theory, the gamma distribution is a flexible two-parameter family that underpins everything from life testing to complex statistical modeling. By adjusting its shap…
Is the humble coin toss truly random, or are we just bad at physics?While we treat coin flipping as the ultimate arbiter of fairness, physics suggests otherwise. Mathematician Persi Diaconis has shown that human tosses are not perfectly random, of…
Statistical significance is not enough: why effect size matters more than p-valuesA p-value tells you if a result is likely due to chance, but it says nothing about the actual importance of the finding. To understand the real-world magnitude of a phenomenon, yo…
Why the long-term average of a single particle can represent an entire systemErgodic theory reveals a surprising mathematical bridge: under the right conditions, the time spent by one particle in a system is equivalent to the average state of the entire sy…
Why this 19th-century statistical rule is both incredibly powerful and almost uselessChebyshev’s inequality offers a universal safety net for data, providing a guaranteed limit on how far values can stray from their average. Because it makes almost no assumptions …
Why simple averages often lie to you about the truthWhen calculating an average, assuming every data point carries equal importance can lead to significant errors. If one group is larger than another, a standard arithmetic mean ign…
Why Spearman's rank correlation is the secret weapon for measuring non-linear relationshipsWhen you need to know if two variables move together without assuming they follow a straight line, you turn to Spearman's rank correlation. Unlike standard methods that demand lin…
Why a brewery worker's secret identity changed the course of modern statistical scienceThe Student's t-distribution is a cornerstone of modern statistics, used to assess sample means and build confidence intervals. Yet, its creator, William Sealy Gosset, published h…
How to compare apples and oranges using the power of the z-scoreEver wondered how to compare test scores from two completely different exams? The z-score is the statistical bridge that makes it possible. By converting raw data into a dimension…
Why the Wilcoxon signed-rank test is the smarter alternative to the t-testWhen your data refuses to follow a normal distribution, the standard t-test can lead you astray. The Wilcoxon signed-rank test offers a robust solution by focusing on the magnitud…
How mathematicians model the probability of success within fixed boundsWhen you need to predict a percentage or a proportion, standard tools often fall short. Enter the beta distribution: a versatile mathematical framework designed to capture random …
Does X cause Y? Granger causality tests if X helps predict Y's future.Granger causality is a statistical method that determines if one time series provides unique information to forecast another. Despite its name, it does not prove true causation. I…
Why your past failures do not change your odds of future successIn a world governed by the geometric distribution, every attempt is a fresh start. Whether you are rolling dice or monitoring a factory line, this statistical model reveals that p…
The Dirichlet distribution is the secret engine behind modeling complex, multi-category probability distributions.Imagine trying to predict the outcome of a multi-sided event, like language modeling or topic classification. The Dirichlet distribution provides the mathematical framework to rep…
Why botany uses precise language to describe the hidden lives of plantsPlants do not just grow; they abscise, acuminate, and adnate. To the uninitiated, botanical terminology can seem like an impenetrable thicket of Latinate jargon. Yet, these precis…
The Dirac delta function is not a function, yet it solves impossible problems.In standard mathematics, a function must map inputs to outputs. The Dirac delta function breaks this rule by being zero everywhere except at one point, where it is infinitely tall…
How to find a hidden signal by sliding one pattern across anotherCross-correlation is a mathematical technique used to measure how similar two signals are as one shifts relative to the other. By calculating the product of two functions at every…
Why the cumulative distribution function is the ultimate map of probabilityEvery probability distribution, whether continuous or discrete, follows a unique blueprint known as the cumulative distribution function. By mapping the likelihood that a variable…
Data analysis is more than just math; it is a rigorous, iterative, and human process.Data analysis is the systematic process of transforming raw information into actionable insights. Far from a simple calculation, it is an iterative journey involving collection, c…
Why a single number is never enough to describe complex, multi-dimensional dataIn statistics, variance tells you how a single variable spreads out. But when you have multiple dimensions, that simple measure fails. To capture the full picture of how variables…
Why knowing the odds changes when you learn new information about an eventConditional probability measures the likelihood of an event occurring, given that another event is already known to have happened. It is not just a theoretical result but a fundam…
Why the color wheel is a mathematical tool, not just an artist's guideWhile artists use color wheels to mix paints, the concept originated as a rigorous scientific method for predicting light mixtures. Developed by Isaac Newton, the color circle map…
Why the simplest probability distribution is actually a perfect rectangleImagine a random outcome where every possibility within a set range is equally likely. This is the continuous uniform distribution, often called the rectangular distribution. It i…
Why simple agreement scores often fail to capture the truth in human judgmentWhen two people evaluate the same set of items, how do you know if their consensus is meaningful or just a lucky guess? Cohen's kappa provides a rigorous way to account for random…
Why the chi-squared distribution is the secret engine behind modern statistical hypothesis testingWhile the normal distribution is famous for modeling natural phenomena, the chi-squared distribution is the workhorse of inferential statistics. It emerges whenever we square inde…
Why there is no single correct way to group your dataCluster analysis is not a singular algorithm but a vast, iterative field of knowledge discovery. Because no mathematical model can simultaneously satisfy scale invariance, richnes…
Why the coefficient of determination is a powerful but often misunderstood statistical toolThe coefficient of determination, or R-squared, is a staple of statistical modeling that quantifies how much of an outcome's variance is explained by your predictors. While it off…
The binomial theorem reveals how simple algebraic powers hide complex geometric and combinatorial structures.Ever wonder how to expand complex algebraic expressions like (x+y) raised to a power? The binomial theorem provides the master key. It transforms these powers into elegant polynom…
Can you calculate the impossible by resampling your own data set?Bootstrapping is a statistical technique that uses your existing data to estimate the accuracy of your findings. By repeatedly resampling your own observations with replacement, y…
The box plot is a masterclass in visualizing data without making complex assumptions.A box plot distills a mountain of data into a simple five-number summary. By mapping the median, quartiles, and range, it reveals the spread and skewness of a dataset at a glance.…
Does the future influence the past? Why our classical view of causality is breaking.We assume causes precede effects in a neat, linear sequence. But modern physics challenges this intuition. From the speed-of-light limits in relativity to the bizarre, instantaneo…
Why mathematicians prefer this complex function to describe simple random variablesIn probability theory, the characteristic function is a powerful tool that completely defines a random variable's distribution. Unlike other methods, it always exists for any real…
Is probability a law of nature or just a measure of your own ignorance?Bayesian probability treats uncertainty not as a random frequency, but as a state of knowledge. By assigning probabilities to hypotheses and updating them as new evidence arrives,…
Why autoregressive models treat the past as an infinite echo of the presentAn autoregressive model predicts future values by looking at its own history. It treats time as a series of linear dependencies, where every single shock—no matter how small—rippl…
Why the number of atoms in a mole is now fixed by decreeFor decades, the Avogadro constant was a value scientists had to measure experimentally, tied to the mass of carbon-12. In 2019, the International System of Units changed everythi…
Can a map of probabilities reveal the hidden causes behind our observed world?Bayesian networks are graphical models that map complex relationships between variables. By representing conditional dependencies as a directed acyclic graph, these networks allow…
A Q-Q plot reveals at a glance whether two distributions share a shapeHistograms can hide the difference between a bell curve and something with dangerously heavy tails. Sort two sets of numbers, plot them against each other, and see whether the dot…
R began as a teaching tool in Auckland and became a data science workhorseTwo statistics professors in New Zealand wanted a better way to teach their introductory course. They named their language R, partly after their own first initials, Ross and Rober…
Flip a coin, step left or right, and discover why gamblers always go brokePut a marker at zero, flip a fair coin, and move one step right for heads or left for tails. Keep going forever and the marker will revisit every point on the line infinitely ofte…
Drawing the best straight line through data explains regression toward the meanMeasure something once, then measure it again, and the second result will on average sit closer to the typical value than the first did. That pull, known as regression toward the …
Skewness measures lopsided data, and the textbook rule about it often failsMany statistics courses teach that in right-skewed data the mean sits to the right of the median. A 2005 journal article pointed out that this rule of thumb fails with surprising …
The Pareto distribution explains the 80:20 rule and why averages can explodeVilfredo Pareto noticed that a small slice of society held most of its wealth. The mathematical curve named after him now describes everything from insurance claims to natural phe…
Pearson's correlation is really the cosine of an angle between two data vectorsThe most widely used measure of how two things move together carries Karl Pearson's name, but a French scientist published its formula decades earlier. Underneath the algebra sits…
Percentiles quietly set internet bills, speed limits and children's growth chartsYour internet provider may ignore your heaviest five per cent of usage when it bills you, and the speed limit on your road may have been set by watching how fast most drivers alre…
Psychometrics tries to measure things nobody can see, like intelligence and introversionThe word psychometry was coined in 1842 by an American who used it for supposed paranormal powers. Today it names a serious and argumentative science: working out how to put numbe…
Mean squared error scores guesses by squaring every missWhenever a model predicts a number, somebody has to decide how wrong it was. The most common answer is to take every miss, square it, and average the results. That simple recipe, …
MIDI succeeded because its inventors gave it awayIn the early 1980s a Roland keyboard could not talk to a Yamaha or an Oberheim; each maker guarded its own connection scheme. Roland's president and a Californian synth builder de…
Minimax means planning for the worst your opponent can doSuppose one of your options could pay 5 but might cost you 100, while another guarantees at least 2. Minimax thinking picks the safe one. The rule, born in game theory, asks a pes…
Intellect Plus