Back to Index

Chapter 6: Probability

Probability

"The true logic of this world is in the calculus of probabilities." — James Clerk Maxwell

šŸŽ²

Chance and Likelihood: Making Better Guesses with Probability

Probability is the language of quantitative judgment when information is incomplete. It describes the relative frequency of various outcomes under repeatable observations.

Definition (imagined repeated trials): P(A) = N_A / N, where N_A is the estimated most likely number of times A occurs.

Equally likely m outcomes: P(A) = 1/m. Example: drawing a specific card from 52 has probability 1/52.

šŸ“ˆFluctuations: Variations in Finite Samples

Flip a coin 30 times — the "most likely" result is 15 heads, but a single experiment will fluctuate around 15; the distribution over many repetitions is given by the binomial formula:

P(k,n) = (n k) / 2^n

Generalized: P(k,n) = (n k) p^k (1-p)^{n-k} (Bernoulli distribution).

Sample standard deviation (equal probability heads/tails): (k - n/2)_rms ā‰ˆ √n/2.

🚶Random Walk: Patterns in Randomness

One step forward or backward with equal probability; after N steps, the expected mean square net displacement D:

⟨D²⟩ = N, D_rms = √N

Equivalent to the binomial distribution: D = 2k - N. Applications: Brownian motion, error accumulation.

šŸ“ŠProbability Density and the Normal Distribution

When step lengths fluctuate but have finite mean square, for large N the endpoint distribution approaches a Gaussian distribution:

p(x) = \dfrac{1}{\sigma\sqrt{2\pi}} e^{-x^2/(2\sigma^2)}, \sigma = \sqrt{N}\,S_rms

The Maxwell speed distribution of gas molecules also requires probability density description; the area under the curve corresponds to the "expected number."

āš›ļøThe Uncertainty Principle: Probability Is Essential in the Microscopic World

[\Delta x]\,[\Delta v] \ge \dfrac{\hbar}{2m}

The probability densities of position and velocity cannot both be arbitrarily narrow simultaneously. Electrons in atoms are described by "probability clouds" rather than definite orbits.

Conclusion: Probability is not a stopgap measure but the most precise way to express the laws of nature at atomic scales.

✨Key Points

1ļøāƒ£

Probability = estimated relative frequency in imagined repeated experiments, depending on information and equal likelihood.

2ļøāƒ£

The binomial distribution describes count distributions in "yes/no" experiments; fluctuations scale as √n.

3ļøāƒ£

Mean square displacement in a random walk grows linearly with steps — true for macroscopic diffusion and microscopic errors alike.

4ļøāƒ£

Quantum uncertainty makes probability fundamental to microscopic description — not a concession.