Conditional Probability & Bayes' Rule

Conditional probability updates uncertainty after evidence arrives; Bayes' rule combines evidence strength with the base rate that existed before the evidence.

New information changes probability only relative to what was believed before. Conditional probability makes that update explicit and prevents a common mistake: confusing “the signal is common when the event is true” with “the event is probably true when the signal appears.”

Conditioning and Bayes' rule #

For events AA and BB with P(B)>0P(B)>0,

P(A∣B)=P(A∩B)P(B).P(A\mid B)=\frac{P(A\cap B)}{P(B)}.

Bayes' rule reverses the direction:

P(A∣B)=P(B∣A)P(A)P(B∣A)P(A)+P(B∣Ac)P(Ac).P(A\mid B)=\frac{P(B\mid A)P(A)}{P(B\mid A)P(A)+P(B\mid A^c)P(A^c)}.

P(A)P(A) is the prior or base rate; P(B∣A)P(B\mid A) is the signal's likelihood when AA is true; and P(A∣B)P(A\mid B) is the updated or posterior probability.

A life example with 1,000 devices #

Suppose 1% of devices are defective. An alarm fires for 90% of defective devices and 5% of good ones. Among 1,000 devices, expect 10 defective, 9 true alarms, 990 good, and about 49.5 false alarms. Therefore

P(Defect∣Alarm)=99+49.5≈0.154.P(Defect\mid Alarm)=\frac{9}{9+49.5}\approx0.154.

The alarm is informative: probability rose from 1% to about 15.4%. But it did not make a defect more likely than not because false alarms act on a much larger base population.

Base-rate tree for a device alarm One thousand devices split into ten defective and nine hundred ninety good devices. Nine defective devices alarm, while about forty-nine and a half good devices produce false alarms. 1,000 devices before testing 1% defective 99% good 10 defective base-rate branch 990 good large base branch 90% alarm 10% quiet 5% alarm 95% quiet 9 true alarms defective + alarm 1 quiet defect missed alarm 49.5 false alarms good + alarm 940.5 quiet good good + quiet
A strong-looking signal can still have a low posterior probability when the event's base rate is small.

Trading update #

Suppose a contract begins at q=0.50q=0.50. Credible evidence raises the trader's estimate to q=0.65q=0.65. That does not imply every venue quote should be copied: the evidence likelihood, base rate, time, and contract wording all belong in the update.

Application to no-hedge #

A reference VWAP is evidence BB, not the target event AA itself. Treating 1−referenceVWAP1-referenceVWAP as a fair value is defensible only when the reference and maker contracts are true complements with identical settlement semantics. A changed reference price should trigger a probability update; it is not a hedge and it does not remove P(NO∣B)P(NO\mid B).

Self-check: why is the posterior only about 15.4% despite a 90% detection rate?

Because defects are rare and the 5% false-positive rate applies to 990 good devices. False alarms outnumber true alarms, so the base rate dominates.

Sources

  1. docsNIST/SEMATECH e-Handbook of Statistical Methods

Searches titles, aliases, headings, summaries, and full text.↑↓ move ↵ open esc close