Accuracy versus Profitability

Accuracy counts winning predictions, while profitability weights every win and loss by price, size, and cost; either metric can be high while the other is poor.

Accuracy treats every correct call as one and every incorrect call as zero. Trading PnL instead depends on purchase price, payout, size, and costs. They answer different questions.

Definitions #

For nn trades,

Accuracy=1n∑i=1n1(Yi=1),Total PnL=∑i=1n(Yi−pi)Ni−costsi.Accuracy=\frac1n\sum_{i=1}^n\mathbf 1(Y_i=1), \qquad Total\ PnL=\sum_{i=1}^n(Y_i-p_i)N_i-costs_i.

YiY_i is settlement, pip_i is execution price, and NiN_i is shares. Accuracy discards three of those four economic inputs.

Below 50% accuracy and profitable #

Buy 100 YES shares across independent markets at p=0.20p=0.20. If only 30 win, accuracy is 30%, but

PnL=30−100(0.20)=+10.PnL=30-100(0.20)=+10.

Each rare win earns 0.80 while each common loss costs 0.20.

Above 50% accuracy and unprofitable #

Buy 100 shares at p=0.90p=0.90. If 80 win, accuracy is 80%, but

PnL=80−90=−10.PnL=80-90=-10.

Frequent ten-cent wins do not cover twenty ninety-cent losses.

Life example #

A delivery company can complete 99 ordinary parcels profitably and lose more on one uninsured high-value parcel than it earned on all 99. Transaction count is not monetary outcome.

Application to no-hedge #

No-hedge evaluation must report net PnL and probability calibration on filled orders, not only win rate. High accuracy can arise from repeatedly buying expensive favorites; low accuracy can be healthy when discounted longshots are correctly valued.

Self-check: 40 wins from 100 shares bought at 0.30. Ignore costs. Accuracy and PnL?

Accuracy is 40%. Total cost is 30, payout is 40, so PnL is +10.

Sources

  1. paperStrictly Proper Scoring Rules, Prediction, and Estimationpdfnotes

Searches titles, aliases, headings, summaries, and full text.↑↓ move ↵ open esc close