Randomness of Correlation & Its Hacking by Big Dataists


This tutorial presents the intuitions of the randomness of sample correlation (spurious correlation) and the methodologies in derivations. Some later sections are somewhat technical as Nassim rederived an old equation with more precise functions (in order to apply to fat tails) and showed the distribution of the maximum of d variables with n points per variable.
This paves the way to the real scientific work on random matric theory under fat tails and the failure of Marchenko-Pastur.

A Mini-MOOC Tutorial: The Randomness of Correlation and its Hacking by Big Dataists

Nassim says:

This tutorial presents the intuitions of the randomness of sample correlation (spurious correlation) and the methodologies in derivations.
Some later sections are somewhat technical as rederived an old equation with more precise functions (in order to apply to fat tails) and showed the distribution of the maximum of d variables with n points per variable.
This paves the way to the real scientific work on random matric theory under fat tails and failure of Marchenko-Pastur.

How Increasing Benefits Increases the Risk of Ruin

Explains why you do not decrease tail risks by increasing benefits, you decrease tail risk by decreasing tail risk. This is a very short exposition of a fallacy quite generalized, but particularly present in discussions concerning the benefits of GMO. Biologists dealing with probability have a problem with tail risk. —- Also sows why “Pascal’s wager” has nothing to do with risk arguments. — Technical Note: By “variance” is meant in the lingo of the author the scale of the distribution: this is a Student T with infinite variance (as one can see above) and \sigma is the scale.

Taleb’s MOOCs | Binary vs Vanilla Payoffs and Predictions: An error in the research/risk literature

“Micro-Mooc on a paper by Taleb and Tetlock (one manifestation of the LUDIC FALLACY). There are serious statistical differences between predictions, bets, and exposures that have a yes/no type of payoff, the “binaries”, and those that have varying payoffs, which we call the “vanilla”. Real world exposures tend to belong to the vanilla category, and are poorly captured by binaries. Yet much of the economics and decision making literature confuses the two. Vanilla exposures are sensitive to Black Swan effects, model errors, and prediction problems, while the binaries are largely immune to them. The binaries are mathematically tractable, while the vanilla are much less so. Hedging vanilla exposures with binary bets can be disastrous–and because of the human tendency to engage in attribute substitution when confronted by difficult questions,decision-makers and researchers often confuse the vanilla for the binary.”
The paper is here: http :// papers. ssrn. com/ sol3/ papers.cfm? abstract_id= 2284964
More general Fat Problems with Tails: http:// www. fooled by randomness. com/ FatTails. html

Taleb’s MOOCs | Law of Large Numbers and Fat Tails (Note #3)

Micro Mooc #3. The law of large numbers is the most important thing in life and science. It is the basis of epistemology and problem of induction. How many observations do you need to know if something is true? We get into the plumbing and show how it is too slow under fat tails. This is a simplified (but technical) presentation of a segment of “Probability and Risk in the Real World”, the Technical Companion for The Black Swan http:// www. fooled by randomness. com/ FatTails. html