Welcome to our community

Be a part of something great, join today!

The Causal Revolution and Why You Should Study It

  • Thread starter
  • Admin
  • #1

Ackbach

Indicium Physicus
Staff member
Jan 26, 2012
4,183
In the mid-1990's, an electrical engineer/computer scientist by the name of Judea Pearl started to change the world by greatly improving our understanding of causality. He brought together many strands of thought that had gone before him, then synthesized them into an integrated whole, with many original contributions as well. For this he was awarded the Turing prize, which is the equivalent of the Nobel prize in computer science.

Here's why you should study causality: because once you've done so, you can begin to ask and answer better questions. For example, instead of merely noting that a hospital's appointments are down at the same time some virus is spreading around, you can ask the better question: is the virus causing appointment counts to go down? The new causality tools give you what you need to answer that question! It is still an inductive procedure, so it's not as though you go from induction to deduction. However, you're asking and answering the questions people really want to know: the "why" questions.

Here's how to learn the new causality. Prerequisites: probability and statistics, the more the better. If you've have a typical calculus-based version, you'd certainly be well-prepared. However, the first book on the list only requires basic probability and statistics. If you want to be able to do all the computations yourself, you would need more background to get through Books 2 and especially 3.

Study these three books, in this order.

  1. The Book of Why, by Judea Pearl and Dana Mackenzie.
  2. Causal Inference in Statistics: A Primer, by Judea Pearl, Madelyn Glymour, and Nicholas P. Jewell.
  3. Causality: Models, Reasoning, and Inference, by Judea Pearl.
Teaser: contrary to the standard doctrine of traditional statistics, which I had learned, you do not always need to have a randomized controlled trial in order to establish causality! With the right data, even an observational study can give you causality (this is how we know that smoking causes lung cancer, e.g., when the right RCT would be unethical).

Another teaser: Have you ever wondered how you can tell when to control for a possibly confounding variable or not? The new causality not only makes the whole concept of confounding much clearer, but tells you when you need to condition on a variable, and when NOT to condition on a variable! (Hint: sometimes conditioning on a variable gives you the WRONG answer!)

Highly recommended!