Sunday, February 21, 2016

Causal Inference Resources

I was inspired by the post "Why you should stop worrying about deep learning and deepen your understanding of causality instead" to write up some of the resources I've used over the past year as I myself have tried to learn more about causality.

The field of Causal Inference has become much more rich and interesting over the past 20 years as a number of new statistical tools were created to help improve the bias inherent in model dependent statistical inference. I find it's best to start with understanding the split between prediction and causal inference that has been in the field for quite a while. Each of the following three references goes into much more detail about how many of the same tools are used between causal inference and prediction, but the meaning assigned to the model, and in particular how you evaluate the model for appropriateness is very different depending on what you're trying to do.
Statistical Modeling: The Two Cultures :
My team and I spent a lot of time dealing with observational data. Therefore much of my focus has been about how to make better decisions when dealing with observational data and quasiexperimental study design. There's been a lot of research in this area because so many medical studies are based on observational data. The Evidence Based Medicine movement came out of a desire to improve clinical decision-making outcomes and provides many ideas that can be reused within my own field. One of the pieces that is fantastic for decision-making in general, is the hierarchy of evidence. This provides a framework within which to base your decision making and understand how biased your study could possibly be.
One of the articles I really enjoyed coming across was by Rubin: "For objective causal inference, design trumps analysis". In it he briefly covers the counterfactual framework, and reworks an observational study through the lens of experimental design, using the appropriate tools to approximate a true experiment to the best of his ability. It definitely gave me a much better understanding about the role of treatment assignment and how it participates and causal inference.
And now onto books!
The first book is particularly awesome and mathy. I find that it hops right in and covers the key concepts you need to understand about modern causal inference theory. That is both a strength, and weakness. If you're not up to date on reading mathematical notation, it can be a little challenging.

"Counterfactuals and Causal Inference" by Morgan and Winship
This was the first book I got. I actually had the first edition, and upgraded to the second edition when it came out, definitely worth it. I found many of the topics more approachable in this book than the previous book, but they restrict the set of tools they give you. Therefore I found it a great place to start and become comfortable with counterfactual theory and causal diagrams, but I eventually had to upgrade to the book out of the Harvard school of public health.
Many papers you encounter will refer back to the work in this book, which is largely a compendium of the research done by Rubin. I found it an additional perspective to many of the concepts covered in the previous two books. So probably not required, but nice to round things out.
This book showed me how little I really knew. It was the last one I purchased and I still haven't finished it. I really need to sit down and compare the contents of this textbook against the second half (Model Dependent Causal Inference) of the Causal Inference book out of Harvard.
OK. This book hasn't shipped, and I haven't read it. But I'm very excited by it. Judea Pearl's other book: "Causality: Models, Reasoning and Inference" is well-regarded, but also known to be very difficult as it connects together causal reasoning in several different fields into one overarching framework. He also has a blog we can stay up-to-date on some of the latest books and research in this area: .
Lastly, one of the early papers I encountered that I felt did a good job in this area: Sekhon, J. S. (2011). Multivariate and propensity score matching software with automated balance optimization: The Matching package for R. Journal of Statistical Software 42(7). . I found his package rather straightforward to use and high enough performance to work against the large data sets I deal with on a regular basis.
If you're ever in the Seattle area and want to chat about these things, I would love to do coffee.


  1. worth saying words are provided for my career use.thanks a lot for gain more.these informative articles are most useful for me.

    Digital Marketing Company in Chennai


  2. Its a wonderful post and very helpful, thanks for all this information. You are including better information regarding this topic in an effective way.Thank you so much

    Personal Installment Loans
    Title Car loan
    Cash Advance Loan

  3. This comment has been removed by the author.

  4. If you need to get really useful info about writing resume job description, I am sure that info from will be helpful for you. Few years ago it helped me to impress my employer.

  5. I had the best argumentative essay done and your blog helped me a lot with resources. Thank you for posting this!

  6. Very good article! Such information is always helpful.
    Writing such articles in any discipline takes a lot of time and effort. You can give it to outsource. Here are the guys who will help you 24/7 in the implementation of all your idea

  7. Do you have difficulty in writing an programming assignment? Here is the solution! Opt for our programming assignment help and get a high-quality programming assignment written within the set deadline.
    For more info please visit our website:

  8. Always our writers who provide Assignment Help Australia service include the logical flow of ideas related to the topic in a proper way to make the writing worth and easy to understand. My Assignment Help Australia

  9. Even if you ask for help while doing your homework (e.g., you still get some knowlage raeding the ready paper before presenting it in front of class, but without struggling doing it.

  10. This is very interesting, You’re a very skilled blogger. I have joined your rss feed and look forward to seeking more of your excellent post. Also, I have shared your website in my social networks!
    Thank you and best of luck.tokeny

  11. How to write a good essay? I know a lot from
    For instance, Avoid explicitly stating the point of your essay. It’s far less effective when you spell it out for someone. Delete every single “That’s when I realized,” “I learned,” and “The most important lesson was...” It's unnecessary, unconvincing, and takes the reader out of the moment. Instead, let them read between the lines and interpret the meaning of your story on their own. You shouldn’t have to say anything like, “And that’s how I learned to stand up for myself,” because the admission's officer should already know. Oftentimes when you watch a movie, an actor’s expression, sigh, or closing of a door speaks louder than words.

  12. How Lemeridian funding service  grant me a loan!!!

    Hello everyone, I'm Lea Paige Matteo from Zurich Switzerland and want to use this medium to express gratitude to lemeridian funding service for fulfilling his promise by granting me a loan, I was stuck in a financial situation and needed to refinance and pay my bills as well as start up a Business. I tried seeking for loans from various loan firms both private and corporate organisations but never succeeded and most banks declined my credit request. But as God would have it, I was introduced by a friend named Lisa Rice to Le_meridian funding service and undergone the due process of obtaining a loan from the company, to my greatest surprise within 48hrs just like my friend Lisa, I was also granted a loan of $216,000.00 So my advise to everyone who desires a loan, "if you must contact any firm with reference to securing a loan online with low interest rate of 1.9% and better repayment plans/schedule, please contact Le_meridian funding service. Besides, he doesn't know that am doing this but due to the joy in me, I'm so happy and wish to let people know more about this great company whom truly give out loans, it is my prayer that GOD should bless them more as they put smiles on peoples faces. You can contact them via email on { Or} or Text through Whatsapp +1-989 394 3740.