HD-OPM Archive
Topics › How to read research

Victorian-diet longevity claim is survivorship bias from excluding deaths under age 5

Louis Nervegna · Dec 01, 2023 · ♥ 9 reactions · 6 comments · original Facebook post
How to read researchMyths, misinformation & controversies
AI summary & key facts

Louis uses a paper on mid-Victorian diets as an example of survivorship bias. The authors exclude deaths before age 5, but those who survive early childhood were genetically selected for health, so their long lives do not show that the diet made average adults live as long as people today. Including the weaker people would have produced a much lower average age of death. The linked paper itself says life expectancy at age 5 was as good or better than today.

The article posted about Victorian era diets is a great example of failure to recognize “survivorship bias” in scientific studies.

Survivorship bias is the logical error of concentrating on entities that passed a selection process while overlooking those that did not. This can lead to incorrect conclusions because of incomplete data.

The article tries to claim that healthy diets magically made grown adults in Victorian times live just as long as we do today, even though they lacked pretty much all of modern medicine. If you intuitively feel that this claim is very suspicious, then your scientific instincts are on to something important.

There is a trick that the authors use to get away with this nonsense. They exclude all deaths between the ages of 0 and 5. Seems harmless right? What do deaths of young children have to do with deaths of full grown adults?

Turns out— a lot. Here’s why.

The “survivors” in this case (those who live past years 0 to 5) are highly genetically biased towards health and strength. Thats why they survived ages 0 to 5 in the first place, while many others died. Illness tends to kill the genetically weakest first. That’s also why the survivors live so long on average— because they are genetically strong.

If all the weaker ones had happened to get lucky and survived the years 0 to 5 as well (instead of dying), they would have likely died significantly younger than the strong ones. Remember that there was no modern medicine. Weaker genes would mean that you die younger, because there was nothing medically available to help you.

If you also included the average age of death of all the weaker ones who were assumed to also survive years 0 to 5, then the average age of death for the whole population in Victorian times would have been a lot younger than it is today— and certainly not the same.

The authors took advantage of unnoticed survivorship bias (i.e. unnoticed by the peer reviewers) to make a ridiculous claim that is very untrue once that bias is revealed and properly accounted for.

You always need to be on the lookout for survivorship bias in scientific studies like this, especially when the authors don’t explicitly disclose that it exists like they always should.

Paper · Int J Environ Res Public Health · 2009How the mid-Victorians worked, ate and died.Analysis of the mid-Victorian period in the U.K. reveals that life expectancy at age 5 was as good or better than exists today, and the incidence of degenerative disease was 10% of ours. Their levels of physical activity and hence calorific intakes were approximately twice ours. They had relatively little access to alcohol and tobacco; and due to their correspondingly high intake of fruits, whole grains, oily fish…pubmed.ncbi.nlm.nih.gov

#survivorshipbiasHD

Research cited

#longevity
← newer: Supplements and foods can raise statin levels through cytocholder: Review of 884 supplement RCTs: omega-3, folic acid and CoQ10 →