Dimitri's Letters · Issue 10

The Bias That Makes Every Treatment Look Good

Almost every surgical comparison you have ever read has one thing in common. Nobody could randomize it. You cannot assign a patient to open surgery versus minimally invasive by coin flip in most real world settings, so researchers reach for registry data instead, compare whoever got treatment A to whoever got treatment B, adjust for a list of variables, and call the result evidence.

Hidden inside a large share of these comparisons is a specific, well documented error that silently makes almost any treatment look protective, even when it does nothing at all. It is called immortal time bias, and once you learn to see it, you will notice it everywhere.

Here is the mechanism, stripped to its simplest form.

Say you want to know whether starting a certain medication after surgery improves survival. You take your cohort, label everyone who eventually started the medication as treated, and everyone who did not as untreated. Then you start the clock for both groups at the same point, say the date of surgery.

The problem is this. A patient can only be labeled treated once they actually receive the medication, which might be weeks after surgery. But by counting them as treated from the date of surgery, you have quietly given the treated group a period of guaranteed survival before the treatment even started, since they had to live long enough to receive it. That guaranteed survival window is immortal time, and it is not a real treatment effect. It is a bookkeeping error that inflates the apparent benefit of almost anything you study this way.

The treatment did not make the patients live longer. Living longer is what let them receive the treatment. The direction of causality got quietly reversed.

This is not a rare or theoretical problem. It has been documented across oncology, cardiology, critical care, and increasingly in surgical outcomes research, and it has reversed the conclusions of published studies once corrected. A 2025 editorial in the British Journal of Surgery specifically made the case for this framework in surgical and perioperative research, where randomized trials are especially hard to run.

The fix has a name: target trial emulation. Before touching the data, you write out the randomized trial you wish you could run. Who would be eligible. What exactly counts as the treatment strategy. When follow up starts for everyone, which must be the same moment eligibility is confirmed, not the moment treatment happens to occur. What the outcome is and how long you follow patients. Only once that hypothetical trial is fully specified do you go into the observational data and force your analysis to emulate it exactly.

Done properly, this single discipline eliminates immortal time bias and several related errors at once, because it forces time zero, the moment your clock starts, to be the same for every patient regardless of when they actually happened to start treatment.

20%

of surgical randomized trials are discontinued early, mostly for recruitment or funding reasons, which is part of why observational methods carry so much weight in this field, and why getting them right matters this much.

You do not need to become a causal inference specialist to benefit from this. You need to ask one question before starting your next observational comparison, and ask it before you touch the data, not after.

Before your next observational study

  1. Write down the trial you wish you could run. Eligibility, treatment strategies being compared, and the outcome, before you look at a single row of data.
  2. Fix time zero for everyone at the same point. The moment a patient becomes eligible, not the moment they happen to start treatment. This one decision prevents most immortal time bias on its own.
  3. Check your last published comparison against this. If treated and untreated groups were not started on the same clock, the effect size you reported may be partly, or entirely, this bias.

If you are currently designing a comparison from registry or cohort data, this is worth working through before the analysis begins. AskDimitri can help you specify the target trial before you touch the dataset.

Specify your target trial →

Randomization is not the only thing that makes a comparison trustworthy. Careful design of the clock is what makes an observational study earn the right to be believed.

Editor's note: in September 2026 the figures in this letter were checked against the sources listed below, and the text was corrected where the letter as sent differed from them.

Until next week,

Dimitri

Dr. Dimitrios Magouliotis · Research Associate Professor, cardiac surgery research · About the author

Sources

  1. Wong KHF, Hinchliffe RJ. Target trial emulation: harnessing real-world data to evaluate surgery and perioperative care interventions. Br J Surg. 2025;112(9):znaf182. doi:10.1093/bjs/znaf182. PMID: 40893042.
  2. Chapman SJ, Shelton B, Mahmood H, Fitzgerald JE, Harrison EM, Bhangu A. Discontinuation and non-publication of surgical randomised controlled trials: observational study. BMJ. 2014;349:g6870. doi:10.1136/bmj.g6870. PMID: 25491195.

A new letter goes out every week, to subscribers first. Join to get the next one.

Get the letters, and access to the assistant

Free. Confirm your email and you are in. We will email you a link to confirm your address. Confirming subscribes you to Dimitri's Letters (unsubscribe anytime) and opens your access to the assistant. You must be 18 or older, and you agree to the Terms and the Privacy policy (σύνοψη στα ελληνικά).

What you share with the assistant is not stored by AskDimitri, unless you choose to save conversations on your account. It goes to Anthropic, our AI provider, only to generate the answer. Anthropic deletes it within 30 days (longer only if it is flagged for a safety review) and does not train on it.