Kind of sounds like you do have a problem with the paper
😛 (being tongue in cheek)
Really great points.
Tangentially related, but this is an excellent read out this week in NEJM on Intention To Treat (ITT) and Per protocol analyses of RCTs
Yeah, I have a problem with the study itself and the
insane process of allowing discontinuation/crossover based on insurance approval/disapproval. By definition, this means that your randomization is bogus. Was there even really intent to treat per protocol, or rather was the intent to "treat per protocol if payment available", As discussed above, the latter is not remotely the former.
I am concerned about how contours were established prior to randomization. This itself could cause bias. These docs are proton docs and presumably are drawing contours that "work for protons". I have no reason to believe that such volumes are ideal for photon treatment. Penumbra is damn important. How many of us are comfortable with an un-contoured contralateral base of tongue volume while treating bilateral neck, because we know the dose falloff will mean 40-50Gy in that area and it lets us get OC dose down? There is no range uncertainty with photons.
For those proton docs out there? Are your contours identical with both modalities?
The paper seems to be written in fairly standard fashion. All research is difficult, and I don't do it. So, I have no problem with them publishing the paper as written. They were very unambitious. (Non-inferiority trial with 9% margin).
Do they even believe in their intervention? They hypothesize about the surprising OS benefit, but who wouldn't.
They should know that it is probably not real.
Thanks for the link. It's a good read. I think the concept of hypotheticals in interpreting per protocol results is really important.
In that vein, let's review what per-protocol overwhelmingly means for this trial.
The hypothetical here is that in a world where all patients can pay for protons, per protocol outcomes would reflect the real equivalence or superiority of protons vs photons. A second hypothetical may be that contours should be independent of modality?
But there is such a simple solution to avoiding these hypotheticals.
Execute the trial independent of payor status. Pay for the intervention.
Or, if as is evident by how these institutions work, the trialists don't really believe in equipoise...only offer the trial to patients who couldn't otherwise afford protons.
Enroll, pay for the intervention, customize the volumes in both arms with an understanding of the modality to be employed...how the trial should be done.