TO THE EDITOR:

We read with interest the recent article by Guglielmelli et al1  in which they report new evidence showing ruxolitinib prolongs survival in individuals with myelofibrosis. The authors analyzed data from a registry of so-called real-world data from European centers. From 2013 to 2014, 1292 individuals with myelofibrosis were registered, 1010 (78%) of whom were analyzed; 645 (50%) were alive at the study start and were followed for 4 years, including 487 receiving hydroxyurea and 108 receiving ruxolitinib. The authors selected 100 participants (8%) from this cohort for propensity score matching, 50 from each therapy group. They report that those receiving ruxolitinib lived a median of 3 years longer than those receiving hydroxyurea.

The never-ending saga of trying to decipher whether ruxolitinib increases survival began in 2012, when the 2 COMFORT randomized controlled trials were published.2,3  One-year follow-up data from the COMFORT-I study suggested better survival in participants at intermediate-2 risk or greater compared with controls, a finding confirmed in long-term follow-up.3  No survival benefit was reported in the initial report of the COMFORT-II study, where participants were assigned to receive ruxolitinib versus best available therapy.4  In contrast, follow-up at 3 years indicated improved survival with ruxolitinib.5 

Results of these trials were greeted enthusiastically by the scientific community. The claim that ruxolitinib prolongs survival appeared in many commentaries and reviews, despite 3 subsequent publications questioning the validity of this conclusion.6-8  Using the Grading of Recommendation, Assessment, Development and Evaluation (GRADE) approach, we downgraded evidence from the COMFORT studies because of performance and attrition biases.7,9  We argued survival data from these studies failed to meet optimal information size criteria, advising confidence in estimates of a survival advantage should be downgraded for imprecision (too few events). Another analysis using GRADE and a Cochrane systematic review reached similar conclusions.6,8 

Getting the survival question right is vital because it affects the decision of whether to recommend ruxolitinib therapy when the goal is prolonging survival rather than reducing splenomegaly or improving constitutional symptoms. Six additional studies1,10-14  addressed the question of whether ruxolitinib or the cognate JAK2 inhibitor momelotinib improves survival, the latest of which is that by Guglielmelli et al.1  Although designs of these studies differ, they are fundamentally case-control analyses (Table 1). We have discussed limitations of case-control studies elsewhere.15  Although Guglielmelli et al used propensity score matching, this does not overcome the limitations of such studies, including selection bias for nonconsecutive enrollment and unjustified exclusion of 22% of patients. Another issue is the use of DIPSS to match cases with controls.16  DIPSS score was an inclusion criterion of the COMFORT trials, and in some countries, it is a criterion for the use of ruxolitinib; however, it is not usually a criterion for decision making regarding ruxolitinib use in individuals who need therapy but are not enrolled in clinical trials. For example, in those with an intermediate- or high-risk DIPSS score with leukocytosis, increased blasts (or elevated CD34+ blood cells), anemia, or thrombocytopenia without symptomatic splenomegaly, we and many others prefer hydroxyurea to ruxolitinib. Matching only for DIPSS score ignores prognostic impacts of hemoglobin, white blood cell concentration, and percentage of blood blasts. This bias has been highlighted by others.10 

Table 1.

Synopsis of results of case-control studies comparing effect of ruxolitinib versus conventional therapy on survival in myelofibrosis

ReferenceCase identificationMethod of matchingCohort, nTime point for survival measurementSurvivalDifference in survivalConclusion reported
ControlRuxolitinibControl cohortRuxolitinib cohort
10  Ruxolitinib and controls: patients at Mayo Clinic in most recent 10-y period DIPSS-plus score 410 51 Ruxolitinib: therapy initiation Controls: initial referral to center NR DIPPS-plus low, 185 mo Intermediate-1, 78 mo Intermediate-2, 35 mo High risk, 16 mo P = .58 (with adjustment for DIPSS-plus) No significant difference in survival rate for ruxolitinib-treated patients compared with those treated with standard therapy 
11  Ruxolitinib: patients at MDACC who participated in INCB 18424-251 trial Controls: historical control group* Trial enrollment criteria 310 107 Ruxolitinib and controls: first observation at center NR OS rate, 69% HR, 0.58 (95% CI, 0.39-0.85); P = .005 (with adjustment for IPSS risk status) Seems to be survival advantage for patients treated with ruxolitinib (finding should be interpreted with caution) 
12  Ruxolitinib: patients who received ruxolitinib in randomized treatment arm or after crossover from best available therapy in COMFORT-II trial Controls: patients entered in database and not receiving any experimental drug IPSS intermediate-2 or high risk Blasts <10% 350 100 Ruxolitinib: therapy initiation Controls: first documentation of intermediate-2– or high-risk status Median OS, 3.5 y (95% CI, 3.0-3.9) Median OS, 5 y (95% CI, 2,9-7.8) HR, 0.61 (95% CI, 0.4-0.9); P = .005 Risk of death might be reduced by 40% to 50% by introducing ruxolitinib in treatment of patients with primary myelofibrosis 
13  Momelotinib: patients who received momelotinib in a phase 1/2 clinical trial (NCT00935987) Controls: retrospective cohort of JAK inhibitor treatment–naive patients from authors’ institutional database DIPSS-plus risk status 442 100 Momelotinib: from tdate of study entry Controls: NR Median OS, 3.2 y Median OS, 3 y P = .44 Comparison of momelotinib-treated patients with risk-matched myelofibrosis cohort not receiving treatment with momelotinib did not reveal significant difference in survival data 
14  Ruxolitinib and controls: SEER (ICD-O-3) By y of diagnosis 975 1045 Diagnosis 4-y RSR, 54% 4-y RSR, 57% P = .776 No difference in survival between pre- and postruxolitinib cohorts 
1  Ruxolitinib and controls: ad hoc registry (ERNEST study) Propensity score matching analysis on baseline covariates including DIPSS 50 50 Start of hydroxyurea or ruxolitinib therapy Median OS, 3.4 y Median OS, 7.7 y P = .002 Compared with treatment with hydroxyurea, ruxolitinib treatment was associated with significant OS benefit 
ReferenceCase identificationMethod of matchingCohort, nTime point for survival measurementSurvivalDifference in survivalConclusion reported
ControlRuxolitinibControl cohortRuxolitinib cohort
10  Ruxolitinib and controls: patients at Mayo Clinic in most recent 10-y period DIPSS-plus score 410 51 Ruxolitinib: therapy initiation Controls: initial referral to center NR DIPPS-plus low, 185 mo Intermediate-1, 78 mo Intermediate-2, 35 mo High risk, 16 mo P = .58 (with adjustment for DIPSS-plus) No significant difference in survival rate for ruxolitinib-treated patients compared with those treated with standard therapy 
11  Ruxolitinib: patients at MDACC who participated in INCB 18424-251 trial Controls: historical control group* Trial enrollment criteria 310 107 Ruxolitinib and controls: first observation at center NR OS rate, 69% HR, 0.58 (95% CI, 0.39-0.85); P = .005 (with adjustment for IPSS risk status) Seems to be survival advantage for patients treated with ruxolitinib (finding should be interpreted with caution) 
12  Ruxolitinib: patients who received ruxolitinib in randomized treatment arm or after crossover from best available therapy in COMFORT-II trial Controls: patients entered in database and not receiving any experimental drug IPSS intermediate-2 or high risk Blasts <10% 350 100 Ruxolitinib: therapy initiation Controls: first documentation of intermediate-2– or high-risk status Median OS, 3.5 y (95% CI, 3.0-3.9) Median OS, 5 y (95% CI, 2,9-7.8) HR, 0.61 (95% CI, 0.4-0.9); P = .005 Risk of death might be reduced by 40% to 50% by introducing ruxolitinib in treatment of patients with primary myelofibrosis 
13  Momelotinib: patients who received momelotinib in a phase 1/2 clinical trial (NCT00935987) Controls: retrospective cohort of JAK inhibitor treatment–naive patients from authors’ institutional database DIPSS-plus risk status 442 100 Momelotinib: from tdate of study entry Controls: NR Median OS, 3.2 y Median OS, 3 y P = .44 Comparison of momelotinib-treated patients with risk-matched myelofibrosis cohort not receiving treatment with momelotinib did not reveal significant difference in survival data 
14  Ruxolitinib and controls: SEER (ICD-O-3) By y of diagnosis 975 1045 Diagnosis 4-y RSR, 54% 4-y RSR, 57% P = .776 No difference in survival between pre- and postruxolitinib cohorts 
1  Ruxolitinib and controls: ad hoc registry (ERNEST study) Propensity score matching analysis on baseline covariates including DIPSS 50 50 Start of hydroxyurea or ruxolitinib therapy Median OS, 3.4 y Median OS, 7.7 y P = .002 Compared with treatment with hydroxyurea, ruxolitinib treatment was associated with significant OS benefit 

CI, confidence interval; DIPSS, Dynamic International Prognostic Scoring System; HR, hazard ratio; ICD-O-3, International Classification of Diseases for Oncology, third edition; IPSS, International Prognostic Scoring System; MDACC, MD Anderson Cancer Center; NR, not reported; OS, overall survival; RSR, relative survival rate; SEER, Surveillance, Epidemiology, and End Results.

*

Databases of 3 international institutions.

The report by Guglielmelli et al1  also lacks other data that would make it more credible, such as whether the effect of ruxolitinib on survival correlated with ruxolitinib dose intensity. Moreover, the authors did not report causes of death, thereby preventing us from knowing whether the survival benefit they observed resulted from slowing disease progression, reducing risk of transformation to acute myeloid leukemia, and/or other mechanisms.

Consistency of results is a criterion for quality of evidence in the GRADE platform.9  Of the studies we have discussed, 3 reported survival differences1,10,12  and 3 reported neutral results.11,13,14  One study reported more new cancers in ruxolitinib receipients.14 

Many investigators have stressed the need for a randomized controlled trial specifically designed and powered to evaluate whether ruxolitinib improves survival in myelofibrosis.10  We agree, and we continue to believe this is an unmet urgent clinical need despite substantial barriers to its execution. Ethical reasons have been put forth against a randomized trial comparing conventional drugs (eg, hydroxyurea) with ruxolitinib in individuals with myelofibrosis requiring therapy for disease progression, because it would contradict the notion of equipoise. We disagree for the reasons we have discussed here. We acknowledge that a randomized controlled trial comparing ruxolitinib with hydroxyurea would face recruitment challenges because most physicians and patients would prefer ruxolitinib, despite uncertainty about a survival benefit. We suggest the solution lies in innovative trial designs, such as partially randomized individual preference trials, which assign potential participants with a preference to that therapy while randomly assigning those without a preference.17  We also acknowledge a funding problem. Over the last 20 years, there has been a huge shift in the funding of cancer clinical trials from public to pharmaceutical sources.18  Almost all phase 3 trials are now funded by the pharmaceutical industry. Impartiality is best guaranteed by funding from nonprofit entities.

Contribution: G.B. and R.P.G. wrote and discussed the paper.

Conflict-of-interest disclosure: R.P.G. is a consultant to BeiGene, Ltd, Fusion Pharma, LLC, LaJolla NanoMedical, Inc., Mingsight Parmaceuticals, Inc., Kite Pharma, and CStone Pharmaceuticals; advisor to Antegene Biotech, LLC, Medical Director, and FFF Enterprises, Inc.; partner in AZACA, Inc.; member of the board of directors of the RakFond Foundation for Cancer Research Support; and member of the scientific advisory board of StemRad, Ltd. G.B. declares no competing financial interests.

Correspondence: Giovanni Barosi, Center for the Study of Myelofibrosis, Istituto di Ricovero e Cura a Carattere Scientifico Policlinico S. Matteo Viale Golgi 19, 27100 Pavia, Italy; e-mail barosig@smatteo.pv.it.

1.
Guglielmelli
P
,
Ghirardi
A
,
Carobbio
A
, et al
.
Impact of ruxolitinib on survival of patients with myelofibrosis in the real world: update of the ERNEST Study
.
Blood Adv.
2022
;
6
(
2
):
373
-
375
.
2.
Verstovsek
S
,
Mesa
RA
,
Gotlib
J
, et al
.
A double-blind, placebo-controlled trial of ruxolitinib for myelofibrosis
.
N Engl J Med.
2012
;
366
(
9
):
799
-
807
.
3.
Verstovsek
S
,
Mesa
RA
,
Gotlib
J
, et al
.
Efficacy, safety and survival with ruxolitinib in patients with myelofibrosis: results of a median 2-year follow-up of COMFORT-I
.
Haematologica.
2013
;
98
(
12
):
1865
-
1871
.
4.
Harrison
C
,
Kiladjian
JJ
,
Al-Ali
HK
, et al
.
JAK inhibition with ruxolitinib versus best available therapy for myelofibrosis
.
N Engl J Med.
2012
;
366
(
9
):
787
-
798
.
5.
Cervantes
F
,
Vannucchi
AM
,
Kiladjian
JJ
, et al;
COMFORT-II investigators
.
Three-year efficacy, safety, and survival findings from COMFORT-II, a phase 3 study comparing ruxolitinib with best available therapy for myelofibrosis
[published correction appears in Blood. 2016;128(25):3013].
Blood.
2013
;
122
(
25
):
4047
-
4053
.
6.
Martí-Carvajal
AJ
,
Anand
V
,
Solà
I
.
Janus kinase-1 and Janus kinase-2 inhibitors for treating myelofibrosis
.
Cochrane Database Syst Rev.
2015
;(
4
):
CD010298
.
7.
Barosi
G
,
Rosti
V
,
Gale
RP
.
Critical appraisal of the role of ruxolitinib in myeloproliferative neoplasm-associated myelofibrosis
.
OncoTargets Ther.
2015
;
8
:
1091
-
1102
.
8.
Cervantes
F
,
Pereira
A
.
Does ruxolitinib prolong the survival of patients with myelofibrosis?
Blood.
2017
;
129
(
7
):
832
-
837
.
9.
Guyatt
GH
,
Oxman
AD
,
Vist
GE
, et al;
GRADE Working Group
.
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
.
BMJ.
2008
;
336
(
7650
):
924
-
926
.
10.
Verstovsek
S
,
Kantarjian
HM
,
Estrov
Z
, et al
.
Long-term outcomes of 107 patients with myelofibrosis receiving JAK1/JAK2 inhibitor ruxolitinib: survival advantage in comparison to matched historical controls
.
Blood.
2012
;
120
(
6
):
1202
-
1209
.
11.
Tefferi
A
,
Litzow
MR
,
Pardanani
A
.
Long-term outcome of treatment with ruxolitinib in myelofibrosis
.
N Engl J Med.
2011
;
365
(
15
):
1455
-
1457
.
12.
Passamonti
F
,
Maffioli
M
,
Cervantes
F
, et al
.
Impact of ruxolitinib on the natural history of primary myelofibrosis: a comparison of the DIPSS and the COMFORT-2 cohorts
.
Blood.
2014
;
123
(
12
):
1833
-
1835
.
13.
Thomas
JW
,
Jamy
O
,
Shah
MV
,
Vachhani
P
,
Go
RS
,
Goyal
G
.
Risk of mortality and second malignancies in primary myelofibrosis before and after ruxolitinib approval
.
Leuk Res.
2022
;
112
:
106770
.
14.
Tefferi
A
,
Barraco
D
,
Lasho
TL
, et al
.
Momelotinib therapy for myelofibrosis: a 7-year follow-up
.
Blood Cancer J.
2018
;
8
(
3
):
29
.
15.
Barosi
G
,
Zhang
MJ
,
Gale
RP
.
Does ruxolitinib improve survival of persons with MPN-associated myelofibrosis? Should it?
Leukemia.
2014
;
28
(
11
):
2267
-
2270
.
16.
Passamonti
F
,
Cervantes
F
,
Vannucchi
AM
, et al
.
A dynamic prognostic model to predict survival in primary myelofibrosis: a study by the IWG-MRT (International Working Group for Myeloproliferative Neoplasms Research and Treatment)
.
Blood.
2010
;
115
(
9
):
1703
-
1708
.
17.
Preference Collaborative Review Group
.
Patients’ preferences within randomised trials: systematic review and patient level meta-analysis
.
BMJ.
2008
;
337
:
a1864
.
18.
Del Paggio
JC
,
Berry
JS
,
Hopman
WM
, et al
.
Evolution of the randomized clinical trial in the era of precision oncology
.
JAMA Oncol.
2021
;
7
(
5
):
728
-
734
.

Author notes

Requests for data sharing may be submitted to Giovanni Barosi (barosig@smatteo.pv.it).