We sought to identify the total number of therapeutic trials targeting FLT3-mutant acute myeloid leukemia (AML) to estimate the number of patients needed to satisfy recruitment when compared with the incidence of this mutation in the US AML population. A systematic review of all therapeutic clinical trials focusing on adult FLT3-mutated AML was conducted from 2000 to 2017. An updated search was performed using ClinicalTrials.gov for trials added between October 2017 and December 2018. Analysis was performed for ClinicalTrials.gov search results from 2000 to 2017 to provide descriptive estimates of discrepancies between anticipated clinical trial enrollment using consistently cited rates of adult participation of 1%, 3%, and 5%, as well as 10% participation identified by the American Society of Clinical Oncology in 2008. Twenty-five pharmaceutical or biological agents aimed at treating FLT3-mutant AML were identified. Pharmaceutical vs cooperative group/nonprofit support was 2.3:1, with 30 different pharmaceutical collaborators and 13 cooperative group/nonprofit collaborators. The number of patients needed to satisfy study enrollment begins to surpass the upper bound of estimated participation in 2010, noticeably surpassing projected participation rates between 2015 and 2016. The number of patients needed to satisfy study enrollment surpasses 3% and 5% rates of historical participation for US-only trials in 2017. We estimate that 15% of all US patients with FLT3-mutant AML would have to enroll in US and internationally accruing trials to satisfy requirements in 2017, or approximately 3 times the upper level of historical participation rates in the United States. The current clinical trial agenda in this space requires high percentage enrollment for sustainability.

In the present era of precision oncology, there is growing recognition that the number of patients needed for enrollment in clinical trials investigating agents with similar mechanisms of action may be greater than the number of patients with specific targetable mutations.1  The therapeutic approaches of precision oncology and immuno-oncology have become more widely used, especially as advancements in sequencing allow relatively inexpensive and rapid characterization of tumor tissue relevance.2,3  In tumor types such as melanoma, the success of immunotherapy heralded by the approval of ipilimumab opened the door for anti-PD-1/ PD-L1 and anti-CTLA-4/CTLA-4 directed therapy in multiple tumor types, and the broad efficacy of this approach led to James P. Allison and Tasuku Honjo being awarded the 2018 Nobel Prize in Physiology and Medicine.4,5 

Despite tremendous success in targeting the immune system across various cancers, a study by Tang et al noted 164 agents targeting PD-1/PD-L1, with 50 of the 164 agents in clinical stages (45 agents in phase I-III clinical trials, 5 approved).6  This highlights the large number of similar agents being investigated in the absence of head-to-head comparisons.6  The increasing number of clinical trials investigating agents that target similar pathways has created challenges for investigators, patients, and regulatory agents, and has prompted some to suggest adjustments to current clinical trial design and regulation.6,7  In addition, accrual requirements for investigational studies often exceed the number of patients in an eligible population harboring a particular tumor type or mutation.6  Several studies (Carlisle et al8  and Mattina et al9 ) have expressed concern regarding redundant and duplicative trial agendas in systematic reviews focusing on sunitinib and sorafenib, respectively.8,9  Despite an abundance of trials using agents that target the same or similar immune or molecular locations, only 5% of clinically tested agents move toward approval by the US Food and Drug Administration.10  This prompts a closer look into the repercussions this may have on clinical trial participants and the quality of this research.6,8-10 

Acute myeloid leukemia (AML) is a hematologic malignancy with growing identification of prognostically significant mutations with the potential for therapeutic inhibition or alteration. AML comprises 1.3% of all new cancer diagnoses in the United States every year, with an estimated 21 380 new cases in 2017.11,12  Research and clinical advances have allowed for further disease classification and the generation of targeted therapies.13,14  One such mutation that has gained attention is the FMS-like tyrosine kinase 3 (FLT3) mutation.14-18  FLT3 mutations are deemed one of a few “actionable” mutations, and occur in 30% of de novo AML cases; 25% are internal tandem duplication (FLT3-ITD) mutations, and 5% are tyrosine kinase domain mutations.11,15,16,19,20  A normally functioning FLT3 protein, after binding to its ligand FL and undergoing phosphorylation, plays a role in the promotion of cellular proliferation and anti-apoptotic activity, and influences hematopoietic precursor cells.14,17  Both ITD and tyrosine kinase domain mutations result in constitutive pathway activation via a conformational change and interference with inhibitory effects of the activation loop, respectively.14 

With an estimated 21 380 new AML cases in 2017, approximately 5345 individuals will harbor FLT3-ITD mutations, and 1069 will possess a tyrosine kinase domain mutation. Multiple small-molecule, tyrosine/multikinase inhibitors have been developed for FLT3-mutated AML.14,19-21  In April 2017, the tyrosine/multikinase inhibitor midostaurin was the first such targeted agent approved by the US Food and Drug Administration for the treatment of FLT3-mutated AML, based on the findings of the phase 3 randomized CALGB 10603/RATIFY clinical trial.21,22  Most recently, gilteritinib was approved for relapsed/refractory FLT3-mutant AML in November 2018, based on the interim analysis results of the ADMIRAL trial (NCT02421939). With the advancement of genetic and molecular testing during the past decade, the focus on targeted therapies for the treatment of AML has expanded.23,24  In turn, this has led to more clinical trials focusing on specific molecular mutations.11,12,23,24 

The FLT3-mutated AML population was chosen to reflect on a larger discussion within clinical hematology/oncology, specifically the development and conduct of potentially duplicative clinical trials in the United States. We sought to examine how many investigational FLT3 agents developed and studied in therapeutic clinical trials targeted FLT3-mutated AML within a specified timeframe. We hypothesized that therapeutic trials examining FLT3 inhibitors require a sizable percentage of patients with FLT3-mutated AML, and that the number of patients needed for recruitment to these trials exceeds the number of eligible patients who are willing and able to participate in clinical trials.

We conducted a systematic review of all therapeutic clinical trials investigating FLT3 inhibitors targeting patients with FLT3-mutated AML registered in ClinicalTrials.gov from 2000 to 2017. We sought to estimate what percentage of patients with AML with FLT3 mutations would need to enroll in clinical trials to satisfy anticipated recruitment needs each year during this period.

Methodology was guided by the PRISMA 2009 guidelines (Figure 1; supplemental Appendices 1 and 2).25  We performed an advanced search, using ClinicalTrials.gov to identify clinical trials focusing on adult FLT3 AML from 1 January 2000 to 11 October 2017 (day of initial search). An additional search was then performed in PubMed for adult FLT3 AML clinical trials cataloged from 1 January 2000 to 31 December 2017. Duplicate removal and a search for associated publications was performed using the ClinicalTrials.gov identifier (NCT identifier) and official study title as the primary and secondary identifiers, respectively (Figure 1). Results produced from both the ClinicalTrials.gov and PubMed searches were assessed for eligibility, and relevant variables extracted. A complete methodology is described in supplemental Appendix 2, with exclusionary criteria detailed in both Figure 1 and supplemental Appendix 2D. After screening and eligibility assessment, there were 78 therapeutic studies focusing on FLT3 AML remaining, and an attempt was made to find abstract or full-article publications for these trials. The 78 clinical trials and publications were sorted into 4 groups: group A: newly diagnosed/treatment naive; group B: relapsed/refractory; group C: newly diagnosed and/or relapsed/refractory; and group D: other, nonspecific inclusion language. All unique pharmaceutical agents used for the study of possible FLT3-mutant inhibition were subsequently identified and confirmed through review of available literature.

Figure 1.

Flow diagram depicting the process of duplicate removal and screening per PRISMA 2009 guidelines.

Figure 1.

Flow diagram depicting the process of duplicate removal and screening per PRISMA 2009 guidelines.

Close modal

An updated search was performed in ClinicalTrials.gov, using the above-mentioned search criteria to account for studies posted between 11 October 2017 and 31 December 2018. This produced 18 additional trials; however, only 7 met criteria for inclusion.

Analysis of trends in trial recruitment

Analysis was performed on all studies registered to ClinicalTrials.gov from 2000 to 2017 that met criteria for inclusion, as detailed in the methods (n = 66). Accrual duration (D) was calculated using the study start date and estimated primary completion date, with variable D used to calculate the average number of patients needed to be enrolled per year (Q) to correspond to the estimated or completed enrollment number. If enrollment was ongoing, Q was found by dividing estimated enrollment by accrual duration, D; if enrollment was completed, the number of persons enrolled at completion was used in place of estimated enrollment. The average number of patients needed to be enrolled per year (Q) was used to estimate the average number of patients accrued in each year of study (P; Table 1).

Table 1.

Methodology for analysis of the 66 studies registered to ClinicalTrials.gov from 2000 to 2017 that met criteria for inclusion

Process stepVariable
Accrual duration (D) of each study from ClinicalTrials.gov D = (estimated primary completion date − study start date)/365.25 
The average number of patients needed to be enrolled per year (Q) to correspond to the estimated (or completed) enrollment number Q = Estimated Enrollment (or completed enrollment)/D 
Estimated average number of patients accrued in each year of study Pij = (Q / 12 mo) * number of months study accrual was active that year (Mi
i = active year; j = NCT number. 
Months were included in Mi for dates ≤15th and were excluded in Mi for dates >15th 
Estimate for number of patients needed for enrollment in final study year Pij (last year of study) = Estimated (or Completed) Enrollment – Sum of all previous Pij 
Process stepVariable
Accrual duration (D) of each study from ClinicalTrials.gov D = (estimated primary completion date − study start date)/365.25 
The average number of patients needed to be enrolled per year (Q) to correspond to the estimated (or completed) enrollment number Q = Estimated Enrollment (or completed enrollment)/D 
Estimated average number of patients accrued in each year of study Pij = (Q / 12 mo) * number of months study accrual was active that year (Mi
i = active year; j = NCT number. 
Months were included in Mi for dates ≤15th and were excluded in Mi for dates >15th 
Estimate for number of patients needed for enrollment in final study year Pij (last year of study) = Estimated (or Completed) Enrollment – Sum of all previous Pij 

Analysis to identify trends in trial recruitment was performed to provide estimates of discrepancies in anticipated clinical trial enrollment. This was done using consistently cited rates of adult clinical trial participation of 1%, 3%, and 5% vs the participant recruitment needed to fulfill specified accrual numbers for primary completion.26-28  The decision was made to exclude the 12 unique publications available through the PubMed search, as study duration was not consistently reported. The updated search performed from October 2017 to December 2018 produced 7 additional studies that had not yet reached completion and are also not included in statistical analysis.

Two assumptions were made for the analysis: accrual rate is constant during the duration of the trial, and the rate of FLT3 mutations has been constant, at 30%, since 2000. Data were obtained and analyzed using the Centers for Disease Control and Prevention and Surveillance, Epidemiology, and End Results databases; literature review; and Microsoft Excel.

Descriptive findings

Of the 85 included trials and publications, the majority were phase 2 trials (n = 27; 31.8%) and were actively recruiting (n = 32; 37.6%) or completed (n = 29, 34.1%; supplemental Appendix 3). Twenty-five unique pharmaceutical or biological agents, either known FLT3 inhibitors or investigational agents used with the intent of targeting this molecular abnormality, were identified and corroborated by literature review (Figure 2).19,29-52  Thirty different pharmaceutical companies acted as collaborators or sole sponsors of these interventional studies (supplemental Appendix 3). Eighteen studies did not list sponsorship/collaboration as coming from a pharmaceutical company. Additional sponsors include the academic universities acting as primary sites, as well as cooperative groups, nonprofit and charitable foundations, and subdivisions of the National Institutes of Health. Of the 30 unique pharmaceutical companies offering sponsorship/collaboration, 25 were the pharmaceutical developers of the proposed FLT3 inhibitors (Figure 2). Pharmaceutical vs nonprofit/cooperative group involvement was 2.3:1. The most prominent pharmaceutical sponsorships were Novartis (midostaurin, PKC 412) and Arog (crenolanib), which sponsored/collaborated on 13 and 8 trials, respectively.

Figure 2.

Unique pharmaceutical agents identified in search and used with the intent of treating FLT3 AML.

Figure 2.

Unique pharmaceutical agents identified in search and used with the intent of treating FLT3 AML.

Close modal

Representation of subgroups

These 85 studies were further divided into 4 groups on the basis of language used in inclusion criteria: group A: newly diagnosed or untreated (n = 19); group B: relapsed/refractory (n = 27); group C: both newly diagnosed or relapsed/refractory (n = 11); and group D: nonspecific language in their inclusion criteria (n = 28), such as: AML in complete remission, patients status after allogeneic stem cell transplant, relapsed/refractory or unfit for induction because of age/comorbidity/other factors per principal investigators discretion, refusal of induction therapy, or AML for which no standard treatment is available (supplemental Appendix 3). Interventional studies represented both international and US sites: 44.4% of the studies included in group A, 52% of the studies included in group B, 36.4% of the studies in group C, and 46.2% of the studies in group D took place in the United States only.

Midostaurin, crenolanib, sorafenib, quizartinib, pacritinib, gilteritinib, sunitinib, lestaurtinib, and SU5416 were used as an interventional agent by more than 1 subgroup (supplemental Appendix 3). Midostaurin was predominately used in trials aimed at targeting newly diagnosed/untreated individuals (group A; n = 9), and was used a total of 8 times across the other 3 groups. Only 1 study (NCT03258931) proposed a head-to-head comparison, exploring the efficacy of midostaurin vs crenolanib. This randomized trial is recruiting as of 15 August 2018, and plans to accrue 510 subjects; estimated primary completion is in November 2022.

Trends in trial recruitment

The 66 ClinicalTrials.gov studies represent 33 US-only trials, 17 international-only trials, 13 studies active both at international and US sites, and 3 trials for which no site location was available at the time of data collection. Projected accrual is as follows: 3802 participants for the combined US and international studies (includes the 3 trials with unlisted location), 2109 participants for international-only trials, and 1704 participants for US-only trials.

Seventeen (25.8%) of the 66 registered trials were newly diagnosed FLT3-mutant AML, and 19 (28.8%) of the 66 registered trials were for relapsed/refractory FLT3-mutant AML. Total accrual for newly diagnosed trials (n = 17) was projected at 3432, with an average of 201.88 patients per trial. Of the 17 newly diagnosed trials, 8 were US only, 6 were international only, and 3 were both US and international. Of the 19 relapsed/refractory trials, 11 were US only, 5 were international only, and 3 were US + international. Projected accrual mean and standard deviation for newly diagnosed and relapsed/refractory trials are included in Table 2. Projected accrual by trial phase for newly diagnosed and relapsed/refractory-only trials is included in Table 3.

Table 2.

Projected accrual, mean, and standard deviation for newly diagnosed (n = 17, 25.8%) and relapsed/refractory (n = 19, 28.8%) trials

Type and locationn (%)MeanSD
Newly diagnosed    
 United States only 824 (24) 103 165.37 
 International only 1286 (38) 214.33 225.71 
 United States + international 1322 (39) 440.67 334.35 
 Total, N 3432   
Relapsed/refractory    
 United States only 1025 (34) 73.21 79.45 
 International only 1073 (36) 214.60 150.11 
 United States + international 924 (31) 308 74.71 
 Total, N 3022   
Type and locationn (%)MeanSD
Newly diagnosed    
 United States only 824 (24) 103 165.37 
 International only 1286 (38) 214.33 225.71 
 United States + international 1322 (39) 440.67 334.35 
 Total, N 3432   
Relapsed/refractory    
 United States only 1025 (34) 73.21 79.45 
 International only 1073 (36) 214.60 150.11 
 United States + international 924 (31) 308 74.71 
 Total, N 3022   

SD, standard deviation.

Table 3.

Enrollment targets (United States only, international only, international + United States)

Total projected enrollment
Newly diagnosed (n = 17)  
 Phase 1 88 
 Phase 1/2 93 
 Phase 2 948 
 Phase 2/3 540 
 Phase 3 1763 
Relapsed/refractory (n = 19)  
 Phase 1 197 
 Phase 1/2 333 
 Phase 2 760 
 Phase 3 1652 
Total projected enrollment
Newly diagnosed (n = 17)  
 Phase 1 88 
 Phase 1/2 93 
 Phase 2 948 
 Phase 2/3 540 
 Phase 3 1763 
Relapsed/refractory (n = 19)  
 Phase 1 197 
 Phase 1/2 333 
 Phase 2 760 
 Phase 3 1652 

We used the study start dates and primary completion dates of all 66 clinical trials from ClinicalTrials.gov remaining after duplicate removal and screening to identify the duration of each trial. These 66 trials were identified in the initial search. Primary completion date was chosen, as this was consistently reported across trials. Incidence data were collected from the Centers for Disease Control and Prevention and Surveillance, Epidemiology, and End Results databases or from publications.53,54  These data were analyzed within the context of the anticipated enrollment across all trials from 2000 to 2017, and contrasted with 1%, 3%, and 5%. clinical trial participation rates. Historical clinical trial participation at 1%, 3%, and 5% was chosen on the basis of evidence suggesting that 5% or less of all individuals with cancer in the United States enroll and partake in clinical studies.26-28  An additional bar depicting projections for 10% clinical trial participation was added to represent the potential for increased enrollment taking place outside the United States and at National Cancer Center-designated cancer centers, based on the American Society of Clinical Oncology statement on minimum standards and exemplary attributes of clinical trial sites.55 

As seen in Figure 3A-B, the number of FLT3-positive patients needed to satisfy study enrollment for FLT3-targeted therapeutic trials begins to surpass the upper bound of estimated participation in 2010 and noticeably surpasses projected participation rates between 2015 and 2016. Beginning with 2015 in Figure 3B (US + international trials), approximately 6.82% of all patients newly diagnosed with FLT3-mutated AML would need to enroll in a clinical trial to satisfy accrual for that year. In 2016, this grows to 10.88% of all FLT3-mutated AML, and in 2017, this number grows to 14.76%, or approximately 3 times the percentage of individuals with any cancer type who will enroll in a clinical study. Enrollment needs to satisfy recruitment surpassed a 10% participation rate for US + international trials in 2016 (Figure 3B). The number of patients needed to satisfy study enrollment surpassed 5% estimated participation for US-only trials in 2017, and 3% estimated participation in 2016 (Figure 3C).

Figure 3.

Recruitment needs vs clinical trial participation rates at 1%, 3%, 5%, and 10% reflected by the green, yellow, gray, and red bars, respectively. This graph represents trials that accrued in the United States, internationally, and in the United States + internationally (A); in the United States and/or the United States + internationally (B); or in the United States only (C). The period reflects trials that were completed and/or enrolling between 2000 and 2017.

Figure 3.

Recruitment needs vs clinical trial participation rates at 1%, 3%, 5%, and 10% reflected by the green, yellow, gray, and red bars, respectively. This graph represents trials that accrued in the United States, internationally, and in the United States + internationally (A); in the United States and/or the United States + internationally (B); or in the United States only (C). The period reflects trials that were completed and/or enrolling between 2000 and 2017.

Close modal

Although it is possible that the inclusion of US-only as well as US + international trials may confound our results, it is unlikely to significantly alter our conclusions. Should trends in US-only clinical trial recruitment needs continue, enrollment needs beyond the available US patient population would need to come from international locations. Thus, Figure 3C would show a bigger discrepancy if the possibility of concurrent international and US accrual were not considered.

Despite the investment in targeted therapies for FLT3-mutated AML, this distinct mutational subset only represents a quarter of all de novo AML cases.11,15,16,19,20  According to our analysis, approximately 15% of patients with FLT3-mutated AML in 2017 would have needed to participate in clinical trials to satisfy the eligibility requirements of all therapeutic FLT3 inhibitor studies. The current rate of clinical trial participation in the United States, at 3% to 5%, is not reflected in our data or in the results of our subsequent analysis.26  Given the heterogeneity of AML, it is not unlikely that the future of clinical trial development will include combinations of targeted agents. For example, IDH1 and IDH2 mutations co-occur with FLT3-ITD mutations in 15% to 27% and 8% to 30% of cases, respectively.56  With the approval of enasidenib (IDH2) and ivosidenib (IDH1) in 2018 and 2019, respectively, targeted combination trials may make more acute the difficulty in satisfying enrollment projections. There is also the potential for our results to underestimate the competition for patients with FLT3-mutant AML, given that some trials (eg, NCT03092674) allow for the treatment of both FLT3-mutant and FLT3-negative participants with a FLT3 inhibitor. Rates of participation may be slightly greater than 1% to 5% for AML if trials are recruiting mutant and wild-type participants as well. Competition for FLT3-mutant trial participants may also be enhanced by the promising clinical results of new therapies that are not FLT3-targeted agents, such as those described in the phase 1/2 results of the combination study of venetoclax with azacytidine or decitabine (NCT02203773).57  Treatment of FLT3-mutant patients under investigational protocols that do not include a FLT3 inhibitor puts further strain on the ability of inhibitor trials to fulfill accrual requirements.

Clinical trials in the era of precision medicine have led to the investigation of multiple therapeutic agents targeting similar and/or identical genomic variants or oncogenic pathways. One possible effect of this biomedical advance is a smaller pool of patients who harbor molecular or genetic abnormalities than may be eligible for trial participation.1  There is also a concern that an abundance of trials focusing on relatively narrow subsets of the population may lead to duplicative analyses, a concern that has been addressed by prior research.6-9,58,59  With the approval of FLT3 inhibitors midostaurin and gilteritinib for newly diagnosed and relapsed/refractory AML, it is likely that more FLT3-mutant patients will receive FLT3 inhibitors that are not part of an investigational trial. Loosening inclusion and exclusion criteria that limits prior exposure to a FLT3 inhibitor could be a way to enhance enrollment numbers. An alternative approach would be to deploy alternative measures to determine effectiveness. The US Food and Drug Administration has provided some guidance by encouraging clinical investigators to develop minimum residual disease assays to be used as surrogates in measuring clinical benefit.60  However, larger phase 3 studies are still needed to evaluate meaningful clinical benefit through survival measures, such as event-free survival or overall survival.

There might also be benefit from broader efforts in both adult and pediatric oncology to enhance the supply of patients for clinical trial participation. In 2018, the National Cancer Institute loosened eligibility requirements for patients with brain metastases, HIV/AIDs, organ dysfunction, prior or current malignancies, and those younger than 18 years.61  This move was supported by additional professional organizations, such as the American Society of Clinical Oncology and Friends of Cancer Research. Promotion of the Children’s Oncology Group has resulted in 90% to 95% of pediatric patients 15 years old or younger receiving care from Children’s Oncology Group-affiliated institutions, with 50% to 60% of trial-eligible children treated on a study protocol if one is available.62,63  Pediatric patients diagnosed with acute lymphoblastic leukemia have seen great benefit from these collaborative initiatives, with cure rates rising from 10% to 90% since the 1960s, evidence that collective efforts to include and treat individuals on such protocols is promising.64  Improved clinical trial enrollment with the intent of improving cancer outcomes has been adopted in adult clinical trials in the United Kingdom as well. In 1999, survival rates were poor when compared with other European Union members, and clinical trial accrual was less than 3.5% of incident cases.61  There have been higher adult participation rates in clinical trials since implementation of the National Health Service Cancer Plan and Cancer Networks in the United Kingdom, where participation is as high as 12% of annual incident cases.65 

The inability to successfully accrue subjects to clinical trials may lead to unpublished scientific findings and research data.8,9,26  Noncompletion of a clinical study can result in exposure of patients to investigational agents without thorough investigation into the benefits or adverse events this may elicit.26  Our findings have prompted supply-side suggestions for increasing clinical trial participation. However, it is worth considering the structure of demand as well. Statistical rigor of phase 2 and 3 clinical trials could be altered to increase acceptable false-positive rates or choose 1-sided instead of 2-sided tests. Phase 1 and 2 trials could concurrently examine efficacy and toxicity. This might represent too large a risk. Alternatively, more rigorous phase 1 and 2 trials could result in only the most beneficial results moving toward larger phase 3 trials. However, one could argue that the production of multiple drugs targeting similar pathways or mutations at any stage of development is good, in that it promotes competition among drug companies, ultimately leading to cheaper drugs for the patient.

Clinical trial conduct and enrollment in the United States is a complex issue without a clear fix. Investment in past and present trends is a promising start. “Venture philanthropy” has incentivized industry and federal partnerships by sharing financial risk, contributing to shortened translational processes and a focus on “human return.”66  Partnerships between foundations and academic institutions have also improved early development by enhancing access both to patients for clinical trial participation and disease specialists for study design consultation.66  For example, growth of the Multiple Myeloma Research Consortium has led to standardized language for clinical trial agreements to allow for multisite integration and further investment and input from industry-led trials.66  The Multiple Myeloma Research Consortium represents partnerships among industry, the US Food and Drug Administration, and the Multiple Myeloma Research Foundation.66  Another method is to work within existing precompetitive public-private partnerships or to advocate for the formation of new partnerships.67  Public-private partnerships offer a groundwork for governmental, university, patient organizations/foundations, and industry collaboration.67  Last, umbrella or basket/master trials allow the opportunity for treatment assignment on the basis of genetic, molecular, cellular, or immune markers, creating a “funneled” screening approach that can increase patient participation and “fit.”68  This again requires flexible partnerships among regulatory agencies, pharmaceutical industries, genomic testing, and academic and clinical sites.68  Examples of umbrella and basket/master trials are the National Cancer Institute Match trial, the TAPUR trial, the Lung-MAP trial, and the Beat AML master trial.68  Encouraging and facilitating ongoing collaboration and partnerships across disciplines is a promising effort to enhance clinical trial participation for patients with FLT3-mutant AML and other malignancies.

Limitations of our study

Systematic review and data extraction were performed by a single person, and are therefore subject to human error. The graphical representations for subgroup analysis are based on US incidence counts only and do not consider the incidence of AML in each international location. In addition, US incidence counts do not include the relapsed/refractory AML population.

Accrual duration was calculated using study start date and primary completion date, where the primary completion date represents the date of data collection for primary endpoint measures. Although it is the most consistently reported measure on ClinicalTrials.gov, study accrual can end before primary completion date, and therefore the duration of accrual could potentially be shorter for many of the included studies. All calculations were made with the assumption that accrual rate has been constant over the course of the trial; this does not account for instances in which accrual varies drastically between years. Our data collection methodology does not account for patients who may have enrolled on multiple therapeutic studies for the treatment of AML, particularly early-phase studies, with targeted or nonspecific agents. This may occur in both FLT3 inhibitor trials and trials of other targeted agents. We anticipate this to be a relatively small patient population, as early-phase studies are available at a limited number of cancer centers. More specific to FLT3 inhibitor trials, we note that before the approval of midostaurin in 2017, some FLT3 inhibitor studies would not allow patients with prior FLT3 inhibitor exposure or prior treatment to enroll on new FLT3-targeted trials (eg, NCT01657682), thus making it difficult for a patient to be on multiple FLT3 inhibitor studies. However, inclusion and exclusion criteria were amended in several such studies after FLT3 inhibitors were added as standard of care (eg, NCT02421939).

There is also the possibility of discrepancies in the incidence data from literature publications vs the Centers for Disease Control and Prevention, as mathematical projections could have differed. The use of incidence data alone does not account for relapsed and refractory patients and underestimates a potential pool of patients with FLT3 AML eligible for clinical trials. However, the prevalence data on patients with relapsed or refractory AML are not easily available, and the preliminary analysis indicates that the number of patients with relapsed and refractory FLT3 AML may be quite small after accounting for remission rate, relapse rate, and overall survival.

In addition, 1%, 3%, and 5% accrual is mostly based on solid tumor data. Patients with AML and hematologic malignancy may be seen more often at academic centers, and may have a higher proportion of accrual. Rates of 1%, 3%, and 5% represent accrual to clinical trials with primary locations in the United States. It could be argued that subject recruitment needed beyond the available patient population in the United States would require international participation to reach projected accrual numbers.

Contribution: T.B. and U.B. designed the research and wrote the paper; J.M.Z. and M.M. analyzed results; and J.M.Z. made the figures.

Conflict-of-interest disclosure: U.B. is a consultant for Genentech, Novartis, and Jazz pharmaceuticals. The remaining authors declare no competing financial interests.

Correspondence: Uma Borate, Department of Hematology and Medical Oncology, Oregon Health & Science University Knight Cancer Institute, 3181 SW Sam Jackson Park Rd, Portland, OR 97239; e-mail: borate@ohsu.edu.

1.
Rinde
M
.
Patient shortage for cancer trials grows. OncologyLive. https://www.onclive.com/publications/oncology-live/2018/vol-19-no-9/patient-shortage-for-cancer-trials-grows?p=1. Accessed 15 May 2018
.
2.
Holt
CL
,
Hussain
A
,
Wachbroit
R
,
Scott
J.
Precision medicine across the cancer continuum: implementation and implications for cancer disparities
.
JCO Precision Oncol
.
2017
;
1
:
1
-
5
.
3.
Dankwa-Mullan
I
,
Bull
J
,
Sy
F
.
Precision medicine and health disparities: advancing the science of individualizing patient care
.
Am J Public Health
.
2015
;
105
(
S3 Suppl 3
):
S368
.
4.
Hodi
FS
,
O’Day
SJ
,
McDermott
DF
, et al
.
Improved survival with ipilimumab in patients with metastatic melanoma
.
N Engl J Med
.
2010
;
363
(
8
):
711
-
723
.
5.
The Nobel Assembly at Karolinska Institutet
. The Nobel Assembly at Karolinska Institutet has today decided to award the
2018
Nobel Prize in physiology or medicine jointly to James P. Allison and Tasuko Honjo for their discovery of cancer therapy by inhibition of negative immune regulation [press release]. https://www.nobelprize.org/prizes/medicine/2018/press-release22. Accessed 5 October 2018.
6.
Tang
J
,
Shalabi
A
,
Hubbard-Lucey
VM
.
Comprehensive analysis of the clinical immuno-oncology landscape
.
Ann Oncol
.
2018
;
29
(
1
):
84
-
91
.
7.
Golan
T
,
Milella
M
,
Ackerstein
A
,
Berger
R
.
The changing face of clinical trials in the personalized medicine and immuno-oncology era: report from the international congress on clinical trials in Oncology & Hemato-Oncology (ICTO 2017)
.
J Exp Clin Cancer Res
.
2017
;
36
(
1
):
192
.
8.
Carlisle
B
,
Demko
N
,
Freeman
G
, et al
.
Benefit, risk, and outcomes in drug development: a systematic review of sunitinib
.
J Natl Cancer Inst
.
2015
;
108
(
1
):
djv292
.
9.
Mattina
J
,
Carlisle
B
,
Hachem
Y
,
Fergusson
D
,
Kimmelman
J
.
Inefficiencies and patient burdens in the development of the targeted cancer drug sorafenib: a systematic review
.
PLoS Biol
.
2017
;
15
(
2
):
e2000487
.
10.
Contopoulos-Ioannidis
DG
,
Ntzani
E
,
Ioannidis
JPA
.
Translation of highly promising basic science research into clinical applications
.
Am J Med
.
2003
;
114
(
6
):
477
-
484
.
11.
American Cancer Society
. Acute myeloid leukemia (AML) in adults. https://www.cancer.org/cancer/acute-myeloid-leukemia.html. Accessed 1 December 2017.
12.
Surveillance, Epidemiology, and End Results Program
. Cancer stat facts: leukemia - acute myeloid leukemia (AML). https://seer.cancer.gov/statfacts/html/amyl.html. Accessed 1 December 2017.
13.
Lam
SSY
,
He
ABL
,
Leung
AYH
.
Treatment of acute myeloid leukemia in the next decade - towards real-time functional testing and personalized medicine
.
Blood Rev
.
2017
;
31
(
6
):
418
-
425
.
14.
Garcia
JS
,
Stone
RM
.
The development of FLT3 inhibitors in acute myeloid leukemia
.
Hematol Oncol Clin North Am
.
2017
;
31
(
4
):
663
-
680
.
15.
Ferrara
F
,
Schiffer
CA
.
Acute myeloid leukaemia in adults
.
Lancet
.
2013
;
381
(
9865
):
484
-
495
.
16.
Marhall
A
,
Fischer
T
,
Heidel
FH
, et al
.
Internal tandem duplication (ITD) in the tyrosine kinase domain of FLT3 displays higher oncogenic potential in acute myeloid leukemia
.
Blood
.
2016
;
128
(
22
):
5118
.
17.
Fathi
AT
,
Chen
Y-B
.
The role of FLT3 inhibitors in the treatment of FLT3-mutated acute myeloid leukemia
.
Eur J Haematol
.
2017
;
98
(
4
):
330
-
336
.
18.
Thiede
C
,
Steudel
C
,
Mohr
B
, et al
.
Analysis of FLT3-activating mutations in 979 patients with acute myelogenous leukemia: association with FAB subtypes and identification of subgroups with poor prognosis
.
Blood
.
2002
;
99
(
12
):
4326
-
4335
.
19.
Larrosa-Garcia
M
,
Baer
MR
.
FLT3 inhibitors in acute myeloid leukemia: current status and future directions
.
Mol Cancer Ther
.
2017
;
16
(
6
):
991
-
1001
.
20.
Fathi
AT
,
Chen
Y-B
.
Treatment of FLT3-ITD acute myeloid leukemia
.
Am J Blood Res
.
2011
;
1
(
2
):
175
-
189
.
21.
DiNardo
CD
,
Stone
RM
,
Medeiros
BC
.
Novel therapeutics in acute myeloid leukemia
.
Am Soc Clin Oncol Educ Book
.
2017
;
37
:
495
-
503
.
22.
US Food and Drug Administration
. Midostaurin. https://www.fda.gov/drugs/resources-information-approved-drugs/midostaurin. Accessed 1 December 2017.
23.
Kayser
S
,
Levis
MJ
.
Advances in targeted therapy for acute myeloid leukaemia
.
Br J Haematol
.
2018
;
180
(
4
):
484
-
500
.
24.
Bode
AM
,
Dong
Z
.
Recent advances in precision oncology research
.
NPJ Precis Oncol
.
2018
;
2
:
11
.
25.
Moher
D
,
Liberati
A
,
Tetzlaff
J
,
Altman
DG
;
PRISMA Group
.
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement
.
PLoS Med
.
2009
;
6
(
7
):
e1000097
.
26.
Unger
JM
,
Cook
E
,
Tai
E
,
Bleyer
A
.
Role of clinical trial participation in cancer research: barriers, evidence, and strategies
.
Am Soc Clin Oncol Educ Book
.
2016
;
35
(
36
):
185
-
198
.
27.
Murthy
VH
,
Krumholz
HM
,
Gross
CP
.
Participation in cancer clinical trials: race-, sex-, and age-based disparities
.
JAMA
.
2004
;
291
(
22
):
2720
-
2726
.
28.
Institute of Medicine (US) Committee on Cancer Clinical Trials and the NCI Cooperative Group Program
.
Nass SJ, Moses HL, Mendelsohn J, editors. Physician and patient participation in cancer clinical trials. A National Cancer Clinical Trials System for the 21st Century: Reinvigorating the NCI Cooperative Group Program. Washington, DC: National Academies Press; 2010
.
29.
Galanis
A
,
Ma
H
,
Rajkhowa
T
, et al
.
Crenolanib is a potent inhibitor of FLT3 with activity against resistance-conferring point mutants
.
Blood
.
2014
;
123
(
1
):
94
-
100
.
30.
Lee
LY
,
Hernandez
D
,
Rajkhowa
T
, et al
.
Preclinical studies of gilteritinib, a next-generation FLT3 inhibitor
.
Blood
.
2017
;
129
(
2
):
257
-
260
.
31.
Perl
AE
,
Altman
JK
,
Cortes
J
, et al
.
Selective inhibition of FLT3 by gilteritinib in relapsed or refractory acute myeloid leukaemia: a multicentre, first-in-human, open-label, phase 1-2 study
.
Lancet Oncol
.
2017
;
18
(
8
):
1061
-
1075
.
32.
Antar
A
,
Otrock
ZK
,
El-Cheikh
J
, et al
.
Inhibition of FLT3 in AML: a focus on sorafenib
.
Bone Marrow Transplant
.
2017
;
52
(
3
):
344
-
351
.
33.
Wander
SA
,
Levis
MJ
,
Fathi
AT
.
The evolving role of FLT3 inhibitors in acute myeloid leukemia: quizartinib and beyond
.
Ther Adv Hematol
.
2014
;
5
(
3
):
65
-
77
.
34.
Stone
RM
,
Mandrekar
SJ
,
Sanford
BL
, et al
.
Midostaurin plus chemotherapy for acute myeloid leukemia with a FLT3 mutation
.
N Engl J Med
.
2017
;
377
(
5
):
454
-
464
.
35.
Marrin
C
,
Edwards
G
,
Knapper
S
,
Burnett
AK
,
Zabkiewicz
J
,
Alvares
C
.
Pacritinib suppresses leukemic outgrowth from FLT3-ITD positive stroma-adherent primary AML cells
.
[abstract]
Blood
.
2014
;
124
(
21
). Abstract
270
.
36.
FLYSYN
. Synimmune® antibodies for life. https://www.synimmune.de/products/flysyn/. Accessed 13 November 2019.
37.
Burton
E
,
Wong
B
,
Zhang
J
, et al
.
The novel inhibitor PLX3397 effectively inhibits FLT3-mutant AML [abstract]
.
Blood
.
2011
;
118
(
21
). Abstract
3632
.
38.
Cao
ZX
,
Liu
JJ
,
Zheng
RL
, et al
.
SKLB1028, a novel oral multikinase inhibitor of EGFR, FLT3 and Abl, displays exceptional activity in models of FLT3-driven AML and considerable potency in models of CML harboring Abl mutants
.
Leukemia
.
2012
;
26
(
8
):
1892
-
1895
.
39.
National Center for Biotechnology Information
. FGFR/VEGFR/PDGFR/FLT3/SRC Inhibitor XL999. https://www.ncbi.nlm.nih.gov/medgen/853352?report=FullReport. Accessed 13 November 2019.
40.
Zhang
W
,
Borthakur
G
,
Gao
C
, et al
.
The dual MEK/FLT3 inhibitor E6201 exerts cytotoxic activity against acute myeloid leukemia cells harboring resistance-conferring FLT3 mutations
.
Cancer Res
.
2016
;
76
(
6
):
1528
-
1537
.
41.
Yamaura
T
,
Nakatani
T
,
Uda
K
, et al
.
A novel irreversible FLT3 inhibitor, FF-10101, shows excellent efficacy against AML cells with FLT3 mutations
.
Blood
.
2018
;
131
(
4
):
426
-
438
.
42.
Eriksson
A
,
Hermanson
M
,
Wickström
M
, et al
.
The novel tyrosine kinase inhibitor AKN-028 has significant antileukemic activity in cell lines and primary cultures of acute myeloid leukemia
.
Blood Cancer J
.
2012
;
2
(
8
):
e81
.
43.
National Cancer Institute
. FLT3/CDK4/6 Inhibitor FLX925. NCI drug dictionary. https://www.cancer.gov/publications/dictionaries/cancer-drug?CdrID=768269. Accessed 13 November 2019.
44.
Shiotsu
Y
,
Kiyoi
H
,
Ozeki
K
, et al
.
KW-2449, a novel multi-kinase inhibitor against FLT3, Abl, FGFR1 and Aurora, suppresses the growth of AML both in vitro and in vivo
.
Blood
.
2007
;
110
(
11
):
1832
.
45.
Yu
J
,
Huck
J
,
Theisen
M
, et al
.
Anti-tumor activity of TAK-659, a dual inhibitor of SYK and FLT3 kinases, in AML models
.
J Clin Oncol
.
2016
;
34
(
15
):
e14091
.
46.
Sanford
D
,
Blum
WG
,
Ravandi
F
, et al
.
Efficacy and safety of an anti-FLT3 antibody (LY3012218) in patients with relapsed acute myeloid leukemia
.
J Clin Oncol
.
2015
;
33
(
15
):
e7059
.
47.
Hernandez-Davies
JE
,
Zape
JP
,
Landaw
EM
, et al
.
The multitargeted receptor tyrosine kinase inhibitor linifanib (ABT-869) induces apoptosis through an Akt and glycogen synthase kinase 3β-dependent pathway
.
Mol Cancer Ther
.
2011
;
10
(
6
):
949
-
959
.
48.
Yee
KWH
,
O’Farrell
AM
,
Smolich
BD
, et al
.
SU5416 and SU5614 inhibit kinase activity of wild-type and mutant FLT3 receptor tyrosine kinase
.
Blood
.
2002
;
100
(
8
):
2941
-
2949
.
49.
Pratz
KW
,
Levis
M
.
How I treat FLT3-mutated AML
.
Blood
.
2017
;
129
(
5
):
565
-
571
.
50.
Chen
Y
,
Pan
Y
,
Guo
Y
, et al
.
Tyrosine kinase inhibitors targeting FLT3 in the treatment of acute myeloid leukemia
.
Stem Cell Investig
.
2017
;
4
(
6
):
48
.
51.
Chen
W
,
Chan
ASH
,
Dawson
AJ
,
Liang
X
,
Blazar
BR
,
Miller
JS
.
FLT3 ligand administration after hematopoietic cell transplantation increases circulating dendritic cell precursors that can be activated by CpG oligodeoxynucleotides to enhance T-cell and natural killer cell function
.
Biol Blood Marrow Transplant
.
2005
;
11
(
1
):
23
-
34
.
52.
De Kouchkovsky
I
,
Abdul-Hay
M
.
Acute myeloid leukemia: a comprehensive review and 2016 update
.
Blood Cancer J
.
2016
;
6
(
7
):
e441
.
53.
American Society of Clinical Oncology
. Leukemia – Acute Myeloid – AML: Statistics. https://www.cancer.net/cancer-types/leukemia-acute-myeloid-aml/statistics. Accessed 1 August 2019.
54.
Djurisic
S
,
Rath
A
,
Gaber
S
, et al
.
Barriers to the conduct of randomised clinical trials within all disease areas
.
Trials
.
2017
;
18
(
1
):
360
.
55.
Zon
R
,
Meropol
NJ
,
Catalano
RB
,
Schilsky
RL
.
American Society of Clinical Oncology Statement on minimum standards and exemplary attributes of clinical trial sites
.
J Clin Oncol
.
2008
;
26
(
15
):
2562
-
2567
.
56.
Boddu
P
,
Takahashi
K
,
Pemmaraju
N
, et al
.
Influence of IDH on FLT3-ITD status in newly diagnosed AML
.
Leukemia
.
2017
;
31
(
11
):
2526
-
2529
.
57.
DiNardo
CD
,
Pratz
K
,
Pullarkat
V
, et al
.
Venetoclax combined with decitabine or azacitidine in treatment-naive, elderly patients with acute myeloid leukemia
.
Blood
.
2019
;
133
(
1
):
7
-
17
.
58.
Prasad
V
,
McCabe
C
,
Mailankody
S
.
Low-value approvals and high prices might incentivize ineffective drug development
.
Nat Rev Clin Oncol
.
2018
;
15
(
7
):
399
-
400
.
59.
Marquart
J
,
Chen
EY
,
Prasad
V
.
Estimation of the percentage of US patients with cancer who benefit from genome-driven oncology
.
JAMA Oncol
.
2018
;
4
(
8
):
1093
-
1098
.journal
60.
US Food and Drug Administration
.
Hematologic malignancies: regulatory considerations for use of minimal residual disease in development of drug and biological product for treatment.
https://www.fda.gov/media/117035/download. Accessed 28 October 2019.
61.
Walters
S
,
Benitez-Majano
S
,
Muller
P
, et al
.
Is England closing the international gap in cancer survival?
Br J Cancer
.
2015
;
113
(
5
):
848
-
860
.
62.
Hunger
SP
,
Mullighan
CG
.
Acute lymphoblastic leukemia in children
.
N Engl J Med
.
2015
;
373
(
16
):
1541
-
1552
.
63.
O’Leary
M
,
Krailo
M
,
Anderson
JR
,
Reaman
GH
;
Children’s Oncology Group
.
Progress in childhood cancer: 50 years of research collaboration, a report from the Children’s Oncology Group
.
Semin Oncol
.
2008
;
35
(
5
):
484
-
493
.
64.
Haugen
M
,
Kelly
KP
,
Leonard
M
, et al
.
Nurse-led programs to facilitate enrollment to children’s oncology group cancer control trials
.
J Pediatr Oncol Nurs
.
2016
;
33
(
5
):
387
-
391
.
65.
Stead
M
,
Cameron
D
,
Lester
N
, et al;
National Cancer Research Networks across the UK
.
Strengthening clinical cancer research in the United Kingdom
.
Br J Cancer
.
2011
;
104
(
10
):
1529
-
1534
.
66.
Ramsey
BW
,
Nepom
GT
,
Lonial
S
.
Academic, foundation, and industry collaboration in finding new therapies
.
N Engl J Med
.
2017
;
376
(
18
):
1762
-
1769
.
67.
de Vrueh
RLA
,
Crommelin
DJA
.
Reflections on the future of pharmaceutical public-private partnerships: from input to impact
.
Pharm Res
.
2017
;
34
(
10
):
1985
-
1999
.
68.
Burd
A
,
Schilsky
RL
,
Byrd
JC
, et al
.
Challenges and approaches to implementing master/basket trials in oncology
.
Blood Adv
.
2019
;
3
(
14
):
2237
-
2243
.

Author notes

For data sharing, e-mails may be sent to the corresponding author, U.B., at borate@ohsu.edu.

The full-text version of this article contains a data supplement.

Supplemental data