In this issue of Blood, Kurosawa et al use a Markov decision process (MDP) of allogeneic hematopoietic cell transplantation (alloHCT) versus chemotherapy in patients with acute myeloid leukemia (AML) in first complete remission (CR1).1 

“In probability theory, a stochastic or random process is the counterpart to a deterministic process…. Instead of dealing with only one possible reality of how the process might evolve over time (eg, solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy in its future evolution described by probability distributions.”2  To simplify, how can one quantify complicated processes for which there is uncertainty, often at each process step or transition? Andrei Andreyevich Markov, a Russian mathematician, is the father of understanding and quantifying stochastic processes; decision processes that contain elements of uncertainty are often named after him. An online tutorial discusses partially observable MDPs.3 

Several investigators have attempted to determine the optimal approach to the clinical management of AML patients in CR1. Strategies have focused on disease characteristics that would predict for a higher risk of relapse such as cytogenetic and molecular markers, ability to attain remission, and other factors including patient age, comorbidities, and donor availability. AlloHCT is associated with a higher early risk of treatment-related mortality (TRM) than chemotherapy and has a unique risk of graft-versus-host disease (GVHD). However, alloHCT is accompanied by the salutary graft-versus leukemia (GVL) effect that significantly decreases the risk of AML relapse compared with chemotherapy. How can these risks be analyzed along with their effects on quality of life (QOL)? MDP has been implemented for medical decision making when evaluating therapy options along with economic, QOL, and/or outcome analyses.4  However, it has not been used frequently for decision making with regard to the use and timing of alloHCT for hematologic disorders. The first report of MDP for AML patients in CR1 was published in 1996 when the rate of alloHCT-TRM was higher, when only younger patients were eligible for alloHCT and without the benefit of cytogenetic and molecular risk stratification.5  Furthermore, MDPs were conducted for alloHCT in the treatment of chronic myeloid leukemia in the pre- and post-imatinib eras, myelodysplastic syndrome in the pre-demethylation agent era, and also for sickle cell anemia.6-9  The analysis of posttreatment outcomes is complex with competing risks for death such as chemotherapy toxicity, GVHD (alloHCT only), infection, and AML relapse. Thus, statistical models that account for competing risks by multistate modeling or landmark analyses allow clinicians to better determine the risk of various patient outcomes for clinical recommendations.10,11 

With a life-threatening disease such as AML, optimizing treatment to prolong survival is the ultimate goal. However, for many patients, in the words of Abraham Lincoln “…it is not the years in your life that count. It is the life in your years.” In the Kurosawa et al analysis, QOL for each state (no relapse without GVHD, no relapse with GVHD, relapse and death for alloHCT in CR1 vs no relapse, relapse, second remission after salvage alloHCT and relapse and death [the lowest QOL measure]) was evaluated by physicians but not by patients. Future analysis might prospectively measure patient-reported QOL outcomes in patients pre- and posttreatment to determine long-term effects of various treatments on QOL that are important to patients. Comparing patient-reported outcomes with physician-assigned QOL—and determining the complexity of interpatient variability in their valuation of QOL and satisfaction with their treatment decision-making—will be very informative. Some individuals place greater value on surviving to experience more of life's milestones, while others place greater value on the quality of that existence; this applies to physicians, patients, and their caregivers. Understanding decision-making in an era of complex treatment choices will allow physicians and patients to make more informed decisions when faced with the prospect of choosing alloHCT or chemotherapy as the best therapeutic option.

When faced with self-determination (“To do is to be”: Socrates) versus determinism (“To be is to do”: Sartre), preservation of existence (“To be or not to be”: Shakespeare) matters in the context of QOL.

Conflict-of-interest disclosure: The authors declare no competing financial interests. ■

1
Kurosawa
 
S
Yamaguchi
 
T
Miyawaki
 
S
, et al. 
A Markov decision analysis of allogeneic hematopoietic cell transplantation versus chemotherapy in patients with acute myeloid leukemia in first remission.
Blood
2011
, vol. 
117
 
7
(pg. 
2113
-
2120
)
2
Stochastic process.
Accessed January 5, 2011 
3
Partially observable Markov decision processes.
Accessed January 5, 2011 
4
Gheorghe
 
AV
Bali
 
HN
Hill
 
WJ
Carson
 
ER
Dynamic decision models for clinical diagnosis.
Int J Biomed Comput
1976
, vol. 
7
 
2
(pg. 
81
-
92
)
5
Hertenstein
 
B
Heil
 
G
Heimpel
 
H
Allogenic bone marrow transplantation or chemotherapy for patients with acute myeloid leukemia in first complete remission: a decision analysis approach.
Ann Hematol
1996
, vol. 
72
 
4
(pg. 
223
-
230
)
6
Lee
 
SJ
Kuntz
 
KM
Horowitz
 
MM
, et al. 
Unrelated donor bone marrow transplantation for chronic myelogenous leukemia: a decision analysis.
Ann Intern Med
1997
, vol. 
127
 
12
(pg. 
1080
-
1088
)
7
Skrepnek
 
GH
Ballard
 
EE
Cost-efficacy of imatinib versus allogeneic bone marrow transplantation with a matched unrelated donor in the treatment of chronic myelogenous leukemia: a decision-analytic approach.
Pharmacotherapy
2005
, vol. 
25
 
3
(pg. 
325
-
334
)
8
Cutler
 
CS
Lee
 
SJ
Greenberg
 
P
, et al. 
A decision analysis of allogeneic bone marrow transplantation for the myelodysplastic syndromes: delayed transplantation for low-risk myelodysplasia is associated with improved outcome.
Blood
2004
, vol. 
104
 
2
(pg. 
579
-
585
)
9
Nietert
 
PJ
Abboud
 
MR
Silverstein
 
MD
Jackson
 
SM
Bone marrow transplantation versus periodic prophylactic blood transfusion in sickle cell patients at high risk of ischemic stroke: a decision analysis.
Blood
2000
, vol. 
95
 
10
(pg. 
3057
-
3064
)
10
van Houwelingen
 
HC
Putter
 
H
Dynamic predicting by landmarking as an alternative for multi-state modeling: an application to acute lymphoid leukemia data.
Lifetime Data Anal
2008
, vol. 
14
 
4
(pg. 
447
-
463
)
11
Klein
 
JP
Andersen
 
PK
Regression modeling of competing risks data based on pseudovalues of the cumulative incidence function.
Biometrics
2005
, vol. 
61
 
1
(pg. 
223
-
229
)
Sign in via your Institution