Table 2.

RE-AIM evaluation measures and outcomes by intervention target

RE-AIM domainPatient participantsProvider participants
Reach Percentage of patients enrolled in the study among all eligible patients: 293/611 (48.0%).
Percentage of patients enrolled in the study among those eligible and approached: 293/343 (85.4%).
Percentage of patients included in the analysis (evaluable∗) among all patients who enrolled but were not included in analyses (unevaluable): 235/293 (80.2%).
Representativeness: evaluable participants tended to be older (median age, 28 vs 25 years), female (49% vs 64%), have HbSS/Sβ0-thal genotype (87% vs 77%), higher annual income (60% vs 74% made <$25 000/year) and higher baseline PDC (39.7% vs 18.5%) than unevaluable, but did not differ in educational level or health coverage type (supplemental Table 2). 		Not measured 
Effectiveness Mean change in hydroxyurea adherence among those receiving the intervention and evaluable: 16.3% (P < .0001) increase in the percentage of d covered from the baseline period through 24 wk Change in knowledge of hydroxyurea in the 5-item HU knowledge scale:

  • mean score changed from 4.6 to 4.7, P = .095).

  • baseline scores ≥4: 62/69 (89.9%) providers

  • baseline scores <4, 7/69 (10.1%) providers. Their mean scores improved from 2.1 to 3.4 (P = .022).

  • Change in self-efficacy of hydroxyurea administration in the 12-item scale:

  • mean score changed from 9.6 to 9.5, P = .96;

  • baseline scores ≥6: 46/73 (91.8%) providers;

  • baseline scores <6: 6/73 (8.2%) providers. Their mean scores improved from 3.6 to 8.6 (P = .042).

 
Adoption Percentage of clinics in each site agreeing to support InCharge Health: all 15 participating clinics received training in how to download and use the InCharge Health app; all approached and enrolled potential participants. Percentage of eligible providers approached: all providers in all participating clinics were approached to participate in the study (100%).
The proportion of enrolled providers in the study among all eligible providers at each site: 89/104 (85.6%) 
Implementation Percentage of all enrolled patients who used the InCharge Health app at least once during the study period: 240/293 (81.9%), median use 26 d (IQR, 7-72 d).
Percentage of all enrolled patients who used the InCharge Health app during the study period >1 d: 224/293 (76.5%).
Percentage of all evaluable patients who used InCharge Health at least one d during the study period: 199/235 (84.7%), median use 17 d (range, 1 to 156 of 168 d).
Percentage of all evaluable patients who used InCharge Health >1 d during the study period: 185/235 (78.7%) 		Percentage of enrolled providers who used the HU Toolbox app during the study period at least once: 58/89 (65.2%).
At least a single use of the app by provider type:

  • physicians: 34 of 49 (69.4%);

  • PAs/NPs: 23 of 36 (63.9%).

10 (11.2%) of all providers used the app at least 6 d over 168 d (i.e., at least once per mo) 
Maintenance Percentage of enrolled patients who used the InCharge Health app in the post-study period >1 d: 133/293 (56.6%), median use 17 of 84 d (range, 1-82 d)
Percentage of evaluable patients who used the InCharge Health app in the post-study period >1 d: 118/235 (50.2%), median use 19 of 84 d (range, 1-82 d)
Mean change in hydroxyurea adherence among those receiving the intervention and evaluable: 11.8% (P < .0001) increase in the percentage of d covered from the baseline period through the post-study period 		Percentage of enrolled providers who used the HU Toolbox app in the post-study period at least once: 10/89 (11.2%) 
RE-AIM domainPatient participantsProvider participants
Reach Percentage of patients enrolled in the study among all eligible patients: 293/611 (48.0%).
Percentage of patients enrolled in the study among those eligible and approached: 293/343 (85.4%).
Percentage of patients included in the analysis (evaluable∗) among all patients who enrolled but were not included in analyses (unevaluable): 235/293 (80.2%).
Representativeness: evaluable participants tended to be older (median age, 28 vs 25 years), female (49% vs 64%), have HbSS/Sβ0-thal genotype (87% vs 77%), higher annual income (60% vs 74% made <$25 000/year) and higher baseline PDC (39.7% vs 18.5%) than unevaluable, but did not differ in educational level or health coverage type (supplemental Table 2). 		Not measured 
Effectiveness Mean change in hydroxyurea adherence among those receiving the intervention and evaluable: 16.3% (P < .0001) increase in the percentage of d covered from the baseline period through 24 wk Change in knowledge of hydroxyurea in the 5-item HU knowledge scale:

  • mean score changed from 4.6 to 4.7, P = .095).

  • baseline scores ≥4: 62/69 (89.9%) providers

  • baseline scores <4, 7/69 (10.1%) providers. Their mean scores improved from 2.1 to 3.4 (P = .022).

  • Change in self-efficacy of hydroxyurea administration in the 12-item scale:

  • mean score changed from 9.6 to 9.5, P = .96;

  • baseline scores ≥6: 46/73 (91.8%) providers;

  • baseline scores <6: 6/73 (8.2%) providers. Their mean scores improved from 3.6 to 8.6 (P = .042).

 
Adoption Percentage of clinics in each site agreeing to support InCharge Health: all 15 participating clinics received training in how to download and use the InCharge Health app; all approached and enrolled potential participants. Percentage of eligible providers approached: all providers in all participating clinics were approached to participate in the study (100%).
The proportion of enrolled providers in the study among all eligible providers at each site: 89/104 (85.6%) 
Implementation Percentage of all enrolled patients who used the InCharge Health app at least once during the study period: 240/293 (81.9%), median use 26 d (IQR, 7-72 d).
Percentage of all enrolled patients who used the InCharge Health app during the study period >1 d: 224/293 (76.5%).
Percentage of all evaluable patients who used InCharge Health at least one d during the study period: 199/235 (84.7%), median use 17 d (range, 1 to 156 of 168 d).
Percentage of all evaluable patients who used InCharge Health >1 d during the study period: 185/235 (78.7%) 		Percentage of enrolled providers who used the HU Toolbox app during the study period at least once: 58/89 (65.2%).
At least a single use of the app by provider type:

  • physicians: 34 of 49 (69.4%);

  • PAs/NPs: 23 of 36 (63.9%).

10 (11.2%) of all providers used the app at least 6 d over 168 d (i.e., at least once per mo) 
Maintenance Percentage of enrolled patients who used the InCharge Health app in the post-study period >1 d: 133/293 (56.6%), median use 17 of 84 d (range, 1-82 d)
Percentage of evaluable patients who used the InCharge Health app in the post-study period >1 d: 118/235 (50.2%), median use 19 of 84 d (range, 1-82 d)
Mean change in hydroxyurea adherence among those receiving the intervention and evaluable: 11.8% (P < .0001) increase in the percentage of d covered from the baseline period through the post-study period 		Percentage of enrolled providers who used the HU Toolbox app in the post-study period at least once: 10/89 (11.2%) 

The study period includes the period between baseline through week 24. The poststudy period includes weeks 24 through 36.

∗

Evaluable patients had baseline and week 24 PDC data and were included in the primary outcome analysis for effectiveness, n = 235.

View Large
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal