Implementation Science

A pragmatic randomized trial to compare strategies for implementing primary HPV testing for routine cervical cancer screening in a large healthcare system

Recent updates to national guidelines recommend primary human papillomavirus (HPV) screening for routine cervical cancer screening alongside previously recommended screening options. However, limited guidance exists for implementation approaches that best facilitate cancer screening practice substitution and achieve optimal stakeholder-centered outcomes. We compared "centrally-administered + locally-tailored" (here after referred to as locally-tailored) vs. "centrally-administered + usual care" (here after referred to as centrally-administered) approaches for achieving substitution of HPV and cytology co-testing with primary HPV screening for routine cervical cancer screening to examine the effect of local tailoring on implementation and stakeholder-centered outcomes. We conducted a pragmatic, cluster randomized trial embedded in the Kaiser Permanente Southern California (KPSC) health system, randomly assigning site groups to study arms at the level of the geographic service area (12 service area randomized). The study took place between 2020-2022. Centrally-administered implementation strategy bundles included physician and staff educational activities. Sites in the locally-tailored arm underwent local needs assessment followed by local selection, tailoring and deployment of implementation strategy bundles. The primary outcome was the proportion of primary HPV screenings among all screenings performed. Secondary stakeholder-centered outcomes included patient (knowledge, emotional reaction, satisfaction, volume of patient inquiries) and provider outcomes (perception, knowledge, acceptance, and satisfaction) measured via repeated surveys or electronic health records. The generalized estimating equation framework and the difference-in-differences approach were used to compare outcomes across study arms. The proportion of appropriate screenings (i.e., use of primary HPV screening) during the post-intervention period was high, with no observed difference between study arms: 98.4% (95% confidence interval [CI] 96.3%-100%) for the locally-tailored arm and 99.1% (95% CI: 97.8%-100%) for the centrally-administered arm (p = 0.34). There were no statistically or clinically significant differences in patient- and provider- outcomes between study arms. Primary HPV screening was feasible and demonstrated high fidelity in all KPSC service areas. The locally-tailored practice substitution approach and centrally-administered practice substitution approach both achieved near complete uptake of primary HPV screening. Further, similar effects on stakeholder-centered outcomes were observed for both approaches. However, generalizability of our findings may be limited due to unique features of our integrated health system. NCT04371887. Registered 30 April 2020, URL: https://clinicaltrials.gov/study/NCT04371887?cond=primary%20HPV%20screening&rank=5 .

Protocol to evaluate sequential electronic health record-based strategies to increase genetic testing for breast and ovarian cancer risk across diverse patient populations in gynecology practices

Abstract Background Germline genetic testing is recommended by the National Comprehensive Cancer Network (NCCN) for individuals including, but not limited to, those with a personal history of ovarian cancer, young-onset (< 50 years) breast cancer, and a family history of ovarian cancer or male breast cancer. Genetic testing is underused overall, and rates are consistently lower among Black and Hispanic populations. Behavioral economics-informed implementation strategies, or nudges, directed towards patients and clinicians may increase the use of this evidence-based clinical practice. Methods Patients meeting eligibility for germline genetic testing for breast and ovarian cancer will be identified using electronic phenotyping algorithms. A pragmatic cohort study will test three sequential strategies to promote genetic testing, two directed at patients and one directed at clinicians, deployed in the electronic health record (EHR) for patients in OB-GYN clinics across a diverse academic medical center. We will use rapid cycle approaches informed by relevant clinician and patient experiences, health equity, and behavioral economics to optimize and de-risk our strategies and methods before trial initiation. Step 1 will send patients messages through the health system patient portal. For non-responders, step 2 will reach out to patients via text message. For non-responders, Step 3 will contact patients’ clinicians using a novel “pend and send” tool in the EHR. The primary implementation outcome is engagement with germline genetic testing for breast and ovarian cancer predisposition, defined as a scheduled genetic counseling appointment. Patient data collected through the EHR (e.g., race/ethnicity, geocoded address) will be examined as moderators of the impact of the strategies. Discussion This study will be one of the first to sequentially examine the effects of patient- and clinician-directed strategies informed by behavioral economics on engagement with breast and ovarian cancer genetic testing. The pragmatic and sequential design will facilitate a large and diverse patient sample, allow for the assessment of incremental gains from different implementation strategies, and permit the assessment of moderators of strategy effectiveness. The findings may help determine the impact of low-cost, highly transportable implementation strategies that can be integrated into healthcare systems to improve the use of genomic medicine. Trial registration ClinicalTrials.gov. NCT05721326. Registered February 10, 2023. https://www.clinicaltrials.gov/study/NCT05721326

The UPFRONT project: tailored implementation and evaluation of a patient decision aid to support shared decision-making about management of symptomatic uterine fibroids

To evaluate implementation of a patient decision aid for symptomatic uterine fibroid management to improve shared decision-making at five clinical settings across the United States. We used a type 3 hybrid effectiveness-implementation stepped-wedge design and the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) planning and evaluation framework. We conducted clinician training, monthly reach tracking with feedback to site clinical leads, patient and clinician surveys, and visit audio-recordings. Implementation strategies included assessment of organizational readiness for shared decision-making, synchronous clinician training, audit and feedback of decision aid reach, and access to multiple decision aid formats. Outcomes and analyses included patient-level reach, clinician-level adoption, and associations of patient-reported decision aid exposure (as treated) and setting-level implementation (intention-to-treat) with patient-reported (collaboRATE measure) and observed (OPTION-5 measure) shared decision-making. We also designed and assessed setting-level plans for sustainability and other factors impacting sustained decision aid use. The decision aid was adopted by 72 of the 74 eligible gynecologists (97%) and reached 2553 patients across five settings. CollaboRATE scores improved among patients who reported receiving the decision aid (as-treated analysis, 69% vs. 59%; OR 1.6, 95% CI 1.16-2.27). CollaboRATE scores remained consistent before and after setting-level decision aid implementation (intention-to-treat analysis, 64% vs. 63%; OR 0.86, 95% CI 0.61-1.22). Participants would prefer to receive a decision aid at multiple time points (91.9% before the visit, 90.7% during the visit, 86.5% after the visit). Shared decision-making experiences did not improve when comparing pre vs. post-implementation collaboRATE scores across included settings (intention-to-treat, 64% vs. 63%; OR 0.86, 95% CI 0.61-1.22). When patients with symptomatic uterine fibroids are given decision aids, they report higher shared decision-making scores. However, the differences we observed between the as-treated and intention-to-treat results suggest that unaddressed implementation challenges continue to limit the extent to which patients receive decision aids and likely hinder their overall impact. Future efforts to implement decision aids should explore enhancing their integration into clinical workflows and standard operating procedures, supported by organizational incentives that prioritize shared decision-making. ClinicalTrials.gov NCT03985449; registered 6 June 2019.

For girls and women (4GW) HPV RCT protocol: a crowdsourced, pragmatic stepped-wedge cluster randomized trial to improve uptake of HPV vaccination and screening among mother-daughter dyads in Nigeria

Abstract Background Expanding human papillomavirus (HPV) vaccination for girls and HPV self-collection for women can reduce the global burden of cervical cancer. However, HPV vaccination and self-collection services are rarely implemented simultaneously in mother-daughter dyads, leaving a critical gap in cervical cancer prevention. From 2023 to 2024, a community-engaged model for combined HPV vaccination and screening was co-designed using crowdsourcing open calls and designathons with mother-daughter teams and pilot-tested by trained research facilitators. This study explores the impact of this crowdsourced, community-engaged mother-daughter campaign and implementation strategy bundle on HPV vaccination among girls and HPV screening among their mothers in Nigeria over 6 months in 18 Nigerian local government areas (LGAs). Methods A hybrid effectiveness-implementation type II pragmatic stepped-wedge cluster randomized control trial has been employed to the effectiveness of an implementation strategy bundle; a crowdsourced, tailored, community-engaged, mother-daughter HPV campaign on increasing uptake of HPV vaccination among girls aged 9–14 and HPV screening uptake among women aged 30–49 in Nigeria. The mother-daughter campaign will be tailored to local sites and conducted among 612 mother-daughter dyads (1,224 participants) recruited from 18 LGAs in six geopolitical zones of Nigeria. Trained community health workers will collect baseline data and implement a mother-daughter campaign that will provide education on cervical cancer control and access to onsite services for HPV vaccination and screening in a private area while engaging mothers and daughters simultaneously to increase uptake of the services. A mixed-methods evaluative and iterative assessment will be conducted using Proctor’s Implementation Outcomes Framework and the PEN- 3 cultural model. The primary outcomes are the uptake of HPV preventive measures—HPV vaccination (one dose) among girls (ascertained by onsite clinical records of vaccine uptake) and HPV self-collection completion among mothers (ascertained by laboratory receipt of self-collected specimens) within six months of trial enrollment. Pre-post effectiveness and cost of study components are embedded in the implementation and sustainment phases, compared to pre-implementation data assessed for each LGA. Discussion This study is a unique dyadic intervention focused on both girls and their mothers or female caregivers to drive cervical cancer control in Africa. Findings have the potential to inform local and global policies aimed at reducing the cervical cancer burden in African countries like Nigeria, eliminating missed opportunities by closing the research-to-translation gap. The protocol was registered with clinicaltrials.gov under registration NCT06728085.

Comparative effectiveness of implementation strategies for Accelerating Cervical Cancer Elimination through the integration of Screen-and-treat Services (ACCESS study): protocol for a cluster randomized hybrid type III trial in Nigeria

Abstract Background Despite the increased risk of cervical cancer (CC) among women living with HIV (WLHIV), CC screening and treatment (CCST) rates remain low in Africa. The integration of CCST services into established HIV programs in Africa can improve CC prevention and control. However, the paucity of evidence on effective implementation strategies (IS) has limited the success of integration in many countries. In this study, we seek to identify effective IS to enhance the integration of CCST services into existing HIV programs in Nigeria. Methods Our proposed study has formative and experimental activities across the four phases of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Through an implementation mapping conducted with stakeholders in the exploration phase, we identified a core package of IS (Core) and an enhanced package of IS (Core+) mostly selected from the Expert Recommendations for Implementing Change. In the preparation phase, we refined and tailored the Core and Core+ IS with the implementation resource teams for local appropriateness. In the implementation phase, we will conduct a cluster-randomized hybrid type III trial to assess the comparative effectiveness of Core versus Core+. HIV comprehensive treatment sites (k = 12) will be matched by region and randomized to Core or Core+ in the ratio of 1:1 stratified by region. In the sustainment phase, we will assess the sustainment of CCST at each site. The study outcomes will be assessed using RE-AIM: reach (screening rate), adoption (uptake of IS by study sites), IS fidelity (degree to which the IS occurred according to protocol), clinical intervention fidelity (delivery of CC screening, onsite treatment, and referral according to protocol), clinical effectiveness (posttreatment screen negative), and sustainment (continued integrated CCST service delivery). Additionally, we will descriptively explore potential mechanisms, including organizational readiness, implementation climate, CCST self-efficacy, and implementation intentions. Discussion The assessment of IS to increase CCST rates is consistent with the global plan of eliminating CC as a public health threat by 2030. Our study will identify a set of evidence-based IS for low-income settings to integrate evidence-based CCST interventions into routine HIV care in order to improve the health and life expectancy of WLHIV. Trial registration Prospectively registered on November 7, 2023, at ClinicalTrials.gov no. NCT06128304. https://classic.clinicaltrials.gov/ct2/show/study/NCT06128304

Results of a cluster randomized trial testing the Systems Analysis and Improvement Approach to increase cervical cancer screening in family planning clinics in Mombasa County, Kenya

Abstract Background Cervical cancer is the leading cause of cancer death in Kenyan women. Integrating cervical cancer screening into family planning (FP) clinics is a promising strategy to improve health for reproductive-aged women. The objective of this cluster randomized trial was to test the efficacy of an implementation strategy, the Systems Analysis and Improvement Approach (SAIA), as a tool to increase cervical cancer screening in FP clinics in Mombasa County, Kenya. Methods Twenty FP clinics in Mombasa County were randomized 1:1 to SAIA versus usual procedures. SAIA has five steps: (1) cascade analysis tool to understand the cascade and identify inefficiencies, (2) sequential process flow mapping to identify bottlenecks, (3) develop and implement workflow modifications (micro-interventions) to address identified bottlenecks, (4) assess the micro-intervention in the cascade analysis tool, and (5) repeat the cycle. Prevalence ratios were calculated using Poisson regression with robust standard errors to compare the proportion of visits where women were screened for cervical cancer in SAIA clinics compared to control clinics. Results In the primary intent-to-treat analysis in the last quarter of the trial, 2.5% (37/1507) of visits with eligible FP clients at intervention facilities included cervical cancer screening compared to 3.7% (66/1793) in control clinics (prevalence ratio [PR] 0.67, 95% CI 0.45–1.00). When adjusted for having at least one provider trained to perform cervical cancer screening at baseline, there was no significant difference between screening in intervention clinics compared to control clinics (adjusted PR 1.14, 95% CI 0.74–1.75). Conclusions The primary analysis did not show an effect on cervical cancer screening. However, the COVID-19 pandemic and a healthcare worker strike likely impacted SAIA’s implementation with significant disruptions in FP care delivery during the trial. While SAIA’s data-informed decision-making and clinic-derived solutions are likely important, future work should directly study the mechanisms through which SAIA operates and the influence of contextual factors on implementation. Trial registration ClinicalTrials.gov, NCT03514459. Registered on April 19, 2018.

Implementation and scale-up of a single-visit, screen-and-treat approach with thermal ablation for sustainable cervical cancer prevention services: a protocol for a stepped-wedge cluster randomized trial in Kenya

Abstract Background An important cervical cancer prevention strategy in low- and middle-income countries (LMICs) has been single-visit screen-and-treat (SV-SAT) approach, using visual inspection with acetic acid (VIA) and ablative treatment with cryotherapy to manage precancerous lesions. While SV-SAT with VIA and cryotherapy have established efficacy, its population level coverage and impact on reducing cervical cancer burden remains low. In Kenya, the estimated cervical cancer screening uptake among women aged 30–49 is 16% and up to 70% of screen-positive women do not receive treatment. Thermal ablation for treatment of precancerous lesions of the cervix is recommended by the World Health Organization and has the potential to overcome logistical challenges associated with cryotherapy and facilitate implementation of SV-SAT approach and increase treatment rates of screen-positive women. In this 5-year prospective, stepped-wedge randomized trial, we plan to implement and evaluate the SV-SAT approach using VIA and thermal ablation in ten reproductive health clinics in central Kenya. Methods The study aims to develop and evaluate implementation strategies to inform the national scale-up of SV-SAT approach with VIA and thermal ablation through three aims: (1) develop locally tailored implementation strategies using multi-level participatory method with key stakeholders (patient, provider, system-level), (2) implement SV-SAT approach with VIA and thermal ablation and evaluate clinical and implementation outcomes, and (3) assess the budget impact of SV-SAT approach with VIA and thermal ablation compared to single-visit, screen-and-treat method using cryotherapy. Discussion Our findings will inform national scale-up of the SV-SAT approach with VIA and thermal ablation. We anticipate that this intervention, along with tailored implementation strategies will enhance the adoption and sustainability of cervical cancer screening and treatment compared to the standard of care using cryotherapy. Trial registration NCT05472311.