Feasibility and Adaptation of an Evidence-Based Multilevel Intervention for Improving Timeliness of Lung Cancer Treatment

Feasibility and Adaptation of an Evidence-Based Multilevel Intervention for Improving Timeliness of Lung Cancer Treatment is sponsored by National Cancer Institute (NCI). Focuses on adapting evidence-based interventions to improve the timeliness of lung cancer treatment, addressing multilevel factors affecting treatment delays.

## [](https://pmc. ncbi. nlm.

nih. gov/articles/PMC12955728/)Abstract Delayed time to treatment is a key determinant of poor survival among patients with lung cancer. Factors affecting timeliness of lung cancer treatment are multilevel in nature.

Most interventions target only one level of influence. Existing evidence-based interventions (EBIs) that work in one setting may fail to work in a different setting due to poor fit in the new setting or deviations from the original intervention. Our study evaluated the feasibility of adopting a Veterans Health Administration (VHA) evidence-based multilevel intervention (EBMLI) within an academic health system.

The VHA EBMLI is a multilevel lung cancer care coordination program previously employed by the VHA targeting the individual-, provider team-, and organization- level. The intervention effectively reduced time to treatment for Veterans with lung cancer over 7 years with significant individual level reductions by about 50%.

We conducted a survey of providers across 5 sites on the acceptability, appropriateness, and feasibility towards the EBMLI using the following validated scales: 1) Acceptability of Intervention Measure (AIM, score range: 1–5); 2) Intervention Appropriateness Measure (IAM, 1–5); 3) Feasibility of Intervention Measure (FIM, 1–5); 4) Implementation Climate Scale (ICS, 0–4) and; 5) Implementation Leadership Scale (ILS, 0–4).

45 providers consented to participate in the survey and 36 (mean age 46±11 years) across 5 sites completed the survey. Most had MD or PhD degrees (46%) and were physicians (42%), had >10 years healthcare experience (49%) with 20±20 patients with lung cancer seen per week, of which 60% of providers saw only adult patients. Mean scores on the scales were: AIM (4.

1±0. 8), IAM (4. 0±0.

8), FIM (4. 1±0. 8), ICS (2.

7±0. 7), ILS (3. 2±0.

9). While the proposed EBMLI may be well received by providers and leadership, acknowledgement of contexts affecting organizational climate is needed to assure feasibility of the adaptation, implementation and sustainability of the VHA EBMLI. **Keywords:**multilevel intervention, feasibility study, implementation science, timeliness of care ## [](https://pmc.

ncbi. nlm. nih.

gov/articles/PMC12955728/)BACKGROUND Delayed time to treatment is a key determinant of poor survival among patients with lung cancer, especially for early stages lung cancer. 1–6 In the US, the death rate is 14% higher for patients treated after 90 days from diagnosis compared to those treated within 30 days. 4 Yet, only 54% of ever-treated patients with lung cancer receive treatment with 30 days.

4 Even worse, 21% of lung cancer-diagnosed patients never receive treatment. 7 West Virginia (WV) ranks among the top five US states with the highest mortality rates for lung cancer. Twelve percent of patients with lung cancer in WV do not receive treatment,7 and treatment is delayed beyond 35 days for 39% of those who receive treatment.

8 This combination of patients who do not receive timely treatment or any treatment constitute a significant number diagnosed with lung cancer in WV who are at risk for poor cancer outcomes. Multilevel interventions target more than one level of influence concurrently or in close succession.

Despite the multilevel nature of barriers to receipt of lung cancer treatment, most interventions that address cancer care delivery only target individual level factors. 9 Evidence-based interventions (EBIs) are intervention strategies that have been shown to be effective.

Existing EBIs that work in one setting may, however, fail to work in a different setting due to poor fit in the new setting or deviations from the original intervention during implementation in the new setting.

10 To improve the timeliness of treatment for patients diagnosed with lung cancer within the West Virginia University (WVU) health system, we are adapting an evidence-based multilevel lung cancer care coordination intervention previously employed by the Veterans Health Administration (VHA) targeting the individual-, provider team-, and organization- level.

11,12 The VHA multilevel intervention: 1) provided a cancer care coordinator/nurse navigator as contact person for patients (**_individual level_**) and clinicians within a thoracic tumor board (**_provider team level_**) during diagnostic and staging process to identify, track, and expedite care from suspicion to definitive treatment; 2) set up a pulmonary tumor board (**_provider team level_**); and 3) reorganized workflow logistics address patient, provider, and health system barriers to treatment, respectively (**_organizational level_**) (Table 1).

11,12 In the Connecticut VA Healthcare System, time to lung cancer treatment reduced from 117 days to 52. 4 days over 7 years. 11 ## [](https://pmc.

ncbi. nlm. nih.

gov/articles/PMC12955728/)OBJECTIVE To evaluate the feasibility, acceptability, appropriateness of implementing an evidence-based multilevel lung cancer care coordination intervention aimed at improving the timeliness of lung cancer treatment and assessing the leadership and organizational climate for implementing the intervention. ## [](https://pmc. ncbi.

nlm. nih. gov/articles/PMC12955728/)METHODS ### Study Design and Setting This was a multisite survey study of provider teams who provide care to patients with lung cancer conducted across the WVU Cancer Institute (CI) network.

WVUCI is a regional network of cancer centers affiliated with WVU Medicine Health System and located across locations in West Virginia, Pennsylvania, and Maryland, with 5 sites credentialed for clinical trials with the National Cancer Institute. The study was approved by the West Virginia University Institutional Review Board.

### Sample and Procedures An electronic survey was distributed to individual providers with provider teams via REDCap where all providers involved in the diagnosis and care of patients with cancer were invited to participate in the study. REDCap is a secure web application for building and managing online surveys and databases. Providers were invited to complete the survey in an introductory email.

The introductory email advised that clicking on the survey link was documentation of consent to participate in the study. A $20 Amazon gift card was provided as incentive upon completion of the survey.

Data was collected using the following validated scales: 1) Implementation Climate Scale (ICS); 2) Implementation Leadership Scale (ILS); 3) Acceptability of Intervention Measure (AIM); 4) Intervention Appropriateness Measure (IAM); 5) Feasibility of Intervention Measure (FIM).

The ICS is an 18-item scale with 5-level response options _(Not at all (0) – Very great extent (4))_ and collected data from providers’ on the support of WVU Medicine as an organization towards the adoption of evidence-based practices in general.

13 The ILS is a 12-item scale with 5-level response options _(Not at all (0) – Very great extent (4))_ and collected data on providers’ attitudes towards adopting evidence-based practices in general.

14 The AIM, IAM, and FIM are each 4-item scales with 5-level response options _(Completely disagree (1) – Completely agree (5))_ and collected data on the acceptability, appropriateness, and feasibility of adopting the lung cancer care coordination intervention.

15 The AIM, IAM, and FIM were introduced with a brief description of the proposed EBMI: We are adapting an evidence-based multilevel intervention to improve timeliness to lung cancer treatment to be used across the West Virginia University Cancer institute (WVUCI) network. Multilevel interventions address multiple levels of needs concurrently or in close succession, improving the chances of successful outcome.

The planned multilevel intervention is a lung cancer care coordination program which: 1) provides a cancer care coordinator as contact person for patients and clinicians within a thoracic tumor board during the diagnostic and staging process to identify, track, and expedite care from suspicion to definitive treatment; 2) modifies the pulmonary tumor board to be consistent with evidence-based processes; and 3) reorganizes workflow logistics address patient, provider, and health system barriers to treatment, respectively.

Additional demographic data were collected on: age, gender, race/ethnicity, highest level of education, type of provider, specialization, years of experience, practice site, type of practice, patient population, and number of patients with lung cancer cared for in one month. Demographic data were summarized using means (with standard deviations) and frequencies (with percentages) for numeric and categorical data, respectively.

Mean scores for the set of items that make up each subscale (where applicable) were computed to obtain scale scores. The mean of the subscale scores or mean scores of the individual items (where there are no subscales) were computed to obtain the total scores along with the standard deviations of the means. Internal consistency of the scales and subscales were assessed using Cronbach’s alpha.

Further, intraclass correlations of the individual items within subscales and the subscales within scales were assessed. Analysis was conducted using SAS 9. 4 (SAS Institute Inc, Cary, NC, USA).

## [](https://pmc. ncbi. nlm.

nih. gov/articles/PMC12955728/)RESULTS Forty-five providers consented to participate in the survey and 37 across the 5 sites attempted the survey. Completion rates for the different sections of the survey varied from 70% (N=27) for the AIM, IAM, and FIM, which were presented at the end to 92–100% (N=34–37) for the ICS, which was presented first.

Table 1 shows characteristics of lung cancer care providers across the five sites within the academic health system. Mean (SD) age was 46 (11) years. Most were female (44.

4%), non-Hispanic White (60. 0%), with MD degrees (35. 6%) and providing care as physicians (42.

2%) or nurses (26. 7%) within oncology (48. 9%) or surgery (13.

3%) specialties in a hospital (37. 8%) or clinic (40. 0%) setting.

The majority of providers had 15 or more years of experience (37. 8%) with an adult only patient population (60. 0%).

Table 2 shows the mean scores, internal consistency reliability and intraclass correlations for each subscale and total scale. Mean scores for ICS and ILS were 2. 70 (0.

66) and 3. 16 (0. 93), respectively while mean scores for AIM, IAM, and FIM were 4.

06 (0. 82), 4. 00 (0.

80), and 4. 06 (0. 78), respectively.

Within the ICS and ILS scales, mean scores for the subscales were moderate to high, ranging from 2. 68 to 3. 25 except for Rewards for EBP subscale within ICS which had a mean score of 0.

75. Intraclass correlations for the total scales ranged from 0. 84 to 0.

91 except for the ICS scale which had an ICC of 0. 11I. ICC for the subscales within the ICS and ILS were higher ranging between 0.

50 to 0. 98 for ICS and 0. 87 to 0.

95 for ILS. Internal consistency reliability was high for both the total scales and subscales ranging from 0. 77 to 0.

98 for the total scales, 0. 88 to 0. 99 for the subscales within ICS, and 0.

96 to 0. 98 for the subscales within ILS. ## [](https://pmc.

ncbi. nlm. nih.

gov/articles/PMC12955728/)DISCUSSION This study aimed to evaluate the feasibility, acceptability, appropriateness of implementing an VHA multilevel lung cancer care coordination intervention aimed at improving the timeliness of lung care treatment and assessing the leadership and organizational climate for implementing the intervention.

High scores were obtained for feasibility, acceptability, and appropriateness of the intervention while moderate and high scores were, respectively, obtained for organizational climate and leadership attitude. Strikingly, moderate scores on organizational climate were driven by low scores on the rewards subscale.

The reward subscale of the ICS elicits financial incentives, bonuses, and compensated time for providers for the use of an EBP. It has been shown in other studies to score lower than other subscales in the ICS. 13,16,17 For example, clinicians who completed the initial survey for the development of the ICS scored an average of 0.

72 on the rewards subscale compared to 1. 68 to 2. 79 for the other subscales.

13 Our survey was conducted within an academic health system where best practices are the standard. The observed low scores on the rewards subscale may be a reflection of the lack of expectation for extra compensation for providing the best possible care to patients. Similar patterns have been observed among nurses and teachers.

16,17 The impact of low scores on the rewards subscale was reflected in low ICC on the overall ICS scale although high ICC were obtained within the subscales. The initial development of the ICS also support aggregation of the six subscales that make up the ICS. 13 Additionally, the academic health system serves a largely disparate population.

About 38% of WV population is considered rural with a poverty rate of 17%. 18 This implies a high level of constraints at the local level as well as budgetary constraints at the policy level which may not support financial incentives for providers to implement EBP.

However, the high scores on the other scales support evidence for positive attitudes by both leadership and providers for implementing our proposed multilevel intervention to improve the timeliness of lung cancer treatment. Next steps will involve adapting the VHA multilevel intervention to improve fit for our academic health system. 10 ## [](https://pmc.

ncbi. nlm. nih.

gov/articles/PMC12955728/)CONCLUSION High scores were obtained on the acceptability, appropriateness, feasibility, and leadership scales. Moderate scores were obtained on the ICS, driven by low scores on the rewards subscale. The observed pattern is consistent with other studies.

While our proposed adoption of the VHA evidence-based multilevel intervention may be well received by providers and leadership, acknowledgement of contexts affecting organizational climate is needed to assure feasibility of adaptation, implementation and sustainability of the VHA intervention. ## [](https://pmc. ncbi.

nlm. nih. gov/articles/PMC12955728/)Funding Research reported in this publication was supported by a grant awarded to SON by the National Cancer Institute of the National Institutes of Health (NCI/NIH) under Award Number R03CA297362.

The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The sponsor played no role in the study design, data collection and analysis, decision to publish, and preparation of the manuscript. **Conflict of Interest Statement:** The authors have no conflict of interest to declare ## [](https://pmc.

ncbi. nlm. nih.

gov/articles/PMC12955728/)REFERENCES * 1.. Tsai, Kung, Kuo, Tsai. Effect of time interval from diagnosis to treatment for non-small cell lung cancer on survival: a national cohort study in Taiwan.

_BMJ Open_. Apr 22 2020;10(4):e034351. doi: doi: 10.

1136/bmjopen-2019-034351 [DOI] [PMC free article] [PubMed] [Google Scholar] * 2.. Mayne, Elser, Darling, _et al. _ Estimating the Impact of Extended Delay to Surgery for Stage I Non-small-cell Lung Cancer on Survival.

_Ann Surg_. May 1 2021;273(5):850–857. doi: doi: 10.

1097/sla. 0000000000004811 [DOI] [PubMed] [Google Scholar] * 3.. Stokstad, Sørhaug, Amundsen, Grønberg.

Associations Between Time to Treatment Start and Survival in Patients With Lung Cancer. _In Vivo_. May-Jun 2021;35(3):1595–1603.

doi: doi: 10. 21873/invivo. 12416 [DOI] [PMC free article] [PubMed] [Google Scholar] * 4..

Cushman, Jones, Akhavan, _et al. _ The Effects of Time to Treatment Initiation for Patients With Non-small-cell Lung Cancer in the United States. _Clin Lung Cancer_.

Jan 2021;22(1):e84–e97. doi: doi: 10. 1016/j.

cllc. 2020. 09.

004 [DOI] [PubMed] [Google Scholar] * 5.. Gomez, Liao, Swisher, _et al. _ Time to treatment as a quality metric in lung cancer: Staging studies, time to treatment, and patient survival.

_Radiother Oncol_. May 2015;115(2):257–63. doi: doi: 10.

1016/j. radonc. 2015.

04. 010 [DOI] [PubMed] [Google Scholar] * 6.. Heiden, Eaton, Engelhardt, _et al.

_ Analysis of Delayed Surgical Treatment and Oncologic Outcomes in Clinical Stage I Non-Small Cell Lung Cancer. _JAMA Netw Open_. May 3 2021;4(5):e2111613.

doi: doi: 10. 1001/jamanetworkopen. 2021.

11613 [DOI] [PMC free article] [PubMed] [Google Scholar] * 7.. American Lung Association. _State of Lung Cancer_, 2022.

Accessed November 2, 2023. https://www. lung.

org/research/state-of-lung-cancer/key-findings [Google Scholar] * 8.. Nduaguba, Lumudae, Stout. Time to Lung Cancer Treatment in West Virginia and Patient Survival.

_Cancer Epidemiology, Biomarkers & Prevention_. 2024; [Google Scholar] * 9.. Stange, Breslau, Dietrich, Glasgow.

State-of-the-art and future directions in multilevel interventions across the cancer control continuum. _J Natl Cancer Inst Monogr_. May 2012;2012(44):20–31.

doi: doi: 10. 1093/jncimonographs/lgs006 [DOI] [PMC free article] [PubMed] [Google Scholar] * 10.. Pitsillidou, Roupa, Farmakas, Noula.

Factors Affecting the Application and Implementation of Evidence-based Practice in Nursing. _Acta Inform Med_. Dec 2021;29(4):281–287.

doi: doi: 10. 5455/aim. 2021.

29. 281-287 [DOI] [PMC free article] [PubMed] [Google Scholar] * 11.. Hunnibell, Rose, Connery, _et al.

_ Using nurse navigation to improve timeliness of lung cancer care at a veterans hospital. _Clin J Oncol Nurs_. Feb 2012;16(1):29–36.

doi: doi: 10. 1188/12. Cjon.

29-36 [DOI] [PubMed] [Google Scholar] * 12.. Alsamarai, Yao, Cain, _et al. _ The effect of a lung cancer care coordination program on timeliness of care.

_Clin Lung Cancer_. Sep 2013;14(5):527–34. doi: doi: 10.

1016/j. cllc. 2013.

04. 004 [DOI] [PubMed] [Google Scholar] * 13.. Ehrhart, Aarons, Farahnak.

Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). _Implement Sci_. Oct 23 2014;9:157.

doi: doi: 10. 1186/s13012-014-0157-1 [DOI] [PMC free article] [PubMed] [Google Scholar] * 14.. Aarons, Ehrhart, Farahnak.

The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. _Implement Sci_. Apr 14 2014;9(1):45.

doi: doi: 10. 1186/1748-5908-9-45 [DOI] [PMC free article] [PubMed] [Google Scholar] * 15.. Weiner, Lewis, Stanick, _et al.

_ Psychometric assessment of three newly developed implementation outcome measures. _Implement Sci_. Aug 29 2017;12(1):108.

doi: doi: 10. 1186/s13012-017-0635-3 [DOI] [PMC free article] [PubMed] [Google Scholar] * 16.. Ehrhart, Shuman, Torres, _et al.

_ Validation of the Implementation Climate Scale in Nursing. _Worldviews Evid Based Nurs_. Apr 2021;18(2):85–92.

doi: doi: 10. 1111/wvn. 12500 [DOI] [PubMed] [Google Scholar] * 17..

Thayer, Cook, Davis, _et al. _ Construct validity of the school-implementation climate scale. _Implement Res Pract_.

Jan-Dec 2022;3:26334895221116065. doi: doi: 10. 1177/26334895221116065 [DOI] [PMC free article] [PubMed] [Google Scholar] * 18..

West Virginia Center on Budget and Policy. _State of Rural West Virginia_, 2018. Accessed October 20, 2025.

https://wvpolicy. org/wp-content/uploads/2018/10/WVCBP_RuralWV_2018. pdf [Google Scholar]