Leveraging Telepsychology and Behavioral Economics to Increase Fidelity to CBT

The goal of this study is to develop and test a telehealth tool intended to support community mental health clinicians to deliver cognitive behavioral therapy (CBT). The main aims of the study are to: 1. Collaborate with clinicians and supervisors to design an accessible prototype to increase clinician use of CBT in community mental health settings through focus groups, interviews, and surveys. 2. Adapt the initial model through feedback from clinicians and their patients who will be asked to test the tool then complete interviews and surveys. 3. Test the model with clinicians and their patients who will be asked to use the tool for several weeks. 4. Evaluate the acceptability and feasibility of using the tool in a pilot trial through surveys and interviews.

Our primary goal in this exploratory project is to develop, iteratively, refine and evaluate the preliminary effectiveness, acceptability, and feasibility of "Tele-BE," a novel telehealth platform that integrates behavioral economics (BE) strategies into the clinician user-interface of standard telehealth technology, to increase clinician use of structural components of cognitive behavioral therapy (CBT). Primary endpoints for this study are the refined Tele-BE platform implementation strategy and evaluation of Tele-BE's preliminary effectiveness to increase clinician fidelity and acceptability, and feasibility. Secondary outcomes include target implementation mechanisms (clinician intentions and their determinants: attitudes, norms and self-efficacy) consistent with our conceptual model. Our primary hypotheses are that Tele-BE will increase clinician fidelity to CBT structural components during the observation period and that Tele-BE will be an acceptable and feasible implementation strategy. Secondary hypotheses are that Tele-BE will engage our target implementation mechanisms of interest, as delineated in Table 1 of the Research Strategy. Of note, as this is a pilot trial, it is not intended to be fully powered to detect effects and we will rely on qualitative and mixed methods analyses to examine study hypotheses. Our goal is to develop and pilot-test Tele-BE to nudge clinicians to deliver six CBT structural components of interest: (1) symptom monitoring, (2) agenda setting guided by shared decision-making, (3) out-of-session practice ("homework") review, (4) skill instruction, (5) skill practice, and (6) homework planning. Tele-BE will leverage the infrastructure of standard telehealth platforms to alter the clinician interface and incorporate behavioral economics (BE) strategies to make it easier and more motivating to deliver structural components of interest to patients. We will partner with BlueJeans by Verizon, who currently partners with Penn Medicine to support HIPAA compliant telehealth technology throughout the system, to create the Tele-BE prototype that will be tested in this study. In Aim 1, we will adapt and refine Tele-BE in collaboration with a Stakeholder Advisory Board, BlueJeans, and Transmogrify, a web development company with an established partnership with Penn Medicine. Aim 1 is a largely preparatory aim during which we will refine our Tele-BE prototype in collaboration with an initial group of 3 community clinicians as our target end-users as well as 3 clinical supervisors. We will recruit three additional clinicians in Aim 1 to test out early elements of Tele-BE. These additional clinicians will engage in laboratory-based usability testing with a basic functional version of Tele-BE. Participants will meet with the study team and interact with the Tele-BE platform for 30 minutes; participants also will conduct a mock therapy session with a graduate student clinician. Participants will be recorded through the BlueJeans platform while interacting with Tele-BE. We will use a "think aloud" framework to have clinicians verbalize their thoughts when using the program. Following the think aloud protocol, participants will complete brief questionnaires and a brief interview to inform Tele-BE refinement. In Aim 2, we will work closely with our web development team to field test and iteratively refine Tele-BE using rapid cycle prototyping to optimize the user experience and refine our specific BE strategies. We anticipate recruiting 5 community clinicians and 5 of their patients to pilot iterations of Tele-BE in their clinical practice for 4-5 weeks. These participants will provide qualitative feedback on Tele-BE's ability to engage target implementation mechanisms. if saturation is not reached with an initial sample of participants, we may recruit up to 5 more clinician and patient dyads. The primary outcome of Aim 2 will be a refined version of Tele-BE to be tested in the pilot trial. Aim 3 is a pilot 12-week open trial to test preliminary effectiveness of the refined Tele-BE to enhance clinician CBT structural component fidelity. We will recruit 30 community mental health clinicians and randomize them to Tele-BE or telehealth as usual (Tele-AU). The trial will include 2 patients per clinician (60 patients total). Note that the exact features included in Tele-BE will be dependent on the outcomes of Aims 1 and 2 and are not designed to change clinician session content (i.e., the specific intervention techniques a clinician employs) in any way. However, we anticipate that it will include some or all of the following design features: (1) Reminder message prompting clinician to identify a skill to review, introduce, or practice, prior to the start of a clinical encounter, (2) Completion of progress measures (in this case, measures of therapeutic alliance) in the telehealth "waiting room," (3) Template agenda of structural components with an option to select CBT interventions that will be delivered in session, (4) Checkmarks indicating the CBT component is completed, with a display that adjusts as goals are reached, (5) Gamification features (e.g., badges) for goals met (e.g., agenda completed \>90% of the time), (6) Feedback messages about elements completed from clinical supervisor (e.g., messages offering praise for hitting certain benchmarks, and (7) Downloadable summary of session activities for the clinical progress note. All therapy sessions will be recorded and subsequently coded for fidelity (Aim 3 primary outcomes). Clinicians will complete measures of intentions and their determinants at Weeks 1, 5, 9, and 12 (Aim 3 secondary outcomes). Using data from the open trial, Aim 4 will examine acceptability and feasibility of Tele-BE from patient and clinician perspectives and potential ethical issues with Tele-BE. We will measure Tele-BE acceptability and feasibility via web analytics, surveys, interviews, and recruitment and retention statistics, and patient outcomes. Patients will complete self-report measures of therapeutic alliance and symptoms on the same schedule as clinician report; they additionally will complete measures of patient centered care at pre and post. Select patients will also complete qualitative interviews. To recruit and enroll clinicians, we first will identify a minimum of 4 Philadelphia agencies that are already using telehealth and are trained in transdiagnostic CBT through the Penn Collaborative for CBT and Implementation Science (directed by MPI Dr. Creed). While the telehealth landscape will likely shift as the COVID-19 pandemic ebbs, Philadelphia's Medicaid behavioral health payor has committed to continuing to reimburse for telehealth after the crisis concludes. We then will employ a cascaded recruitment strategy to recruit 30 clinicians who then will identify their patients aged 14 or older (the age of consent for mental health services in Pennsylvania) with whom they are providing psychotherapy via telehealth. We will work with clinicians to identify two patients that they will approach for study participation. For each clinician-patient dyad, participation will occur over a 12-week trial period. Clinicians and patients will complete study measures as outlined in Table 3 of the Research Strategy.