Accessibility and equity considerations in the clinical validation of prescription digital therapeutics: a scoping review
Highlight box
Key findings
• Analysis of thirty-two clinical validation studies of six Food and Drug Administration (FDA)-approved prescription digital therapeutics (DTx) revealed significant equity assessment gaps.
• Over 60% reported basic demographics (gender, race/ethnicity, education), but fewer than 15% addressed other PROGRESS-Plus health equity factors.
• No studies incorporated cultural adaptation frameworks or provided non-English translations.
• Two studies found digital literacy significantly affected intervention effectiveness.
What is known and what is new?
• Digital health interventions are known to be less accessible for racial, ethnic, and culturally minoritized groups.
• This is the first systematic review examining health equity, cultural competence, and digital accessibility in FDA-mandated DTx clinical validation studies.
• Current regulatory processes inadequately address equity despite DTx requiring sustained patient engagement.
What is the implication, and what should change now?
• Clinical validation studies must incorporate comprehensive health equity assessments including cultural adaptation frameworks and digital literacy evaluations.
• FDA approval processes should require diversity action plans and accessibility standards similar to Culturally and Linguistically Appropriate Services standards.
• Future DTx development should integrate patient-centered design with lived experiences from target populations to ensure equitable effectiveness.
Introduction
Digital health products are often cited as a potential mechanism for expanding equal access to high-quality healthcare services and reducing health disparities. It is imperative that these tools are developed using a health equity lens to ensure these improvements are accessible and beneficial to all populations.
Digital therapeutics (DTx) are software-based digital health products that are classified by the Food and Drug Administration (FDA) as Software as a Medical Device (SaMD) or Mobile Medical Applications (MMA). The development of DTx typically follows a structured approach that includes the identification of a clinical need, software development, and rigorous clinical validation to ensure safety and efficacy. The Digital Therapeutics Alliance (DTA) has established a set of best practices for the development and deployment of DTx, focusing on patient-centered design, usability, and evidence-based validation. However, these guidelines are not mandatory and may not fully address the specific needs of culturally and linguistically diverse populations. Accessibility and equity considerations may be crucial for DTx because the effectiveness of the therapeutic intervention is dependent on the patient independently and consistently utilizing the software. Current FDA policy does not require cultural competence or linguistic diversity assessments for medical devices submitted to the agency for approval (1). The FDA has non-binding recommendations promoting diversity, but a recent review found that less than 30% of submissions to the FDA for premarket approval reported diversity data (2). Medical devices are not subject to the National Standards for Culturally and Linguistically Appropriate Services (CLAS) that are designed to ensure that patients from racial, cultural, and language minority communities have equal access to high quality health services (3).
To this end, research shows that digital health interventions are largely less accessible to and less effective for racial, ethnic, and culturally minoritized groups, even after controlling for factors such as socioeconomic status, place of residence, and education level (4,5). Psychosocial interventions are underpinned by the sociocultural context of their development; in most cases that of White males from the West. The disparity in the effectiveness of these interventions for cultural/ethnic minority populations can be partially attributed to differences in cultural values and beliefs between Western and non-Western communities. This impact is compounded for DTx because there is no clinician involvement, and therefore no opportunity for individual tailoring that could carry dimensions of culture into the intervention. Studies have shown that the lack of culturally appropriate tailoring can produce treatment gaps between Black and White patients, lead to decreased health utilization for patients of color, and create community mistrust of the healthcare system (6,7).
Technological access and digital literacy represent the emerging digital determinants of health (8). DTx are largely designed and developed in cultural contexts where technology access and digital literacy are ubiquitous, and therefore may not consider the barriers for populations who are impacted by the digital divide (5,8). DTx and other digital interventions that require technological tools are inaccessible to populations who do not have or know how to use these tools. Low-income, rural, and racial/ethnic minority populations are more likely to lack technology access and digital literacy, which exacerbates existing health disparities associated with the social determinants of health.
To our knowledge this is the first review of health equity, cultural competence, or digital access factors for currently marketed prescription DTx. This review focuses on assessing evidence reported in FDA-mandated clinical validation studies. These studies are conducted specifically to establish the safety and efficacy of the product under evaluation for the intended use population which makes them particularly appropriate for the assessment in a scoping review.
The intent of the scoping review was to examine the extent, range, and nature of research activity related to health equity, cultural competence, and digital accessibility considerations in the development of prescription digital therapeutic products. Health equity, cultural competence, and digital access factors must be considered in the design, development, and validation processes of DTx to ensure these products achieve their intended results for the entire intended use population. We present this article in accordance with the PRISMA-ScR reporting checklist (available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-25-12/rc).
Methods
Research question
The review was conducted following the methodological framework proposed (9) and updated by prior research (10), which guided the systematic identification, selection, and synthesis of relevant literature on DTx. The review was guided based on the research question: “Are the prescription digital therapeutics currently on the market appropriate for culturally and linguistically diverse populations?” This question was refined iteratively through group discussions with the research team to ensure it was broad enough to capture relevant studies while maintaining focus on the specific concerns related to health equity, cultural competence, and digital access. Identified literature was assessed to identify product or clinical trial design considerations relevant to health equity, cultural competence, and digital accessibility, and data enabling the assessment of the effects of the intervention on health equity. We did not have a review protocol since we utilized an iterative process for this exploratory scoping review.
Eligibility criteria
Products were included if they received FDA authorization through the end of 2023. The search covered studies published up until February 2023 that were relevant to products which received FDA authorization in 2023 or earlier. The eligibility criteria for the inclusion of articles in this review were as follows: articles were considered if they were case reports describing the use of the subject device or human clinical studies presenting clinical evidence on the subject device. Articles were excluded if they were duplicate publications, did not constitute clinical studies or case reports (for example, in vitro, animal, cadaver, benchtop, or biomechanical studies, patents), were not pertinent to the subject device, primarily focused on health economic evaluations, or primarily contained duplicate data from another included study. These references were included in the clinical evidence assessment. In these cases, the results posted on ClinicalTrials.gov were included in the clinical evidence assessment. Evaluations of predicate technologies relevant to the development of the devices in scope were also included when this information was available.
Information sources
Data on authorized therapeutic applications was extracted from the FDA Product Code Classification Database (11) using a procedure adapted from past research (12). Identified product labelling and regulatory approval documents were manually searched for references to clinical literature. To enhance the results beyond the references specifically included in the FDA documentations, PubMed, Google Scholar, and ClinicalTrials.Gov were searched for the product name, manufacturer, and known previous product names (e.g., “Regulora”, “MetaMe Health”). The included articles’ reference lists were hand searched for relevant publications. The most recent search was executed in March 2023.
Search
This involved searching the FDA database by (I) using the terms “digital”, “mobile”, “software”, “application”, “smartphone”, and “computer”; and (II) excluding product codes that were not therapeutic in functionality or were not software-only devices. The resulting product codes were inputted into the FDA Center for Devices and Radiological Health approved product database to identify DTx products. The literature search focused on four key domains: health equity considerations, cultural competence in design and implementation, digital accessibility, and clinical effectiveness, as it relates to clinical evidence of identified prescription DTx. The primary intention of this review was to review clinical evidence used in the development and submission of the DTx products for FDA approval. Given the focus on FDA-mandated validation studies for specific commercially available products, this targeted search approach was deemed appropriate for capturing the relevant clinical evidence used in regulatory submissions. There were two instances where the clinical trial listings included results from clinical evaluations that were not identified in the published clinical literature.
Selection of sources of evidence
All citations were imported into the bibliographic manager Zotero and duplicate citations were removed manually. Level one (title and abstract) and level two (full text) screening were conducted and tracked in an Excel spreadsheet using Covidence Review software to ensure the quality of our search results. The initial screening was performed by [Redacted Initials], followed by a comprehensive review of the full texts of the selected papers.
Data charting process
Data extraction followed a systematic approach, with a comprehensive data extraction form developed based on the guidelines in the Cochrane Handbook for Systematic Reviews of Interventions. The data extraction form included standardized definitions and assessment criteria for health equity factors, cultural competence evaluations, and digital literacy assessments to ensure consistent application across all studies. The data extraction form was reviewed and approved by all investigators. Data extraction was performed in Excel by one investigator and verified through a thorough, independent review by a second investigator ([Redacted Initials]), with discrepancies resolved through discussions with a third reviewer ([Redacted Initials]) until consensus was achieved. Discrepancies between reviewers were systematically documented and categorized by type (factual extraction errors versus interpretive differences in assessment ratings). Disagreements were first addressed through discussion between the two primary reviewers, with reviewers referring back to the operational definitions. When consensus could not be reached after discussion, a third reviewer ([Redacted Initials]) provided an independent assessment of the disputed items. Final decisions were made by majority consensus among the three reviewers, with all resolution decisions documented along with the rationale for the final determination.
Data items
The following details were extracted from each included study: publication details (title, journal, and year); authors’ details (names, affiliations, funding, and conflicts of interest); study details (start and end date, country, design, purpose, and statistical analyses); participant’s characteristics (condition, inclusion and exclusion criteria, sample size, recruitment process, and demographics); intervention (type, duration, frequency, other details, and primary and secondary outcome); results (primary and secondary outcomes). Each study was assessed for the incorporation of health equity considerations using the PROGRESS-Plus framework, which includes factors such as place of residence, race/ethnicity, culture/language, occupation, gender/sex, religion, educational background, socioeconomic status, and social capital. For this review, ‘race/ethnicity’ and ‘culture/language’ were considered separately, and LGBTQ+ identity was added as a distinct category. Each article was also assessed for methodology used to assess effects of health inequalities (e.g., subgroup analysis, targeted analysis of vulnerable populations) and reference to health equity factors in the study discussion, limitations, or implications.
Studies were evaluated for cultural appropriateness using a systematic assessment framework with operationally defined criteria. Cultural adaptation was assessed based on: (I) whether studies employed evidence-based cultural adaptation frameworks, defined as peer-reviewed systematic approaches for modifying interventions for specific cultural groups (e.g., Bernal & Sáez-Santiago Cultural Adaptation Framework, Cultural Adaptation Process model by Cabassa & Baumann, or similar validated frameworks); and (II) whether studies addressed researchers’ cultural biases by explicitly acknowledging potential cultural limitations in study design, discussing cultural assumptions underlying interventions, or recognizing cultural factors that may influence intervention effectiveness. Studies were also evaluated for any reference to cultural competence or cultural adaptation in the study discussion, limitations, or implications sections.
Linguistic appropriateness was assessed using standardized criteria: (I) availability of intervention materials in languages other than English, with documentation of which languages were offered; and (II) inclusion of systematic translation and cultural adaptation processes for individuals with limited English proficiency, including back-translation procedures, cultural review panels, or community input processes. Studies were systematically reviewed for explicit language-based exclusion criteria and documentation of participants’ primary or preferred languages.
Studies were systematically reviewed for digital access and literacy using operationalized criteria adapted from prior research (13). Each criterion was assessed using standardized definitions: (I) baseline digital literacy was considered adequately assessed if studies evaluated participants’ ability to use smartphones for basic functions like chatting, reading, and writing, or assessed prior technology experience and comfort levels; (II) appropriate device/software training was rated as adequate if studies provided structured patient training and guidance on technology use, including orientation protocols or documented training procedures; (III) reading level appropriateness required assessment of content using plain language principles, avoidance of medical jargon, or explicit evaluation of health literacy considerations; (IV) health-related content language was evaluated for display and organization of information with simplified navigation, clear visual design, and intuitive user interfaces; and (V) device and software usability required formal usability testing, feasibility studies, or systematic user experience evaluation conducted before or during implementation. Additionally, the context surrounding technological access for the intended populations was reviewed. Compatibility with digital accessibility tools was systematically extracted and categorized as: (I) screen reader compatibility; (II) text size enhancement options; (III) text-to-speech functions; and (IV) other accessibility accommodations (high contrast modes, keyboard navigation, etc.).
Synthesis of results
We did not reach out to study authors for additional or unclear information. Given the anticipated variability in tasks and endpoints, we did not perform formal meta-analyses. Instead, we provided aggregate statistics to offer an overview of the characteristics of the eligible trials. The data was then organized into thematic categories based on health equity, cultural competence, and digital access, allowing for the identification of patterns and gaps.
Results
Four relevant product codes were identified from the FDA Product Code Database search (Table 1 and Figure 1). The product search identified seven FDA cleared DTx products (Table 2 and Appendix 1). There were 32 clinical studies identified in the clinical evidence search (Figure 2). Of these, 25 studies pertained to the devices under evaluation or a precursor device. Precursors were defined as versions of the device with the same intended purpose and for the same intended use population that were delivered through digital mechanisms different than those in the final version of the device (e.g., web-based vs. mobile app). Precursor technologies were included if they were referenced in the FDA approval documentation and relevant literature was identified through the clinical evidence search. These studies are described in Table 3.
Table 1
| Product code | Device | Definition | Physical state | Medical specialty |
|---|---|---|---|---|
| QMY | Computerized Behavioral Therapy Device For Treating Symptoms | A computerized behavioral therapy device for treating symptoms of gastrointestinal conditions is a prescription device intended to provide a computerized version of condition-specific therapy as an adjunct to standard of care treatments to patients with gastrointestinal conditions | This is a software as a medical device that delivers therapy | Gastroenterology, urology |
| PWE | Computerized Behavioral Therapy Device For Psychiatric Disorders | The device is intended to provide cognitive behavioral therapy to treat substance use disorder | The device is a software-based mobile app downloaded onto a smartphone | Neurology |
| QFT | Digital Therapeutic Software For Attention Deficit Hyperactivity Disorder | A digital therapy device for ADHD is a software intended to provide therapy for ADHD or any of its individual symptoms as an adjunct to clinician supervised treatment | Digital video game-like software device that delivers a creative and immersive action video game experience | Neurology |
| QVO | Computerized Behavioral Therapy Device | The device is intended to provide cognitive behavioral therapy to treat insomnia | The device is a software-based mobile app downloaded onto a smartphone | Neurology |
ADHD, attention deficit hyperactivity disorder.
Table 2
| Product code | 510(k) or de novo number | Product name | Indication | Company | FDA decision date |
|---|---|---|---|---|---|
| QMY | DEN200029 (26) | Parallel† | Irritable bowel syndrome | Mahana Therapeutics | 25-Nov-2020 |
| K211372 (27) | Mahana Parallel Digital CBT Mobile Application for IBS† | Irritable bowel syndrome | Mahana Therapeutics | 02-Jun-2021 | |
| K211463 (28) | Regulora | Irritable bowel syndrome | MetaMe Health | 21-Nov-2021 | |
| PWE | DEN160018 (29) | reSET | Substance-use disorder | Pear Therapeutics | 14-May-2017 |
| K173681 (30) | reSET-O | Opiate-use disorder | Pear Therapeutics | 10-Dec-2018 | |
| QVO | K191716 (31) | Somryst | Insomnia | Pear Therapeutics | 23-Mar-2020 |
| QFT | DEN200026 (32) | EndeavorRx | ADHD | Akili Interactive | 15-Jun-2020 |
†, ‘Parallel’ and ‘Mahana Parallel Digital CBT Mobile Application for IBS’ are manufactured by the same company, have the same indications for use, and are considered substantially equivalent per the FDA regulatory submissions. They differ only in their method of delivery—web-based vs. mobile app. The manufacturer website lists these as a single product. They are considered interchangeable through the rest of this paper. ADHD, attention deficit hyperactive disorder; CBT, cognitive behavioral therapy; FDA, Food and Drug Administration; IBS, irritable bowel syndrome.
Table 3
| Product | Reference | Study design (n) | Study purpose | Study population | Results |
|---|---|---|---|---|---|
| EndeavorRx | (33) | Randomized parallel group follow-up study nested within an randomized controlled trial (n=175) | Assess potential maintenance of clinical benefit for cognition and ADHD symptoms following 4 weeks of at-home digital therapy in ADHD children | Children aged 8 to 12 years who completed a 28-day randomized clinical trial evaluating the efficacy of a digital video game-like therapeutic for ADHD | TOVA API (mean difference): 0.407 (SD =2.823)† |
| Conclusion: no statistical improvements in measures | |||||
| (34) | Case-control interventional study (n=63) | Characterizing efficacy of evidence-based cognitive control intervention at enhancing attentional abilities for children with sensory processing dysfunction | Children with sensory processing disorder with and without challenges with inattention or hyperactivity compared to typically developing controls | TOVA API: F(2, 43) =0.345, P=0.71 (2-way RM ANOVA). Perceptual discrimination paradigm: F(2, 40) =2.7, P=0.08 (2-way RM ANOVA). Project EVO assessment: F(2, 50) =1.5, P=0.24 (2-way RM ANOVA). Basic response time task: F(2, 40) =0.50 P=0.62 (2-way RM ANOVA) | |
| Conclusion: no statistical improvements in measures | |||||
| (35) | Case-control interventional study (n=80) | Assess treatment acceptability and explore improvements in cognitive process implicated in ADHD following use of a digital video game-like therapeutic in children with ADHD | Children aged 8 to 12 years with or without confirmed diagnoses of ADHD with normal intellectual functioning who were off any psychotropic medication | TOVA API: t=2.21, P=0.033, effect size (d) =0.35, mean of differences =−1.43 (2-tailed t-test). Working memory (BRIEF-parent form): z=1.81, P=0.07, effect size (r) =0.29, mean of differences =2.48 (Wilcoxon signed-rank test). Spatial working memory (CANTAB): improvements (P<0.05) on 8 of 12 variables. Rapid visual processing (CANTAB): improvements (P<0.05) on 3 of 10 variables. Delayed match to sample (CANTAB): no significant improvements on 0 of 16 variables | |
| Conclusion: statistical improvements in attention performance (TOVA API), working memory (CANTAB), and visual processing speed (CANTAB) | |||||
| (36) | Before-and-after study (n=28) | Examine changes in neural markers of attentional control (midline frontal theta circuitry) following use of a digital video game-like therapeutic in children with ADHD | Children aged 8 to 12 years with a confirmed ADHD diagnosis, without psychiatric or neurological comorbidities who had been off ADHD medications for at least 30 days prior to study initiation | MFT EEG power: F(1, 21) =4.76, P=0.04, d=0.44 (RM ANOVA). Perceptual discrimination task (response time): t(24) =3.35, P=0.003, effect size (d) =0.62 (paired t-test). Sustained attention task (TAU): t(23) =2.09, P=0.048, effect size (d) =0.46 (paired t-test). Vanderbilt ADHD diagnostic parent scale: t(24) =5.32, P<0.001, effect size (d) =1.25 (paired t-test) | |
| Conclusion: statistical improvements in attention-related brain activity, response time in attention tasks, and parent-reported ADHD symptoms. No significant changes in response time variability or sustained attention | |||||
| (37) | Randomized controlled trial (n=348) | Evaluate the efficacy and tolerability of a digital video game-like therapeutic in improving attention and cognitive control for pediatric patients with ADHD | Children aged 8 to 12 years with a confirmed diagnosis of ADHD, cognitive deficits in the attention domain, a baseline intelligence quotient of 80 and above who were not optimally managed with stimulants and were willing to discontinue stimulants prior to study enrollment | TOVA API: P=0.006, Hodges-Lehmann estimate =0.88 (Wilcoxon rank-sum test). No intervention-group differences for secondary measures: IRS, ADHD Rating Scale total and subscales, BRIEF-Parent subscales, and CGI-I (Wilcoxon rank-sum test) | |
| Conclusion: statistical improvements in attention performance (TOVA API) | |||||
| (38) | Open-label interventional effectiveness study (n=206) | Evaluate a digital video game-like therapeutic as an adjunctive therapy in children currently taking stimulant medication for their ADHD | Children aged 8 to 14 years with diagnosed ADHD | IRS: P<0.001 (both), mean change =−0.7 (on stimulants), −0.5 (no stimulants), effect size (d) =0.65 and 0.59, respectively (paired t-test). ADHD-RS total: P<0.001 (both), mean change =−6.1 (on stimulants), −7.4 (no stimulants), effect size (d) =0.85 and 0.74, respectively (paired t-test). ADHD-RS-inattention: P<0.001 (both), mean change =−3.4 (on stimulants), −3.9 (no stimulants), effect size (d) =0.77 and 0.70, respectively (paired t-test). ADHD-RS-hyperactivity/impulsivity: P<0.001 (both), mean change =−2.7 (on stimulants), −3.4 (no stimulants), effect size (d) =0.69 and 0.67, respectively (paired t-test). CGI-I: P<0.001 (both), score =3.3 (on stimulants), 3.4 (no stimulants), effect size (d) =0.81 and 0.70, respectively (paired t-test) | |
| Conclusion: statistical improvements in impairment (IRS), ADHD symptoms (ADHD-RS Total, ADHD-RS-IA, ADHD-RS-HI), and clinical functioning (CGI-I) in both stimulant and non-stimulant groups | |||||
| (39) | Randomized controlled trial (n=19) | Measure feasibility of using an video-game like treatment for cognitive control in children with autism spectrum disorder and co-occurring ADHD symptoms | Children aged 9 to 15 years with a confirmed diagnosis of ASD, symptoms of ADHD, a nonverbal IQ of at least 70 and a verbal mental age equivalent of at least 8 years | TOVA API: P=0.12, effect size (g) =0.72. BRIEF2 (BRI, ERI, CRI): P=0.01, effect size (g) =1.24 (BRI); P=0.12, effect size (g) =0.71 (ERI); P=0.003, effect size (g) =1.64 (CRI). ADHD Rating Scale: P=0.003, effect size (g) =2.03. SSIS social skills, problem behavior: P<0.05 (both), effect size (g) =1.32 (both) | |
| Conclusion: no statistical improvements relative to control, but promising effect sizes supporting efficacy of treatment | |||||
| Mahana | (14) | Randomized controlled trial (n=734) | Evaluate clinical effectiveness of telephone-delivered CBT and web-delivered CBT vs. treatment as usual | Adults with refractory IBS symptoms for at least 12 months at the time of study enrollment, who had clinically significant symptoms despite first-line therapies, no evidence of bowel cancer, and had not received CBT in the past 2 years | BS-SSS: P<0.001, mean reduction =61.6 (TCBT); P=0.002, mean reduction =35.2 (WCBT) (paired t-test). WSAS: P<0.001, mean reduction =3.5 (TCBT); P=0.001, mean reduction = 3.0 (WCBT) (paired t-test). HADS: P<0.001, mean reduction =2.8 (TCBT); P=0.001, mean reduction = 2.3 (WCBT) (paired t-test) |
| Conclusion: statistical improvements in IBS symptom severity (IBS-SSS), functional impairment (WSAS), and anxiety/depression (HADS) in both TCBT and WCBT groups | |||||
| (40) | Longitudinal qualitative study nested in a randomized controlled trial (n=34) | Identify barriers and facilitators to engagement with telephone- and web-delivered CBT for refractory IBS | Adults with IBS who participated in a randomized controlled trial evaluated the efficacy of telephone-delivered CBT and web-delivered CBT (15) | Findings: participants viewed CBT as credible. Flexible delivery helped. Barriers: skepticism, motivation, WCBT novelty. Positive changes: IBS understanding, attitudes, behaviors, symptoms. Lasting effects on work, social life, with some attenuation over time | |
| (41) | Before and after study nested in a randomized controlled trial (n=34) | Investigate whether baseline brain and gut microbiome parameters predict CBT response | Adults with moderately severe IBS who participated in a randomized controlled trial assessing clinical response to home-based CBT compared with clinic-based CBT (43) | IBS-SSS: P=0.86, effect size (d) =−0.06 | |
| Findings: CBT responders had reduced connectivity in sensorimotor, brainstem, salience, default mode networks, and white matter changes in basal ganglia. Changes correlated with bacteroides expansion | |||||
| (43) | Randomized controlled trial nested in a prospective before and after study (n=53) | Evaluate if changes in outcomes in the before and after study are attributable to distress resulting from the beginning of the COVID-19 pandemic | Adults with IBS, regular access to a computer with internet, and at least mild IBS symptom severity | IBS-SSS: P<0.001 (t=−4.20, df =22, effect size (d) =0.88, 2 months); P<0.0001 (t=−5.33, df =21, effect size (d) =1.14, 3 months) (paired t-test). Utilization: 52% completed 4+ sessions. IBS-BRQ (safety behaviors): P=0.08 (t=−1.827, df =22, 1 month); P<0.03 (t=−2.428, df =20, 2 months) (paired t-test). IBS-BRQ (avoidance behaviors): P=0.31 (t=−1.031, df =22, 1 month); P=0.06 (t=−1.953, df =20, 2 months) (paired t-test). CSFBD: P=0.15 (t=−1.509, df =20, 1 month); P<0.03 (t=−2.458, df =19, 2 months) (paired t-test). VS.I: P=0.27 (t=−1.135, df =20, 1 month); P<0.02 (t=−2.563, df =20, 2 months) (paired t-test) | |
| Conclusion: statistical improvements in IBS symptoms from baseline to post-treatment, with small to moderate between-groups effect sizes compared to control | |||||
| (15) | Exploratory factorial RCT (n=135) | Assess the effectiveness of Regul8 against the prescribed medications in UK general practice for IBS and placebo | Adults age 18 to 60 years with symptoms of IBS not currently taking mebeverine or methylcellulose | IBS-SSS: P=0.243, mean =218.2 (no website), 207.9 (website), 193.4 (website + support) (ANCOVA). HADS: P=0.123, mean =8.0 (no website), 8.8 (website), 9.2 (website + support) (ANCOVA). SGA: P=0.035, responders =32.4% (no website), 45.7% (website), 63.2% (website + support) (ordinal regression). PEQ: P=0.001, 56.8% with score =0 (no website), 18.4% (website), 10.5% (website + support) (ordinal regression) | |
| Conclusion: no statistical improvements in primary outcome of IBS symptom severity (IBS-SSS). Statistical improvements in secondary measures (perception of relief, empowerment) | |||||
| (44) | Qualitative study nested in a randomized controlled trial (n=31) | Explore patients’ views and experiences of using a CBT-based website for IBS self-management | Adults with IBS who used Regul8 in a randomized clinical trial (15) | Findings: three engagement types in patients: some (mostly website-only) had no engagement, some engaged with lifestyle advice, others engaged with psychological content related to IBS | |
| Regulora | (45) | Randomized controlled trial (n=378) | Evaluate efficacy of gut-directed hypnotherapy software as a medical device compared to active comparator muscle relaxation software as a medical device | Adults with IBS symptoms who agreed to use an online tool to track IBS symptoms for at least 30 days prior to study point of enrollment | Abdominal pain intensity: P=0.81, mean difference =0.6 (ANOVA). Abdominal pain frequency: P=0.76, mean difference =0.044 (ANOVA). >30% BSFS improvement: P=0.48, OR =1.17 (GDH vs. MR) (CMH test). Daily stool frequency (IBS-C): P=0.68, mean difference =0.080 (GDH vs. MR); IBS-D: P=0.95, mean difference =0.173 (mixed models analysis). IBS-QOL: P=0.21, mean difference =4.59 (GDH vs. MR) (mixed models analysis). WPAI: P=0.3676, mean difference =2.372 (GDH vs. MR) (mixed models analysis) |
| Conclusion: no statistical improvements in any measures | |||||
| reSET | (46) | Randomized controlled trial (n=507) | Evaluate effectiveness of the Therapeutic Education System, an internet-delivered behavioral intervention (precursor to reSET) | Adults with recent self-reported use of illicit substances who had entered an outpatient community-based treatment program within 30 days of study entry who planned to remain in the treatment program for more than 3 months and were not currently being treated with opioid replacement therapy | 12-week abstinence: P=0.010, OR =1.62 (treatment vs. control) (logistic regression). 12-week drop-out rate: P=0.010, HR =0.72 (treatment vs. control) (Cox regression) |
| Conclusion: statistical improvements in abstinence and retention in treatment group relative to control | |||||
| (47) | Randomized controlled trial (n=494) | Evaluate effectiveness of the Therapeutic Education System (precursor to reSET) with incarcerated individuals with substance-user disorder | Incarcerated adults with low to moderate severity substance use disorders who were not receiving other substance-use treatment and expected release dates within 4 to 6 months of study enrollment | 12-month reincarceration: P=0.13, OR =1.41 (treatment vs. control) (logistic regression). Criminal activity: P=0.97, OR =1.01 (treatment vs. control) (logistic regression). Illegal drug use: P=0.98, OR =0.99 (treatment vs. control) (logistic regression) | |
| Conclusion: no statistical improvements in any measures | |||||
| (48) | Secondary data analysis of randomized controlled trial (n=206) | Determine how patient engagement with a digital therapeutic for substance use disorder delivered at clinics was associated with abstinence outcomes | Adults who had used illicit substances in the 30 days prior to study entry, were in their first 30 days of enrollment in a community treatment program for substance use disorder, and were not currently receiving medication for opioid use disorder | 9–12 weeks abstinence: OR 1.09 (treatment engagement vs. no treatment), 95% CI: 1.07–1.12 (logistic regression) | |
| Conclusion: greater engagement leads to increased probability of abstinence | |||||
| (49) | Real-world observational study (n=602) | Evaluate real-world engagement and clinical outcomes in patients diagnosed with substance use disorder who were prescribed reSET | Patients who were prescribed reSET, filled the prescription, and who were exposed to therapeutic content by completing at least one lesson | Last 4-week retention: 74%. Abstinence: 62% | |
| Conclusion: participants exhibited high retention rates and promising rates of abstinence | |||||
| reSET-O | (50) | Randomized controlled trial (n=136) | Evaluate comparative effectiveness of (I) a computer-assisted CRA behavioral treatment with vouchers, (II) therapist-delivered CRA behavioral treatment with vouchers, and (III) treatment as usual | Adults meeting DSM-IV opioid dependence criteria and FDA methadone treatment qualification criteria, receiving concurrent treatment with buprenorphine, without comorbid psychiatric disorders or significant mental illness | Abstinence: P<0.05, F(2, 132) =3.06, therapist-delivered =7.98 weeks (SEM =1.09), computer-assisted =7.78 weeks (SEM =1.17), standard =4.69 weeks (SEM =0.88) (ANOVA); effect size (therapist-delivered) r=0.19 (SE =0.09), P=0.03; effect size (computer-assisted) r=0.18 (SE =0.09), P=0.04 (Fisher’s LSD). Retention: P=0.69, χ²(2) =0.73, standard =58%, therapist-delivered =53%, computer-assisted =62%. Addiction Severity Index: employment =0.55 (SEM =0.04), drug =0.38 (SEM =0.01), legal =0.33 (SEM =0.03), psychiatric =0.30 (SEM =0.03), family =0.20 (SEM =0.03), medical =0.18 (SEM =0.03), alcohol =0.06 (SEM =0.01); P<0.05 except alcohol (RM ANOVA). HAQ-P: P=0.86, F(2, 121) =0.15, standard =4.74 (SEM =0.05), therapist-delivered =4.84 (SEM =0.04), computer-assisted =4.86 (SEM =0.05) (ANOVA) |
| Conclusion: statistical improvements in abstinence and ASI scores relative to standard treatment | |||||
| (51) | Block-randomized treatment trial (n=170) | Identify if the addition of an Internet-based community reinforcement approach intervention increases abstinence rates from opioid and cocaine use as compared to a contingency management program | Adults meeting DSM-IV opioid dependence criteria and FDA buprenorphine treatment qualification criteria, without comorbid psychiatric disorders or significant mental illness | Addiction Severity Index: medication subscale, t(127) =2.11, P=0.04, CRA+ > CM-alone (t-test). 12-week retention: HR (CRA+ vs. control) =2.12 [χ2(1) =6.14, P=0.013], OR =2.30 [χ2(1) =5.57, P=0.018] (Cox regression). Longest continuous abstinence: t(152.4) =1.25, P=0.214, CRA+ =55.0 days, CM-alone =49.5 days (t-test). Total abstinence: t(133.4) =2.59, P=0.011, CRA+ =67.1 days, CM-alone =57.3 days (t-test) | |
| Conclusion: statistical improvements in one subscale of the Addiction Severity Index (medication), retention, and total abstinence | |||||
| (52) | Randomized controlled trial (n=160) | Evaluate effectiveness of a web-based behavioral intervention when partially substituted for standard counseling in a community-based specialty addiction treatment program | Adults entering methadone maintenance treatment for opioid dependence | Weeks of opioid abstinence: F(1, 158) =5.90, P<0.05 (48% TES vs. 37% standard) for overall study weeks of abstinence (generalized linear models). Abstinence over time: χ2(3) =4.02, P=0.26; z=2.10, P<0.05, OR =2.04 (reduced standard + TES vs. standard) (logistic regression). Retention: HR =0.94, z=−0.33, P=0.74 (Cox regression) | |
| Conclusion: statistical improvements in certain abstinence outcomes relative to standard treatment | |||||
| Somryst | (53) | Randomized controlled trial (n=34) | Evaluate feasibility and efficacy of computer-based CBT-I for patients with comorbid psychiatric diagnoses | English speaking adults engaged in mental health care treatment with self-identified difficulty sleeping, available for daytime weekday study visits | PSQI: F(1, 26) =10.5, P=0.003 (ANOVA); week 6: P=0.0006, 10 vs. 13 (cb-CBT-I vs. sleep diary), Cohen d =0.72 (Fisher’s exact). ISI: F(1, 26) =15.3, P=0.0006 (ANOVA); week 6: P=0.009, 13 vs. 19 (cb-CBT-I vs. sleep diary), Cohen d =1.1; decrease in cb-CBT-I: P<0.0001, Cohen d =1.8; treatment response: 53% vs. 0%, P=0.0025 (Fisher’s exact) |
| Conclusion: statistical improvements in sleep quality (PSQI) and insomnia symptoms (ISI) | |||||
| (18) | Randomized clinical trial (n=303) | Evaluate long term improvements in insomnia following treatment with a web-based automated CBT-I program | Adults with sleep-onset or sleep maintenance insomnia who reported significant distress or impairment associated with insomnia symptoms, who had not received any previous behavioral treatment for insomnia | ISI: F(3, 1063) =20.65, P<0.001 (paired t-test), favor treatment. SOL: F(3, 1042) =6.01, P<0.001 (paired t-test), favor treatment. Wake after sleep onset (WASO): F(3, 1042) =12.68, P<0.001 (RM ANOVA), SHUTi. Sleep efficiency: F(3, 1042) =8.39, P<0.001 (paired t-test), favor treatment. No. of awakenings: F(3,1042) =3.41, P=0.02 (paired t-test), favor treatment. Sleep quality: F(3, 1042) =2.93, P=0.03 (paired t-test), favor treatment. Total sleep time: F(3, 1042) =0.40, P=0.76 (paired t-test) | |
| Conclusion: statistical improvements in insomnia severity, sleep onset latency, wake after sleep onset, number of awakenings, and sleep quality | |||||
| (19) | Randomized controlled trial (n=1,149) | Evaluate effectiveness of a web-based CBT-I program for short-term reductions in depressive symptoms and long-term reductions in major depressive disorder, suicide risk, anxiety, and disability | Adults with diagnostically confirmed insomnia, subclinical depression, reliable internet access, fluency in written English, and no serious mental illness diagnoses | PHQ-9: P<0.001, F(2, 640.1) =37.2, SHUTi =3.8 (SEM =0.2), HealthWatch =5.5 (SEM =0.2) (RM ANOVA). PSF (suicidality): P=0.036, F(2, 642.0) =3.4, SHUTi =0.6 (SEM =0.1), HealthWatch =0.7 (SEM =0.1) (RM ANOVA). Insomnia Severity Index (ISI): P<0.001, F(2, 595.0) =111.3, SHUTi =7.7 (SEM =0.3), HealthWatch =12.1 (SEM =0.3) (RM ANOVA). GAD-7: P<0.001, F(2, 624.5) =23.0, SHUTi =3.1 (SEM =0.2), HealthWatch =4.2 (SEM =0.2) (RM ANOVA). WHODAS-12: P<0.001, F(2, 668.3) =10.6, SHUTi =16.1 (SEM =0.3), HealthWatch =17.2 (SEM =0.3) (RM ANOVA). BTACT: P=0.782, F(1, 854.1) =0.1, SHUTi =44.3 (SEM =0.5), HealthWatch =43.8 (SEM =0.5) (RM ANOVA). GHSQ-sleep: P=0.034, F(2, 627.4) =3.4, SHUTi =5.2 (SEM =0.1), HealthWatch =5.4 (SEM =0.1) (RM ANOVA). AHSQ-sleep: P=0.001, F(2, 1147.0) =7.6, SHUTi =1.2 (SEM =0.1), HealthWatch =1.8 (SEM =0.1) (RM ANOVA) | |
| Conclusion: statistical improvements in depression, insomnia, anxiety, disability, and AHSQ relative to control | |||||
| (54) | Cross-sectional user survey nested within randomized controlled trial (n=21) | Assess user’s perception of the usability, likeability, usefulness, and effectiveness of the online CBT-I program | Adults with insomnia who received access to a digital CBT-I program as part of a randomized controlled trial | Findings: 95% found SHUTi improved sleep, 90% rated it effective, 81% predicted long-term cure, 57% reduced doctor visits, 73% reduced medication use, 86% kept diaries, 62% followed treatment recommendations |
†, no P value reported. ADHD, attention deficit hyperactive disorder; AHSQ, Actual Help-Seeking Questionnaire; ASD, autism spectrum disorder; BRI, Behavioral Regulation Index; BRIEF, Behavior Rating Inventory of Executive Function; BSFS, Bristol Stool Form Scale; BTACT, Brief Test of Adult Cognition by Telephone; CANTAB, Cambridge Neuropsychological Test Automated Battery; CBT, cognitive behavioral therapy; CBT-I, cognitive-behavioral therapy for insomnia; CGI-I, Clinical Global Impressions-Improvement; CI, confidence interval; CM-alone, Contingency Management Alone; CMH, Cochran-Mantel-Haenszel; COVID-19, coronavirus disease 2019; CRA, Community Reinforcement Approach; CRA+, Community Reinforcement Approach Intervention Plus; CRI, Cognitive Regulation Index; CSFBD, Cognitive Scale for Functional Bowel Disorders; df, degrees of freedom; DSM, Diagnostic and Statistical Manual of Mental Disorders; EEG, electroencephalogram; ERI, Emotional Regulation Index; FDA, Food and Drug Administration; GDH, Gut-Directed Hypnotherapy; GHSQ, General Help-Seeking Questionnaire; HADS, Hospital Anxiety and Depression Scale; HAQ-P, Helping Alliance Questionnaire-Patient Version; HR, hazard ratio; IBS, irritable bowel syndrome; IBS-BRQ, IBS behavioral responses questionnaire; IBS-QOL, IBS Quality of Life; IBS-SSS, Irritable Bowel Syndrome Symptom Severity Score; IRS, Impairment Rating Scale; ISI, Insomnia Severity Index; MFT, Midline frontal theta; MR, Muscle Relaxation; OR, odds ratio; PEQ, Patient Enablement Questionnaire; PHQ-9, Patient Health Questionnaire-9; PSF, Psychiatric Symptom Frequency Scale; PSQI, Pittsburgh Sleep Quality Index; RM ANOVA, repeated measures analysis of variance; RS, Rating Scale; SD, standard deviation; SEM, standard error of the mean; SGA, Subject’s Global Assessment of Relief; SOL, sleep onset latency; SSIS, Social Skills Improvement System; TAU, treatment as usual; TCBT, telephone-delivered CBT; TES, Therapeutic Education System; TOVA API, Test of Variables of Attention-Attention Performance Index; UK, United Kingdom; VSI, Visceral Sensitivity Index; WCBT, web-based CBT; WHODAS, World Health Organization Disability Assessment Schedule; WPAI, Work Productivity and Activity Impairment; WSAS, Work and Social Adjustment Scale.
Seven of the identified studies pertained to non-digital evidence-based therapeutic models that underlie the therapeutic intervention delivered by the devices under evaluation. Information about the underlying therapeutic models was included if they were referenced in the FDA approval documentation and relevant literature was identified through the clinical evidence search. These studies are described in Table 4. The therapeutic intervention for EndeavorRx is a video game-like software that was developed and validated for current use in digital format, so there is no applicable therapeutic-model. Somryst implements a model of cognitive behavioral therapy (CBT) for insomnia. The regulatory approval documents and labeling for this product reference pre-existing internet-based CBT-I programs which are included in Table 3.
Table 4
| Product | Reference | Study design | Study purpose | Study population | Results |
|---|---|---|---|---|---|
| Mahana | (42) | Randomized controlled trial (n=436) | Assess clinical response to home-based CBT compared with clinic-based CBT and patient education | Adults with IBS who had GI symptoms considered ‘moderately severe’ without other GI disease or major psychiatric disorder, and who were not currently undergoing IBS-targeted psychotherapy | CGI-I: MC-CBT—EDU: immediate =0.36±0.30 (P<0.05), 3 months =0.39±0.32 (P<0.05), 6 months =0.28±0; MC-CBT—S-CBT: immediate =0.03±0.31, 3 months =0.08±0.34, 6 months =0.05±0.34 (linear probability model). IBS-SSS: MC-CBT—EDU: immediate =−4.95±22.4 , 3 months =−17.41±22.9, 6 months =−13.34±23.4; MC-CBT—S-CBT: immediate =−8.39±24.0, 3 months =−2.71±24.2, 6 months =−7.74±24.9 (linear probability model) |
| Conclusion: statistical improvements in IBS symptoms (CGI-I) for MC-CBT group relative to EDU group. No statistical improvements of MC-CBT relative to S-CBT group | |||||
| (55) | Randomized controlled trial (n=64) | Test efficacy of CBT-based self-management program as compared to treatment-as-usual | Adults with IBS who lived in proximity to the study center who did not have other GI conditions or current serious mental disorders | SGA (6 months): 76.7% (self-management), 21.2% (TAU), OR =12.2 (logistic regression). IBS-SSS (6 months): 109 (self-management), 29.5 (TAU), OR =5.3 (logistic regression). WSAS (8 months): 4.7 (self-management), −0.72 (TAU), t=3.41, P<0.001 (t-test). HADS anxiety (6 months): F(2. 8)=14.92, P=0.05. Reduction for treatment (ANOVA). HADS depression (6 months): F(2.36)=1.35, P=0.26 (ANOVA) | |
| Conclusion: statistical improvements in self-management, IBS symptom severity, functional impairment, and anxiety relative to control | |||||
| Regulora | (16) | Retrospective data analysis (n=1,000) | Audit of a large cohort of IBS patients treated with hypnotherapy in standard clinical practice | Adults with IBS were referred to a hypnotherapy unit after failing to adequately respond to first-line treatment | BS-SSS: P<0.001, pre-HT =317.8, post-HT =189.0, mean change =128.8 (95% CI: 122.3, 135.3) (paired t-test). Noncolonic Symptom Score: pre-HT =224.9, post-HT =160.1, change =64.8 (95% CI: 60.3, 69.2), P<0.001 (paired t-test). QoL score: pre-HT =264.60, post-HT =330.80, change =66.1 (95% CI: 61.6, 70.6), P<0.001 (paired t-test). HADS anxiety: pre-HT =11.1, post-HT =8.0, change =3.0 (95% CI: 2.8, 3.3), P<0.001 (paired t-test). HADS depression: pre-HT=7.0, post-HT =4.6, change =2.5 (95% CI: 2.3, 2.7), P<0.001 (paired t-test) |
| Conclusion: statistical improvements in IBS symptom severity, quality of life, depression, and anxiety. No control group in study | |||||
| (56) | Before-and-after study (n=18) | Assess the effects of hypnosis on gut pain, muscle tone, IBS symptoms, psychological symptoms, autonomic arousal, somatization, and long-term outcomes (10 months) | Adults with IBS who had experienced IBS symptoms at least once a week in the month prior to enrollment and who were not currently taking any psychotropic or IBS medications | Bowel symptoms: F(4, 12)=0.395, P=0.808 (MANOVA). SCL-90-R (psychological): 39.3±7.3 vs. 27.1±5.8 (pre-post), P=0.013 (paired t-test). Beck Depression Inventory: 7.92±0.82 vs. 7.31±1.20, P>0.05 (not specified) (paired t-test). Muscle tone (Barostat): 67.83±7.54 vs. 66.19±7.79 mL: t(16)=0.213, P=0.834 (paired t-test). Rectal pain thresholds (Barostat): 28.75±2.84 vs. 28.73±3.33 mmHg; t(16)=0.005, P=0.996 (paired t-test) | |
| Conclusion: statistical improvements in psychological symptoms, promising improvements in other measures warranting further study. No control group | |||||
| (57) | Randomized controlled trial (n=24) | Assess the effects of hypnosis on gut pain, muscle tone, IBS symptoms, psychological symptoms, autonomic arousal, somatization, and long-term outcomes (10 months) | Adults with IBS who had experienced IBS symptoms at least once a week in the month prior to enrollment and who were not currently taking any psychotropic or IBS medications | SPSI: 29.2±3.45 vs. 19.2±2.89 (pre-post), P=0.0001 (paired t-test). SCL-90-R: 34.6±4.07 vs. 25.3±4.54, P=0.002 (paired t-test). Skin conductance: 1.41±0.18 vs. 1.01±0.19, P=0.01 (paired t-test). Immediate treatment group relative to delayed control group: less pain: t(29)=2.07, P=0.049; lower proportion of bowel movements rated hard or watery: t(29)=3.26, P=0.003; bloating: t(29)=0.20, P=0.68; frequency of bowel movements: t(27)=1.09, P=0.286 (paired t-test) | |
| Conclusion: statistical improvements in physical symptoms, psychological symptoms, and self-reported pain | |||||
| reSET | (17) | Qualitative semi-structured interviews (n=14) | Increase understanding of how patients with substance use disorder prefer to receive app-based treatments to inform the implementation of these treatments in primary care | Adult patients with past-year cannabis, stimulant, or opioid use disorder who used a smartphone in daily life | Findings: participants preferred learning about apps during drug use discussions, integrated into existing visits. Most wanted clinician support for app use, seeking a trusting, supportive relationship. Follow-up via phone or secure messaging was favored for convenience, no copays or travel |
| (58) | Pair-matched randomized trial (n=16) | Evaluate and validate of the Community-Reinforcement Approach to alcoholism | Adult males admitted to a state hospital for treatment of alcoholism who suffered withdrawal symptoms and were diagnosed as alcoholic | Mean percent (reinforcement group vs. control): spent drinking (14% vs. 79%), unemployed (5% vs. 62%), away from family (16% vs. 36%), institutionalized (2% vs. 27%), P<0.005 for all measures (t-test) | |
| Conclusion: statistical improvements in treatment group relative to control for all outcomes |
†, this refers to the first study (“Study 1”) (57). ‡, this refers to the second study (“Study 2”) (58). ANOVA, analysis of variance; CBT, cognitive behavioral therapy; CGI-I, Clinical Global Impressions-Improvement; CI, confidence interval; EDU, patient education group; GI, gastrointestinal; HADS, Hospital Anxiety and Depression Scale; IBS, irritable bowel syndrome; HT, hypnotherapy; IBS-SSS, Irritable Bowel Syndrome Symptom Severity Score; MANOVA, multivariate analysis of variance; MC-CBT, minimal contact-cognitive behavioral therapy; OR, odds ratio; QoL, quality of life; S-CBT, Standard Cognitive Behavioral Therapy; SCL-90-R, Symptom Checklist 90 Revised; SGA, Subject’s Global Assessment of Relief; SPSI, Stress-Related Physical Symptoms Inventory; TAU, treatment as usual; WSAS, Work and Social Adjustment Scale.
The identified literature was assessed across the themes of health equity, cultural and linguistic appropriateness, and digital literacy and digital access. All 32 studies were included in the health equity and cultural and linguistic appropriateness assessments. Seven studies that did not involve use of a digitally delivered intervention were excluded from the digital access and digital literacy evaluation; therefore, the assessment for these categories is based on 25 studies.
Across the 32 included studies, the most reported PROGRESS-Plus factors were gender (n=31), race/ethnicity (n=22), and educational status (n=21) (Figure 3). Subgroup or differential effects analyses for PROGRESS-Plus factors were reported in 13 studies; three of which found significant differences. Two studies, both for Mahana (14,15), used the English Indices of Deprivation to characterize the relative deprivation level of the participants’ primary place of residence. Both studies found that participants residing in more deprived areas were less likely to experience symptom reduction after completing web-delivered CBT for irritable bowel syndrome (IBS). One study for Regulora (16), found the hypnosis treatment was more effective for females than males.
No studies reported data related to the participants’ religious status or background. One study reported data related to LGBTQ+ status; this study enrolled a single participant identifying as transgender/gender nonconforming (17). Notably, this study was a qualitative usability and patient preference assessment of reSET which did not involve use of the device. One study for reSET was conducted in a prison setting with a population of incarcerated individuals who were nearing release from the facility.
Occupation was not applicable for seven of the 32 included studies because they were for EndeavorRx, which is indicated for pediatric use. All ten studies that reported occupation data limited this information to occupation status (e.g., employed full-time, employed part-time, unemployed, etc.); none reported type of occupation or profession.
The articles included in this review did not describe any cultural adaptation, either in their own design and development process or by reference to existing evidence-based cultural adaptation frameworks. There was no evidence that the researchers designing the interventions assessed for their own cultural biases or assessed how patients’ culture, language, or religion could impact interventional appropriateness or effectiveness. Five of the six products referenced existing evidence-based interventions as the basis for the model of therapy delivered by the DTx; none of which reference cultural competence or cultural adaptation. Four of the six products are available in English only, with no identified processes for translation and adaptation for individuals with limited English proficiency. Fifteen studies in this review also explicitly excluded participants who were not fluent in English and no studies included data about participants’ primary or native languages.
A ClinicalTrials.Gov listing (NCT05353296) for Somryst indicates that validation of a culturally adapted Spanish language version of the product was initiated in 2022. The study was terminated after enrolling only 7 of 200 anticipated subjects and no associated publications were identified. A 2022 press release from Pear Therapeutics indicated that reSET and reSET-O were available in Spanish. However, no clinical evidence regarding the translation and adaption of the products has been identified in the scientific literature. Further, Pear Therapeutics filed for bankruptcy and its products were subsequently withdrawn from the market.
Two studies, both for Somryst (18,19), assessed the effect of digital literacy on interventional effectiveness and found participants’ self-reported level of comfort with internet use to have a statistically significant mediating effect on the effectiveness of the intervention. Digital literacy considerations of reviewed articles are shown in Figure 4.
Technological access must be considered in the context of the intended use populations (Figure 5). reSET and reSET-O are intended for use by individuals with substance-use disorder and opiate-use disorder, respectively. These populations are often affected by houselessness and poverty, which limits their consistent access to reliable internet services. The clinical validation trials for these products involved participants using study-provided computer labs to access the investigational software during regularly scheduled medical appointments. This cannot be translated to real-world use of the products and none of the studies for these products reported the population’s baseline digital access. Similarly, children enrolled in the clinical trials for EndeavorRx were provided a tablet to use during the study, but in real-world application patients must have access to their own device which limits the use population to those who can afford these devices. None of the studies related to EndeavorRx described the population’s baseline digital access or assessed for digital literacy.
Products were also assessed on general accessibility. Clinical studies for reSET and reSET-O indicate that participants had the option to have the content of the intervention read aloud by the computer via text to speech. It is unclear if this feature is available in the commercially available version of the product which is mobile-app based, whereas the version used in these studies was computer-based. No information was found regarding compatibility with other digital accessibility tools for the other products in scope.
Discussion
The results of this scoping review indicate that there is a consistent deficit in assessing the appropriateness and effectiveness of DTx across health equity, cultural competence, and digital access domains. More than 60% of studies reported population characteristics for gender, race/ethnicity, and education level. However, less than 15% of studies reported other characteristics related to health equity. There was no data for any product regarding cultural and linguistic appropriateness and none are accessible for individuals with limited English proficiency. The two studies that assessed the effect of digital literacy on interventional effectiveness both found a statistically significant mediating effect (18,19). These results are supported by a review (20), which found that digital literacy was a critical factor influencing the uptake and effectiveness of DTx by both patients and health professionals. Their work similarly highlighted that while demographic characteristics like age, gender, and ethnicity were frequently considered in patient-related discussions, other factors such as digital literacy were underreported, despite being identified as the most important factor by health professionals.
Clinical evidence for reSET and reSET-O included acknowledgement of the particular accessibility and cultural challenges for the target patient population, however, the operationalization of these considerations was lacking across all included studies and particularly in the studies regarding the underpinning therapeutic model. Studies for 2 of the 3 products (Mahana and Regulora) intended for patients with IBS included some considerations of the participants’ demographic characteristics. Studies for EndeavorRx included very limited information about accessibility and equity; however, the therapeutic model underpinning this product is neurological rather than behavioral in nature which may inherently reduce the impact of these disparities.
None of the products included in the review reported considerations related to cultural competence or linguistic appropriateness. There were no references to evidence-based cultural adaptation frameworks and no products are available in non-English languages. This was despite the fact that 5 out of 6 reviewed Dtx products were based on existing evidence-based psychological or behavioral health interventions. These findings are particularly striking, as they reveal a fundamental gap in the lack of consideration for cultural factors in the original conception of the interventions these DTx are based upon. While this is the first study that has reviewed literature on the cultural and linguistic accessibility of DTx, other reviews focused on health interventions more broadly have found similar trends. A previous review (21) found that across 200 cluster and randomized clinical trials, only 9% of studies reported subgroup analyses by age/ethnicity/culture/language, 4% by socioeconomic status, 3% by place of residence, and less than 5% cumulatively for all other PROGRESS-Plus characteristics (21). Similarly, a review of medical device clinical trials found that only 14% provided subgroup analyses that addressed both effectiveness and safety, or sensitivity and selectivity, across gender, race, and age (2).
Unlike traditional medical devices like oxygen therapy, which work through proper use under supervision, DTx rely on patient engagement, motivation, and adherence to achieve therapeutic outcomes. The CLAS Standards in Health Care, which guides healthcare organizations in ensuring their services are responsive to the cultural and linguistic needs of diverse patient populations, are commonly implemented in hospitals via translated patient education materials or culturally tailored mental health services (22). These standards, however, do not currently apply to medical devices (13). While cultural and linguistic appropriateness may be less critical for traditional medical devices, which tend to function relatively independently of patient engagement, the engagement-driven nature of digital therapeutic interventions suggests that as these technologies become more prevalent, it is crucial to update existing standards to ensure they are equally engaging and effective for all users (23).
The FDA issued an Enforcement Policy in April 2020 that allowed the distribution and use of digital health therapeutic medical devices for mental health and psychiatric disorders without the requirement that these products comply with traditional regulatory policies (6). This guidance expired in November 2023 and as of 2024, any new DTx products must fully comply with all standard FDA regulatory requirements. Nonetheless, several federal policies and initiatives exist that aim to enhance access to digital technologies, particularly among underserved populations. The Digital Equity Act, part of the Infrastructure Investment and Jobs Act of 2021, was a federal policy that allocated $2.75 billion of federal funding to expand broadband access in rural and low-income areas and promote digital literacy training through community-based programs in schools and libraries (23).
However, while these initiatives improve access and useability of digital products and therapeutics, they may not be sufficient for racially and ethnically diverse populations which often face unique cultural and linguistic barriers. While the FDA has issued nonbinding guidances encouraging diversity in clinical trials, these efforts have largely focused on drugs and biologics, with less attention to devices such as DTx. Historically, digital health regulation has emphasized innovation and market access over equity, leaving gaps in guidance around cultural competence, linguistic accessibility, and digital literacy. One solution could involve incorporating requirements for cultural and linguistic appropriateness into the FDA approval process for DTx, similar to the CLAS Standards in other healthcare areas or the FDA’s current mandate of Diversity Action Plans in clinical trials. Furthermore, streamlined processes could be developed for the approval of multilingual versions of DTx products, ensuring that non-English-speaking populations have timely access to these interventions. Finally, incentivizing the development of DTx that address health disparities, such as extended market exclusivity or fast-track approvals, could further encourage the creation of more inclusive digital health solutions. To ensure equitable effectiveness, future regulatory frameworks must explicitly incorporate health equity requirements into the clinical validation and FDA approval processes for DTx.
In addition to various federal initiatives, key frameworks have also been created to better incorporate digital equity in the development of DTx. The Patient-Centered Outcomes Research Institute (PCORI) Framework aims to include lived experiences from target populations during the development of health treatments, which has been shown to improve the recruitment and effectiveness of health interventions in underserved groups (24). Similarly, frameworks like the Framework for Digital Health Equity (FDHE) focus on enhancing consideration of social determinants of health such as socioeconomic status, education, and access to technology in the design and deployment of digital health tools (25).
There are several limitations for this review. First, this is a scoping review and may not include all the available evidence for these products. This limitation was mitigated to the extent possible by hand searching regulatory approval documents, product labeling, and the reference lists of the included articles, but it is still possible that some existing articles were not identified through this method. Additionally, our review was limited to prescription DTx that received FDA authorization through the end of 2023, which means that more recently approved products and their associated clinical evidence fall outside our scope. This temporal boundary was necessary to ensure comprehensive analysis of the regulatory evidence available at the time of our review. Furthermore, the search does not capture more recent products past February 2023, which may affect the comprehensiveness of the findings. Finally, due to the rapidly changing nature of the field, while expert opinions from the authors were considered, the input from other external stakeholders were not sought out to prioritize a timely synthesis of evidence
This review found insufficient evidence to conclude whether DTx are effective for or acceptable to individuals from historically oppressed minoritized communities. To address the identified gaps, future studies on DTx should focus on including populations from underrepresented racial, ethnic, and linguistic groups. Furthermore, future development of DTx should aim to integrate cultural adaptation frameworks, have competently translated and culturally neutral interventions, and include lived experiences and patient partnership research from target populations. The current market exacerbates health disparities and limits access for vulnerable populations, but the evolving regulatory landscape presents an opportunity to address these issues. Addressing these barriers will be crucial for the long-term and widespread adoption of DTx.
Conclusions
In summary, our findings reveal that clinical validation studies of FDA-approved prescription DTx inadequately assess health equity, cultural competence, and digital accessibility factors. While basic demographics were commonly reported, comprehensive equity considerations were largely absent, with no studies incorporating cultural adaptation frameworks or linguistic translations. The significant mediating effect of digital literacy on intervention effectiveness, despite being rarely assessed, demonstrates the critical need for systematic equity evaluations in DTx validation. These gaps suggest that current regulatory approaches may perpetuate health disparities rather than achieve the equitable healthcare access that DTx promise to deliver.
Acknowledgments
None.
Footnote
Reporting Checklist: The authors have completed the PRISMA-ScR reporting checklist. Available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-25-12/rc
Peer Review File: Available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-25-12/prf
Funding: None.
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-25-12/coif). S.D. is an employee of Smith and Nephew Inc. The other authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Kelsey MD, Patrick-Lake B, Abdulai R, et al. Inclusion and diversity in clinical trials: Actionable steps to drive lasting change. Contemp Clin Trials 2022;116:106740. [Crossref] [PubMed]
- Fox-Rawlings SR, Gottschalk LB, Doamekpor LA, et al. Diversity in Medical Device Clinical Trials: Do We Know What Works for Which Patients? Milbank Q 2018;96:499-529. [Crossref] [PubMed]
- Whitehead L. Barriers to and Facilitators of Digital Health Among Culturally and Linguistically Diverse Populations: Qualitative Systematic Review. J Med Internet Res 2023;25:e42719. [Crossref] [PubMed]
- Mitchell UA, Chebli PG, Ruggiero L, et al. The Digital Divide in Health-Related Technology Use: The Significance of Race/Ethnicity. Gerontologist 2019;59:6-14. [Crossref] [PubMed]
- Saeed SA, Masters RM. Disparities in Health Care and the Digital Divide. Curr Psychiatry Rep 2021;23:61. [Crossref] [PubMed]
- Friis-Healy EA, Nagy GA, Kollins SH. It Is Time to REACT: Opportunities for Digital Mental Health Apps to Reduce Mental Health Disparities in Racially and Ethnically Minoritized Groups. JMIR Ment Health 2021;8:e25456. [Crossref] [PubMed]
- Brogan J. The Next Era of Biomedical Research: Prioritizing Health Equity in The Age of Digital Medicine. Voices in Bioethics 2021;7: [Crossref]
- Sieck CJ, Sheon A, Ancker JS, et al. Digital inclusion as a social determinant of health. NPJ Digit Med 2021;4:52. [Crossref] [PubMed]
- Arksey H, O’Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology 2005;8:19-32.
- Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010;5:69. [Crossref] [PubMed]
- U.S. Food and Drug Administration. Product Code Classification Database. Retrieved January 3, 2023. Available online: https://www.fda.gov/medical-devices/classify-your-medical-device/product-code-classification-database
- Ono M, Iwasaki K. Comprehensive Analysis of Clinical Studies and Regulations of Therapeutic Applications in the United States and Japan. Ther Innov Regul Sci 2023;57:86-99. [Crossref] [PubMed]
- Birati Y, Yefet E, Perlitz Y, et al. Cultural and Digital Health Literacy Appropriateness of App- and Web-Based Systems Designed for Pregnant Women With Gestational Diabetes Mellitus: Scoping Review. J Med Internet Res 2022;24:e37844. [Crossref] [PubMed]
- Everitt HA, Landau S, O'Reilly G, et al. Assessing telephone-delivered cognitive-behavioural therapy (CBT) and web-delivered CBT versus treatment as usual in irritable bowel syndrome (ACTIB): a multicentre randomised trial. Gut 2019;68:1613-23. [Crossref] [PubMed]
- Everitt H, Moss-Morris R, Sibelli A, et al. Management of irritable bowel syndrome in primary care: the results of an exploratory randomised controlled trial of mebeverine, methylcellulose, placebo and a self-management website. BMC Gastroenterol 2013;13:68. [Crossref] [PubMed]
- Miller V, Carruthers HR, Morris J, et al. Hypnotherapy for irritable bowel syndrome: an audit of one thousand adult patients. Aliment Pharmacol Ther 2015;41:844-55. [Crossref] [PubMed]
- Glass JE, Matson TE, Lim C, et al. Approaches for Implementing App-Based Digital Treatments for Drug Use Disorders Into Primary Care: A Qualitative, User-Centered Design Study of Patient Perspectives. J Med Internet Res 2021;23:e25866. [Crossref] [PubMed]
- Ritterband LM, Thorndike FP, Ingersoll KS, et al. Effect of a Web-Based Cognitive Behavior Therapy for Insomnia Intervention With 1-Year Follow-up: A Randomized Clinical Trial. JAMA Psychiatry 2017;74:68-75. [Crossref] [PubMed]
- Christensen H, Batterham PJ, Gosling JA, et al. Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight Study): a randomised controlled trial. Lancet Psychiatry 2016;3:333-41. [Crossref] [PubMed]
- van Kessel R, Roman-Urrestarazu A, Anderson M, et al. Mapping Factors That Affect the Uptake of Digital Therapeutics Within Health Systems: Scoping Review. J Med Internet Res 2023;25:e48000. [Crossref] [PubMed]
- Petkovic J, Jull J, Yoganathan M, et al. Reporting of health equity considerations in cluster and individually randomized trials. Trials 2020;21:308. [Crossref] [PubMed]
- Diamond LC, Wilson-Stronks A, Jacobs EA. Do hospitals measure up to the national culturally and linguistically appropriate services standards? Med Care 2010;48:1080-7. [Crossref] [PubMed]
- Barksdale CL, Rodick WH 3rd, Hopson R, et al. Literature Review of the National CLAS Standards: Policy and Practical Implications in Reducing Health Disparities. J Racial Ethn Health Disparities 2017;4:632-47. [Crossref] [PubMed]
- Federal Register. Digital Equity Act of 2021; Request for Comments. A Notice by the National Telecommunications and Information Administration on 03/02/2023. Available online: https://www.federalregister.gov/documents/2023/03/02/2023-04242/digital-equity-act-of-2021-request-for-comments
- Fortuna KL, Myers A, Brooks J, et al. Co-production of the quality of patient-centered outcomes research partnerships instrument for people with mental health conditions. Patient Exp J 2021;8:148-56. [Crossref] [PubMed]
- Richardson S, Lawrence K, Schoenthaler AM, et al. A framework for digital health equity. NPJ Digit Med 2022;5:119. [Crossref] [PubMed]
- U.S. Food and Drug Administration. DEN200029 (November 25, 2020). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf20/DEN200029.pdf
- U.S. Food and Drug Administration. K211372 (June 2, 2021). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf21/K211372.pdf
- U.S. Food and Drug Administration. K211463 (November 24, 2021). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf21/K211463.pdf
- U.S. Food and Drug Administration. De Novo Summary (DEN160018) (May 16, 2016). Available online: https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN160018.pdf
- U.S. Food and Drug Administration. K173681 (May 23, 2019). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf17/K173681.pdf
- U.S. Food and Drug Administration. K191716 (September 15, 2023). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf19/K191716.pdf
- U.S. Food and Drug Administration. DEN200026 (June 15, 2020). Available online: https://www.accessdata.fda.gov/cdrh_docs/pdf20/DEN200026.pdf
- ClinicalTrials.gov. An exploratory study to assess the sustained effects of digital therapy in pediatric subjects 8 to 12 years old with attention deficit hyperactivity disorder (ADHD). Akili Interactive Labs, Inc. 2019-01-18. Available online: https://clinicaltrials.gov/ct2/show/NCT02828644
- Anguera JA, Brandes-Aitken AN, Antovich AD, et al. A pilot study to determine the feasibility of enhancing cognitive abilities in children with sensory processing dysfunction. PLoS One 2017;12:e0172616. [Crossref] [PubMed]
- Davis NO, Bower J, Kollins SH. Proof-of-concept study of an at-home, engaging, digital intervention for pediatric ADHD. PLoS One 2018;13:e0189749. [Crossref] [PubMed]
- Gallen CL, Anguera JA, Gerdes MR, et al. Enhancing neural markers of attention in children with ADHD using a digital therapeutic. PLoS One 2021;16:e0261981. [Crossref] [PubMed]
- Kollins SH, DeLoss DJ, Cañadas E, et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet Digit Health 2020;2:e168-e178. [Crossref] [PubMed]
- Kollins SH, Childress A, Heusser AC, et al. Effectiveness of a digital therapeutic as adjunct to treatment with medication in pediatric ADHD. NPJ Digit Med 2021;4:58. [Crossref] [PubMed]
- Yerys BE, Bertollo JR, Kenworthy L, et al. Brief Report: Pilot Study of a Novel Interactive Digital Treatment to Improve Cognitive Control in Children with Autism Spectrum Disorder and Co-occurring ADHD Symptoms. J Autism Dev Disord 2019;49:1727-37. [Crossref] [PubMed]
- Hughes S, Sibelli A, Everitt HA, et al. Patients' Experiences of Telephone-Based and Web-Based Cognitive Behavioral Therapy for Irritable Bowel Syndrome: Longitudinal Qualitative Study. J Med Internet Res 2020;22:e18691. [Crossref] [PubMed]
- Jacobs JP, Gupta A, Bhatt RR, et al. Cognitive behavioral therapy for irritable bowel syndrome induces bidirectional alterations in the brain-gut-microbiome axis associated with gastrointestinal symptom improvement. Microbiome 2021;9:236. [Crossref] [PubMed]
- Lackner JM, Jaccard J, Keefer L, et al. Improvement in Gastrointestinal Symptoms After Cognitive Behavior Therapy for Refractory Irritable Bowel Syndrome. Gastroenterology 2018;155:47-57. [Crossref] [PubMed]
- Owusu JT, Sibelli A, Moss-Morris R, et al. A pilot feasibility study of an unguided, internet-delivered cognitive behavioral therapy program for irritable bowel syndrome. Neurogastroenterol Motil 2021;33:e14108. [Crossref] [PubMed]
- Tonkin-Crine S, Bishop FL, Ellis M, et al. Exploring patients' views of a cognitive behavioral therapy-based website for the self-management of irritable bowel syndrome symptoms. J Med Internet Res 2013;15:e190. [Crossref] [PubMed]
- ClinicalTrials.gov. The efficacy and safety of IBS digital behavioral treatment study. metaMe Health 2022-04-06. Available online: https://clinicaltrials.gov/ct2/show/NCT04133519
- Campbell AN, Nunes EV, Matthews AG, et al. Internet-delivered treatment for substance abuse: a multisite randomized controlled trial. Am J Psychiatry 2014;171:683-90. [Crossref] [PubMed]
- Chaple M, Sacks S, McKendrick K, et al. A comparative study of the therapeutic education system for incarcerated substance-abusing offenders. The Prison Journal 2016;96:485-508.
- Luderer HF, Campbell ANC, Nunes EV, et al. Engagement patterns with a digital therapeutic for substance use disorders: Correlations with abstinence outcomes. J Subst Abuse Treat 2022;132:108585. [Crossref] [PubMed]
- Xiong X, Braun S, Stitzer M, et al. Evaluation of real-world outcomes associated with use of a prescription digital therapeutic to treat substance use disorders. Am J Addict 2023;32:24-31. [Crossref] [PubMed]
- Bickel WK, Marsch LA, Buchhalter AR, et al. Computerized behavior therapy for opioid-dependent outpatients: a randomized controlled trial. Exp Clin Psychopharmacol 2008;16:132-43. [Crossref] [PubMed]
- Christensen DR, Landes RD, Jackson L, et al. Adding an Internet-delivered treatment to an efficacious treatment package for opioid dependence. J Consult Clin Psychol 2014;82:964-72. [Crossref] [PubMed]
- Marsch LA, Guarino H, Acosta M, et al. Web-based behavioral treatment for substance use disorders as a partial replacement of standard methadone maintenance treatment. J Subst Abuse Treat 2014;46:43-51. [Crossref] [PubMed]
- Feuerstein S, Hodges SE, Keenaghan B, et al. Computerized Cognitive Behavioral Therapy for Insomnia in a Community Health Setting. J Clin Sleep Med 2017;13:267-74. [Crossref] [PubMed]
- Thorndike FP, Saylor DK, Bailey ET, et al. Development and Perceived Utility and Impact of an Internet Intervention for Insomnia. E J Appl Psychol 2008;4:32-42. [Crossref] [PubMed]
- Moss-Morris R, McAlpine L, Didsbury LP, et al. A randomized controlled trial of a cognitive behavioural therapy-based self-management intervention for irritable bowel syndrome in primary care. Psychol Med 2010;40:85-94. [Crossref] [PubMed]
- Palsson OS, Turner MJ, Johnson DA, et al. Hypnosis treatment for severe irritable bowel syndrome: investigation of mechanism and effects on symptoms. Dig Dis Sci 2002;47:2605-14. [Crossref] [PubMed]
- Hunt GM, Azrin NH. A community-reinforcement approach to alcoholism. Behav Res Ther 1973;11:91-104. [Crossref] [PubMed]
Cite this article as: Divatia S, Foster T, Cui S, Tapiavala V, Fortuna KL. Accessibility and equity considerations in the clinical validation of prescription digital therapeutics: a scoping review. mHealth 2026;12:10.




