A systematic review and evaluation of mobile health apps designed for parents who are preparing or caring for medically complex infants
Review Article

A systematic review and evaluation of mobile health apps designed for parents who are preparing or caring for medically complex infants

Anne Chevalier McKechnie1 ORCID logo, Nellie Munn Swanson1 ORCID logo, Ratchada Jantraporn1 ORCID logo, Kristin M. Elgersma1 ORCID logo, Taylor Iwaszko Wagner1 ORCID logo, Suhyun Park2 ORCID logo, Anna Trebilcock3 ORCID logo

1Child and Family Health, School of Nursing, University of Minnesota, Minneapolis, MN, USA; 2Cizik School of Nursing, University of Texas Health Science Center at Houston, Houston, TX, USA; 3Cranial Technologies, Inc., Tempe, AZ, USA

Contributions: (I) Conception and design: AC McKechnie, KM Elgersma; (II) Administrative support: None; (III) Provision of study materials or patients: None; (IV) Collection and assembly of data: AC McKechnie, KM Elgersma, NM Swanson, T Iwaszko Wagner, A Trebilcock; (V) Data analysis and interpretation: All authors; (VI) Manuscript writing: All authors; (VII) Final approval of manuscript: All authors.

Correspondence to: Anne Chevalier McKechnie, PhD, RN. Child and Family Health, School of Nursing, University of Minnesota, 308 Harvard St SE, WDH 6-139A, Minneapolis, MN, USA. Email: acmckech@umn.edu.

Background: Parents learning about their children with medical complexity often use numerous health-related resources, including mobile health applications (mHealth apps). mHealth apps could provide broad access to key information and support, lower healthcare costs, and improve care. The quality of mHealth apps for this population has been a concern, but is currently unknown. The objective of this systematic review was to identify and evaluate the quality of publicly available mHealth apps designed for parents who are preparing or caring for medically complex infants.

Methods: A systematic search strategy was applied to identify mHealth apps in the Apple and Google Play app stores in November 2022 and replicated in August 2024. Apps with no cost, in English, designed for parents of infants with perinatal medical complexity requiring hospitalization were included. Apps for healthy pregnancies, children >1 year, non-parental caregivers or healthcare professionals, primarily for tracking/monitoring, or unrelated activities/products were excluded. Independent raters used the Mobile Application Rating Scale (MARS) subscales of Engagement, Functionality, Aesthetics, and Information to evaluate quality for each app. Mean ratings were calculated by subscale and for overall app quality.

Results: From 1,917 identified apps, 32 apps were downloaded and fully screened. The final sample of 15 unique apps were available on the Apple App Store, with six also available on the Google Play Store. Most apps focused on prematurity (n=6), followed by the neonatal intensive care experience (n=4), congenital heart disease (n=4), and hypoxic-ischemic encephalopathy (n=1). MARS ratings of the overall sample (mean =3.61, median =3.58; range, 2.65–4.68) indicated 20% (3/15) were of good quality and 67% (10/15) were of acceptable quality. Apps showed strengths in Functionality and Information and performed worst in Engagement.

Conclusions: The poorest quality found in Engagement suggests that most of these apps do not effectively target users’ interests or needs. Notably, many suffered from a lack of recent updates or became unavailable. This decline appears to parallel the increasing integration of digital health technologies within healthcare systems, which could prompt testing of mHealth apps on health outcomes. High-quality mHealth apps that are valued by parents and offer evidence-based information and support are needed to extend care.

Keywords: Infant care; neonatal intensive care; mobile applications; mobile health; systematic review


Received: 01 November 2024; Accepted: 21 February 2025; Published online: 27 May 2025.

doi: 10.21037/mhealth-24-84


Highlight box

Key findings

• The majority of publicly available mHealth apps for medically complex infants earned acceptable or good quality ratings overall, with higher ratings in functionality and information, and poor-quality ratings in engagement.

• Nearly half of the apps had not been updated for 2–7 years, and several became nonfunctional or unavailable over the past 5 years.

What is known and what is new?

• While mHealth apps have the potential to provide broad access to key health-related resources, lower healthcare costs, and improve patient care, the quality of mHealth apps—both in general and for this population—has been a concern.

• This systematic review and evaluation underscored the need to improve app engagement to effectively target parents encountering high levels of distress or healthcare inequities.

What is the implication, and what should change now?

• With healthcare systems increasingly integrating digital health technologies (e.g., mHealth apps, websites, telehealth, patient engagement platforms) into patient care, consideration should be given to testing these technologies for user acceptance and effectiveness on health outcomes.

• More research is required to establish evidence-based, high-quality mHealth apps that are engaging and valued by parents to expand the reach of information and support needed for this vulnerable population.


Introduction

Background

More than 1 in 10 infants are born with medical complexity, with recent trends showing increasing rates of hospitalization with intensive care for infants born prematurely (1) or with congenital heart disease (2-4). Parents often learn about their child with medical complexity over the perinatal period through a process of information seeking. This process often involves parents’ efforts to understand the health condition, medical interventions, course of hospitalization, and transition to home, as well as to navigate their psychosocial experiences (5-9). During the transition from intensive care settings to home with their vulnerable infants, families rely heavily on healthcare resources as they take on complex care routines and face high risks for infant mortality and repeated readmission to the hospital (10). In addition to their healthcare providers, these parents look to sources of information through the internet, social media, and mobile health applications (mHealth apps) (5,7,11-13).

Nearly all adults of childbearing age in the United States—and a majority of adults worldwide—own a smartphone (14-17). There are over 300,000 mHealth apps in app stores worldwide (18). Many of these apps are designed to offer health and wellness information and can include tracking or management functionalities. Of the thousands of mHealth apps, nearly three-quarters (73%) are downloaded by users independently rather than upon recommendations from others, including their healthcare providers (19). Given that pregnant and birthing people represent an increasing consumer demographic of mHealth apps (20-23), numerous apps relevant to pregnancy and the care of infants encountering hospitalization are available. Most of the apps focused on pregnancy, however, lacked evidence-based information (24). While mHealth apps have the potential to provide broad access to key health-related resources, lower healthcare costs, and improve patient care (25,26), the quality of mHealth apps in general and for this population has been a concern (27-29).

The most recent app review and evaluation relevant to parents of hospitalized infants was published in 2019, with the evaluation conducted in 2017, and underscored substantial concerns for quality and credibility (29). The findings indicated that only 7 of 18 apps provided acceptable educational content, and most did not address parents’ top concerns. Change is to be expected in the dynamic mHealth app market, especially considering emerging efforts to create evidence-based mHealth apps to address this gap and meet the needs of parents over the perinatal time and transitioning from hospital to home (30-34). Thus, knowledge of the current availability and quality of mHealth apps designed for parents of infants with medical complexity is particularly important. This systematic review and evaluation will focus on the quality of publicly available mHealth apps that these parents might turn to, which is currently not known.

Objective

The objective of this systematic review was to identify and evaluate the quality of publicly available mHealth apps designed for parents who are preparing or caring for medically complex infants (e.g., prematurity, congenital anomalies, or who required hospitalization due to a perinatal event) to support their learning needs and caregiving capacities during the perinatal period. We present this article in accordance with the PRISMA reporting checklist, with some necessary modifications of methods mostly related to search strategy (available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-24-84/rc) (35).


Methods

Study design

This study was conducted with systematic search and evaluation methods focused on mHealth apps for parents. Resources such as e-tools (e.g., websites, web-based modules, courses, tutorials), parent support groups, or social media groups were not considered in this review. The search strategy, screening, data extraction, and evaluation process was completed independently, with outcomes discussed and any discrepancies resolved through consensus by reviewers.

Search strategy

The systematic search strategy was applied by five authors (A.C.M., N.M.S., K.M.E., T.I.W., A.T.) in November 2022 and replicated by three authors (A.C.M., N.M.S., T.I.W.) in August 2024 to capture any changes due to the evolving app market. This search strategy incorporated pragmatic search techniques used for mobile apps and digital app distribution platforms, as described in similar review studies (11,29,36,37). The search was conducted on iPhone and Android mobile operating systems using the Apple App Store on both an iPhone and a computer, the Google Play Store on an Android phone, and the LDPlayer application on a computer, applying a priori eligibility criteria. The initial screening of apps that appeared eligible was completed using the app store information. The following search terms were used consistently across operating systems at both time points: “birth defect”, “fetal anomaly”, “fetal medicine”, “fetal diagnosis”, “prenatal diagnosis”, “heart defect”, “heart disease”, “infant heart”, “infant heart disease”, “heart baby”, “neonatal care”, “NICU”, “premature”, and “preterm”.

Inclusion and exclusion criteria were applied as follows to determine the sample for this review. Inclusion criteria were apps targeting parents of infants with perinatal medical complexity (i.e., fetal/infant health conditions detected during the perinatal period that prompt medical intervention after birth), required hospitalization, were available in English, and were accessible to the general public with no cost (e.g., free). Exclusion criteria were apps accessible only to parents as patients within healthcare clinics/systems (i.e., not publicly available/accessible for review), content focused on healthy pregnancy, fetuses, or infants or those affected by chromosomal conditions (e.g., Trisomy 21), targeting parents of children beyond the first year of life, primarily designed for non-parental caregivers or healthcare professionals, primary function for tracking/monitoring (e.g., fetal movements, labor contractions timing, infant feeding/growth), or focused on unrelated activities or products (e.g., parent self-care or infant care products).

For each search term, both operating systems were used to screen up to 100 app suggestions provided by a dynamic algorithm, which adapted to populate app lists in order of decreasing relevance to the search term. Second, apps that appeared to meet eligibility criteria were downloaded to a device and further screened for eligibility. Lastly, our search strategy included snowball searching, which involved reviewing a minimum of ten additional apps recommended based on the search algorithm to ensure eligible apps were captured.

Four authors (A.C.M., K.M.E., R.J., S.P.) identified relevant, key data for apps considered for inclusion. Data were extracted from app store descriptions and the downloaded apps and entered into an analytic matrix generated for this study. Data extracted included information about the developer, last update, features, and aim/purpose of the app. Extracted data were reviewed and updated as needed in August-September 2024. All app data were reviewed by the first author (A.C.M.) and verified as needed with other authors for accuracy. Following the systematic review process, which included applying the inclusion and exclusion criteria to each app in the context of the extracted data, the research team then determined the final sample for this evaluation.

Measure—app evaluation tool

Eligible apps were evaluated for quality using the Mobile Application Rating Scale (MARS; available free online at https://mhealth.jmir.org/article/downloadSuppFile/3422/14733). The MARS was developed by healthcare providers, academics, and technology professionals to reliably evaluate health-related mobile apps (38). MARS was the most appropriate tool for this evaluation because it provides a multi-dimensional evaluation with healthcare considerations (e.g., clinical accuracy), and has previously demonstrated validity and reliability (39). The MARS includes four quality dimensions, operationalized by a total of 19 items across corresponding subscales of Engagement, Functionality, Aesthetics, and Information quality to rate mHealth app quality. Engagement (5 items) captures how interesting, adaptable, and interactive an app is for a particular user. Functionality (4 items) focuses on performance in terms of usability, navigation, and intuitive gesture-based interactions. Aesthetics (3 items) considers visual appeal, layout, and graphics. Information (7 items) represents source credibility, as well as clarity, accuracy, and comprehensiveness of the information presented within the app. Ratings for each item relied on a 5-point scale (1= inadequate to 5= excellent), or could be marked as not applicable. For each app, mean subscale ratings were calculated, and the mean rating for all subscales represented an overall app quality rating, using the same quality scale applied to items. Two optional subscales on subjective quality and perceived impact include items such as whether the reviewer would recommend the app, how often the app might be used, and how much the app might impact the parent user. These subscales can increase bias and variability, and thus, were not included in this evaluation.

Congruent with the expectations for informed evaluations within our content area, our research team includes nurses with research and practice areas focused on infants with medical complexity, including fetal/infant structural anomalies and prematurity. To prepare for the app review, all authors viewed the MARS training video and engaged in the study-specific evaluation process. Before applying the MARS tool to the app sample reported on in this paper, all authors independently completed a practice evaluation of an app with content adjacent to our study interests, followed by a research team discussion.

Data analysis

From November 2022 to February 2023, all authors were involved in the independent evaluation process with final ratings discussed and any differences greater than 1 point resolved through consensus. Following these same methods, three authors (A.C.M., N.M.S., T.I.W.) independently evaluated updated apps and additional apps that met inclusion criteria from August to September 2024, and final mean ratings were determined for the sample. Throughout this process, additional data were extracted and notes were recorded in the analytic matrix on features, key content, and functionality for each app in the sample.


Results

Screening process

Our systematic search of both the Apple App Store and Google Play Store resulted in screening a total of 1,917 apps. Following the initial screening process conducted in 2022 and replicated in 2024, 32 apps were downloaded for further eligibility screening. Among those downloaded apps, 6 were no longer found or functional, 3 showed substantial updates, and 1 additional app was identified for screening. The final sample of 15 unique mHealth apps were included for independently conducted evaluations. All 15 apps were available on the Apple App Store, and 6 were available on both Apple and Google Play mobile operating systems. Figure 1 shows a PRISMA flow diagram of this screening process (35).

Figure 1 Flow diagram of the app identification and selection process.

Descriptive characteristics of apps

All evaluated apps appeared to originate from reputable sources, and none solicited in-app purchases. See Table 1 for descriptive characteristics of each app. Most apps focused on prematurity (n=6), followed by apps on the neonatal intensive care experience (n=4), congenital heart disease (n=4), and hypoxic-ischemic encephalopathy (n=1). The app developers represented non-profit organizations (n=5), hospitals/clinics (n=4), private developers (n=4), and universities (n=2). The majority of the apps (n=11) were developed in the United States, with other countries including New Zealand (n=1), Italy (n=1), and the United Kingdom (n=2). In addition to English, some apps were also offered in Spanish (n=3), French (n=2), and other languages. Of the 15 apps evaluated, only 47% (7/15) were updated on at least one operating system since 2022. One app did not provide information on the last update year. One app (Babble NZ) had been trialed and tested (31).

Table 1

Descriptive characteristics of mHeath app sample (n=15)

App Developer Country Language(s) Mobile operating system Version Last updated
BABBLE NZ Neonatal Family App Neonatal Unit, MidCentral District Health Board New Zealand English iOS 2.7.1 Jun 2021
Android 3.2.86.473 Aug 2023
Compass by March of Dimes March of Dimes, Inc. USA English iOS 1.1.13 Jul 2024
Android 740.0 July 2024
Congenital heARts Università di Padova Italy English iOS 1.0.2 May 2021
Android Unavailable
Hand to Hold Hand to Hold (TX) USA English, Dutch, French, Japanese, Spanish, Ukrainian iOS 4.39.1 Jul 2024
Android Unavailable
HeartPedia Cincinnati Children’s Hospital Medical Center USA English iOS 1.4.1 Jun 2018
Android 1.3 Jun 2018
Life’s Little Love Courtney LaRocque USA English iOS 1.1.0 Jul 2019
Android Unavailable
My Prem Baby—by Tommy’s Tommy’s UK English iOS 1.8.1 Dec 2023
Android Unavailable
MyPreemie Graham’s Foundation USA English, Spanish iOS 2.3.1 Apr 2020
Android 1.34.0 Oct 2023
NICU Companion Indiana University USA English iOS 2.1.0 Jan 2018
Android Unavailable
Our Journey in the NICU Phoenix Children’s Hospital USA English, Spanish iOS 2.1 Feb 2020
Android Unavailable
Pediatric Cardiology Isaac Perach USA English iOS 4.1 Dec 2017
Android Unavailable
Peekaboo ICU Preemie Jozo Radman USA English iOS 1.08 Oct 2017
Android Unavailable
PEEPS HIE Peeps UK UK English, Cambodian, French, Italian iOS 4.5.0
Android 4.5.0 Dec 2022
PretermConnect Chih H. Wang USA English (some resources available in Spanish) iOS 1.8.9 Jul 2024
Android 2.7.0 Jul 2024
Surgical Animate! Cincinnati Children’s Hospital Medical Center USA English iOS Not found Not found
Android Unavailable

, required consent for research by developer to access the app.

As shown in Table 2, the apps in our sample offered a wide range of features. All but two apps provided condition-specific content, which included text, articles, or other resources for the unique needs and challenges faced by parents of infants in the NICU. This content often addressed topics such as explanations of the health condition, definitions of medical jargon, and promotion of parental involvement in hospital care routines. Several apps (n=7) included videos, with three apps (Congenital HeARts, Heartpedia, Surgical Animate!) offering sophisticated video/3D visualizations of the heart anatomy, physiology, and surgical repairs. There were apps (n=7) that offered parent-parent support through external links to Facebook communities, mental health screeners, events, and podcasts. Some, including Hand to Hold and PretermConnect, offered in-app community forums for psychosocial support to address parent stress related to infant hospitalization. Trackers (n=5) relevant to infant feeding, weight, diaper changes, and notification settings (n=4) for reminders and new information/events were available. Parents could also write journal entries, take notes, and store photos in some apps (n=6). Only three apps allowed parents to communicate with healthcare providers or specialists through links to healthcare system websites with contact information, or request forms for limited, free mental health services.

Table 2

Features found in this sample of mHealth apps

App Condition-specific content (text, articles, resources) Videos and/or 3D visualization Parent-parent support (in-app forum or external links) Trackers (feeding, weight, diapers) Documentation (journal entries, notes, photos) Contact healthcare provider/specialist Notifications settings
BABBLE NZ Neonatal Family App
Compass by March of Dimes
Congenital heARts
Hand to Hold
HeartPedia
Life’s Little Love
My Prem Baby
MyPreemie
NICU Companion
Our Journey in the NICU
Pediatric Cardiology
Peekaboo ICU Preemie
PEEPS HIE
PretermConnect
Surgical Animate!

Quality assessment using MARS

Using the MARS quality subscales, the overall mean ratings for the 15 apps ranged from 2.65–4.68, with a total mean of 3.61 and a median of 3.58. Approximately two-thirds, 67% (10/15) received an overall quality rating of ‘acceptable’ (range, 3.29–3.85), and 20% (3/15) received a rating of ‘good’ (range, 4.08–4.68). None of the apps received a score of ‘excellent’. The Engagement subscale showed the widest range, yet the overall lowest subscale ratings (range, 1.50–5.0; mean =2.70). Aesthetics ratings (range, 2.17–4.83; mean =3.43) and Information ratings (range, 3.40–4.75; mean =3.98) were moderate. Functionality earned the highest ratings (range, 2.25–4.88; mean =4.01), and was evaluated as having good quality. The top three apps with overall mean ratings of good quality (i.e., PretermConnect, My Prem Baby, MyPreemie) were among the most robust in Functionality and Information. See Table 3 for a summary of results from the MARS ratings.

Table 3

Mobile App Rating Scale evaluation of mHealth apps for parents preparing or caring for infants with medical complexity

App Subscales Total (mean)
Engagement (mean) Functionality (mean) Aesthetics (mean) Information (mean)
PretermConnect 5.00 4.63 4.33 4.75 4.68
My Prem Baby 4.00 4.38 3.67 4.42 4.12
MyPreemie 3.50 4.38 4.17 4.28 4.08
HeartPedia 2.60 4.38 4.83 3.58 3.85
BABBLE NZ Neonatal Family App 2.60 4.25 4.17 4.10 3.78
Surgical Animate! 2.40 4.13 4.00 4.60 3.78
Congenital heARts 3.10 3.88 4.33 3.60 3.73
Compass by March of Dimes 3.00 3.88 3.44 4.00 3.58
Peekaboo ICU Preemie 3.00 4.00 2.67 4.40 3.52
NICU Companion 2.75 3.50 3.33 4.25 3.46
Life’s Little Love 2.10 4.88 2.67 4.10 3.44
PEEPS HIE 2.70 4.38 2.83 3.83 3.44
Our Journey in the NICU 2.40 4.38 2.67 3.73 3.29
Hand to Hold 2.20 2.25 3.00 3.40 2.71
Pediatric Cardiology 1.50 3.50 2.17 3.42 2.65
Subscale Means 2.70 4.01 3.43 3.98 3.61

All apps were rated independently by at least 2 reviewers; any discrepancies >1 in ratings were resolved through consensus. “†” indicates re-evaluation prompted by substantial app update.


Discussion

Increasingly, parents who are preparing or caring for infants with medical complexity are looking to mHealth apps among many resources to address their informational and psychosocial needs over the perinatal period (12,40). Only one previous review and evaluation of mHealth apps focused on this population was found, which was conducted over 5 years ago (29). Employing the MARS tool, our findings showed that the majority of mHealth apps in our sample were found to be of acceptable (n=10; range, 3.29–3.85) or good (n=3; range, 4.08–4.68) quality. We also recognized the mHealth app market as a dynamic one, with updates lagging and changes in app availability.

The MARS quality dimensions allow for the evaluation of currently available apps, as well as for comparing app quality across studies. The Functionality and Information dimensions were rated as being of good quality for more than half of the apps in this sample. The lowest ratings were observed in the Engagement dimension, with an overall mean indicating poor quality, suggesting that more than half of these apps failed to effectively target users. This poor engagement quality was typically due to a lack of content or features that could elicit parents’ interest, be tailored to their needs, or offer interactive functions (e.g., setting notifications, enabling sharing). Poor engagement can negatively impact user retention, reducing the potential benefits of the apps (41). Low engagement could be particularly detrimental, diminishing mHealth access to mental health assessments and services for these parents who are known to encounter high levels of distress when expecting or caring for their vulnerable infants (42-44). Our findings showed slightly increased overall quality, yet similarly low engagement ratings when compared to a review of apps designed for parents of hospitalized infants by Richardson et al. (2019) (29). These findings could be important to consider in the context of parents’ generally high use of mHealth apps over the perinatal period, yet with uptake lowest among less resourced and culturally diverse groups (45). The apps in our sample tended to be text-heavy and appeared to exceed recommended readability levels (46), which might limit usefulness or perceived value for many adult learners. Thus, improvements in app engagement using multiple means of information delivery, including visual displays, videos, animations, or gamification, could be key for equitably reaching parents.

Our replicated search also revealed that the selection of apps for these parents had not been recently updated, and several were no longer functioning or available. Nearly half of the apps (n=7) had not been updated for 2–7 years, which is known to compromise functionality (47,48). We also identified six apps in our searches that were not accessible due to functionality issues or were no longer available on the app stores. Although our review (n=15 apps) and the review by Richardson et al. (2019) (n=18 apps) used slightly different inclusion criteria, seven apps appeared in both samples, and an additional six from their sample that met our inclusion criteria were no longer available (29). Thus, publicly available apps for this parent population have declined over the past 5 years. It is possible that sustaining app quality could be more feasible for non-profit organizations, which accounted for most developers within our sample, and more challenging for individual developers or freelancers.

Six apps identified in our searches were designed for patients of healthcare systems, requiring a secure log-in. As healthcare systems increasingly integrate digital health technologies (e.g., mHealth apps, websites, telehealth, patient engagement platforms) into patient care (49), there is a need to test these technologies for user acceptance and effectiveness on health outcomes. Recent literature suggests that developing and testing mHealth apps with these goals could be on the rise, with examples including the Heart Observation app (HOBS) (50), Preparing Heart and Mind (PHM) (33,34), and NICU2Home (51). There is promise in generating evidence for mHealth apps that are high quality and sustainably designed to meet the needs of parents who may otherwise lack access to such beneficial resources during a high risk and difficult time. Although most mHealth apps are currently limited in facilitating parent-healthcare provider communication, improving engagement could be achieved through secure use of in-app chats and video call channels, as well as AI integration into digital health products (52). High-quality mHealth apps offering evidence-based information and support, and that are both used and valued by parents, are particularly needed to extend care for those preparing or caring for infants with medical complexity.

Strengths and limitations

Limitations of this study include applying a systematic search strategy to dynamic and algorithmically-directed app store platforms, the inclusion of apps publicly available only in the United States, and conducting the search and evaluation in English only. To conduct a systematic search, we relied on PRISMA guidelines with necessary modifications that were demonstrated in similar app reviews. Recognizing that the mobile phones, operating system versions, and algorithms serving the results differed by research team member, we documented our search findings and resolved any unusual or divergent results through discussion and consensus. These factors limit the replicability of the search, and this review should be interpreted with reasonable caution. This review and evaluation included mHealth apps that were publicly available in the United States app stores due to required access for evaluation and because our research team did not include individuals residing in any other countries. Finally, although our research team members brought fluency in different languages, it was only possible to complete independent evaluations in English by at least two reviewers.


Conclusions

The objective of this systematic review was to identify and evaluate the quality of publicly available mHealth apps designed for parents who are preparing or caring for medically complex infants. The current review appears to be timely, given an ever-changing app market, and only one older study relevant to this parent population was found. MARS ratings showed that the majority of mHealth apps in our sample were of acceptable or good quality overall, with higher ratings predominantly in the Functionality and Information dimensions. Over half of the apps demonstrated poor quality in the Engagement dimension. Low engagement quality indicated that many apps lacked customizable content and interactive features needed by parents. Lack of engagement could hinder the digital reach to parents encountering high levels of distress and perpetuate inequities in providing health information to parents with diverse learning styles and literacy levels. Our findings also revealed that nearly half of the apps evaluated had not been updated for 2–7 years, and several apps became non-functional or unavailable over the past 5 years. While publicly available apps for this parent population are declining, it appears that healthcare systems are increasingly integrating mHealth apps, among other digital health technologies, into patient care. Our findings provide valuable insights to improve future development of mHealth apps designed for the perinatal period. More research is needed, however, to establish evidence-based, high-quality mHealth apps as an engaging approach that is needed to expand the reach of information and support to parents of vulnerable infants.


Acknowledgments

We wish to thank Tiffany Pollock for her contributions to this project.


Footnote

Reporting Checklist: The authors have completed the PRISMA reporting checklist. Available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-24-84/rc

Peer Review File: Available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-24-84/prf

Funding: This work was supported through the University of Minnesota School of Nursing Foundation Research Professorship of A.C.M., and by the National Institutes of Health’s National Center for Advancing Translational Sciences (Nos. K12TR004373 and 1UM1TR004405-01A1 to K.M.E.). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health’s National Center for Advancing Translational Sciences.

Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at https://mhealth.amegroups.com/article/view/10.21037/mhealth-24-84/coif). A.C.M. holds the University of Minnesota, School of Nursing Foundation Research Professorship, which provides funding for research. K.M.E. reports funding from the National Institutes of Health’s National Center for Advancing Translational Sciences (Nos. K12TR004373 and 1UM1TR004405-01A1), and payment as a speaker on human milk for infants with congenital heart disease for Medela America educational webinar in June 2023. A.T. reports the employment with Cranial Technologies, Inc., which is unrelated to this study or the writing of this manuscript. The other authors have no conflicts of interest to declare.

Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.


References

  1. Kim Y, Ganduglia-Cazaban C, Chan W, et al. Trends in neonatal intensive care unit admissions by race/ethnicity in the United States, 2008-2018. Sci Rep 2021;11:23795. [Crossref] [PubMed]
  2. van der Linde D, Konings EE, Slager MA, et al. Birth prevalence of congenital heart disease worldwide: a systematic review and meta-analysis. J Am Coll Cardiol 2011;58:2241-7. [Crossref] [PubMed]
  3. Wu W, He J, Shao X. Incidence and mortality trend of congenital heart disease at the global, regional, and national level, 1990-2017. Medicine (Baltimore) 2020;99:e20593. [Crossref] [PubMed]
  4. Bouma BJ, Mulder BJ. Changing Landscape of Congenital Heart Disease. Circ Res 2017;120:908-22. [Crossref] [PubMed]
  5. McKechnie AC, Pridham K, Tluczek A. Preparing Heart and Mind for Becoming a Parent Following a Diagnosis of Fetal Anomaly. Qual Health Res 2015;25:1182-98. [Crossref] [PubMed]
  6. Blackburn C, Harvey M. “We weren’t prepared for this”: parents’ experiences of information and support following the premature birth of their infant. Infants Young Child 2019;32:172-85. [Crossref]
  7. Elgersma KM, McKechnie AC, Sommerness SA, et al. Wayfinding through the "ocean of the great unknown": how lactating parents establish a direct breastfeeding relationship with an infant with critical CHD. Cardiol Young 2023;33:2000-11. [Crossref] [PubMed]
  8. Davis-Strauss SL, Johnson E, Lubbe W. Information and support needs of parents with premature infants: An integrative review. J Early Interv 2021;43:199-220. [Crossref]
  9. Lumsden MR, Smith DM, Wittkowski A. Coping in parents of children with congenital heart disease: a systematic review and meta-synthesis. J Child Fam Stud 2019;28:1736-53. [Crossref]
  10. Kieran E, Sara R, Claydon J, et al. Outcomes of Neonates With Complex Medical Needs. Adv Neonatal Care 2019;19:275-84. [Crossref] [PubMed]
  11. Davis DW, Logsdon MC, Vogt K, et al. Parent Education is Changing: A Review of Smartphone Apps. MCN Am J Matern Child Nurs 2017;42:248-56. [Crossref] [PubMed]
  12. Orr T, Campbell-Yeo M, Benoit B, et al. Smartphone and Internet Preferences of Parents: Information Needs and Desired Involvement in Infant Care and Pain Management in the NICU. Adv Neonatal Care 2017;17:131-8. [Crossref] [PubMed]
  13. Sundstrom B. Mothers "Google It Up:" Extending Communication Channel Behavior in Diffusion of Innovations Theory. Health Commun 2016;31:91-101. [Crossref] [PubMed]
  14. Pew Research Center. Mobile fact sheet. 2024. Available online: https://www.pewresearch.org/internet/fact-sheet/mobile/#:~:text=The%20vast%20majority%20of%20Americans,smartphone%20ownership%20conducted%20in%202011
  15. GSMA. GSMA. 2023. Smartphone owners are now the global majority, new GSMA report reveals. Available online: https://www.gsma.com/newsroom/press-release/smartphone-owners-are-now-the-global-majority-new-gsma-report-reveals/
  16. Pew Research Center. Social media seen as mostly good for democracy across many nations, but U.S. is a major outlier - Smartphone and social media use. 2022. Available online: https://www.pewresearch.org/global/2022/12/06/internet-smartphone-and-social-media-use-in-advanced-economies-2022/
  17. Pew Research Center. Smartphone and social media use in advanced economies 2022. 2024. Available online: https://www.pewresearch.org/global/2022/12/06/internet-smartphone-and-social-media-use-in-advanced-economies-2022/#:~:text=Nearly%20all%20people%20surveyed%20across,50%20and%20older%20(55%25)
  18. Georgiou M. How mobile apps are transforming the healthcare industry. 2022. Available online: https://imaginovation.net/blog/infographic-mobile-apps-transforming-the-healthcare-industry/
  19. Pangarkar T. Market.us Scoop. 2024. mHealth apps statistics 2024 by technology, usage, challenges. Available online: https://scoop.market.us/mhealth-apps-statistics/
  20. Waring ME, Moore Simas TA, Xiao RS, et al. Pregnant women's interest in a website or mobile application for healthy gestational weight gain. Sex Reprod Healthc 2014;5:182-4. [Crossref] [PubMed]
  21. Goetz M, Müller M, Matthies LM, et al. Perceptions of Patient Engagement Applications During Pregnancy: A Qualitative Assessment of the Patient's Perspective. JMIR Mhealth Uhealth 2017;5:e73. [Crossref] [PubMed]
  22. Lupton D, Pedersen S. An Australian survey of women's use of pregnancy and parenting apps. Women Birth 2016;29:368-75. [Crossref] [PubMed]
  23. Guerra-Reyes L, Christie VM, Prabhakar A, et al. Postpartum Health Information Seeking Using Mobile Phones: Experiences of Low-Income Mothers. Matern Child Health J 2016;20:13-21. [Crossref] [PubMed]
  24. Bert F, Passi S, Scaioli G, et al. There comes a baby! What should I do? Smartphones' pregnancy-related applications: A web-based overview. Health Informatics J 2016;22:608-17. [Crossref] [PubMed]
  25. Marvel FA, Dowell P, Mossburg SE. Agency for Healthcare Research and Quality, US Department of Health and Human Services. Patient Safety Network. 2022. Emergence of application-based healthcare. Available online: https://psnet.ahrq.gov/perspective/emergence-application-based-healthcare
  26. Cruz-Ramos NA, Alor-Hernández G, Colombo-Mendoza LO, et al. mHealth Apps for Self-Management of Cardiovascular Diseases: A Scoping Review. Healthcare (Basel) 2022;10:322. [Crossref] [PubMed]
  27. Kao CK, Liebovitz DM. Consumer Mobile Health Apps: Current State, Barriers, and Future Directions. PM R 2017;9:S106-15. [Crossref] [PubMed]
  28. Grundy QH, Wang Z, Bero LA. Challenges in Assessing Mobile Health App Quality: A Systematic Review of Prevalent and Innovative Methods. Am J Prev Med 2016;51:1051-9. [Crossref] [PubMed]
  29. Richardson B, Dol J, Rutledge K, et al. Evaluation of Mobile Apps Targeted to Parents of Infants in the Neonatal Intensive Care Unit: Systematic App Review. JMIR Mhealth Uhealth 2019;7:e11620. [Crossref] [PubMed]
  30. Lakshmanan A, Sunshine I, Calvetti S, et al. Designing a Mobile Health Solution to Facilitate the Transition from NICU to Home: A Qualitative Study. Children (Basel) 2022;9:260. [Crossref] [PubMed]
  31. Gibson C, Williams M, Ross K, et al. Distress, self-efficacy, feeling informed and the Babble app: A New Zealand neonatal parent sample. J Neonatal Nurs 2023;29:273-7. [Crossref]
  32. Gibson C, Ross K, Williams M, et al. The experiences of mothers in a neonatal unit and their use of the babble app. Sage Open 2021;11:21582440211. [Crossref]
  33. McKechnie AC, Elgersma KM, Iwaszko Wagner T, et al. An mHealth, patient engagement approach to understand and address parents' mental health and caregiving needs after prenatal diagnosis of critical congenital heart disease. PEC Innov 2023;3:100213. [Crossref] [PubMed]
  34. McKechnie AC, Elgersma KM, Ambrose MB, et al. Nurse-guided Mobile Health Care Program to Reduce Emotional Distress Experienced by Parents of Infants Prenatally Diagnosed with Critical Congenital Heart Disease: A Pilot Study. Prog Pediatr Cardiol 2024;72:101687. [Crossref] [PubMed]
  35. Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Int J Surg 2021;88:105906. [Crossref] [PubMed]
  36. Cheng H, Tutt A, Llewellyn C, et al. Content and Quality of Infant Feeding Smartphone Apps: Five-Year Update on a Systematic Search and Evaluation. JMIR Mhealth Uhealth 2020;8:e17300. [Crossref] [PubMed]
  37. Roberts AE, Davenport TA, Wong T, et al. Evaluating the quality and safety of health-related apps and e-tools: Adapting the Mobile App Rating Scale and developing a quality assurance protocol. Internet Interv 2021;24:100379. [Crossref] [PubMed]
  38. Stoyanov SR, Hides L, Kavanagh DJ, et al. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3:e27. [Crossref] [PubMed]
  39. Terhorst Y, Philippi P, Sander LB, et al. Validation of the Mobile Application Rating Scale (MARS). PLoS One 2020;15:e0241480. [Crossref] [PubMed]
  40. Padovani P, Singh Y, Pass RH, et al. E-Health: A Game Changer in Fetal and Neonatal Cardiology? J Clin Med 2023;12:6865. [Crossref] [PubMed]
  41. Kowalski L, Finnes A, Koch S, et al. User engagement with organizational mHealth stress management intervention - A mixed methods study. Internet Interv 2024;35:100704. [Crossref] [PubMed]
  42. Mangin-Heimos KS, Strube M, Taylor K, et al. Trajectories of Maternal and Paternal Psychological Distress After Fetal Diagnosis of Moderate-Severe Congenital Heart Disease. J Pediatr Psychol 2023;48:305-16. [Crossref] [PubMed]
  43. Woolf-King SE, Anger A, Arnold EA, et al. Mental Health Among Parents of Children With Critical Congenital Heart Defects: A Systematic Review. J Am Heart Assoc 2017;6:e004862. [Crossref] [PubMed]
  44. Oliveira LSM, Costa EF, Brito SFS, et al. Parental stress and associated symptoms in premature babies’ parents: a systematic review. Estud Psicol Camp 2023;40:e21011. [Crossref]
  45. Buchanan L, Anderson E. Sources of information and the use of mobile applications for health and parenting information during pregnancy: Implications for health promotion. Health Informatics J 2021;27:14604582211043146. [Crossref] [PubMed]
  46. National Institutes of Health (NIH). Clear communication. [cited 2024 Oct 25]. Clear and Simple. Available online: https://www.nih.gov/institutes-nih/nih-office-director/office-communications-public-liaison/clear-communication/clear-simple
  47. Brouard B, Bardo P, Bonnet C, et al. Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools? Ann Med 2016;48:509-15. [Crossref] [PubMed]
  48. Noei E, Syer MD, Zou Y, et al. A study of the relation of mobile device attributes with the user-perceived quality of Android apps. Empir Software Eng 2017;22:3088-116. [Crossref]
  49. Al-Shorbaji N. Improving healthcare access through digital health: the use of information and communication technologies. Healthcare Access. IntechOpen London, UK: 2021;315-38.
  50. Hjorth-Johansen E, Børøsund E, Martinsen Østen I, et al. Acceptability and Initial Adoption of the Heart Observation App for Infants With Congenital Heart Disease: Qualitative Study. JMIR Form Res 2023;7:e45920. [Crossref] [PubMed]
  51. Garfield CF, Kerrigan E, Christie R, et al. A Mobile Health Intervention to Support Parenting Self-Efficacy in the Neonatal Intensive Care Unit from Admission to Home. J Pediatr 2022;244:92-100. [Crossref] [PubMed]
  52. Mearian L. SAI Group buys Get Well: Aims to use AI for better patient engagement. Computer World, 2024. Available online: https://www.computerworld.com/article/2515643/sai-group-buys-get-well-aims-to-use-ai-for-better-patient-engagement.html
doi: 10.21037/mhealth-24-84
Cite this article as: McKechnie AC, Swanson NM, Jantraporn R, Elgersma KM, Iwaszko Wagner T, Park S, Trebilcock A. A systematic review and evaluation of mobile health apps designed for parents who are preparing or caring for medically complex infants. mHealth 2025;11:38.

Download Citation