Key takeaway
A rapid review of 19 papers found three groups of factors that damage the quality of data from person-owned wearables: device and technical, user-related, and data governance. They can leave data incomplete, incorrect and heterogeneous. It is a narrative synthesis of a small literature and gives no measured error rates.
Study design
Evidence review
Reading basis
Published abstract
Reading focus
Design & applicability
The research question
Researchers increasingly want to reuse data that people generate with their own wearables, which raises worries about data quality, yet little literature addresses it. The authors set out to identify the factors that affect quality and the data quality challenges they produce.
Who and how
Rapid systematic review following PRISMA guidelines. The authors searched PubMed, the Association for Computing Machinery, the Institute of Electrical and Electronics Engineers and Google Scholar for studies on wearable devices (fitness trackers, sleep monitors; research-grade and consumer-grade) and data quality. Relevant content was annotated and iteratively sorted into similar factors until the authors reached consensus, and data quality challenges were extracted and categorized too. 19 papers were included.
What it found
The authors’ reported results. Read each estimate with its population and uncertainty.
- 1Three high-level factors affect data quality: device and technical factors (hardware, software, connectivity), user-related factors (device nonwear and user error), and data governance factors (lack of standardization).
- 2These factors can lead to incomplete, incorrect and heterogeneous data.
- 3Missing and incorrect data are well known; the authors highlight heterogeneity as another aspect, at three levels: within one person using one device, between people using the same brand, model and version, and between people using different devices.
- 4Between-person heterogeneity across devices applies especially to data collected under a bring-your-own-device policy.
Limits & uncertainty
- 1Only 19 papers were included and the abstract calls the literature on this topic sparse.
- 2Factors were sorted by the authors' consensus, a qualitative method that may differ if repeated by others.
- 3The review is a rapid review and reports no quantitative error rates, so it cannot say which factor matters most.
- 4This reading is based on the abstract only.
What to take from it
Wearable numbers are shaped by hardware, how you wear it and which device you own, so small differences and gaps are expected. For research, pooling data from many brands needs care. As a user, treat your own data as most reliable when compared with itself.
Reading your own data
Wear the same device the same way, charge it on a routine and note nonwear days. Compare your own trends over weeks, not your numbers against a friend's device. Changing devices or firmware can shift your baseline, so mark the change date.
How to read this evidence
Check which designs were included, how searches and bias assessment were conducted, and the last search date. Publication date alone does not make the underlying evidence current.
Authors’ structured abstract English
The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.
Background
There is increasing interest in reusing person-generated wearable device data for research purposes, which raises concerns about data quality. However, the amount of literature on data quality challenges, specifically those for person-generated wearable device data, is sparse.
Objective
This study aims to systematically review the literature on factors affecting the quality of person-generated wearable device data and their associated intrinsic data quality challenges for research.
Methods
The literature was searched in the PubMed, Association for Computing Machinery, Institute of Electrical and Electronics Engineers, and Google Scholar databases by using search terms related to wearable devices and data quality. By using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, studies were reviewed to identify factors affecting the quality of wearable device data. Studies were eligible if they included content on the data quality of wearable devices, such as fitness trackers and sleep monitors. Both research-grade and consumer-grade wearable devices were included in the review. Relevant content was annotated and iteratively categorized into semantically similar factors until a consensus was reached. If any data quality challenges were mentioned in the study, those contents were extracted and categorized as well.
Results
A total of 19 papers were included in this review. We identified three high-level factors that affect data quality-device- and technical-related factors, user-related factors, and data governance-related factors. Device- and technical-related factors include problems with hardware, software, and the connectivity of the device; user-related factors include device nonwear and user error; and data governance-related factors include a lack of standardization. The identified factors can potentially lead to intrinsic data quality challenges, such as incomplete, incorrect, and heterogeneous data. Although missing and incorrect data are widely known data quality challenges for wearable devices, the heterogeneity of data is another aspect of data quality that should be considered for wearable devices. Heterogeneity in wearable device data exists at three levels: heterogeneity in data generated by a single person using a single device (within-person heterogeneity); heterogeneity in data generated by multiple people who use the same brand, model, and version of a device (between-person heterogeneity); and heterogeneity in data generated from multiple people using different devices (between-person heterogeneity), which would apply especially to data collected under a bring-your-own-device policy.
Conclusions
Our study identifies potential intrinsic data quality challenges that could occur when analyzing wearable device data for research and three major contributing factors for these challenges. As poor data quality can compromise the reliability and accuracy of research results, further investigation is needed on how to address the data quality challenges of wearable devices.
Sources & attribution
Factors Affecting the Quality of Person-Generated Wearable Device Data and Associated Challenges: Rapid Systematic Review.
Cho S, Ensari I, Weng C, Kahn MG, Natarajan K.
JMIR mHealth and uHealth · 2021-03-19
DOI: 10.2196/20738 ↗PubMed · 33739294 ↗Europe PMC · Recorded licence: cc by ↗Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.
MoveVitals editorial interpretation · educational content · no individual clinical review recorded
Sources checked 2026-11-01
Practical guides
Read in context
Activity–stroke and heart attack curves differ by accelerometer processing method
Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.
Preventive Medicine
Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven
A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.
Forensic Science International
Activity trackers: about 1,800 more steps a day, but small effects on other outcomes
An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.
The Lancet Digital Health
Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages
In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.
Sleep

