Idea principal
Across 24 systematic reviews covering 249 validation studies and 430,465 participants, consumer wearables had a mean heart rate bias of ±3% but overestimated VO2max by ±15.24% (resting tests) and ±9.83% (exercise tests). Only about 11% of released devices have been validated for any outcome, and the research is so varied in methods that firm accuracy verdicts are not yet possible.
Study design
Revisión de revisiones
Reading basis
Published abstract
Reading focus
Design & applicability
Esta explicación editorial está disponible en inglés, chino simplificado y chino tradicional. Esta interfaz muestra la lectura en inglés.
Pregunta de investigación
Millions of people trust wearables for heart rate, sleep and activity, yet it is unclear how accurate each reading really is. The authors set out to gather all the systematic reviews that compared consumer devices against accepted reference standards, and to keep that evidence up to date as a living review.
Población y método
Umbrella review (a review of systematic reviews and meta-analyses) searching MEDLINE via PubMed, Embase, Cinahl and SPORTDiscus. Included reviews had to validate consumer wearables against accepted reference standards. The team extracted mean absolute percentage error (MAPE), pooled absolute bias, intraclass correlation coefficients and mean absolute differences. Of 904 studies identified in the first search, 24 systematic reviews qualified, containing 249 non-duplicate validation studies with 430,465 participants (43% female). The protocol was registered as CRD42023402703.
Resultados
The authors’ reported results. Read each estimate with its population and uncertainty.
- 1Heart rate was the strongest measure: mean bias of ±3%. Arrhythmia detection had a pooled sensitivity of 100% and specificity of 95%.
- 2VO2max was significantly overestimated, by ±15.24% in resting tests and ±9.83% in exercise tests. Physical activity intensity had a mean absolute error of 29 to 80%, depending on the intensity.
- 3Steps were mostly underestimated (MAPE from -9 to 12%). Energy expenditure had a mean bias of -3 kcal per minute (-3%), with errors from -21.27 to 14.76%. Blood oxygen saturation differed by up to 2.0% on average.
- 4Total sleep time tended to be overestimated, with MAPE typically above 10%.
- 5Only about 11% of released devices have been validated for at least one outcome, and the existing validation studies are just 3.5% of what a comprehensive evaluation would need.
Límites e incertidumbre
- 1The authors describe pervasive heterogeneity in outcomes and methods across the included reviews, which blocks a conclusive accuracy ranking.
- 2Pooled figures such as the ±3% heart rate bias hide large differences between brands, models, wear positions and activities, and the abstract does not break them down.
- 3Because it combines existing reviews, the same underlying studies may be counted in several places, and device models change faster than reviews are updated.
- 4This reading is based on the abstract only.
Relevancia práctica
Treat heart rate and arrhythmia flags from wearables as reasonably reliable and VO2max, calorie burn, sleep duration and activity intensity as rough estimates. Do not set training zones or health decisions on a single wearable estimate of any of the weaker measures. A symptom or an irregular rhythm alert is something to raise with a clinician rather than settle with the watch.
Tus datos
Because absolute errors are large for VO2max, calories and sleep time, use these numbers only as your own trend from one device, compared under similar conditions. Avoid comparing readings across brands, and when a decision matters, confirm with a reference measure such as a lab test or chest strap.
Cómo interpretar la evidencia
Reviews may reuse the same trials. Review counts are not independent replications; study quality, overlap and outcome-specific certainty matter.
Resumen estructurado de los autores English
El resumen original en inglés se reproduce con atribución bajo la licencia indicada. Es una fuente, no una interpretación de MoveVitals. El análisis preparado figura arriba; verifica los resultados importantes en la fuente.
Background
Consumer wearable technologies have become ubiquitous, with clinical and non-clinical populations leveraging a variety of devices to quantify various aspects of health and wellness. However, the accuracy with which these devices measure biometric outcomes such as heart rate, sleep and physical activity remains unclear.
Objective
To conduct a 'living' (i.e. ongoing) evaluation of the accuracy of consumer wearable technologies in measuring various physiological outcomes.
Methods
A systematic search of the literature was conducted in the following scientific databases: MEDLINE via PubMed, Embase, Cinahl and SPORTDiscus via EBSCO. The inclusion criteria required systematic reviews or meta-analyses that evaluated the validation of consumer wearable devices against accepted reference standards. In addition to publication details, review protocol, device specifics and a summary of the authors' results, we extracted data on mean absolute percentage error (MAPE), pooled absolute bias, intraclass correlation coefficients (ICCs) and mean absolute differences.
Results
Of 904 identified studies through the initial search, 24 systematic reviews met our inclusion criteria; these systematic reviews included 249 non-duplicate validation studies of consumer wearable devices involving 430,465 participants (43% female). Of the commercially available wearable devices released to date, approximately 11% have been validated for at least one biometric outcome. However, because a typical device can measure a multitude of biometric outcomes, the number of validation studies conducted represents just 3.5% of the total needed for a comprehensive evaluation of these devices. For heart rate, wearables showed a mean bias of ± 3%. In arrhythmia detection, wearables exhibited a pooled sensitivity and specificity of 100% and 95%, respectively. For aerobic capacity, wearables significantly overestimated VO_(2max) by ± 15.24% during resting tests and ± 9.83% during exercise tests. Physical activity intensity measurements had a mean absolute error ranging from 29 to 80%, depending on the intensity of the activity being undertaken. Wearables mostly underestimated step counts (mean absolute percentage errors ranging from - 9 to 12%) and energy expenditure (mean bias = - 3 kcal per minute, or - 3%, with error ranging from - 21.27 to 14.76%). For blood oxygen saturation, wearables showed a mean absolute difference of up to 2.0%. Sleep measurement showed a tendency to overestimate total sleep time (mean absolute percentage error typically > 10%).
Conclusions
While consumer wearables show promise in health monitoring, a conclusive assessment of their accuracy is impeded by pervasive heterogeneity in research outcomes and methodologies. There is a need for standardised validation protocols and collaborative industry partnerships to enhance the reliability and practical applicability of wearable technology assessments.
Prospero id
CRD42023402703.
Fuentes y atribución
Keeping Pace with Wearables: A Living Umbrella Review of Systematic Reviews Evaluating the Accuracy of Consumer Wearable Technologies in Health Measurement.
Doherty C, Baldwin M, Keogh A, Caulfield B, Argent R.
Sports medicine (Auckland, N.Z.) · 2024-07-30
DOI: 10.1007/s40279-024-02077-2 ↗PubMed · 39080098 ↗Europe PMC · Licencia registrada: cc by ↗Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.
Interpretación editorial de MoveVitals · contenido educativo · sin revisión clínica individual registrada
Fuentes verificadas 2026-11-01
Guías prácticas
Leer en contexto
Activity–stroke and heart attack curves differ by accelerometer processing method
Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.
Preventive Medicine
Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven
A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.
Forensic Science International
Activity trackers: about 1,800 more steps a day, but small effects on other outcomes
An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.
The Lancet Digital Health
Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages
In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.
Sleep

