Skip to content
Wearables & measurementOverview of reviews4 min read

Wearables: good at heart rate, weak at VO2max, activity intensity and sleep time

MoveVitals Editorial Collective · Study published · Reading updated

Original paper:Keeping Pace with Wearables: A Living Umbrella Review of Systematic Reviews Evaluating the Accuracy of Consumer Wearable Technologies in Health Measurement. · Sports medicine (Auckland, N.Z.) · 2024 · Original paper ↗

Key takeaway

Across 24 systematic reviews covering 249 validation studies and 430,465 participants, consumer wearables had a mean heart rate bias of ±3% but overestimated VO2max by ±15.24% (resting tests) and ±9.83% (exercise tests). Only about 11% of released devices have been validated for any outcome, and the research is so varied in methods that firm accuracy verdicts are not yet possible.

Study design

Overview of reviews

Reading basis

Published abstract

Reading focus

Design & applicability

The research question

Millions of people trust wearables for heart rate, sleep and activity, yet it is unclear how accurate each reading really is. The authors set out to gather all the systematic reviews that compared consumer devices against accepted reference standards, and to keep that evidence up to date as a living review.

Who and how

Umbrella review (a review of systematic reviews and meta-analyses) searching MEDLINE via PubMed, Embase, Cinahl and SPORTDiscus. Included reviews had to validate consumer wearables against accepted reference standards. The team extracted mean absolute percentage error (MAPE), pooled absolute bias, intraclass correlation coefficients and mean absolute differences. Of 904 studies identified in the first search, 24 systematic reviews qualified, containing 249 non-duplicate validation studies with 430,465 participants (43% female). The protocol was registered as CRD42023402703.

What it found

The authors’ reported results. Read each estimate with its population and uncertainty.

  1. 1
    Heart rate was the strongest measure: mean bias of ±3%. Arrhythmia detection had a pooled sensitivity of 100% and specificity of 95%.
  2. 2
    VO2max was significantly overestimated, by ±15.24% in resting tests and ±9.83% in exercise tests. Physical activity intensity had a mean absolute error of 29 to 80%, depending on the intensity.
  3. 3
    Steps were mostly underestimated (MAPE from -9 to 12%). Energy expenditure had a mean bias of -3 kcal per minute (-3%), with errors from -21.27 to 14.76%. Blood oxygen saturation differed by up to 2.0% on average.
  4. 4
    Total sleep time tended to be overestimated, with MAPE typically above 10%.
  5. 5
    Only about 11% of released devices have been validated for at least one outcome, and the existing validation studies are just 3.5% of what a comprehensive evaluation would need.

Limits & uncertainty

  1. 1
    The authors describe pervasive heterogeneity in outcomes and methods across the included reviews, which blocks a conclusive accuracy ranking.
  2. 2
    Pooled figures such as the ±3% heart rate bias hide large differences between brands, models, wear positions and activities, and the abstract does not break them down.
  3. 3
    Because it combines existing reviews, the same underlying studies may be counted in several places, and device models change faster than reviews are updated.
  4. 4
    This reading is based on the abstract only.

What to take from it

Treat heart rate and arrhythmia flags from wearables as reasonably reliable and VO2max, calorie burn, sleep duration and activity intensity as rough estimates. Do not set training zones or health decisions on a single wearable estimate of any of the weaker measures. A symptom or an irregular rhythm alert is something to raise with a clinician rather than settle with the watch.

Reading your own data

Because absolute errors are large for VO2max, calories and sleep time, use these numbers only as your own trend from one device, compared under similar conditions. Avoid comparing readings across brands, and when a decision matters, confirm with a reference measure such as a lab test or chest strap.

How to read this evidence

Reviews may reuse the same trials. Review counts are not independent replications; study quality, overlap and outcome-specific certainty matter.

Authors’ structured abstract English

The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.

Background

Consumer wearable technologies have become ubiquitous, with clinical and non-clinical populations leveraging a variety of devices to quantify various aspects of health and wellness. However, the accuracy with which these devices measure biometric outcomes such as heart rate, sleep and physical activity remains unclear.

Objective

To conduct a 'living' (i.e. ongoing) evaluation of the accuracy of consumer wearable technologies in measuring various physiological outcomes.

Methods

A systematic search of the literature was conducted in the following scientific databases: MEDLINE via PubMed, Embase, Cinahl and SPORTDiscus via EBSCO. The inclusion criteria required systematic reviews or meta-analyses that evaluated the validation of consumer wearable devices against accepted reference standards. In addition to publication details, review protocol, device specifics and a summary of the authors' results, we extracted data on mean absolute percentage error (MAPE), pooled absolute bias, intraclass correlation coefficients (ICCs) and mean absolute differences.

Results

Of 904 identified studies through the initial search, 24 systematic reviews met our inclusion criteria; these systematic reviews included 249 non-duplicate validation studies of consumer wearable devices involving 430,465 participants (43% female). Of the commercially available wearable devices released to date, approximately 11% have been validated for at least one biometric outcome. However, because a typical device can measure a multitude of biometric outcomes, the number of validation studies conducted represents just 3.5% of the total needed for a comprehensive evaluation of these devices. For heart rate, wearables showed a mean bias of ± 3%. In arrhythmia detection, wearables exhibited a pooled sensitivity and specificity of 100% and 95%, respectively. For aerobic capacity, wearables significantly overestimated VO_(2max) by ± 15.24% during resting tests and ± 9.83% during exercise tests. Physical activity intensity measurements had a mean absolute error ranging from 29 to 80%, depending on the intensity of the activity being undertaken. Wearables mostly underestimated step counts (mean absolute percentage errors ranging from - 9 to 12%) and energy expenditure (mean bias = - 3 kcal per minute, or - 3%, with error ranging from - 21.27 to 14.76%). For blood oxygen saturation, wearables showed a mean absolute difference of up to 2.0%. Sleep measurement showed a tendency to overestimate total sleep time (mean absolute percentage error typically > 10%).

Conclusions

While consumer wearables show promise in health monitoring, a conclusive assessment of their accuracy is impeded by pervasive heterogeneity in research outcomes and methodologies. There is a need for standardised validation protocols and collaborative industry partnerships to enhance the reliability and practical applicability of wearable technology assessments.

Prospero id

CRD42023402703.

Sources & attribution

Keeping Pace with Wearables: A Living Umbrella Review of Systematic Reviews Evaluating the Accuracy of Consumer Wearable Technologies in Health Measurement.

Doherty C, Baldwin M, Keogh A, Caulfield B, Argent R.

Sports medicine (Auckland, N.Z.) · 2024-07-30

DOI: 10.1007/s40279-024-02077-2 ↗PubMed · 39080098 ↗Europe PMC · Recorded licence: cc by ↗

Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.

MoveVitals editorial interpretation · educational content · no individual clinical review recorded

Sources checked 2026-11-01

Practical guides

Read in context

·Cohort study

Activity–stroke and heart attack curves differ by accelerometer processing method

Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.

Preventive Medicine

In-depth explainersRead study →
·Validation study/review

Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven

A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.

Forensic Science International

In-depth explainersRead study →
·Overview of reviews

Activity trackers: about 1,800 more steps a day, but small effects on other outcomes

An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.

The Lancet Digital Health

In-depth explainersRead study →
·Validation study/review

Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages

In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.

Sleep

In-depth explainersRead study →
Wearables & measurement →