Skip to content
Wearables & measurementValidation study/review3 min read

Apple Watch, Fitbit and Garmin heart rate and calorie accuracy varied with exercise intensity

MoveVitals Editorial Collective · Study published · Reading updated

Original paper:Estimating Accuracy at Exercise Intensities: A Comparative Study of Self-Monitoring Heart Rate and Physical Activity Wearable Devices. · JMIR mHealth and uHealth · 2017 · Original paper ↗

Key takeaway

In 62 people on a treadmill, heart rate error (MAPE) was 1.14% to 6.70% for the Apple Watch, 2.38% to 16.99% for the Fitbit Charge HR and 7.87% to 24.38% for the Garmin Forerunner 225, while calorie error was far larger on all three. These are older wrist devices tested in a short lab session, so they do not describe current models or daily life.

Study design

Validation study/review

Reading basis

Published abstract

Reading focus

Reference & error

The research question

Wrist trackers are widely used to judge heart rate and calories burned, even in weight loss programs, but it was not known whether they stay accurate as exercise gets harder. The authors tested heart rate and energy expenditure accuracy of three popular devices at different exercise intensities.

Who and how

Validation study of 62 participants (58% female, 47% nonwhite) who wore an Apple Watch, a Fitbit Charge HR and a Garmin Forerunner 225 together. A chest strap served as the heart rate reference and a metabolic cart as the energy expenditure reference. The protocol was a 10-minute seated baseline, separate 4-minute treadmill stages of light, moderate and vigorous intensity, and a 10-minute seated recovery. Devices were compared with each reference by two-way repeated-measures analysis of variance and Bland-Altman analysis, with error expressed as mean absolute percentage error (MAPE).

What it found

The authors’ reported results. Read each estimate with its population and uncertainty.

  1. 1
    Apple Watch heart rate error ranged from 1.14% to 6.70% MAPE. Readings matched the chest strap at the start (P=.78), baseline (P=.76) and vigorous intensity (P=.84) but were lower at light (P=.03) and moderate intensity (P=.001) and in recovery (P=.004).
  2. 2
    Fitbit heart rate error ranged from 2.38% to 16.99%. It matched at the start (P=.67) and moderate intensity (P=.34), read lower at baseline, vigorous intensity and recovery (P<.001) and higher at light intensity (P<.001).
  3. 3
    Garmin heart rate error ranged from 7.87% to 24.38%. It matched only at vigorous intensity (P=.35) and read higher at other stages.
  4. 4
    Calorie estimates were much less accurate: MAPE was 14.07% to 210.84% for Apple Watch, 16.85% to 84.98% for Fitbit and 30.77% to 155.05% for Garmin. Apple Watch and Garmin read higher at all stages. Fitbit read higher at baseline and light and moderate intensity but matched at vigorous intensity (P=.70) and recovery (P=.10).

Limits & uncertainty

  1. 1
    Three specific wrist devices from 2017 or earlier, with firmware and algorithms that have since changed; results do not describe current models.
  2. 2
    Short 4-minute treadmill stages in a lab, so steady-state running or real-world movement such as cycling or lifting is not covered.
  3. 3
    The abstract does not report how skin tone, wrist fit or fitness level affected accuracy, even though 47% of the sample was nonwhite.
  4. 4
    Based on the abstract only; Bland-Altman limits of agreement are not given.

What to take from it

Heart rate on these wrist devices was usable in some conditions and clearly off in others, and the error changed with exercise intensity. Calorie numbers were so far from the metabolic cart that they are better treated as rough guesses than as precise data.

Reading your own data

If you train by heart rate zones, check your watch against a chest strap occasionally, especially at easy and moderate efforts, and treat calorie burn as a rough relative figure. Compare your own numbers over time on the same device and wear position.

How to read this evidence

Agreement is specific to the device, firmware, reference, population and setting. Correlation is not agreement, and validating a metric is not proof of diagnostic or treatment benefit.

Authors’ structured abstract English

The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.

Background

Physical activity tracking wearable devices have emerged as an increasingly popular method for consumers to assess their daily activity and calories expended. However, whether these wearable devices are valid at different levels of exercise intensity is unknown.

Objective

The objective of this study was to examine heart rate (HR) and energy expenditure (EE) validity of 3 popular wrist-worn activity monitors at different exercise intensities.

Methods

A total of 62 participants (females: 58%, 36/62; nonwhite: 47% [13/62 Hispanic, 8/62 Asian, 7/62 black/ African American, 1/62 other]) wore the Apple Watch, Fitbit Charge HR, and Garmin Forerunner 225. Validity was assessed using 2 criterion devices: HR chest strap and a metabolic cart. Participants completed a 10-minute seated baseline assessment; separate 4-minute stages of light-, moderate-, and vigorous-intensity treadmill exercises; and a 10-minute seated recovery period. Data from devices were compared with each criterion via two-way repeated-measures analysis of variance and Bland-Altman analysis. Differences are expressed in mean absolute percentage error (MAPE).

Results

For the Apple Watch, HR MAPE was between 1.14% and 6.70%. HR was not significantly different at the start (P=.78), during baseline (P=.76), or vigorous intensity (P=.84); lower HR readings were measured during light intensity (P=.03), moderate intensity (P=.001), and recovery (P=.004). EE MAPE was between 14.07% and 210.84%. The device measured higher EE at all stages (P<.01). For the Fitbit device, the HR MAPE was between 2.38% and 16.99%. HR was not significantly different at the start (P=.67) or during moderate intensity (P=.34); lower HR readings were measured during baseline, vigorous intensity, and recovery (P<.001) and higher HR during light intensity (P<.001). EE MAPE was between 16.85% and 84.98%. The device measured higher EE at baseline (P=.003), light intensity (P<.001), and moderate intensity (P=.001). EE was not significantly different at vigorous (P=.70) or recovery (P=.10). For Garmin Forerunner 225, HR MAPE was between 7.87% and 24.38%. HR was not significantly different at vigorous intensity (P=.35). The device measured higher HR readings at start, baseline, light intensity, moderate intensity (P<.001), and recovery (P=.04). EE MAPE was between 30.77% and 155.05%. The device measured higher EE at all stages (P<.001).

Conclusions

This study provides one of the first validation assessments for the Fitbit Charge HR, Apple Watch, and Garmin Forerunner 225. An advantage and novel approach of the study is the examination of HR and EE at specific physical activity intensities. Establishing validity of wearable devices is of particular interest as these devices are being used in weight loss interventions and could impact findings. Future research should investigate why differences between exercise intensities and the devices exist.

Sources & attribution

Estimating Accuracy at Exercise Intensities: A Comparative Study of Self-Monitoring Heart Rate and Physical Activity Wearable Devices.

Dooley EE, Golaszewski NM, Bartholomew JB.

JMIR mHealth and uHealth · 2017-03-16

DOI: 10.2196/mhealth.7043 ↗PubMed · 28302596 ↗Europe PMC · Recorded licence: cc by ↗

Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.

MoveVitals editorial interpretation · educational content · no individual clinical review recorded

Sources checked 2026-11-01

Practical guides

Read in context

·Cohort study

Activity–stroke and heart attack curves differ by accelerometer processing method

Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.

Preventive Medicine

In-depth explainersRead study →
·Validation study/review

Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven

A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.

Forensic Science International

In-depth explainersRead study →
·Overview of reviews

Activity trackers: about 1,800 more steps a day, but small effects on other outcomes

An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.

The Lancet Digital Health

In-depth explainersRead study →
·Validation study/review

Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages

In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.

Sleep

In-depth explainersRead study →
Wearables & measurement →