Skip to content
Wearables & measurementResearch article3 min read

Fitbit step counts were accurate on a treadmill but poor with a walker or while eating

MoveVitals Editorial Collective · Study published · Reading updated

Original paper:How Accurate Is Your Activity Tracker? A Comparative Study of Step Counts in Low-Intensity Physical Activities. · JMIR mHealth and uHealth · 2017 · Original paper ↗

Key takeaway

In 15 healthy young adults, three Fitbit models correlated well with true step counts on a treadmill (ICC > 0.75) but poorly when walking with a walker (ICC < 0.60). The sample was small and young, so it says little about older people or the aid users the findings matter for.

Study design

Research article

Reading basis

Published abstract

Reading focus

Design & applicability

The research question

Consumer activity trackers are used in clinical trials, yet they have mostly been tested while walking and running, not in slow movement or with walking aids. The authors asked how accurate three Fitbit models are at different wearing positions and speeds, and whether the best wearing site depends on activity intensity.

Who and how

Lab comparison in 15 healthy young adults, each wearing three Fitbit devices (Zip, One and Flex) on the chest, in a pants pocket and on the wrist. They performed 6 activities: treadmill walking at 2.5, 5 and 8 km/h, pushing a shopping cart, walking with a walker, and eating while seated. Tracker step counts were compared with gold-standard counts using ANOVA, intraclass correlation coefficient (ICC), mean absolute error rate and correlation.

What it found

The authors’ reported results. Read each estimate with its population and uncertainty.

  1. 1
    On the treadmill, all three trackers showed good-to-excellent agreement with the gold-standard step counts (ICC > 0.75).
  2. 2
    With the walker, agreement was poor (ICC < 0.60) and the error rate was significantly higher than in the other activities.
  3. 3
    In the shopping cart task there was no significant difference between the trackers and the gold standard.
  4. 4
    The wrist-worn Flex counted several steps while the person was eating (P < .01). The chest was the most promising site for higher-intensity activities, and the wrist for lower-intensity ones.

Limits & uncertainty

  1. 1
    Only 15 healthy young adults took part, with none using a walker for real mobility needs, so results may not carry over to older or less mobile people.
  2. 2
    Only three Fitbit models and 6 scripted lab activities were tested, not everyday free-living movement, other brands or newer devices.
  3. 3
    The authors call it a feasibility study and say that a larger study with a more diverse population, other vendors and more activities is needed.
  4. 4
    This reading is based on the abstract only, which gives no error percentages.

What to take from it

Step counts from a tracker are reasonably dependable for ordinary walking, but they can be badly off if you walk with a walker or stroller-like aid, and a wrist device can add steps from arm movement while seated. Choose a wearing position that suits your activity, and treat the number as an estimate. This was a small lab test, not a verdict on any one product.

Reading your own data

If your steps come from a wrist device, expect some phantom counts from arm movement and undercounts when your hands are on a cart, walker or stroller. Wear the same device in the same place every day, and compare weekly trends instead of single-day totals or other people's numbers.

How to read this evidence

The index does not establish a precise design. Read the methods before making causal claims; check population, comparator, outcomes and uncertainty in the source.

Authors’ structured abstract English

The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.

Background

As commercially available activity trackers are being utilized in clinical trials, the research community remains uncertain about reliability of the trackers, particularly in studies that involve walking aids and low-intensity activities. While these trackers have been tested for reliability during walking and running activities, there has been limited research on validating them during low-intensity activities and walking with assistive tools.

Objective

The aim of this study was to (1) determine the accuracy of 3 Fitbit devices (ie, Zip, One, and Flex) at different wearing positions (ie, pants pocket, chest, and wrist) during walking at 3 different speeds, 2.5, 5, and 8 km/h, performed by healthy adults on a treadmill; (2) determine the accuracy of the mentioned trackers worn at different sites during activities of daily living; and (3) examine whether intensity of physical activity (PA) impacts the choice of optimal wearing site of the tracker.

Methods

We recruited 15 healthy young adults to perform 6 PAs while wearing 3 Fitbit devices (ie, Zip, One, and Flex) on their chest, pants pocket, and wrist. The activities include walking at 2.5, 5, and 8 km/h, pushing a shopping cart, walking with aid of a walker, and eating while sitting. We compared the number of steps counted by each tracker with gold standard numbers. We performed multiple statistical analyses to compute descriptive statistics (ie, ANOVA test), intraclass correlation coefficient (ICC), mean absolute error rate, and correlation by comparing the tracker-recorded data with that of the gold standard.

Results

All the 3 trackers demonstrated good-to-excellent (ICC>0.75) correlation with the gold standard step counts during treadmill experiments. The correlation was poor (ICC<0.60), and the error rate was significantly higher in walker experiment compared to other activities. There was no significant difference between the trackers and the gold standard in the shopping cart experiment. The wrist worn tracker, Flex, counted several steps when eating (P<.01). The chest tracker was identified as the most promising site to capture steps in more intense activities, while the wrist was the optimal wearing site in less intense activities.

Conclusions

This feasibility study focused on 6 PAs and demonstrated that Fitbit trackers were most accurate when walking on a treadmill and least accurate during walking with a walking aid and for low-intensity activities. This may suggest excluding participants with assistive devices from studies that focus on PA interventions using commercially available trackers. This study also indicates that the wearing site of the tracker is an important factor impacting the accuracy performance. A larger scale study with a more diverse population, various activity tracker vendors, and a larger activity set are warranted to generalize our results.

Sources & attribution

How Accurate Is Your Activity Tracker? A Comparative Study of Step Counts in Low-Intensity Physical Activities.

Alinia P, Cain C, Fallahzadeh R, Shahrokni A, Cook D, Ghasemzadeh H.

JMIR mHealth and uHealth · 2017-08-11

DOI: 10.2196/mhealth.6321 ↗PubMed · 28801304 ↗Europe PMC · Recorded licence: cc by ↗

Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.

MoveVitals editorial interpretation · educational content · no individual clinical review recorded

Sources checked 2026-11-01

Practical guides

Read in context

·Cohort study

Activity–stroke and heart attack curves differ by accelerometer processing method

Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.

Preventive Medicine

In-depth explainersRead study →
·Validation study/review

Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven

A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.

Forensic Science International

In-depth explainersRead study →
·Overview of reviews

Activity trackers: about 1,800 more steps a day, but small effects on other outcomes

An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.

The Lancet Digital Health

In-depth explainersRead study →
·Validation study/review

Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages

In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.

Sleep

In-depth explainersRead study →
Wearables & measurement →