Key takeaway
In a System Usability Scale (SUS) survey of 388 participants rating seven wearables, scores ranged from a mean of 61.4 (Apple Watch) to 67.6 (Huawei Honor B2), with no significant difference among brands. Scores were tied to how long people had used the device and their job background, but the devices were tested in 2018-era models and the sample's selection is not described.
Study design
Research article
Reading basis
Published abstract
Reading focus
Design & applicability
The research question
Wearables could encourage healthier habits, but only if people find them usable enough to keep wearing. Few usability studies exist, so the authors compared the features of seven mainstream devices and asked users to rate them.
Who and how
Mixed-methods study: a feature comparison of the Apple Watch, Samsung Gear S, Fitbit Surge, Jawbone Up3, Mi Band, Huawei Honor B2 and Misfit Shine, plus a System Usability Scale (SUS) evaluation by 388 participants. A higher SUS score means better usability. Attributes such as weight, battery life, price and 22 functions were correlated with SUS scores. The abstract does not describe how participants were recruited or how many rated each device.
What it found
The authors’ reported results. Read each estimate with its population and uncertainty.
- 1Features were largely alike: every device counted steps, timed activity and recorded distance. The Apple Watch, Samsung Gear S, Jawbone Up3 and Fitbit Surge measured heart rate, and all but the Apple Watch monitored sleep.
- 2Usability scores were modest and close together: highest was the Huawei Honor B2 at a mean of 67.6 (SD 16.1) and lowest the Apple Watch at 61.4 (SD 14.7), with no significant difference among brands.
- 3Longer experience with a device went with higher scores (r = 0.32, P < 0.001), a moderate correlation. Price (r = -0.10, P = 0.03) and support for expandable new features (r = -0.11, P = 0.02) had very weak negative correlations, and activity type identification a very weak positive one (r = 0.11, P = 0.02).
- 4Participants in the medical and health care industries rated devices higher (means 68.7 versus 61.1, P = 0.03).
Limits & uncertainty
- 1The abstract does not say how participants were recruited or how many used each device, so the brand comparison may be unreliable.
- 2Correlations between SUS and product features are very weak (r between -0.11 and 0.11), so they are unlikely to be practically useful.
- 3The seven models were current in 2018 and are now dated; the findings about particular brands cannot be assumed to apply to today's devices.
- 4SUS measures perceived usability, not whether a device improves health or accuracy of data.
What to take from it
If you are choosing a wearable, this paper suggests brand name is a weak guide to how usable you will find it, and your own experience and situation matter more. Do not read the specific scores as a ranking of today's devices.
Reading your own data
Usability is about how comfortable you are with a device, not how accurate its numbers are. Whichever you choose, stick with one device and wear it consistently so your own trends in steps, heart rate and sleep are comparable over time.
How to read this evidence
The index does not establish a precise design. Read the methods before making causal claims; check population, comparator, outcomes and uncertainty in the source.
Authors’ structured abstract English
The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.
Background
Wearable devices have the potential to promote a healthy lifestyle because of their real-time data monitoring capabilities. However, device usability is a critical factor that determines whether they will be adopted on a large scale. Usability studies on wearable devices are still scarce.
Objective
This study aims to compare the functions and attributes of seven mainstream wearable devices and to evaluate their usability.
Methods
The wearable devices selected were the Apple Watch, Samsung Gear S, Fitbit Surge, Jawbone Up3, Mi Band, Huawei Honor B2, and Misfit Shine. A mixed method of feature comparison and a System Usability Scale (SUS) evaluation based on 388 participants was applied; the higher the SUS score, the better the usability of the product.
Results
For features, all devices had step counting, an activity timer, and distance recording functions. The Samsung Gear S had a unique sports track recording feature and the Huawei Honor B2 had a unique wireless earphone. The Apple Watch, Samsung Gear S, Jawbone Up3, and Fitbit Surge could measure heart rate. All the devices were able to monitor sleep, except the Apple Watch. For product characteristics, including attributes such as weight, battery life, price, and 22 functions such as step counting, activity time, activity type identification, sleep monitoring, and expandable new features, we found a very weak negative correlation between the SUS scores and price (r=-.10, P=.03) and devices that support expandable new features (r=-.11, P=.02), and a very weak positive correlation between the SUS scores and devices that support the activity type identification function (r=.11, P=.02). The Huawei Honor B2 received the highest score of mean 67.6 (SD 16.1); the lowest Apple Watch score was only 61.4 (SD 14.7). No significant difference was observed among brands. The SUS score had a moderate positive correlation with the user's experience (length of time the device was used) (r=.32, P<.001); participants in the medical and health care industries gave a significantly higher score (mean 61.1, SD 17.9 vs mean 68.7, SD 14.5, P=.03).
Conclusions
The functions of wearable devices tend to be homogeneous and usability is similar across various brands. Overall, Mi Band had the lowest price and the lightest weight. Misfit Shine had the longest battery life and most functions, and participants in the medical and health care industries had the best evaluation of wearable devices. The perceived usability of mainstream wearable devices is unsatisfactory and customer loyalty is not high. A consumer's SUS rating for a wearable device is related to their personal situation instead of the device brand. Device manufacturers should put more effort into developing innovative functions and improving the usability of their products by integrating more cognitive behavior change techniques.
Sources & attribution
Usability Study of Mainstream Wearable Fitness Devices: Feature Analysis and System Usability Scale Evaluation.
Liang J, Xian D, Liu X, Fu J, Zhang X, Tang B, Lei J.
JMIR mHealth and uHealth · 2018-11-08
DOI: 10.2196/11066 ↗PubMed · 30409767 ↗Europe PMC · Recorded licence: cc by ↗Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.
MoveVitals editorial interpretation · educational content · no individual clinical review recorded
Sources checked 2026-11-01
Practical guides
Read in context
Activity–stroke and heart attack curves differ by accelerometer processing method
Among 90,237 UK Biobank adults free of cardiovascular disease at baseline, followed until December 2022 for 1,298 strokes and 2,031 myocardial infarctions, the shape of the link between moderate-vigorous physical activity (MVPA) and each outcome depended on how the accelerometer data were processed. For stroke, hazard fell in a straight line only with the machine-learning metric; for myocardial infarction, two metrics gave a curved decline and activity counts a straight one. The abstract gives no hazard ratios, so it shows that methods disagree, not which one is right, and the findings are observational associations.
Preventive Medicine
Smartwatch data as forensic evidence: heart rate is best validated, the rest uneven
A systematic review and meta-analysis of studies on smartwatches from four major brands, framed around digital forensics, found that heart rate was both the most studied and the most accurate measure. Step count, distance, energy expenditure, activity classification and sleep were less consistently validated, and results varied by brand, protocol and reporting. The abstract gives no pooled numbers, and most studies were run in healthy people in laboratories, so it cannot say how a particular watch performs for a particular person in daily life.
Forensic Science International
Activity trackers: about 1,800 more steps a day, but small effects on other outcomes
An umbrella review of 39 systematic reviews and meta-analyses, covering 163,992 participants, found that activity trackers were associated with more physical activity (SMD 0.3–0.6), equating to about 1,800 extra steps and 40 minutes more walking per day, and with a bodyweight reduction of about 1 kg. Effects on blood pressure, cholesterol, glycosylated haemoglobin, quality of life and pain were typically small and often non-significant. The abstract does not say what else came with the trackers in these programs or how much the reviews overlap, so the gains cannot be credited to the device alone.
The Lancet Digital Health
Seven sleep trackers: good at spotting sleep, weak on wake and sleep stages
In a sleep laboratory, 34 healthy young adults wore a subset of seven consumer sleep trackers for three nights. Against polysomnography every device detected sleep very well (sensitivity 0.93 or higher) but caught wake poorly (specificity 0.18–0.54), and five of the seven matched or beat research actigraphy (specificity 0.39). Sleep-stage estimates were inconsistent, and the participants were healthy adults aged 18 to 35 in a fixed 8-hour bed window, with each device tested in only 11 to 20 of them, so the results say little about people with sleep problems.
Sleep

