Key takeaway
Across 11 consumer sleep trackers tested against in-lab polysomnography in 75 people in Korea, sleep-stage agreement varied widely: the best macro F1 score was 0.69 and the worst was 0.26. The tested people were in sleep clinics and a hospital, so results may not match everyday home use.
Study design
Validation study/review
Reading basis
Published abstract
Reading focus
Reference & error
The research question
Millions of people use sleep trackers, but few studies have compared many popular devices against the clinical standard in one large sample. The authors tested how well wearables, bedside devices (nearables) and phone apps (airables) agree with polysomnography, the overnight sleep-lab recording.
Who and how
Prospective multicenter validation study of 11 commercial trackers: 5 wearables (Google Pixel Watch, Galaxy Watch 5, Fitbit Sense 2, Apple Watch 8, Oura Ring 3), 3 nearables (Withings Sleep Tracking Mat, Google Nest Hub 2, Amazon Halo Rise) and 3 airables (SleepRoutine, SleepScore, Pillow). The trackers were split into 2 groups so devices would not interfere with each other, and each group (8 trackers) was compared with polysomnography. 75 participants were recruited from a tertiary hospital and a primary sleep-specialized clinic in Korea. Epoch-by-epoch agreement of sleep stages was scored with macro F1.
What it found
The authors’ reported results. Read each estimate with its population and uncertainty.
- 1The study analysed 349,114 epochs from the 11 trackers, collecting 3890 hours of tracker sleep sessions and 543 hours of polysomnography. Epoch-by-epoch sleep-stage agreement varied greatly, with macro F1 from 0.26 (lowest) to 0.69 (highest).
- 2By stage, SleepRoutine did best for wake and rapid eye movement (REM) sleep, while wearables such as Google Pixel Watch and Fitbit Sense 2 did best for deep sleep.
- 3Errors followed device type: wearables showed high proportional bias in sleep efficiency, and nearables showed high proportional bias in sleep latency.
- 4Macro F1 varied with BMI, sleep efficiency and apnea-hypopnea index, while differences between men and women were minimal.
Limits & uncertainty
- 1Testing took place in a hospital and a sleep clinic with only 75 participants, so everyday home sleep may be tracked differently.
- 2The abstract does not report which device earned the 0.69 or the 0.26, or per-device figures beyond the stage highlights.
- 3Each group of trackers was only compared as a set of 8 devices, so devices from different groups were not worn on the same nights.
- 4This reading is based on the abstract only.
What to take from it
Do not assume all trackers are equally good at naming sleep stages; the spread in agreement with the sleep lab was large. Some devices agreed substantially with polysomnography, but stage-by-stage accuracy still differs by device and by how you sleep. Treat stage breakdowns as rough estimates.
Reading your own data
If you wear an Oura Ring, Apple Watch, Fitbit or a bedside device, compare your own nightly totals over weeks on the same device rather than reading single-night stage minutes. Deep sleep, wake time and sleep latency estimates are device-dependent, so do not compare numbers across brands.
How to read this evidence
Agreement is specific to the device, firmware, reference, population and setting. Correlation is not agreement, and validating a metric is not proof of diagnostic or treatment benefit.
Authors’ structured abstract English
The attributed English abstract is reproduced under the recorded open licence. It is source material, not a MoveVitals interpretation. The prepared analysis above separates the authors’ findings from our interpretation.
Background
Consumer sleep trackers (CSTs) have gained significant popularity because they enable individuals to conveniently monitor and analyze their sleep. However, limited studies have comprehensively validated the performance of widely used CSTs. Our study therefore investigated popular CSTs based on various biosignals and algorithms by assessing the agreement with polysomnography.
Objective
This study aimed to validate the accuracy of various types of CSTs through a comparison with in-lab polysomnography. Additionally, by including widely used CSTs and conducting a multicenter study with a large sample size, this study seeks to provide comprehensive insights into the performance and applicability of these CSTs for sleep monitoring in a hospital environment.
Methods
The study analyzed 11 commercially available CSTs, including 5 wearables (Google Pixel Watch, Galaxy Watch 5, Fitbit Sense 2, Apple Watch 8, and Oura Ring 3), 3 nearables (Withings Sleep Tracking Mat, Google Nest Hub 2, and Amazon Halo Rise), and 3 airables (SleepRoutine, SleepScore, and Pillow). The 11 CSTs were divided into 2 groups, ensuring maximum inclusion while avoiding interference between the CSTs within each group. Each group (comprising 8 CSTs) was also compared via polysomnography.
Results
The study enrolled 75 participants from a tertiary hospital and a primary sleep-specialized clinic in Korea. Across the 2 centers, we collected a total of 3890 hours of sleep sessions based on 11 CSTs, along with 543 hours of polysomnography recordings. Each CST sleep recording covered an average of 353 hours. We analyzed a total of 349,114 epochs from the 11 CSTs compared with polysomnography, where epoch-by-epoch agreement in sleep stage classification showed substantial performance variation. More specifically, the highest macro F1 score was 0.69, while the lowest macro F1 score was 0.26. Various sleep trackers exhibited diverse performances across sleep stages, with SleepRoutine excelling in the wake and rapid eye movement stages, and wearables like Google Pixel Watch and Fitbit Sense 2 showing superiority in the deep stage. There was a distinct trend in sleep measure estimation according to the type of device. Wearables showed high proportional bias in sleep efficiency, while nearables exhibited high proportional bias in sleep latency. Subgroup analyses of sleep trackers revealed variations in macro F1 scores based on factors, such as BMI, sleep efficiency, and apnea-hypopnea index, while the differences between male and female subgroups were minimal.
Conclusions
Our study showed that among the 11 CSTs examined, specific CSTs showed substantial agreement with polysomnography, indicating their potential application in sleep monitoring, while other CSTs were partially consistent with polysomnography. This study offers insights into the strengths of CSTs within the 3 different classes for individuals interested in wellness who wish to understand and proactively manage their own sleep.
Sources & attribution
Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study.
Lee T, Cho Y, Cha KS, Jung J, Cho J, Kim H, Kim D, Hong J, Lee D, Keum M, Kushida CA, Yoon IY, Kim JW.
JMIR mHealth and uHealth · 2023-11-02
DOI: 10.2196/50983 ↗PubMed · 37917155 ↗Europe PMC · Recorded licence: cc by ↗Abstract © the original authors, reproduced under the recorded open licence. Translations support reading; use the English record to check terminology and numerical results. Our methodological interpretation is separate from the authors’ conclusions.
MoveVitals editorial interpretation · educational content · no individual clinical review recorded
Sources checked 2026-11-01
Practical guides
Read in context
Exercise improved sleep-quality scores in adults 45 and older with sleep disorders
Pooling 23 randomized trials with 1,478 adults aged 45 to 77 who had sleep disorders, exercise improved Pittsburgh Sleep Quality Index scores (SMD 0.62, 95% CI 0.40–0.83), and aerobic exercise showed the largest effect in the network analysis (SMD 1.34, 95% CrI 0.86–1.82). Certainty was low to moderate, the outcomes were questionnaires, and the best weekly dose of about 539 MET-min/week is a model estimate, not a prescription.
Journal of Exercise Science & Fitness
Sleep regularity tracked mortality more closely than sleep duration in 60,977 UK adults
Among 60,977 UK Biobank adults who wore a wrist accelerometer for a week, the most regular fifth of sleepers had a fully adjusted all-cause mortality HR of 0.70 (95% CI 0.59–0.83) against the least regular fifth, over about 6.3 years and 1859 deaths. Regularity fitted the data better than sleep duration, but the study is observational and rests on one week of sleep data.
Sleep
Sleep extension cut daily energy intake by about 270 kcal in adults with overweight
In 80 adults with overweight who usually slept under 6.5 hours, two weeks of sleep-extension counselling added about 1.2 hours of sleep and lowered measured energy intake by 270.4 kcal/d versus control (95% CI −393.4 to −147.4). The trial was short, single-centre and in a narrow group, so it does not show lasting weight loss or any benefit for people who already sleep enough.
JAMA Internal Medicine
Six hours or less of sleep at 50 and 60 linked to higher dementia risk
In 7959 British civil servants followed for about 25 years, sleeping six hours or less at age 50 (HR 1.22, 95% CI 1.01–1.48) or age 60 (HR 1.37, 1.10–1.72) was linked to a higher dementia rate than sleeping seven hours, and persistent short sleep gave an HR of 1.30 (1.00–1.69). Sleep was mostly self-reported and the study is observational, so early brain disease or other factors may explain part of the link.
Nature Communications

