Activity trackers not as accurate for some activities, ISU study finds

Iowa State researchers put some of the more popular activity trackers to the test. Video by Dave Olson.  

AMES, Iowa – Activity trackers can provide a good overall estimate of calories burned, but an Iowa State University study finds they’re less accurate when measuring certain activities, such as strength training.

In this latest round of testing, a team of researchers in ISU’s Department of Kinesiology tested four consumer fitness trackers – Fitbit Flex, Nike+ FuelBand SE, Jawbone UP 24 and Misfit Shine – to see how well they measured sedentary, aerobic and resistance activity. Two research monitors – the BodyMedia Core and Actigraph GT3X+ – were also included in the study.

Overall, the BodyMedia Core was the top performer with a rate of error of 15.3 percent. The Misfit Shine was the least accurate with a 30.4 percent error rate. The results are published in Medicine & Science in Sports & Exercise. The following is a breakdown of error rates for each monitor based on activity:     

Overall results for each monitor:
BodyMedia Core 15.3 percent
Actigraph GT3X+ 16.7 percent
Fitbit Flex 16.8 percent
Nike+ FuelBand SE 17.1 percent
Jawbone UP24 18.2 percent
Misfit Shine 30.4 percent
Results for aerobic activity:
BodyMedia Core 17.2 percent
Nike+ FuelBand SE 18.5 percent
Actigraph GT3X+ 22.1 percent
Jawbone UP 24 30.0 percent
Fitbit Flex 34.7 percent
Misfit Shine 60.1 percent
Results for sedentary activity:
BodyMedia Core 15.7 percent
Misfit Shine 18.2 percent
Nike+ FuelBand SE 20.0 percent
Fitbit Flex 29.4 percent
Jawbone UP24 29.4 percent
Actigraph GT3X+ 45.2 percent
Results for resistance activity:
Nike+ FuelBand SE 20.0 percent
BodyMedia Core 29.2 percent
Fitbit Flex 31.6 percent
Misfit Shine 36.8 percent
Actigraph GT3X+ 45.2 percent
Jawbone UP24 52.6 percent

A test of real conditions

ISU researchers designed the study to mimic real daily living activities. The 56 participants were asked to complete 20 minutes of sedentary activity, such as reading a book, working at the computer or watching a video. That was followed by 25 minutes of their choice of aerobic activity and 25 minutes of resistance exercise, with 5 minutes of rest between each activity.

“By looking at the most commonly performed activities in exercise and daily living settings, we can examine where the errors occur,” said Yang Bai, lead author and a graduate research assistant in kinesiology. “As expected, some monitors overestimate or underestimate all three activities, but some monitors overestimate one type and underestimate the other two categories, which can cancel out if we don't measure them separately.”

As with the previous activity monitor study, researchers say accuracy is important, but it is only part of the equation in terms of improving physical activity levels.

“I think the key to a consumer is not so much if the activity monitor is accurate in terms of calories, but whether it’s motivational for them and keeps them accountable for activity in a day,” said Greg Welk, professor of kinesiology.

Yoon Ho Nam, Joey Lee, Jung-Min Lee, Youngwon Kim, Nathan Meier and Philip Dixon were part of the research team that contributed to the study.