How to test a smartwatch or fitness tracker

To beta test a smartwatch or fitness tracker well, compare it against a reference you trust (a route you have measured for GPS, a chest strap for heart rate), repeat the same checks each week and record the conditions every time. BetaSuite: Tester's Toolkit (betasuite.app) is an iPhone, iPad and Android app built for this: it burns the date and time into every photo and video, and its dual recording captures your phone's screen and the watch together. It doesn't read the watch's sensors, and nothing here is medical advice. The checklist below works with any tool, and there is a free 12-step protocol to import.

Updated 2 October 2026 · Written by Goodfield Studio, the maker of BetaSuite

What to test in a wearable beta

Start with pairing, sync and battery, because every other result depends on the watch staying connected and charged. Then work through the sensors and features, and repeat anything that fails so you can say how often it happens.

AreaWhat you are checkingEvidence worth capturing
Set-up and pairingTime to pair with the phone and app, the profile and permissions set-up, and whether pairing survives a restart of the watch or the phone, or an update.A screen recording of the pairing, and a screenshot of any error with the time visible.
GPS accuracyDistance and route against a reference on a route you know well. Lock time from a cold start. Behaviour under trees, near tall buildings and in tunnels.A photo of the watch's summary next to the reference, and screenshots of both tracks.
Heart rateReadings against a chest strap at a steady effort, and how well the watch follows a change (intervals, a hill, a stop). Cold weather and a loose strap matter too.A photo of the watch and the strap's display together, with the time visible.
Activity and workout trackingStart, pause and stop, auto-detect and auto-pause, laps, and whether a saved workout matches what you did. Counting 100 steps by hand is a quick check on step counts.A screenshot of the workout summary and a note of what you did.
Sleep trackingWhether bedtime, wake time and any wake-ups roughly match what you remember, across several nights. Treat it as an estimate, not a measurement.A dated screenshot of each night's summary, with a note of your own estimate.
Battery lifeBattery against the maker's claim, on the settings you actually use (always-on display, GPS use, notifications). Start from the same level each time.A dated tally of the battery percentage at fixed times, and the settings you used.
Sync reliabilityHow quickly workouts, sleep and settings reach the phone app, and whether anything is missing, duplicated or stuck after a Bluetooth drop.Screenshots of the app and the watch side by side with the time visible.
NotificationsDelay between the phone and the watch, duplicates, missed alerts, and whether actions such as dismiss and reply work. Check with the phone locked and with Do Not Disturb on.A dual recording of the phone's screen and the watch together.
Water resistanceOnly within the rating and the conditions the manufacturer states. Check the screen, buttons and touch afterwards, and look for any moisture under the glass.A photo of the watch before and after, and a note of what it went through.
Screen, buttons and comfortReadability in sun, touch response with wet hands, the feel of the buttons, strap comfort and any skin irritation over a long wear.Photos of the screen outdoors, and a note of how long you wore it.

Not medical advice. Heart rate, sleep, blood oxygen and similar readings from a wearable are consumer estimates unless the manufacturer says otherwise, and a beta device can be wrong. Comparing a watch with a chest strap shows how the watch behaves in your test, not whether it is clinically accurate, and neither this guide nor BetaSuite can diagnose anything. Don't change medication, training or anything else about your health because of a beta device, and talk to a health professional about any concern. Take the watch off if it irritates your skin or feels too hot, and don't test emergency features such as SOS or fall detection unless the brief says how, because they can contact real emergency services.

A repeatable accuracy test

"It seems about right" can't be compared from one week to the next. This test can, so you can tell whether a firmware update or a setting made things better or worse. It is a relative test, not a lab result.

  1. Choose a route you can measure on a map or with a measuring app (a lap of a park or a running track), and use the same one every time. Write down the length your reference gives.
  2. Wear the watch snugly on the same wrist, and a chest strap if you have one, with the strap's display or app in view.
  3. Wait for the watch to lock GPS before you start, and note how long that took.
  4. Start the watch and the reference at the same moment. Do a steady effort for ten minutes, then a few short harder efforts with a rest between (only as hard as is safe for you), so you test both steady and changing heart rate.
  5. At the end, photograph the watch and the reference together, with the time visible, and screenshot both app summaries.
  6. Work out the result: distance error % = (watch distance − reference distance) ÷ reference distance × 100. Note the heart-rate gap during the steady part and after each effort.
  7. Repeat after every firmware or settings change, in the same conditions where you can, and log the result in the same row each time.

Tree cover, tall buildings and tunnels change GPS results, so repeat on an open route before you blame the watch. A second watch is a comparison, not a reference: if the two disagree, you know one is off but not which.

Conditions to record every time

A fault you can't reproduce is just a story. Log the same details every time so engineers can line your problem up against everyone else's.

RecordWhy it matters
Date, time and time zoneEngineers can match your report to the watch's own logs and your account, if the manufacturer collects them. Note it again after travel across time zones.
WearWhich wrist, the strap type and how tight it is. Fit changes optical heart-rate readings a lot, and so do cold and sweat.
ActivityThe type of activity, how long, how hard and the route. Use the same activity and route where you can.
Weather and surroundingsTemperature, rain, open sky or tree cover, and buildings nearby. All of them affect GPS and heart-rate results.
Reference devicesWhat you compared against (a chest strap model, a measured route, a second GPS device) and how it was set up.
Watch settingsAlways-on display, GPS mode, heart-rate sampling, notifications, power saving and any custom settings. Battery percentage at the start and end of each check.
PhonePhone model and operating system, Bluetooth on or off, and background permissions for the watch's app. Many sync problems are phone settings.
SoftwareWatch firmware and app version. Note them again after every update.

BetaSuite adds the date and time to every photo and video for you, and can add GPS, live weather, the season and the time zone, each of which you can turn on or off in Settings.

A first-week routine

Adjust this to your brief. The point is to do the same checks in the same order, so a change in the result means something changed in the watch.

WhenFocus
Day 1Charge, pair and set up the watch. Note the firmware, the settings and the battery level. Photograph it on your wrist. Take a first walk to check GPS lock time and the basics.
Days 2–3Run the accuracy test on your measured route, with a chest strap if you have one. Check workout start, pause and stop. Count 100 steps by hand once.
Days 4–5Test notifications with the phone locked and unlocked. Check sync after each workout, and after a Bluetooth drop (walk away from the phone and come back).
Days 6–7Wear it overnight to see sleep tracking and the overnight battery drop. Log the result each morning.
One full battery cycleRun the battery down on your normal settings, noting the percentage at fixed times and what you did, then compare the result with the maker's claim.
After any updateRepeat the accuracy test, the sync check and the notification check.

A pass/fail checklist for a wearable

Agree your thresholds with the manufacturer's brief first. If it doesn't give any, write your own before you start (for example, "distance within 3 percent of the reference") so you aren't judging after the fact.

A fail isn't a verdict on the watch. It's a finding. Write it up with the conditions and a clip.

Health and location data are personal. Before you start, check what the watch and its app store and where they send it. A GPS track can show where you live and work, so crop or leave out the start and end of a route before you share it. If the unit is under NDA, check what you may show.

How to capture evidence engineers can use

What to send the manufacturer

A good report is short at the top, specific in the middle and backed up at the bottom. See how to write a beta test report for the full structure.

SectionWhat goes in it
At a glanceModel and serial number, watch firmware and app versions, phone model and operating system, test dates, the reference devices you used and how you wore the watch. Three sentences on how it went.
Findings, worst firstSafety or skin issues first, then anything that loses or corrupts your data, then annoyances. For each one: what happened, what you expected, how to repeat it, how often it happens and the conditions.
EvidenceTime-stamped photos and clips matched to each finding by name or time, with route start and end points left out if you prefer.
What workedA short list. Engineers also need to know what not to change.
Data filesA CSV or JSON of your findings if they ask, so they can load it into their own tools. BetaSuite reports can ship with both.

Here is the format for one finding. The values are made up, to show the shape.

Title:      Heart rate reads about 20 beats low after each interval
Severity:   Medium (workout data is misleading)
Expected:   Within a few beats of the chest strap
Actual:     The watch lagged and read about 20 below the strap for 30 seconds after each effort
Frequency:  4 of 4 interval sessions
Conditions: Outdoors, 6°C, left wrist, snug strap, firmware 1.8.0
Evidence:   Photo of the watch and strap together stamped 07:42:18, plus both app summaries

Want to see a finished report? Open the sample report (PDF). It has an At a Glance summary, findings sorted by severity and an image appendix.

Running it in BetaSuite

  1. Create a project for the watch, and note the model, serial number and firmware in your first session.
  2. Import the free protocol below.
  3. Start a session each time you test. Capture the photos and clips the steps ask for, and drop a marker whenever something happens.
  4. At the end of the week, generate a PDF or Word report with an At a Glance summary and findings by severity, plus JSON and CSV data files if you want them.

AI summaries are optional and opt-in. For units under NDA, Confidential Mode blocks cloud AI and cloud uploads and warns you before you share or export anything; on a supported iPhone or iPad, on-device Apple Intelligence can still write summaries. Everything is stored on your device, with no account.

Free BetaSuite protocol: smartwatch and tracker test

This is a ready-made, 12-step protocol for the first week or two with a smartwatch or fitness tracker. It was built with the site's own Protocol Builder, so the link below is a real import link. It mixes pass/fail checks with choice, multiple-choice and rating questions, and asks for a photo or dual recording where the evidence matters. It is a comparison for your own testing, not a health or lab test. For the general idea, see the test protocol template.

Smartwatch and tracker test · 12 steps · free to import and edit

Open this protocol

  1. Set-up: pair the watch with the phone and its app. It pairs on the first attempt, shows the right time and profile, and keeps its settings after a restart of the watch and of the phone.Pass / Fail
  2. GPS distance: on a route you have measured, how far from the reference was the watch's recorded distance? Photo: the watch's summary next to the reference.Options: Within 1 percent · 1 to 3 percent · 3 to 5 percent · More than 5 percent offChoicePhoto required
  3. Route shape: the recorded track follows the real path without big jumps, cut corners or drift, including near trees or tall buildings. Screenshot: the track in the watch's app.Pass / Fail
  4. Heart rate at a steady effort, compared with a chest strap: how close were they? Photo: the watch and the strap's display together.Options: Within 3 beats · 4 to 6 beats apart · 7 or more beats apart · No strap to compareChoicePhoto required
  5. Changing effort: during intervals or a hill, the watch's heart rate follows the change without a long lag or odd spikes.Pass / Fail
  6. Sleep tracking: over three nights, how closely did the sleep summary match how you felt? 1 = not at all, 5 = very closely.Rating (1–5)
  7. Notifications: a message and an app alert reach the watch within a few seconds of the phone, without duplicates, and dismissing one on the watch works. Record the phone's screen and the watch together. Test an incoming call separately, with no recording running, and note the result.Pass / FailDual recording required
  8. Sync: after a workout and after a night, the data reaches the phone app by itself, with nothing missing or duplicated, including after the watch drops its Bluetooth connection.Pass / Fail
  9. Battery life on your normal settings, compared with the maker's claim:Options: Met or beat the claim · A little short · Well short · Not measured yetChoice
  10. Water resistance: only within the rating and the conditions the manufacturer states, the watch works normally afterwards, with a clear screen, working buttons and touch, and no moisture under the glass.Pass / Fail
  11. Which problems did you see? Tick all that apply.Options: Slow or failed GPS lock · Heart-rate dropouts or spikes · Late or missed notifications · Sync failed · Disconnected from the phone · Froze or restarted · Skin irritation or discomfort · None of theseMultiple choice
  12. How happy would you be to wear this watch every day? 1 = not at all, 5 = very.Rating (1–5)

Steps marked required show the tester a Start capture button for that photo, video or dual recording, and the capture is attached to the step's result. Answers roll up into the report: pass rates, ratings and every result grouped by question. A step that asks for a screenshot has no capture button: take it with your phone's own buttons, then import it from your photo library afterwards.

Show the raw code

How to import it

  1. On your phone, tap Open this protocol. If BetaSuite is installed, it opens its import sheet with the code filled in. If the link opens in your browser instead, tap Copy code there (or here).
  2. In BetaSuite, open Test protocols, choose Import and paste the code or link.
  3. Edit any step to suit your unit, then run it. Your answers are saved to a session and roll up into the report. Protocols, sessions and reports are part of Advanced mode; if you're in Basic mode, Test protocols offers to switch for you.

Want to change the steps first? Open the link in the free Protocol Builder. It runs in your browser with no account, and you can generate a fresh code from your edits. Running a whole beta programme? See how to give every tester the same protocol and merge the results.

When BetaSuite is the wrong choice

BetaSuite covers everything from a single stamped photo to a full report for the manufacturer. It is the wrong tool only when:

Don't need a report? If the manufacturer takes findings through its own portal or form, or you only want stamped photos and video, switch BetaSuite to Basic mode (Settings > App mode). It keeps every capture tool, including dual recording and Instant Capture, and leaves out projects, sessions and reports, so it works as a plain timestamp camera. Attach the files wherever the manufacturer asks, and switch back to Advanced at any time without losing anything.

If you run the programme rather than test in it, see the programme page. For the longer case for the app, see why BetaSuite. Testing something you ride? See the e-bike testing log and the electric scooter testing log.

Frequently asked questions

What is a smartwatch or fitness tracker beta test?
A pre-release or early-access trial where a manufacturer lets real users wear an unfinished watch, tracker, firmware or app and report faults before general release. The tester's job is to find problems in real use and describe them so engineers can reproduce them.
How can I check a smartwatch's heart rate or GPS accuracy?
Compare it with a reference you trust: a chest strap for heart rate at a steady effort, and a route you have measured for GPS distance. Start both together, keep the conditions the same each time and photograph the watch and the reference together. It is a comparison for your own testing, not a clinical or lab result.
Can I use a beta smartwatch to make health decisions?
No. Beta hardware and software can be wrong, so treat every reading as unverified. This guide is not medical advice. Don't change medication or treatment because of a beta device, and talk to a health professional about any concern.
Can I use BetaSuite for a wearable under NDA?
Yes. Everything is stored on your device with no account. Confidential Mode blocks cloud AI and cloud uploads, and warns you before you share or export anything. Check your NDA first for what you may photograph and what you may send, and by what route.
Is BetaSuite a TestFlight alternative?
No. BetaSuite: Tester's Toolkit is not an app-beta tool and has no connection to TestFlight or Google Play testing tracks. It is for people who beta test physical products in the field and need timestamped evidence and a report for the manufacturer.
Is BetaSuite a subscription?
No. It is a one-time purchase from the App Store or Google Play, with no subscription, no ads and no account. Each store sets the price.

Start testing with timestamped evidence

BetaSuite: Tester's Toolkit burns the date and time into every photo and video, then turns your sessions, markers and findings into a PDF or Word report, on iPhone, iPad and Android. Only need a timestamp camera? Use Basic mode.

One-off purchase · No subscription · No ads · No tracking · Yours for life

No account needed. The price is set in each store.

See everything else BetaSuite does →