Player tracking
cliply detects every player in a clip and follows them: place a marker and it stays with the player as the clip plays.
On this page
Player tracking detects every person in a clip and follows them through the play. You put a marker on a player and the marker follows that player as the clip plays. You can then save it as a drawing, and it replays, exports and appears in share links like any telestration.
The computing happens on your own computer, inside cliply Sidecar. Nothing is uploaded for tracking: the video and its frames never leave your machine, and the models run locally. The only thing that syncs is a drawing you choose to save.
Before you start
- A Mac with Apple Silicon, with cliply Sidecar (recommended). On other machines the panel says Tracking needs an Apple Silicon Mac. If you don't have Sidecar, see Without cliply Sidecar: in the browser.
- cliply Sidecar installed and this browser paired with it. Install and pairing are explained in Time-shift. Without it, the tracking button appears only if tracking in the browser is on for your organization.
- A video it can read. Either a file Sidecar plays from your disk (attached with the workspace Source menu, see Upload videos) or the cloud copy of an uploaded video. YouTube and Vimeo don't work: their players don't expose the pixels. When the current source can't be tracked, the panel says Open the video from your disk through cliply Sidecar, or use the cloud copy.
- The models, once. The first time, the panel offers Download models · 37 MB. Sidecar downloads them and checks them against cliply's published checksums.
Without cliply Sidecar: in the browser
If you don't have Sidecar, tracking can also run inside the browser tab. It's included in every paid plan — not the free one — and uses no credits, since it runs on your own computer. This option may not be turned on for your organization yet — write to hi@cliply.video.
- You choose. With Sidecar paired, the tracking bar shows Browser and Sidecar before a clip is tracked: pick one and cliply remembers it. Browser is the default. Sidecar is faster and handles whole matches, but it only reads files it opens itself or the cloud copy — not a file the browser opened.
- What you need. A browser with WebGPU: Chrome or Edge on a recent computer (Apple Silicon Macs work well). Without WebGPU the tracking button doesn't appear. If something prevents it, the bar says Tracking in the browser needs WebGPU — use Chrome or Edge, or cliply Sidecar.
- Source. Only a video file on this computer, attached to the video from the workspace Source menu (see Upload videos). YouTube, Vimeo and the cloud copy don't work. Without the file, the bar says Attach this video's file from this computer to track it.
- The models, once. The first time, tap Download models · 37 MB: they download into the browser (about 39 MB in total), are checked against cliply's published checksums, and stay for later sessions.
- Speed. A 30-second clip takes roughly 1 minute on a recent Mac, about half the speed of Sidecar. Whole matches are for Sidecar. Keep the tab open while it runs: closing it stops the job.
- Everything else is the same. Markers, styles, teams, the ⇄ correction and Save as drawing work as usual. Markers and tracking results stay in this browser until you save them as a drawing; signing out of cliply deletes them from the browser (the downloaded models stay).
- Privacy. In this mode the video doesn't leave your computer either.
Track a clip
- In Analyze mode, select a clip.
- Tap the crosshair button, Player tracking, in the drawing group of the player controls, next to the sparkles button for AI tools. It's disabled until you pick a clip.
- Tap Track players.
The status shows Tracking with progress and ends at Tracked (or Tracked · nobody detected). The whole clip is tracked: a 30-second clip takes roughly half a minute to a minute on a recent Mac. Keep Sidecar open while it runs; you can keep working in the tab.
Place markers
Once the clip is tracked, pause the video. As in any telestrator, pick the Effect on the bar first, then who: click the players you want to mark, or press Mark everyone and every player on screen gets a marker, numbered in order. If the video isn't paused, the bar says Pause the video to select a player. Mark everyone follows the team filter, so with Team 1 selected it marks only that team.
Clicking a marker opens its panel next to the player: number, color, effect, ⇄ to reassign it, ✋ to place it by hand and the trash can to delete it.
- Effect: Ground ellipse, Overhead triangle, Box marker or Spotlight (follows the player). With no marker selected, changing it on the bar changes every marker; with one selected, only that one.
- Teams: filter markers with Both teams, Team 1, Team 2 or Hide all markers. Teams come from kit colors.
- Kits: if cliply mixes up the teams or counts a referee as a player, open Teams and, under Kits, click the eyedropper next to Team 1, Team 2 or Referees, then click a player wearing that kit. From then on the teams split around those colors, and anyone dressed like the referee loses their box, cannot be picked and is left out of Mark players in AI tools (a marker you already put on them stays). The colors are saved on the video, so they hold for the whole staff on any computer. The × forgets a color.
- ⋯ (More tracking options): Show all detections, Include the movement trail, Auto-track new clips in the background, Re-track and Clear all markers.
Correct a marker
If a marker jumped to the wrong player, select it and press ⇄ (Reassign this marker to another player). Then click the right player: the marker follows them from that moment on, and the past stays as it was. If the right player was wearing another marker, the two trade places: that is what happens when two players cross and the tracking swaps them, and one click fixes both.
If the marker loses its player (someone blocked them, or tracking stopped seeing them), its panel shows Lost at 00:12.4. Press it to jump there. From that moment you have two options:
- Reassign (⇄) once the player is detected again. When the two pieces can't be two different players (they don't overlap in time), tracking joins them into one, so every marker on that player follows the fix too.
- Place by hand (✋, Place this marker by hand) when nobody detects them: click where the player is, step a few frames ahead and click again. The marker moves point to point and stays on the last one until you reassign it. Placing stays on between clicks; Escape turns it off.
When the playhead is outside the tracked part, the panel says Outside the tracked range. If you changed the clip's in or out after tracking, you'll see The clip changed since it was tracked — re-track (⟳) to cover all of it. Re-track (in ⋯, or ⟳ on the bar when the clip changed) asks for confirmation and deletes that clip's tracking and markers.
Save as a drawing
On the web, markers live in this browser until you tap Save on the bar. To show the movement, turn on Include the movement trail in ⋯: once saved, the dashed path is drawn under the markers for as long as they follow their players. Until you save, Save shows a dot.
Once saved, it's a normal drawing: it syncs, replays, exports and travels in share links. To edit or delete it, see Drawing & telestration.
Distance and speed
With the pitch calibrated with the measure ruler, each tracked player adds up their metres run and top speed on the clip, with no GPS: you see them in the clip panel under Distance and speed, and while the video plays the current speed shows under the marker.
- Feet markers only. The player marker and the box are measured; the overhead triangle (it marks the head) and the spotlight (the body's centre) don't sit on the grass and aren't measured.
- Fixed camera. The calibration holds for the framing you made it on. If tracking sees the camera move (a pan or a tilt) during the clip, the panel warns you: the numbers still show, but read them as rough. A zoom isn't detected.
- Precision. The calibration's error (the panel shows it in metres) is the floor: on a 10 m sprint, half a metre per point weighs 10 %. Impossible jumps (the tracker swapping players) and gaps are dropped rather than added up.
Effect on AI tools
With Sidecar paired, opening AI tools on a clip asks Sidecar to track it in the background. Once it's tracked, clicking a player gives a more reliable silhouette, because it uses the tracker's box. And Mark players reads the tracker's team colors instead of guessing from a single frame.
If something doesn't work
- The button is missing. The browser isn't paired or Sidecar isn't running. Open Sidecar and tap Retry; the steps are in Time-shift.
- Tracking needs an Apple Silicon Mac. This feature doesn't run on other machines.
- Open the video from your disk through cliply Sidecar, or use the cloud copy. The current source can't be read; change it from the Source menu.
- Sidecar can't read this file because the browser opened it. Pick Browser on the bar, or in the LOCAL menu tap Detach and add it again with With Sidecar…, so Sidecar opens it from your disk.
- Tracking found no players — retrack (⟳) over the full clip. Track again without trimming the clip.
- Couldn't read the video in this range — check the file and try again. Happens in browser mode; check that the attached file opens fine.
- Tracking models missing — download them and try again. Tap Download models · 37 MB.
- This browser can't run tracking — use Chrome or Edge, or cliply Sidecar.
Related
Rather talk to a person?
If the guide isn't enough, message us on WhatsApp or by email. Someone on the team answers, no bots.


