Watch Your Six detects people around an LED totem installation and turns what they do into events for the visuals.
Every camera feed, a USB camera or a video file, goes through a YOLO11 pose model. People are tracked across frames, and the program estimates how close each one is to the camera.
A per-person state machine turns noisy detections into stable events:
- enter and exit, when someone crosses a calibrated boundary line. A separate dead-zone line on the way out stops people standing on the line from flickering in and out;
- proximity of the closest person;
- arms raised, read from the pose keypoints, with a cooldown per camera;
- counts per camera and in total.
The events go as OSC messages to Resolume, which drives the LED visuals.
A FastAPI web interface shows the live camera streams and an event log. You add and calibrate cameras there by dragging the boundary and dead-zone lines on the preview. It has a phone layout and finds the server on the network with mDNS. The 93 tests run on synthetic data, without cameras. Production runs on Windows with CUDA.