Fly Brain Hub日本語

Demos & Games

flybrain-eyegaze-tracking

Rick Gorman (@rickgorman)

A webcam gaze tracker feeds a MaleCNS simulation. Browser-side MediaPipe turns iris positions and head pose into a screen point, and only the normalized direction from the on-screen fly to that point leaves the page. That drives LC4 and LPLC2 on each side, 80 ms of a 162,517-neuron, 6,138,378-connection leaky integrate-and-fire run, and a linear readout of 1,310 descending neurons' membrane voltage becomes a velocity. Only the readout is trained and the wiring stays fixed. The README states plainly that the connectome does not make gaze tracking more accurate.

Official site ↗

flybrain-eyegaze-tracking

#gaze-tracking#webcam#mediapipe#lc4#lplc2#descending-neurons#malecns

Sources checked

Every fact above was read from these pages on the date the entry was added.