fly-cartpole

Two mushroom bodies wired from MaleCNS v1.0, one per push direction, learn to balance CartPole under a dopamine prediction error. They hold the pole for 392.5 steps on average over the last hundred episodes across 20 evaluation seeds, against 18.7 with plasticity off and 22.8 for random pushes. Shuffled wiring scores 390.3, which a permutation test puts at p = 0.48, so the layout rather than the exact synapse map is doing the work. The log of nineteen tested hypotheses is the real document: plasticity that can only weaken synapses exhausts them.

Official site ↗

#cartpole#mushroom-body#dopamine#preregistration#shuffled-control#reinforcement-learning#malecns