ReproFly-AI

A blinded, tool-mediated benchmark that asks whether an autonomous-scientist agent can find targets in the male Drosophila CNS connectome through an oracle it cannot see past; the agent evaluated here was GLM-5.3. The release ships the benchmark, blinding and scoring library, frozen paper-level results, figure sources and four offline reproduction scripts that make no model API calls. It is explicit about what is withheld: the private-state test suite and member-level ground truth stay controlled, and the supplementary wrappers are not a complete independently runnable reconstruction.

Official site ↗

#malecns#benchmark#llm-agent#blinded#reproducibility