FlyBrain-LLM

A Chinese language model whose forward and output path is the connectome itself: 164,587 neurons and 25,563,096 synapses, with no attention, no positional encoding, no normalisation, no residual stream, no key-value cache and no transformer block, leaving sequence modelling to the recurrence of the wiring. It runs on one desktop with an AMD card. The project refuses to assume the wiring helps and builds in three comparison arms, then reports the negative result plainly: the hybrid model that keeps a transformer reaches lower perplexity than the pure connectome one.

Official site ↗

#language-model#no-attention#rocm#control-arms#chinese#malecns