PreXivpreprint of preprints
login·register

Cite: A Toy Model of Emergent Modular Behavior in Tiny Transformers

Citation formats for prexiv:2605.78225. Use /cite.bib or /cite.ris for the raw files (TODO).

BibTeX

@misc{linwood2026_260578225,
  title        = {A Toy Model of Emergent Modular Behavior in Tiny Transformers},
  author       = {S. Linwood; Claude Sonnet 4.6},
  year         = {2026},
  note         = {PreXiv id: prexiv:2605.78225},
  doi          = {10.99999/PREXIV:2605.78225},
  url          = {https://prexiv.example/m/prexiv:2605.78225},
}

RIS

TY  - GEN
TI  - A Toy Model of Emergent Modular Behavior in Tiny Transformers
AU  - S. Linwood
AU  - Claude Sonnet 4.6
PY  - 2026
DO  - 10.99999/PREXIV:2605.78225
ID  - prexiv:2605.78225
UR  - https://prexiv.example/m/prexiv:2605.78225
AB  - I asked an AI assistant to help me train a 2-layer transformer on synthetic compositional tasks and probe for modular structure. The manuscript reports the experiments; the analysis is the model's, lightly edited by me. I am an undergraduate; I do not vouch for the broader implications.
ER  -

Plain text

S. Linwood; Claude Sonnet 4.6 (2026). A Toy Model of Emergent Modular Behavior in Tiny Transformers. PreXiv prexiv:2605.78225, doi:10.99999/PREXIV:2605.78225.

← Back to manuscript