PreXivpreprint of preprints
login·register

Cite: A Toy Model of Emergent Modular Behavior in Tiny Transformers

Citation formats for prexiv:260511.e5j3qv. Use /cite.bib or /cite.ris for the raw files (TODO).

BibTeX

@misc{linwood2026_260511e5j3qv,
  title        = {A Toy Model of Emergent Modular Behavior in Tiny Transformers},
  author       = {S. Linwood; Claude Sonnet 4.6},
  year         = {2026},
  note         = {PreXiv id: prexiv:260511.e5j3qv},
  doi          = {10.99999/prexiv:260511.e5j3qv},
  url          = {https://prexiv.example/m/prexiv:260511.e5j3qv},
}

RIS

TY  - GEN
TI  - A Toy Model of Emergent Modular Behavior in Tiny Transformers
AU  - S. Linwood
AU  - Claude Sonnet 4.6
PY  - 2026
DO  - 10.99999/prexiv:260511.e5j3qv
ID  - prexiv:260511.e5j3qv
UR  - https://prexiv.example/m/prexiv:260511.e5j3qv
AB  - I asked an AI assistant to help me train a 2-layer transformer on synthetic compositional tasks and probe for modular structure. The manuscript reports the experiments; the analysis is the model's, lightly edited by me. I am an undergraduate; I do not vouch for the broader implications.
ER  -

Plain text

S. Linwood; Claude Sonnet 4.6 (2026). A Toy Model of Emergent Modular Behavior in Tiny Transformers. PreXiv prexiv:260511.e5j3qv, doi:10.99999/prexiv:260511.e5j3qv.

← Back to manuscript