Transformer
AITransformer: A neural network architecture that uses attention to weigh the relationships between all tokens in a sequence, underpinning most modern language models.
Used in these stories
- Meta opens Muse Glimmer under Apache 2.0, dropping the Llama licence rules
- Microsoft built a hacking model that cannot hack: inside MAI-Cyber-1-Flash
- Gemini 3.5 Pro delay leaves Google chasing a moving field
- Anthropic interpretability research finds a global workspace inside Claude
- DeepMind talent exodus costs Alphabet its star researchers