Joshua Ainslie
Researcher / author (OpenAlex)
Facts
1 property
🔗 Connections
Author of 7
ETC: Encoding Long and Structured Inputs in Transformers,
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference,
FNet: Mixing Tokens with Fourier Transforms,
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints,
LongT5: Efficient Text-To-Text Transformer for Long Sequences,
Making Transformers Solve Compositional Tasks,
RealFormer: Transformer Likes Residual Attention
← Authored by 7
ETC: Encoding Long and Structured Inputs in Transformers,
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference,
FNet: Mixing Tokens with Fourier Transforms,
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints,
LongT5: Efficient Text-To-Text Transformer for Long Sequences,
Making Transformers Solve Compositional Tasks,
RealFormer: Transformer Likes Residual Attention
Affiliated with 1
Press Enter · cited answer in seconds
0 sources
Summary
Joshua Ainslie is a human[1].