FASA: FREQUENCY-AWARE SPARSE ATTENTION

 

Yifei Wang¹, Yueqi Wang², Zhenrui Yue³, Huimin Zeng³,
Yong Wang^1†, Ismini Lourentzou³ Zhengzhong Tu⁴ Xiangxiang Chu¹ Julian McAuley²

¹AMAP, Alibaba Group,    ²University of California San Diego
³University of Illinois Urbana-Champaign ⁴Texas A&M University
^†Project leads and corresponding authors.

🔥 News

• 🔥 [2026.01]: 🎉🎉🎉 Congratulations! Our paper is accepted by ICLR 2026.

✍️ Citation

If you find this codebase useful in your research, please consider giving us a star ⭐ and citing our work 📝:

@inproceedings{
  wang2026fasa,
  title={{FASA}: {FREQUENCY}-{AWARE} {SPARSE} {ATTENTION}},
  author={Yifei Wang and Yueqi Wang and Zhenrui Yue and Huimin Zeng and Yong Wang and Ismini Lourentzou and Zhengzhong Tu and Xiangxiang Chu and Julian McAuley},
  booktitle={The Fourteenth International Conference on Learning Representations},
  year={2026},
  url={https://openreview.net/forum?id=FnSgecCEwg}
  }