[acl 2021] On The Distribution, Sparsity, And Inference-time Quantization Of Attention
Synopsis
This short talk describes our ACL 2021 Findings paper on transformer attention. Paper is here: https://arxiv.org/abs/2106.01335 ...
You Might Also Like
![Modeling the Unigram Distribution [ACL 2021]](https://i.ytimg.com/vi/xhzWoWyytvg/hqdefault.jpg?sqp=-oaymwE2COADEI4CSFXyq4qpAygIARUAAIhCGAFwAcABBvABAfgB_gmAAtAFigIMCAAQARhlIGUoZTAP&rs=AOn4CLAsJ39xngDF_3myGvZhVweMET3kew)
![[ACL 2021] IrEne: Interpretable Energy Prediction for Transformers](https://i.ytimg.com/vi/Rg7zF81xDgw/hq720.jpg?sqp=-oaymwE2CNAFEJQDSFXyq4qpAygIARUAAIhCGAFwAcABBvABAfgB1AaAAuADigIMCAAQARhlIGUoZTAP&rs=AOn4CLA5t0mmlKluC0q5tVeLixsyr1RdFA)
![[ACL 2021] TellMeWhy: A Dataset for Answering Why-Questions in Narratives](https://i.ytimg.com/vi/vl5KnITgx34/hqdefault.jpg?sqp=-oaymwE2COADEI4CSFXyq4qpAygIARUAAIhCGAFwAcABBvABAfgBgA2AAvIHigIMCAAQARgyIEsofzAP&rs=AOn4CLDfbnVGSeK25tb2d_cJ6_0_eyy6rA)
![[REFAI Seminar 04/20/23] Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time](https://i.ytimg.com/vi/0g351WQTaf8/hq720.jpg?sqp=-oaymwEcCNAFEJQDSFXyq4qpAw4IARUAAIhCGAFwAcABBg==&rs=AOn4CLDEqZltD_QH2EaE5u2wIsvkG9ra0Q)
Download Options
Choose a download method below. All links open in new tabs.
| Service | Features | Action |
|---|---|---|
| SaveFrom |
MP4 & MP3 • HD Quality • Browser Extension Available
|
Download |
Security Notice: These are third-party services. We recommend using antivirus software and being cautious of pop-up ads.