Efficient Transformer: A Compilation and Tuning Guide for Block-Sparse Attention
2:56
Efficient Transformer: A Compilation and Tuning Guide for …
5 views4 months ago
YouTube
We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence — whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30x longer than possible previously. Read more: https://openai.com/blog/sparse-transformer/ | OpenAI
0:27
We’ve developed the Sparse Transformer, a deep neural networ…
7.9K viewsApr 23, 2019
FacebookOpenAI
Giannis Daras: Improving sparse transformer models for efficient self-attention (spaCy IRL 2019)
20:14
Giannis Daras: Improving sparse transformer models for efficient s…
3.2K viewsJul 12, 2019
YouTubeExplosion
13x FASTER Video Generation - Sparse Linear Attention Diffusion Transformer
10:25
13x FASTER Video Generation - Sparse Linear Attention Diffusion …
907 views5 months ago
YouTubeVuk Rosić
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs
10:12
The Sparse Frontier: Sparse Attention Trade-offs in Transform…
96 views10 months ago
YouTubeKeyur
Longformer: The Long-Document Transformer
26:36
Longformer: The Long-Document Transformer
26.2K viewsApr 20, 2020
YouTubeYannic Kilcher
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs (Apr 2025)
20:56
The Sparse Frontier: Sparse Attention Trade-offs in Transform…
69 views9 months ago
YouTubeAI Paper Slop
Video Sparse Transformer With Attention-Guided Memory for Vide…
Aug 5, 2022
ieee.org
9:47
DynaST: Dynamic Sparse Transformer for Exemplar-Guided …
195 viewsOct 11, 2023
bilibilihave-done
1:14
Sparse Attention: The AI Secret Behind Smarter, Faster Models #S…
2 views2 months ago
YouTubeCollapsedLatents
Depth-Aware Sparse Transformer for Video-Language Learning | Pro…
Oct 27, 2023
acm.org
1:15:42
Evolution of the Transformer architecture 2017–2025 | Compari…
421 views10 months ago
YouTube3CodeCamp
7:31
Soft Mixture of Experts - An Efficient Sparse Transformer
5.6K viewsAug 4, 2023
YouTubeAI Papers Academy
4:16
FASA: Sparse Attention for Efficient LLM KV Cache
33 views1 month ago
YouTubeAI Research Roundup
34:30
Big Bird: Transformers for Longer Sequences (Paper Explained)
25.7K viewsAug 2, 2020
YouTubeYannic Kilcher
36:05
[Transformer Survey] #2 Sparse Attention
4.1K viewsAug 4, 2021
YouTube서울대학교 산업공학과 DSBA 연구실
53:01
Graph Transformer explained with paper implementation from scratch
2.2K viewsMay 18, 2024
YouTubeTai Do
0:25
MonarchRT: Faster Video Attention with Monarch Matrices + Triton Ke…
6 views3 weeks ago
YouTubeABV — AI · Books · Validation
12:08
Sparse Identification of Nonlinear Dynamics for Model Predictive Co…
29.9K viewsJun 11, 2018
YouTubeSteve Brunton
4:25
IndexCache: Faster Sparse Attention for LLMs
1 week ago
YouTubeAI Research Roundup
Video Semantic Segmentation via Sparse Temporal Transformer | Pr…
Oct 17, 2021
acm.org
1:02
This AI Breakthrough Changes Everything (Sparse Gated Attentio…
2 views1 month ago
YouTubeCollapsedLatents
17:51
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstr…
71 viewsNov 6, 2023
bilibilihave-done
57:07
Sparse is Enough in Scaling Transformers (aka Terraformer) | …
24.2K viewsDec 2, 2021
YouTubeYannic Kilcher
4:00
InfLLM-V2: Switchable Attention for Long LLMs
44 views5 months ago
YouTubeAI Research Roundup
10:47
Accelerating Sparse MoE Transformer Layer on FPGA usin…
42 views3 months ago
YouTubeZhiru Zhang
0:43
Dense vs Sparse Transformers: A Practical Accuracy and Efficiency …
51 views3 months ago
YouTubeNextGen Play
3:29
What are Sparse Transformers?
1K viewsDec 24, 2023
YouTubeWhat Is It
5:55
TIP: Real-time Human Motion Reconstruction from Sparse IMUs …
1.8K viewsSep 22, 2022
YouTubeYifeng Jiang
HTViT: an efficient CNN-Transformer hybrid model with high throughput
Dec 3, 2024
spiedigitallibrary.org
See more videos
Static thumbnail place holder