Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
-
Updated
Jun 7, 2024 - TypeScript
#
flash-attention-2
Here are 14 public repositories matching this topic...
Triton implementation of FlashAttention2 that adds Custom Masks.
deep-learning triton attention cuda-kernels attention-mechanism triton-lang flash-attention flash-attention-2
-
Updated
Aug 14, 2024 - Python
Uses the powerful WhisperS2T and Ctranslate2 libraries to batch transcribe multiple files
audio-recorder audio-recording transcription audio-transcribing transcriber audio-transcription transcr ctranslate2 flash-attention-2 whispers2t
-
Updated
Mar 13, 2025 - Python
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
gpu cuda inference nvidia cutlass mha multi-head-attention llm tensor-core large-language-model flash-attention flash-attention-2
-
Updated
Feb 27, 2025 - C++
A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).
-
Updated
Mar 4, 2025 - Python
A cutlass cute implementation of headdim-64 flashattentionv2 TensorRT plugin for LightGlue. Run on Jetson Orin NX 8GB with TensorRT 8.5.2.
cuda transformer cutlass cute tensorrt feature-matching multihead-attention superpoint lightglue flash-attention flash-attention-2
-
Updated
Mar 3, 2025 - Cuda
Vulkan & GLSL implementation of FlashAttention-2
vulkan glsl artificial-intelligence gpu-acceleration attention gpu-computing deel-learning tensor-cores large-language-models llm flash-attention flash-attention-2
-
Updated
Jan 19, 2025 - C++
FlashAttention-2 in Triton for sliding window attention (fwd + bwd pass)
-
Updated
Mar 6, 2025 - Python
Poplar implementation of FlashAttention for IPU
-
Updated
Mar 12, 2024 - C++
Toy Flash Attention implementation in torch
-
Updated
Sep 22, 2024 - Python
Systematically train and benchmark Mistral, Qwen2.5, and SmolLM2 on essay grading across 39 experiments through data analysis and engineering, structured preprocessing, instruction tuning, postprocessing, and leakage aware evaluation for robust score and rationale generation
modeling evaluation transformers data-engineering data-analysis lora preprocessing postprocessing automatic-essay-scoring instruction-tuning supervised-finetuning flash-attention-2 mistral-7b unsloth qwen2-5 smollm2
-
Updated
May 31, 2025 - Jupyter Notebook
Coding Flash Attention from scratch using triton
-
Updated
Mar 30, 2025 - Python
Transcribe audio in minutes with OpenAI's WhisperV3 and Flash Attention v2 + Transformers without relying on third-party providers and APIs. Host it yourself or try it out.
python modal transformers transcription wavesurfer-js nvidia-cuda bun nvidia-gpu virtual-environment fastapi huggingface-transformers flash-attention-2 next14 whisper- whisperv3
-
Updated
Jun 18, 2024 - TypeScript
Vulkan & GLSL implementation of FlashAttention-2
vulkan glsl artificial-intelligence gpu-acceleration attention gpu-computing deel-learning tensor-cores large-language-models llm flash-attention flash-attention-2
-
Updated
Jun 11, 2025
Improve this page
Add a description, image, and links to the flash-attention-2 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the flash-attention-2 topic, visit your repo's landing page and select "manage topics."