ETA for Flash Attention 2.0 Support in ChatGLMForConditionalGeneration

#46

by frank098 - opened Jun 17, 2024

Jun 17, 2024

I am currently using the glm-4-9b-chat model and would like to know if there is an estimated timeline for when Flash Attention 2.0 support might be added.

zRzRzRzRzRzRzR

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org Jun 25, 2024

support it now

zRzRzRzRzRzRzR changed discussion status to closed Jul 10, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment