How to set up smdm after removal of rotary/xentropy kernels in FlashAttention

[seohyeonShin]

Hi,

I noticed that FlashAttention recently removed old kernels such as rotary and xentropy (see commits like f288... and c4be...).

However, the smdm.md setup guide still instructs users to enter those directories and install them manually. This creates confusion because those folders no longer exist in the latest repository.

My question is:

Should we ignore those installation steps and just rely on the standard pip install . process for FlashAttention?

Or should we pin FlashAttention to an older commit (before the removal) to keep smdm compatible?

I’d appreciate clarification on the intended setup process under the new structure.

[jiangnanhugo]

You may use this: https://github.com/Dao-AILab/flash-attention/tree/v2.8.2/csrc/rotary

[giladturok]

To use the correct version of flash attention, you need to modify how we download it from Github. In CONDA.MD, You need to replace:
git clone https://github.com/Dao-AILab/flash-attention
with the version that specifies the release tag v2.8.2:
git clone --branch v2.8.2 https://github.com/Dao-AILab/flash-attention

[giladturok]

Has anyone successfully gotten the environment to work? I'm having a lot of trouble.