mamba encoder

[wincj]

sorry
In your paper，I find you use mamba encoder to get K and V.But i can not find where you use mamba encoder in your code
Could you please tell me
That's good job! Thank you

[Fengxiang23]

main_pretrain.py use the mamba-based model.
''import models_mamba '' in the 23 line of main_pretrain.py.
The different version of Mamba encoder are listed in the models_mamba.py