Skip to content

[WiP] Add buf_init_callbacks for dist inference = auto generate rope embeddings after meta/fake tracing#32439

Open
lessw2020 wants to merge 2 commits intohuggingface:mainfrom
lessw2020:mistral_rope_init
Open

[WiP] Add buf_init_callbacks for dist inference = auto generate rope embeddings after meta/fake tracing#32439
lessw2020 wants to merge 2 commits intohuggingface:mainfrom
lessw2020:mistral_rope_init

Commits

Commits on Aug 6, 2024