Skip to content

Investigate failure when running metal delegated whisper sampler (argmax) #16984

@manuelcandales

Description

@manuelcandales

🐛 Describe the bug

Error reported in huggingface/optimum-executorch#208:

E 00:00:13.059103 executorch:et_metal.mm:246] ETMetalShaderLibrary: Failed to compile shader library: program_source:3813:29: error: assigning to 'bfloat' from incompatible type 'float'
tmp_acc_2 = tmp0;
^~~~

E 00:00:13.059124 executorch:et_metal.mm:263] ETMetalShaderLibrary: Library not compiled
E 00:00:13.059126 executorch:et_metal.mm:301] ETMetalShaderLibrary::getKernelFunction: Failed to get pipeline state for 'generated_kernel'
E 00:00:13.059127 executorch:shim_mps.mm:105] aoti_torch_mps_get_kernel_function: Failed to get kernel function 'generated_kernel'
E 00:00:13.059129 executorch:shim_mps.mm:517] aoti_torch_mps_run_command_block: null function handle

This PR disabled the sampler export code path to let runner fallback to C++ CPU sampler.

Versions

main

Metadata

Metadata

Labels

module: metalIssues related to the AOTI Metal backendtriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

Status

To triage

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions