Skip to content

Conversation

@BradLarson
Copy link
Contributor

The tests for steps 5+ place the test tensors on the CPU, but on GPU-enabled systems the graph is by default placed on the GPU. This causes a mismatch on compilation, leading to these tests failing with cryptic errors on systems with NVIDIA or AMD GPUs.

Additionally, once the graph is run on the GPU, the default datatype is bfloat16 but that datatype isn't supported in NumPy. When results are read back into the NumPy array, these reads fail without an appropriate cast to float32 values.

This fixes these tests for steps 5, 6, 7, 9, 10, and 11 and enables them to run on GPU-equipped machines. Steps 8 and 12 have additional issues to fix, even when this casting is handled. They will be fixed later.

Fixes issue #12

@dunnoconnor dunnoconnor self-assigned this Jan 5, 2026
@dunnoconnor dunnoconnor merged commit e2657a7 into modular:main Jan 5, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants