Skip to content

Source of AMD MI210 Hardware Description #5

@roychowdhuryrohit-dev

Description

@roychowdhuryrohit-dev

I am currently using the LLMCompass framework to benchmark GPT-3 on an AMD MI300X GPU as part of my MS studies at Santa Clara University. While filling out the hardware description template, I encountered difficulties finding values for several fields, including:
• num_rdwr_ports
• mac_per_cycle
• pin_count_per_channel
• flit_size_byte
• (and other detailed parameters)

I have consulted the AMD MI300 instruction set documentation and datasheets, but these fields are not explicitly mentioned. When I attempt to run the software using available values, I receive an error related to missing systolic array fields.

Request for Assistance:
• Could you clarify where the MI210 hardware description values were sourced from?
• If certain values were estimated or assumed, could you provide guidance on how to derive or approximate them for MI300X?

This information is crucial for completing my benchmarking task, and I would greatly appreciate any insights or assistance.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions