-
Notifications
You must be signed in to change notification settings - Fork 58
Description
I am currently using the LLMCompass framework to benchmark GPT-3 on an AMD MI300X GPU as part of my MS studies at Santa Clara University. While filling out the hardware description template, I encountered difficulties finding values for several fields, including:
• num_rdwr_ports
• mac_per_cycle
• pin_count_per_channel
• flit_size_byte
• (and other detailed parameters)
I have consulted the AMD MI300 instruction set documentation and datasheets, but these fields are not explicitly mentioned. When I attempt to run the software using available values, I receive an error related to missing systolic array fields.
Request for Assistance:
• Could you clarify where the MI210 hardware description values were sourced from?
• If certain values were estimated or assumed, could you provide guidance on how to derive or approximate them for MI300X?
This information is crucial for completing my benchmarking task, and I would greatly appreciate any insights or assistance.