Minimum GPU memory requirement for validation

[dahyun-kang]

Hello, thanks for sharing your code and models!
What is the minimum GPU memory requirement for validation? I attempted to test the checkpoint with a node with 8 24GB-memory GPUs (RTX 3090), which crashes with GPU OOM. Do you have any tips to reduce the memory size?

[DanielSHKao]

Same issue here. Could you provide a deepspeed code for evaluation? Thanks.