Report non-embedding FLOPs #25
Description
It would be better to report both total flops and non embedding flops.
Leave out both the lm_head and the initial nn.Embedding
{{ message }}
It would be better to report both total flops and non embedding flops.
Leave out both the lm_head and the initial nn.Embedding