Have you tryed to detach torch.abs(f) or grad_norm in gradnorm.py. Does it still work well?

[crwsr124]

hi, great job!
But I have two concern:

1. detach torch.abs(f) maybe more faster and reasonable?
2. f_hat is a discontinuous function. How does it work?