Hello, some posts suggest that lrn layer is not necessary when using batch norm. I found removing lrn layer gives 1-2% performance gain.