It seems that the channels in branch_main and branch_proj should be out_channel // 2, but you use the inp here. https://github.com/ouyanghuiyu/Thundernet_Pytorch/blob/master/lib/model/faster_rcnn/modules.py#L289