Inference on CPU

[abhigoku10]

@soeaver @zhirihuixin thanks for sharing the code base , can we run the inference on cpu ? what all changes have to be made for the model to run on cpu

Thanks in advance