Investigate why this happens. It may very well be that the bug is in the original InfiniTAM code, but it also might be that the DepthIntegrationEngine doesn't integrate color properly (refer to legacy SceneReconstructionEngine for fix if that is the case).