newborn baby

Is it okay to have a neutered boar in the same cage with a sow and her 3 week old baby girl? (and another sow who’s their other daughter). I’ve seen that the males shouldn’t be with the babies when the mom is around at first or at all, is that still true if he’s neutered? I had him in the cage...