No, this will not assure your child’s safety. Your child is already safe with you.
Now, that may sound scary, especially in light of recent stories in the news of women drowning their children, but recognize that the media often publicizes the most gory and shocking stories it can find (as the saying goes, “if it bleeds, it leads”).
Although these cases do happen now and then, they are so rare that the chances of them happening to you and your child are amazingly slim. You have a better chance of dying in a car accident while driving your child to the doctor than you do of drowning your child.
Further, these women meet criteria for diagnoses other than OCD, they often talk about hearing voices telling them to sacrifice their children, which is more akin to the diagnosis of major depressive disorder with psychotic features than it is to OCD.
That being said, the more that you ignore bathing your child, the more likely you will fear it, convincing yourself that the only reason your child is safe is because your husband does the bathing. If you really want to get help with this, it may be best to talk to a therapist about your fears.
A therapist can help normalize your concerns (many women, especially new mothers, have thoughts about harming their children, it is not uncommon at all) and start you on an exposure therapy protocol for bathing your child. Your therapist may have you do some bathing with a sponge first, working up to a small bucket of water, and then moving to the sink or the bathtub.
They may also have your husband stay with you at first for initial reassurance, having him slowly decrease the amount of time he is supervising you with your baby. Finally, you will be able to be alone with your child around water and recognize that just because you have thoughts about harming your child does not mean that you actually will harm your child.
A recent area of research for OCD is postpartum OCD. Remember, it was mentioned earlier that having a child can be a stressor that can be an OCD trigger. This new area of study will hopefully lead to some fruitful ideas for treatment of people who find themselves with OCD symptoms after the birth of a child.