Loving on cats is fine. Toxoplasmosis is the worry with cat boxes. Not every cat is spreading it in their feces. Having read up on the likelihood of it in our cats (all indoors, we'd owned them for several years and knew they hadn't eaten rabbits, rodents, etc and they don't go outside, and so on) I was not worried. If my husband was home, he'd do the boxes, but if he was on a work trip, I'd do them. At work I wore gloves when cleaning cat boxes.