Explanation: Illness, a dirty litter box, too few boxes, litter or location preferences, arthritis, stress, painful elimination -- there are lots of reasons your cat may start going outside the box. Because advanced age, illnesses like kidney stones, urinary tract infections, or cystitis, or pain from arthritis or trauma can trigger inappropriate elimination, always talk to your vet about litter box issues. And never punish your cat for going outside the box. It can make the situation worse, causing your cat to associate the box with punishment.