In some breeds, mostly toys, the puppy teeth really cause problems with the adult teeth start to come in. Many of these puppies, once the teeth start to go, have the remaining deciduous teeth removed. In some breeds, the adult teeth will come in right beside the baby teeth leaving a complete row of double teeth.
If they are removed when they start to loosen naturally, this avoids this problem.