Are there any negatives to walking with hand weights?

Agreed, potentially unneeded wear & tear on your shoulders & rotator cuff muscles. Spend a couple extra minutes in the gym & lift to strengthen your shoulders. If you want your walking workouts to be more challenging find some hills or sand.