I'd keep them on. it breaks up the smoothness of the door which without mkaes it look too rounded and weird imo, and they're there for a perfectly good functional reason too.
Though if anyone's got any undamaged, unpainted ones they've removed and are going to throw away, I may be interested in buying some.