If they are working their way out, install the new pins then take a centre punch (automatic or old school) and place two small marks on close to either side of the pin to stake the pin into place. The surrounding metal of the arm should mush over slightly to hold the pin. You could also run some thin lockwire through the centre of the pin and wrap it around the arm to hold the pin in place.
