Support is the key here. A solid surface like a concrete slab, a socket and a two pound mall.
The weight of the moving mall has inertia. A lot of it. With a solid backing all of the hammer momentum will be transferred to the pin through
a 1/8 inch STEEL punch with a flat end, not pointed.
I use a modified punch. Tip cut off to about 1/4" long and ground flat.