Also, apply Liquid Wrench or other penetrating oil first and let it soak in good before drifting. Just yesterday I was having trouble drifting the front sight on an ancient Springfield. Liquid Wrench made all the difference.

Bolt side? Left to right or right to left? Whew.
Let's say we hold the rifle as one would while shooting it, muzzle pointed away, person at the butt end looking down the barrel toward the muzzle.
Now with this frame of reference which way to remove?

Left to right.

Just to be clear, bolt-side is right, other side left. On Pre 64 model 70s, to remove the blank you will tapping out from the left or the non-bolt side. So you will be tapping towards the bolt side to remove or left to right. Go right to left to insert. I'm not sure if we are getting our lefts and rights mixed up here or not??? A little Kroil is sometimes a good idea to get started. Most tap out fairly easily but some can be really stubborn. Good idea to remove the stock, take your time, and only use a Brass punch. The brass marks cleanup with a little solvent and if you need a little bigger hammer, that's ok too.