Is the power strip also a surge protector? If so, I’d bet that the ground on the outlets on the surge protector are not true ground as you find inside your wall. Thus your grounding probe is lowering the potential, but not all the way.
Also, I’d stop testing this with your hand. Whatever is causing this could be failing equipment. This could start leaking higher voltage levels and will shock you a lot more. Also, if you remove that grounding probe, the voltage differential may increase and give a larger shock. I suggest you start checking with a multi-meter.