Unfortunately, that is not a set screw, it is a oil wick. From what I can tell the magnet and shaft were inserted into the frame, and then after the brass washer was added at the bottom, the end of the shaft was peened out to hold everything in place. So, I don't think it is easily repaired...