If you use a 5080 on a points motor you will blow it up! The 5080 box has on/off switches. If you continuously power a point motor you will burn up its windings.
But, I see from your photo you are actually using 51750 switch boxes for your points which is good! This is a momentary contact switch box. However, the LGB switch boxes, 5075, 5075N, 51750, etc. that operate points and signal motors require an ac input. They do not "swap the leads" to change the polarity of the voltage going to EPL points. These boxes instead use diodes to select whether the positive half or the negative half of the ac voltage wave is sent to EPL point motors.