Why won the lights turn off when the relay has opened?
If the relay appears to switch and the status LED goes ON and OFF, possibly the line and load circuit wires were stripped back too far and pushed into the relay at an angle causing a connection between the two wires. The contacts could also be welded due to a short circuit on the line at power-up.