No, you won't do any harm by using the bike with the wire(s) off of the neutral switch .
But now, you are dependent on the switch at the clutch lever to work properly, if it fails (I've had two fail so far), you won't be able to operate the starter .