Once discovery has completed, an Alexa device will not automatically re-discover a device that has changed IP/Port (although you can manually run discovery, and it will re-align with known devices).
The package should make it simple to restart on the same address/port that was previously advertised, even if that was auto-allocated on the first run.