If you do not allow transports reload and make a change that affects the transports (like IP address / NAT change) then you would have to restart asterisk (fwconsole restart) after applying the configuration.
If you do allow transport reload then the change would go into effect with the Apply button without having to restart. Some people have reported instability with this configuration. See Allow Transport Reload