Correctly add/remove outgoing connections when reloading configuration.