IMHO this is pointless to remove.  There's no resource leakage resulting from not removing the forwarding handle from the config listener list.  Just drop the field and don't worry about deregistering.