rabbitmq-streams delete_replica fails when the node of the replica to be deleted is down. #9282
Description
Describe the bug
rabbit-3 is down in this case:
Removing a replica of queue s1 on node rabbit-3@nkarlVMD6R... Error: node_not_running Reproduction steps
- create stream in a cluster
- stop a rabbit node
- try to delete the stream replica on that node
...
Expected behavior
The replica should be deleted irrespective of node status. I.e. even if the node isn't in rabbit cluster anymore.
Additional context
The stream coordinator would keep trying even if the command was let through, we also would need to report success back if the target node is no longer in the rabbit cluster.
https://groups.google.com/g/rabbitmq-users/c/62eUMwZHvOM/m/dnVou9pLAwAJ