-
Couldn't load subscription status.
- Fork 5.9k
Closed
Description
#7838 implement batch barrier feature, and we also need to implement merging SelectedRows in server site dynamically, just because:
- After the distributed transpiler, a SelectedRows variable block maybe contains an empty Tensor, and we don't need to send the empty Tensor in SendOp.
- For the server site, we can not use an Op to merge the received SelectedRows, because the Input size should be a definite value, but the number of received SelectedRows variable is different between each batch.
So I think we also need to implement the following feature:
- Send Op don't need to send the variable which was not initialized.
- Merge SelectedRows in server site.
Metadata
Metadata
Assignees
Labels
No labels