There was an error while loading. Please reload this page.
In some condition, the operation of set_zero is unnecessary, because math::matmul will reset input_grad. And zeroing is also time consuming.