【slice】Stridecopy support diff input-dim and ouput_dim #74038
Merged
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
PR Category
Execute Infrastructure
PR Types
Improvements
Description
pcard-67164
stride_copy 支持 input 的dim 只要和output dim 的后面维度一致时即可copy ,
这样可以减少前处理的broadcast, 在x.shape= [108,64,12288] , index=slice(0,100,2), value.shape = [64, 12288] case 下,性能提升一倍
todo: 当前stride_copy内部分成了三个路径,input.numel = 0; input.numel = output.numel; input canexpand to output.numel. 每个路径中又根据Rank, vecsize 分为4*9个分支. 代码非常多,可以进行优化