Skip to content

Conversation

@zhaoyinglia
Copy link
Contributor

@zhaoyinglia zhaoyinglia commented Mar 11, 2022

PR types

New features

PR changes

Others

Describe

  • Add Converter implement of AutoParallel.
  • convert tensors' values from one parallel strategy to another one.
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

"but got '{}'.".format(str(type(cur_strategy))))
self._cur_strategy = cur_strategy

def convert(self, strict=True):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

explain meaning of "strict" argument in doc

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

.. code-block:: python

import numpy as np
complete_param = np.arange(4).reshape([2, 2])
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

complete_param --> complete_params

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

param_not_in_ckpt.append(param_name)
continue

param_list = self._params_dict[param_name]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"param_xxx" --> "tesnor_xxx" a more proper and meaningful naming

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

partition_index, complete_shape)

assert len(partition_param_list) == 1 or not partition_param_list, \
"Fail to merge parameter"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also throw out the information of failed tensor, like name, pre_dist_attr, target_dist_attr

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

@zhaoyinglia zhaoyinglia reopened this Mar 11, 2022
Copy link
Contributor

@XieYunshen XieYunshen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@JZ-LIANG JZ-LIANG left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JZ-LIANG JZ-LIANG merged commit 3881b6c into PaddlePaddle:develop Mar 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

3 participants