-
Notifications
You must be signed in to change notification settings - Fork 23k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Model Averaging] Provide a util function for model averaging #60303
Conversation
The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
💊 CI failures summary and remediationsAs of commit cd89a27 (more details on the Dr. CI page and at hud.pytorch.org/pr/60303):
1 failure not recognized by patterns:
This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.Please report bugs/suggestions to the (internal) Dr. CI Users group. |
The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) ghstack-source-id: 131874673 Pull Request resolved: #60303
…ing" The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
Pull Request resolved: #60303 The util function can be used for averaging parameters. More optimizations can be done in the future. ghstack-source-id: 131897728 Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/)
…ing" The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
…ing" The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
Pull Request resolved: #60303 The util function can be used for averaging parameters. More optimizations can be done in the future. ghstack-source-id: 131899104 Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall, just one concern about non-world subgroups.
…ing" The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
Pull Request resolved: #60303 The util function can be used for averaging parameters. More optimizations can be done in the future. ghstack-source-id: 131907564 Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/)
…ing" The util function can be used for averaging parameters. More optimizations can be done in the future. Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/) [ghstack-poisoned]
Pull Request resolved: #60303 The util function can be used for averaging parameters. More optimizations can be done in the future. ghstack-source-id: 132214212 Differential Revision: [D29242806](https://our.internmc.facebook.com/intern/diff/D29242806/)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
This pull request has been merged in aeea5bf. |
Stack from ghstack:
The util function can be used for averaging parameters.
More optimizations can be done in the future.
Proposal: #59699
Differential Revision: D29242806