-
Notifications
You must be signed in to change notification settings - Fork 23k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[4/N] Nnapi backend delegation preprocess: List Tensors & Comment Updates #61752
Conversation
…ates Updated Android NNAPI preprocess, so that it can accept both single Tensor inputs and Tensor List inputs. -The inputs are not real data, but input parameters for shape, dtype, quantization, and dimorder that are bundled as a Tensor. Comments were updated to make this clearer. -In the future, preprocess will also accept a dedicated NnapiArg object. Compile_spec should have the following format: {"forward": {"inputs": at::Tensor}} OR {"forward": {"inputs": c10::List<at::Tensor>}} Example input Tensor: torch.tensor([[1.0, -1.0, 2.0, -2.0]]).unsqueeze(-1).unsqueeze(-1) ###Testing OSS testing is blocked by #61594. Testing was done locally in TODO: Add OSS tests for single Tensor and Tensor List inputs. Differential Revision: [D29726432](https://our.internmc.facebook.com/intern/diff/D29726432/) [ghstack-poisoned]
💊 CI failures summary and remediationsAs of commit d18fa5d (more details on the Dr. CI page and at hud.pytorch.org/pr/61752):
🕵️ 1 new failure recognized by patternsThe following CI failures do not appear to be due to upstream breakages: pytorch_macos_10_13_py3_test (1/1)Step: "Test" (full log | diagnosis details | 🔁 rerun)
|
…ates Updated Android NNAPI preprocess, so that it can accept both single Tensor inputs and Tensor List inputs. -The inputs are not real data, but input parameters for shape, dtype, quantization, and dimorder that are bundled as a Tensor. Comments were updated to make this clearer. -In the future, preprocess will also accept a dedicated NnapiArg object. Compile_spec should have the following format: {"forward": {"inputs": at::Tensor}} OR {"forward": {"inputs": c10::List<at::Tensor>}} Example input Tensor: torch.tensor([[1.0, -1.0, 2.0, -2.0]]).unsqueeze(-1).unsqueeze(-1) ###Testing OSS testing is blocked by #61594. Testing was done locally in TODO: Add OSS tests for single Tensor and Tensor List inputs. Differential Revision: [D29726432](https://our.internmc.facebook.com/intern/diff/D29726432/) ghstack-source-id: 133656416 Pull Request resolved: #61752
…Comment Updates" Updated Android NNAPI preprocess, so that it can accept both single Tensor inputs and Tensor List inputs. - The inputs are not real data, but input parameters for shape, dtype, quantization, and dimorder that are bundled as a Tensor. Comments were updated to make this clearer. - In the future, preprocess will also accept a dedicated NnapiArg object. Compile_spec should have the following format: {"forward": {"inputs": at::Tensor}} OR {"forward": {"inputs": c10::List<at::Tensor>}} Example input Tensor: torch.tensor([[1.0, -1.0, 2.0, -2.0]]).unsqueeze(-1).unsqueeze(-1) **Testing** OSS testing is blocked by #61594. Testing was done locally in TODO: Add OSS tests for single Tensor and Tensor List inputs. Differential Revision: [D29726432](https://our.internmc.facebook.com/intern/diff/D29726432/) [ghstack-poisoned]
…ates Pull Request resolved: #61752 Updated Android NNAPI preprocess, so that it can accept both single Tensor inputs and Tensor List inputs. - The inputs are not real data, but input parameters for shape, dtype, quantization, and dimorder that are bundled as a Tensor. Comments were updated to make this clearer. - In the future, preprocess will also accept a dedicated NnapiArg object. Compile_spec should have the following format: {"forward": {"inputs": at::Tensor}} OR {"forward": {"inputs": c10::List< at::Tensor >}} Example input Tensor: torch.tensor([[1.0, -1.0, 2.0, -2.0]]).unsqueeze(-1).unsqueeze(-1) ### Testing OSS testing is blocked by #61594. Testing was done locally in D29726948 TODO: Add OSS tests for single Tensor and Tensor List inputs. ghstack-source-id: 133683735 Differential Revision: [D29726432](https://our.internmc.facebook.com/intern/diff/D29726432/)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thanks!
This pull request has been merged in 6349bde. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks
Stack from ghstack:
Updated Android NNAPI preprocess, so that it can accept both single Tensor inputs and Tensor List inputs.
Compile_spec should have the following format:
{"forward": {"inputs": at::Tensor}} OR {"forward": {"inputs": c10::Listat::Tensor}}
Example input Tensor:
torch.tensor([[1.0, -1.0, 2.0, -2.0]]).unsqueeze(-1).unsqueeze(-1)
Testing
OSS testing is blocked by #61594. Testing was done locally in
TODO: Add OSS tests for single Tensor and Tensor List inputs.
Differential Revision: D29726432