Skip to content

Add remote session functionality for tvm_launcher.py#2

Open
dsbarinov1 wants to merge 5 commits into
tvm/mainfrom
dbarinov/tvm_launcher_remote_session
Open

Add remote session functionality for tvm_launcher.py#2
dsbarinov1 wants to merge 5 commits into
tvm/mainfrom
dbarinov/tvm_launcher_remote_session

Conversation

@dsbarinov1
Copy link
Copy Markdown

Motivation: until the current patch, tvm launcher was not able to work with RPC session, hence validating models on remote devices was impossible. In addition, it was also impossible to validate models on the GPU.

This patch is intended to bring this functionality with two additional flags "device" and "session", which are responsible for selecting "cpu" or "gpu" devices and "local" or "remote" sessions respectively.
At the moment, remote session and GPU device selection are implemented for android devices.

@dsbarinov1
Copy link
Copy Markdown
Author

Motivation: some neural network models require compilation with the "Virtual Machine" module to work properly with them. An example of such a model is "ssd-resnet34-1200-onnx".

This patch is intended to integrate support for the "Virtual Machine" module when running "Accuracy Checker" with the "tvm launcher" by adding an additional "vm" flag that allows you to specify with "true" or "false" whether "Accuracy Checker" inference should be started with "Virtual Machine".
In addition, at this point it is necessary to specify the "outputs" parameter, which will contain the names of the output layers of the model.

Important: at the moment, all parameters need to be written explicitly in the configuration file "accuracy-check.yml" in fields that are at the same level as the path to the model in .so format or, for example, at the sane level with "inputs" parameter.

@dsbarinov1
Copy link
Copy Markdown
Author

@KJlaccHoeUM9l could you please review my updates? :)

@dsbarinov1 dsbarinov1 marked this pull request as draft October 7, 2022 12:15
*Added rpc support
*Added Virtual Machine module support
*Add updated configuration files for Accuracy Checker and auxiliary scripts
@dsbarinov1 dsbarinov1 force-pushed the dbarinov/tvm_launcher_remote_session branch from c68bf1f to a2eae97 Compare October 7, 2022 12:21
@dsbarinov1 dsbarinov1 changed the base branch from master to tvm/main October 7, 2022 12:24
@dsbarinov1 dsbarinov1 marked this pull request as ready for review October 7, 2022 12:24
@dsbarinov1 dsbarinov1 force-pushed the dbarinov/tvm_launcher_remote_session branch from 23a9bc3 to a2eae97 Compare April 11, 2023 09:55
@dsbarinov1
Copy link
Copy Markdown
Author

dsbarinov1 commented Apr 12, 2023

Motivation:
[Hexagon][Accuracy Checker] Integrate Hexagon target into Accuracy Checker: https://octoml.atlassian.net/browse/DEELVIN-372

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants