MX Testing on Common Models

Setup

Install docker first. Then, run

docker run --gpus all --ipc=host --ulimit memlock=-1 --ulimit stack=67108864 -it \
   -v "$(pwd)":/workspace nvcr.io/nvidia/pytorch:24.07-py3

Then, install microxcaling,

git pull https://github.com/microsoft/microxcaling
cd microxcaling
pip install -e .

To find your docker container,

docker ps -a 

this gives you a container name, which you can use to start and enter the container

systemctl start docker
docker start <container-name>
docker exec -it <container-name> bash

CNN Tests

Run

python -W ignore mx_rn_mnv2.py

LM Tests

Run

python -W ignore mx_bert_phi.py