Add batch infer feature and gpu allocation feature#136

ZTWHHH wants to merge 1 commit into

mm-evaluation:mainmm-evaluation/simple-mmeval:mainfrom

ZTWHHH:batch-inferZTWHHH/simple-mmeval:batch-inferCopy head branch name to clipboard