fix: escape undecodable subprocess output bytes and deflake graceful shutdown test

fix: escape undecodable subprocess output bytes and deflake graceful shutdown test #826