Across 300 queries, without subtracting idle power: - AWD-LSTM: 193 ms/q, 0.678J/q - MoS: 253 ms/q, 1.314 J/q MoS: reproduced STOA perplexity Latency UI test: http://rocketeer.net/test
Across 300 queries, without subtracting idle power:
MoS: reproduced STOA perplexity
Latency UI test: http://rocketeer.net/test