Architecture

###Where will the code be run? For each test, a docker container with the environment needed to run the language will be deployed to its own box. For comparisons between multiple languages, containers can be built on demand to include the dependencies for each language in the test.

###How will the code be run? For each supported language, there will be a script that handles any necessary compilation and will run the code using the predefined binary installed onto the docker container.

###How will performance be measured? For synchronous jobs, benchmarking code is injected at the beginning and end of the code snippet. For asynchronous jobs, the given snippets must use a specified callback. The benchmarking code will be a simple timer that records the runtime of the script. Each language will needs its own version of the benchmarking code. Further metrics such as CPU and memory usage could be considered. The code will be run many times (1,000-100,000) and the results will be averaged.

###List of Dependencies

• Docker
• Deis
• Redis
• MongoDB