Improve tasks management

[Leo-Marbehan]

Improve tasks management

To do

• Make an environment variable out of the MAX_STATES_EXTRACTION_CONCURRENT_TASKS variable.
• Update the documentation for both environment variables.
• Fix lint.

Modifications

• Increase task allocation time while paused or loading states.
• Add the DEBUG_TASKS environment variable to enable debugging of tasks in the client.
• Move the state retrieval login in SimulationService.
• Update the server side of the state retrieval to include more information used by the parallel tasks mechanism.
• Change tasks to have one task per state instead of one task for all states (to allow parallelism).
• Fetch new states more often :
  • Fetch new states as soon as we receive the previous one (instead of after it has been processed),
  • Stop fetching when more than MAX_STATES_EXTRACTION_CONCURRENT_TASKS are currently being processed (10 by default).
• Keep track of the extract state tasks and dynamically change the priority to process the closest to the visualization time first.
• Add tests to ensure that the priority update is working and update some configuration files.

[Leo-Marbehan]

I'll deploy a test version later to avoid having two concurrent features at a time being deployed.

[pamun1]

The PR looks good overall. However, I noticed a potential logic bug in how the task priority is determined. Please take a look at my comments for more details.

[pamun1]

Thank you for the modifications. You’ve resolved many issues related to task priority. That's great! However, I believe there is still a minor problem with the condition for selecting the most urgent task. Please see my comment for more details.

[pamun1]

Thank you for the changes. Everything looks fine to me now.