Partitioner for Python 3

[adrianespejo]

This is the implementation of the dynamic task granularity scheduler. All previous functionality still works.

[codecov]

Codecov Report

❗ No coverage uploaded for pull request base (master@9861982). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #275   +/-   ##
=========================================
  Coverage          ?   92.74%           
=========================================
  Files             ?       32           
  Lines             ?     5282           
  Branches          ?        0           
=========================================
  Hits              ?     4899           
  Misses            ?      383           
  Partials          ?        0

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9861982...9366875. Read the comment docs.

[polsm91]

There are many divisions, make sure that you never divide by 0 :)

In the future, if we need to add more partition strategies consider using Enum. I think it's okay for now to have the strategy as a string.

https://docs.python.org/3/library/enum.html

[polsm91]

Suggestion :)

strategy = getattr(config, "partition_strategy". "SIMPLE")
return Partitioner(father, strategy).split()

[polsm91]

Not working. The tokens partitions eats the memory and does a loooong loop because of "token_range_size"