Skip to content
This repository was archived by the owner on Oct 31, 2023. It is now read-only.
This repository was archived by the owner on Oct 31, 2023. It is now read-only.

Note on EnvPool Features #37

Description

@cdmatters

This is just a note to keep track of some useful EnvPool features:

  • "Retries" - It would be good add an option to allow a certain number of retries if the Env crashes. It can be a little annoying if there is a single env that crashes and brings down training. Ideally, this could return a done, and restart, only truly crashing after say N failures.

  • "Reset" - The envpool doesnt currently have a reset function! It probably should.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions