The current implementation of ActorCriticBase makes it a bit trick to have custom actor and critic networks that have shared layers. This is because the instantiation of the networks happen in the ActorCriticBase class. You can probably get around it but it's very tricky. I'd recommend you pass in the actor/critic objects rather than the class types and let the user initialize them.
The current implementation of
ActorCriticBasemakes it a bit trick to have custom actor and critic networks that have shared layers. This is because the instantiation of the networks happen in theActorCriticBaseclass. You can probably get around it but it's very tricky. I'd recommend you pass in the actor/critic objects rather than the class types and let the user initialize them.