Skip to content

How to Generate Action Chunk #12

Description

@wuxiongbin123

Hi! When reading Appendix C, I ran into some confusion about how action chunks are implemented.
When I run inference using your open-sourced model, I notice that the model only outputs one set of actions per frame.

To produce an action chunk, do you:

feed the model’s previous output back into the model again through multiple rounds of prompting,
or

have the model generate multiple actions in one single forward pass?

If it’s the second case, then how does the model produce an action chunk of size 2 during inference, given that the action-chunk sizes used during training were 1 and 3?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions