Give the agent the ability to call the VLM. - #2211
Conversation
Updated the README to reflect the new project title and removed outdated sections.
Updated installation instructions and added commands for datasets and training/evaluation.
Updated installation instructions for HM3D scenes and Objectnav dataset.
Updated installation instructions for HM3D scenes and clarified usage commands.
Removed code block formatting from dataset installation and training commands in README.
|
Hi @aayush-fadia! Thank you for your pull request and welcome to our community. Action RequiredIn order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks! |
Policy will use CLIP to embed both, the thought text and the observation image, into the same vector space. Thought is now a 512-dim vector that is the CLIP embedding dimension. Placeholder tensors are passed around for now.
Works for one single thread. Also a lot of debugging fluff BECAUSE TRACEBACKS ARE NOT AVAILABLE.
2 participants
No description provided.