Adding Diverse Verifier Tree Search (DVTS)

[ShayekhBinIslam]

Feature request

I am interested in contributing the Diverse Verifier Tree Search (DVTS) as implemented here:
https://github.com/huggingface/search-and-learn/tree/main/recipes#recipes

Motivation

"Diverse Verifier Tree Search (DVTS): An unpublished extension we developed to the verifier-guided tree search technique. This simple yet effective method improves diversity and delivers better performance, particularly at large test-time compute budgets." - Hugging Face Team

Your contribution

Yes, I can contribute to integrate DVTS into OpenR.

[YanSong97]

Hi there, I'm excited to hear that! Any related material on DVTS in terms of how they are implemented? And how is it compared to Critic-MCTS (A self-questioning MCTS variant we implemented in a pull request)?