Skip to content

Ray benchmark miniapp - #238

Merged
pshriwise merged 9 commits into
xdg-org:mainfrom
Waqar-ukaea:ray-benchmark-miniapp
Jun 17, 2026
Merged

Ray benchmark miniapp#238
pshriwise merged 9 commits into
xdg-org:mainfrom
Waqar-ukaea:ray-benchmark-miniapp

Conversation

@Waqar-ukaea

@Waqar-ukaea Waqar-ukaea commented Jun 3, 2026

Copy link
Copy Markdown
Collaborator

This PR adds a simple miniapp to compare the total ray throughput between backends within XDG.

I previously had a PR up for something similar in #194 centred around GPRT. The difference here in this new PR is that the benchmark miniapp is being added independent of any GPU backend (GPRT or cuBQL) and only works with embree along with some minor changes/cleanup to get it to a state where it is much easier to extend to also work with cuBQL.

One immediate question is whether or not an explicit check for correctness is required in this benchmark. Initially I didn't want to do anything that checks for correct rays as it would slow down the benchmark but I wonder if that would be useful.

@Waqar-ukaea Waqar-ukaea added the Miniapps/Tooling Changes associated with miniapps. No changes to core XDG library label Jun 8, 2026
Comment thread tools/ray_benchmark.cpp Outdated
Comment thread tools/ray_benchmark.cpp Outdated
Comment thread tools/ray_benchmark.cpp Outdated
Comment thread tools/ray_benchmark.h
Comment thread tools/ray_benchmark.cpp Outdated
Comment thread tools/ray_benchmark.cpp Outdated

@pshriwise pshriwise left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Waqar-ukaea! It will be nice to have a single tool to do some of our benchmarking work.

Comment thread tools/ray_benchmark.cpp Outdated
@Waqar-ukaea

Copy link
Copy Markdown
Collaborator Author

@pshriwise I have gone ahead and made the changes you suggested and fleshed out some of them with some extra functionality. The only thing is with switching to using XDGConfig the tool now reports the incorrect number of threads when running

@pshriwise pshriwise left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one final suggestion, but regardless left but regardless I think this is good to go!

Comment thread tools/ray_benchmark.cpp Outdated
@Waqar-ukaea

Copy link
Copy Markdown
Collaborator Author

@pshriwise I think we are good on this one now. I may put up an additional PR that adds a python script to drive multiple runs of the benchmark too once I am at the point where I want to start doing proper comparison runs with cuBQL etc.

I'll also close #194 in favour of this one now too.

@pshriwise pshriwise left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thank you @Waqar-ukaea!

@pshriwise
pshriwise merged commit d287ebb into xdg-org:main Jun 17, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Miniapps/Tooling Changes associated with miniapps. No changes to core XDG library

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants