Skip to content

Reduce peak VRAM usage in Diamond WE. #133

Open
SoraSuegami wants to merge 12 commits into
mainfrom
feat/fix-we-test-logs
Open

Reduce peak VRAM usage in Diamond WE. #133
SoraSuegami wants to merge 12 commits into
mainfrom
feat/fix-we-test-logs

Conversation

@SoraSuegami

@SoraSuegami SoraSuegami commented Jun 22, 2026

Copy link
Copy Markdown
Member

Summary

  • Adjust Diamond WE GPU and IO code to improve test logging and error reporting
  • Reduce peak VRAM usage in Diamond WE

@SoraSuegami SoraSuegami changed the title Fix Diamond WE test logging and GPU plot generation Reduce peak VRAM usage in Diamond WE. Jun 22, 2026
@SoraSuegami
SoraSuegami marked this pull request as ready for review June 22, 2026 17:22

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 90e2ea25c3

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/we/diamond_we.rs
Comment on lines +328 to +332
let chunk_cols = Self::preimage_chunk_cols(total_cols).unwrap_or_else(|| {
panic!(
"DiamondWE missing full preimage artifact {id} and chunking is disabled for total_cols={total_cols}"
)
});

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Persist preimage chunk layout for decoding

When a ciphertext is encrypted with chunked preimages under one AUX_SAMPLING_CHUNK_WIDTH and decoded later after that variable is changed or unset, no full preimage artifact exists and this recomputes chunk_cols from the current environment rather than the layout used to write the files. The decoder will then look for different chunk boundaries and can panic on a missing artifact or column-count mismatch, so the chunk width/count needs to be stored with the artifacts/ciphertext or discovered from the persisted chunks.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant