Repository navigation
standards write speed, UoA collection and metadata fixes - #346
Merged
Merged
Conversation
kujaku11
merged commit Sep 11, 2026
5986cbd
into
IAGA-DVI-DataStandards:patches
5 of 10 checks passed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Depends on IAGA-DVI-DataStandards/mt-io#6: item 2 imports UoACollection from there, so CI against the released mt-io will fail on that import until #6 merges. The other items are independent of it.
Bulk add_rows and one standards summary: the ~600-row standards summary table was written one h5py setitem per row, twice per file (file init and add_survey) and add_row formatted every row into a debug f-string even with logging off. Rows now write as one block and the summary array is built once per process and reused.
Split PR6-24 stations into runs: the UoA client now builds its file list through UoACollection (added in mt-io#6), so multi-run EDL stations come in as separate runs instead of one concatenated block.
Scan for data in blocks: has_data ran np.nonzero over entire channel datasets, so closing a file read every channel in full. It now scans ~4M-sample blocks and exits at the first nonzero.
Client metadata fixes: in phoenix.py the station update_metadata() call sat outside the station loop so only the last station was finalised and in metronix.py the survey update_metadata was referenced without parentheses.