Skip to content

Commit 9589498

Browse files
audristroyerclaude
andcommitted
Document that live cloud tests have not been verified yet
Add section to MATLAB_TEST_MAPPING.md explaining the two skip marker tiers (requires_cloud vs requires_upload with canUploadDataset=true) and that none of the _live tests have been run against real APIs yet. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 7ce6a98 commit 9589498

1 file changed

Lines changed: 29 additions & 0 deletions

File tree

tests/matlab_tests/MATLAB_TEST_MAPPING.md

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -340,6 +340,35 @@ official `openminds` Python library (v0.4.0) instead of non-existent
340340

341341
---
342342

343+
## Live Cloud Tests Not Yet Verified
344+
345+
The cloud tests use two skip markers with increasing privilege levels:
346+
347+
| Marker | Condition | Tests |
348+
|--------|-----------|-------|
349+
| `@requires_cloud` | `NDI_CLOUD_USERNAME` env var is set | Login/logout, list datasets, get user, get published/unpublished, get branches, invalid dataset, sync upload |
350+
| `@requires_upload` | `requires_cloud` + account has `canUploadDataset=true` | Dataset lifecycle (create/update/delete), document lifecycle (add/get/update/delete), file upload/download, bulk operations, compute hello-world |
351+
352+
**None of the `_live` tests have been run against the real NDI cloud API yet.** They
353+
are all currently skipped in CI because no credentials are configured. The mocked
354+
versions pass and mirror the MATLAB test logic, but the live versions need to be
355+
validated with real credentials and an account that has upload permissions.
356+
357+
To run them:
358+
359+
```bash
360+
# Read-only cloud tests (list, get, auth)
361+
NDI_CLOUD_USERNAME=user NDI_CLOUD_PASSWORD=pass \
362+
pytest tests/matlab_tests/test_cloud_api.py -v -k "live"
363+
364+
# Full cloud tests including dataset/document creation (needs canUploadDataset=true)
365+
NDI_CLOUD_USERNAME=user NDI_CLOUD_PASSWORD=pass \
366+
pytest tests/matlab_tests/test_cloud_api.py tests/matlab_tests/test_cloud_sync.py \
367+
tests/matlab_tests/test_cloud_compute.py -v -k "live"
368+
```
369+
370+
---
371+
343372
## Running the Tests
344373

345374
```bash

0 commit comments

Comments
 (0)