Data pvlib integration - #104

Open

KULcoder wants to merge 103 commits into

GeodataTools:dataset-refactorfrom

KULcoder:data-pvlib-integration

Commits on Dec 2, 2025

Adding a new testing file for PR
Keyu Long
committed
3d35329
Merge pull request #1 from KULcoder/data-tests
KULcoder
authored
dcacdd8
A commit to check test
Keyu Long
committed
d1b75d9
fix: Debug Update test_dataset_comprehensive.py
KULcoder
authored
9dddcfe
Merge pull request #2 from KULcoder/data-tests
KULcoder
authored
4c8073c
fix: modify the test file, such that it allows the tolerance for xr.sel()
KULcoder
committed
aa043d6
Merge pull request #3 from KULcoder/data-tests
KULcoder
authored
991de7e

Commits on Dec 3, 2025

test: adding a test_era5_wind3d test to ensures wind3d workflow
KULcoder
committed
511cba1
fix: trying to check why RuntimeError: Unspecified error in H5DSget_num_scales (return value <0) occur on the workflow
KULcoder
committed
7dc5fd0
fix: remove unuseful test (.prepare(), where do we need this function?)
KULcoder
committed
f80c953
fix: correct turbine name
KULcoder
committed
8074b93
fix: trying to make the flow smooth
KULcoder
committed
5e92282
fix: trying to ensure the interpolate flow behave correctly
KULcoder
committed
d398091
fix: trying to ensure the interpolate flow behave correctly: modify _make_interp_coeff
KULcoder
committed
b3c1816
Revert "fix: trying to make the flow smooth"
KULcoder
committed
df7c540
Revert "fix: trying to ensure the interpolate flow behave correctly: modify _make_interp_coeff"
KULcoder
committed
187d31c
Revert "fix: trying to ensure the interpolate flow behave correctly"
KULcoder
committed
3f0a2d3
Adding a simple file to check for possible errors
KULcoder
committed
403acda
fix: deal with client
KULcoder
committed
c41d17a
fix: add download
KULcoder
committed
15968fa
fix: add my download path
KULcoder
committed
12016dc
fix: use general source of dataset
KULcoder
committed
4266a8e
fix: moving path setting to the top
KULcoder
committed
257744f
fix: finish the test file at least on TSCC
KULcoder
committed
5748222
Testing on the if previous errors
KULcoder
committed
27f6f1b
Revert "Testing on the if previous errors"
KULcoder
committed
f20a585
fix: solve the bug appears in model.prepare stage
Keyu Long
committed
a6fda0b
fix: improve the new test file to fulfill the lint requirement
Keyu Long
committed
5ad4218
fix: delete not useful file
Keyu Long
committed
cef9158
fix: fixing linux opening h5netcdf error
KULcoder
committed
715fe65
fix: continuing fixing linux opening h5netcdf error
KULcoder
committed
e6646e4
fix: lint style fix
KULcoder
committed
6ef404e
feat: enable debugging methods used for testing
KULcoder
committed
4e4fb4b
fix: fix daily.py and monthly.py for the h5dsget_num_scales issue
KULcoder
committed
f8d9de5

Commits on Dec 4, 2025

fix: modify gitignore
KULcoder
committed
6125e4b
feat: refactor the era5 to reverse the order
KULcoder
committed
9a573c7
fix: small bug fixes on the inter connections in era5
KULcoder
committed
677c1ff
feat: adding specific prepare function for wind-solar, adding some certifications
KULcoder
committed
d6c547e
fix: solving could not load types.PathLike: change to absolute path
KULcoder
committed
b8df0f5
fix: lint style fix
KULcoder
committed
5fadadf
Merge pull request #4 from KULcoder/reorg-dataset
KULcoder
authored
5460f71

Commits on Dec 19, 2025

feat: new branch trying to reimplement the pvlib into dataset refactor on a monthly basis
KULcoder
committed
18a60bd
fix: implement a abstract method
KULcoder
committed
54fa725
fix: renaming longtitude/latitude to x/y for slicing
KULcoder
committed
7b22478
fix: make pvlib model to use h5netcdf engine only
KULcoder
committed
1d3c60f
fix: naming issue: for humidity calculation, move from ds.d2m to ds.dewpoint_temprature
KULcoder
committed
8c3fc4c
fix: adding dewpoint_temperature back into the processed dataset
KULcoder
committed
a9c0a1c
feat: add timing functions and testing
KULcoder
committed
4f759dd
fix: modify hourly / monthly wind-solar download file with default engine
KULcoder
committed
ae70b5d
fix: also modify the save engine
KULcoder
committed
9fdd339

Commits on Dec 20, 2025

fix: modify the engine in the base dataset object: h5netcdf for wind-solar
KULcoder
committed
68cbb92

Commits on Dec 22, 2025

feat: adding the parallelism for pvlib coordinate processing
KULcoder
committed
4de098f

Commits on Dec 23, 2025

fix: fix the logic in detecing cpus and prioritize slurm in detection
KULcoder
committed
84d979f

Commits on Jan 8, 2026

feat: adding the testing file for era5-windsolar workflow
KULcoder
committed
b6551ff
fix: fix some lint errors
KULcoder
committed
583ddb5

Commits on Jan 9, 2026

fix: make the testing flag working correctly for era5-windsolar-hourly datasets
KULcoder
committed
5c1df1f

Commits on Jan 10, 2026

fix: choose a subset of coordinates that is meaningful
KULcoder
committed
eb4568a
fix: disable merra2 tests for debugging usage
KULcoder
committed
61328c7

Commits on Jan 13, 2026

fix: fix the version numbers of all dependencies
KULcoder
committed
d1d5aef
fix: fixing the pyproject dependencies with the download flag
KULcoder
committed
96cd3e5

Commits on Jan 14, 2026

Revert "fix: fixing the pyproject dependencies with the download flag"
KULcoder
committed
6e37272
Revert "fix: fix the version numbers of all dependencies"
KULcoder
committed
9f9f244
fix: remove netcdf4 support
KULcoder
committed
998b984

Commits on Jan 15, 2026

Commits on Feb 4, 2026

Commits on Feb 6, 2026

Commits on Feb 7, 2026

fix: update the new method to allow a more flexible xs, ys range selection
KULcoder
committed
b0a104b

Commits on Feb 10, 2026

Merge pull request #7 from KULcoder/integrate-pvlib-new
KULcoder
authored
4e1be0f

Commits on Feb 17, 2026

fix: trying to solve the wind model issue
KULcoder
committed
df34a30

Commits on Feb 18, 2026

Revert "fix: trying to solve the wind model issue"
KULcoder
committed
7584446

Commits on Mar 18, 2026

fix: fixing the coordinate problem with pvlib model and the wind model
KULcoder
committed
29eb06a

Commits on Apr 18, 2026

Commits on Apr 20, 2026

Commits on Apr 23, 2026

Commits on Apr 24, 2026

Merge pull request #12 from KULcoder/integrate-pvlib-new
KULcoder
authored
e71625c

Commits on Jun 3, 2026

Commits on Jun 4, 2026

Commits on Jun 10, 2026