OBIS provides a full export of presence records [1] in both csv [2] and parquet [3]. Would it be feasible to add something to pyobis that goes out and efficiently grabs the whole export?
I'm sure folks smarter than me know of ways to parallelize the call or do something fancy with the available services to download in a reasonable time frame.
[1] - https://obis.org/data/access/
[2] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.csv.zip
[3] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.parquet
Could also be a waste of time for this package.
OBIS provides a full export of presence records [1] in both csv [2] and parquet [3]. Would it be feasible to add something to pyobis that goes out and efficiently grabs the whole export?
I'm sure folks smarter than me know of ways to parallelize the call or do something fancy with the available services to download in a reasonable time frame.
[1] - https://obis.org/data/access/
[2] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.csv.zip
[3] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.parquet
Could also be a waste of time for this package.