Date
Notification Thread
https://lists.apache.org/thread/r5hckl3v9vglpn3k08nwcwy6pzhsm2cz
Meeting Link
https://meet.google.com/smb-zamj-efy
Attendees
- Nga Chung
- Riley Kuttruff
- Thomas Loubrieu
- Grace Llewellyn
- Kevin Marlis
- William Phyo
- Joe Roberts
Discussion Topics
| Topic | Notes |
|---|---|
| SDAP Plugins / Plugable algorithms | Need a way to distribute specialized algorithms Specialized algorithms that may depend on GPL, non-compatible Apache 2.0 licenses, e.g. Cloud-Optimized GeoTIFF dependencies on GDAL Algorithms as pypi modules How would these pypi modules be added into docker image? For now, it may be worth releasing new algorithms with SDAP core until we figure out how to manage SDAP plugins We should start a DISCUSS thread when ready |
| Discussion: Zarr dataset performance issues with Spark | Accessing Zarr data works fine, but opening the dataset can cause excessive delays, especially depending on how the time coordinate is chunked. This is worse for Spark endpoints as all the workers need to do this and it isn't guaranteed to remain open between queries. Need advice for a workaround. Riley believes he has a workaround and will open a PR when ready NASA DAAC AWS credential refresh options
|