11-06, 16:40– (Australia/Hobart), Main Auditorium
Prefect is a modern open-source orchestration tool for data and ML engineers. How can it be used to build geospatial data pipelines?
Prefect is a modern open-source orchestration tool for data and ML engineers. This talk will look at how the Australian Ocean Data Network has been using prefect to build geospatial data pipelines processing NetCDF files that will be easy to maintain and monitor.
Marty Hidas is a senior data engineer for the Australian Ocean Data Network with the Integrated Marine Observing System.