FOSS4G 2022 general tracks

Human-in-the-loop Machine Learning with Realtime Model Predictions using GroundWork and Raster Vision
2022-08-24, 11:30–12:00 (Europe/Rome), Room 4

Acquiring and labeling geospatial data for training machine learning models is a time-consuming and expensive process. It is made even more difficult by the lack of specialized open-source tools for dealing with the idiosyncrasies of geospatial data. At Azavea, we have encountered both of these problems before. In this talk, we will present a solution that incorporates our geospatial annotation platform, GroundWork (https://groundwork.azavea.com), with our open-source deep learning framework, Raster Vision (https://rastervision.io), to provide a human-in-the-loop active learning workflow. This workflow allows labelers to immediately see the effect of their created labels on the model’s performance, thus speeding up the labeling-training-labeling cycle and making the connection between the AI and human GIS data labelers easy and seamless.

This talk will extend the hands-on experience introduced in last year’s “Human-in-the-loop Machine Learning with GroundWork and STAC'' FOSS4G workshop. We will present an enhanced active-learning workflow that allows labelers to train a model and see predictions on-the-fly as they create labels in GroundWork. The model-training and predictions will be handled by Raster Vision. This workflow will give the labelers a clear view of the model’s current strength and weaknesses at all times, and thus allow them to direct their labeling efforts more efficiently. Newly created labels will propagate back to the AI model in real time, and an asynchronous job will continue to refine the model and predictions. This loop is backed by the open-source Raster Foundry (https://rasterfoundry.azavea.com) and Franklin (https://azavea.github.io/franklin) APIs, and is compliant with the STAC (https://stacspec.org) and OGC Features (https://www.ogc.org/standards/ogcapi-features) open standards.

Aaron Su is a Software Engineer III on Geospatial Applications team at Azavea who is the Technical Lead of GroundWork product. He has worked on open-source products such as Franklin, and Raster Foundry, and has contributed to STAC spec.

Adeel Hassan is a Machine Learning Engineer on the Geospatial Technology and Research team at Azavea and a maintainer of the open source geospatial deep learning library, Raster Vision.

Simon is a Software Engineer at Azavea. He builds geospatial web applications and has contributed to open source projects such as Raster Vision and PySTAC.