Our journey into an OGC-compliant Processing Engine
07-05, 11:30–12:00 (Europe/Tallinn), Destination Earth (Van46 ring)

We have recently adopted the OGC API-Processes specification as we modernize our legacy processing platform at UP42. The legacy platform was plagued by poor compatibility among linked processes, high rates of failure, and unnecessary complexity when handling multi-data inputs. The OGC API-Processes specification offers a standard interface that makes complex computational processing services accessible via a RESTful API.

Behind the scenes we built a well choreographed set of micro-services providing substance to the standard endpoints: a process registry service (ProcessList, ProcessDescrition), a job registry service (Status, JobList, Result), a task execution service (Execute) and more. To avoid the failure rate experienced in our legacy platform, we enabled a very restrictive validation of every job ahead of execution, leveraging our STAC-in/STAC-out paradigm (widely relying on extensions like proj, eo etc). Our job-registry-service also leverages STAC to ensure full traceability of jobs and items.

Now we would like to look back and share our journey with the community, showing how embracing
community specifications like STAC and OGC-Processes API enabled us to transition into a more reliable and scalable processing engine.

More information: https://up42.com/blog/pansharpening-an-initial-view-into-our-advanced-analytic-capabilities

See also:

I come originally from Portugal and live in Berlin since 2007. I worked a long time in academia at GFZ Potsdam and University of Potsdam, building land-surface models for predicting water availability and extreme-events. Since 2022 I joined UP42 and have been involved in leveraging STAC and COGs for revamping our data management and processing platforms.