The Pacific Data Hub, a federated data platform
11-21, 14:30–14:55 (Pacific/Auckland), WG404

A deep dive into the open-source based tech stack behind the Pacific Data Hub.


The Pacific Data Hub platform is the one-stop-shop for anyone who seeks data about the Pacific region across multiple domains including population statistics, fisheries science, climate change adaptation, disaster risk reduction, public health, food security and human rights.
It was designed as a set of highly-specialised, open-source based data management systems covering the different types of data (array-oriented scientific data, geospatial datasets, statistical data cubes, and documents) overarched by a catalog of metadata forming a federated data platform. The catalog also references data from national governements, regional organizations, and global partners.

The datasets are indexed in the CKAN-based catalog via harvesters or entry forms. The metadata is then re-disseminated by CKAN with a centralised schema and taxonomy via Data Catalog Vocabulary (DCAT). Whenever it is possible, the catalog provides links to the data either as direct download link or OGC standards APIs.
The federated data platforms includes:
- Geonode for Geospatial datasets (DEMs, bathymetry, administrative boundaries, risk assessment output models, ...)
- THREDDS and TDS for scientific data arrays (sea surface height, temperature, wave, current, tides, salinity, ...)
- .Stat Suite for statistical indicators (SDGs, population, economy, trade, ...)

Those platforms are completed by dashboards, tools and visualisation apps connected to the data via APIs to provide insights to inform better policy development and decision-making including:
- the Pacific Maritime Boundaries Dashboard is the regional tool for sharing information about the Pacific island maritime boundaries and zones. Based on Drupal pages, it provides map views of EEZs and other maritime zones and links to their associated treaties.
- the Blue Pacific 2050 Dashboard is a NextJS dashboard that display charts of key development indicators pulling data from a SDMX APIs.
- PacificMap is a generic map viewer that can connect to the CKAN catalog to display the Geonode-hosted GIS datasets but also the .Stat statistical indicators as chloropeth maps.
- the Pacific Ocean Portal provides access to historical and forecast ocean conditions as well as in-situ observations provided by TDS.

This presentation is about giving details on the standards, technologies and tools deployed within the platform, describing the API-based interconnections and the data workflows involved. It will also provide an overview of the challenges encountered when maintaining a platform with reliable and timely data coming from a wide diversity of providers.

A web developer passionate about geospatial data.
Working for the Pacific Community in Nouméa.
Always eager to innovate and use new tools, formats, techniques to create cool stuff.

Solutions Architect for the Pacific Data Hub