11-20, 09:05–09:10 (Pacific/Auckland), WG403
This presentation investigates whether Large Language Models (LLMs) possess adequate knowledge to function as effective intermediaries between non-expert users and FOSS4G CLI tools. We assess the capability of current LLMs to correctly respond to queries requiring geospatial domain-specific knowledge and generate appropriate solutions for spatial analysis tasks.
The complexity of CLI-based geospatial analysis tools presents a significant barrier to widespread adoption of FOSS4G technologies. While tools like GDAL, PDAL, and Python geospatial libraries offer powerful capabilities, their command-line interfaces require substantial technical expertise. This limits effective utilization to technical specialists, despite FOSS4G's promise of democratizing geospatial analysis.
Recent advances in Large Language Models (LLMs) suggest potential for bridging this technical gap. LLMs could theoretically interpret natural language requests and generate appropriate CLI commands, making these tools accessible to domain experts who possess valuable geospatial knowledge but lack programming backgrounds.
However, effective geospatial analysis requires understanding of domain-specific concepts such as coordinate reference systems, data formats, and regional standards. Our preliminary investigations reveal that current LLMs often fail to correctly handle country-specific geospatial information.
This presentation evaluates whether existing LLMs possess sufficient geospatial domain knowledge to serve as reliable intermediaries. We examine their performance and evaluate specific knowledge gaps that prevent LLMs from effectively facilitating FOSS4G CLI tool usage for non-technical users.
Acknowledgment
This work was supported by JSPS KAKENHI Grant Number JP25K21880, 24K16071.
This research was performed by the Environment Research and Technology Development Fund (JPMEERF25S12421) of the Environmental Restoration and Conservation Agency provided by Ministry of the Environment of Japan.
Dr. Nobusuke Iwasaki has been a board member of the OSGeo Japan chapter since 2007, as Vice Representative since 2014 and Representative since 2018. From 2009 to 2015, He participated in projects of the Japanese Ministry of Education to localize FOSS4G Tools, such as GRASS and QGIS, and to create tutorials. He currently incorporates FOSS4G tools into educational programs at Tottori University, promoting open-source geospatial technologies in academic curricula.
Ayaka Onohara is an assistant professor in data science at Rikkyo University in Japan.
Her research combines geospatial analysis, natural language processing and cultural evolution, with a focus on how places shape emotions and behaviour.
She actively explores FOSS4G tools and large language models in teaching and research to build reproducible, CLI-based geospatial workflows.