Logo image
A multimodal framework for extraction and fusion of satellite images and public health data
期刊文章   同儕審查

A multimodal framework for extraction and fusion of satellite images and public health data

Dana Moukheiber, David Restrepo, Sebastián Andrés Cajas, María Patricia Arbeláez Montoya, Leo Anthony Celi, Kuan-Ting Kuo, Diego M. López, Lama Moukheiber, Mira Moukheiber, Sulaiman Moukheiber, …
Scientific data, 卷.11(1), 634
15/06/2024
PMID: 38879585
Web of Science ID: WOS:001249128100002

摘要

Analysis
In low- and middle-income countries, the substantial costs associated with traditional data collection pose an obstacle to facilitating decision-making in the field of public health. Satellite imagery offers a potential solution, but the image extraction and analysis can be costly and requires specialized expertise. We introduce SatelliteBench, a scalable framework for satellite image extraction and vector embeddings generation. We also propose a novel multimodal fusion pipeline that utilizes a series of satellite imagery and metadata. The framework was evaluated generating a dataset with a collection of 12,636 images and embeddings accompanied by comprehensive metadata, from 81 municipalities in Colombia between 2016 and 2018. The dataset was then evaluated in 3 tasks: including dengue case prediction, poverty assessment, and access to education. The performance showcases the versatility and practicality of SatelliteBench, offering a reproducible, accessible and open tool to enhance decision-making in public health.

檔案與連結 (1)

url
https://doi.org/10.1038/s41597-024-03366-1檢視
已出版(紀錄版本)

相關連結

指標

1 檢視次數

詳細資料

Logo image