Cross-Domain Foundation Model Adaptation: Pioneering Computer Vision Models for Geophysical Data Analysis
We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. However, geoscience faces challenges like lacking curated training datasets and high...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | We explore adapting foundation models (FMs) from the computer vision domain
to geoscience. FMs, large neural networks trained on massive datasets, excel in
diverse tasks with remarkable adaptability and generality. However, geoscience
faces challenges like lacking curated training datasets and high computational
costs for developing specialized FMs. This study considers adapting FMs from
computer vision to geoscience, analyzing their scale, adaptability, and
generality for geoscientific data analysis. We introduce a workflow that
leverages existing computer vision FMs, fine-tuning them for geoscientific
tasks, reducing development costs while enhancing accuracy. Through
experiments, we demonstrate this workflow's effectiveness in broad applications
to process and interpret geoscientific data of lunar images, seismic data, DAS
arrays and so on. Our findings introduce advanced ML techniques to geoscience,
proving the feasibility and advantages of cross-domain FMs adaptation, driving
further advancements in geoscientific data analysis and offering valuable
insights for FMs applications in other scientific domains. |
---|---|
DOI: | 10.48550/arxiv.2408.12396 |