NASA Logo in the header
CISTO
In Development

SatVision Pix4D: Spatiotemporal Foundation Model for Cloud & Convection Prediction (SatVision Pix4D)

Developed a Foundation Model from coarse-resolution spatiotemporal satellite imagery and fine-tuned it using a physics-based loss function to predict cloud and convection patterns.

Launch Date
--
Class
Data/Image Computer Models
Website
Key Staffs

  • What we did: Developed a Foundation Model from coarse-resolution spatiotemporal satellite imagery and fine-tuned it using a physics-based loss function to predict cloud and convection patterns.
  • Impact: SatVision Pix4D was able to evaluate 3D cloud type and reconstruct 3D clouds.
  • What’s next: Track 3D convection and continue evaluating how to best train foundation models to better answer science questions.
  • Benefits: Find experimental answers in a short-period of time, shorten the amount of data and compute time needed for experimentation, and increase our understanding of input-output relationships.