University of AlbertaMultimedia Research Centre · Dept. of Computing Science
ROSSRemote Observation, Sensing & System
Research / R/02 Agriculture & Environment / Large-scale rice mapping with vision transformers
R/02 · Agriculture & Environment

Large-scale rice mapping with vision transformers

Vision transformers on multi-temporal Sentinel-1 SAR time series map rice fields across nine regions of Brazil — 42,481 km² — outperforming LSTM, TFBS, SegFormer and SETR.

Agriculture & EnvironmentSARVision TransformerAgriculture

Rice is a staple food for over half the world’s population and supplies roughly one fifth of global caloric demand. More than a quarter of the world’s developed freshwater goes to growing it, and methane from rice farming carries 21 times the warming potential of CO₂. Knowing where rice grows, accurately and at scale, matters for food security and the environment alike.

Our method applies vision transformers to multi-temporal Sentinel-1 SAR time series: 3D convolutions with temporal max-pooling feed a transformer encoder-decoder that turns a season of radar observations into a rice map.

The study area spans nine regions across southern and central Brazil, totalling 42,481 km², with the Santa Catarina 2017/2018 season shown in detail. In qualitative comparisons, our approach (SCAN) outperforms LSTM, TFBS, SegFormer and SETR baselines.

Map of the Brazil study area showing nine regions with inset

The study area: nine regions across southern and central Brazil.

Qualitative comparison grid of rice maps: RGB vs LSTM, TFBS, SegFormer, SETR and SCAN

Qualitative comparison: our approach (SCAN) against LSTM, TFBS, SegFormer and SETR.