PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances

PixelDINO

Retrogressive Thaw Slumps are a permafrost disturbance comparable to landslides induced by permafrost thaw. Their detection and monitoring is important for understanding the dynamics of permafrost thaw and the vulnerability of permafrost across the Arctic. To do this efficiently with deep learning, large amounts of annotated data are needed, of which currently we do not have enough.

In order to address this without needing to manually digitize vast areas across the Arctic, we propose a semi-supervised learning approach which is able to combine existing labelled data with additional unlabelled data.

This is done by asking the model to derive pseudo-classes, according to which it will segment the unlabelled images. For these pseudo-classes, consistency across data augmentations is enforced, which provides valuable training feedback to the model even for unlabelled tiles.

Results

Paper

Currently under review.

Pre-print available at https://arxiv.org/abs/2401.09271

Code

If you would like to have a closer look at the implementation details, work with our method, or reproduce our results, you can find all of our code on Github .

BandcampTimes CircleTerminalE-MailDownloadgiftGitHubAlternate GitHubHeartMenuCheck CirclerocketSpace ShuttleSpotifyangle-rightWarning