SOS-Match
segmentation for open-set robust correspondence search and robot localization
SOS-Match is a novel framework for detecting and matching objects in unstructured environments. Our system consists of a front-end mapping pipeline using a zero-shot segmentation model to extract object masks from images and a frame alignment pipeline that uses the geometric consistency of object relationships to efficiently localize across a variety of conditions.