Self-supervised Active Learning

Self-supervised Active Learning (SSL-AL) is a label-efficient machine-learning paradigm that pre-trains a model on unlabeled data using self-supervised objectives, then strategically queries a human oracle for the most informative labels using an active-learning acquisition function. The result is strong predictive performance with a fraction of the annotation cost required by fully supervised approaches.