Wykaz obszarów badawczych związanych z tagiem Self-supervised-learning:
| # | Obszar badawczy | Dziedzina naukowa |
|---|---|---|
| 1 |
Self-supervised learning (SSL) methods have shown significant potential in improving the sample efficiency of deep learning and in providing a starting point for the learning of downstream tasks. Contrastive SSL methods have become a standard pre-training approach for a range of domains such as NLP and vision. Initial results suggest that non-contrastive SSL has been able to narrow the gap to the performance levels of contrastive methods, while obviating the need for explicit construction of negative samples. The aim of this research project is two-fold: 1) investigate the extent to which contrastive and non-contrastive methods can be used in novel SSL architectures, 2) examine whether the alignment of representations in SSL can be achieved by alternative methods, such as enforcing the ability to predict an input representation from the representations of similar inputs.
|