It's helpful to know what the default parameters were in the papers to get started. We should add the default projection head parameters which were used for pre-training on Imagenet to all projection and prediction heads in lightly/models/modules/heads.py.

Add examples for all ApiWorkflow functions

17

Open

Add multi-modal loss

4

Find more good first issues

s3prl / s3prl

Star

Self-Supervised Speech Pre-training and Representation Learning Toolkit.

Updated Jul 8, 2022
Python

lucidrains / byol-pytorch

Sponsor

Star

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

deep-learning artificial-intelligence self-supervised-learning

Updated Apr 6, 2022
Python

divelab / DIG

Star

A library for graph deep learning research

deep-learning graph-generation explainable-ml self-supervised-learning 3d-graph graph-neural-network

Updated Jul 9, 2022
Python

wvangansbeke / Unsupervised-Classification

Star

SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]

clustering image-classification representation-learning unsupervised-learning moco self-supervised-learning simclr eccv2020 eccv-2020 contrastive-learning

Updated Jun 18, 2022
Python

vturrisi / solo-learn

Star

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

Updated Jul 8, 2022
Python

TorchSSL / TorchSSL

Star

A PyTorch-based library for semi-supervised learning (NeurIPS'21)

machine-learning computer-vision deep-learning toolkit pytorch semi-supervised-learning codebase self-supervised-learning

Updated Jun 30, 2022
Python

asheeshcric / awesome-contrastive-self-supervised-learning

Star

A comprehensive list of awesome contrastive self-supervised learning papers.

deep-learning transfer-learning representation-learning unsupervised-learning self-supervised-learning hacktoberfest-accepted

Updated May 15, 2022

ChandlerBang / awesome-self-supervised-gnn

Star

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

machine-learning deep-learning graph-mining graph-neural-networks self-supervised-learning pre-training pretraining

Updated Jun 26, 2022

LirongWu / awesome-graph-self-supervised-learning

Star

Awesome Graph Self-Supervised Learning

machine-learning deep-learning transfer-learning representation-learning unsupervised-learning data-augmentation graph-neural-networks self-supervised-learning pre-training pretext-task

Updated Jul 2, 2022

jackroos / VL-BERT

Star

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

pytorch representation-learning bert vision-and-language self-supervised-learning pre-training iclr2020 vl-bert

Updated Feb 11, 2022
Jupyter Notebook

zhirongw / lemniscate.pytorch

Star

Unsupervised Feature Learning via Non-parametric Instance Discrimination

computer-vision deep-learning pytorch imagenet representation-learning unsupervised-learning nce cvpr2018 self-supervised-learning

Updated Mar 25, 2021
Python

YyzHarry / imbalanced-semi-self

Star

[NeurIPS 2020] Semi-Supervision (Unlabeled Data) & Self-Supervision Improve Class-Imbalanced / Long-Tailed Learning

semi-supervised-learning class-imbalance imbalanced-data imbalanced-learning long-tail unlabeled-data self-supervised-learning neurips imbalanced-classification neurips-2020 long-tailed-recognition

Updated Apr 3, 2021
Python

MrGiovanni / ModelsGenesis

Star

Official Keras & PyTorch Implementation and Pre-trained Models for Models Genesis - MICCAI 2019

transfer-learning representation-learning 3d-model fine-tuning self-supervised-learning pre-trained-model

Updated Feb 18, 2022
Jupyter Notebook

mkocabas / EpipolarPose

Star

Self-Supervised Learning of 3D Human Pose using Multi-view Geometry (CVPR2019)

machine-learning computer-vision pytorch human-pose-estimation cvpr 3d-pose-estimation self-supervised-learning cvpr-2019 cvpr2019 cvpr19

Updated Jun 26, 2019
Jupyter Notebook

Megvii-BaseDetection / cvpods

Star

All-in-one Toolbox for Computer Vision Research.

research computer-vision detection pytorch classification segmentation keypoints 3d self-supervised-learning cvpods

Updated Jan 7, 2022
Python

dipy / dipy

Star

DIPY is the paragon 3D/4D+ imaging library in Python. Contains generic methods for spatial normalization, signal processing, machine learning, statistical analysis and visualization of medical images. Additionally, it contains specialized methods for computational anatomy including diffusion, perfusion and structural imaging.