Skip to content

Commit f9ae668

Browse files
committed
Adding setup in README
1 parent 8b3ca2b commit f9ae668

File tree

1 file changed

+18
-2
lines changed

1 file changed

+18
-2
lines changed

README.md

Lines changed: 18 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,18 @@
1-
# data2vec-pytorch
2-
PyTorch implementation of Data2Vec 2.0: Highly efficient self-supervised representation learning for vision, speech and text.
1+
# Data2Vec 2.0
2+
3+
Data2Vec is self-supervised highly-efficient general framework to generate representations for vision, speech and text. This repository contains ready-to train [data2vec](https://github.com/facebookresearch/fairseq/tree/main/examples/data2vec) ([arXiv](https://arxiv.org/abs/2202.03555)) implementation containing helper scripts to load, process & train the data.
4+
5+
6+
## Run in a Free GPU powered Gradient Notebook
7+
[![Gradient](https://assets.paperspace.io/img/gradient-badge.svg)](https://console.paperspace.com/github/ashutosh1919/data2vec-pytorch?machine=Free-GPU)
8+
9+
10+
## Setup
11+
12+
The file `installations.sh` contains all the necessary code to install required things. Note that your system must have CUDA to train data2vec. Also, you may require different version of `torch` based on the version of CUDA. If you are running this on [Paperspace](https://www.paperspace.com/), then the default version of CUDA is 11.6 which is compatible with this code. If you are running it somewhere else, please check your CUDA version using `nvcc --version`. If the version differs from ours, you may want to change versions of PyTorch libraries in the first line of `installations.sh` by looking at [compatibility table](https://github.com/pytorch/pytorch/wiki/PyTorch-Versions).
13+
14+
To install all the dependencies, run below command:
15+
16+
```
17+
bash installations.sh
18+
```

0 commit comments

Comments
 (0)