🚀 Feature request

This is a feature request to add Wav2Vec2 Pretraining functionality to the transformers library. This is a "Good Second Issue" feature request, which means that interested contributors should have some experience with the transformers library and ideally also with training/fine-tuning Wav2Vec2.

Motivation

The popular [Wav2Vec2](https://huggingface.co/models?filter=w

We keep this issue open to collect feature requests from users and hear your voice. Our monthly release plan is also available here.

You can either:

1. Suggest a new feature by leaving a comment.
2. Vote for a feature request with 👍 or be against with 👎. (Remember that developers are busy and cannot respond to all feature requests, so vote for your most favorable one!)
3. Tell us that

🐛 Bug

If the checkpoint file is not found at the location provided in resume_from_checkpoint argument in pl.Trainer, the training starts from scratch after displaying a UserWarning that is easy to miss.

To Reproduce

Use the following BoringModel.

Expected behavior

Should rai

Change tensor.data to tensor.detach() due to
pytorch/pytorch#6990 (comment)
tensor.detach() is more robust than tensor.data.

Bug Report

These tests were run on s390x. s390x is big-endian architecture.

Failure log for helper_test.py

________________________________________________ TestHelperTensorFunctions.test_make_tensor ________________________________________________

self = <helper_test.TestHelperTensorFunctions testMethod=test_make_tensor>

    def test_make_tensor(self):  # type: () -> None
    

I'm using mxnet to do some work, but there is nothing when I search the mxnet trial and example.