The Wayback Machine - https://web.archive.org/web/20210801054029/https://github.com/topics/language-modeling

#

language-modeling

Here are 170 public repositories matching this topic...

quark0 / darts

Star

Differentiable architecture search for convolutional and recurrent networks

deep-learning language-modeling pytorch recurrent-networks image-classification convolutional-networks automl neural-architecture-search

Updated Jan 3, 2021
Python

Separius / BERT-keras

Star

Keras implementation of BERT with pre-trained weights

nlp theano tensorflow keras language-modeling transformer transfer-learning pretrained-models

Updated Jul 26, 2019
Python

uber-research / PPLM

Star

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.

nlp machine-learning natural-language-processing deep-learning language-modeling natural-language-generation

Updated Mar 2, 2021
Python

meta-toolkit / meta

Star

A Modern C++ Data Sciences Toolkit

nlp search-engine c-plus-plus graph-algorithms text-classification word-embeddings text-analysis language-modeling inverted-index text-analytics pos-tag nlp-parsing

Updated Dec 13, 2020
C++

hirofumi0810 / neural_sp

Star

End-to-end ASR/LM implementation with PyTorch

streaming speech language-modeling pytorch transformer speech-recognition seq2seq attention automatic-speech-recognition sequence-to-sequence language-model attention-mechanism asr ctc rnn-transducer transformer-xl

Updated May 29, 2021
Python

songlab-cal / tape

Star

Open

Extend list of models by SeqVec

1

ptynecki commented May 16, 2020

Hey,

I would propose extend list of available models by SeqVec (ELMo-based implementation) which was presented in the Modeling aspects of the language of life through transfer-learning protein sequences paper.

SeqVec model trained on UniRef50 is available at: [SeqVec-model](

Read more

enhancement good first issue help wanted wontfix

majumderb / rezero

Star

Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"

deep-neural-networks language-modeling transformer resnet pytroch

Updated Jun 2, 2021
Python

L0SG / relational-rnn-pytorch

Star

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

deep-learning language-modeling pytorch recurrent-neural-networks transformer deepmind language-model word-language-model self-attention

Updated Dec 27, 2018
Python

rusiaaman / XLnet-gen

Star

XLNet for generating language.

text language-modeling language-model language-generation gpt2 xlnet transformer-xl

Updated Jan 30, 2021
Python

tonybeltramelli / Deep-Lyrics

Star

Lyrics Generator aka Character-level Language Modeling with Multi-layer LSTM Recurrent Neural Network

natural-language-processing deep-learning tensorflow language-modeling recurrent-neural-networks

Updated Sep 25, 2017
Python

suriyadeepan / rnn-from-scratch

Star

Use tensorflow's tf.scan to build vanilla, GRU and LSTM RNNs

tensorflow language-modeling recurrent-neural-networks rnn

Updated Mar 3, 2017
Python

songlab-cal / tape-neurips2019

Star

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)

benchmark deep-learning protein-structure language-modeling dataset semi-supervised-learning protein-sequences

Updated Jan 2, 2020
Python

jiali-ms / JLM

Star

A fast LSTM Language Model for large vocabulary language like Japanese and Chinese

deep-neural-networks tensorflow decoder language-modeling lstm beam-search viterbi

Updated Jun 4, 2019
Python

Sunnydreamrain / IndRNN_pytorch

Star

Independently Recurrent Neural Networks (IndRNN) implemented in pytorch.

skeleton language-modeling rnn action indrnn

Updated Dec 23, 2020
Python

uzaymacar / comparatively-finetuning-bert

Star

Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.

language-modeling pytorch bert natural-language-understanding fine-tuning imdb-dataset attention-visualization

Updated Jul 2, 2020
Python

indiejoseph / chinese-char-rnn

Star

Character-Level language models

nlp deep-learning tensorflow language-modeling rnn chinese

Updated Jun 17, 2017
Python

lyeoni / pretraining-for-language-understanding

Star

Pre-training of Language Models for Language Understanding

nlp language-modeling pytorch language-model pytorch-tutorial language-understanding

Updated Aug 24, 2019
Python

kmario23 / KenLM-training

Star

Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2

python natural-language-processing deep-neural-networks language-modeling speech-recognition automatic-speech-recognition language-model probabilistic-models kenlm deep-speech kenlm-toolkit

Updated May 20, 2019

nlp-en-es / nlp-de-cero-a-cien

Star

Curso práctico: NLP de cero a cien 🤗

nlp natural-language-processing word-embeddings transformers language-modeling lstm rnn transfer-learning espanol attention-mechanism

Updated Jul 28, 2021
Jupyter Notebook

geyingli / unif

Star

仿 Scikit-Learn 设计的深度学习自然语言处理框架, 支持约 40 种模型类, 涵盖语言模型、文本分类、NER、MRC、机器翻译等各个领域

nlp tensorflow mrc language-modeling transformer classification distillation bertology gpu-training

Updated Jul 18, 2021
Python

nstrodt / UDSMProt

Star

Protein sequence classification with self-supervised pretraining

machine-learning deep-learning language-modeling protein-classification

Updated Dec 1, 2020
Python

prajjwal1 / language-modelling

Star

LM, ULMFit et al.

nlp deep-learning language-modeling pytorch

Updated Dec 30, 2019
Python

miras-tech / MirasText

Star

MirasText

nlp sentiment-analysis article corpus language-modeling dataset persian-nlp text-corpus word-embedding irony-detection

Updated Aug 12, 2020
Python

shaoxiongji / fed-att

Star

Attentive Federated Learning for Private NLM

deep-learning language-modeling pytorch attention-mechanism federated-learning

Updated Apr 13, 2020
Python

uyaseen / theano-recurrence

Star

Recurrent Neural Networks (RNN, GRU, LSTM) and their Bidirectional versions (BiRNN, BiGRU, BiLSTM) for word & character level language modelling in Theano

theano language-modeling lstm gru rnn bidirectional-rnn bidirectional-gru bidirectional-lstm

Updated Sep 16, 2016
Python

referit3d / referit3d

Star

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

computer-vision deep-learning computer-graphics language-modeling rgbd multimodal-deep-learning

Updated Jun 29, 2021
C++

mit-han-lab / neurips-micronet

Star

[JMLR 2020] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion

natural-language-processing language-modeling pruning quantization knowledge-distillation efficient-model

Updated Feb 26, 2021
Jupyter Notebook

asahi417 / LSTMCell

Star

Implement modern LSTM cell by tensorflow and test them by language modeling task for PTB. Highway State Gating, Hypernets, Recurrent Highway, Attention, Layer norm, Recurrent dropout, Variational dropout.

deep-learning tensorflow language-modeling python3 lstm recurrent-highway-networks

Updated Oct 23, 2018
Python

IDSIA / recurrent-fwp

Star

Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers"

reinforcement-learning transformers language-modeling recurrent-neural-networks fast-weights fast-weight-programmers

Updated Jun 15, 2021
Python

giganticode / codeprep

Star

A toolkit for pre-processing large source code corpora

natural-language-processing language-modeling word-segmentation mining-software-repositories source-code-analysis

Updated Apr 24, 2021
Python

Improve this page

Add a description, image, and links to the language-modeling topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the language-modeling topic, visit your repo's landing page and select "manage topics."