Natural language processing
Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.
Here are 16,154 public repositories matching this topic...
-
Updated
Sep 7, 2021 - Python
-
Updated
Sep 11, 2021 - Python
-
Updated
Oct 12, 2021 - Python
-
Updated
Oct 15, 2021 - Python
-
Updated
Jun 12, 2017
-
Updated
Oct 15, 2021 - Python
-
Updated
Sep 19, 2021
-
Updated
May 2, 2021
Describe the bug
I'm having major trouble with from_csv
.
Context: I'm writing tutorial for build simple text search engine with Jina + Hub. I don't want to include a whole section of processing datasets, hence just passing a CSV into from_csv
. I tried with meme dataset (converted tsv) before, and now using [superhero dataset](https://www.kaggle.com/jonathanbesomi/superheroes-nlp-datas
-
Updated
Oct 15, 2021 - Python
Is your feature request related to a problem? Please describe.
I typically used compressed datasets (e.g. gzipped) to save disk space. This works fine with AllenNLP during training because I can write my dataset reader to load the compressed data. However, the predict
command opens the file and reads lines for the Predictor
. This fails when it tries to load data from my compressed files.
-
Updated
Jun 26, 2021 - Jupyter Notebook
Maybe add something like this as a pre or post processing step?
It might make sense to download the emoji list and store it as part of the build, so people do not need to load the emojis module, ...
import emoji
from emoji import unicode_codes
import re
EMOJI_UNICODE = unicode_codes.EMOJI_UNICODE['en']
emojis = sorted(EMOJI_UNICODE.values(), key=len, reverse=True)
print (emojis
-
Updated
Oct 15, 2021 - Python
-
Updated
Dec 22, 2020 - Python
-
Updated
Oct 14, 2021 - JavaScript
-
Updated
Jul 1, 2021 - Python
-
Updated
Jul 25, 2021 - Jupyter Notebook
-
Updated
Oct 15, 2021 - TypeScript
-
Updated
Oct 15, 2021 - Java
-
Updated
Aug 17, 2021 - Python
-
Updated
Oct 15, 2021 - Python
-
Updated
Oct 22, 2020
-
Updated
Jul 21, 2021 - Python
-
Updated
Sep 23, 2020 - Jupyter Notebook
Created by Alan Turing
- Wikipedia
- Wikipedia
Environment info
transformers
version: 4.11.3