Build software better, together

RaRe-Technologies / gensim

Star

Open

Gensim's FastText model reads in unsupported modes from Facebook's FastText

2

mpenkov commented Jun 22, 2021

In gensim/models/fasttext.py:

    model = FastText(
        vector_size=m.dim,
        vector_size=m.dim,
        window=m.ws,
        window=m.ws,
        epochs=m.epoch,
        epochs=m.epoch,
        negative=m.neg,
        negative=m.neg,
        # FIXME: these next 2 lines read in unsupported FB FT modes (loss=3 softmax or loss=4 onevsall,
        # or model=3 supervi

make `remove_stopwords()` behavior more consistent

17

Open

Move BrownCorpus from word2vec to gensim.corpora

6

Find more good first issues →

oborchers / Fast_Sentence_Embeddings

Star

Compute Sentence Embeddings Fast!

cython embeddings gensim fse fasttext word2vec-model maxpooling document-similarity wordembedding sif sentence-similarity sentence-embeddings sentence-representation usif gensim-model swem

Updated Apr 10, 2021
Python

IlyaGusev / tgcontest

Star

Telegram Data Clustering contest solution by Mindful Squirrel

nlp data-science machine-learning cpp clustering classification fasttext document-similarity

Updated May 12, 2021
HTML

andrewmcloud / consimilo

Star

A Clojure library for querying large data-sets on similarity

Updated Feb 17, 2019
Clojure

abhilampard / Simple-Plagiarism-Checker

Star

Web Application for checking the similarity between query and document using the concept of Cosine Similarity.

Updated Jul 29, 2020
Python

Sarthakjain1206 / Intelligent_Document_Finder

Star

Document Search Engine Tool

search-engine scrapy-spider indexer scrapy text-summarization search-algorithm webcrawler latent-dirichlet-allocation bm25 spellchecker document-similarity wikipedia-search wikipedia-crawler ranking-algorithm document-summarization reverse-index

Updated Jun 8, 2021
Python

massanishi / document_similarity_algorithms_experiments

Star

Document similarity algorithms experiment - Jaccard, TF-IDF, Doc2vec, USE, and BERT.

algorithm deep-learning tf-idf jaccard bert new-york-times document-similarity universal-sentence-encoder

Updated Aug 11, 2020
Python

zayedrais / DocumentSearchEngine

Star

Document Search Engine project with TF-IDF abd Google universal sentence encoder model

python data-science machine-learning deep-learning tensorflow text-analysis semantic-search-engine tensorflow-tutorials tfidf semantic-search tensorflow-models text-search document-similarity document-search juypter tfidf-text-analysis text-semantic-similarity universal-sentence-encoder tfidf-vectorizer python-text-analysis

Updated Apr 21, 2020
Jupyter Notebook

meenavyas / Misc

Star

machine-learning deep-neural-networks spark tensorflow document-similarity

Updated Jun 12, 2020
Jupyter Notebook

shrebox / Natural-Language-Processing

Star

Compilation of Natural Language Processing (NLP) codes. BONUS: Link to Information Retrieval (IR) codes compilation. (checkout the readme)

regex word2vec spacy edit-distance generative-model ner doc2vec pos-tagging document-similarity word-similarity hidden-markov-models hmm-viterbi-algorithm nlp-tools discriminative-model

Updated Sep 21, 2020
Python

TarunSunkaraneni / Document-Similarity

Star

Using Jaccard-Similarity and Minhashing to determine similarity between two text documents

jupyter-notebook duplicates minhash jaccard-similarity document-similarity

Updated Mar 3, 2018
Jupyter Notebook

Sarthakjain1206 / Intelligent-Document-Finder

Star

A tool which can find your any document using semantic search

python search-engine natural-language-processing database sqlite-database pandas web-scraping semantic-search pos-tagging relevant-search document-similarity rank-bm25

Updated Jun 8, 2021
Python

blazingeagle1002 / DocumentSimilarity

Star

topic-modeling tf-idf lda document-similarity infersent gensim-doc2vec

Updated Jun 7, 2019
Python

Dohppak / About_Prof.

Star

WebApplication for Similarity between Professor and Keyword based on WordEmbedding

similarity flask-application document-similarity wordembedding

Updated Jan 31, 2019
Jupyter Notebook

mdietrichstein / ir-search-engine-rust

Star

Rust-based text search engine from scratch supporting multiple document similarity metrics (TF-IDF, BM25, BM25VA)

search nlp rust search-engine information-retrieval document-similarity document-search

Updated Jun 5, 2021
Rust

Bit-Nation / notary

Star

The Bitnation Jurisdiction Public Notary DApp

solidity document-similarity timestamping notary

Updated Sep 28, 2018
JavaScript

maxoodf / tgnews

Star

Telegram Data Clustering Contest (Bossy Gnu's submission )

nlp telegram cpp word2vec nlp-machine-learning document-clustering document-similarity document-embedding

Updated Feb 8, 2021
C++

nicoDs96 / Document-Similarity-using-Python-and-PySpark

Star

Document Similarity with Apache Spark using Locality Sesitive Hashing and Python

python lsh pyspark locality-sensitive-hashing document-similarity

Updated Mar 26, 2020
Jupyter Notebook

topcat / pubmed-docsim

Star

Code to train a LSI model using Pubmed OA medical documents and to use pre-trained Pubmed models on your own corpus for document similarity.

python natural-language-processing pubmed medical-information document-similarity latent-semantic-analysis topic-modelling

Updated Feb 17, 2019
Python

yadhu98 / Document-Similarity-using-Python

Star

This is a program used to check document similarity using Natural Language Tool Kit,using Cosine Similarity.

machine-learning nltk document-similarity

Updated Aug 9, 2018
Python

priyanka-ddit / NLP

Star

This repository will demonstrate how to explore spiritual world using NLP techniques like, sentiment analysis, topic modeling, information retrieval and text summarization.

nlp information-retrieval text-analysis text-summarization topic-modeling data-cleaning document-similarity sentime