Top 148 information-retrieval open source projects

Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs

Trinity IR Infrastructure

Accelerated deep learning R&D

Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.

My (slightly modified) Keras implementation of RankNet and PyTorch implementation of LambdaRank.

Burp Extender plugin that generates a sitemap of a website using Wayback Machine

HDLTex: Hierarchical Deep Learning for Text Classification

A Collection of BM25 Algorithms in Python

An Open-Source Package for Information Retrieval.

Word Embeddings for Information Retrieval

NeuralQA: A Usable Library for Question Answering on Large Datasets with BERT

K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling

Learning to Rank in TensorFlow

Books worth spreading

A Python implementation of the BM25 ranking function.

Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search

Topic Modelling for Humans

Terrier IR Platform

Python interface to the Anserini IR toolkit built on Lucene

Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"

Deep neural network to extract intelligent information from invoice documents.

Entity-Duet Neural Ranking Model

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures

The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning

My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.

A curated list of NLP resources for Hungarian

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

🏴‍☠️ Information Gathering tool 🏴‍☠️ DNS / Subdomains / Ports / Directories enumeration

pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.

Simple NLP in Rust with Python bindings

A library of inverted index data structures

Semantic Entity Retrieval Toolkit

Flexible classic and NeurAl Retrieval Toolkit

A Java client for the Sypht API

Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/

Dice Solr Plugins from Simon Hughes Dice.com

pyndri is a Python interface to the Indri search engine.

Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

High performance tokenizers for natural language processing and other related tasks

Unofficial Gaana API

Web Service for E-Discovery Analytics

Vietnamese question answering system with BERT

Text classification with Sparse Composite Document Vectors.

This repository contains the Domain Discovery Tool (DDT) project. DDT is an interactive system that helps users explore and better understand a domain (or topic) as it is represented on the Web.

NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval

Python Keyphrase Extraction module

A collection of research on knowledge graphs

API to let user fetch the events that happen(ed) on a specific date

Notes on Deep Reinforcement Learning for Natural Language Processing papers

A large scale feature extraction tool for text-based machine learning

Dice.com's relevancy feedback solr plugin created by Simon Hughes (Dice). Contains request handlers for doing MLT style recommendations, conceptual search, semantic search and personalized search

A curated list of papers dedicated to neural text (semantic) matching.

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

A Lucene toolkit for replicable information retrieval research

Hardware-accelerated vector-based search engine. Available as a HTTP service or as an embedded library.

My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.

⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.

PISA: Performant Indexes and Search for Academia