A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).

Efficient Inference for Big Models

On Transferability of Prompt Tuning for Natural Language Processing

Code for the paper "Exploiting Pretrained Biochemical Language Models for Targeted Drug Design", to appear in Bioinformatics, Proceedings of ECCB2022.

The code for the ACL 2023 paper "Linear Classifier: An Often-Forgotten Baseline for Text Classification".

A Keras-based and TensorFlow-backend NLP Models Toolkit.

The code of An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answering

The official repository for AAAI 2024 Oral paper "Structured Probabilistic Coding"

Identified ADEs and associated terms in an annotated corpus with Named Entity Recognition (NER) modeling with Flair and PyTorch. Fine-tuned pre-trained transformer models such as XLM-RoBERTa, SpanBERT, and Bio_ClinicalBERT. Achieved F1 scores of 0.73 and 0.77 for BIOES and BIO tagging models, respectively.

A python tool for evaluating the quality of few-shot prompt learning.

LSTM models for text classification on character embeddings.

Fine tuned BERT, mBERT and XLMRoBERTa for Abusive Comments Detection in Telugu, Code-Mixed Telugu and Telugu-English.