distilbiobert

Here is 1 public repository matching this topic...

nlpie-research / Compact-Biomedical-Transformers

This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"

knowledge-distillation biomedical-nlp distilbiobert compact-transformer compact-biobert

Updated Mar 26, 2024
Python

Add this topic to your repo

To associate your repository with the distilbiobert topic, visit your repo's landing page and select "manage topics."

Learn more