Implementation of Multi-Head Mixture-of-Depths-and-Experts for group project in NLP course.
Implementation of Multi-Head Mixture-of-Depths-and-Experts Transformer for NLP course.