This repo is the official implementation of "Retrieval-Augmented Dynamic Prompt Tuning for Incomplete Multimodal Learning" accepted by AAAI 2025.
-
Updated
Apr 14, 2026 - Python
#
multimodal-transformers
Here are 2 public repositories matching this topic...
A transformer-based system that generates time-synchronized captions, speaker-attributed transcripts, and abstractive summaries from videos by integrating audio and visual modalities. It leverages CLIP and Whisper embeddings with cross-attention fusion and T5-based generation to produce accurate, context-aware outputs..
computer-vision transformers video-summarization speech-to-text natural-language-generation speaker-diarization video-captioning generative-ai multimodal-transformers
-
Updated
Dec 19, 2025 - Python
Improve this page
Add a description, image, and links to the multimodal-transformers topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multimodal-transformers topic, visit your repo's landing page and select "manage topics."