#

multimodal-learning

Here are 734 public repositories matching this topic...

HenryNdubuaku / maths-cs-ai-compendium

Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.

python nlp computer-science machine-learning statistics reinforcement-learning computer-vision deep-learning math algorithms linear-algebra machine-learning-algorithms probability mathematics artificial-intelligence speech-processing multimodal-learning jax ai-textbook

Updated Jul 18, 2026
TypeScript

pliang279 / awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

machine-learning natural-language-processing reinforcement-learning computer-vision deep-learning robotics healthcare reading-list representation-learning speech-processing multimodal-learning

Updated Aug 20, 2024

mlfoundations / open_flamingo

An open-source framework for training large multimodal models.

computer-vision deep-learning pytorch language-model flamingo multimodal-learning in-context-learning

Updated Aug 31, 2024
Python

KaiyangZhou / CoOp

Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)

multimodal-learning prompt-learning foundation-models

Updated May 20, 2024
Python

Awesome-Multimodal-Research

Eurus-Holmes / Awesome-Multimodal-Research

A curated list of Multimodal Related Research.

awesome multimodal-learning multimodal multimodal-research

Updated Aug 5, 2023
Python

AILab-CVC / UniRepLKNet

[CVPR 2024 & TPAMI 2025] UniRepLKNet

deep-learning architecture artificial-intelligence convolutional-neural-networks multimodal-learning

Updated Aug 10, 2025
Python

PreferredAI / cornac

A Comparative Framework for Multimodal Recommender Systems

collaborative-filtering matrix-factorization recommendation-system recommendation-engine recommender-system recommendation-algorithms multimodality multimodal-learning

Updated Aug 6, 2026
Python

ArrowLuo / CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

search retrieval ranking clip multimodality multimodal-learning multimodal activitynet retrieval-model msvd msrvtt video-text-retrieval lsmdc didemo video-clip-retrieval

Updated Apr 12, 2024
Python

richard-peng-xia / awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

medical-imaging multimodal-learning visual-question-answering multimodal-deep-learning large-language-models medical-report-generation multimodal-large-language-models large-multimodal-models

Updated Jul 29, 2026

DmitryRyumin / ICCV-2023-25-Papers

ICCV 2023-2025 Papers: Discover cutting-edge research from ICCV 2023-25, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support visual intelligence development!

Updated Nov 7, 2025
Python

declare-lab / multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-interactions multimodal-learning multimodal-sentiment-analysis multimodal-deep-learning

Updated Mar 15, 2023
OpenEdge ABL

HuaizhengZhang / Awsome-Deep-Learning-for-Video-Analysis

Papers, code and datasets about deep learning and multi-modal learning for video analysis

machine-learning deep-learning paper video-classification video-analysis multimodal-learning video-dataset

Updated Oct 10, 2021

mlfoundations / MINT-1T

🍃 MINT-1T: A one trillion token multimodal interleaved dataset.

dataset multimodal-learning vision-language-model

Updated Jul 31, 2024

henghuiding / ReLA

[CVPR 2023 Highlight & IJCV 2026] GRES: Generalized Referring Expression Segmentation

multimodal-learning referring-image-segmentation referring-expression-segmentation referring-expression-comprehension vision-language-transformer cvpr2023

Updated Nov 26, 2025
Python

pliang279 / MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

machine-learning natural-language-processing computer-vision deep-learning robotics healthcare representation-learning speech-processing multimodal-learning

Updated Jan 27, 2024
HTML

georgian-io / Multimodal-Toolkit

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

natural-language-processing tabular-data transformer multimodal-learning huggingface-transformers

Updated May 4, 2026
Python

MMMU-Benchmark / MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

machine-learning natural-language-processing deep-neural-networks computer-vision deep-learning evaluation question-answering stem multimodality multimodal-learning visual-question-answering multimodal multimodal-deep-learning foundation-models large-language-models llm llms large-multimodal-models

Updated Jul 28, 2026
Python

sangminwoo / awesome-vision-and-language

A curated list of awesome vision and language resources (still under construction... stay tuned!)

awesome awesome-list multimodal-learning vision-and-language

Updated Nov 4, 2024

llm-lab-org / Multimodal-RAG-Survey

A Survey on Multimodal Retrieval-Augmented Generation

multimodal-learning rag retrieval-augmented-generation

Updated Feb 20, 2026

henghuiding / MeViS

[ICCV 2023 & TPAMI 2025] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

video-understanding multimodal-learning referring-expression-segmentation referring-expression-comprehension referring-video-object-segmentation mose-dataset mevis-dataset

Updated Jan 8, 2026
Python

Improve this page

Add a description, image, and links to the multimodal-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multimodal-learning topic, visit your repo's landing page and select "manage topics."