List of academic resources on Multimodal ML for Music

[CVPR 2021] Multi-Modal-CelebA-HQ: A Large-Scale Text-Driven Face Generation and Understanding Dataset

muon is a multimodal omics Python framework

A curated list of awesome Multimodal studies.

Data Analysis program and framework for materials science data analytics, based on the managing framework SIMPL framework.

Unified storage framework for the entire machine learning lifecycle

Interface for easier topic modelling.

Corpus of resources for multimodal machine learning with physiological signals (mmps).

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

Frontiers in Intelligent Colonoscopy [ColonSurvey | ColonINST | ColonGPT]

An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!

[IEEE TGRS 2022] Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Study of Transformer based models for Multimodal Remote Sensing Image Classification

Collects a multimodal dataset of Wikipedia articles and their images

A fully differentiable set autoencoder

Manage logical datasets!

The backend algorithms and framework associated with DREAM3DNX, a data analysis program for materials science data analytics

A multimodal architecture to build multimodal knowledge graphs with flexible multimodal feature extraction and dynamic multimodal concept generation

A comprehensive collection of data quality resources, tools, papers, and projects across various data types including traditional data, LLM pretraining/fine-tuning data, multimodal data, and more. Essential reference for researchers and practitioners in data-centric AI.

Prompt Engineering and Dev-Ops toolkit for applications powered by Language Models