Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
-
Updated
May 8, 2025 - Python
#
multimodal-generation
Here are 21 public repositories matching this topic...
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
text-to-speech multimodality text-to-image text-to-audio text-to-video text-to-music multimodal-models aigc large-language-models llm text-to-3d multimodal-generation mllm text-to-sound large-vision-language-models multimodal-large-language-models lvlm
-
Updated
Apr 4, 2025 - HTML
OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditions (NeurIPS 2025)
-
Updated
Jan 3, 2026 - Python
Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"
deep-learning image-processing pytorch artificial-neural-networks object-detection image-retrieval banner-generator banner-advertisements encoder-decoder-architecture image-text-retrieval aigc layout-design multimodal-generation poster-generation geneative-creation
-
Updated
Dec 18, 2023 - Python
[ISMIR 2025] A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.
-
Updated
Aug 9, 2025
[NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
-
Updated
Sep 19, 2025 - Python
[ICLR 2024] Contextualized Diffusion Models for Text-Guided Image and Video Generation
-
Updated
May 24, 2024 - Python
[CVPR 2025 Highlight] Official repository for CoMM Dataset
-
Updated
Dec 31, 2024 - Python
[CVPR '23] Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models
imagenet text-to-image semantic-segmentation plug-and-play face-generation multimodal celeba-hq-dataset multimodal-deep-learning face-synthesis text-to-image-synthesis diffusion-models ffhq-dataset text-to-image-generation multimodal-generation text-to-image-diffusion
-
Updated
Mar 31, 2024 - Python
[NeurIPS 2025] GuideFlow3D: Optimization-Guided Rectified Flow For Appearance Transfer
-
Updated
Mar 20, 2026 - Python
The code used to train and run inference with MMDocRAG
information-retrieval multimodal-generation large-language-model vision-language-model retrieval-augmented-generation multimodal-retrieval-augmented-generation
-
Updated
Nov 6, 2025 - JavaScript
A Survey of Multimodal Retrieval-Augmented Generation
multimodal-retrieval large-language-models llms multimodal-generation multimodal-large-language-models retrieved-augmented-generation mllms multimodal-retrieval-augmented-generation
-
Updated
Nov 3, 2025
NeurIPS 2025 D&B | RAG-IGBench: benchmark for RAG-based interleaved image-text generation.
benchmark rag open-domain-qa datasets-and-benchmarks multimodal-generation neurips-2025 interleaved-generation
-
Updated
Jun 10, 2026 - Python
Unofficial PyTorch reproduction for Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling.
pytorch image-generation reproduction vision-language multimodal-generation janus-pro unofficial-implementation
-
Updated
Jun 10, 2026 - Python
Unofficial PyTorch reproduction for OmniGen2, instruction-aligned multimodal generation and editing.
-
Updated
Jun 10, 2026 - Python
[ICML 2026] TMD-Bench: A Multi-Level Evaluation Paradigm for Music-Dance Co-Generation
-
Updated
May 22, 2026 - Python
Unofficial PyTorch reproduction for DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation.
computer-vision pytorch diffusion diffusion-model multimodal-generation mllm manga-generation cvpr-2025 unofficial-implementation
-
Updated
Jun 10, 2026 - Python
[ICML 2026] TMD-Bench: A Multi-Level Evaluation Paradigm for Music-Dance Co-Generation
-
Updated
May 22, 2026 - Python
Unified multimodal generation via image-flow matching in a shared visual latent space
machine-learning research pytorch image-generation image-synthesis latent-space visual-representation multimodal-generation flow-matching
-
Updated
Apr 11, 2026 - Python
Unofficial PyTorch reproduction for Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Models.
computer-vision pytorch vector-graphics diffusion svg-generation llm multimodal-generation cvpr-2025 unofficial-implementation
-
Updated
Jun 10, 2026 - Python
Improve this page
Add a description, image, and links to the multimodal-generation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multimodal-generation topic, visit your repo's landing page and select "manage topics."