E2051 - Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

🤗 Upvotes: 23 | cs.LG

Authors:
Minh-Quan Le, Armand Comas, Alexandros Lattas, Stylianos Moschoglou, Pedro Vélez, Amit Raj, Aaron Germuth, Thabo Beeler, Dimitris Samaras, Di Qiu

Title:
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

Arxiv:
http://arxiv.org/abs/2607.13188v1

Abstract:
Human cognition does not separate understanding and generation. A teacher at a whiteboard speaks and draws $\textit{together}$, each modality reshapes the other. In this paper, we bring this coupled loop to artificial systems. Masked Diffusion Models (MDMs) are ideally suited to this task, yet...