
Rudrabha Mukhopadhyay
IIIT Hyderabad
talking face generation
lip reading
speech enhancement
diffusion models
out-of-distribution inversion
semantic editing
2
presentations
23
number of views
SHORT BIO
I am currently registered as a Ph.D. student in CVIT, IIIT Hyderabad. My Ph.D. is supervised by Professor C.V. Jawahar from IIIT H and co-supervised by Professor Vinay Namboodiri from IIT Kanpur. My work in IIIT H revolves around multimodal deep learning. Currently, my main focus has been on various problems that involve lip movements and speech. These two modalities are naturally interlinked with each other and thus can be used to solve interesting problems. I have published multiple papers in conferences like CVPR, ACM Multimedia, and WACV on problems based on the mentioned modalities. My broader interest is in audio-visual problems and problems involving other modalities like text and vision, and speech.
Presentations

Understanding the Generalization of Pretrained Diffusion Models on Out-of-Distribution Data
Sai Niranjan Ramachandran and 4 other authors

The Interplay of Speech and Lip Movements
Rudrabha Mukhopadhyay