2 Mayank_Vatsa
2 Mayank_Vatsa
Mayank Vatsa
Professor and Swarnajayanti Fellow
Fellow, IEEE and IAPR
सृजन, COE on Generative AI
IIT Jodhpur, India
[email protected]
http://iab-rubric.org/
We are stepping into the
world of Foundation Models
Foundation Models
Language
Vision Models Multimodal Audio Models
Models
We are stepping into the
world of Foundation Models
Foundation Models
Language
Vision Models Multimodal Audio Models
Models
From Sight to Sound …
Foundation Models
Language
Vision Models Multimodal Audio Models
Models
What is Generative AI
(or GenAI)?
Generative AI is a category of artificial intelligence models designed
to create new content by learning patterns from existing data.
Deepfake Detection
Example 1:
Sketch to Photo Generation
Sketch to Photo Generation
Input Sketch
Selected Output
Sketch to Photo Generation
Recognizing Injured Faces via SCIFI Loss. IEEE Trans. Biom. Behav. Identity
Sci. 3(1): 112-123 (2021)
Why it is challenging?
Generating Synthetic Injured Faces
to Train Face Recognition Model
(a)
(b)
Real and Synthetic Faces for Training Results on Real Data Results on Synthetic Data
Orissa Train Collision Incident
1 2 3 4 5 6
1 2 3 4 5 6
Synthetic
Real samples
Multiple cases:
Responsible GenAI
Bias and fairness
Synthetic media detection
Model editing and generalization