Intro to Generative AI-STM
Intro to Generative AI-STM
WALT:
Students will be able to define Generative Al & classify different kinds.
Applying Generative Al tools to create content.
Understanding the ethical considerations of using Generative Al.
Supervised Learning and Discriminative Modelling:
Supervised Learning:
Supervised learning is a machine learning where a model is trained on a labelled dataset,
implying that each input data point is associated with a corresponding output label. The goal of
supervised learning is to learn the mapping between input data and output labels, enabling the
model to make predictions on new, unseen data.
For example: In the given image, first is the input image and characteristics of this image are
marked as boy and ball which can be seen in centre image. Now according to supervised learning, it
must learn the mapping between input labels and output labels, which is shown in last image and
highlights "ball" as red, "boy" as purple and "boy playing with a ball" in a rectangle.
Discriminative Modelling:
Discriminative modelling is an approach in machine learning where the focus is on learning the
boundary or decision boundary that separates different classes or categories directly from the
data. So, if an image contains a combination of Dogs and Cats, the model can tell which is a Dog
and which is a Cat.
In supervised learning, discriminative modelling contrasts with generative modelling, where the
goal is to model the joint probability distribution of both the input features and the output labels.
Generative models can be used to generate new data points that resemble the training data, whereas
discriminative models are primarily focused on classification or regression tasks.
Unsupervised Learning and Generative Modelling:
Unsupervised Learning:
Unsupervised learning is a type of machine learning where the model is trained on input data
without any corresponding output labels. The goal of unsupervised learning is to find patterns,
structure, or representations in the data without human intervention. An unsupervised learning
approach works on an unlabelled dataset. This means that the data which is fed to the machine is
random and there is no know-how available about it to the trainer.
Generative Modelling:
Generative Modelling do not necessarily require labelled datasets. It can work with unlabelled
data to learn the underlying distribution of the data and can generate structured data from the
Random Noise dataset. So, if random images are fed as training data for the model it can create
relevant output based on the features of the input data. For example, if there are random images
which depict streets, cars, buildings, sky etc. Given a dataset of street images, a Generative
Modelling can learn to generate new street scenes that look like the ones in the dataset. In
another example, if given a dataset of news articles, a generative model can learn to generate
new articles that resemble the style and content of the training data.
Types of Generative AI
Generative AI comes in a variety of forms, each with unique advantages and uses. Some of the most
typical varieties are listed below:
1. Text Generation:
Language Models: These generate coherent text based on prompts. Examples include OpenAI's
GPT-3 and GPT-4, Google's BERT, and T5.
Chatbots: AI designed to simulate conversation with users. Examples include OpenAI's ChatGPT
and Google's Meena.
2. Image Generation:
GANs (Generative Adversarial Networks): These generate realistic images from random noise.
Examples include StyleGAN and BigGAN.
VAEs (Variational Autoencoders): These generate images by learning the distribution of input data.
Diffusion Models: These iteratively refine noise to generate images, such as DALL-E 2 and Stable
Diffusion.
3. Audio Generation:
Music Generation: AI that composes music. Examples include OpenAI's MuseNet and Jukedeck.
Speech Synthesis: Converts text to natural-sounding speech. Examples include Google WaveNet
and Amazon Polly.
4. Video Generation: DeepFakes: AI-generated videos that can superimpose faces. Examples
include DeepFaceLab and FaceApp.
Generative Video Models: AI that creates new video content. Examples include VQ-VAE and
MoCoGAN.
5. 3D Object Generation:
3D GANs: Generate three-dimensional objects. Examples include 3D-GAN and PointNet.
6. Code Generation:
AI Code Assistants: These generate or autocomplete code. Examples include GitHub Copilot and
OpenAI Codex.
Benefits of using Generative AI