0% found this document useful (0 votes)
43 views

Training Tracker - ECT-DEV AI-ML Group

Uploaded by

Richie Sam
Copyright
© © All Rights Reserved
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
43 views

Training Tracker - ECT-DEV AI-ML Group

Uploaded by

Richie Sam
Copyright
© © All Rights Reserved
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
You are on page 1/ 206

Date 20-Feb-24

Kishor Bhagvat Jadhav SDP Training

Started with Python concept Casting, Tuple, Set


Madhurendra Purbay
and SQL basics.

Refreshed python concept and set up python, vs code for


Md Salmaan Azam
django framework.

Pagadala Sukhanth Babu Revising Python basics, ML,CNN and NLP concepts

Working on Architecture design of workflow management


Pramod Kumar Galipalli
process shared by Joseph

Rahul Dhruv Rana SDP Training

Chatbot guided proj-FastAPI as Backend,SQL-Database,


Richard G R
Dialogflow-Manages user input

Fastapi framework, REST Architecture, Uvicorn server,


Roshan Kumar Sharma Pydantic library, how to connect database and perform
CRUD operations

Sagar Shivansh Khare Worked on SDP assignment

Read the Django Documentation, intro and it's overview


Shiv Kumar
and FAST API operations

Revising Python and its libraries including Pandas , Numpy,


Simmi Singh
Matplotlib and Seaborn.

Learninng FastAPI and how to connect database and


Suman Kar
perform CRUD operations
21-Feb-24

SDP Training

Went through Python conditions, loop, lambda fun,


Class and opps concept. Started with FastAPI and SQL

Refreshed oops concept and read about Django template

setup python, vscode and done hands on fast api


framework , Uvicorn server, creating routes, handling post
requests,pydantic models

80% of the HLD for workflow management process is


complete

SDP Training

Glimpse on Vector db-milvus,Continued learning on FastAPI

Learning standard code structure from sources like medium

Set up the VS code and started learning python

FastAPI - Pydantic Basemodel, Model Validation, Data


validation using Pydantic

Installed and setup Python and VS code. Learned how to


read a pdf using a pdf reader. Learning how to split if there
is script written on the both sides of the page.

Set up VS code in my office laptop and started with Path


Parameter, Query Parameter, Request body and Pydantic
basemodel
22-Feb-24

SDP Training

Went through Python DATE,MATH, JSON and FAST API


Hello Word, Uvicorn,mypy, About Rest Architecture,

Learned about ORM, making Form page, doing operations


and using Static pages and changing into dynamic in Django

Hands on fastapi like multiprocessing, error handling,


dependency injection,configuration
cors in Fast API

100% completion of the HLD for work flow process and sent
for review. Completed security controls document for web
application without VPN.

SDP Training

Touched a bit on regexp,manipulation of JSON, Django


components
Learning to pass path parameters,
query parameters,
creating models,
and practising to write better code structure
by building sample app

Explored the tuples, set, list, dictionaries, along with control


statements

FastAPI - Request Methods + delay functions

Read FastAPI documentation and practiced its get and post


requests along with some basic examples of datasets. Also
did splitting the script of a pdf file, now learning how to
feed this text in LLM interface.

Read the FastAPI documentation of SQL database, status


code and completed all 4 request method-
GET,PUT,POST,DELETE with hands on demo.
23-Feb-24

SDP Training

Most of time spent with IT team for Linux configuration.


Exploreed Python RegEx, PIP, Exception handling,
FastApi Parameter Validation, Request body

Learn about Setting up Postgresql and Pgadim and


Refreshed SQL commands and Functions

Hands on fastapi modules graphQL,websockets,


typehints,IDE support
Going through Langchain document

Leave

SDP Training

Django, Postgres-pgadmin setup,Decorators

creating sample app to practice fastapi(in progress) and


implementing the code structuring learnt so far

Explored the OOPs concepts, dateTime module, Math


Functions, JSON packages

FastAPI - Security/Authentication

Was able to extact the text or paragraphs in pdf file in a


readable format.

Created another sample table and perform all 4 request


mode
26-Feb-24

SDP Training

Explored database connection with python,


Run diffrent SQL query using python and model writing

Revised conversion of a static page into a dynamic page,


learned about Jinja template for loop case and conditional
statement, Refreshed SQL constraints

done basic crud operations(post,put,get,delete) and


gone through fastapi architecture and langchain document

Worked on converting open source vulenerability scan tool


from python 2.4 to 3.8, researched on open source log
analyser fluentd and Nikto vulenerability scan tool.
Installing docker for it.

SDP Training

Django-Forms,URLs,Views,Templates,begun a mini proj

Learnt sql_alchemy ORM,


implemented in sample project,
learnt and implemented the use of sessionmaker,
learning jwt authentication,
implementation of jwt authentication in progress

Explored the constructs like file-handling and error-handling

Django MTV architecture, project create, app create,


development server

Extracted tables in pdf. Setup FAST API in VS code. Practiced


the codes in FAST API Documentation.

Gone through API Router and relationship documentation


of FastAPI.
27-Feb-24

SDP Training

Hand on with Fast API request body, parameter validation,


Body Fields

Explored concepts on adding and fetching data from


database, Learned about user registrations, login and logout

different integations of langchain with providers like


openai, huggingface,
google,microsoft and anthropic and their algos

Worked on Nikto vulnerability tool setup. Installed the


docker engine. Fixing the bugs in Grabber tool.

SDP Training

Explored and practiced components within Django-


ORM,CRUD
understanding session token,
jwt token,
differences between them,
why jwt was necessary, implementing jwt
authentication in practice project

Hands-on with python and set-up the django framework,


set-up and installed the docker desktop

Django admin createsuperuser, model creation, activating


models, terminal shell API use

Extracted tables along with text present in pdf file. In Fast


API Learned routing including path and query parameters
as well as API documentation using swagger.

Gone through OAuth2 with Password and JWT


documentation and also practically implemented APIRouter
28-Feb-24

SDP Training

Hand on Fast API on topic likes Nested Model,


Declare request with example data, Header parameter,
Return model type, Extra model, and response status code

Went through the django rest framework documentation


and setup the virutal enviornment and installed the
necessary packagess.
have reached out to it team for the ubuntu
Nikto in
installation can scan
the vulnerability
laptop , fix somescan is working
problems and done
Grabber has challenges with beautifulsoup
coding practice in my laptop dependency
with 2.7 and pip installation- ruled out
Wapiti3 has challenges with the dependencies conflict -
ruled out
Jfrog vulnerability scan has been installed. It is a paid but 15
day trial is present.Server is not starting with the docker run
command.informed the support.
Tenable is a paid software for network vulnerability scan. It
can be used.
Sonarqube - code quality SDPandTraining
security w.r.t code. Working
on the installation of the opensource.

Django-ORM, Custom migrations, REST

Practised and implemented jwt_authentication,


made 4 APIs to understand user role management
(access view for superadmin and normal user)

Started learning of Django and read about its


documentations.

DjangoTemplates, HTTP responses, renderer, URL


dispatcher

In FastAPI, studied Requesting body, debugging, SQL


database using SQL alchemy, Object Relational Mapper,
Creating Models and tables.

Gone through OAuth2 with Password and JWT


documentation and hands on JWT access token and router
behind authentication.
29-Feb-24

SDP Training

Hand on Fast API on topic Form Data, Request File,


Request Forms and File, Handling errors

Read about Serialization, creting a model for Seralizer and


Serializer class, Writing django views using Serializer, Tested
Web API
Have explored linux configuration how to activate vpn
and setup vscode,anaconda,ms teams,outlook and done
hands on fast api which i have done in my system when
it was windows config

Worked on Jfrog installation and log analyser installation. It


is still in proogress.

SDP Training

Learnt to Convert Function based views to class


based,Model query,REST & Serializers

Learning middleware, error handling,


and how to invalidate jwt_token for any specific user

Created an simple app and made it dockerized and Explored


about Docker-Compose

Django request post method from template

Installed table plus, Database connection, Creating Pydantic


Schemas, Continued creating Models and table, store blogs
to database.

Verify user logged in, Testing Expired token, Go through


JWT access token, Understanding OAuth with the spotify
API and continue FastAPI tutorial.
1-Mar-24

SDP Training

Created Simple registration with User models, Exploared


CryptContext for password hashing

Read about How can we Request and Response, API Views,


GET, POST, PUT, PATCH and DELETE request methods.

Explored openai and gemini pro versions

Worked on Jfrog installation and log analyser installation. It


is still in proogress.

SDP Training

API, Setted up Postman, Created a mini proj possessing crud


operations

Made several APIs to learn and practise FastAPI

Dockerized the two app using Docker-compose and was


able to run from different different containers using single
image file.

Django documentation MVT architecture

Went through the theory of Response model creation,


Creating a user, hashing password, showing the user,
relationship and API router.

Went through Foreign key concept and also practically


implemented it. Assiging owner Id when create new blog( at
first encounter with an error, and it takes full day to
understand)
4-Mar-24
Revising basic concepts of Python,Datatypes,Functions,
Methods,Loops.
Setup and Installation of Python,VScode,Anaconda.

Read out SQL Query in Python different joins, order by,


Group by, In FastAPi went though email verification while
doing user registration

Read about Class-based Views and Authentication and


permission

read the documentation of gemini pro vision


version

Worked on Jfrog installation and log analyser installation. It


is still in proogress.

Basics of transformers and its applications

Serializers,Auth with JWT,Implemenatation of jwt

Learnt how to invalidate jwt_token, middleware


implementation

Started exploring Django's architectures along with Django


Shell

Not Well

Created two APIs on User creation, user


authentication(Token authentication) using OAuth2.

Practially implemented delete and update on your own


blog, went through relationship again and worked on
search,limit,skip query parameters.
5-Mar-24
Explored Python libraries numpy, matplotlib, pandas, scikit-
learn, Keras
Started working on tag prediction use case (Mini Project)

Leave

Read about Relationship and Hyperlinked API, and Viewset


and Routers
Have tried image captioning by using gemini pro vision
version 3 and its capability of short prompting after feeding
the data and its description in a specific JSON format and it
will note on the new image just like analogies

Worked on Jfrog installation and log analyser installation. It


is still in proogress.

Huggingface interface and challenges with transformers

Exploited the usage of simple jwt package and embedded in


the endpoints where required, Storing Jwt tokens-
inprogress
Learnt and implemented WebSockets support, API
versioning,
customisation of openapi_schema,
Background Tasks

Explored the Django's templates, HTTP method:- GET and


POST, Set-up the PostgreSQL and pgAdmin

Django template example create a poll,using POST method

Went through the concepts of middleware, logging, error


handling, authentication and started working on a project
that will include all the conecpts of FastAPI.

Leave
6-Mar-24
Learn about the deep learning models ANN and CNN,
Designed a basic Artificial Neural Network (ANN) model for
classifying tags.

Leave

Read about Simple JWT, created enviornment and installed


django and drf, Create Custom User model and Custom
UserModel admin

went through basic word embeddings like Bag of words,


Term frequency-inverse document frequency and
word2vec and how it vectorizes the features for each token

Worked on Jfrog installation and ELK log analyser installed -


configuration for memory is pending. It is still in proogress.

Training a transformer based text classifier


as feature extractor

Managed & Stored JWT, Django Search

Learning cookie parameters, header parameter,


threading in python,
implementing invalidation of jwt token
(facing issue, resolving)

Leave

Implemented example of django tutorial till part 5

Understood testing and API Versioning. Added basic HTTP


requests, path parameter and query parameter examples in
the project.

Understood enviornment variable which can be used to


secure the credentials. Created one vote table in my project
and try to create vote route and user can vote any blogs.
7-Mar-24

Completed a mini-project on tag prediction and Explored


CNN pretrained models like VGG16, VGG19

Implementing send email for user verification


while doing registration, Exploring JWT, Message Schema,
FastEmail, dotenv_values

Implemeted a User Registration, Login, Profile View, and


Change passwpord by using the JWT tokens.

have gone through word embeddings and preprocess the


text data like removing stop words before feeding
into the embeddings

Had a meeting with jfrog team. A few issues were resolved.


Today I have a call with the team to reolve more issues with
jfrog. ELK memory allocation research is in progress.

Training a text classifier as Fine-tuning


transformers

Execution of Search by title, web Socket, Chanelling

Resolved the issue faced while


implementing invalidation of jwt token,
Learning concurrency, threading

Leave

Intro to automated testing through shell terminal,


customize app,showing views poll, insert data to database

Added different sections in the Fast API project including-


Request Body, Query Parameters and String Validations,
Path Parameters and Numeric Validations, Body - Multiple
Parameters, Body - Fields and Body - Nested Models.

Understand joining concept in SQL and tried to


implemented in sqlalchemy but stuck with an error, looking
for the solution.
8-Mar-24
Explored word Embedding Techniques like Bag of words
(BoWs), Term Frequency-Inverted Document Frequency
(TF-IDF),Word2Vec Read about the Inception model

Implemented send email for user verifcation while doing


User registration, Genrating token for users and verifying it
Explored socket programing

Implement the changes in User Login and User change


password and implemented the backed for sending a
password rest link via mail and reset it using the mail

started reading the concepts of stemming,


lemmetization,RNN,N-gram model, LSTM and Bi-directional
RNN

Worked on jfrog installation. Docker container ip is attached


with 25672 port. Even after uninstallition of the RabbitMQ
container IP is attached to port. Trying to resolve the issue.

Word embeddings

Getting started with sample project on API's to manipulate


pdfs.

Implemented and practised threading


and practised to use concurrent.futures
library in python

Leave

static templates files in django, customize admin form,


debug toolbar

Added few more topics including - Declare Request Example


Data, Extra Data Types, Cookie Parameters, Header
Parameters, Response Model - Return Type, Extra Models,
Response Status Code, Form Data, Request Files, Request
Forms and Files
Gone through Error Handling, How to upload file and image
using FastApi, and still looking for the soltuion on last day
error issue.
11-Mar-24
Introduction to Large Language Models and their Problems
-->History of LLM, Pretraining, Finetuning, Jailbreak, Prompt
Injection & Backdoor attacks, etc.

Work on implementation part of Websocket and


Explored Fast API security OAuth2, with the Password flow,
using a Bearer token.

Erros Solving on SMTP Authenticationa and Started working


on Djsore Authentication Project

read about the sequence to sequence models which are


encoders-decoders and how it can be used for
for image captioning(image to text) by adding standard CNN
in place of encoder

Completed the installation of ELK cloud. Jfrog Xray needs 2


separate instances with 8GB ram and 100 GB storage.

Ensemble learning

Working on the pdf API project, trynna figure & debugging


the errors thrown

Learning CORS, Path operation configuration,


Dependencies - classes as dependencies,
sub dependencies, Global Dependencies,
Dependencies with yield

Explored the Django ORM, some functions like filter(), get()


and explored the postgres and pgAdmin

Tags, syntax, filters in a template and its components, html


basics + mini project setup

Exception handling, Path Configuration, Added path tags to


all the above codes, Cookie parameter and its age.

Fixed the last day error issue and trying to hands on image
file upload and started alembic as migration tool youtube
video.
12-Mar-24
worked on a mini project where developed a text
generation model focused on Shakespearean text, utilizing
a single-layer LSTM for text prediction, and assessed the
outcomes across different temperatures.
Debug send email using FastMail and smtplib,
Hand on some use case of FastApi Security like
login with username and password, parallelly working on e
commerce use case
Downloaded Postgresql and Mysql and Revised DRF
tutotials on Serializer, Request and Response , class based
views.
Have gone through mutiple blogs to underdsand
the architecture of attention models and different types
of attention models like global, local attention models
to improve bleu score for long sentences

Worked on documentation of Vulnerability scan report.

Bagging and Boosting techniques


implementatiion

Debugged and resolved the csrf cookie error ,thus the


creation of endpoints on top of opensource library has been
achieved
Continued learning about Threads:
- how threads are created by the python virtual interpreter
- creating threads for methods in class, for static methods
- built-in funtions in threading
- Lock in threading
- Need of RLock
- exception in multithreading, etc.
Continuation to exploring postgres and pgAdmin things and
Dockerized both of them into container

bootstrap framework(nav bar components, forms) to use in


Django template, small blog website mini project

Added JSON Compatible Encoder, Dependencies , Class


dependencies, Sub-Dependencies, Dependencies in path
operation decorators and Security in the FAST API Project.

Hands on image file upload and understand the Alembic


tool and started with the Email verfication in Fastapi
3/13/2024
Working of Sentiment Analysis and its types, Word Cloud
creation, Post-processing of sentiment classification and its
evalution

Explored FAST API DB connection by using SQLAlchemy


also spent time on e commerece use case

Solved SMTP Authentication Error and it's sending mail to


users. Added an API call for deleting users from the
database.

i am working on
a mini project on lstm and cnn for predicting image caption
for the image

Submitted the consolidated Vulnerability scan report with


implementation instructions to Joseph

Email Classification using different models

Working on the Sample Chat Room Project based on


websocket

continued learning about threads and working for demo for


each concept in multi-threading in python

Debugged the authentication issue w.r. t creating


connection between local machine to docker container.

Made some API's to get the filtered data, & models having
one one relation as suggested by Debashish

Added JWT Authentication and Middleware example to the


Fast API project. Solved some response issue with cookie
parameter.

Hands on Alembic autogenrative command as migrate all


the table and adding new column changes. also goining
through the Sending email verification part.
3/14/2024

worked on a small-scale project focused on the sentiment


analysis and classification of Amazon product reviews.

Create SQLAlchemy models from the Base class, Work on E


commerce usecase, Explored Pydantic model and db query

Gave a Demo of my Authentication Project. Explored more


on JWT Tokens and Implemented an API for generating new
access token using the refresh token.
i have used transfer learning for extracting image features
and fed to fully connected network and used lstm model for
sequential data used these two as encoder with relu
activation functionand decoder for predicting caption with
256 units

Gone through the old Architecture document of NHMind

Email Classification using different models


and comparing results

Made ready the sample chat room- 2 modules; one for user
auth and other handles consumers responsible for async
conversation between users;

working for demo in multi-threading(covering all the


concepts for demo which are mentioned in documentation
of python)

Started exploring SQL injection along with OS command


injection in Django

Implemented other model relations like many to many, one


to many and made some changes in API to POST data and
get data based on model

Modified some parameters of the Fast API Project and


started exploring SQL Alchemy.

tart exploring Fastapi-mail package, email as background


task and today i will implement the mail verfication part
and will show you the demo next day
3/15/2024

Explored Traditional Machine learning Algorithms like Linear


regression, Multiple linear regression, Logistic regression

i have done a project Next word prediction by using Bi-


Directional LSTM and comparing results(accuracy) with the
normal LSTM for the range of epochs

Gone through the old Architecture document of NHMind

Developing and assessing natural language models


ranging from traditional methods to state-of-the-art
transformers, with real-time application evaluations.

FastAPI, python self learning with multiple mini projects

Created several projects related to different different use


cases

Mini Project

Fast API self learning , PDF read code and Fast API Project.

Fast API Project


3/18/2024
Explored Traditional Machine learning Algorithms like
Decision tree, Naïve Bayes, K nearest neighbors, Random
forest, Association rule etc

Had a session with Joseph on Stringer Archicture. Then,


started working on the Architecture document.

Learned and implementing SQL Relational Database


example in the project.
Remarks
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

Started with Python concept Casting, Tuple, Set


20-Feb-24
and SQL basics.

Went through Python conditions, loop, lambda fun,


21-Feb-24
Class and opps concept. Started with FastAPI and SQL

Went through Python DATE,MATH, JSON and FAST API


22-Feb-24
Hello Word, Uvicorn,mypy, About Rest Architecture,..

Most of time spent with IT team for Linux configuration.


23-Feb-24 Exploreed Python RegEx, PIP, Exception handling,
FastApi Parameter Validation, Request body

Explored database connection with python,


26-Feb-24
Run diffrent SQL query using python and model writing.

Hand on with Fast API request body, parameter validation,


27-Feb-24 Body Fields

Hand on Fast API on topic likes Nested Model,


28-Feb-24 Declare request with example data, Header parameter,
Return model type, Extra model, and response status code
Hand on Fast API on topic Form Data, Request File,
29-Feb-24
Request Forms and File, Handling errorsr

Created Simple registration with User models, Exploared


1-Mar-24
CryptContext for password hashing

Hand on class conept and SQL joins ,


4-Mar-24 Went throughemail
verification for user registration

5-Mar-24 Leave

6-Mar-24 Leave

Implementing send email for user verification


7-Mar-24 while doing registration, Exploring JWT, Message Schema,
FastEmail, dotenv_values

Implemented send email for user verifcation while doing


8-Mar-24 User registration, Genrating token for users and verifying it
Explored socket programing

Work on implementation part of Websocket and


11-Mar-24 Explored Fast API security OAuth2, with the Password flow,
using a Bearer token.
Debug send email using FastMail and smtplib,
Hand on some use case of FastApi Security like
12-Mar-24
login with username and password, parallelly working on e
commerce use case

Explored FAST API DB connection by using SQLAlchemy


13-Mar-24
also spent time on e commerece use case : User registration

Create SQLAlchemy models from the Base class, Work on E


14-Mar-24
commerce usecase, Explored Pydantic model and db query
Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Python Syntax, Comments, Tuple, set,Dict, SQL basics

Explored Python loop, For loop , brreak statement, if else,


Fuctions, Class, Inheritance, Iterator, Polymorphism, SQL
agrregator TOP LIMIT SUM MAX

Went through Python DATE,MATH, JSON and FAST API


Hello Word, Uvicorn,mypy, About Rest Architecture, Path
parameter in GET, Will statrt from Query Parameters

Most of time spent with IT team for Linux configuration.


Exploreed Python RegEx, PIP, Exception handling,
FastApi Parameter Validation, Request body, and
SQL db connection in Python

Explored Python connector,connect, execute also run


different
SQL query on database using python select, insert, create
db,Update

Hand on with Fast API request body, parameter validation,


Body Fields
Uses Query, Path, Annotated, Field

Explored topics: Nested Model,


Declare request with example data, Header parameter,
Return model type, Extra model, and response status code
Hand on Fast API on topic Form Data, Request File,
Request Forms and File, Handling errors

Created Simple registration with User models, Exploared


CryptContext for password hashing, Used Dict, List,
datetime

Read out SQL Query in Python different joins, order by,


Group by, In FastAPi went though email verification while
doing user registration

Implementing send email for user verification


while doing registration, Exploring JWT, Message Schema,
FastEmail, dotenv_values, Setting up .env file
Creating HTML template for email

Implemented send email for user verifcation while doing


User registration, Genrating token for users and verifying it
Explored socket programing , Connecting with on particular
token

Work on implementation part of Websocket and


Explored Fast API security OAuth2, with the Password flow,
using a Bearer token. Will start doing hand on Fast API
security
Debug send email using FastMail and smtplib,
Hand on some use case of FastApi Security like
login with username and password, parallelly working on e
commerce use case

Explored FAST API DB connection by using SQLAlchemy


also spent time on e commerece use case : User registration

Create SQLAlchemy models from the Base class, Work on E


commerce usecase, Explored Pydantic model and db query
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://www.w3schools.com/python/

https://www.w3schools.com/python/https://docs.python.org/3/tutorial/index.html

https://www.tutorialspoint.com/fastapi/index.htmlhttps://fastapi.tiangolo.com/

https://www.tutorialspoint.com/fastapi/index.htmlhttps://fastapi.tiangolo.com/

https://tortoise.github.io/getting_started.html
https://www.w3schools.com/sql/sql_create_db.asp
https://www.w3schools.com/sql/sql_create_table.asp

https://fastapi.tiangolo.com/tutorial/query-params-str-validations/

https://fastapi.tiangolo.com/tutorial/extra-models/
https://fastapi.tiangolo.com/tutorial/handling-errors/

https://fastapi.tiangolo.com/tutorial/handling-errors/

https://www.youtube.com/watch?v=gdKBn5cp3TM&list=PLU7aW4OZeUzymX37MosNIT44FLnF-OKdB&index=4https://www.w

https://www.youtube.com/watch?v=gdKBn5cp3TM&list=PLU7aW4OZeUzymX37MosNIT44FLnF-OKdB&index=4

https://fastapi.tiangolo.com/advanced/websockets/#__tabbed_1_1

https://fastapi.tiangolo.com/tutorial/security/first-steps/https://fastapi.tiangolo.com/advanced/websockets/#__tabbed_1_1
https://fastapi.tiangolo.com/tutorial/security/simple-
oauth2/
https://www.youtube.com/watch?
v=g_CIIUrbubY&list=PLU7aW4OZeUzymX37MosNIT44FLnF-
OKdB&index=5

https://fastapi.tiangolo.com/tutorial/sql-databases/https://www.youtube.com/watch?v=ijiVby4g4oI&list=PLU7aW4OZeUzym

https://fastapi.tiangolo.com/tutorial/sql-databases/https://www.youtube.com/watch?v=ijiVby4g4oI&list=PLU7aW4OZeUzym
Additional Notes (If any)

Covered regression
Learned ggplot

str-validations/
#__tabbed_1_1
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

Refreshed python concept and set up python, vs code for


20-Feb-24
django framework.

21-Feb-24 Refreshed oops concept and read about Django template

Learned about ORM, making Form page, doing operations


22-Feb-24
and using Static pages and changing into dynamic in Django

Learn about Setting up Postgresql and Pgadim and


23-Feb-24
Refreshed SQL commands and Functions

Revised conversion of a static page into a dynamic page,


26-Feb-24 learned about Jinja template for loop case and condition
statement, Refreshed SQL constraints

Explored concepts on adding and fetching data from


27-Feb-24 database, Learned about user registrations, login and
logout.

Went through the django rest framework documentation


28-Feb-24 and setup the virutal enviornment and installed the
necessary packagess.
Read about Serialization, creting a model for Seralizer and
29-Feb-24 Serializer class, Writing django views using Serializer, Tested
Web API

Read about How can we Request and Response, API Views,


1-Mar-24
GET, POST, PUT, PATCH and DELETE request methods.

Read about Class-based Views, and Authentication and


4-Mar-24
permission

Read about Relationship and Hyperlinked API, and Viewset


5-Mar-24
and Routers

6-Mar-24 Started Working on a Autheraization mini project.

Implemeted a User Registration, Login, Profile View, and


7-Mar-24
Change passwpord by using the JWT tokens.

Implement the changes in User Login and User change


8-Mar-24 password and implemented the backed for sending a
password rest link via mail and reset it using the mail

Erros Solving on SMTP Authenticationa and Started working


11-Mar-24
on Djsore Authentication Project
Downloaded Postgresql and Mysql and Revised DRF
12-Mar-24 tutotials on Serializer, Request and Response , class based
views.

Solved SMTP Authentication Error and was able to send


mail to the user. Implemented an API for deleting users
13-Mar-24
from the database. Explore concepts of Select_Related and
Prefetch_related

Gave a Demo of my Authentication Project. Explored more


14-Mar-24 on JWT Tokens and Implemented an API for generating new
access token using the refresh token.
Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Refreshed python concept and set up python, vs code for


django framework.

Revised Classes, Inheritance, polymorphism and In Django


build an basic app and testing django templates

Learned about Object Relationship Mapper, create a Form


and done some operations, Learned about two Request
Method : Get and Post, Download a Free Static Template
for UI and used it to create my front page and later changed
it into Dyanamic page.

Learned about Setting up Postgresql and pgadmin, Models


and Migrations, RE-migration,(How to create tables from
Django and alter it) andRefreshed SQL commands and
functions.

Revised conversion of a static page into a dynamic as I am


stuck in installing Postgres, learned about Jinja template for
loop case condition statement, Refreshed SQL constraints

Explored concepts on adding and fetching data from


database, Learned about user registrations, login and logout

went through the django rest documentation and installed


the rest framework package, trying to start the runserver
and stucked in one Assertation error, which took the whole
day.
Read about Serialization, creting a model for Seralizer and
Serializer class, Writing django views using Serializer, Tested
Web API

Read about How can we Request and Response, API Views,


GET, POST, PUT, PATCH and DELETE request methods.

Read about Class-based Views, using mixins and generic


class based views, add login in the browsable API, Different
project level permission: AllowAny, IsAuthenticated,
IsAdminUser, IsAuthenticatedOrReadeOnly

Read about different Relationships in DRF like Foreignkey


relationship, Nested Relationship and Hyperlinked
Relationship, Viewset, Difference between Viewset vs View,
and DefaultRouters and SimpleRouters

Read about Simple JWT, created enviornment and installed


django and drf, Create Custom User model and Custom
UserModel admin

Implemeted a User Registration, Login, Profile View, and


Change passwpord by using the JWT tokens.

Implement the changes in User Login and User change


password and implemented the backed for sending a
password rest link via mail and reset it using the mail. I got
Stucked in SMTPAuthenticationError.

SMTP Authenatication error is still unsolved. Most of the


time spend on solving that error. Laslty Started learning
about another authentication project using djoser library
and MySql database. Did necessary installations and
downalod MySQL but unable to install as it is also asking for
admin username and password.
Downloaded Postgresql and Mysql and Revised DRF
tutotials on Serializer, Request and Response , class based
views.

Took help from Subramanium to solve the SMTP Error, Able


to send mail now. Explore the concept of select_related and
Prefetch_related as suggested by Subramanium. Later, I
implemented a Deleteview on Deleting user.

Gave a Demo of my Authentication Project to the team.


Manish told me to add a Generate New Access Token
feature when it expires so I explored the JWT token again
and implemented API View for generating new access
token in my project
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

OOPs Concept: https://www.javatpoint.com/python-oops-concepts Telesku Django Basic Tutorail : https://www.youtube.com

https://www.youtube.com/watch?v=Tt3mgy2ECug&list=PLsyeobzWxl7r2ukVgTqIQcl-1T0C2mzau&index=12&ab_channel=Tel

https://www.w3schools.com/sql/sql_syntax.asp

https://www.w3schools.com/sql/sql_constraints.asp https://jinja.palletsprojects.com/en/3.0.x/templates/

https://www.youtube.com/watch?v=ExTaxRmDnP8&list=PLsyeobzWxl7r2ukVgTqIQcl-1T0C2mzau&index=21

https://www.django-rest-framework.org/
https://www.django-rest-framework.org/tutorial/1-serialization/

https://www.django-rest-framework.org/tutorial/2-requests-and-responses/

https://www.django-rest-framework.org/tutorial/3-class-based-views/ https://www.django-rest-framework.org/tutorial/4-au

https://www.django-rest-framework.org/tutorial/5-relationships-and-hyperlinked-apis/#tutorial-5-relationships-hyperlinked-a

https://www.youtube.com/watch?v=lo7lBD9ynVc

https://www.youtube.com/watch?v=lo7lBD9ynVc

https://www.youtube.com/watch?v=lo7lBD9ynVc

https://www.youtube.com/watch?v=_IKk553cH2s&t=4547s
https://www.django-rest-framework.org/

https://www.youtube.com/watch?v=_IKk553cH2s&t=4547s https://docs.djangoproject.com/en/5.0/ref/models/querysets/

https://django-rest-framework-simplejwt.readthedocs.io/en/latest/creating_tokens_manually.html
Additional Notes (If any)

Covered regression
Learned ggplot
-serialization/
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 Revising Python basics, ML,CNN and NLP concepts

setup python, vscode and done hands on fast api


21-Feb-24 framework , Uvicorn server, creating routes,
handling post requests,pydantic models

22-Feb-24 Exploring Fast API and features

Exploring Fast API and its features


23-Feb-24
& started Langchain

26-Feb-24 Going through langchain document

Explored Langchain document and its different


27-Feb-24
integrations and models

28-Feb-24 Have spent whole day for ubuntu installation


most of the time spent in exploring linux configuration how
29-Feb-24 to activate vpn
and setup vscode,anaconda,ms teams,outlook

1-Mar-24 Explored openai and gemini pro versions

read the documentation of gemini pro vision


4-Mar-24
version

5-Mar-24 Hands on gemini pro vision in google collab

read about the BOW, TF-IDF vectorizers and


6-Mar-24
word embeddings

read about the Glove embedding, text


7-Mar-24
preprocessing techniques

Have gone through the concepts of stemming,


8-Mar-24
lemmetization and Bi-directional RNN

11-Mar-24 started reading sequence to sequence models


12-Mar-24 Understand the attention model building

13-Mar-24 Gone through tranformers architecture

14-Mar-24 Image captioning project by using lstm and cnn


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

python data types(list,tuple,sets,ductionaries) and


RNN,LSTM

Hands on Fast API and UVIcorn by creating routes,


query parameters in function,path partameters,
Handling post requests,pydantic models

Hands on fastapi like multiprocessing, error handling,


dependency injection,configuration
cors in Fast API

Hands on fastapi modules graphQL,websockets,


typehints,IDE support
Going through Langchain document and
different integration for LLMs

done basic crud operations(post,put,get,delete) and


gone through fastapi architecture and langchain document

different integations of langchain with providers like


openai, huggingface,
google,microsoft and anthropic and their algos

have reached out to it team for the ubuntu


installation in the laptop , fix some problems
Have explored linux configuration how to activate vpn
and setup vscode,anaconda,ms teams,outlook and done
hands on fast api which i have done in my system when
it was windows config

i have gone through langchain providers openai and


gemini pro documentations and had done hands on
by executing the code in google collab

read the documentation of gemini pro vision


version

Have tried image captioning by using gemini pro vision


version 3 and its capability of short prompting after feeding
the data and its description in a specific JSON format and it
will note on the new image just like analogies

went through basic word embeddings like Bag of words,


Term frequency-inverse document frequency and
word2vec and how it vectorizes the features for each token

Refered word embeddings and preprocess the text data


like removing stop words before feeding
into the embeddings

After a quick revision of RNN, LSTM i explored lexical,


syntatctic analysis and text preprocessing techniques
like stemming , lemmetization

read about the sequence to sequence models which are


encoders-decoders and how it can be used for
for image captioning(image to text) by adding standard CNN
in place of encoder
Have gone through mutiple blogs to underdsand
the architecture of attention models and different types
of attention models like global, local attention models
to improve bleu score for long sentences

along with reading transformer architecture and bert


models i have build
a mini project on lstm and cnn for predicting image caption
for the image

i have used transfer learning for extracting image features


and fed to fully connected network and used lstm model for
sequential data used these two as encoder with relu
activation functionand decoder for predicting caption with
256 units
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://www.analyticsvidhya.com/blog/2021/03/introduction-to-long-short-term-memory-lstm/LSTMs Explained: A Complete

https://www.youtube.com/watch?v=7t2alSnE2-I
https://www.geeksforgeeks.org/fastapi-introduction/

https://www.youtube.com/watch?v=7t2alSnE2-I
https://www.geeksforgeeks.org/fastapi-introduction/

https://www.youtube.com/watch?v=7t2alSnE2-I
https://www.geeksforgeeks.org/fastapi-introduction/
https://python.langchain.com/docs/integrations/
platforms/a

https://www.youtube.com/watch?v=7t2alSnE2-I
https://www.geeksforgeeks.org/fastapi-introduction/
https://python.langchain.com/docs/integrations/platfo
rms/a

https://python.langchain.com/docs/integrations/platfo
rms/a
https://www.youtube.com/watch?
v=_FpT1cwcSLg&list=PLZoTAELRMXVORE4VF7WQ_fAl0L1Gl
jtar&index=4
https://huggingface.co/
https://www.youtube.com/watch?v=Kn7SX2Mx_Jk
https://python.langchain.com/docs/integrations/platforms/

https://colab.research.google.com/github/google
/generative-ai-docs/blob/main/site/en/tutorials/
python_quickstart.ipynb

https://www.youtube.com/watch?v=pO_6Jk0QtKw
https://medium.com/analytics-vidhya/introduction-to-
word-embeddings-c2ba135dce2f
https://medium.com/zero-to/word-embedding-
understanding-the-fundamentals-746748000700

https://www.youtube.com/watch?v=pO_6Jk0QtKwhttps://www.analyticsvidhya.com/blog/2017/06/word-embeddings-count

https://www.youtube.com/watch?v=pO_6Jk0QtKwhttps://keremkargin.medium.com/nlp-tokenization-stemming-lemmatizati

https://www.youtube.com/watch?v=pO_6Jk0QtKw
https://www.youtube.com/watch?v=pO_6Jk0QtKw

https://medium.com/@amanatulla1606/transformer-architecture-explained-2c49e2257b4c

https://www.youtube.com/watch?v=fU
STbGrL1tc&t=4842s
https://www.analyticsvidhya.com/blog/2021/12/step-by-
step-guide
-to-build-image-caption-generator-using-deep-learning/
Additional Notes (If any)

Covered regression
Learned ggplot

referred some other blogs and videos on lstm gru


https://medium.com/sfu-cspmp/nlp-word-embedding-techniques-for-text-analysis-ec4e91bb886fhttps://www.analyticsvidhy

https://medium.com/analytics-vidhya/word-embeddings-in-nlp-word2vec-glove-fasttext-24d4d4286a73
Date

Example

20-Feb-24

21-Feb-24

22-Feb-24

23-Feb-24

26-Feb-24

27-Feb-24
28-Feb-24

29-Feb-24

1-Mar-24

4-Mar-24

5-Mar-24

6-Mar-24

7-Mar-24
8-Mar-24

11-Mar-24

12-Mar-24

13-Mar-24

14-Mar-24
15-Mar-24

18-Mar-24
Topic(s) Covered

Machine Learning
Data Visualization

30% Architecture design of workflow management process shared by Joseph is


complete

80% of the HLD for workflow management process is complete

100% completion of the HLD for work flow process and sent for review. Completed
security controls document for web application without VPN.

Leave

Worked on converting open source vulenerability scan tool from python 2.4 to 3.8,
researched on open source log analyser fluentd and Nikto vulenerability scan tool.
Installing docker for it.

Worked on Nikto vulnerability tool setup. Installed the docker engine. Fixing the bugs
in Grabber tool.
Nikto can scan vulnerability scan is working
Grabber has challenges with beautifulsoup dependency with 2.7 and pip installation-
ruled out
Wapiti3 has challenges with the dependencies conflict - ruled out
Jfrog vulnerability scan has been installed. It is a paid but 15 day trial is present.Server
is not starting with the docker run command.informed the support.
Tenable is a paid software for network vulnerability scan. It can be used.
Sonarqube - code quality and security w.r.t code. Working on the installation of the
opensource.

Worked on Jfrog installation and log analyser installation. It is still in proogress.

Worked on Jfrog installation and log analyser installation. It is still in proogress.

Worked on Jfrog installation and log analyser installation. It is still in proogress.

Worked on Jfrog installation and log analyser installation. It is still in proogress.

Worked on Jfrog installation and ELK log analyser installed - configuration for memory
is pending. It is still in proogress.

Had a meeting with jfrog team. A few issues were resolved. Today I have a call with
the team to reolve more issues with jfrog. ELK memory allocation research is in
progress.
Worked on jfrog installation. Docker container ip is attached with 25672 port. Even
after uninstallition of the RabbitMQ container IP is attached to port. Trying to resolve
the issue.

Completed the installation of ELK cloud. Jfrog Xray needs 2 separate instances with
8GB ram and 100 GB storage.

Worked on documentation of Vulnerability scan report.

Submitted the consolidated Vulnerability scan report with implementation


instructions to Joseph

Gone through the old Architecture document of NHMind


Gone through the old Architecture document of NHMind
Had a session with Joseph on Stringer Archicture. Then, started working on the
Architecture document.
Sub Topic(s)

Regression, Classification
ggplot, Data Exploration
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>
Additional Notes (If any)

Covered regression
Learned ggplot
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 Head Started with FASTAPI and essential Python methods

21-Feb-24 Glimpse on Vector db-milvus,Continued learning on FastAPI

22-Feb-24 Fastapi,JSON,Django

23-Feb-24 Django, Postgres-pgadmin setup

26-Feb-24 Django-Forms,URLs,Views,Templates,begun a mini proj

27-Feb-24 Django-ORM,CRUD

28-Feb-24 Django-ORM, Custom migrations, REST


29-Feb-24 Django-ORM,REST framework

1-Mar-24

4-Mar-24 serializers,JWT

5-Mar-24 JWT-simple JWT

6-Mar-24 Managed & Stored JWT, Django Search

7-Mar-24 Execution of Search by title, Socketing, Chanelling

Getting started with sample project on API's to manipulate


8-Mar-24
pdfs.

Working on the pdf API project, trynna figure & debugging


11-Mar-24
the errors thrown.
Debugged and resolved the csrf cookie error ,thus the
12-Mar-24 creation of endpoints on top of opensource library has
been achieved

Working on the Sample Chat Room Project based on


13-Mar-24
websocket

14-Mar-24 Achieved building the sample chat room


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Fastapi-database connect,webhooking,Dialogflow
integration,dict

milvus, simple proj leveraging milvus, pydantic validation

Touched a bit on regexp,manipulation of JSON, Django


components

Continued learning on Django-MVT, Postgres-


pgadmin,ORM,Auth,Decorators

Django-Forms,URLs,Views,Templates,mini proj

ORM-OR,AND,Union,Aggregation,performRawsql

django inheritance optimization,migration,REST API


Learnt to Convert Function based views to class
based,Model query,REST & Serializers

API, Setted up Postman, Created a mini proj possessing crud


operations

serializers,Auth with JSON webtokens

Django Auth framework,implemented

Managed & Stored JWT, Django Search, Pagination

Execution of Search by title keyword , Socketing, Chanelling

Getting started with sample project on API's to manipulate


pdfs.

Received 403 error CSRF verification failed & Attribute error


Created an API endpoints to manipulate pdf's, including
compression,conversion,merge ops,Besides created a
function to convert email to pdf filtered by emailid & sub

Allows Bi-directional Real time communication between


client and browser without refreshing the page

Accomplished building the sample chat room- has 2


modules; one for user auth and other handles consumers
responsible for async conversation between users; has 2
models, Room and message to dump db
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://www.youtube.com/watch?v=2e5pQqBvGco&t=7602s

https://youtu.be/erUfLIi9OFM?si=3gGxB2aygJP4t3qE
chatgpt
https://www.youtube.com/watch?
v=2e5pQqBvGco&t=7602s
https://www.geeksforgeeks.org/fastapi-architecture/

https://regex101.com
https://www.w3schools.com/django/
Chatgpt

https://medium.com/codex/mastering-django-development-a-comprehensive-guide-ce5526403220

udemy

https://www.youtube.com/watch?v=iQF6pln3Gog&list=PLOLrQ9Pn6cazjoDEnwzcdWWf4SNS0QZml https://www.youtube.co

https://www.youtube.com/watch?
v=Y4ahqzSs7nI&list=PLOLrQ9Pn6cazjoDEnwzcdWWf4SNS0
QZml&index=12

https://www.youtube.com/watch?v=GN6ICac3OXY

https://docs.djangoproject.com/en/5.0/howto/writing-
migrations/
https://www.youtube.com/watch?v=-3BN-JMLE0A https://www.youtube.com/watch?v=PD3YnPSHC-c

https://www.udemy.com/course/python-django-2021-complete-course/learn/lecture/27270390#overview, GPT

https://youtu.be/5GxQ1rLTwaU?si=4sfrNINFumAsntv8 https://youtu.be/0_seNFCtglk?si=c0SRZO-hxdJCbl-Z

https://www.youtube.com/watch?v=xjMP0hspNLE

https://youtu.be/brIUmVnTwJ0?si=sqXc6sE5itvRMjD7

https://www.youtube.com/watch?v=m5WUPHRgdOA&list=PLKcvQn8OTDUbRpJxRVjZ81nA4LjLokuFn

github.com/AndyCyberSec/pylovepdf
https://developer.ilovepdf.com/docs/api-reference#upload
https://github.com/AndyCyberSec/pylovepdf/blob/
master/README.md
https://www.geeksforgeeks.org/convert-text-and-text-file-
to-pdf-using-python/

https://channels.readthedocs.io/en/latest/topics/consumers.html

https://websockets.readthedocs.io/en/stable/howto/django.htmlhttps://medium.com/@adabur/introduction-to-django-chan
Additional Notes (If any)

Covered regression
Learned ggplot
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 FastAPI python

21-Feb-24 FastAPI python

22-Feb-24 FastAPI python

23-Feb-24 FastAPI python

26-Feb-24 FastAPI python

27-Feb-24 FastAPI python

28-Feb-24 FastAPI python


29-Feb-24 FastAPI python

1-Mar-24 FastAPI python

4-Mar-24 FastAPI python

5-Mar-24 FastAPI python

6-Mar-24 FastAPI python

7-Mar-24 FastAPI python

8-Mar-24 FastAPI python

11-Mar-24 FastAPI python


12-Mar-24 FastAPI python

13-Mar-24 FastAPI python

14-Mar-24 FastAPI python


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Fastapi framework, REST Architecture, Uvicorn server, Pydantic library,


how to connect database and perform CRUD operations

Learning standard code structure from sources like medium

Learning to pass path parameters, query parameters, creating models,


and practising to write better code structure by building sample app
and reading articles and referring to already written github code

creating sample app to practice fastapi(in progress) and implementing


code structure learnt so far

Learnt sql_alchemy ORM, implemented in sample project, learnt and


implemented the use of sessionmaker, learning jwt authentication,
implementation of jwt authentication in progress

understanding session token, jwt token, differences between them, why


jwt was necessary, implementing jwt authentication in practice project

Practised and implemented jwt_authentication, made 4 APIs to


understand user role management(access view for superadmin and
normal user)
Learning middleware, error handling, and how to invalidate jwt_token
for any specific user

Made several APIs to learn and practise FastAPI

Learnt how to invalidate jwt_token, middleware implementation

Learning WebSockets support, API versioning, customisation of


openapi_schema, Background Tasks

Learning cookie parameters, header parameter, threading in python,


implementing invalidation of jwt token(facing issue, resolving)

Resolved the issue faced while implementing invalidation of jwt token,


Learning concurrency, threading

Implemented and practised threading and practised to use


concurrent.futures library in python

Learning CORS, Path operation configuration, Dependencies - classes as


dependencies, sub dependencies, Global Dependencies, Dependencies
with yield
Continued learning about Threads:
- how threads are created by the python virtual interpreter
- creating threads for methods in class, for static methods
- built-in funtions in threading
- Lock in threading
- Need of RLock
- exception in multithreading, etc.

continued learning about threads and working for demo for each
concept in multi-threading in python

working for demo in multi-threading(covering all the concepts for demo


which are mentioned in documentation of python)
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://www.tutorialspoint.com/fastapi/index.htm

https://python.plainenglish.io/a-comprehensive-guide-to-
structuring-a-fastapi-project-for-reproducibility-and-
maintainability-1705c41dac41

https://github.com/zhanymkanov/fastapi-best-practices

https://www.geeksforgeeks.org/tips-for-writing-efficient-
and-maintainable-code-with-fastapi/
https://github.com/zhanymkanov/fastapi-best-practices

https://www.tutorialspoint.com/fastapi/index.htm

https://www.geeksforgeeks.org/tips-for-writing-efficient-
and-maintainable-code-with-fastapi/

https://jwt.io/

https://www.freecodecamp.org/news/how-to-add-jwt-
authentication-in-fastapi/

https://www.sqlalchemy.org/

https://fastapi.tiangolo.com/tutorial/sql-databases/
https://fastapi.tiangolo.com/learn/
https://www.youtube.com/watch?v=nC9ob8xM3AM
https://medium.com/@prashantramnyc/difference-
between-session-cookies-vs-jwt-json-web-tokens-for-
session-management-4be67d2f066e

https://www.youtube.com/watch?
v=0A_GCXBCNUQ&ab_channel=EricRoby

https://fastapi.tiangolo.com/learn/
https://fastapi.tiangolo.com/learn/

https://fastapi.tiangolo.com/learn/

https://fastapi.tiangolo.com/learn/

https://www.youtube.com/watch?
v=jzB4TfmOZyw&ab_channel=PSAfterHours

https://www.youtube.com/watch?
v=Ut8hMZWKcr0&ab_channel=SsaliJonathan

https://fastapi.tiangolo.com/learn/

https://fastapi.tiangolo.com/learn/
https://www.youtube.com/watch?
v=jzB4TfmOZyw&ab_channel=PSAfterHours

https://www.youtube.com/watch?
v=Ut8hMZWKcr0&ab_channel=SsaliJonathan

https://fastapi.tiangolo.com/learn/
https://docs.python.org/3/library/concurrency.html

https://fastapi.tiangolo.com/learn/
https://docs.python.org/3/library/concurrency.html

https://fastapi.tiangolo.com/learn/
https://fastapi.tiangolo.com/learn/
https://docs.python.org/3/library/concurrency.html

https://docs.python.org/3/library/threading.html

https://docs.python.org/3/library/threading.html
Additional Notes (If any)

Covered regression
Learned ggplot
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 Worked on SDP assignment

Set up the VS code and python. Started with its syntax and
21-Feb-24
functionality

Explored the python's data structure and conditional


22-Feb-24
statements & loops

Explored the OOPs concepts, dateTime module, Math


23-Feb-24
Functions, JSON packages

26-Feb-24 Explored the constructs like file-handling and error-handling

Hands-on with python and set-up the django framework,


27-Feb-24
set-up and installed the docker desktop

Started learning of Django and read about its


28-Feb-24
documentations.
Created an simple app and made it dockerized and Explored
29-Feb-24
about Docker-Compose

Built and started Django project with Docker-Compose and


1-Mar-24
worked in Docker Container

4-Mar-24 Started exploring Django's architectures and Django Shell

Explored the Django's templates, HTTP method:- GET and


5-Mar-24
POST, Set-up the PostgreSQL and pgAdmin

6-Mar-24 Leave

7-Mar-24 Leave

8-Mar-24 Leave

Explored the Django ORM, some functions like filter(), get()


11-Mar-24
and explored the postgres and pgAdmin
Continuation to exploring postgres and pgAdmin things and
12-Mar-24
Dockerized both of them into container

Debugged the authentication issue w.r. t creating


13-Mar-24
connection between local machine to docker container.

Started exploring SQL injection along with OS command


14-Mar-24
injection in Django
Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Learned about its variables, Data types, Numbers, Casting,


Boolean, Operatiors

Learned about tuples, list, dictionaries, set and conditional


statements along with loops

Learned about OOPs concept like Inheritance,


Polymorphism, Classes, Objects and also explored the its
iterators

Learned about file-handling read, write, create, delete files


in python along with error-handling try, except

Got familiar with Django components through its


documentation and created a simple app to know how
things are working.
Created dockerfile with respect to this.

Dockerized the two app using Docker-compose and was


able to run from different different containers using single
image file. I created docker-compose.yml file w.r.t this

Learned about its architectures like models, views,


templates, URLs and explored the Django shell and
performed CRUD operations

Learned Django's templates with its extension, explored the


HTTP methods like GET and POST, able to set-up
PostgreSQL DB and pgAdmin
Created another docker-compose.yml file with respect to
this.

Learned about its occuring possibilites and prevention


methods like Query parameterizatiion, Input Escaping and
also studied about OS command injection and created one
project to do hands-on to get familiar with these things.
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://www.w3schools.com/python/https://www.tutorialspoint.com/python/

https://www.w3schools.com/python/https://www.tutorialspoint.com/python/

https://www.w3schools.com/python/

https://docs.djangoproject.com/en/5.0/
https://www.w3schools.com/django/
https://www.youtube.com/watch?v=W5Ov0H7E_o4&list=PLOLrQ9Pn6cazCfL7v4CdaykNoWMQymM_C&index=1

https://www.youtube.com/watch?v=aMqs_y6dZw4&list=PLOLrQ9Pn6cazCfL7v4CdaykNoWMQymM_C&index=2

https://www.youtube.com/watch?v=UO2oWFFRjIo&list=PLVBKjEIdL9bvCdI4l1Emvbezv10GjUaLk&index=7
https://www.youtube.com/watch?
v=_oqSGs3rrf8&list=PLOLrQ9Pn6cazCfL7v4CdaykNoWMQy
mM_C&index=9

https://djangocentral.com/using-postgresql-with-
django/

https://www.youtube.com/watch?v=8uMbSooxSr8&list=PL4iRawDSyRvUwtJbv_Rq_Hx5Ls3lnXVyv&index=1
Additional Notes (If any)

Covered regression
Learned ggplot
Django's latest version 5.0.2 is not supported with Docker.
So I downgraded the Django version to 4.2.10 to make it
run.
Don't use ip address of postgres in docker using docker
inspect <container_id_of_postgres>, rather than using
"host.docker.internal" to cmmunicate from docker
container to host
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

Read the Django Documentation, intro and it's


20-Feb-24
overview and FAST API operations

21-Feb-24 FastAPI - Pydantic Basemodel

22-Feb-24 FastAPI - Request Methods + delay functions

23-Feb-24 FastAPI - Security/Authentication

26-Feb-24 Django

27-Feb-24 Django-documentation

28-Feb-24 Django-documentation tutorial


29-Feb-24 Django documentation

1-Mar-24 Django documentation

4-Mar-24 Not well / Leave

5-Mar-24 Django-documentation tutorial

6-Mar-24 Django Tutorial implement

7-Mar-24 Django Tutorial database

8-Mar-24 Django tutorial

11-Mar-24 Django Template + mini project


12-Mar-24 Django mini project

13-Mar-24 Mini Project

14-Mar-24 Mini Project


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

intro, overview, operations

Model Validation, Data validation using Pydantic

Completed all 4 request method- GET,PUT,POST,DELETE and asyns


delay function, concurrency

JSON web tokens , Error handling

Django MTV architecture, project create, app create, development


server

Django admin createsuperuser, model creation, activating models,


terminal shell API use

DjangoTemplates, HTTP responses, renderer, URL dispatcher


Django request post method from template

MVT architecture

Django template example create a poll,using POST method

Implemented example of django tutorial till part 5

Intro to automated testing through shell terminal, customize


app,showing views poll, insert data to database

static templates files in django, customize admin form, debug toolbar

Tags, syntax, filters in a template and its components, html basics +


mini project setup
bootstrap framework(nav bar components, forms) to use in Django
template, small blog website mini project

Made some API's to get the filtered data, & models having one one
relation as suggested by Debashish

Implemented other model relations like many to many, one to many


and made some changes in API to POST data and get data based on
model
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

https://fastapi.tiangolo.com/#installationhttps://betterprogramming.pub/fastapi-best-practices-1f0deeba4fce

https://fastapi.tiangolo.com/async/https://fastapi.tiangolo.com/tutorial/body/

https://fastapi.tiangolo.com/tutorial/security/oauth2-jwt/
https://fastapi.tiangolo.com/tutorial/handling-errors/

https://docs.djangoproject.com/en/5.0/intro/tutorial01/

https://docs.djangoproject.com/en/5.0/intro/tutorial02/
https://docs.djangoproject.com/en/5.0/contents/

https://docs.djangoproject.com/en/5.0/topics/http/urls/https://docs.djangoproject.com/en/5.0/intro/tutorial03/
https://docs.djangoproject.com/en/5.0/intro/tutorial04/

https://docs.djangoproject.com/en/5.0/contents/

https://docs.djangoproject.com/en/5.0/intro/tutorial04/

https://docs.djangoproject.com/en/5.0/contents/

https://docs.djangoproject.com/en/5.0/intro/tutorial05/ https://docs.djangoproject.com/en/5.0/intro/tutorial06/

https://docs.djangoproject.com/en/5.0/intro/tutorial07/
#customize-the-admin-form
https://docs.djangoproject.com/en/5.0/intro/tutorial08/

https://docs.djangoproject.com/en/5.0/topics/templates/https://www.w3schools.com/html/default.asp
https://getbootstrap.com/docs/5.0/components/navbar/https://docs.djangoproject.com/en/5.0/ref/contrib/messages/
Additional Notes (If any)

Covered regression
Learned ggplot

Documentation
https://www.youtube.com/watch?v=JxzZxdht-XY
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 Revised Python basic tools and libararies.

21-Feb-24 Python & Vs Code Installation. Pdf reader code writing.

22-Feb-24 Fast API Documentation, Splitting pdf.

23-Feb-24 Text pdf read.

26-Feb-24 Table extraction in pdf. Fast API setup and practice.

Text and pdf extraction. Learned routing and API


27-Feb-24
documentation.

28-Feb-24 Fast API SQL (Relational) Database.


29-Feb-24 Fast API SQL (Relational) Database continued.

1-Mar-24 Fast API data validation and authentication(theory).

4-Mar-24 User creation and authentication.

5-Mar-24 Middleware and FastAPI project

6-Mar-24 Testing, API Versioning and Project.

7-Mar-24 Fast API Project

8-Mar-24 Fast API Project

11-Mar-24 Fast API Project


12-Mar-24 Fast API Project

13-Mar-24 Fast API Project

14-Mar-24 Fast API Project

15-Mar-24 Fast API Project

18-Mar-24 SQL Relational Database Learning and Project

19-Mar-24 SQL Relational Database Learning and Project

20-Mar-24 API Task

21-Mar-24 API Task

22-Mar-24 API Task

25-Mar-24 API Task, Fast API


26-Mar-24 API, Redis

27-Mar-24 Redis

28-Mar-24 Redis

29-Mar-24 Redis

1-Apr-24 Redis Installation

2-Apr-24 Redis Installation


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Revising Python and its libraries including Pandas , Numpy,


Matplotlib and Seaborn.

Installed and setup Python and VS code. Learned how to


read a pdf using a pdf reader(PyPDF2). Learning how to split
if there is script written on the both sides of the page.

Read FastAPI documentation and practiced its get and post


requests along with some basic examples of datasets. Also
did splitting the script of a pdf file, now learning how to
feed this text in LLM interface.

Was able to extact the text or paragraphs in pdf file in a


readable format.

Extracted tables in pdf. Setup FAST API in VS code. Practiced


the codes in FAST API Documentation.

Extracted tables along with text present in pdf file. For FAST
API, Learned routing including path and query parameters
as well as API documentation using swagger.

In FastAPI, studied Requesting body, debugging, SQL


database using SQL alchemy, Object Relational Mapper,
Creating Models and tables.
Installed table plus, Database connection, Creating Pydantic
Schemas, Continued creating Models and table, store blogs
to database.

Went through the theory of Response model creation,


Creating a user, hashing password, showing the user,
relationship and API router.

Created two APIs on User creation, user


authentication(Token authentication) using OAuth2.

Went through the concepts of middleware, logging, error


handling, authentication and started working on a project
that will include all the conecpts of FastAPI.

Understood testing and API Versioning. Added basic HTTP


requests, path parameter and query parameter examples in
the project.

Added different sections in the Fast API project including-


Request Body, Query Parameters and String Validations,
Path Parameters and Numeric Validations, Body - Multiple
Parameters, Body - Fields and Body - Nested Models.

Added few more topics including - Declare Request Example


Data, Extra Data Types, Cookie Parameters, Header
Parameters, Response Model - Return Type, Extra Models,
Response Status Code, Form Data, Request Files, Request
Forms and Files

Exception handling, Path Configuration, Added path tags to


all the above codes, Cookie parameter and its age.
Added JSON Compatible Encoder, Dependencies , Class
dependencies, Sub-Dependencies, Dependencies in path
operation decorators and Security in the FAST API Project.

Added JWT Authentication and Middleware example to the


Fast API project. Solved some response issue with cookie
parameter.

Modified some parameters of the Fast API Project and


started exploring SQL Alchemy.

Fast API self learning , PDF read code and Fast API Project.

Learned and implementind SQL Relational Database


example in the project.

Implemented SQL Database example in the Project

Working on making an API that takes pdf or any other file


and extract its text.

Made the API that takes pdf or any other file and extract its
text.

Working on the API. Now adding JWT authentication to it.

Added authentication. Learning Background tasks,


metadata and docs.
Went through the online videos explaining redis, working
on the API mini project.

Reading redis documentation and watching online videos.

Made redis connection with Fast API and written basic


commands.

Reading the documentation of using Redis with FastAPI.

Trying to install redis in the system

Trying to install redis in the system


Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

______

https://fastapi.tiangolo.com/tutorial/first-steps/
https://fastapi.tiangolo.com/tutorial/query-params-str-
validations/

____

https://fastapi.tiangolo.com/tutorial/first-steps/
https://fastapi.tiangolo.com/tutorial/query-params-str-
validations/

FastAPI - A python framework | Full Course (youtube.com)

FastAPI - A python framework | Full Course (youtube.com)


FastAPI - A python framework | Full Course (youtube.com)

FastAPI - A python framework | Full Course (youtube.com)

Quickly Authenticate Users with FastAPI and Token Authentication (youtube.com)

Middleware - FastAPI (tiangolo.com)

First Steps - FastAPI (tiangolo.com)

Path Parameters and Numeric Validations - FastAPI (tiangolo.com) , https://fastapi.tiangolo.com/tutorial/body-multiple-param

Cookie Parameters - FastAPI (tiangolo.com) , https://fastapi.tiangolo.com/tutorial/response-model/

Handling Errors - FastAPI (tiangolo.com) , https://fastapi.tiangolo.com/tutorial/path-operation-configuration/


Dependencies - FastAPI (tiangolo.com)

Security - FastAPI (tiangolo.com)

SQLAlchemy - The Database Toolkit for Python

Background Tasks - FastAPI (tiangolo.com)


Using Redis with FastAPI | The Home of Redis Developers
Additional Notes (If any)

Covered regression
Learned ggplot
Date Topic(s) Covered

Machine Learning
Example
Data Visualization

20-Feb-24 Learninng FastAPI

FastAPI-Installation Process and started with Hands on


21-Feb-24
demo

22-Feb-24 FastAPI- Request Method, Status Code

23-Feb-24 FastAPI

26-Feb-24 FastAPI documentation

27-Feb-24 FastAPI

28-Feb-24 FastAPI documentation and Hands on


29-Feb-24 FastAPI Testing

1-Mar-24 Fast API SQL (Relational) Database continued.

4-Mar-24 Fast API SQL (Relational) Database continued.

5-Mar-24 Not well /Leave

6-Mar-24 FastAPI project

7-Mar-24 FastAPI project

8-Mar-24 FastAPI Documentation

11-Mar-24 FastAPI project


12-Mar-24 FastAPI project

13-Mar-24 FastAPI project

14-Mar-24 FastAPI project


Sub Topic(s)

Regression, Classification
ggplot, Data Exploration

Started learning fastapi which is used as modern, fast (high-


performance), web framework for building APIs

Set up VS code in my office laptop and started with Path


Parameter, Query Parameter, Request body and Pydantic
basemodel

Completed Pydantic Schemas, how to connect database,


created model & tables and completed all 4 request
method- GET,PUT,POST,DELETE with hands on demo. Also
completed Exception & Status Code.

Created another sample table and perform all 4 request


mode, tags and leaning about relationship between tables,
how we can create relationship between two table. Also i
have raised one service request to set up SQLlite database.

Gone through Relationship, API Router and API Router path


operators documentation. Waiting for IT team's response to
install and set up TablePlus.

Gone through OAuth2 with Password and JWT


documentation and also practically implemented
APIRouter. Today i will try to implement JWT part.

Gone through OAuth2 with Password and JWT


documentation and hands on JWT access token and router
behind authentication.
Verify user logged in, Testing Expired token, Go through
JWT access token, Understanding OAuth with the spotify
API and continue FastAPI tutorial.

Went through Foreign key concept and also practically


implemented it. Assiging owner Id when create new blog( at
first encounter with an error, and it takes full day to
understand)

Practially implemented delete and update on your own


blog, went through relationship again and worked on
search,limit,skip query parameters.

Understood enviornment variable which can be used to


secure the credentials. Created one vote table in my project
and try to create vote route and user can vote any blogs.

Understand joining concept in SQL and tried to


implemented in sqlalchemy but stuck with an error, looking
for the solution.

Gone through Error Handling, How to upload file and image


using FastApi, and still looking for the soltuion on last day
error issue.

Fixed the last day error issue and trying to hands on image
file upload and started alembic as migration tool youtube
video.
Hands on image file upload and understand the Alembic
tool and started with the Email verfication in Fastapi

Hands on Alembic autogenrative command as migrate all


the table and adding new column changes. also goining
through the Sending email verification part.

tart exploring Fastapi-mail package, email as background


task and today i will implement the mail verfication part
and will show you the demo next day
Resources Used

Online Tutorial: <Name, Link>


Online Tutorial: <Name, Link>

Tutorial - User Guide - FastAPI (tiangolo.com)

https://fastapi.tiangolo.com/tutorial/first-steps/
https://fastapi.tiangolo.com/tutorial/query-params-str-
validations/

https://fastapi.tiangolo.com/tutorial/sql-databases/
https://fastapi.tiangolo.com/tutorial/response-status-code/

https://fastapi.tiangolo.com/tutorial/sql-databases/?h=relationships#create-the-relationships

https://fastapi.tiangolo.com/tutorial/sql-databases/
https://fastapi.tiangolo.com/tutorial/bigger-applications/

https://fastapi.tiangolo.com/tutorial/security/oauth2-jwt/

https://fastapi.tiangolo.com/tutorial/security/oauth2-jwt/
OAuth2 with Password (and hashing), Bearer with JWT tokens - FastAPI (tiangolo.com)

https://fastapi.tiangolo.com/tutorial/sql-databases/

https://www.youtube.com/watch?v=RdaYFmUHZDw&list=PL8VzFQ8k4U1L5QpSapVEzoSfob-4CR8zM&index=77https://www.

Vote/Like theory: Part #81 Python API Course (youtube.com)

Vote/Like theory: Part #81 Python API Course (youtube.com)

FastAPI Tutorial for beginners 06_FastAPI Upload file (Image) (youtube.com)

https://alembic.sqlalchemy.org/en/latest/
https://www.youtube.com/watch?v=i9RX03zFDHU
Email Address Verification in FastAPI using Twilio Verify

Welcome to Alembic’s documentation! — Alembic 1.13.1 documentation (sqlalchemy.org)

Example - FastApi-MAIL (sabuhish.github.io)


Additional Notes (If any)

Covered regression
Learned ggplot
Date Topic(s) Covered
Machine Learning
Example
Data Visualization

20-Feb-24 SDP Training

21-Feb-24 SDP Training

22-Feb-24 SDP Training

23-Feb-24 SDP Training

26-Feb-24 SDP Training

27-Feb-24 SDP Training

28-Feb-24 SDP Training

29-Feb-24 SDP Training

1-Mar-24 SDP Training


4-Mar-24 Basics of transformers and its applications

Huggingface interface and challenges with


5-Mar-24
transformers

Training a transformer based text classifier


6-Mar-24
as feature extractor

Training a text classifier as Fine-tuning


7-Mar-24
transformers

8-Mar-24 Word embeddings

11-Mar-24 Ensemble learning

Bagging and Boosting techniques


12-Mar-24
implementatiion

13-Mar-24 Email Classification using different models

Email Classification using different models


14-Mar-24
and comparing results
Sub Topic(s)
Regression, Classification
ggplot, Data Exploration
Encoder-Decoder Framework, Attention
Mechanisms, Transfer Learning in NLP

Hugging Face Hub, Hugging Face Tokenizers,


Hugging Face Datasets, Hugging Face Accelerate,
challenges with transformers.

Using pretrained models, Extracting the last hidden


states, Creating a feature matrix, Training a simple
classifier

Loading a pretrained model, Defining the


performance metrics, Training the model, Error
analysis, Saving and sharing the model.

Word representation, Using word embeddings,


Properties of word embeddings, Embedding matrix

Simple ensemble learning techniques, Advanced


ensemble learning techniques like stacking,
blending, Bagging and boosting.

Bagging, Random forests, AdaBoost, Gradient


Boosting, XGBoost, Light GBM implementation with
Sklearn

Preprocessing datasest. Email classification using


Naive Bayes Classifier, Support Vector Machines,
Logistic Regression.

Email classification using Random forests, Gradient


Bossting, Transformer based models, comparing
results of all the model used.
Resources Used
Online Tutorial: <Name, Link>
Online Tutorial: <Name, Link>
https://huggingface.co/learn/nlp-course/en/chapter1/1?fw=pt
https://towardsdatascience.com/transformers-89034557de14
Natural Language Processing with Transformers by Lewis Tunstall.

https://huggingface.co/

Natural Language Processing with Transformers by Lewis Tunstall.

Natural Language Processing with Transformers by Lewis Tunstall.

https://www.geeksforgeeks.org/word-embeddings-in-nlp/
https://www.coursera.org/learn/nlp-sequence-models/home/week/2

https://www.analyticsvidhya.com/blog/2018/06/comprehensive-guide-
for-ensemble-models/#:~:text=Ensemble%20learning%20is%20a
%20machine,collective%20intelligence%20of%20the%20ensemble.

https://www.analyticsvidhya.com/blog/2018/06/comprehensive-guide-
for-ensemble-models/#:~:text=Ensemble%20learning%20is%20a
%20machine,collective%20intelligence%20of%20the%20ensemble.
https://scikit-learn.org/stable/modules/ensemble.html#

https://scikit-learn.org/stable/supervised_learning.htmlhttps://huggingface.co/models?pipeline_tag=text-classification&sort=

https://scikit-learn.org/stable/supervised_learning.htmlhttps://huggingface.co/models?pipeline_tag=text-classification&sort=
Additional Notes (If any)
Covered regression
Learned ggplot
Date Topic(s) Covered
Machine Learning
Example
Data Visualization

20-Feb-24 SDP Training

21-Feb-24 SDP Training

22-Feb-24 SDP Training

23-Feb-24 SDP Training

26-Feb-24 SDP Training

27-Feb-24 SDP Training

28-Feb-24 SDP Training

29-Feb-24 SDP Training

1-Mar-24 SDP Training


Revising basic concepts of Python
4-Mar-24 Setup and Installation of Python, VScode,
Anaconda.

Explored python libraries


5-Mar-24 Started Working on tag prediction use case
(Mini Project)

6-Mar-24 Deep Learning

7-Mar-24 Deep Learning

Word Embedding Techniques & Deep


8-Mar-24
Learning

Introduction to Large Language Models


11-Mar-24
and their Problems

12-Mar-24 Text Generation

13-Mar-24 Sentiment Analysis


14-Mar-24 Sentiment Analysis

15-Mar-24 Machine Learning

18-Mar-24 Machine Learning


Sub Topic(s)
Regression, Classification
ggplot, Data Exploration
Datatypes, Functions, Methods, Loops, List, Tuple
String,Dictionary,

Numpy,Matplotlib,Pandas,scikit-learn,Keras
Performed preprocing steps on text data
Tokenization,Steaming,Lammatization

Learn about the deep learning models ANN and


CNN.
Designed a basic Artificial Neural Network (ANN)
model for classifying tags.

Completed a mini-project on tag prediction


Explored CNN pre-trained models like VGG16,
VGG19.

Bag of words (BoWs), Term Frequency-


Inverted Document Frequency (TF-IDF),
Word2Vec
Explored CNN pre-trained models like Inception

History of LLM, Pretraining, Finetuning, Jailbreak,


Prompt Injection & Backdoor attacks

I worked on a mini project where I developed a text


generation model focused on Shakespearean text,
utilizing a single-layer LSTM for text prediction, and
assessed the outcomes across different
temperatures.

Working of Sentiment Analysis and its types, Word


Cloud creation, Post-processing of sentiment
classification and its evalution
worked on a small-scale project focused on the
sentiment analysis and classification of Amazon
product reviews.

Explored Traditional Machine learning Algorithms


like Linear regression, Multiple linear regression,
Logistic regression

Explored Traditional Machine learning Algorithms


like Decision tree, Naïve Bayes, K nearest neighbors,
Random forest, Association rule etc
Resources Used
Online Tutorial: <Name, Link>
Online Tutorial: <Name, Link>
https://www.youtube.com/watch?v=RAwntanK4wQ&list=PLwgFb6VsUj_lQTpQKDtLXKXElQychT_2jhttps://www.geeksforgeek

https://www.w3schools.com/python/numpy/default.asphttps://pandas.pydata.org/pandas-docs/stable/reference/api/panda

https://www.youtube.com/watch?v=QDX-1M5Nj7s&list=PLtBw6njQRU-rwp5__7C0oIVt26ZgjG9NI&index=1https://towardsda

https://arxiv.org/abs/1409.1556

https://www.youtube.com/watch?v=VO6PeW6AePs&list=PLZoTAELRMXVNNrHSKv36Lr3_156yCo6Nn&index=4https://www.a

https://www.youtube.com/watch?v=zjkBMFhNj_g

https://www.analyticsvidhya.com/blog/2022/07/sentiment-analysis-using-python/
https://www.youtube.com/watch?v=6A2w-KYG4Ko&t=1560shttps://www.youtube.com/watch?v=Ah-J2T2a-sM

https://www.youtube.com/watch?v=JxgmHe2NyeYhttps://www.saedsayad.com/data_mining_map.htm

https://www.youtube.com/watch?v=JxgmHe2NyeYhttps://www.saedsayad.com/data_mining_map.htm
Additional Notes (If any)
Covered regression
Learned ggplot

You might also like