CP-III Project Report on

NUTRISCAN AI

at
U. V. Patel College of Engineering

Internal Guide: Prepared By:

Patel Fenil Dixitbhai(21012531006)
Prof. Manan D. Thakkar Patel Vivek Sandipbhai(21012531015)
Ragadibai Ashish Reddy(21012531019)

B.Tech Semester VII

(Computer Engineering-Artificial Intelligence)
Nov-Dec 2024

Submitted to,
Department of Computer Engineering
U.V. Patel College of Engineering
Ganpat University, Ganpat Vidyanagar – 384012
 U.V. PATEL COLLEGE
OF
ENGINEERING

CERTIFICATE

TO WHOM SO EVER IT MAY CONCERN

This is to certify that Mr. Patel Fenil Dixitbhai student of B.Tech. Semester-VII
(Computer Engineering) has completed his full semester Capstone Project - III
work titled “NutriScan AI” satisfactorily in partial fulfillment of the requirement
of Bachelor of Technology degree of Computer Engineering of Ganpat University,
Ganpat Vidyanagar in the year 2024-2025.

Prof. Mannan D. Thakkar Dr. Paresh M. Solanki

College Project Guide Head, Computer Engineering
 U.V. PATEL COLLEGE
OF
ENGINEERING

CERTIFICATE

TO WHOM SO EVER IT MAY CONCERN

This is to certify that Mr. Patel Vivek Sandipbhai student of B.Tech. Semester
VII (Computer Engineering) has completed his full semester Capstone Project -
III work titled “NutriScan AI” satisfactorily in partial fulfillment of the
requirement of Bachelor of Technology degree of Computer Engineering of Ganpat
University, Ganpat Vidyanagar in the year 2024-2025.

Prof. Manan D. Thakkar Dr. Paresh M. Solanki

College Project Guide Head, Computer Engineering
 U.V. PATEL COLLEGE
OF
ENGINEERING

CERTIFICATE

TO WHOM SO EVER IT MAY CONCERN

This is to certify that Mr. Ragadibai Ashish Reddy student of B.Tech. Semester
VII (Computer Engineering) has completed his full semester Capstone Project -
III work titled “NutriScan AI” satisfactorily in partial fulfillment of the
requirement of Bachelor of Technology degree of Computer Engineering of Ganpat
University, Ganpat Vidyanagar in the year 2024-2025.

Prof. Manan D. Thakkar Dr. Paresh M. Solanki

College Project Guide Head, Computer Engineering
 Acknowledgement
This satisfaction that successful completion of any task would be incomplete without the
mention of people whose ceaseless cooperation it made it possible, whose constant
guidance and encouragement crown all efforts with success. We are grateful to our guide
Prof. Manan Thakkar for the guidance, inspiration and constructive suggestions that
helpful us in the preparation of this project. We also thank our colleagues who have helped
in successful completion of the project.
Thanking You,
Fenil, Vivek, Ashish

I
 Abstract

NutriScan AI is an innovative tool designed to enhance consumer safety by scanning the

ingredients of packaged foods and identifying potentially harmful substances. The
application leverages advanced AI and machine learning algorithms alongside a robust
technology stack to deliver accurate and actionable insights. Using EasyOCR for optical
character recognition, NutriScan AI extracts ingredient data directly from product labels,
while OpenCV ensures precise image processing for improved text recognition accuracy.
The platform is built using Python and Pandas, enabling efficient data processing and
management. A user-friendly interface developed with Streamlit allows individuals to
interact with the tool seamlessly, accessing ingredient breakdowns and personalized
dietary recommendations in real time. Additionally, NutriScan AI generates detailed
reports on user statistics, employing statistical analysis to highlight trends and median
values that inform healthier dietary decisions. For accessibility, the application is designed
for mobile deployment, leveraging frameworks like Median to create a lightweight APK
for Android devices.
NutriScan AI empowers individuals to make informed dietary choices, reduce exposure to
harmful chemicals, and promote healthier lifestyles. It is particularly beneficial for those
with specific dietary needs, allergies, or health conditions, offering a practical solution to
navigate the complexities of modern food labeling. By fostering greater transparency in
food consumption, this project contributes to public health and enables consumers to stay
informed about what they eat.

II
 INDEX

1 Introduction.................................................................................................................................1
1.1 Project Overview................................................................................................................. 1
1.2 Background.......................................................................................................................... 1
1.3 Purpose.................................................................................................................................1
1.4 Impact, Significance and Contributions...............................................................................2
1.5 Organization of Project Report............................................................................................ 4
2 Project Scope............................................................................................................................... 6
2.1 Food Image Analysis Module..............................................................................................6
2.2 Health Impact Classification................................................................................................6
2.3 Real-Time Analysis and User Interaction............................................................................6
2.4 Personalized Health Profile Integration............................................................................... 6
2.5 Scalability and Future Expansion........................................................................................ 6
2.6 User Education and Awareness............................................................................................6
2.7 Privacy and Security Considerations................................................................................... 7
2.8 Documentation and Deployment......................................................................................... 7
2.9 Mobile App Development (Future Work)............................................................................7
2.10 Project Timeline.................................................................................................................7
2.11 Collaboration......................................................................................................................7
3 Feasibility Analysis..................................................................................................................... 8
3.1 Technical feasibility............................................................................................................. 8
3.2 Time schedule feasibility..................................................................................................... 9
3.3 Operational Feasibility.........................................................................................................9
3.4 Implementation feasibility................................................................................................... 9
3.5 Economic feasibility............................................................................................................ 9
4 Software requirements specifications (SRS)...........................................................................10
4.1 Software Requirements......................................................................................................10
4.2 Hardware Requirements.....................................................................................................11
5 Process Model............................................................................................................................12
5.1 Problem Definition and Requirements Analysis................................................................12
5.2 System Design................................................................................................................... 12
5.3 Data Collection and Preprocessing.................................................................................... 12
5.4 Model Development...........................................................................................................13
5.5 System Integration............................................................................................................. 13
5.6 Performance Optimization................................................................................................. 13
5.7 Testing and Validation........................................................................................................13
6 Project Plan............................................................................................................................... 15
 6.1 Project planning and Initial Research (Week 1).................................................................15
6.2 Design Phase (Weeks 2-3)................................................................................................. 15
6.3 Data Collection and Preprocessing (Weeks 4-6)................................................................15
6.4 Model Development (Weeks 7-12).................................................................................... 16
6.5 System Integration (Weeks 13-15).....................................................................................16
6.6 Performance Optimization (Weeks 16-17)........................................................................ 16
6.7 Testing and Validation (Weeks 18-20)............................................................................... 17
6.8 Deployment (Weeks 21-22)............................................................................................... 17
6.9 Maintenance and Updates (Ongoing)................................................................................ 17
7 System Design............................................................................................................................18
7.1 Class Diagram....................................................................................................................18
7.2 Activity Diagram............................................................................................................... 19
7.3 Use-case Diagram.............................................................................................................. 20
7.4 Data Flow Diagram............................................................................................................20
7.4.1 Level 0……………………………………………………………………………...20
7.4.2 Level 1……………………………………………………………………………...21
7.4.3 Level 2……………………………………………………………………………...22
8 Implementation Details............................................................................................................ 24
8.1 Understanding the Foundation...........................................................................................24
8.2 Data collection................................................................................................................... 24
8.3 Data Preprocessing.............................................................................................................25
8.4 Training..............................................................................................................................27
8.5 Design Access....................................................................................................................29
8.6 Security Measures..............................................................................................................29
8.7 Scalability and Performance Optimization........................................................................ 30
8.8 Documentation and Ongoing Maintenance....................................................................... 31
8.9 Final Testing and User Feedback....................................................................................... 32
8.10 Deployment Strategies..................................................................................................... 32
9 Testing........................................................................................................................................ 33
9.1 Introduction to NutriScan AI Testing............................................................................... 33
9.2 Testing Strategies............................................................................................................... 33
9.3 Importance of Testing........................................................................................................ 33
9.4 Unit Testing........................................................................................................................34
9.5 Integration Testing............................................................................................................. 35
9.6 User Testing....................................................................................................................... 35
9.7 Performance Testing.......................................................................................................... 37
9.8 Usability Testing................................................................................................................ 38
9.9 Scalability Testing..............................................................................................................38
10 Prototype..................................................................................................................................40
Fig 10.1 : Welcome Page of NutriScanAI...............................................................................40
Fig 10.2 : Home Page of NutriScanAI....................................................................................40
Fig 10.3 : Ingredients Scanning Page of NutriScanAI............................................................41
Fig 10.4 : Admin Login Page of NutriScanAI........................................................................42
Fig 10.5 : Admin Dashboard of NutriScanAI.........................................................................42
11 User Manual............................................................................................................................ 43
Fig 11.1 : Home Page of NutriScanAI....................................................................................43
Fig 11.2 : User Page of NutriScanAI....................................................................................... 43
Fig 11.3 : Enter Basic Details.................................................................................................. 44
Fig 11.4 : Scanned Ingredients from Packet............................................................................ 44
Fig 11.5 : User with Nut Allergy............................................................................................. 45
Fig 11.6 : Ingredients Matching User Allergy......................................................................... 45
Fig 11.7 : Admin Login Page...................................................................................................46
Fig 11.8 : Successfully Login to Admin Dashboard................................................................46
Fig 11.9 : Admin Dashboard with Graph Representation........................................................47
Fig 11.10 : Line Graph for Last 30 Days Usage...................................................................... 47
12 Conclusion and Future Work................................................................................................ 48
12.1 Conclusion....................................................................................................................... 48
12.2 Key Achievements........................................................................................................... 48
12.3 Challenges Overcome...................................................................................................... 49
12.4 Future Work..................................................................................................................... 49
13 Annexure..................................................................................................................................51
13 About College.......................................................................................................................... 54
 List of Figures
Figure 1 : Class Diagram............................................................................................................... 18
Figure 2 : Activity Diagram...........................................................................................................19
Figure 3 : Use-Case Diagram.........................................................................................................20
Figure 4 : Data-Flow Diagram Level 0..........................................................................................20
Figure 5 : Data-Flow Diagram Level 1..........................................................................................21
Figure 6 : Data-Flow Diagram Level 2..........................................................................................22
Figure 7 : Model testing on Ingredients Scanning......................................................................... 36
Figure 8 : Welcome Page of NutriScanAI.................................................................................... 40
Figure 9 : Home Page of NutriScanAI..........................................................................................40
Figure 10 : Ingredients Scanning Page of NutriScanAI................................................................41
Figure 11 : Admin Login Page of NutriScanAI............................................................................42
Figure 12 : Admin Dashboard of NutriScanAI.............................................................................42
Figure 13 : Home Page of NutriScanAI........................................................................................43
Figure 14 : User Page of NutriScanAI...........................................................................................43
Figure 15 : Enter Basic Details...................................................................................................... 44
Figure 16 : Scanned Ingredients from Packet................................................................................ 44
Figure 17 : User with Nut Allergy................................................................................................. 45
Figure 18 : Ingredients Matching User Allergy............................................................................. 45
Figure 19 : Admin Login Page.......................................................................................................46
Figure 20 : Successfully Login to Admin Dashboard....................................................................46
Figure 21 : Admin Dashboard with Graph Representation........................................................... 47
Figure 22 : Line Graph for Last 30 Days Usage............................................................................47
Team ID: 103 2CEIT703: Capstone Project-III

1 INTRODUCTION
1.1 Project Overview
NutriScan AI is a cutting-edge project that leverages artificial intelligence to analyze
food ingredients for their health impact, allergy risks, and overall nutritional quality.
The project combines computer vision, machine learning, and real-time data analysis to
create an intuitive platform that enables users to easily assess the nutritional content of
their meals. NutriScan AI extracts ingredient data from food images, categorizes the
health risks associated with each ingredient, and offers personalized alerts based on the
user's health profile. With the growing interest in health-conscious eating and the rising
awareness of food allergies, NutriScan AI offers a comprehensive solution for
promoting healthier eating habits and providing individuals with the tools to make
informed food choices.

1.2 Background

The modern world faces an increasing prevalence of food-related health issues,

including allergies, intolerances, and chronic diseases caused by poor diet choices.
Traditional methods of understanding and managing food health, such as reading food
labels, are often tedious, error-prone, and inaccessible for people with specific dietary
restrictions. NutriScan AI addresses these challenges by offering an automated and
intelligent way to evaluate the health implications of the food we consume, allowing
for quick, accurate, and personalized insights.

Despite the advancements in food analysis, there remain barriers to widespread

adoption, including the need for real-time processing, accuracy in ingredient detection,
and the ability to offer personalized recommendations that cater to individual health
concerns such as allergies and chronic conditions.

1.3 Purpose
1.3.1 Problem Statement
The current landscape of food health analysis faces several challenges:

- Manual Analysis: Individuals often rely on food labels, which can be

inaccurate or difficult to interpret for people with dietary restrictions.
- Health Risk Identification: Allergy identification and nutritional quality are
not always readily accessible, making it harder for consumers to make safe and
informed choices.
- Time-Consuming: Many food analysis tools require lengthy input processes,
which are impractical for users looking for quick, actionable insights.

NutriScanAI 1
Team ID: 103 2CEIT703: Capstone Project-III

1.3.2 Problem Aim

The aim of NutriScan AI is to develop an advanced platform that overcomes these
limitations, providing a real-time, accurate, and scalable solution for analyzing food
ingredients. By using AI-driven image recognition, the system will classify ingredients
based on their nutritional health impact, flag harmful ingredients with allergy warnings,
and offer personalized advice based on user preferences or health conditions. The goal
is to make food evaluation fast, accessible, and tailored to individual health needs.

1.3.3 Problem Objective

- Improve Ingredient Detection Accuracy
Enhance the accuracy of ingredient detection in food images to ensure the
system can identify ingredients precisely, even in challenging conditions such
as poor lighting, varied food textures, and complex ingredient combinations.
- Refine Health Impact Classification
Improve the classification of ingredients by accurately determining their health
impact. This includes distinguishing between safe ingredients, mildly harmful
ones, and highly harmful ingredients, based on their nutritional properties and
potential risks, such as allergens and harmful chemicals.
- Enhance Personalization
Develop personalized allergy alerts and health risk assessments that are
tailored to each user’s unique health profile. The aim is to provide individuals
with the most relevant food information based on their specific health concerns
or dietary restrictions.
- Optimize Real-time Processing
Ensure that NutriScan AI operates efficiently and swiftly, enabling real-time
analysis of food images without compromising the accuracy or quality of the
results. This objective focuses on processing speed to provide immediate
insights to users.

1.4 Impact, Significance and Contributions

1.4.1 Enhanced Health Awareness
- NutriScan AI significantly improves health awareness by offering consumers
real-time insights into the nutritional quality and health risks of their food. This
contributes to better dietary choices, helping individuals avoid harmful
ingredients, manage allergies, and make healthier decisions in their daily eating
habits.

1.4.2 Personalized Health Management

- By tailoring the analysis to individual health profiles, NutriScan AI enables
personalized food recommendations and allergy alerts. This personalization
empowers users to manage their health better, particularly for those with
specific dietary restrictions or chronic conditions, such as diabetes, gluten
NutriScanAI 2
Team ID: 103 2CEIT703: Capstone Project-III

intolerance, or food allergies.

1.4.3 Streamlined Food Analysis Process

- NutriScan AI streamlines the food analysis process by eliminating the need for
manual label-reading or tedious research. The platform allows users to analyze
the health content of their meals instantly by simply taking a photo, saving time
and ensuring accuracy in the evaluation of ingredients.

1.4.4 Empowered Food Choices

- The project promotes informed food choices by offering immediate feedback on
food ingredients. This allows users to make better dietary decisions, promoting
long-term health outcomes and encouraging more mindful eating, ultimately
contributing to the prevention of diet-related diseases and fostering overall
well-being.

1.4.5 Scalability and Accessibility

- NutriScan AI contributes to making food analysis accessible and scalable for a
wide audience. The ability to analyze ingredients in real-time, irrespective of
location, means the platform can cater to diverse populations, from individuals
managing allergies to healthcare professionals using it as a tool for patient
health management.

1.4.6 Support for Healthy Eating Trends

- NutriScan AI helps support the growing trend towards healthier eating by
providing users with the information they need to make healthier food choices.
The system can evaluate foods against popular health trends (e.g., low-carb,
vegan, gluten-free), helping users align their meals with specific health goals or
dietary preferences.

1.4.7 Reduction of Food Waste

- By providing detailed insights into the quality and health risks of food,
NutriScan AI helps reduce food waste. Users can better understand which
ingredients in their kitchen are safe to consume and which are potentially
harmful, allowing for more efficient use of food and a reduction in unnecessary
discarding of ingredients.

1.4.8 Encouragement of Dietary Transparency

- NutriScan AI promotes greater transparency in the food industry by enabling
consumers to quickly access information about the ingredients in their meals.
As the system grows in usage, it encourages food manufacturers and restaurants

NutriScanAI 3
Team ID: 103 2CEIT703: Capstone Project-III

to provide clearer and more accurate ingredient labeling, aligning with

increasing consumer demand for transparency and accountability.

1.5 Organization of Project Report

1.5.1 Literature Survey
This section provides an overview of existing systems and research related to food
health analysis, ingredient recognition, and AI-powered nutritional assessment. We
examine various methods and technologies used in similar systems, including computer
vision techniques for food image recognition, AI algorithms for food health
classification, and the integration of health databases. We also analyze how existing
projects address common challenges such as accuracy, scalability, and user
personalization. Based on this, we highlight the technologies that NutriScan AI
leverages and how our solution improves on these existing systems.

1.5.2 Functional and Non-functional requirements

Functional Requirements:

● Real-time food image processing and ingredient extraction.

● Classification of ingredients based on their health impact (Type 0 to Type 3).
● Personalized allergy alerts and health warnings tailored to individual users.
● User-friendly interface for uploading food images and viewing analysis results.
● Integration with health profiles for personalized dietary recommendations.

Non-functional Requirements:

● Performance: The system should be capable of processing food images in near

real-time, with minimal latency.
● Scalability: The model should scale efficiently to handle a growing database of
food ingredients and user health profiles.
● Security: The system must ensure the privacy and security of user data,
particularly health and allergy information.
● Usability: The interface should be intuitive and accessible, offering a seamless
experience for users of all backgrounds.
● Availability: NutriScan AI should be available and responsive for use at all
times, with robust backup systems in place.

1.5.3 Diagrams
This section includes visual representations of the system architecture, data flow, and
key components of NutriScan AI.

1.5.4 Prototype
The prototype section demonstrates the interface and user experience of NutriScan AI.
NutriScanAI 4
Team ID: 103 2CEIT703: Capstone Project-III

This includes screenshots.

1.5.5 Conclusion and Future works

Summary of the project is included in this chapter.

1.5.6 References
This section provides references to academic papers, articles, and similar projects that
informed the development of NutriScan AI.

NutriScanAI 5
Team ID: 103 2CEIT703: Capstone Project-III

2 PROJECT SCOPE
The scope of the NutriScan AI project focuses on several key areas related to food
health analysis and real-time nutritional assessment:

2.1 Food Image Analysis Module

- Develop a robust image recognition system capable of accurately detecting food
ingredients from photographs. This module needs to handle variations in image
quality, food types, and presentation styles (e.g., different angles, lighting
conditions).

2.2 Health Impact Classification

- Design and implement an AI-powered system that classifies food ingredients
into categories (Type 0 to Type 3) based on their health risk level. This
classification will take into account various health factors such as allergies,
toxicity, and overall nutritional value.

2.3 Real-Time Analysis and User Interaction

- The system will allow users to upload images of food items and receive instant
analysis results. The platform will highlight potentially harmful ingredients,
classify them based on health risks, and provide personalized allergy alerts.

2.4 Personalized Health Profile Integration

- NutriScan AI will support the creation of user profiles where individuals can
input their health information, allergies, and dietary preferences. The system
will then tailor its analysis and alerts to match the user’s unique health profile.

2.5 Scalability and Future Expansion

- The system will be designed to scale efficiently, accommodating a growing
number of ingredients and users. In the future, NutriScan AI could integrate
with external databases, mobile applications, or health tracking platforms to
provide users with even more comprehensive nutrition insights.

2.6 User Education and Awareness

- Dietary Education: NutriScan AI could include educational resources to help
users better understand the impact of different ingredients on their health, such
as blog posts, health tips, and video content.
- Food Label Awareness: Educate users on how to read food labels more
effectively, helping them make better dietary choices based on the ingredients
and their potential health risks.

NutriScanAI 6
Team ID: 103 2CEIT703: Capstone Project-III

2.7 Privacy and Security Considerations

- Implement industry-standard security protocols to ensure user data (especially
health-related data) is securely stored and transmitted. NutriScan AI will
comply with data protection regulations (e.g., GDPR, HIPAA) to protect user
privacy.

2.8 Documentation and Deployment

- Prepare comprehensive documentation detailing the system architecture,
implementation details, usage instructions, and best practices. Facilitate the
deployment of the NutriScan AI in real-world settings, providing support and
guidance for integration and maintenance.

2.9 Mobile App Development (Future Work)

- Develop a mobile app version of NutriScan AI to provide users with a
convenient way to analyze food ingredients on the go. The mobile app would
have similar features to the web platform, with additional support for camera
integration for food scanning.

2.10 Project Timeline

- The project scope will be executed within the allotted timeframe of the capstone
course, with the possibility of future enhancements post-graduation.

2.11 Collaboration
- The project will leverage the collective expertise and contributions of all team
members with clear roles and responsibilities outlined.

NutriScanAI 7
Team ID: 103 2CEIT703: Capstone Project-III

3 FEASIBILITY ANALYSIS
3.1 Technical feasibility
3.1.1 Hardware and Software Requirements
The hardware requirements for NutriScan AI include sufficient CPU/GPU for efficient
AI model training and inference (with a GPU recommended), at least 8 GB of RAM for
real-time image processing, SSD storage for food ingredient databases and user data, a
high-resolution camera for capturing food images, and a reliable internet connection for
image uploads and backend operations. The software stack consists of
TensorFlow/Keras for deep learning, OpenCV[2] for image processing, Streamlit for
web app development, and Pandas for data handling. A PyMango database is used for
storing profiles and ingredient data, with APIs for system integration and encryption for
secure data handling and privacy.

3.1.2 Technology Expertise

NutriScan AI requires expertise in deep learning libraries like TensorFlow and Keras
for building and training image recognition models to detect and classify food
ingredients, along with proficiency in image processing using OpenCV[2] for tasks
such as resizing, normalization, and augmentation. Knowledge of health risk
categorization algorithms, such as supervised classification models, is also essential.
Web development skills are needed for building interactive applications with Streamlit,
integrating APIs using Flask or Django, and designing responsive user interfaces with
CV2, Pil(Image Processing) and Streamlit. Data management and security expertise is
critical for handling large datasets[3] while ensuring compliance with privacy
regulations (e.g., GDPR), and integrating external APIs for nutritional and allergen
data. Real-time image processing optimization and cloud deployment experience (e.g.,
AWS, Azure) are necessary for delivering instant feedback and scaling the system for
high user traffic.

3.1.3 Data Availability

NutriScan AI requires a comprehensive and up-to-date food ingredient dataset that
includes detailed nutritional information, such as calorie content, macronutrients
(proteins, fats, carbs), and micronutrients (vitamins, minerals), along with allergen data
to provide personalized health alerts. Additionally, a diverse set of high-quality food
images is needed for training the model to recognize ingredients accurately. Health and
risk data, including classifications of ingredients based on their safety (e.g., Type 0 to
Type 3), is crucial for the AI's risk assessment. Furthermore, personal user data, such as
dietary preferences and allergy information, must be securely stored and encrypted,
complying with privacy regulations like GDPR and HIPAA to ensure data security and
user privacy.

NutriScanAI 8
Team ID: 103 2CEIT703: Capstone Project-III

3.2 Time schedule feasibility

3.2.1 Project Timeline
Create a detailed project timeline with milestones and deadlines. Ensure that the project
can be completed within the allotted time, considering factors like development,
testing, and documentation phases.

3.2.2 Resource Allocation

Assess the availability of team members and other resources required to meet the
project's timeline. Ensure that workloads are manageable and realistic.

3.3 Operational Feasibility

3.3.1 User Needs and Acceptance
User acceptance of NutriScan AI relies on delivering a seamless, user-friendly interface
with accurate and timely health assessments. Users need a simple process to upload
food images, understand nutritional analysis, and receive health alerts. Ensuring user
privacy by securing sensitive health data and providing transparency in data handling
are crucial for building trust and encouraging adoption.

3.3.2 User Training

Training users will focus on helping them understand how to upload food images,
interpret health risk classifications, and utilize personalized feedback effectively. Clear
instructions on managing user profiles, allergies, and preferences will also be essential
for a smooth user experience.

3.4 Implementation feasibility

3.4.1 Development Resources
The project requires skilled developers, data scientists, and UX/UI designers to build
and optimize the AI model, web interface, and backend systems. Availability of
resources and team expertise must be ensured to meet project timelines.

3.4.2 Infrastructure and Hosting

The system will need reliable cloud hosting (AWS, Azure) for handling image
processing, AI model inference, and user data storage. Scalability to support real-time
image analysis and large user bases should be prioritized.

3.5 Economic feasibility

3.5.1 Cost Analysis
A cost estimate should cover expenses for development, data acquisition, AI model
training, infrastructure, and maintenance. The budget must be evaluated to ensure the
project remains financially viable while meeting performance expectations.

NutriScanAI 9
Team ID: 103 2CEIT703: Capstone Project-III

4 SOFTWARE REQUIREMENTS SPECIFICATIONS (SRS)

4.1 Software Requirements
4.1.1 Operating System
- Development: Windows, macOS, or Linux (based on the developers'
preferences)
- Deployment Server: Linux (recommended for server hosting due to stability
and cost- effectiveness)

4.1.2 Development tools and frameworks

- Programming Languages: Python
- Python Libraries: TensorFlow/Keras (for deep learning), OpenCV[2] (for
image processing), Pandas (for data handling), Streamlit (for web application
development)
- Web Framework: Streamlit (for building interactive web apps)
- Database Management System: MySQL or MongoDB (for storing user data,
food ingredients, and health classifications)

4.1.3 Version Control

- Git and a platform like GitHub, GitLab, or Bitbucket for version control and
collaboration.

4.1.4 Integrated Development Environment (IDE)

- Visual Studio Code, PyCharm, or Sublime Text for Python development and
web interface design.

4.1.5 Development and Testing Tools

- Testing Frameworks: pytest (for unit testing), Selenium (for UI testing)
- Virtual Environment: Virtualenv or Conda (for managing Python
dependencies)
- Dependency Management: pip (for managing Python packages)
- Continuous Integration/Continuous Deployment (CI/CD) Tools: Jenkins,
GitLab CI/CD, or CircleCI (for automated testing and deployment)

4.2 Hardware Requirements

4.2.1 Development Machine
- A modern computer or laptop with a multi-core CPU (Intel i5 or above, AMD
Ryzen equivalent recommended) and at least 8 GB of RAM.

NutriScanAI 10
Team ID: 103 2CEIT703: Capstone Project-III

- Sufficient storage space for development tools and datasets (minimum 256 GB
SSD recommended).

4.2.2 Server Hosting

- If deploying the project to a cloud server, consider cloud providers like Amazon
WebServices (AWS), Google Cloud Platform (GCP), or Microsoft Azure.
- The server hardware specifications should align with expected traffic and
resource needs for real-time image processing and user interactions.

4.2.3 Web Server Hardware

- Ensure the server has sufficient CPU, RAM, and storage to efficiently handle
incoming user requests for image uploads, analysis, and feedback.

4.2.4 Database Server Hardware

- If using a dedicated database server, it should meet the requirements of the
chosen DBMS (e.g., MySQL, PostgreSQL), with adequate storage for user data,
food ingredients, and health risk classifications.

4.2.5 Machine Learning Hardware(Optional)

- For faster training of machine learning models, a high-end GPU (e.g., NVIDIA
GeForce RTX or higher) is recommended. Alternatively, cloud-based GPU
instances can be used for model training and inference.

4.2.6 Web Camera

- A compatible high-resolution webcam for capturing food images from users,
particularly for real-time image analysis in the web application.

NutriScanAI 11
Team ID: 103 2CEIT703: Capstone Project-III

5 PROCESS MODEL
5.1 Problem Definition and Requirements Analysis
- Identify Objectives: Define the main goals of NutriScan AI, such as real-time
food ingredient detection, health risk classification, and personalized nutrition
analysis.
- Requirement Gathering: Gather functional requirements (e.g., accurate
ingredient recognition, health impact categorization, allergy alerts) and
non-functional requirements (e.g., real-time performance, scalability, ease of
use).
- Stakeholder Analysis: Identify stakeholders, including end-users (e.g.,
individuals, health-conscious consumers), developers, and potential clients (e.g.,
food brands or nutritionists).

5.2 System Design

- Architecture Design: Design the overall architecture, which includes:
o Input Module: User uploads images of food ingredients via a
mobile/web interface.
o Processing Module: Machine learning models for ingredient detection
and classification (using frameworks like TensorFlow or Keras).
o Storage Module: Database to store food ingredients, health risk data,
user profiles, and historical data.
o Output Module: Real-time feedback displayed to users about the
nutritional value and health risks of food ingredients.

- Module Design: Detail the design of each module:

o Food Ingredient Detection Module: Using image recognition
techniques (e.g., CNNs) to identify ingredients in food images.
o Health Risk Classification Module: Classifying food ingredients based
on their health impact (Type 0 to Type 3).
o User Profile Module: Handling personalized health preferences and
allergy information.
o User Interface Module: Creating a user-friendly web interface using
tools like Streamlit for visualizing the results.

5.3 Data Collection and Preprocessing

- Data Acquisition: Collect a diverse set of food images and nutritional
information from open food databases or custom datasets[3].
- Data Annotation: Label the food images for training purposes, specifying
ingredients and health risk categories.
- Data Augmentation: Use techniques like rotation, scaling, and flipping to
increase dataset diversity and improve model generalization.

NutriScanAI 12
Team ID: 103 2CEIT703: Capstone Project-III

- Preprocessing: Normalize images, resize them to standard dimensions, and

perform color adjustments if needed for optimal model input.

5.4 Model Development

- Algorithm Selection: Choose appropriate machine learning algorithms for food
ingredient detection and classification (e.g., supervised models for health risk
categorization).
- Training: Train the models using labeled data, split into training, validation,
and test sets for evaluation.
- Hyperparameter Tuning: Optimize model hyperparameters for enhanced
accuracy and efficiency, such as learning rate, batch size, and epochs.
- Validation and Testing: Validate and test the trained models using separate test
data to evaluate performance (accuracy, speed) and robustness.

5.5 System Integration

- Integration of Modules: Integrate the food ingredient recognition, health risk
classification, user profile management, and nutrition feedback modules.
- Real-time Processing: Implement real-time image processing to analyze food
ingredients uploaded by users quickly and efficiently, providing immediate
feedback on health risks and nutritional information.
- Database Integration: Ensure seamless interaction with the database for
storing and retrieving food ingredient data, user profiles, health risk
classifications, and allergy information.

5.6 Performance Optimization

- Speed Optimization: Optimize machine learning models and image processing
algorithms to ensure real-time performance, minimizing delays in ingredient
detection and health analysis.
- Resource Management: Ensure efficient use of CPU and GPU resources,
particularly when processing large food image datasets or running complex
deep learning models.
- Scalability: Design the system to handle large-scale user uploads and ingredient
databases, supporting multiple concurrent users without compromising
performance.

5.7 Testing and Validation

- Unit Testing: Test individual modules, including food recognition, health risk
classification, and user profile management, for correctness and accuracy.
- Integration Testing: Ensure that all integrated modules work together
seamlessly, providing smooth functionality across the system.

NutriScanAI 13
Team ID: 103 2CEIT703: Capstone Project-III

- System Testing: Test the entire system, including the web interface, AI model,
and database interaction, under real-world conditions to assess overall
performance and reliability.
- User Acceptance Testing: Gather feedback from users, ensuring that the
system provides accurate health risk classifications, personalized nutrition
recommendations, and user-friendly interactions.

NutriScanAI 14
Team ID: 103 2CEIT703: Capstone Project-III

6 PROJECT PLAN
6.1 Project planning and Initial Research (Week 1)
Objectives: Establish project goals, define the scope, and gather initial requirements.
Activities:
- Conduct team meetings to clarify project objectives.
- Identify key features such as real-time food image analysis, health risk
classification, and allergy detection.
- Develop a high-level project plan, outlining phases and milestones.

6.2 Design Phase (Weeks 2-3)

Objectives: Develop the system design, including architecture, modules, and database
schema.
Activities:
Sprint 1:
- System Architect: Design overall architecture (AI model, database, front-end
interface).
- UI/UX Designer: Create wireframes and initial user interface mockups for the
web application.
- Review: Present design concepts and receive feedback for refinement.

6.3 Data Collection and Preprocessing (Weeks 4-6)

Objectives: Collect and preprocess data required for training the food ingredient
recognition models.
Activities:
Sprint 2 (Weeks 4-5):
- Data Engineers: Gather food ingredient and nutritional datasets, including
allergen data.
- Data Scientists: Perform data augmentation (rotation, resizing) and
preprocessing (normalization, labeling).
- Review: Validate the quality of preprocessed data for model readiness.
Sprint 3 (Week 6):
- Data Engineers: Finalize dataset and ensure it is ready for model training.
- Data Scientists: Review and confirm dataset quality for training.

NutriScanAI 15
Team ID: 103 2CEIT703: Capstone Project-III

6.4 Model Development (Weeks 7-12)

Objectives: Develop and train the NutriScan AI models for food ingredient recognition
and health risk classification.

Activities:
Sprint 4 (Weeks 7-9):
- Data Scientists: Select appropriate machine learning algorithms for food
recognition and health classification.
- Machine Learning Engineers: Train models using the preprocessed datasets.
- Review: Evaluate the initial model performance and refine for accuracy.

Sprint 5 (Weeks 10-12):

- Data Scientists: Further refine and validate models.
- Machine Learning Engineers: Perform hyperparameter tuning.
- Review: Finalize model selection based on performance metrics.
6.5 System Integration (Weeks 13-15)
Objectives: Integrate food ingredient recognition, health risk classification, and user
profile management modules with the rest of the system.
Activities:
Sprint 6:
- Database Administrators: Integrate the database with food ingredient data, user
profiles, and health classifications.
- Review: Test module integration to ensure seamless operation between the AI
models and database, making necessary adjustments.

6.6 Performance Optimization (Weeks 16-17)

Objectives: Optimize the NutriScan AI system for real-time processing and efficient
resource management.
Activities:
Sprint 7:
- System Engineers: Optimize algorithms for faster food ingredient recognition
and health risk categorization.
- DevOps Engineers: Manage CPU/GPU resources and ensure optimal
performance for real-time analysis.
- Review: Conduct performance testing and make adjustments to improve system
speed and resource management.

NutriScanAI 16
Team ID: 103 2CEIT703: Capstone Project-III

6.7 Testing and Validation (Weeks 18-20)

Objectives: Conduct thorough testing to validate the system's accuracy and reliability.
Activities:
Sprint 8:
- Quality Assurance (QA) Team: Perform unit testing on individual modules and
integration testing across the entire system.
- QA Team: Test system functionality in real-world scenarios to validate
performance and accuracy.
- Review: Analyze test results, address any bugs, and refine the system for
deployment readiness.

6.8 Deployment (Weeks 21-22)

Objectives: Deploy NutriScan AI in the target environment and ensure its operational
functionality.
Activities:
Sprint 9:
- DevOps Engineers: Develop and execute the deployment plan to move the
system to production.
- System Administrators: Deploy NutriScan AI, ensuring proper integration with
cloud platforms and monitor for any post-deployment issues.
- Review: Confirm that the system is fully deployed, functional, and address any
immediate concerns or issues.

6.9 Maintenance and Updates (Ongoing)

Objectives: Provide ongoing support, maintenance, and regular updates for NutriScan
AI.
Activities:
Sprint 10:
- Support Team: Offer user support, address any issues reported, and gather
feedback for future improvements.
- Development Team: Implement regular bug fixes, updates, and new features
based on user feedback and technological advancements.
- Review: Implement regular bug fixes, updates, and new features based on user
feedback and technological advancements.

NutriScanAI 17
Team ID: 103 2CEIT703: Capstone Project-III

7 SYSTEM DESIGN
7.1 Class Diagram

Fig 7.1 : Class Diagram

NutriScanAI 18
Team ID: 103 2CEIT703: Capstone Project-III

7.2 Activity Diagram

Fig 7.2 : Activity Diagram

The diagram depicts the user journey of a food safety application, beginning with user
authentication, followed by data input or image upload. The system then processes the
data to extract ingredients and assess potential risks, providing the user with a final
report.

NutriScanAI 19
Team ID: 103 2CEIT703: Capstone Project-III

7.3 Use-case Diagram

Fig 7.3 : Use-Case Diagram

This diagram illustrates the user flow of a food safety application, starting with user
login and leading to ingredient analysis and risk assessment
7.4 Data Flow Diagram
7.4.1 Level 0 :

Fig 7.4.1 : Data Flow Diagram Level 0

This diagram illustrates the user interaction with the NutriScan AI system. The user
first enters their credentials and uploads an image of food. The system then analyzes
the image to identify the ingredients and assess potential risks, providing the user with
a detailed report.

NutriScanAI 20
Team ID: 103 2CEIT703: Capstone Project-III

7.4.2 Level 1 :

Fig 7.4.2 : Data Flow Diagram Level 1

This diagram illustrates the workflow of a food image analysis system. The user
starts by entering their username and selecting an image to upload. The system
then validates the image to ensure it meets the required format and quality
standards. If the image is valid, the system performs Optical Character
Recognition (OCR) to extract text from the image, matches the extracted
ingredients with a database of known ingredients, and finally displays the results
to the user.

NutriScanAI 21
Team ID: 103 2CEIT703: Capstone Project-III

7.4.3 Level 2 :

Fig 7.4.3.1 : Data Flow Diagram Level 2

NutriScanAI 22
Team ID: 103 2CEIT703: Capstone Project-III

Fig 7.4.3.2 : Data Flow Diagram Level 2

The DFD level 2 provides a detailed breakdown of the system's processes involved in
food image analysis. It starts with user input, image validation, and OCR to extract text.
The extracted text undergoes cleaning and tokenization for ingredient matching.
Finally, the system displays the results, including ingredient identification, allergy
information, and an HTML report.

NutriScanAI 23
Team ID: 103 2CEIT703: Capstone Project-III

8 IMPLEMENTATION DETAILS
8.1 Understanding the Foundation
8.1.1 Tech Stack
8.1.1.1 Programming Language:
- Python - A widely-used language with strong support for machine learning,
deep learning, and computer vision tasks, providing a broad range of libraries
for data manipulation, image processing, and model development.

8.1.1.2 Computer Vision Libraries:

- OpenCV[2] (Open Source Computer Vision Library) - A comprehensive
open-source library for image and video processing, used to handle tasks such
as food image preprocessing, object detection, and feature extraction.
- TensorFlow/Keras - Powerful deep learning frameworks for developing,
training, and fine-tuning machine learning models to recognize and classify
food ingredients.

8.1.1.3 Machine Learning Libraries:

- scikit-learn - A well-known Python library providing tools for data
preprocessing, model training, and evaluation. It helps in implementing
classification algorithms to categorize food ingredients based on their health
impact.
- Pandas - For data manipulation and analysis, especially for working with large
food databases, user profiles, and nutritional information.

8.1.1.4 User Interface:

● Streamlit - A Python-based web application framework used to create
interactive, user-friendly front-end interfaces. This tool will display food
analysis results, show health risks, and allow users to upload and interact with
their food images.

8.2 Data collection

8.2.1 Data Sources
The success of NutriScan AI relies on gathering a diverse dataset of food ingredients,
nutritional information, and allergen data. The data for training and development will
come from public datasets, nutritional databases (e.g., USDA, Open Food Facts), and
custom-collected food images, ensuring comprehensive coverage of food types,
ingredient compositions, and potential health risks. Data collection methods will
involve scraping online nutritional databases, collaborating with food industry sources,
and manually annotating image data for model training.
8.2.2 Image Data
For NutriScan AI, we work with a diverse set of food images, each containing various
food ingredients that are labeled with corresponding details such as their nutritional
information and health risk classification. The dataset[3] includes both raw images of
food items and processed data (like nutritional information, allergens, and health
categories) which are essential for training our machine learning models.

NutriScanAI 24
Team ID: 103 2CEIT703: Capstone Project-III

8.2.3 Quantity and Quality

The effectiveness of NutriScan AI depends on the quantity and quality of the data
collected. Our dataset includes a large volume of images from a wide variety of food
types, ensuring that the AI can learn to recognize and classify ingredients from multiple
cuisines and food categories. High-quality images are crucial for accurate ingredient
recognition and nutritional analysis.

8.2.4 Data Privacy and Consent

We take data privacy seriously. For NutriScan AI, we collect food images and user data
(e.g., dietary preferences, allergies) only after obtaining explicit consent from users.
Their personal data, including dietary information, is securely stored and encrypted,
following best practices for privacy protection and compliance with regulations like
GDPR. Only anonymized data is used for model training to safeguard user privacy.

8.2.5 Data Annotation

Data annotation for NutriScan AI is a crucial process for training the machine learning
model. We use a combination of manual and automatic annotation methods to label
food images with the correct ingredients, nutritional information, and health risk
classifications. This ensures that the AI model learns to identify ingredients accurately
and classify them based on health impact.

8.2.6 Data Challenges

Collecting a wide variety of food images with accurate labeling can be a
time-consuming task. Ensuring that images represent diverse food items and account
for variations in presentation (e.g., food preparation styles) adds complexity to data
collection. Additionally, obtaining accurate nutritional and health risk data for all
ingredients can be a challenge.

8.3 Data Preprocessing

8.3.1 Data Cleaning
The collected images undergo a rigorous cleaning process to remove noise and
irrelevant data. This ensures that the model only trains on high-quality, representative
food images.
8.3.2 Data Normalization
Normalization of image data is essential for standardizing the food images in terms of
size, brightness, and contrast, making it easier for the model to detect and classify
ingredients consistently, regardless of external factors like lighting or presentation style.

NutriScanAI 25
Team ID: 103 2CEIT703: Capstone Project-III

8.3.3 Data Augmentation

To increase the diversity of the dataset and improve the model's robustness, data
augmentation techniques such as rotation, cropping, and flipping are applied. This
helps the model generalize better, especially for real-time food image processing.

8.3.4 Data Splitting

The dataset is split into training, validation, and test sets to allow for effective model
training and evaluation. This ensures that the model can be tested on unseen data,
providing a realistic assessment of its accuracy and performance.

8.3.5 Data Labelling

In NutriScan AI, data labeling is a crucial step in the preprocessing phase. It involves
mapping food images to their corresponding ingredients, nutritional values, health risk
classifications, and allergen information. This labeling enables the AI model to
accurately recognize and categorize food items, assess their health impact, and provide
nutritional analysis.

8.3.6 Data Balancing

To ensure that the model does not favor one category of ingredients over another,
techniques such as oversampling, undersampling, or synthetic data generation (e.g.,
SMOTE) are applied to balance the dataset. This ensures fair representation of all food
categories, which is vital for achieving a robust and accurate model that can handle
diverse food types.

8.3.7 Data Storage

The preprocessed data, including food images and their associated labels (nutritional
information, health classifications, and allergens), is stored in a structured manner. This
allows for efficient access and retrieval during training and testing.

8.3.8 Data Versioning

Data versioning is implemented to maintain consistency and traceability throughout
NutriScan AI’s development. By versioning datasets, we ensure that changes to the data
are documented, enabling us to track data modifications and maintain data integrity
during model updates and improvements. This practice ensures that the system can
maintain backward compatibility and facilitate reproducibility.

8.3.9 Tools and Frameworks

The data preprocessing phase for NutriScan AI leverages several powerful tools and
frameworks. OpenCV[2] is used for image processing tasks like resizing,

NutriScanAI 26
Team ID: 103 2CEIT703: Capstone Project-III

normalization, and augmentation. scikit-learn handles machine learning preprocessing

tasks, while TensorFlow is employed for building and training the deep learning models
that power the ingredient recognition and health risk classification features. These tools
streamline the data preprocessing pipeline, ensuring efficient handling and preparation
of data for model training.

8.4 Training
8.4.1 Preprocessing Module
The preprocessing module is responsible for preparing food images for analysis. Key
tasks include resizing images to a consistent resolution, normalizing pixel values to
standardize the input data, and applying data augmentation techniques such as rotation,
flipping, and scaling to increase dataset diversity and improve the model's robustness.
This step ensures that food images are standardized for feeding into the neural network
while maintaining data diversity for better generalization.

8.4.2 Ingredient Extraction

The ingredient detection module utilizes Easy OCR or other suitable algorithms to
identify and localize different ingredients within the input food images. This step
locates regions of interest in the image that contain food items, preparing them for
further analysis in the next stages. The module may employ object detection techniques
such as Easy OCR to accurately identify and segment food ingredients.

8.4.3 Feature Extraction Module

Once the ingredients are detected, the feature extraction module extracts essential
characteristics from the image, such as shapes, textures, and patterns specific to each
food item. These features are converted into high-dimensional vectors that represent the
unique properties of the detected ingredients. This module helps the model capture the
distinctive aspects of different food types, such as their color, texture, and shape, which
are key for classification.

8.4.4 Health Risk Classification Module

The health risk classification module analyzes the extracted features and compares
them to a pre-built database of known food ingredients and their associated health risks.
Using machine learning algorithms, the system classifies each ingredient into different
health categories, ranging from "safe" to "harmful" (Types 0–3). The module may use
similarity metrics such as cosine similarity or Euclidean distance to compare features
with those in the database, enabling accurate classification based on the health impact
of each ingredient.

NutriScanAI 27
Team ID: 103 2CEIT703: Capstone Project-III

8.4.5 Data Collection and Preparation

For NutriScan AI, a diverse dataset[3] of food images is collected, representing various
types of ingredients from different food categories. Each image is labeled with the
corresponding ingredient name and its health classification based on its impact (e.g.,
Type 0 - Safe, Type 3 - Harmful). This dataset serves as the training data for both
ingredient detection and health risk classification models.

8.4.6 Model Selection and Architecture Design

Suitable pretrained models or architectures are selected based on their ability to handle
food images effectively. Computer Vision(CV2s) are typically chosen for their
performance in image recognition tasks. Models such as ResNet or EfficientNet, known
for their computational efficiency and ability to recognize fine-grained features, are
evaluated. A hybrid model combining food detection with health classification is
designed to ensure compatibility with project requirements.

8.4.7 Finetuning and Training

The selected models are finetuned and trained using the labeled food dataset. During
training, the models learn to detect food ingredients accurately and classify them
according to their health risk. Data augmentation techniques like rotation, scaling, and
cropping are applied to improve the model’s robustness. Training involves iterating on
the model, adjusting hyperparameters, and optimizing the performance for real-time
analysis of food images.

8.4.8 Validation and Evaluation

The trained models are validated using separate validation datasets to assess
performance metrics such as accuracy, precision, recall, and F1 score. This evaluation
helps ensure that the models can generalize well to unseen food images. Iterative
adjustments and fine-tuning are made based on the validation results to improve
classification accuracy and minimize errors in ingredient detection and health risk
assessment.

8.4.9 Deployment

Once the models achieve satisfactory performance, they are deployed into the
production environment. This includes integrating the models into the NutriScan AI
web application, ensuring it can analyze food images in real-time. The system is
deployed on a cloud or server infrastructure that supports fast processing of food
images. Continuous monitoring and updates are implemented to ensure optimal
performance and to handle any potential issues with the real-time ingredient analysis
and health classification.

NutriScanAI 28
Team ID: 103 2CEIT703: Capstone Project-III

8.5 Design Access

8.5.1 Creating Minimalistic Layouts
For NutriScan AI, the user interface will be designed with a focus on minimalism to
create a clean, straightforward experience. The layout will prioritize essential
functionalities such as image upload, real-time ingredient analysis, health risk
classification, and allergy alerts. Unnecessary elements and distractions will be
minimized, ensuring that users can easily navigate the app. Icons and buttons will be
intuitive and well-labeled, offering users clear guidance to upload food photos and view
analysis results without any confusion.

8.5.2 Incorporating User Testing and Feedback Integration

NutriScan AI’s design process will be highly user-centric. Real-time feedback will be
collected from users through surveys, direct feedback forms, and user testing sessions.
This feedback will be actively integrated into the iterative design and development
process, refining features based on user needs. For example, if users express difficulty
understanding ingredient health classifications, adjustments will be made to the
color-coding system or labeling of food health risks. Continuous user input will ensure
that the app is accessible and effective for a broad range of users, including those with
dietary restrictions or health conditions.

8.6 Security Measures

8.6.1 Regular Security Audits and Vulnerability Assessments
NutriScan AI will undergo regular security audits and vulnerability assessments to
ensure the platform remains secure. These audits will be conducted by security experts
who will assess the system for potential vulnerabilities. Penetration testing will be
performed to simulate attack scenarios and identify any weaknesses. The app will be
continuously updated to address any discovered vulnerabilities, ensuring a secure user
experience.

8.6.2 Implementing Multi-Factor Authentication

To enhance user account security, NutriScan AI will offer multi-factor authentication
(MFA). Users will be encouraged to enable MFA, which could involve SMS-based
authentication, email verification, or biometric recognition (such as fingerprints or face
scanning). This additional layer of security ensures that only authorized users can
access sensitive data, such as health information or personalized food analysis results.

8.6.3 Ensuring Data Anonymization

Where applicable, NutriScan AI will anonymize user data to safeguard privacy.
Personally identifiable information (PII) such as names or email addresses will be
separated from health data and food analysis results. Anonymization will allow
NutriScan AI to analyze usage patterns and improve services without compromising

NutriScanAI 29
Team ID: 103 2CEIT703: Capstone Project-III

user privacy. This will be particularly important for users who may be sharing dietary
or allergy information, ensuring that sensitive health data is protected and not linked to
personal identifiers.

8.6.4 Compliance with Data Protection Regulations

For NutriScan AI, we are committed to adhering to regional and international data
protection regulations, including the General Data Protection Regulation (GDPR). User
data, such as uploaded food images, ingredient analysis, and health risk profiles, will be
handled with the utmost care and transparency. Our data collection practices will be
fully compliant with the GDPR guidelines, ensuring that personal and sensitive data is
processed lawfully, fairly, and transparently.

8.7 Scalability and Performance Optimization

8.7.1 Efficient Code Optimization
To ensure NutriScan AI operates smoothly and efficiently, we employ best practices for
code optimization. Our development team will focus on creating clean, modular, and
well-structured code, reducing resource consumption while maintaining functionality.
Efficient algorithms will be employed to process food images and analyze ingredients
in real-time, ensuring that the system can handle high volumes of concurrent users
without compromising performance. By optimizing code, we ensure that the app
remains responsive even when analyzing large amounts of data or when processing
complex ingredient classifications.

8.7.2 Server-Side Optimization

To manage the heavy computational load of real-time image analysis and classification,
NutriScan AI will use server-side optimizations. Tasks such as image processing, AI
model inference, and database queries will be handled by robust, cloud-based servers.
Load balancing will ensure that user requests are evenly distributed across servers,
preventing overloading and maintaining the app's responsiveness during peak usage
times. Caching mechanisms will store frequent data, such as ingredient classifications,
to reduce redundant processing and speed up responses.

8.7.3 Image and Data Compression

Reducing network latency is crucial for real-time applications like NutriScan AI. We
utilize techniques such as data compression, WebSocket protocols, and asynchronous
data loading to minimize latency. These methods enable rapid data exchange between
the app and servers, ensuring faster food image analysis and quick delivery of health
reports. Compressed data requires less bandwidth, allowing users to upload food
images and receive feedback with minimal waiting times.

NutriScanAI 30
Team ID: 103 2CEIT703: Capstone Project-III

8.7.4 Continuous Performance Monitoring

Food images can be data-intensive, especially when processed for analysis. To ensure
quick results, we implement image and data compression algorithms that reduce the
size of multimedia files exchanged within the app. This leads to faster transmission of
data, reducing loading times for users and improving the overall user experience.

8.7.5 User Experience Feedback Loops

We incorporate performance monitoring tools that continuously track the app's
responsiveness, server load, and resource utilization. These tools provide real-time
insights into system performance, enabling us to identify bottlenecks and address them
proactively. By regularly collecting user feedback on app speed and performance, we
can continuously refine the app, resolve slowdowns, and ensure an optimal experience
for all users.

8.7.6 Scalable Architecture

To support a growing user base and increasing data volume, we prioritize scalable
architecture. We leverage cloud infrastructure and load balancing to handle large
datasets and ensure smooth app performance under heavy use. This scalable approach
helps maintain fast, efficient data processing, allowing NutriScan AI to grow and adapt
while continuing to deliver accurate results quickly.

8.8 Documentation and Ongoing Maintenance

8.8.1 Creating User Guides and Ensuring Long-Term Support
Documentation is key to ensuring users understand and can efficiently utilize
NutriScan AI. We provide comprehensive user guides and manuals that cover how to
upload food images, interpret nutritional information, and make use of the app's
features. These guides include step-by-step instructions, common troubleshooting tips,
and FAQs, ensuring that users can navigate the app smoothly and understand how to
get the most value from the nutritional analysis tools.

8.8.2 Long-Term Maintenance and Support

Long-term maintenance and support are integral to the app's success. We offer
continuous support services, addressing bug fixes, performance improvements, and
necessary security updates. Our dedicated support team is available to assist users with
any issues they encounter, ensuring timely resolutions. Regular updates will guarantee
that NutriScan AI stays up-to-date with evolving dietary trends, new food ingredients,
and changing health guidelines, ensuring a reliable and secure experience for users over
time.

NutriScanAI 31
Team ID: 103 2CEIT703: Capstone Project-III

8.9 Final Testing and User Feedback

8.9.1 Thoroughly Testing the App : User Opinion Matters
Before launching NutriScan AI, the app undergoes rigorous testing across various
functional, performance, and usability aspects. Our Quality Assurance (QA) team
conducts extensive tests, simulating different real-world use cases and scenarios. We
also incorporate beta testing to gather user feedback from actual users, allowing us to
identify any potential issues early on and fine-tune the app for reliability and user
satisfaction. Beta testers provide valuable insights, helping us make adjustments to the
app before the official launch.

8.10 Deployment Strategies

8.10.1 Getting the App into User's Hands
Deployment is a critical phase for bringing NutriScan AI to users. We implement a
gradual rollout strategy, initially releasing the app to a select group of users. This
allows us to assess initial user experiences and make adjustments based on real-world
feedback. Once any necessary improvements have been made, we expand the release to
a larger user base.

8.10.2 User Training and Support

Upon deployment, we offer comprehensive user training through tutorials, webinars,
and interactive guides to help users understand the app’s features. We also set up
dedicated support channels including email, chat, and helplines to address any queries
or issues promptly. These resources ensure users feel confident in using the app to its
full potential and that any problems are addressed quickly.

8.10.3 Continuous Iterative Development

For NutriScan AI, deployment marks the beginning of an ongoing, iterative
development cycle rather than the end. Regular updates and feature enhancements are
planned based on user feedback, advancements in nutritional science, and emerging
technologies. As new ingredients, health data, and dietary trends evolve, we
continuously improve the app's functionality and accuracy. User suggestions and
reported issues will be addressed in each update, ensuring the app remains relevant and
effective. This iterative approach guarantees that users always receive the best possible
service and that the app adapts to meet changing health and dietary needs over time.

NutriScanAI 32
Team ID: 103 2CEIT703: Capstone Project-III

9 TESTING
9.1 Introduction to NutriScan AI Testing
Testing is a vital phase in the development of NutriScan AI. This process ensures that
the system functions as intended, delivers accurate results, and provides a seamless user
experience. By thoroughly evaluating the application's features and usability, testing
helps achieve the project’s objective of empowering users to make informed decisions
about their food choices.

9.2 Testing Strategies

9.2.1 Internal Testing
Our development team will perform rigorous internal testing to evaluate the accuracy of
food analysis, the app's performance, and its usability. This phase ensures that the AI
model accurately identifies harmful or banned ingredients and provides meaningful
insights.

9.2.2 User Trials with Friends

We will engage friends and acquaintances to test the app by uploading or scanning food
labels from various products. Their feedback will help identify usability challenges,
inconsistencies in results, and areas for enhancement before launching to a wider
audience.

9.2.3 Gradual User Release

NutriScan AI will follow a phased release strategy, starting with a beta version for a
small group of users. This allows for iterative feedback collection and refinement,
ensuring the app is robust, reliable, and user-friendly before its full-scale release.

9.3 Importance of Testing

Testing is the cornerstone of validating NutriScan AI's ability to deliver accurate and
reliable food assessments. It instills confidence in the app's functionality and ensures
the system meets its goal of promoting healthier food choices by identifying harmful
ingredients.

● Accuracy: Ensuring that the AI model correctly identifies unhealthy or banned

ingredients across diverse food products.
● Reliability: Verifying that the app performs consistently under various
scenarios.
● User Experience: Guaranteeing that the app is intuitive and easy to use for all
users, regardless of their technical expertise.

NutriScanAI 33
Team ID: 103 2CEIT703: Capstone Project-III

9.3.1 Rigorous Testing

Thorough testing is crucial to detect and address potential issues, optimize the AI
model’s performance, and improve the overall user experience. A systematic approach
minimizes the risk of errors and ensures that NutriScan AI is both dependable and
accessible.

9.4 Unit Testing

9.4.1 Overview

Unit testing will focus on verifying individual components of NutriScan AI in isolation.

Each module, such as the ingredient scanning feature, the AI analysis engine, and the
user interface, will be tested to ensure they work as intended.

● Ingredient Scanning Module: Tests will validate the accuracy of text

extraction from uploaded images or scanned labels.
● AI Analysis Engine: This involves verifying the AI's capability to identify and
flag harmful or banned ingredients accurately.
● User Interface (UI): Ensures that buttons, menus, and navigation paths
function seamlessly.
● Performance Testing: Assesses the app's speed and stability when handling
large datasets or multiple simultaneous users.

9.4.2 The Role of Unit Testing

Unit testing is pivotal in validating the correctness of NutriScan AI's core components.
It enables early detection and correction of errors, ensuring the smooth functioning of
the system. By isolating individual modules for testing, unit testing minimizes the risk
of issues escalating to affect the entire application. This makes it a critical quality
assurance step in the development process.

9.4.3 Unit Test Cases

Unit test cases for NutriScan AI are crafted to verify the functionality and reliability of
specific features or modules. These tests cover a range of scenarios, from standard use
cases to edge cases, ensuring that the system is robust under varying conditions. Each
test case targets a particular aspect of the application to guarantee thorough validation.

9.4.4 Example of Unit Test Case

An example unit test case for NutriScan AI involves validating the accuracy of the AI
analysis engine by testing its ability to correctly identify harmful or banned ingredients
from an uploaded or scanned label. The test ensures the system detects predefined
harmful substances, such as "sodium benzoate" or "aspartame," and highlights them in
the results.

NutriScanAI 34
Team ID: 103 2CEIT703: Capstone Project-III

9.5 Integration Testing

9.5.1 Overview
Integration testing in NutriScan AI focuses on the interactions and collaborations
between its various modules, such as the OCR text extraction, AI analysis engine, and
user interface. This phase ensures that these components work cohesively when
combined, addressing potential compatibility issues and inconsistencies.

9.5.2 The Role of Integration Testing

Integration testing validates that the integrated system functions as a unified whole,
meeting its intended objectives. It is essential for identifying issues related to data flow,
communication between components, and bottlenecks that could impact the app’s
performance and reliability.

9.6 User Testing

9.6.1 Overview
User testing is a pivotal phase for NutriScan AI, emphasizing a user-centric evaluation
of the system. It moves beyond technical validation to understanding real user
interactions and gathering valuable feedback on the app's usability and performance.

9.6.2 Importance of User Testing

User testing is critical for assessing NutriScan AI’s user-friendliness, accessibility, and
effectiveness in real-world scenarios. Insights from real users help evaluate how
intuitive the system is, how well it meets user expectations, and its overall impact on
decision-making for healthier food choices.
9.6.3 User Testing Scenarios
User testing scenarios involve users interacting with NutriScan AI to perform real-life
tasks, such as scanning a food label, uploading an ingredient list, and interpreting the
health analysis results. These scenarios aim to evaluate the app's usability, functionality,
and overall user experience across diverse usage contexts, including varying device
types and environmental conditions.
9.6.4 User feedback and iterative development
Feedback gathered during user testing is an invaluable resource for iterative
development. User insights are carefully analyzed to identify areas for improvement,
such as refining the AI model’s accuracy or enhancing the app's navigation. This
iterative process ensures NutriScan AI aligns with user needs and expectations, leading
to a more refined and effective solution.

NutriScanAI 35
Team ID: 103 2CEIT703: Capstone Project-III

Fig 9.1 : Model testing on Ingredients Scanning

This image displays the interface of NutriScan AI, showcasing an ingredient analysis
system where uploaded food label data is processed. Ingredients are categorized by risk
levels (red for highest risk, green for lowest), with confidence scores indicating
detection accuracy. The user-friendly design helps users quickly identify potentially
harmful substances.
NutriScanAI 36
Team ID: 103 2CEIT703: Capstone Project-III

9.7 Performance Testing

9.7.1 Overview
Performance testing evaluates NutriScan AI’s responsiveness, efficiency, and
scalability to ensure the application operates optimally under various conditions and
load levels. This testing phase is crucial for delivering a seamless experience to users,
even in high-demand scenarios.

9.7.2 Performance Metrics

Performance metrics for the NutriScan AI may include:
9.7.2.1 Response Time:
Measures the time taken by the system to analyze scanned or uploaded
ingredient labels and deliver results. This ensures users receive quick and
accurate health assessments without delays.

9.7.2.2 Throughput:
Assesses the system's ability to handle a high volume of simultaneous
requests, such as multiple users scanning or uploading food labels at the same
time. This ensures NutriScan AI can maintain efficiency during peak usage
periods.

9.7.2.3 Resource Utilization:

Monitors the system's resource usage, including CPU, memory, and network
bandwidth, to ensure the app operates efficiently without overloading the
server or affecting performance.

9.7.2.4 Error Rate:

Measures the frequency of errors encountered during the operation of
NutriScan AI, such as incorrect ingredient recognition, failed label uploads, or
misidentifications in the AI analysis. Monitoring this metric ensures that errors
are minimized, and the system maintains high accuracy and reliability during
use.

9.7.3 Benchmark Results

Benchmarking NutriScan AI under various scenarios evaluates its speed, efficiency,
and reliability. Results highlight potential bottlenecks, such as delays in text extraction
or AI analysis, guiding optimizations to ensure consistent performance across diverse
use cases.

NutriScanAI 37
Team ID: 103 2CEIT703: Capstone Project-III

9.8 Usability Testing

9.8.1 Overview
Usability testing in NutriScan AI focuses on evaluating the user experience, assessing
how easily users can navigate the app, upload or scan food labels, and interpret health
assessments. The goal is to ensure the system is intuitive and user-friendly, providing a
smooth experience for individuals of all technical levels.

9.8.2 Usability Testing Scenarios

Users will interact with NutriScan AI by performing tasks like uploading a food label,
scanning ingredients, and reviewing health analysis results. These scenarios help assess
the app’s ease of use, the clarity of its interface, and how effectively users can
understand and act on the information provided.

9.8.3 Improvements Based on Usability Testing

The results from usability testing will guide improvements to the app’s design and user
interface. Potential enhancements may include streamlining navigation, adding helpful
tooltips or instructions, and improving accessibility to ensure users can easily interact
with the app and make informed food choices.

9.9 Scalability Testing

9.9.1 Overview
Scalability testing evaluates NutriScan AI's ability to manage increased user load and
larger volumes of data, ensuring the system can handle growth without performance
degradation. This phase confirms that the app can efficiently accommodate a growing
user base and rising demand for food label analysis.

9.9.2 Scalability Metrics

Metrics for scalability testing may include:
9.9.2.1 Response time under Load:
Measures how quickly NutriScan AI responds when subjected to heavy usage,
such as multiple users uploading or scanning labels simultaneously.

9.9.2.2 Resource scalability:

Assesses the system's ability to allocate additional resources (e.g., processing
power, memory) to support increased load without affecting performance.

9.9.2.3 Data Handling capacity:

Evaluates how well the system handles a larger volume of ingredient data,
ensuring the AI can process and analyze more food labels concurrently.

NutriScanAI 38
Team ID: 103 2CEIT703: Capstone Project-III

9.9.3 Optimization for Scalability

Based on testing results, optimizations may be implemented to improve scalability.
These may include load balancing, database scaling, and resource allocation
enhancements, ensuring NutriScan AI remains efficient as its user base and data
volume grow.

NutriScanAI 39
Team ID: 103 2CEIT703: Capstone Project-III

10 PROTOTYPE

Fig 10.1 : Welcome Page of NutriScanAI

This image introduces NutriScan AI, an AI-powered web-based application designed
to scan product ingredient labels for harmful or banned substances across different
countries.

NutriScanAI 40
Team ID: 103 2CEIT703: Capstone Project-III

Fig 10.2 : Home Page of NutriScanAI

This image showcases the NutriScan AI prototype interface, featuring a minimalist
design with a sidebar menu offering navigation options like Home, NutriScan, and
Admin.

Fig 10.3 : Ingredients Scanning Page of NutriScanAI

This image shows the figma prototype of user interface of NutriScanAI. Users can input
their name, gender, and state, and then upload an image of food or use the camera to take
a photo. The app will analyze the image and provide information about the ingredients
present in the food.

NutriScanAI 41
Team ID: 103 2CEIT703: Capstone Project-III

Fig 10.4 : Admin Login Page of NutriScanAI

This image shows a login screen with fields for username and password. The user can
enter their credentials and click the "Login" button to proceed. There is also an eye icon
next to the password field, which likely indicates a toggle to show or hide the password
for security purposes.

Fig 10.5 : Admin Dashboard of NutriScanAI

This image depicts an admin dashboard interface displaying a line graph for data trends,
along with two pie charts providing a visual breakdown of categorical data
NutriScanAI 42
Team ID: 103 2CEIT703: Capstone Project-III

11 USER MANUAL

Fig 11.1 : Home Page of NutriScanAI

This image shows the home page of the NutriScanAI application. It provides an
overview of the platform's purpose, which is to evaluate the ingredients in packaged
food items and categorize them based on their potential health impact. The page also
explains the categorization system used by the AI model and provides a brief overview
of how to use the application.

Fig 11.2 : User Page of NutriScanAI

This image shows the user interface of the NutriScanAI application. It presents a form
where users can input their personal details, including name, gender, state, and any
allergies. This information is likely used to personalize the analysis and
recommendations provided by NutriScan AI

NutriScanAI 43
Team ID: 103 2CEIT703: Capstone Project-III

Fig 11.3 : Enter Basic Details

This screenshot is with filled details of the user with their basic details such as state and
name and then the image is uploaded.

Fig 11.4 : Scanned Ingredients from Packet

This image shows the result of uploading a food image to the NutriScanAI application.
The system has successfully identified several ingredients, including potato, roasted
peanuts, peanut, and palm oil. Each ingredient is displayed with a confidence level,
indicating the system's certainty in the identification. The ingredients are also
color-coded to highlight potential allergens or health concerns.

NutriScanAI 44
Team ID: 103 2CEIT703: Capstone Project-III

Fig 11.5 : User with Nut Allergy

This image shows the user interface of the NutriScanAI application. The user has input
their name, gender, state, and specified a nut allergy. They are now ready to upload an
image of food to be analyzed for potential allergens.

Fig 11.6 : Ingredients Matching User Allergy

This image shows the result of uploading a food image to the NutriScanAI application
when the user has a nut allergy. The system has identified several ingredients, including
roasted peanuts, peanut, and nutmeg, which are potential allergens for the user. The
identified allergens are highlighted with a warning symbol and a red background. The
system also displays a list of all detected ingredients, including those that are not
allergens to the user.

NutriScanAI 45
Team ID: 103 2CEIT703: Capstone Project-III

Admin Manual

Fig 11.7 : Admin Login Page

This image shows the admin login screen of the NutriScanAI application. It requires the
admin to enter their username and password to access the administrative panel of the
application.

Fig 11.8 : Successfully Login to Admin Dashboard

This image showcases the admin dashboard of the NutriScanAI application. It provides
key insights and functionalities, including a customizable time period filter, report
generation, and a line graph visualizing user activity over time. This dashboard
empowers the admin to monitor usage, identify trends, and make informed decisions to
enhance the platform.

NutriScanAI 46
Team ID: 103 2CEIT703: Capstone Project-III

Fig 11.9 : Admin Dashboard with Graph Representation

This image displays an admin dashboard featuring various graphs and charts to
visualize data. The dashboard likely provides insights into user activity, usage patterns,
and other relevant metrics. The graphs might show trends over time, comparisons
between different groups, or the distribution of specific data points.

Fig 11.10 : Line Graph for Last 30 Days Usage

This image displays an admin dashboard featuring a line graph that tracks user activity
over the past 30 days. The graph likely shows the number of users or user interactions
over time, providing insights into usage trends and patterns. Additionally, there's a
stacked bar graph that visualizes the distribution of users by gender and state over the
same 30-day period. These graphs help the admin analyze user behavior and make
data-driven decisions.

NutriScanAI 47
Team ID: 103 2CEIT703: Capstone Project-III

12 CONCLUSION AND FUTURE WORK

12.1 Conclusion
In conclusion, NutriScan AI has established itself as a cutting-edge tool in the realm of
health and wellness. Through advanced image recognition and real-time food analysis,
we have created an intuitive platform that helps users make informed decisions about
their diet and overall health. By leveraging artificial intelligence, machine learning, and
a robust database of food ingredients, NutriScan AI provides accurate health
assessments and personalized recommendations, all while prioritizing user privacy and
security. The system’s scalable architecture ensures that it can evolve with the growing
demands of a health-conscious world.

The development of NutriScan AI has been shaped by innovation, dedication, and

user-centric design. We have transformed a simple idea into a practical, accessible tool
that empowers individuals to take control of their health. With its easy-to-use interface
and powerful analytical capabilities, NutriScan AI stands as a testament to our
commitment to improving lives through technology and fostering a healthier, more
informed future.

12.2 Key Achievements

12.2.1 Accurate Health Analysis
Achieved reliable, real-time food health assessments through image recognition,
offering users valuable insights into the ingredients’ impact on their health.

12.2.2 User-Centric Design

Developed an intuitive interface that simplifies the process of uploading food images
and receiving detailed nutritional information and health warnings.

12.2.3 Personalized Recommendations

Delivered customized health suggestions based on individual dietary preferences,
allergies, and health goals, promoting healthier eating habits.

12.2.4 Data Security and Privacy

Ensured stringent privacy measures in line with global regulations, protecting users'
personal data and health information.

12.2.5 Scalable Platform

Built a flexible infrastructure that can easily scale to accommodate expanding
ingredient databases and growing user demands.

NutriScanAI 48
Team ID: 103 2CEIT703: Capstone Project-III

12.3 Challenges Overcome

12.3.1 Ingredient Variability
We addressed the challenge of variations in food images caused by differences in
lighting, angles, and image quality. By utilizing data augmentation and robust
preprocessing techniques, we ensured accurate ingredient recognition and analysis
across diverse food types and images.

12.3.2 Technical Complexity

Overcame the technical complexities associated with real-time image processing and
food ingredient analysis, optimizing the AI algorithms for fast and accurate results,
even on lower-end devices.

12.3.3 User Experience

Balancing the complexity of health assessments with a simple and intuitive user
interface was a challenge. Through extensive usability testing and user feedback, we
created an interface that is both user-friendly and efficient, ensuring seamless
interaction with the app.

12.4 Future Work

While NutriScan AI has made significant strides, there are several areas for
improvement and expansion that will further enhance the user experience and overall
system performance.

12.4.1 Enhanced Image Recognition Accuracy

Continuous improvements in the AI models, including more advanced algorithms for
ingredient recognition, will ensure higher accuracy in health risk classification and
nutritional analysis.

12.4.2 Expanded Ingredient Database

We plan to broaden the database to include a wider range of food ingredients from
different cultures and regions, providing a more comprehensive analysis for users
worldwide.

12.4.3 Personalized Dietary Recommendations

Future versions will integrate users' health profiles and dietary preferences to provide
more tailored recommendations, helping users make healthier food choices based on
their specific needs.

NutriScanAI 49
Team ID: 103 2CEIT703: Capstone Project-III

12.4.4 Offline Functionality

Implementing offline capabilities will allow users to access basic functionality, such as
food photo uploads and ingredient analysis, without needing an active internet
connection.

12.4.5 Global Localization

Expanding language support and culturally adapting the user interface will ensure that
NutriScan AI is accessible to a broader, international audience, enhancing usability
across diverse regions and languages.

12.4.6 Research on Food Health Assessment System Variability

Studying usage patterns and system variability for NutriScan AI will help inform
optimizations tailored to meet specific user needs across different food types, dietary
preferences, and environmental factors.

NutriScanAI 50
Team ID: 103 2CEIT703: Capstone Project-III

13 ANNEXURE
Glossary of Terms and Abbreviations
1. Food Ingredient Detection: The process of identifying food items in an image
and extracting information about their ingredients.
2. Food Health Assessment: The process of evaluating the nutritional value and
potential health risks of food ingredients based on a predefined health
classification system.
3. Real-time Analysis: The ability to assess food ingredients and provide health
information immediately after an image is uploaded, without noticeable delay.
4. Scalability: The ability of NutriScan AI to handle a growing number of users,
food images, and data without compromising the speed or accuracy of the
analysis.
5. Robustness: The ability of a system to function correctly and reliably under
various conditions and scenarios.
6. Data Augmentation: Techniques used to artificially expand the training dataset
by applying transformations (such as cropping, rotation, or scaling) to existing
food images to improve model performance.
7. Preprocessing: The steps involved in preparing raw food image data for
analysis, including resizing, normalization, and filtering, to enhance the quality
and consistency of input data.
8. Hyperparameter Tuning: The process of adjusting the parameters of the
NutriScan AI model, such as learning rate, dropout rate, or batch size, to
optimize the system’s performance.
9. Model Training: The process of teaching NutriScan AI to recognize and
classify food ingredients through exposure to a large dataset[3] of labeled food
images and corresponding health information.
10. Deployment: The process of making NutriScan AI available for end-users,
including integrating it into a user-friendly platform and ensuring it operates
efficiently in real-world environments.
Abbreviations:
1. DBMS: Database Management System
2. GPU: Graphics Processing Unit
3. IDE: Integrated Development Environment
4. NLP: Natural Language Processing
5. QA: Quality Assurance
6. RAM: Random Access Memory
7. UX: User Experience

NutriScanAI 51
Team ID: 103 2CEIT703: Capstone Project-III

Tools and Technologies

This study leveraged a combination of advanced tools and technologies from the fields
of machine learning, computer vision, and web development to build, train, and deploy
the NutriScan AI system. The following tools and libraries were utilized:

1. Python: Python is the primary programming language for this project due to its
extensive support for machine learning, deep learning, and data science. Its rich
ecosystem of libraries makes it an excellent choice for developing and
deploying AI-driven applications.
2. TensorFlow/PyTorch: These deep learning frameworks were used for building,
training, and evaluating the models in NutriScan AI. Both TensorFlow and
PyTorch offer flexible and efficient ways to implement neural networks and
benefit from GPU acceleration, which is essential for processing large volumes
of image data.
3. Sentence Transformer: It plays a pivotal role in generating semantic
embeddings for ingredient analysis. This advanced natural language processing
(NLP) model is used to convert textual ingredient descriptions into dense vector
representations. These embeddings capture the contextual and semantic
meaning of ingredients, enabling efficient similarity comparisons and
classification. By leveraging pre-trained Sentence Transformer models, the
application ensures high accuracy in identifying relationships between
ingredient terms and their associated risks.
4. EasyOCR: It is utilized as a key technology for ingredient scanning. This
lightweight and highly efficient Optical Character Recognition (OCR) library
extracts text from product labels, enabling accurate identification of ingredients
listed on packaged foods.
5. Faiss: It is employed for efficient word similarity matching and retrieval.
Developed by Facebook AI, Faiss is a powerful library for fast similarity search
and clustering of dense vectors. It enables the system to compare ingredient
embeddings (generated using Sentence Transformer) with a pre-indexed
database of harmful substances, ensuring quick and accurate identification of
potential matches.
6. OpenCV: OpenCV[2] was utilized for essential image processing tasks in
NutriScan AI, such as resizing, normalization, and image augmentation (e.g.,
random cropping, rotation, and flipping). Its highly optimized functions helped
in preparing food images for analysis.
7. Streamlit: Streamlit was chosen as the framework for building the NutriScan
AI web interface. Streamlit allows for quick and interactive web applications,
making it easy to integrate the model's functionality with a user-friendly
interface that enables real-time image uploads and analysis.

NutriScanAI 52
 Team ID: 103 2CEIT703: Capstone Project-III

References
[1] Sentence Transformers Embedding
[2] EasyOCR for Optical Character Recognition
[3] USA’s FDA Dataset
[4] Cheng, H., et al. "Deep learning for food image recognition: A review." Artificial
Intelligence in Food Research (2020).
[5] Zhu, X., et al. "Deep learning for health risk classification from food-related data."
Journal of Machine Learning in Health Sciences (2020).

NutriScanAI 53
Team ID: 103 2CEIT703: Capstone Project-III

About College
U.V. Patel College of Engineering,
Ganpat University
Ganpat University-U. V. Patel College of Engineering (GUNI-UVPCE) is situated in
Ganpat Vidyanagar campus. It was established in September 1997 with the aim of
providing educational opportunities to students from It is one of the constituent
colleges of Ganpat University various strata of society. It was armed with the vision of
educating and training young talented students of Gujarat in the field of Engineering
and Technology so that they could meet the demands of Industries in Gujarat and
across the globe.
The College is named after Shri Ugarchandbhai Varanasibhai Patel, a leading
industrialist of Gujarat, for his generous support. It is a self-financed institute approved
by All India Council for Technical Education (AICTE), New Delhi and the
Commissionerate of Technical Education, Government of Gujarat. The College is
spread over 25 acres of land and is a part of Ganpat Vidyanagar Campus. It has six
ultra-modern buildings of architectural splendor, class rooms, tutorial rooms, seminar
halls, offices, drawing hall, workshop, library, well equipped departmental laboratories,
and several computer laboratories with internet connectivity through 1 Gbps Fiber link,
satellite link education center with two-way audio and one-way video link.
The superior infrastructure of the Institute is conducive for learning, research, and
training. The Institute offers various undergraduate programs, postgraduate programs,
and Ph.D. programs. Our dedicated efforts are directed towards leading our student
community to the acme of technical excellence so that they can meet the requirements
of the industry, the nation and the world at large. We aim to create a generation of
students that possess technical expertise and are adept at utilizing the technical
'know-hows' in the service of mankind.

NutriScanAI 54