Data Structures & Algorithms

Lecture 1: Introduction

Dr. Muhammad Shahzad

[email protected]

Department Of Computing (DOC),

School of Electrical Engineering & Computer Science (SEECS),
National University of Sciences & Technology (NUST)

14/10/2020
 What to expect?

▪ Objectives:

► Learn common data structures i.e., linked lists, queues, trees

and graphs

► Study routinely used algorithms in computer science including

sorting, search trees, hash-tables, heaps, graph theory and
dynamic programming

► Evaluation of these algorithms in terms of running time

complexity

- Introduction to techniques like Big-Oh notation, Recurrences and

basic probabilistic analysis of random algorithms

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 6

 Course content

▪ Introduction to data structures & algorithms

▪ Pointers, structures & arrays
▪ Linked Lists (single, double & circular)
▪ Stacks (and its applications)
▪ Queues
▪ Algorithm (with asympototic analysis)
▪ Sorting algorithms (insertion-, merge-, quick-sort)
▪ Recurrsion
▪ Trees (binary tree, kd trees)
▪ Heapsort
▪ Hash tables
▪ Graphs
▪ Search algorithms (Depth First Search)
▪ Shortest path algorithm
M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 7
 Recommended literature

▪ Text books:

► Adam Drozdek, Data Structures and Algorithms in C++

(Fourth edition)

► T. H. Cormen, Charles E. Leiserson, R. L. Rivest, Clifford S.

Introduction to Algorithms, (Third Edition)

▪ Reference books:

► Steven S Skiena. The Algorithm Design Manual, Second

Edition (2008)

► Mark A. Weiss, Data Structures and Algorithm Analysis in

C++, Third Edition (2006)

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 8

 Class ethics

▪ Attendance (75% mandatory)

▪ Be disciplined & give respect to all
▪ Quizzes
► Anytime
▪ “Don’t cheat”
► You may try BUT if caught NO MERCY!
► Will NOT accept phrases like:
- “… by chance we had the same variable name”
▪ Assignments & lab exercises
▪ Plagiarism
► No copying

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 9

 Distribution

▪ Lecture 75%
► Assignments : 10%
► Mid-term : 30 % 75%
► Final : 60%

▪ Labs 25%
► Labs : 80% 25%
► Final Exam/Project : 20%

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 10

 What is a Data Structure?

▪ Data Structure => Data StructurING

► How do we organize information so that we can find, update,

add, and delete portions of it efficiently?

► Data Structure is a systematic way to organize data in order to

use it efficiently

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 11

 Why to perform Data Structuring?

▪ How many cities with more than 250,000 people lie within
500 km of Islamabad?

▪ How many people in a company make over Rs.1,000,000

per year?

▪ Can we connect all of our telephone customers with less

than 1,000 kms of cable?

To answer questions like these, it is not enough to have the

necessary information
We must organize that information in a way that allows
us to find the answers in time to satisfy our needs

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 12

 What is a Data Structure?

▪ It’s an agreement about:

► How to store a collection of objects in memory,

► What operations we can perform on that data,

► The algorithms for those operations, and

► How time and space efficient those algorithms are

▪ A collection of data elements whose organization is

managed by the operations that are used to store and
retrieve the individual data elements

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 13

 Why is Data StructurING necessay?

Three common problems:

▪ Data Search
► E.g., an inventory of 1 million(106) items of a store

▪ Processor Speed
► Processor speed although being very high, falls limited if the
data grows to billion records

▪ Multiple Requests
► As thousands of users can search data simultaneously on a
web server, even the fast server fails while searching the data

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 14

 Foundation terms

Each data structure has an

▪ Interface
► Represents the set of operations that a data structure
supports &
► Only provides the list of supported operations, type of
parameters they can accept and the return type of these
operations

▪ Implementation
► Provides the internal representation of a data structure &
► The definition of the algorithms used in the operations of the
data structure

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 15

 Example

▪ Data structure for storing data of students:-

► Arrays
► Linked Lists

▪ Issues
► Space needed
► Operations efficiency (Time required to complete operations)
- Retrieval
- Insertion
- Deletion

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 16

 Which data structure to use?

▪ Data structures let the input and output be represented in a

way that can be handled efficiently and effectively

array

Linked list

queue
tree stack

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 17

 Introduction to algorithms

▪ Algorithm

► Named after a Muslim mathematician, Al-Khawarzmi

► Definition

- An algorithm is a definite procedure for solving a problem in

finite number of steps

- Algorithm is a well-defined computational procedure that takes

some value(s) as input, and produces some value(s) as output

- Algorithm is finite number of computational statements that

transform input into the output

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 18

 What is an algorithm?

▪ An algorithm is an effective method for solving a

problem using a finite sequence of instructions

▪ Examples
► sort a list of numbers
► find a route from one place to another (cars, packet routing,
phone routing, ...)
► find the longest common substring between two strings
► microchip wiring/design (VLSI)
► solving sudoku
► cryptography
► compression (file, audio, video)
► pagerank
► classify a web page

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 19

 Properties of interest

▪ What properties of algorithms are we interested in?

► Does it terminate?

► Is it correct, i.e. does it do what we think it’s supposed to do?

► What are the computational costs?

► What are the memory/space costs?

► What happens to the above with different inputs?

► How difficult is it to implement and implementing it correctly?

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 20

 Data structures & algorithms

▪ Operations are associated with data structure

▪ To perform these operations, algorithms are needed

Data structures + Algorithms = Programs

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 21

 Data type

▪ A data type is a type together with a collection of operations

to manipulate the type

► E.g., an integer variable is a member of the integer data type

while addition is an example of an operation on the integer
data type

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 22

 Data types

▪ Primitive Data Types

► Bool, Int, float etc.

▪ User-Defined Data Types (UDTs)

► Aggregate data types e.g., structures, array-of-integers etc.

▪ Abstract Data Types (ADTs)

► Does not specify how the data type is implemented

► These implementation details are hidden from the user of the

ADT and protected from outside access, a concept referred to
as encapsulation

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 23

 Abstract data types (ADT)

▪ Different implementations possible for same ADT

▪ In an object-oriented language such as C++, an ADT

and its implementation together make up a class

Much of our concern in this course is how to implement data

structures as ADTs

M. Shahzad: Data Structures & Algorithms Lecture 1: Introduction 24