Linear Regression Interview Questions & Answers

Q1. True-False: Linear Regression is a supervised machine learning algorithm.

A) TRUE

B) FALSE

Yes, Linear regression is a supervised learning algorithm because it uses true labels for

training. A supervised machine learning model should have an input variable (x) and an output

variable (Y) for each example.

Q2. True-False: Linear Regression is mainly used for Regression.

A) TRUE

B) FALSE

Linear Regression has dependent variables that have continuous values.

Q3. True-False: It is possible to design a Linear regression algorithm using a neural network.

A) TRUE

B) FALSE

Q4. Which of the following methods do we use to find the best-fit line for data in Linear
Regression?

A) Least Square Error

B) Maximum Likelihood

C) Logarithmic Loss

D) Both A and B
Q5. Which of the following evaluation metrics can be used to evaluate a model while modeling a
continuous output variable?

A) AUC-ROC

B) Accuracy

C) Logloss

D) Mean-Squared-Error

Q6. True-False: Lasso Regularization can be used for variable selection in Linear Regression.

A) TRUE

B) FALSE

Q7. Which of the following is true about residuals?

A) Lower is better

B) Higher is better

C) A or B depending on the situation

D) None of these

Q8. Suppose we have N independent variables (X1, X2… Xn) and Y’s dependent variable.

Now Imagine that you are applying linear regression by fitting the best-fit line using the least

square error on this data. You found that the correlation coefficient for one of its variables (Say

X1) with Y is -0.95.

Which of the following is true for X1?

A) Relation between the X1 and Y is weak

B) Relation between the X1 and Y is strong

C) Relation between the X1 and Y is neutral

D) Correlation can’t judge the relationship

Q9. Looking at the above two characteristics, which of the following options is the correct
Pearson correlation between V1 and V2?

If you are given the two variables V1 and V2, which follow the below two characteristics:

1. If V1 increases, then V2 also increases

2. If V1 decreases, then V2 behavior is unknown

A) Pearson correlation will be close to 1

B) Pearson correlation will be close to -1

C) Pearson correlation will be close to 0

D) None of these

Q10. Suppose the Pearson correlation between V1 and V2 is zero. In such a case, is it right to
conclude that V1 and V2 do not have any relation between them?

A) TRUE

B) FALSE

Q11. Suppose the horizontal axis is an independent variable and the vertical axis is a
dependent variable. Which of the following offsets do we use in linear regression’s least square
line fit?
A) Vertical offset
B) Perpendicular offset
C) Both, depending on the situation
D) None of above

Q12. True- False: Overfitting is more likely when you have a huge amount of data to train.

A) TRUE

B) FALSE

Q13. We can compute the coefficient of linear regression with the help of an analytical method
called “Normal Equation.” Which of the following is/are true about Normal Equations?

1. We don’t have to choose the learning rate.

2. It becomes slow when the number of features is very large.

3. There is no need to iterate.

A) 1 and 2

B) 1 and 3

C) 2 and 3

D) 1,2 and 3

Q14. Which of the following statement is true about the sum of residuals of A and B?
Below graphs show two fitted regression lines (A & B) on randomly generated data. Now, I want

to find the sum of residuals in both cases, A and B.

Note:

1. Scale is the same in both graphs for both axes.

2. X-axis is the independent variable, and Y-axis is the dependent variable.

A) A has a higher sum of residuals than B

B) A has a lower sum of residual than B

C) Both have the same sum of residuals

D) None of these

Context for Questions 15-17:

Suppose you have fitted a complex regression model on a dataset. Now, you are using Ridge

regression with penalty x.

Q15. Choose the option which describes bias in the best manner.

A) In the case of a very large x, bias is low

B) In the case of a very large x, bias is high

C) We can’t say about bias

D) None of these

Q16. What will happen when you apply a very large penalty?

A) Some of the coefficients will become absolute zero

B) Some of the coefficients will approach zero but not absolute zero

C) Both A and B depending on the situation

D) None of these

Q17. What will happen when you apply a very large penalty in the case of Lasso regression?

A) Some of the coefficients will become zero

B) Some of the coefficients will be approaching zero but not absolute zero

C) Both A and B depending on the situation

D) None of these

Q18. Which of the following statement is true about outliers in Linear regression?

A) Linear regression is sensitive to outliers

B) Linear regression is not sensitive to outliers

C) Can’t say

D) None of these

Q19. Suppose you plotted a scatter plot between the residuals and predicted values in linear
regression and found a relationship between them. Which of the following conclusion do you
make about this situation?

A) Since there is a relationship means our model is not good

B) Since there is a relationship means our model is good

C) Can’t say

D) None of these

Context for Questions 20-22:

Suppose that you have a dataset D1 and you design a linear model of degree 3 polynomial and

find that the training and testing error is “0” or, in other words, it perfectly fits the data.

Q20. What will happen when you fit a degree 4 polynomial in linear regression?

A) There is a high chance that degree 4 polynomial will overfit the data

B) There is a high chance that degree 4 polynomial will underfit the data

C) Can’t say

D) None of these

Q21. What will happen when you fit a degree 2 polynomial in linear regression?

A) It is a high chance that degree 2 polynomial will overfit the data

B) It is a high chance that degree 2 polynomial will underfit the data

C) Can’t say

D) None of these

Q22. In terms of bias and variance. Which of the following is true when you fit degree 2
polynomial?

A) Bias will be high, and variance will be high

B) Bias will be low, and variance will be high

C) Bias will be high, and variance will be low

D) Bias will be low, and variance will be low

Context for Question 23:

Below are three graphs, A, B, and C, between the cost function and the number of iterations, I1,

I2, and I3, respectively.

Q23. Suppose l1, l2, and l3 are the three learning rates for A, B, and C, respectively. Which of
the following is true about l1,l2, and l3?

A) l2 < l1 < l3

B) l1 > l2 > l3

C) l1 = l2 = l3

D) None of these

Context for Questions 24-25:

We have been given a dataset with n records in which we have an input attribute as x and an

output attribute as y. Suppose we use a linear regression method to model this data. To test our

linear regressor, we split the data in the training set and test a set randomly.

Q24. Now we increase the training set size gradually. As the training set size increases, what do
you expect will happen with the mean training error?

A) Increase

B) Decrease

C) Remain constant

D) Can’t Say
Q25. What do you expect will happen with bias and variance as you increase the size of training
data?

A) Bias increases, and Variance increases

B) Bias decreases, and Variance increases

C) Bias decreases, and Variance decreases

D) Bias increases, and Variance decreases

E) Can’t Say False

Context for Question 26:

Consider the following data where one input(X) and one output(Y) are given.

Q26. What would be the root mean square training error for this data if you run a Linear
Regression model of the form (Y = A0+A1X)?

A) Less than 0

B) Greater than zero

C) Equal to 0

D) None of these

Context for Questions 27-28:

Suppose you have been given the following scenario for training and validation error for Linear

Regression.

Scenario Learning Number of iterations Training Error Validation Error

Rate
1 0.1 1000 100 110
2 0.2 600 90 105
3 0.3 400 110 110
4 0.4 300 120 130
5 0.4 250 130 150

Q27. Which of the following scenario would give you the right hyperparameter?

A) 1

B) 2

C) 3

D) 4

Which of the following thing would you observe in such a case?

A) Training Error will decrease, and Validation error will increase

B) Training Error will increase, and Validation error will increase

C) Training Error will increase, and Validation error will decrease

D) Training Error will decrease, and Validation error will decrease

E) None of the above

Context for Questions 29-30:

Suppose you got a situation where you find that your linear regression model is underfitting the

data.

Q29. In such a situation, which of the following options would you consider?
 Add more variables

 Start introducing polynomial degree variables

 Remove some variables

A) 1 and 2

B) 2 and 3

C) 1 and 3

D) 1, 2 and 3

Q30. Now the situation is the same as written in the previous question (under-fitting). Which of
the following regularization algorithms would you prefer?

A) L1

B) L2

C) Any

D) None of these

Q31. What is the full form of “AI”?

a) Artificially Intelligent
b) Artificial Intelligence
c) Artificially Intelligence
d) Advanced Intelligence
Q32. What is Artificial Intelligence?
a) Artificial Intelligence is a field that aims to make humans more intelligent
b) Artificial Intelligence is a field that aims to improve the security
c) Artificial Intelligence is a field that aims to develop intelligent machines
d) Artificial Intelligence is a field that aims to mine the data
Q33. Who is the inventor of Artificial Intelligence?
a) Geoffrey Hinton
b) Andrew Ng
c) John McCarthy
d) Jürgen Schmidhuber
Q34. Which of the following is the branch of Artificial Intelligence?
a) Machine Learning
b) Cyber forensics
c) Full-Stack Developer
d) Network Design
Q35. What is the goal of Artificial Intelligence?
a) To solve artificial problems
b) To extract scientific causes
c) To explain various sorts of intelligence
d) To solve real-world problems

Q36. Which of the following is an application of Artificial Intelligence?

a) It helps to exploit vulnerabilities to secure the firm
b) Language understanding and problem-solving (Text analytics and NLP)
c) Easy to create a website
d) It helps to deploy applications on the cloud
Q37. In how many categories process of Artificial Intelligence is categorized?
a) categorized into 5 categories
b) processes are categorized based on the input provided
c) categorized into 3 categories
d) process is not categorized
Q38. Based on which of the following parameter Artificial Intelligence is categorized?
a) Based on functionally only
b) Based on capabilities only
c) Based on capabilities and functionally
d) It is not categorized
Q39. Which of the following is a component of Artificial Intelligence?
a) Learning
b) Training
c) Designing
d) Puzzling
40. What is the function of an Artificial Intelligence “Agent”?
a) Mapping of goal sequence to an action
b) Work without the direct interference of the people
c) Mapping of precept sequence to an action
d) Mapping of environment sequence to an action

41. Which of the following is not a type of Artificial Intelligence agent?

a) Learning AI agent
b) Goal-based AI agent
c) Simple reflex AI agent
d) Unity-based AI agent
42. Which of the following is not the commonly used programming language for Artificial
Intelligence?
a) Perl
b) Java
c) PROLOG
d) LISP
43. What is the name of the Artificial Intelligence system developed by Daniel Bobrow?
a) program known as BACON
b) system known as STUDENT
c) program known as SHRDLU
d) system known as SIMD
44. What is the function of the system Student?
a) program that can read algebra word problems only
b) system which can solve algebra word problems but not read
c) system which can read and solve algebra word problems
d) None of the mentioned
45. Which of the following is not an application of artificial intelligence?
a) Face recognition system
b) Chatbots
c) LIDAR
d) DBMS
46. Which of the following machine requires input from the humans but can interpret the
outputs themselves?
a) Actuators
b) Sensor
c) Agents
d) AI system
47. _________ number of informed search method are there in Artificial Intelligence.
a) 4
b) 3
c) 2
d) 1
48. The total number of proposition symbols in AI are ________
a) 3 proposition symbols
b) 1 proposition symbols
c) 2 proposition symbols
d) No proposition symbols
49. The total number of logical symbols in AI are ____________
a) There are 3 logical symbols
b) There are 5 logical symbols
c) Number of logical symbols are based on the input
d) Logical symbols are not used

50. Which of the following are the approaches to Artificial Intelligence?

a) Applied approach
b) Strong approach
c) Weak approach
d) All of the mentioned
51. Face Recognition system is based on which type of approach?
a) Weak AI approach
b) Applied AI approach
c) Cognitive AI approach
d) Strong AI approach

52. Which of the following is an advantage of artificial intelligence?

a) Reduces the time taken to solve the problem
b) Helps in providing security
c) Have the ability to think hence makes the work easier
d) All of the above

53. Which of the following can improve the performance of an AI agent?

a) Perceiving
b) Learning
c) Observing
d) All of the mentioned
54. Which of the following is/are the composition for AI agents?
a) Program only
b) Architecture only
c) Both Program and Architecture
d) None of the mentioned

55. On which of the following approach A basic line following robot is based?
a) Applied approach
b) Weak approach
c) Strong approach
d) Cognitive approach

56. Artificial Intelligence has evolved extremely in all the fields except for _________
a) Web mining
b) Construction of plans in real time dynamic systems
c) Understanding natural language robustly
d) All of the mentioned

57. Which of the following is an example of artificial intelligent agent/agents?

a) Autonomous Spacecraft
b) Human
c) Robot
d) All of the mentioned

58. Which of the following is an expansion of Artificial Intelligence application?

a) Game Playing
b) Planning and Scheduling
c) Diagnosis
d) All of the mentioned

59. What is an AI ‘agent’?

a) Takes input from the surroundings and uses its intelligence and performs the desired
operations
b) An embedded program controlling line following robot
c) Perceives its environment through sensors and acting upon that environment through
actuators
d) All of the mentioned

60. Which of the following environment is strategic?

a) Rational
b) Deterministic
c) Partial
d) Stochastic

61. What is the name of Artificial Intelligence which allows machines to handle vague
information with a deftness that mimics human intuition?
a) Human intelligence
b) Boolean logic
c) Functional logic
d) Fuzzy logic

62. Which of the following produces hypotheses that are easy to read for humans?
a) Machine Learning
b) ILP
c) First-order logic
d) Propositional logic

63. What does the Bayesian network provide?

a) Partial description of the domain
b) Complete description of the problem
c) Complete description of the domain
d) None of the mentioned

64. What is the total number of quantification available in artificial intelligence?

a) 4
b) 3
c) 1
d) 2

65. What is Weak AI?

a) the study of mental faculties using mental models implemented on a computer
b) the embodiment of human intellectual capabilities within a computer
c) a set of computer programs that produce output that would be considered to reflect
intelligence if it were generated by humans
d) all of the mentioned

66. Which of the following are the 5 big ideas of AI?

a) Perception
b) Human-AI Interaction
c) Societal Impact
d) All of the above