A Comprehensive Review of Linear Regression in Machine

Learning
Reyes, Aldrich P. , David, Arbel T. , Lacap, Reniel S. , Dungca, Jester H. , Villanueva, Zirach P.

Abstract: Linear regression is maybe one of the most widely used and complete statistics and machine learning methods. Linear to
discover a linear relationship between one or more factors, regression is performed. There are two varieties of linear regression: simple
regression and several regressions (MLR). This essay examines several studies on polynomial and linear regression by various researchers.
And evaluates each group's performance using the most effective strategy for increasing forecast accuracy. most of the articles examined in
this dataset are the focus of the review; to assess a model's effectiveness, it must be correlated with the actual values obtained for the
explanatory elements.

summarized, such as used algorithms, databases, accuracy and

I.INTRODUCTION
performance[12]. This essay is structured as follows.
Machine learning [1–5] is widely used in various fields to solve Introductory notes in Section I. Section II provides a
difficult problems that are not easily solved by computational theoretical foundation. Section III continues with a description
techniques. One of the simplest and most commonly used and experimental comparison of A Review. Section IV
machine learning methods is linear regression. This is how you addresses this discussion. Conclusions are provided in Section
perform mathematical predictive analytics. Linear regression V.
can predict continuous, real, or mathematical variables. The
idea of linear regression was first developed by Sir Francis II.THEORY
Galton in 1894. Linear regression [6-8] is a mathematical test A. Regression
used to evaluate and quantify relationships between variables Regression
under consideration. Analyzes using univariate regression A known technique that is being used for two theories. First, the
analyzes such as chi-square, Fisher's exact test, t-test, and regression analyzes are most commonly used for forecasting and
analysis of variance (ANOVA) cannot account for the influence prediction, in which upon being implied, it has overlaps with the area
of other variables or founders. To assess the effects of of machine learning. Second, regression analysis can also be applied in
confounding, scientists can use partial correlation and some cases to determine causal relations between the independent and
regression tests [4, 9, 10]. Linear regression [11] is a popular dependent variables. Last and foremost, regressions alone, shows only
tool in mathematical research methods because it allows relations between a dependent variable and a fixed dataset collection
researchers to model and measure predictive effects for of various variables.
different input variables. It is a data modeling and analysis B. Regression Models
technique that creates a linear relationship between dependent As stated in the regression models, the independent variables
and independent variables. This approach therefore simulates predict the dependent variables. Regression analysis estimates
the correlation between the dependent and independent dependent 'y' variable value due to the range of independent
variables from the analysis and learns using the results of the variable values 'x'. Regression may either be classified as a simple
last training. This article provides a comprehensive overview of linear regression or multiple regression.
modern and popular methods for processing linear regression • Simple Linear Regre
data, various statistics, and machine learning over the last five
years. The particulars of each process are often
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

Simple Linear Regression is a case model with a single Where𝛽0 = 𝛽0∗ − 𝛽1 𝑥 − . We need to solve for
𝑛
independent variable [18]. Simple Linear regression defines the 𝜕
dependence of the variable. 𝑦 = β0 + β1 𝑥 + 𝜀 . Simple ∑[𝑦𝑖 − (𝛽0∗ + 𝛽1 𝑥̅𝑖 )]2 = 0
𝛿𝛽0
regression distinguishes the influence of independent variables 𝑖=1
𝑛
from the interaction of dependent variables[19]. 𝜕
∑[𝑦𝑖 − (𝛽0∗ + 𝛽1 𝑥̅𝑖 )]2 = 0
𝛿𝛽1
• Multivariate linear regression (MLR) 𝑖=1
MLR is a statistical technique to predict the result of an answer Taking the partial derivatives with respect to β0 and β1 we have
𝑛
variable, using a number of explanatory variables. The object
∑[𝑦𝑖 − (𝛽0∗ + 𝛽1 (𝑥𝑖 − 𝑥̅ ))] = 0
of (MLR) is to model the linear relationship between the
𝑖=1
independent variables x and dependent variable y that will be 𝑛
analyzed [20].The basic model for MLR is: ∑[𝑦𝑖 − (𝛽0∗ + 𝛽1 (𝑥𝑖 − 𝑥̅ ))](𝑥𝑖 − 𝑥̅ ) = 0
𝑦 = β0 + β1 x1 + ⋯ + β𝑚 x𝑚 + 𝜀 The formula to determine
𝑖=1
the formula matrix is:[21] . Note that
𝑛 𝑛

∑ 𝑦𝑖=𝑛𝛽0 + ∑ 𝛽1 (𝑥𝑖 − 𝑥̅ ) = 𝑛𝛽0∗

𝛽መ = (𝑋 𝑇 𝑋)−1 𝑋 𝑇 𝑦 Where
𝑖=1 𝑖=1
1
Therefore, we have 𝛽0∗ = ∑𝑛𝑖=1 𝑦𝑖 = 𝑦̅ Substituting 𝛽0∗ by
𝑛
𝑦̅ we obtain
• Polynomial Regression 𝑛
Polynomial regression [22, 23] is a type of regression analyze
∑[𝑦𝑖 − (𝑦̅ + 𝛽1 (𝑥𝑖 − 𝑥̅ ))](𝑥𝑖 − 𝑥̅ ) = 0
in the nth degree polynomial modeling of the relationship
𝑖=1
between independent and dependent variables. Polynomial Denote 𝑏0 and 𝑏1 be the solutions. Now it is easy to see
regression is a special case of MLR in which the polynomial ∑𝑛𝑖=1(𝑦𝑖 − 𝑦̅)(𝑥𝑖 − 𝑥̅ ) 𝑆𝑥𝑦
equation of data blends in with curvilinear interplay of the 𝑏1 = =
dependent and independent variables [24]. Model of ∑𝑛𝑖=1(𝑥𝑖 − 𝑥̅ )2 𝑆𝑥𝑥
polynomial [25, 26] is: 𝑦 = β0 + β1 𝑥 + β2 𝑥 2 + ⋯ + βℎ 𝑥 ℎ + 𝜀 And
Where h is named the polynomial degree [27, 28]. 𝑏0 = 𝑏0∗ − 𝑏1 𝑥̅ = 𝑦̅ − 𝑏1 𝑥̅
The explanation behind the LSM is to determine parameter
estimates by taking the "closest" row to all data points(𝑥𝑖 , 𝑦𝑖 )
C. Least square method
The least square method (LSM) [29, 30] use to find the best fit [31]. Residual analysis plays a critical role in regression
curve or line for one set of data points by reducing the amount analysis. Residual linear regression can be determined for the
of the squares of the offsets (residual part) of the points of the measurements 𝑦𝑖 and the fitted values𝑦̂𝑖 ’s, residuals can be
curve. The LSM in the linear regression model use to find 𝑏0 shown. It must be. Remembered that the 𝜀𝑖 term is not found in
and 𝑏1 predictions such that the cumulative squared distance the regression model. Therefore, regression error not found and
the residual regression is observed [32]. Normally the predicted
from the real 𝑦𝑖 response 𝑦̂ = 𝛽0 + 𝛽1 𝑥𝑖 approaches the
value, the average of the whole population, is not observed[33,
minimum of all possible regression coefficients β0 and β1
34]. A linear regression model test can be described as follows:
option.
𝑛

(𝑏0 , 𝑏1 ) = 𝑎𝑟𝑏 min ∑[𝑦𝑖 − (𝛽0 + 𝛽1 𝑥𝑖 )]2 • F-Test

(𝛽0 ,𝛽1 )
𝑖=1 The 𝐹 − 𝑡𝑒𝑠𝑡 [35] is more stable than the other tests. The test
The motivation behind the least squares approach has been to mathematical variable F is:
find the estimates of the parameters using the least squares that ∑(𝑦̂𝑖 − 𝑦̅𝑖 )2 /(𝑚 − 1)
is the nearest line to all points(𝑥𝑖 , 𝑦𝑖 ). The least squares result 𝐹= ~𝐹(𝑚 − 1, 𝑛 − 𝑚)
∑(𝑦𝑖 − 𝑦̂𝑖 )2 /(𝑚 − 1)
of the basic linear regression used for the purpose of this paper Where m-1 is the freedom degree of to modify regression.
are calculated by solving this system. ∑(𝑦̂𝑖 − 𝑦̅𝑖 )2 ; 𝑛 − 𝑚 Freedom degree of residual
𝑛
𝜕 variation∑(𝑦𝑖 − 𝑦̂𝑖 )2 .If 𝐹𝛼 (𝑚 − 1, 𝑛 − 𝑚), then a significant
∑[𝑦𝑖 − (𝛽0 + 𝛽1 𝑥𝑖 )]2 = 0
𝛿𝛽0 linear relationship between y and the variables 𝑥1 , 𝑥1 , … 𝑥𝑚 is
𝑖=1
𝑛 considered below the rate of priority α, that is, Regression
𝜕 equation is important on the contrary, the equation is not
∑[𝑦𝑖 − (𝛽0 + 𝛽1 𝑥𝑖 )]2 = 0
𝛿𝛽1 important.
𝑖=1
Considering that 𝑏0 and 𝑏1 are the solutions to the above
system, we can describe the relationship between 𝑥 and 𝑦 with • t-Test
the regression line 𝑦̂ = 𝑏0 + 𝑏1 𝑥 indicated by convention. It is Evaluate independent variable affect 𝑥𝑗 of the y is applicable,
easier to solve for 𝑏0 and 𝑏1 by using a centralized linear close to the test hypothesis. Statistical test variable t [36]:
model:
𝑦𝑖 = 𝛽0∗ + 𝛽1 (𝑥𝑖 − 𝑥̅ ) + 𝜀𝑖

141
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

̂𝑗
𝛽 the MLR could well be appropriate for the long-term tempering
𝑡𝑗 =
∑(𝑦 −𝑦
̂ )
2 estimation for the high-voltage switchgear communication with
𝑖 𝑖
√𝐶𝑗𝑗 √ (𝑛−𝑚) a slight variance. The inference is that the longitudinal
Where 𝐶𝑗𝑗 is jth component on matrix(𝑥́ 𝑥)−1 . regression of MLR has a high precision in long-term
temperature prediction.
Tadahiko Maeda. [41] Automatic design software for
III.A REVIEW ON (LINEAR REGRESSION) human-equivalent phantoms with linear and exponential
Hyun-il Lim. [11]a framework has been developed for the regression analyzes was proposed to increase the production
use of linear regression in the evaluation of software features performance of human-equivalent phantoms for antenna
defined applications using code vectors based on software calculation. The components of the human phantoms are water,
instructions. Experiments have been conducted to test the silicone emulsion, glycerin, sodium chloride and agar. The
suggested method, although experimental findings suggest that software uses MLR and exponential regression analyses to
linear regression can be an efficient way to classify related create compositions that target the target fantasy. The article
software in software analysis. To conclude, a well-designed describes the findings of measurements for brain dreams and
machine learning model can be easily used in software analysis. mind dreams developed with the software as examples of the
The use of machine learning in information analysis would also new software. Fabricated phantoms show that it takes an
enhance comprehension of software functionality. additional 9% brain fantasy value and 13% stomach fantasy
Xingang Wang. [37] Used MLR algorithm to calculate its value to get closer to the real world. It is confirmed.
weight, which eliminates redundancy between attributes, Zhaobin Zhang. [20] Proposed new approach for intra-
proposed a weighted naive Bayesian algorithm on the basis of coding video based on MLR. The proposed method uses a linear
the multiple regression (MLWNBC). Simultaneously, each regression model to learn from end-to-end projections and the
attribute will also determine the impact size of each attribute on best intra-predictive block. The technology is developed in the
the basis of weight. MLWNBC makes WNBC more rational realm of pixels rather than physical space. A separate model is
(weighted naive bias classification algorithm). The study results qualified to optimize the model by using intra-prediction. The
of which classification of 10 data sets in UCI database indicate clean and succinct style but also delivers promising results. A
that the algorithm has strong properties and is capable of suggestion is implemented into the HEVC reference program,
enhancing accuracy, reducing consumption time. The data outperforming a matched anchor. These findings offer valuable
collection estimates all attributes, and certain properties have information for video coding in the future. The experimental
no influence on the results. findings indicated the reliability of the proposed system and
Zhihao PENG. [38] It is proposed to use a multivariate provided important insights into how classical video coding
statistical method, i.e. factor analysis, to identify predictor algorithms could be further manipulated.
variables by their relationships and importance, in order to Ethan C. Jackson. [42] They contrast two contemporary
approximate portfolio sensitivities to 4 chosen macroeconomic methods in task-based functional magnetic resonance imaging
factors (Market Performance, Real GDP, Inflation, and (fMRI) for a MLR: linear Regression with ridge regularization
Unemployment). (Market Performance, Real GDP, Inflation, and nonlinear Symbolic Regression by genetic programming.
and Unemployment). Introduces and applies a multi-factor The data for this project reflect an experimental fMRI
model for portfolio management of stocks. First, the model is framework for visual stimulation. For 10 topics, linear and non-
established, the portfolio will then be refined and multi-factors linear models were developed, with a further 4 refused for
will eventually be used to estimate portfolio sensitivity. Results validation. Model consistency is measured by comparing R
show that improved results can be obtained by choosing the less values (Pearson product-moment correlation) in different
associated variables. contexts, including single run self-compatibility, generalization
Qingxiang Feng. [39] Proposed enter-based weighted of the subjects and generalization between subjects. The
kernel linear regression (CWKLR) classifier is proposed for suitability for modeling overfit strategies is determined with a
objects and face recognition. The middle of each class is used separate resting state scan. The findings show that neither
in CWKLR to provide information. CWKLR can then use the approach is necessarily or statistically superior to the other.
Tikhonov Matrix to achieve weighted classification projection R. Harimurti. [43] The article focuses on the processing of
coefficients. Experimental results show that, relative to many educational data to predict the psychomotor domain of students.
state-of-the-art approaches, the classifier proposed achieves In this case, the method of linear regression is used. Four
improved efficiency, analyzes and preliminary findings in three regularizations were used during this point, namely: no
datasets indicate the efficacy and face detection of the regularization, ridge regression, lasso regression and elastic net
suggested algorithms for artifacts. regression. In comparison, utilizing as an appraisal tool two
Xuan Feng. [40] Centered on the 110KV high voltage sampling methods: cross-validation sampling and random
switchgear contact temperature results. Using the Map Reduce sampling as examples. The experimental result shows that an
model, the temperature regression model is developed by MLR elastic net regression is the best regularization for cross
models to analysis and process the monitoring point data. The validation and random sampling, as this regularization yields
effects of the estimation are evaluated by the F regression the lowest predictive error. For cross-validation, MSE, RMSE
criterion. The results show that the longitudinal regression in and MAE values are respectively 40.079, 6.330 and 5.183. In

142
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

comparison, for random sampling, the MSE, RMSE and MAE all the combinations of variables that cause a low RMSE value.
values are 86.910, 8.428 and 6.511 respectively. This then is seen by the line diagram. Evaluations show a
Yanming Yang, [44] I worked on a statistical model and cumulative RMSE of 0.39 – 1.34 in a suggested study in two
used MLR. The MLR analyses interval projections. A MLR separate regions.
model has been developed which forecasts airplane material Dehua WANG. [49] The average measurement data
consumption. Based upon a study of the cases, fitness test, t- processing technique was introduced by EXCEL to draw the
testing and residual tests, and a detailed and reliable regression color readings and content concentration dispersion diagram
model have been validated and evaluated. The model indicates using a linear regression analysis system to calculate linear
the use of aero-material replacement parts is permanent and regression equation levels for color readings and material
successful. The results provide a realistic and analytic estimate model. We use the least square approach to derive the
of aero material consumption. regression equation and we use the cumulative square sum,
Dejian Wei. [45] MLR methods are used to quantify the residual square sum and regression sum and model error to
details in the simulated world on Chinese medicine bone setting evaluate model errors.
manipulation. A linear regression is used to predict the content Timur Bakibayev, [50] Proposed an algorithm for
of abstract knowledge from the manipulation. We model the processing spatial co-ordinates using polynomial regression to
displacement and angle knowledge of bone manipulation. Both measure the movement's common behaviour. The key benefit
medications and physical exercise helps accomplish the bone of this algorithm is that a trajectory map is usable in every area.
settling and bone movement mechanism. A true and science Used Python programming language for machine learning and
forum assists students in understanding bone setting viewing along with Science-Learning and Mattplotlib libraries.
manipulation and practicing bone setting manipulation. There At the end they attempt to forecast the movement of all points
are efforts to enhance the education level, treatment standard on the map over several stages.
and heritage of bone setting in Chinese medicine. A linear Franc¸ois Grondin, [51] Proposed a simple 2-D approach
regression analysis can be used to determine the strength of the by creating and overlaying the acoustic image with the visual
relationship between a treatment and its effect on a dependent field of a camera with the auditory field of an array microphone.
variable. Polynomial regression can effectively resolve non-linear video
Sreehari. [46] A described article explains MLR rainfall distortion using a low-cost microphone array and off-stage
prediction. It will help farmers determine crop yields. Floods or camera and that SVD-PHAT, a newly suggested approach for
droughts can be evaluated together at the same time. The MLR real-time analysis of sound sources can be tailored for this role.
technique was implemented in the Andhra Pradesh district of Used polynomial regression to match an acoustic picture with a
Nellore. Our analysis is designed to take advantage of the simple method of calibration that needs little calculation. The
relevant rainfall findings as a basic linear regression. The findings also suggest that SVD-PHAT is effective in producing
researchers have applied the MLR method, estimate the values, the acoustic picture in real time with a reduction of 47 compared
and the MLR error rate much less simple linear regression. with SRP-PHAT.
MLR are stronger than just linear regressions. Vapor pressure Soon-Jong Kwon, [52] Propose a method for estimating
is a dependent variable, others are independent variables, and remaining useful life (RULs) by the application of the IR
MLR is applied. voltage and capacitance correlation to the regression method of
Gopalakrishnan T. [47] Worked to evaluate the sales of a the polynomials. In addition, an accelerated degradation test
big store and estimate future sales in order to maximize their and the ESI test were performed using LIBs (LINixCoyMn1-x-
revenues and make their brands much better and more yO2 (NCM) with separate nickel material (Ni), life properties
competitive by generating customer loyalty. The technology and alternating current (AC) impedance properties. In
used for revenue prediction is the Deep Learning Linear polynomial regression analysis, the association between
Regression Algorithm. The revenue figures are from 2011-2013 internal resistance (IR) voltage and the power extracted from
and the data are expected for 2014. In addition, real-time 2014 the accelerating degradation test was applied, which revealed
data are taken and real 2014 data are compared with the that the NCM LIB was projected for the remaining useful life
expected data to measure the predictability. They took data for (RUL).
2014 and compared it to their estimated sales volume and found Ismail El kafazi, [53] Proposed two ways to predict
our projections 84% accurate, which is very similar indeed. renewable energy. Wind and solar power integration and
Luminto. [48] Worked on MLR model to predict the rice system improvement and availability assure continued output
cultivation time and the result showed highest farmer's and ensure supply of necessary amount of energy. The energy
exchange rate. The weather data shall be obtained using from renewable sources is tailored to customer needs.
National Statistical Authority's weather forecast and Farmer Historical statistics were used to analyze energy production
Exchange Rate data, and the obtained data will be used to over time. This experiment was to show the feasibility of the
construct a regression model using MLR to detect the weather power output projection from 2016-2030. Output predictions
FR association. The factors are "Average Temperature," are often inaccurate because of meteorological data. A linear
"Average Moisture," "Rainfall" and "Radiation from Solar." model suggested a polynomial model and reliability estimates.
Their effects are estimated, but their effects are mainly derived The Maxent model was the maximum R-square and
from the other factors. Prediction can be achieved by checking modified R-square, meaning that both models were more

143
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

IV.DISCUSSION accuracy of the models was measured and the predictive ability
of the method is really important, to measure the performance of
Most of the papers included in this review are observational a regression method, a comparative study has been done
studies which used linear regression models through (2016 to between predicted and sample values.
2020). Table 1. presents a summary of each study selected
(reviewed) in this paper , the summary includes the dataset of VI.REFERENCES
each paper, technique/ method, pros and cons of the used
method and accuracy of the results. As given in Table 1 there [1] S. Shalev-Shwartz and S. Ben-David, Understanding machine
are three regression models (methods), two papers (or 18%) are learning: From theory to algorithms: Cambridge university press,
used SLRM, 7 papers (or 63%) are used MLRM and 2 papers 2014.
(or 18%) are used polynomial regression. About (40%) used [2] K. P. Murphy, Machine learning: a probabilistic perspective: MIT
simulation to generate data to be modeled and (60%) are used press, 2012.
[3] P. Domingos, "A few useful things to know about machine
the historical data sets, Fewer than (20%) of the papers predicted learning," Communications of the ACM, vol. 55, pp. 78-87, 2012.
of future values, examined collinearity. Statistical significance [4] D. Q. Zeebaree, H. Haron, A. M. Abdulazeez, and D. A. Zebari,
testing or confidence intervals, goodness of fit were reported in "Machine learning and Region Growing for Breast Cancer
all papers. The best-achieved accuracy of the reviewed papers Segmentation," in 2019 International Conference on Advanced
and from those who depended on the MLRM algorithms is Science and Engineering (ICOASE), 2019, pp. 88-93.
[5] Bargarai, F., Abdulazeez, A., Tiryaki, V., & Zeebaree, D. (2020).
research [44] because the fitting of the MLRM is very good and Management of Wireless Communication Systems Using Artificial
the prediction error is small. [11] Used SLM method, the Intelligence-Based Software Defined Radio.
average accuracy was 90% or almost 10% of the forecasts were [6] B. Akgün and Ş. G. Öğüdücü, "Streaming linear regression on Spark
inaccurate Based on a test run of the regression program, there MLlib and MOA," in Proceedings of the 2015 IEEE/ACM
were some drawbacks to the software's predictive results. We International Conference on Advances in Social Networks Analysis
and Mining 2015, 2015, pp. 1244-1247.
may implement advanced machine learning algorithms, such as [7] M. H. Dehghan, F. Hamidi, and M. Salajegheh, "Study of linear
help vector machine and deep neural network, to solve regression based on least squares and fuzzy least absolutes
problems. [53] Two methods were proposed for estimating deviations and its application in geography," in 2015 4th Iranian
energy output from renewables, using the R-square figure for the Joint Congress on Fuzzy and Intelligent Systems (CFIS), 2015, pp.
curve fitting of the polynomial method is considerably higher 1-6.
than the one of the linear regression method. However, the [8] D. M. Abdulqader, A. M. Abdulazeez, and D. Q. Zeebaree,
"Machine Learning Supervised Algorithms of Gene Selection: A
obtained regression equation will be used in the future to analyze Review," Machine Learning, vol. 62, 2020.
and study the relationship and interactions between demand and [9] Zebari, D. A., Zeebaree, D. Q., Abdulazeez, A. M., Haron, H., &
energy production using machine learning in order to model Hamed, H. N. A. (2020). Improved Threshold Based and Trainable
electrical transport. The accuracy value of three reviewed papers Fully Automated Segmentation for Breast Cancer Boundary and
were used MLRM method [14, 37, 49] is about (82%), fitting a Pectoral Muscle in Mammogram Images. IEEE Access, 8, 203097-
203116..
model with low accuracy can cause by including not significant [10] Abdulazeez, A, M. A. Sulaiman, and D. Q. Zeebaree "Evaluating
variables, in these situations to identify candidate variables the Data Mining Classification Methods Performance in Internet of
stepwise regression can be used, because Specification of the Things Applications," Journal of Soft Computing and Data Mining,
appropriate model depends on the proper variables. In [37] it is vol. 1, pp. 11-25, 2020.
considered that the standard MLRM is applied and the accuracy [11] H.-I. Lim, "A Linear Regression Approach to Modeling Software
Characteristics for Classifying Similar Software," in 2019 IEEE
of the data is improved. Early stage regression modelling using 43rd Annual Computer Software and Applications Conference
Stepwise and Best Subsets Regression can help in model (COMPSAC), 2019, pp. 942-943.
specification. The authors in [14] Discrete features (derived [12] M. R. Sarkar, M. G. Rabbani, A. R. Khan, and M. M. Hossain,
from sampled diabetes data) were projected to a new space using "Electricity demand forecasting of Rajshahi City in Bangladesh
PCA, after which they were analyzed using MLRM. using fuzzy linear regression model," in 2015 International
Conference on Electrical Engineering and Information
V.CONCLUSION Communication Technology (ICEEICT), 2015, pp. 1-3.
[13] J. Wu, C. Liu, W. Cui, and Y. Zhang, "Personalized Collaborative
Regression modeling is a statistical method commonly used in Filtering Recommendation Algorithm based on Linear Regression,"
research, particularly for observational studies. The proper in 2019 IEEE International Conference on Power Data Science
choice of regression model, the choosing and presence of model (ICPDS), 2019, pp. 139-142.
[14] H. Roopa and T. Asha, "A linear model based on principal
variables are the key actions which should be established and component analysis for disease prediction," IEEE Access, vol. 7, pp.
properly controlled in order to achieve valid statistical results 105314-105318, 2019.
because the unavailability or misapplication of an appropriate [15] G. A. Seber and A. J. Lee, Linear regression analysis vol. 329: John
regression modeling may cause to inaccuracies results. This Wiley & Sons, 2012.
review utilized (23) papers appeared in the last 5 years on three [16] D. C. Montgomery, E. A. Peck, and G. G. Vining, Introduction to
linear regression analysis vol. 821: John Wiley & Sons, 2012.
regression models: Simple Linear Regression Model is suitable
[17] S. Kavitha, S. Varuna, and R. Ramya, "A comparative analysis on
to data contains a linear relationship between two variables, a linear regression and support vector regression," in 2016 Online
MLR Model is a linear relation between two or more International Conference on Green Engineering and Technologies
independent variables a Polynomial Regression Model would be (IC-GET), 2016, pp. 1-5.
used in case of variables having a polynomial relationship. The [18] Abdulazeez, A., Salim, B., Zeebaree, D., & Doghramachi, D.
results of this review illustrate that almost all of the provided (2020). Comparison of VPN Protocols at Network Layer Focusing
on Wire Guard Protocol..
research papers estimated the models utilizing data sets, the

doi:10.38094/jastt1457
145
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

[19] M. S. Acharya, A. Armaan, and A. S. Antony, "A comparison of Transformer winding diagnosis based on frequency response
regression models for prediction of graduate admissions," in 2019 analysis," in 2017 IEEE PES PowerAfrica, 2017, pp. 16-22.
International Conference on Computational Intelligence in Data [37] X. Wang and X. Sun, "An improved weighted naive bayesian
Science (ICCIDS), 2019, pp. 1-5. classification algorithm based on multivariable linear regression
[20] Z. Zhang, Y. Li, L. Li, Z. Li, and S. Liu, "Multiple linear regression model," in 2016 9th International Symposium on Computational
for high efficiency video intra coding," in ICASSP 2019-2019 IEEE Intelligence and Design (ISCID), 2016, pp. 219-222.
International Conference on Acoustics, Speech and Signal [38] Z. Peng and X. Li, "Application of a multi-factor linear regression
Processing (ICASSP), 2019, pp. 1832-1836. model for stock portfolio optimization," in 2018 International
[21] Najat, N., & Abdulazeez, A. M. (2017, November). Gene clustering Conference on Virtual Reality and Intelligent Systems (ICVRIS),
with partition around mediods algorithm based on weighted and 2018, pp. 367-370.
normalized Mahalanobis distance. In 2017 International Conference [39] Q. Feng, C. Yuan, J. Huang, and W. Li, "Center-based weighted
on Intelligent Informatics and Biomedical Sciences (ICIIBMS) (pp. kernel linear regression for image classification," in 2015 IEEE
140-145). IEEE.. International Conference on Image Processing (ICIP), 2015, pp.
[22] M. C. Roziqin, A. Basuki, and T. Harsono, "A comparison of 3630-3634.
montecarlo linear and dynamic polynomial regression in predicting [40] X. Feng, Y. Zhou, T. Hua, Y. Zou, and J. Xiao, "Contact
dengue fever case," in 2016 International Conference on Knowledge temperature prediction of high voltage switchgear based on multiple
Creation and Intelligent Computing (KCIC), 2016, pp. 213-218. linear regression model," in 2017 32nd Youth Academic Annual
[23] A. K. Prasad, M. Ahadi, B. S. Thakur, and S. Roy, "Accurate Conference of Chinese Association of Automation (YAC), 2017,
polynomial chaos expansion for variability analysis using optimal pp. 277-280.
design of experiments," in 2015 IEEE MTT-S International [41] T. Maeda, S. Kiyoda, T. Kurashige, and Y. Miyataki, "Learning
Conference on Numerical Electromagnetic and Multiphysics effects of automatic composition design software for human-
Modeling and Optimization (NEMO), 2015, pp. 1-4. equivalent phantoms from 1 GHz to 5 GHz with linear and
[24] Y. Chen, P. He, W. Chen, and F. Zhao, "A polynomial regression exponential regression analysis," in 2015 IEEE MTT-S 2015
method based on Trans-dimensional Markov Chain Monte Carlo," International Microwave Workshop Series on RF and Wireless
in 2018 IEEE 3rd Advanced Information Technology, Electronic Technologies for Biomedical and Healthcare Applications (IMWS-
and Automation Control Conference (IAEAC), 2018, pp. 1781- BIO), 2015, pp. 40-41.
1786. [42] E. C. Jackson, J. A. Hughes, and M. Daley, "On the generalizability
[25] G. D. Finlayson, M. Mackiewicz, and A. Hurlbert, "Color correction of linear and non-linear region of interest-based multivariate
using root-polynomial regression," IEEE Transactions on Image regression models for fmri data," in 2018 IEEE Conference on
Processing, vol. 24, pp. 1460-1470, 2015. Computational Intelligence in Bioinformatics and Computational
[26] N. N. Mohammed and A. M. Abdulazeez, "Evaluation of Biology (CIBCB), 2018, pp. 1-8.
partitioning around medoids algorithm with various distances on [43] R. Harimurti, Y. Yamasari, and B. Asto, "Predicting student's
microarray data," in 2017 IEEE International Conference on psychomotor domain on the vocational senior high school using
Internet of Things (iThings) and IEEE Green Computing and linear regression," in 2018 International Conference on Information
Communications (GreenCom) and IEEE Cyber, Physical and Social and Communications Technology (ICOIACT), 2018, pp. 448-453.
Computing (CPSCom) and IEEE Smart Data (SmartData), 2017, [44] Y. Yang, "Prediction and analysis of aero-material consumption
pp. 1011-1016. based on multivariate linear regression model," in 2018 IEEE 3rd
[27] H. Jie and G. Zheng, "Calibration of Torque Error of Permanent International Conference on Cloud Computing and Big Data
Magnet Synchronous Motor Base on Polynomial Linear Regression Analysis (ICCCBDA), 2018, pp. 628-632.
Model," in IECON 2019-45th Annual Conference of the IEEE [45] D. Wei, M. Xing, J. Zhang, C. Zhang, and H. Cao, "Applied
Industrial Electronics Society, 2019, pp. 318-323. Research of Multiple Linear Regression in the Information
[28] H. Niu, Q. Lu, and C. Wang, "Color correction based on histogram Quantification of Chinese Medicine Bone-setting Manipulation," in
matching and polynomial regression for image stitching," in 2018 2018 IEEE International Conference on Bioinformatics and
IEEE 3rd International Conference on Image, Vision and Biomedicine (BIBM), 2018, pp. 1912-1916.
Computing (ICIVC), 2018, pp. 257-261. [46] E. Sreehari and S. Srivastava, "Prediction of Climate Variable using
[29] X. Yan and X. Su, Linear regression analysis: theory and Multiple Linear Regression," in 2018 4th International Conference
computing: World Scientific, 2009. on Computing Communication and Automation (ICCCA), 2018, pp.
[30] Y. Fujita, S. Ikuno, T. Itoh, and H. Nakamura, "Modified Improved 1-4.
Interpolating Moving Least Squares Method for Meshless [47] T. Gopalakrishnan, R. Choudhary, and S. Prasad, "Prediction of
Approaches," IEEE Transactions on Magnetics, vol. 55, pp. 1-4, Sales Value in Online shopping using Linear Regression," in 2018
2019. 4th International Conference on Computing Communication and
[31] J. Wolberg, Data analysis using the method of least squares: Automation (ICCCA), 2018, pp. 1-6.
extracting the most information from experiments: Springer Science [48] H. Luminto, "Weather analysis to predict rice cultivation time using
& Business Media, 2006. multiple linear regression to escalate farmer's exchange rate," in
[32] J.-H. Xue and D. M. Titterington, "$ t $-Tests, $ F $-Tests and Otsu's 2017 International Conference on Advanced Informatics, Concepts,
Methods for Image Thresholding," IEEE Transactions on Image Theory, and Applications (ICAICTA), Denpasar, Indonesia, 2017,
Processing, vol. 20, pp. 2392-2396, 2011. pp. 16-18.
[33] R. Zhang and J. Tian, "Multi-parameter ocean surface wind speed [49] D. Wang, Y. Gao, and Z. Tian, "One-Variable Linear Regression
retrieval based on least square method," in 2016 IEEE International Mathematical Model of Color Reading and Material Concentration
Geoscience and Remote Sensing Symposium (IGARSS), 2016, pp. Identification," in 2017 International Conference on Smart City and
5835-5837. Systems Engineering (ICSCSE), 2017, pp. 119-122.
[34] H. Chi, "A Discussions on the Least-Square Method in the Course [50] T. Bakibayev and A. Kulzhanova, "Common Movement Prediction
of Error Theory and Data Processing," in 2015 International using Polynomial Regression," in 2018 IEEE 12th International
Conference on Computational Intelligence and Communication Conference on Application of Information and Communication
Networks (CICN), 2015, pp. 486-489. Technologies (AICT), 2018, pp. 1-4.
[35] N. V. Sabnis, P. Patil, N. S. Desai, S. Hirikude, S. Ingale, and V. [51] F. Grondin, H. Tang, and J. Glass, "Audio-Visual Calibration with
Kulkarni, "Outcome-Based Education—A Case Study on Project Polynomial Regression for 2-D Projection Using SVD-PHAT," in
Based Learning," in 2019 IEEE Tenth International Conference on ICASSP 2020-2020 IEEE International Conference on Acoustics,
Technology for Education (T4E), 2019, pp. 248-249. Speech and Signal Processing (ICASSP), 2020, pp. 4856-4860.
[36] G. Nnachi, A. Akumu, C. Richards, and D. Nicolae, "Application of [52] S.-J. Kwon, J. Park, J. H. Choi, J.-H. Lim, S.-E. Lee, and J. Kim,
statistical tools in power transformer FRA results interpretation: "Polynomial Regression method-based Remaining Useful Life
Prediction and Comparative Analysis of Two Lithium Nickel Cobalt

146
 Maulud et al. / Journal of Applied Science and Technology Trends Vol. 01, No. 04, pp. 140 –147, (2020)

Manganese Oxide Batteries," in 2019 IEEE Energy Conversion

Congress and Exposition (ECCE), pp. 2510-2515.
[53] I. El Kafazi, R. Bannari, A. Abouabdellah, M. O. Aboutafail, and J.
M. Guerrero, "Energy Production: A Comparison of Forecasting
Methods using the Polynomial Curve Fitting and Linear
Regression," in 2017 International Renewable and Sustainable
Energy Conference (IRSEC), 2017, pp. 1-5.
[54] A. Al-Imam, "A Novel Method for Computationally Efficacious
Linear and Polynomial Regression Analytics of Big Data in
Medicine," Modern Applied Science, vol. 14, pp. 1-10, 2020.

147