Explanation of Simplex Method
Explanation of Simplex Method
Introduction
The Simplex method is an approach to solving linear programming models by hand using slack
variables, tableaus, and pivot variables as a means to finding the optimal solution of an
optimization problem. A linear program is a method of achieving the best outcome given a
maximum or minimum equation with linear constraints. Most linear programs can be solved
using an online solver such as MatLab, but the Simplex method is a technique for solving linear
programs by hand. To solve a linear programming model using the Simplex method the
following steps are necessary:
● Standard form
● Introducing slack variables
● Creating the tableau
● Pivot variables
● Creating a new tableau
● Checking for optimality
● Identify optimal values
This document breaks down the Simplex method into the above steps and follows the example
linear programming model shown below throughout the entire document to find the optimal
solution.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 1
Step 1: Standard Form
Standard form is the baseline format for all linear programs before solving for the optimal
solution and has three requirements: (1) must be a maximization problem, (2) all linear
constraints must be in a less-than-or-equal-to inequality, (3) all variables are non-negative.
These requirements can always be satisfied by transforming any given linear program using
basic algebra and substitution. Standard form is necessary because it creates an ideal starting
point for solving the Simplex method as efficiently as possible as well as other methods of
solving optimization problems.
To transform a minimization linear program model into a maximization linear program model,
simply multiply both the left and the right sides of the objective function by -1.
Once the model is in standard form, the slack variables can be added as shown in Step 2 of the
Simplex method.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 2
Step 2: Determine Slack Variables
Slack variables are additional variables that are introduced into the linear constraints of a linear
program to transform them from inequality constraints to equality constraints. If the model is in
standard form, the slack variables will always have a +1 coefficient. Slack variables are needed
in the constraints to transform them into solvable equalities with one definite answer.
After the slack variables are introduced, the tableau can be set up to check for optimality as
described in Step 3.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 3
Once the tableau has been completed, the model can be checked for an optimal solution as
shown in Step 4.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 4
Step 4: Check Optimality
The optimal solution of a maximization linear programming model are the values assigned to the
variables in the objective function to give the largest zeta value. The optimal solution would
exist on the corner points of the graph of the entire model. To check optimality using the
tableau, all values in the last row must contain values greater than or equal to zero. If a value is
less than zero, it means that variable has not reached its optimal value. As seen in the previous
tableau, three negative values exists in the bottom row indicating that this solution is not optimal.
If a tableau is not optimal, the next step is to identify the pivot variable to base a new tableau on,
as described in Step 5.
In the example shown below, -10 is the smallest negative in the last row. This will designate the
10
x2 column to contain the pivot variable. Solving for the indicator gives us a value of for the
3
8 8
first constraint, and a value of for the second constraint. Due to being the smallest non-
5 5
negative indicator, the pivot value will be in the second row and have a value of 5.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 5
Now that the new pivot variable has been identified, the new tableau can be created in Step 6 to
optimize the variable and find the new possible optimal solution.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 6
Step 6: Create the New Tableau
The new tableau will be used to identify a new possible optimal solution. Now that the pivot
variable has been identified in Step 5, row operations can be performed to optimize the pivot
variable while keeping the rest of the tableau equivalent.
I. To optimize the pivot variable, it will need to be transformed into a unit value (value of
1). To transform the value, multiply the row containing the pivot variable by the
reciprocal of the pivot value. In the example below, the pivot variable is originally 5, so
1
multiply the entire row by .
5
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 7
II. After the unit value has been determined, the other values in the column containing the
unit value will become zero. This is because the x2 in the second constraint is being
optimized, which requires x2 in the other equations to be zero.
III. In order to keep the tableau equivalent, the other variables not contained in the pivot
column or pivot row must be calculated by using the new pivot values. For each new
value, multiply the negative of the value in the old pivot column by the value in the new
pivot row that corresponds to the value being calculated. Then add this to the old value
from the old tableau to produce the new value for the new tableau. This step can be
condensed into the equation on the next page:
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 8
New tableau value = (Negative value in old tableau pivot column) x (value in new tableau pivot
row) + (Old tableau value)
Old Tableau:
New Tableau:
Numerical examples are provided below to help explain this concept a little better.
Numerical examples:
I. To find the s2 value in row 1:
New tableau value = (Negative value in old tableau pivot column) * (value in new
tableau pivot row) + (Old tableau value)
1 3
New tableau value = (-3) * ( ) + 0 = -
5 5
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 9
New tableau value = (Negative value in old tableau pivot column) * (value in new
tableau pivot row) + (Old tableau value)
1
New value = (10) * ( ) + -8 = -6
5
Once the new tableau has been completed, the model can be checked for an optimal solution.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 10
Step 7: Check Optimality
As explained in Step 4, the optimal solution of a maximization linear programming model are the
values assigned to the variables in the objective function to give the largest zeta value.
Optimality will need to be checked after each new tableau to see if a new pivot variable needs to
be identified. A solution is considered optimal if all values in the bottom row are greater than or
equal to zero. If all values are greater than or equal to zero, the solution is considered optimal
and Steps 8 through 11 can be ignored. If negative values exist, the solution is still not optimal
and a new pivot point will need to be determined which is demonstrated in Step 8.
With the new pivot variable identified, the new tableau can be created in Step 9.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 11
Step 9: Create New Tableau
After the new pivot variable has been identified, a new tableau will need to be created.
Introduced in Step 6, the tableau is used to optimize the pivot variable while keeping the rest of
the tableau equivalent.
I. Make the pivot variable 1 by multiplying the row containing the pivot variable by the
1
reciprocal of the pivot value. In the tableau below, the pivot value was , so everything
5
is multiplied by 5.
II. Next, make the other values in the column of the pivot variable zero. This is done by
taking the negative of the old value in the pivot column and multiplying it by the new
value in the pivot row. That value is then added to the old value that is being replaced.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 12
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 13
Step 11: Identify Optimal Values
Once the tableau is proven optimal the optimal values can be identified. These can be found by
distinguishing the basic and non-basic variables. A basic variable can be classified to have a
single 1 value in its column and the rest be all zeros. If a variable does not meet this criteria, it is
considered non-basic. If a variable is non-basic it means the optimal solution of that variable is
zero. If a variable is basic, the row that contains the 1 value will correspond to the beta value.
The beta value will represent the optimal solution for the given variable.
For the variable x1, the 1 is found in the second row. This shows that the optimal x1 value is
found in the second row of the beta values, which is 8.
Variable s1 has a 1 value in the first row, showing the optimal value to be 2 from the beta
column. Due to s1 being a slack variable, it is not actually included in the optimal solution since
the variable is not contained in the objective function.
The zeta variable has a 1 in the last row. This shows that the maximum objective value will be
64 from the beta column.
The final solution shows each of the variables having values of:
x1 = 8 s1 = 2
x2 = 0 s2 = 0
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 14
x3 = 0 z = 64
The maximum optimal value is 64 and found at (8, 0, 0) of the objective function.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 15
Conclusion
The Simplex method is an approach for determining the optimal value of a linear program by
hand. The method produces an optimal solution to satisfy the given constraints and produce a
maximum zeta value. To use the Simplex method, a given linear programming model needs to
be in standard form, where slack variables can then be introduced. Using the tableau and pivot
variables, an optimal solution can be reached. From the example worked throughout this
document, it can be determined that the optimal objective value is 64 and can be found when
x1=8, x2=0, and x3=0.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 16
Glossary
Basic variables are variables that are non-negative in terms of the optimal solution.
Constraints are a series of equalities and inequalities that are a set of criteria necessary to satisfy
when finding the optimal solution.
Inequality is an expression that does not have one definite solution and is distinguishable by its
‘greater than’ or ‘less than’ symbols in the place of a traditional equal sign.
Linear program is a model used to achieve the best outcome given a maximum or minimum
equation with linear constraints.
Non-basic variables are variables that are zero in terms of the optimal solution.
Optimal solution of a maximization linear programming model are the values assigned to the
variables in the objective function to give the largest zeta value. The optimal solution would
exist on the corner points of the graph of the entire model.
Pivot variable is used in row operations to identify which variable will become the unit value
and is a key factor in the conversion of the unit value.
Simplex method is an approach to solving linear programming models by hand using slack
variables, tableaus, and pivot variables as a means to finding the optimal solution of an
optimization problem.
Simplex tableau is used to perform row operations on the linear programming model as well as
for checking optimality.
Slack variables are additional variables that are introduced into the linear constraints of a linear
program to transform them from inequality constraints to equality constraints.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 17
Standard form is the baseline format for all linear programs before solving for the optimal
solution.
IMSE Concept Library | Laurel Nichols & Gina Christofaro | Spring 2015 18