3 Systems of Linear Equations

A progressive guide to representing, reducing, solving, classifying, and applying systems of linear equations using matrices, pivots, and rank.

From equations to matrices

A linear equation in variables x1,…,xnx_1,\ldots,x_n has the form

a1x1+a2x2+⋯+anxn=b.a_1x_1+a_2x_2+\cdots+a_nx_n=b.

Several such equations impose conditions simultaneously. A solution is an ordered tuple (x1,…,xn)(x_1,\ldots,x_n) that satisfies every equation.

For example, the system

{x+2y−z=3,2x−y+3z=4\begin{cases} x+2y-z=3,\\ 2x-y+3z=4 \end{cases}

has coefficient matrix

A=[12−12−13],A=\left[\begin{array}{ccc}1&2&-1\\2&-1&3\end{array}\right],

unknown vector x\mathbf{x}, and constants vector b\mathbf b. Its compact form is Ax=bA\mathbf{x}=\mathbf b. The corresponding is

[A∣b]=[12−132−134].[A\mid\mathbf b]=\left[\begin{array}{ccc|c}1&2&-1&3\\2&-1&3&4\end{array}\right].

The vertical bar separates coefficients from right-hand-side constants.

Takeaway: matrix notation organizes many equations into a form that can be simplified systematically.

Simplifying a system safely

The solution set is preserved by the three :

  1. Interchange two rows.

  2. Multiply a row by a nonzero constant.

  3. Replace one row by itself plus a multiple of another row.

For example,

[1253411]→R2←R2−3R1[1250−2−4].\left[\begin{array}{cc|c}1&2&5\\3&4&11\end{array}\right] \xrightarrow{R_2\leftarrow R_2-3R_1} \left[\begin{array}{cc|c}1&2&5\\0&-2&-4\end{array}\right].

The matrix operation corresponds to replacing the second equation by the second equation minus three times the first. Because each operation is reversible, the original and transformed systems have exactly the same solutions.

Two matrices are row equivalent when one can be obtained from the other through a finite sequence of .

Takeaway: row reduction changes the appearance of a system, not its solution set.

Pivots and echelon forms

Row reduction aims to create a staircase pattern. In , zero rows appear below nonzero rows, each leading nonzero entry lies farther right than the leading entry above it, and entries below each leading entry are zero. Each leading nonzero entry is a .

A variable corresponds to a column. A corresponds to a nonpivot column. In , every equals 11 and is the only nonzero entry in its column.

stops after reaching and then uses back-substitution. continues to , where the solution can usually be read directly.

A practical procedure is:

  1. Find the leftmost column containing a nonzero entry.

  2. Move a nonzero entry into the current position if necessary.

  3. Scale the row so the is 11, when convenient.

  4. Use row replacement to create zeros below the .

  5. Continue in lower rows and columns to the right.

  6. For , eliminate entries above each as well.

Takeaway: pivots reveal which variables are determined and which variables may remain free.

Reading and classifying solutions

The final matrix reveals the solution type. A row such as

[0004]\left[\begin{array}{ccc|c}0&0&0&4\end{array}\right]

represents 0=40=4, which is impossible. Therefore, the system has no solution and is inconsistent.

If no contradictory row occurs, the system is . Then:

  • There is a unique solution when every variable column contains a .

  • There are infinitely many solutions when the system is and at least one variable is free.

  • There is no solution when row reduction produces 0=c0=c with c≠0c\neq 0.

For example,

[102501−310000]\left[\begin{array}{ccc|c}1&0&2&5\\0&1&-3&1\\0&0&0&0\end{array}\right]

gives

x+2z=5,y−3z=1.x+2z=5,\qquad y-3z=1.

The variable zz is free. Set z=tz=t, giving

x=5−2t,y=1+3t,x=5-2t,\qquad y=1+3t,

so the complete solution set is

(x,y,z)=(5−2t,1+3t,t),t∈R.(x,y,z)=(5-2t,1+3t,t),\qquad t\in\mathbb R.

Takeaway: count pivots and inspect the augmented column before deciding whether a system has one, infinitely many, or no solutions.

Consistency through

The of a matrix is the number of pivots in its row-reduced form. For an augmented system Ax=bA\mathbf{x}=\mathbf b, consistency can be tested using

rank⁡(A)=rank⁡([A∣b]).\operatorname{rank}(A)=\operatorname{rank}([A\mid\mathbf b]).

If the has a in its final column, the augmented is larger and a contradictory row appears. If the ranks are equal, the system is .

For a system with nn variables:

  • rank⁡(A)=n\operatorname{rank}(A)=n means every variable column has a , so the solution is unique.

  • rank⁡(A)<n\operatorname{rank}(A)<n means at least one variable is free, so infinitely many solutions result.

This viewpoint summarizes the test and works for systems with different numbers of equations and variables.

Takeaway: compares the number of independent constraints with the number of unknowns.

A complete elimination example

Consider

{x+y+z=6,2x−y+z=3,x+2y−z=4.\begin{cases} x+y+z=6,\\ 2x-y+z=3,\\ x+2y-z=4. \end{cases}

Its is

[11162−11312−14].\left[\begin{array}{ccc|c}1&1&1&6\\2&-1&1&3\\1&2&-1&4\end{array}\right].

Eliminating below the first gives

→R2←R2−2R1R3←R3−R1[11160−3−1−901−2−2].\xrightarrow{\substack{R_2\leftarrow R_2-2R_1\\R_3\leftarrow R_3-R_1}} \left[\begin{array}{ccc|c}1&1&1&6\\0&-3&-1&-9\\0&1&-2&-2\end{array}\right].

Swap the second and third rows:

→R2↔R3[111601−2−20−3−1−9].\xrightarrow{R_2\leftrightarrow R_3} \left[\begin{array}{ccc|c}1&1&1&6\\0&1&-2&-2\\0&-3&-1&-9\end{array}\right].

Then eliminate below the second :

→R3←R3+3R2[111601−2−200−7−15].\xrightarrow{R_3\leftarrow R_3+3R_2} \left[\begin{array}{ccc|c}1&1&1&6\\0&1&-2&-2\\0&0&-7&-15\end{array}\right].

Back-substitution gives

−7z=−15⟹z=157,-7z=-15\quad\Longrightarrow\quad z=\frac{15}{7},
y−2z=−2⟹y=167,y-2z=-2\quad\Longrightarrow\quad y=\frac{16}{7},

and then

x+y+z=6⟹x=117.x+y+z=6\quad\Longrightarrow\quad x=\frac{11}{7}.

Thus,

(x,y,z)=(117,167,157).(x,y,z)=\left(\frac{11}{7},\frac{16}{7},\frac{15}{7}\right).

There is a in every variable column and no contradictory row, so the solution is unique.

Takeaway: record each row operation carefully, then interpret the final equations through back-substitution.

Applications and interpretation

Systems of linear equations model several quantities constrained at the same time.

In a mixture problem, let xx be the liters of a 20%20\% solution and yy the liters of a 50%50\% solution. To make 1010 liters containing 30%30\% acid, the conditions are

{x+y=10,0.20x+0.50y=3.\begin{cases} x+y=10,\\ 0.20x+0.50y=3. \end{cases}

The first equation tracks total volume, and the second tracks total acid. Solving the system determines the amounts of each solution.

The same modeling pattern applies to network and flow problems, where conservation at a junction equates total incoming and outgoing flow. Economic models can use variables for quantities of goods and equations for budgets, capacities, or balance conditions.

A reliable modeling process is:

  1. Define the unknown quantities.

  2. Translate each condition into a linear equation.

  3. Form the .

  4. Row-reduce and interpret the result in context.

  5. Reject mathematically valid values that violate practical restrictions, such as negative quantities or capacity limits.

Takeaway: the algebraic solution must be checked against the real-world meaning of the variables.