MATH F112

Vector Spaces
Row space, Column Space and Null space

Mukesh Kumar Nagar

Department of Mathematics

BITS Pilani, K K Birla Goa Campus

Email : [email protected]

February 3, 2025

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 1 / 12
Recall Basis for row space/column space
Theorem 1
Elementary row operations do not change the null space of a matrix.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 2 / 12
Recall Basis for row space/column space
Theorem 1
Elementary row operations do not change the null space of a matrix.

Theorem 2
Elementary row operations do not change the row space of a matrix.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 2 / 12
Recall Basis for row space/column space
Theorem 1
Elementary row operations do not change the null space of a matrix.

Theorem 2
Elementary row operations do not change the row space of a matrix.
Can you say something about column space under an ERO?

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 2 / 12
Recall Basis for row space/column space
Theorem 1
Elementary row operations do not change the null space of a matrix.

Theorem 2
Elementary row operations do not change the row space of a matrix.
Can you say something about column space under an ERO?

Theorem 3
If a matrix R is in row echelon form, then the row vectors with the
leading 1’ s (the nonzero row vectors) form a basis for the row space
of R,

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 2 / 12
Recall Basis for row space/column space
Theorem 1
Elementary row operations do not change the null space of a matrix.

Theorem 2
Elementary row operations do not change the row space of a matrix.
Can you say something about column space under an ERO?

Theorem 3
If a matrix R is in row echelon form, then the row vectors with the
leading 1’ s (the nonzero row vectors) form a basis for the row space
of R,
and the column vectors with the leading 1’ s of the row vectors form a
basis for the column space of R.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 2 / 12
Example
Example 4
Find bases for the row and column spaces of the matrix
 
1 −2 5 0 3
 0 1 3 0 0 
R=  0 0 0 1 0 

0 0 0 0 0

Solution: r1 = [1 − 2 5 0 3]
r2 = [0 1 3 0 0]
r3 = [0 0 0 1 0]
form a basis of row space of R and the set {c1 , c2 , c4 } form a basis
for the column space R.
If R is not in row echelon form, then ??
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 3 / 12
Example 5
Find a basis for the row space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1 3

−4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 4 / 12
Example 5
Find a basis for the row space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1 3

−4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=  0 0 0 0

1 5 
0 0 0 0 0 0
Thus, the set {r01 , r02 , r03 } form a basis for row space of R.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 4 / 12
Example 5
Find a basis for the row space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1 3

−4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=  0 0 0 0

1 5 
0 0 0 0 0 0
Thus, the set {r01 , r02 , r03 } form a basis for row space of R.
Hence, the corresponding set of rows of A, i.e., {r1 , r2 , r4 }
forms a basis for the row space A.
Here, Row space of R= Row space of A.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 4 / 12
Column Space
But the column space of A and the column space of R need not be
the same. How to find a basis of column space of A?

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 5 / 12
Column Space
But the column space of A and the column space of R need not be
the same. How to find a basis of column space of A?
An elementary row operation can alter its column space.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 5 / 12
Column Space
But the column space of A and the column space of R need not be
the same. How to find a basis of column space of A?
An elementary row operation can alter its column space.
The good news is that elementary row operations do not alter
dependence relationships among the column vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 5 / 12
Column Space
But the column space of A and the column space of R need not be
the same. How to find a basis of column space of A?
An elementary row operation can alter its column space.
The good news is that elementary row operations do not alter
dependence relationships among the column vectors.

Theorem 6
If A and B are row equivalent matrices, then:
1 A given set of column vectors of A is linearly independent if and
only if the corresponding column vectors of B are linearly
independent.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 5 / 12
Column Space
But the column space of A and the column space of R need not be
the same. How to find a basis of column space of A?
An elementary row operation can alter its column space.
The good news is that elementary row operations do not alter
dependence relationships among the column vectors.

Theorem 6
If A and B are row equivalent matrices, then:
1 A given set of column vectors of A is linearly independent if and
only if the corresponding column vectors of B are linearly
independent.
2 A given set of column vectors of A forms a basis for the column
space of A if and only if the corresponding column vectors of B
form a basis for the column space of B.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 5 / 12
Example 7
Find a basis for the column space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1

3 −4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 6 / 12
Example 7
Find a basis for the column space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1

3 −4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=  0 0 0 0

1 5 
0 0 0 0 0 0
Thus, the set {c01 , c03 , c05 } of column vectors of R is L.I.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 6 / 12
Example 7
Find a basis for the column space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1

3 −4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=  0 0 0 0

1 5 
0 0 0 0 0 0
Thus, the set {c01 , c03 , c05 } of column vectors of R is L.I.
Hence, the corresponding set of column vectors of A is L.I., i.e.,

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 6 / 12
Example 7
Find a basis for the column space of the matrix
 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A=  −1

3 −4 2 −5 −4 
2 −6 9 −1 9 7

Solution: Using elementary row operations, we have the following

REF of A
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=  0 0 0 0

1 5 
0 0 0 0 0 0
Thus, the set {c01 , c03 , c05 } of column vectors of R is L.I.
Hence, the corresponding set of column vectors of A is L.I., i.e.,
{c1 , c3 , c5 } form a basis for the column space A.
It is easy to see that span{c01 , c03 , c05 } =
6 span{c1 , c3 , c5 }.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 6 / 12
Basis of Span

Problem 8
Given a set of vectors S = {v1 , v2 , . . . , vk } in Rn , find a subset of
these vectors that forms a basis for span(S),

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 7 / 12
Basis of Span

Problem 8
Given a set of vectors S = {v1 , v2 , . . . , vk } in Rn , find a subset of
these vectors that forms a basis for span(S),

and express each vector that is not in that basis as a linear

combination of the basis vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 7 / 12
Basis of Span

Problem 8
Given a set of vectors S = {v1 , v2 , . . . , vk } in Rn , find a subset of
these vectors that forms a basis for span(S),

and express each vector that is not in that basis as a linear

combination of the basis vectors.

Solution: Recall elementary row operations do not alter dependence

relationships among the column vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 7 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }
• STEP 2. Reduce the matrix A to reduced row echelon form R.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }
• STEP 2. Reduce the matrix A to reduced row echelon form R.
• STEP 3. Denote the column vectors of R by w1 , w2 , · · · , wk .

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }
• STEP 2. Reduce the matrix A to reduced row echelon form R.
• STEP 3. Denote the column vectors of R by w1 , w2 , · · · , wk .
• STEP 4. Identify the columns of R that contain the leading 1’s.
The corresponding column vectors of A form a basis for span(S).
This completes the first part of the problem.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }
• STEP 2. Reduce the matrix A to reduced row echelon form R.
• STEP 3. Denote the column vectors of R by w1 , w2 , · · · , wk .
• STEP 4. Identify the columns of R that contain the leading 1’s.
The corresponding column vectors of A form a basis for span(S).
This completes the first part of the problem.
• STEP 5. Obtain a set of dependency equations for the column
vectors w1 , w2 , · · · , wk . of R by successively expressing each wi
that does not contain a leading 1 of R as a linear combination of
predecessors that do.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Basis for span(S), where S = {v1 , v2 , · · · , vk } ⊂ Rn
• STEP 1. Form the matrix A whose columns are the vectors in
the set S = {v1 , v2 , · · · , vk }
• STEP 2. Reduce the matrix A to reduced row echelon form R.
• STEP 3. Denote the column vectors of R by w1 , w2 , · · · , wk .
• STEP 4. Identify the columns of R that contain the leading 1’s.
The corresponding column vectors of A form a basis for span(S).
This completes the first part of the problem.
• STEP 5. Obtain a set of dependency equations for the column
vectors w1 , w2 , · · · , wk . of R by successively expressing each wi
that does not contain a leading 1 of R as a linear combination of
predecessors that do.
• STEP 6. In each dependency equation obtained in Step 5,
replace the vector wi by the vector vi for i = 1, 2, · · · , n.
This completes the second part of the problem.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 8 / 12
Example 9
1 Find a subset of the vectors
v1 = (1, 2, 2, −1), v2 = (−3, −6, −6, 3), v3 = (4, 9, 9, −4),
v4 = (−2, −1, −1, 2), v5 = (5, 8, 9, −5), v6 = (4, 2, 7, −4)
that forms a basis for the subspace of R4 spanned by these
vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 9 / 12
Example 9
1 Find a subset of the vectors
v1 = (1, 2, 2, −1), v2 = (−3, −6, −6, 3), v3 = (4, 9, 9, −4),
v4 = (−2, −1, −1, 2), v5 = (5, 8, 9, −5), v6 = (4, 2, 7, −4)
that forms a basis for the subspace of R4 spanned by these
vectors.

2 Express each vector not in the basis as a linear combination of

the basis vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 9 / 12
Example 9
1 Find a subset of the vectors
v1 = (1, 2, 2, −1), v2 = (−3, −6, −6, 3), v3 = (4, 9, 9, −4),
v4 = (−2, −1, −1, 2), v5 = (5, 8, 9, −5), v6 = (4, 2, 7, −4)
that forms a basis for the subspace of R4 spanned by these
vectors.

2 Express each vector not in the basis as a linear combination of

the basis vectors.

Solution: Matrix A with columns vectors v1 , v2 , v3 , v4 , v5 , v6 is

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 9 / 12
Example 9
1 Find a subset of the vectors
v1 = (1, 2, 2, −1), v2 = (−3, −6, −6, 3), v3 = (4, 9, 9, −4),
v4 = (−2, −1, −1, 2), v5 = (5, 8, 9, −5), v6 = (4, 2, 7, −4)
that forms a basis for the subspace of R4 spanned by these
vectors.

2 Express each vector not in the basis as a linear combination of

the basis vectors.

Solution: Matrix A with columns vectors v1 , v2 , v3 , v4 , v5 , v6 is

 
1 −3 4 −2 5 4
 2 −6 9 −1 8 2 
A= 
 2 −6 9 −1 9 7 
−1 3 −4 2 −5 −4

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 9 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and
c02 = −3c01 , c04 = −14c01 + 3c03 , c06 = −37c01 + 4c03 + 5c05

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and
c02 = −3c01 , c04 = −14c01 + 3c03 , c06 = −37c01 + 4c03 + 5c05

The corresponding column set {c1 , c3 , c5 } form a basis for the column
space A and

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and
c02 = −3c01 , c04 = −14c01 + 3c03 , c06 = −37c01 + 4c03 + 5c05

The corresponding column set {c1 , c3 , c5 } form a basis for the column
space A and
c2 = −3c1 , c4 = −14c1 + 3c3 , c6 = −37c1 + 4c3 + 5c5

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and
c02 = −3c01 , c04 = −14c01 + 3c03 , c06 = −37c01 + 4c03 + 5c05

The corresponding column set {c1 , c3 , c5 } form a basis for the column
space A and
c2 = −3c1 , c4 = −14c1 + 3c3 , c6 = −37c1 + 4c3 + 5c5

In other words, {v1 , v3 , v5 } form a basis for the

span{v1 , v2 , v3 , v4 , v5 , v6 } and

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
and REF of A is
 
1 −3 4 −2 5 4
 0 0 1 3 −2 −6 
R=
 0 0 0 0

1 5 
0 0 0 0 0 0
Therefore {c01 , c03 , c05 } form a basis for the column space R and
c02 = −3c01 , c04 = −14c01 + 3c03 , c06 = −37c01 + 4c03 + 5c05

The corresponding column set {c1 , c3 , c5 } form a basis for the column
space A and
c2 = −3c1 , c4 = −14c1 + 3c3 , c6 = −37c1 + 4c3 + 5c5

In other words, {v1 , v3 , v5 } form a basis for the

span{v1 , v2 , v3 , v4 , v5 , v6 } and

v2 = −3v1 , v4 = −14v1 + 3v3 , v6 = −37v1 + 4v3 + 5v5

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 10 / 12
Rank of a Matrix
Theorem 10
The row space and the column space of a matrix A have the same
dimension.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 11 / 12
Rank of a Matrix
Theorem 10
The row space and the column space of a matrix A have the same
dimension.
Proof: Hint
dim(row space of A) = dim(row space of R) = non-zero rows of R
dim(column space of A) = dim(column space of R)

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 11 / 12
Rank of a Matrix
Theorem 10
The row space and the column space of a matrix A have the same
dimension.
Proof: Hint
dim(row space of A) = dim(row space of R) = non-zero rows of R
dim(column space of A) = dim(column space of R)

Definition 11
The common dimension of the row space and column space of a
matrix A is called the rank of A and is denoted by rank(A).

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 11 / 12
Rank of a Matrix
Theorem 10
The row space and the column space of a matrix A have the same
dimension.
Proof: Hint
dim(row space of A) = dim(row space of R) = non-zero rows of R
dim(column space of A) = dim(column space of R)

Definition 11
The common dimension of the row space and column space of a
matrix A is called the rank of A and is denoted by rank(A).
The dimension of the null space of A is called the nullity of A and is
denoted by nullity(A).

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 11 / 12
Exercises

Problem 12
Find a change of basis matrix PB→B 0 where
B = {1, 1 + x, 1 + x + x2 } and {1 − x, 1 − x − x2 , x2 } in P2 (R). Let
v = 2 + 3x − 5x2 be a polynomial in P2 (R). Find (v)B and (v)B 0 .
Also, verify your answer using PB→B 0 .

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 12 / 12
Exercises

Problem 12
Find a change of basis matrix PB→B 0 where
B = {1, 1 + x, 1 + x + x2 } and {1 − x, 1 − x − x2 , x2 } in P2 (R). Let
v = 2 + 3x − 5x2 be a polynomial in P2 (R). Find (v)B and (v)B 0 .
Also, verify your answer using PB→B 0 .

Problem 13
1 Find a subset of the vectors
v1 = (1, 0, 2, 1, −1), v2 = (1, 5, −6, 0, 3), v3 = (2, 7, 3, −4, 1),
v4 = (2, 0, −1, 1, 6), v5 = (2, 5, 0, 9, 1), v6 = (7, 1, 8, 7, 2)
that forms a basis for the subspace of R5 spanned by these
vectors.

Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 12 / 12
Exercises

Problem 12
Find a change of basis matrix PB→B 0 where
B = {1, 1 + x, 1 + x + x2 } and {1 − x, 1 − x − x2 , x2 } in P2 (R). Let
v = 2 + 3x − 5x2 be a polynomial in P2 (R). Find (v)B and (v)B 0 .
Also, verify your answer using PB→B 0 .

Problem 13
1 Find a subset of the vectors
v1 = (1, 0, 2, 1, −1), v2 = (1, 5, −6, 0, 3), v3 = (2, 7, 3, −4, 1),
v4 = (2, 0, −1, 1, 6), v5 = (2, 5, 0, 9, 1), v6 = (7, 1, 8, 7, 2)
that forms a basis for the subspace of R5 spanned by these
vectors.
2 Express each vector not in the basis as a linear combination of
the basis vectors.
Mukesh Kumar Nagar (BITS Pilani Goa) MATH F112 Vector Spaces February 3, 2025 12 / 12