PHD → Algebra → Linear Algebra ↓
Vector Spaces
In the study of linear algebra, an important concept is that of vector spaces. Vector spaces provide a framework for working with vectors, which can be thought of as quantities having both magnitude and direction. These fundamental structures are essential in various fields of mathematics, physics, engineering, and computer science.
Definition of vector space
A vector space, or linear space, is a collection of objects called vectors. These vectors can be added together and multiplied by numbers, called scalars. Scalars are often real numbers, but they can also be complex numbers or elements of a specified field (a mathematical term that covers numbers on which certain operations are defined that follow certain rules).
More formally, a vector space V over a field F is a set equipped with two operations: vector addition and scalar multiplication. The vector space must satisfy the ten axioms listed below:
- Closure under addition: for all
u, v
inV
, the sumu + v
is also inV
- Closure under scalar multiplication: for any scalar
c
inF
and any vectorv
inV
, the productc * v
is inV
- Associative property of addition: For all
u, v, w
inV
,(u + v) + w = u + (v + w)
- Commutative property of addition: For all
u, v
inV
,u + v = v + u
. - Identity element of sum: There exists an element
0
inV
, called the zero vector, such thatv + 0 = v
for allv
inV
- Inverse elements of a sum: for every
v
inV
, there exists a-v
inV
such thatv + (-v) = 0
. - Compatibility of scalar multiplication with field multiplication: for all
a, b
inF
andv
inV
,(a * b) * v = a * (b * v)
- Identity element of scalar multiplication: for all
v
inV
,1 * v = v
, where1
is the multiplicative identity inF
- Distributive property of scalar multiplication with respect to vector addition: for all
a
inF
andu, v
inV
,a * (u + v) = a * u + a * v
. - Distributive property of scalar multiplication with respect to field addition: for all
a, b
inF
andv
inV
,(a + b) * v = a * v + b * v
.
Geometric interpretation of a vector space
Let's look at a vector space in a more geometric sense. Imagine the simple case of a two-dimensional space, usually denoted as R^2
. Here the vectors are line segments directed from the origin.
This diagram shows the vectors u
, v
and u+v
in two-dimensional space.
In this simple 2D case, the sum of two vectors u
and v
can also be found graphically. Place them so that the tail of v
is at the head of u
, and their sum is the vector from the base of u
to the head of v
. This is also known mathematically as the "parallelogram rule".
Examples of vector spaces
Now, let's explore different examples of vector spaces:
Example 1: Physical location
The most intuitive vector space might be the 3-dimensional physical space around us, R^3
. The basic operations of vector addition and scalar multiplication can be easily visualized here by moving through the space.
Example 2: Polynomial
Consider the set of all polynomials with real coefficients, R[x]
. This is a vector space where vector addition is polynomial addition, and scalar multiplication is multiplying each term in the polynomial by the same scalar.
Example 3: Function
The set of all continuous real-valued functions defined on a closed interval is another example. Here, vector summation corresponds to function addition, and scalar multiplication again modifies the 'height' of each function by a scalar.
Subspace
A subspace is a subset of a vector space that is itself a vector space. Subspaces must pass some simple tests:
- If
u
andv
are in a subspace, thenu + v
must also be in a subspace. - If
c
is any scalar, andv
is in the subspace, thenc * v
must also be in the subspace. - The zero vector must be in any subspace.
Example 1: Lines through the origin
Any line in R^2
passing through the origin is a subspace. It contains the zero vector and is closed under addition and scalar multiplication.
Example 2: Plane
The subspace of R^3
can be any plane through the origin. Again, it has the zero vector and is closed under our operations.
Base and dimensions
A basis for a vector space V
is a set of vectors in V
that are linearly independent and that span V
. This means that you can reach any vector in V
by scaling and adding the basis vectors. The dimension of a vector space is the number of vectors in the basis of the vector space. For example, a basis of R^2
typically consists of two vectors, such as (1, 0)
and (0, 1)
, and thus has dimension 2.
These vectors form a basis for R^2
.
In three dimensions, R^3
, a simple basis could be (1, 0, 0)
, (0, 1, 0)
, and (0, 0, 1)
.
Spanning sets
A set of vectors {v1, v2, ..., vn}
is said to be spanned in a vector space V
if every vector in V
can be written as a linear combination of v1, v2, ..., vn
. Spanning sets include definitions and concepts for basis.
Linear independence
Vectors are linearly independent if none of them can be written as a linear combination of the others. This independence is a key concept in defining the dimension of a vector space.
Mathematical representation
For vectors v1, v2, ..., vn
in a vector space, they are linearly independent if the equation:
a1*v1 + a2*v2 + ... + an*vn = 0
It has only the trivial solution where a1 = a2 = ... = an = 0
.
Conclusion
Vector spaces are the cornerstone of linear algebra and are used throughout mathematics and the applied sciences. They provide a formal method for studying linear equations and transformations, providing insight into many real-world problems structured around the structure of space and multi-dimensional quantities.