21 Sequences
In the previous chapter on calculus we began the discussion of sequences but we were not able to cover sequences convergence and divergence at the time. We will cover that here, as well recall that a sequence is an ordered set of terms, lets denote them , for all . Now in calculus we mentioned the idea of convergence of a sequence but we did not define it. Below we are given the formal definition as it is provided in analysis [18].
Definition.
A sequence of real numbers converges to a limit , written
if for every there exists such that
It should also be noted that any sequence that does not converge, diverges, as the formal definition has been omitted.
If we want to analyze this definition, we already know that if a sequence is converging it is converging to a point . In this formal definition we now can see that this point can be calculated by taking the limit as goes to infinity of the sequence. This is possible only if the limit point is within a range such that the absolute valued difference between a term in the sequence and the limit point is less than some value, denoted by , greater than 0.
Now we need to provide a definition of in order to fully comprehend convergence.
Definition.
Epsilon, denoted is a positive, infinitesimal quantity whose limit is usually taken as [39].
So when we tie this into our convergence definition for sequences the absolute valued difference of a term in the sequence and the limit point should be less than which should be decreasing to 0. This means that the difference should be getting smaller as such that .
Now that we have a good understanding of convergences for sequences lets look at monotonically increasing and monotonically decreasing sequences and their convergence as well as sub-sequences and convergence in the following subsections.
18.1 Monotone and Cauchy Sequences
In an analysis course we are asked to look past calculated results to patterns and be able to categorize functions based on those patterns. With sequences we can look at the pattern of the terms to describe if a sequence is monotone or not and if so, is the sequence monotonically increasing or monotonically decreasing.
A sequence is considered to be monotonically increasing if the the terms, defined as follow the relationship for all [2]. This means that the sequence is strictly increasing, every term is equal to or larger than the one previous.
We also have a monotonically decreasing sequence which is defined as a sequence with terms following the relationship of for all . This means that the sequence is strictly decreasing, every term is smaller than or equal to the term previous. Lets look at an example.
Example:
Consider the sequence for all . Let for be arbitrary, then . If we take the square root of both sides we get which simplifies to thus we can conclude that the sequence is monotonically increasing.
We briefly discussed the Axiom of Completeness in an earlier section which introduced the idea of bounded sets. Let us consider that sequences can be bounded, as well, either by a lower bound, an upper bound, or both.
Definition. Lower Bound
A sequence is said to contain a lower bound if [3].
Definition. Upper Bound
A sequence is said to contain an upper bound if [3].
We include these definitions because sequences can be bounded which means a sequence has both an upper and lower bound, . This bounded property leads us to our theorem for monotone convergence [3].
Theorem: The Monotone Convergence Theorem
If a sequence is monotone and bounded, then it converges.
This is quite straight forward and easy to apply for sequences that qualify. It should be noted that not every sequence is monotone, a perfect example of a sequence that is not monotone is an alternating sequence. Lets analyze an example.
Example:
Consider the sequence here we have a sequence whose every other term will be negative and the pattern of the sequence is a rotation of negatives and positives for every other term, this fails the definition for a monotonic sequences.
This does not mean that in analysis we just consider these sequences to be non-monotonic and toss them to the side. There is a large focus on non-monotone sequences and in real analysis courses we include this focus under the Cauchy sequence.
Definition. Cauchy Sequence
A sequence can be called Cauchy if, given , there exists such that if then .
To summarize, a Cauchy sequence is such that the terms of the sequence become arbitrarily close together, so much so that the difference is less than a value of that will continue to approach 0 as the space between terms grows smaller. Lets look at an example that is not monotone.
Example:
Consider the sequence
The first few values of the sequence are as follows:
The sequence is Cauchy because it is converging to 0, which can tell because the denominator is growing larger than the numerator. The sequence is not monotone because it is neither increasing nor decreasing exclusively, given that the term changes between negative and positive values.
Continuing on our discussion of Cauchy sequences there are a few properties to keep in mind. Any sequence that converges is a Cauchy sequence and is therefore a bounded sequence. There is also a theorem known as the Cauchy criterion which states the following.
Theorem: The Cauchy Criterion
A sequence converges if and only if it is a Cauchy Sequence
Although this theorem seems very exclusive for sequences it is one of the most inclusive sequences for determining convergence. Consider that monotone convergence relies on the fact that the sequence is monotone and bounded where as Cauchy sequences include convergent sequences that fail to be monotone as well as including monotone sequences.
We also discussed earlier the idea of closed sets and how closed sets contain all of their limit points. Since Cauchy sequences are any sequence that converges to a limit point, then we must introduce the following property [3].
Theorem: Properties of Limit Points
A point is a limit point of a set if anf only if there exists a sequence contained in A with for all , and .
We will discuss limits more later but including this property now is necessary to help understand the example we are about to look at for Cauchy sequences which brings together our understanding of closed sets, Cauchy sequences, and limit points.
Example:
Prove that a set is closed if and only if every Cauchy sequence contained in has a limit that is also an element of [3].
Proof: Consider that every Cauchy sequence in has a limit that is also an element of . If is closed then all the limit points of are contained within the . Let represents a limit that is contained in . If we have the Cauchy sequence in and it converges to then is an element of . Let us assume that then does not converge to for any since is closed. By The Properties of Limit Points is a limit point of and is therefore an element of . This is a contradiction so we conclude that .
Now consider that every Cauchy sequence in has a limit also in , then by The Proporties of Limit Points and thus the limits of the Cauchy sequences are in . If we let be an arbitrary limit of then there is a sequence such that but which converges to then we say that this sequence is Cauchy and since and are in then we conclude that is closed.
This is a great problem to consider as it tests the properties of closed sets and Cauchy sequences as well as our understanding of limits and how sequences converge to limit points which may or may not fall within a set, depending on the set properties. We can also utilize our understanding of convergence and limit points to prove sets are open or closed depending on the type of sequence contained within them.
Mastering convergence is vital to success in an analysis course and with this in mind we now move on to the next subsection which will break down convergence and the idea of sub-sequences.
18.2 Subsequences and Convergence
We already know that limits determine if terms of a sequence converge to a real number, or diverge which means the limit of the sequence is either or and we used this knowledge to study Cauchy sequences. Now, we will look at sub-sequences and how convergence can be derived from their associated properties.
We begin by looking at the formal definition for a sub-sequence.
Definition.
Let be a sequence of real numbers, and is a sequence of natural numbers where , then the sequence is a sub-sequence of [40].
Recall from our discussion on sets, that a we defined a subset as a set whose elements are also elements of another set. The same idea holds for sub-sequences, if we have a monotonically increasing sequence for which every term is a term in a larger sequence containing more terms then we can say that this sequence is a sub-sequence.
Let’s now consider some theorems that help us understand sub-sequences and their relation to a sequence [3].
Theorem:
Let be a convergent sequence with limit point , then every sub-sequence converges to limit point as well.
What this theorem tells us is that all sub-sequences under a convergent sequence, must also converge to the same limit as the limit of convergent sequence. This leads us into the next theorem for the relationship between sequences and sub-sequences [3].
Theorem: The Bolzano-Weierstrass Theorem
Every bounded sequence has a convergent sub-sequence.
This theorem is extremely useful because not every bounded sequence is convergent but by the Bolzano-Weierstrass does tell us some part of the sequence, a sub-sequence, does converge even if the sequence itself does not.
We could go further and address more theorems and more relationships between sub-sequences and sequences but we will end the discussion here and move on to the final section of real analysis that will grow our understanding of limits past what we know from calculus as well as what we have gained from limits and convergence.