2.3. The Principle of Induction | IRA |
Definition 2.3.1: Ordered and Well-Ordered Set A set S is called partially ordered if there exists a relation r (usually denoted by the symbol ) between S and itself such that the following conditions are satisfied:
- reflexive: a
a for any element a in S
- transitive: if a
b and b
c then a
c
- anti-symmetric: if a
b and b
a then a = b
A set S is called ordered if it is partially ordered and every pair of elements x and y from the set S can be compared with each other via the partial ordering relation.
A set S is called well-ordered if it is an ordered set for which every non-empty subset contains a smallest element.
Examples 2.3.2:
Determine which of the following sets and their ordering relations are partially ordered, ordered, or well-ordered:
- S is any set. Define a
b if a = b
- S is any set, and P(S) the power set of S. Define A
B if A
B
- S is the set of real numbers between [0, 1]. Define a
b if a is less than or equal to b (i.e. the 'usual' interpretation of the symbol
)
- S is the set of real numbers between [0, 1]. Define a
b if a is greater than or equal to b.
Which of the following sets are well-ordered ?
- The number systems N, Z, Q, or R ?
- The set of all rational numbers in [0, 1] ?
- The set of positive rational numbers whose denominator equals 3 ?
Theorem 2.3.3: Induction Principle Let S be a well-ordered set with the additional property that every element except for the smallest one has an immediate predecessor. Then: if Q is a property such that: Then the property Q holds for every element in S
- the smallest element of S has the property Q
- if s
S has property Q then the successor of s also has property Q
Recall the this is very similar to parts of the Peano Axioms, and it is easy to see that the principle of induction applies to the well-ordered set of natural numbers.
To use the principle of induction for the natural numbers one has to proceed in four steps:
Before stating a theorem whose proof is based on the induction principle, we should find out why the additional property that every element except the smallest one must have an immediate predecessor is necessary for the induction principle:
Examples 2.3.4:
A somewhat more complicated, but very useful theorem that can be proved by induction is the binomial theorem:
Example 2.3.5:
The set of natural numbers, with the usual ordering, is well-ordered, and in addition every element except of 1 has an immediate predecessor. Now impose a different ordering labeled << on the natural numbers:
Is the set of natural numbers, together with this new ordering << well-ordered ? Does it have the property that every element has an immediate predecessor ?
- if n and m are both even, then define n << m if n < m
- if n and m are both odd, then define n << m if n < m
- if n is even and m is odd, we always define n << m
Suppose the induction principle defined above does not contain the assumption that every element except for the smallest has an immediate predecessor. Then show that it could be proved that every natural number must be even (which is, of course, not true so the additional assumption on the induction principle is necessary).
Theorem 2.3.6: Binomial Theorem Let a and b be real numbers, and n a natural number. Then:
![]()
Based on the Induction principle is the principle of Recursive Definition that is used frequently in computer science.
Definition 2.3.7: Recursive Definition Let S be a set. If we define a function h from N to S as follows: Then this construction determines a unique function h from N to S.
- h(1) is a uniquely defined element of S
- h(n) is defined via a formula that involves at most terms h(j) for 0 < j < n
When first encountering proofs by induction, it seems that anything can be proved. It is hard, in fact almost impossible, to find out why a particular property should be true when looking at an induction proof, and therefore, one might use induction to prove anything (Incidentally, such proofs are often called non-constructive proofs).
Examples 2.3.8:
Here is a more elaborate example of an invalid induction proof:
Exercise 2.3.9:
"Proof"
Example 2.3.10:
- All birds are of the same color.
To conclude, let's prove two more 'theorems' via induction:
Example 2.3.11:
Examples 2.3.12: Sum of Squares and Cubes Prove the following statements via induction:
- The sum of the first n numbers is equal to
![]()
- The sum of the first n square numbers is equal to
![]()
- The sum of the first n cubic numbers is equal to
![]()