3

I don't understand induction. I first describe what I know and then I ask a set of conceptual questions.

From Terence Tao's Analysis I book (3rd edition), we have the following description of mathematical induction:

Axiom 2.5 (Principle of mathematical induction). Let $P (n)$ be any property pertaining to a natural number $n$. Suppose that $P (0)$ is true, and suppose that whenever $P (n)$ is true, $P (n+1)$ is also true. Then $P (n)$ is true for every natural number $n$.

To put it formally:

$$(P(0) \; \wedge\; \forall k {\in} \mathbb{N}(P(k) \implies P(k + 1))) \implies \forall n {\in} \mathbb{N}(P(n)).$$

When I use induction, I do the following: I show that the base case $P(0)$ holds. I proceed to an inductive assumption: $\forall k {\in} \mathbb{N}(P(k))$ is true. I then realize I cannot assume that $\forall k {\in} \mathbb{N}(P(k))$ since this is precisely what needs to be proved, however this is not a problem since analysing the formal logical statement of mathematical induction shows that it does not matter whether our inductive assumption is false or true:

  1. If $\forall k {\in} \mathbb{N}(P(k))$ is false, then the implication $\forall k {\in} \mathbb{N}(P(k) \implies P(k + 1))$ is true, and, therefore, once $P(0)$ is true, the whole hypothesis $P(0) \; \wedge\; \forall k {\in} \mathbb{N}(P(k) \implies P(k + 1)$ is true, and, therefore, we obtain that $\forall n {\in} \mathbb{N}(P(n))$ is true, as desired.

  2. If $\forall k {\in} \mathbb{N}(P(k))$ is true, then we show that $\forall k {\in} \mathbb{N}(P(k + 1))$ is true. Once this has been shown, the implication is true, and once $P(0)$ is true, we obtain that $\forall n {\in} \mathbb{N}(P(n))$, as desired.

This closes induction.

Here's what I'm struggling with:

  1. Consider case $1$ above. We have that $\forall k {\in} \mathbb{N}(P(k))$ is false and $\forall n {\in} \mathbb{N}(P(n))$ is true, which is a contradiction. Where am I wrong in my reasoning?
  2. Some authors express induction formally as $$(P(0) \; \wedge\; \exists k {\in} \mathbb{N}(P(k) \implies P(k + 1))) \implies \forall n {\in} \mathbb{N}(P(n)).$$ a) Is this correct? b) If this is correct, why do we have two inequivalent statements for one concept? c) And if this is correct, which statement should I use: with a universal quantifier or with an existential quantifier?
ryang
  • 44,428
  • " I then realize I cannot assume that..." An assumption is an assumption and not necessarily true (see proof by contradiction for a different example). We do not prove $A(k+1)$ "absolutely" but we prove: "IF $A(k)$ holds, then also $A(k+1)$ will hold." This allows us to conclude correctly because we have a sort of "infinite" Modus Ponens: $A(0)$ is ok; then using $A(k) \to A(k+1)$ with $k=0$ we prove $A(1)$. Then, using $A(1)$ and $k=1$... More details in the linked post. – Mauro ALLEGRANZA Sep 27 '24 at 08:32
  • 2
    But the mistake is "suppose that A(k) is true for every k". No, this is circular: we suppose that A(k) is true for a "generic" k and we derive that it holds for k+1. If the derivation is correct, then we can generalize to every k. – Mauro ALLEGRANZA Sep 27 '24 at 08:44
  • 1
    If all $A(k)$ are false, how can $A(0)$ be true? –  Sep 27 '24 at 08:50
  • 1
    "Some authors use...": no, this can't be. –  Sep 27 '24 at 08:52
  • In mathematics, you will virtually never see a statement like $\exists x(P(x)\to Q(x))$. This is just an obfuscated way of saying that there is an $x$ such that $P(x)$ is false, or there is an $x$ such that $Q(x)$ is true. – Joe Sep 27 '24 at 20:09
  • 1
    This question is similar to: Mathematical Induction and implication. If you believe it’s different, please [edit] the question, make it clear how it’s different and/or how the answers on that question are not helpful for your problem. – Another User Sep 28 '24 at 08:03
  • @YvesDaoust The OP wrote it is false that ∀k∈N P(k) rather than ∀k∈N, it is false that P(k). The former is consistent with P(0) being true, whilst the latter (what you misread the OP to have written) certainly contradicts P(0). – ryang Sep 28 '24 at 13:18

1 Answers1

14

This is a very good question, because these are all common misconceptions, and I probably had the same questions as a student.

Let $P (n)$ be any property pertaining to a natural number $n$.

To put it formally:

$$\Big(P(0) \; \wedge\; \forall k {\in} \mathbb{N}\,\big(P(k) \implies P(k + 1)\big)\Big) \implies \forall n {\in} \mathbb{N}\:P(n).$$

Yes.

I proceed to an inductive assumption: $\forall k {\in} \mathbb{N}\,P(k)$ is true.

No: assuming $\forall k {\in} \mathbb{N}\, P(k)$ is equivalent to assuming $\forall n {\in} \mathbb{N}\, A(n),$ begging the question (circular reasoning)! Rather, in the induction hypothesis, $k$ is just an arbitrary natural number; at this point, we haven't invoked Universal Generalisation yet.

If $\forall k {\in} \mathbb{N}\,P(k)$ is true, then we show that $\forall k {\in} \mathbb{N}\,P(k + 1)$ is true.

No, the induction step is showing not $$\Big(\forall k {\in} \mathbb{N}\;P(k)\Big) \implies \Big(\forall k {\in} \mathbb{N}\;P(k + 1)\Big),$$ but $$\forall k {\in} \mathbb{N}\,\big(P(k) \implies P(k + 1)\big),$$ here finally introducing the universal quantifier, thereby discharging the arbitrary constant (akin to eventually discharging every provisional assumption in a proof). For absolute clarity, instead of recycling the induction hypothesis's arbitrary constant $\boldsymbol k$ as the induction-step's conclusion's dummy variable, it may be more elucidating to write $$\forall \boldsymbol m {\in} \mathbb{N}\,\big(P(\boldsymbol m) \implies P(\boldsymbol m + 1)\big),$$ or even $$\forall \boldsymbol n {\in} \mathbb{N}\,\big(P(\boldsymbol n) \implies P(\boldsymbol n + 1)\big),$$ instead.

Some authors express induction formally as $$\Big(P(0) \; \wedge\; \exists k {\in} \mathbb{N}\,\big(P(k) \implies P(k + 1)\big)\Big) \implies \forall n {\in} \mathbb{N}\:P(n).$$

Incorrect (and not even mathematically true). Unfortunately, many authors write the induction hypothesis as “Suppose that $P(k)$ for some natural number $k\text”,$ which, although not definitively wrong, is potentially misleading or confusing.

Better: “Suppose that $P(k)$ for some arbitrary natural number $k.\text”$

Best: “Suppose that $P(k)$ for an arbitrary natural number $k.\text”$

Incidentally, the abovementioned misconception that the induction hypothesis is $\forall k {\in} \mathbb{N}\, P(k)$ may be due partly to the egregious phrasing “Suppose that $P(k)$ for any natural number $k\text”,$ whose meaning is at best ambiguous. It can be improved as “Take any (even better: take an arbitrary) natural number $k,$ and suppose that $P(k).\text”$

In any case, the statement $\exists k {\in} \mathbb{N}\,\Big(P(k) \implies P(k + 1)\Big)$ actually means that some natural number $k$ either satisfies $P(k+1)$ or fails to satisfy $P(k);$ clearly, this is weaker than what the induction step shows.


Reply to comments

Why is not this circular reasoning: “suppose $P(k)$ for an arbitrary $k\text”?$ What is the reason behind this supposition?

First, click on the first link above. To explain it another way: if, for an arbitrary element $k$ of a set $S,$ we have subsequently derived the result $(P(k)\Rightarrow P(k+1)),$ then, since $\boldsymbol k$ has no special feature besides being $\boldsymbol {S'}\textbf s$ member (by the definition of $k$ being an arbitrary element of $S),$ we can conclude that $(P(n)\Rightarrow P(n+1))$ is actually true for every member of $S,$ in other words, that $\forall n{\in}S\,(P(n)\Rightarrow P(n+1))$ or, equivalently, $\forall k{\in}S\,(P(k)\Rightarrow P(k+1)).$

To be clear: as an arbitrary constant, $k$ has an arbitrarily fixed value for each iteration of the induction step, in which it doesn't alternately carry different values.

to finally clarify, am I right that it does not matter whether $P(k)$ is true or false for a particular but arbitrarily chosen $k∈\mathbb N,$ since even if $P(k)$ is false the implication follows vacuously?

Yes.

The formalisation at the top of this post shows that mathematical induction proofs are logically valid; thus, if the two premises of an induction proof have been proven true—that is, if its base case has been proven and its induction step has successfully reached its desired conclusion—then it is a sound argument, which entails that its conclusion $\forall n\,P(n)$ must be true.

ryang
  • 44,428
  • 4
    Excellent answer! Yes, the crucial distinction is between $\forall k \ P(k) \to \forall k \ P(k+1)$ and $\forall k (P(k) \to P(k+1))$ .. many beginning students fail to understand the difference, and thus think induction is circular. You put this very well, and I did not think the answers in the earlier linked question did so, so I reopened. – Bram28 Sep 27 '24 at 20:01
  • Why is not this circular reasoning: suppose $P(k)$ for an arbitrary $k$? At this point, I've shown that only $P(0)$ holds. What is the reason behind this supposition? – Vlad Mikheenko Sep 28 '24 at 06:56
  • @VladMikheenko Okay, I've added an addendum. – ryang Sep 28 '24 at 09:55
  • @ryang, to finally clarify, am I right that it does not matter whether $P(k)$ is true or false for a particular but arbitrary chosen $k \in \mathbb{N}$ since if $P(k)$ is false, then the implication follows and if it is true, then the implication follows since we've shown that $P(k + 1)$ is true. – Vlad Mikheenko Sep 28 '24 at 10:10
  • 1
    @VladMikheenko Okay, I've expanded the addendum. – ryang Sep 28 '24 at 10:30
  • Please keep edits to a minimum. – Shaun Sep 28 '24 at 13:14
  • @VladMikheenko Say we want to prove that $P(\boldsymbol n)$ is true for every natural $\boldsymbol n,$ and our induction step has been using the arbitrary constant $\boldsymbol k.$ I've since added a paragraph to suggest that $∀\boldsymbol m∈N(P(\boldsymbol m)⟹P(\boldsymbol m+1))$ and $∀\boldsymbol n∈N(P(\boldsymbol n)⟹P(\boldsymbol n+1))$ are helpful (in fact, more technically correct) alternative ways to finish up the induction step, reminding us that $k$ is an arbitrary constant and that the induction hypothesis has really never been $∀k,P(k).$ – ryang Sep 30 '24 at 04:31
  • Since this answer is rather long, I'd like to emphasize the small part that I think is the root of OP's confusion: $\forall k,(P(k)\to P(k+1))$ is not logically equivalent to $(\forall k,P(k))\to(\forall k,P(k+1))$. The former is part of what needs to be verified in order to apply the induction principle; the latter is what got OP to assume $\forall k,P(k)$. There is no reason to think (or even dream) about $\forall k,P(k)$ when verifying $\forall k,(P(k)\to P(k+1))$. – Andreas Blass Nov 02 '24 at 18:12