How fast is a falling stone travelling at a single instant? Average velocity over a time interval is easy — divide distance by duration — but at one instant both quantities are zero, and is undefined. The same tension appears everywhere in calculus: tangent slopes, areas, infinite sums. Each is a limit: the value a quantity approaches as the input approaches a target.
This lesson develops the limit concept precisely enough to prove things about it, then builds the two structural theorems of continuous functions — the Intermediate Value Theorem and the Extreme Value Theorem — that the rest of calculus depends on.
Prerequisites. Inequalities, absolute value, and the completeness of (every nonempty bounded set has a supremum). No derivative or integral machinery is used.
The Formal Definition of a Limit
Intuitively, means we can make arbitrarily close to by making sufficiently close to The obstacle in making this precise is circularity: “sufficiently close” must not depend on the value which may not even exist. The resolution, due to Weierstrass, is to quantify the two tolerances and order them: for every output tolerance there exists an input tolerance — and must be chosen before seeing any particular
Let with and let be a limit point of (every neighborhood of contains points of other than Then
if for every there exists such that for all
Let with and let be a limit point of (every neighborhood of contains points of other than Then
if for every there exists such that for all
Three boundary cases deserve explicit attention:
- The condition excludes . The limit ignores what happens at the point — need not even be defined there. This is exactly what lets tangent slopes and instantaneous velocity make sense.
- ” is a limit point” prevents vacuous truth: if were isolated in some -neighborhood would contain no other and the implication would hold trivially for any
- may depend on (and on but a single must work for all in the window simultaneously — the condition is uniform in
The definition is best internalized as a two-player game. Your opponent picks shrinking the target zone on the -axis; you must respond with a window on the -axis, so that every input from the window (except lands inside the target zone. You win if you have a response to every [Spivak (4th ed.), Ch. 5 “Limits”, §“Delta–Epsilon Proofs”]
Worked Example 1: a linear function
Claim.
Given we must force by bounding Start from the quantity we control:
So whenever Choose Then gives for every at once. The limit is proved.
Concretely: if the opponent demands respond with any within of gives within of
Verification Check
For at with target tolerance : evaluate which proposed values guarantee the bound.
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
Worked Example 2: a nonlinear function
Claim.
Here a variable factor multiplies the quantity we control. The trick is to freeze it. Impose the preliminary restriction then means so Now
Choose Then activates the bound and finishes: for every with
Compare the two proofs. In Example 1 the response was proportional in Example 2 it is not, because the sensitivity of to changes in varies along the window. The further is from the smaller the working for the same — the definition captures local sensitivity, not a global property of the formula.
Verification Check
In proving , evaluate each statement concerning the preliminary bound :
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
The geometry of this game, for the linear example: the horizontal -band around pulls back through the line to a vertical -window around and is the exact threshold.
Move the ε-band
Change ε and watch the corresponding δ-window shrink or expand.
For f(x)=3x−1 at c=2, the δ-window pulls back the ε-band around L=5.
Fundamental Limit Theorems
Computing limits directly from the - definition for every new function would be unusable. The algebra of limits lets us assemble complicated limits from simple ones, provided the pieces exist and the operations are defined.
Suppose and and is a limit point of the relevant domains. Then:
- if additionally then
Suppose and and is a limit point of the relevant domains. Then:
- if additionally then
ProofExpand proofCollapse
We prove the sum rule; the product and quotient rules follow the same pattern with an extra preliminary bound (Problem 1.P.1
Let
- Since there exists such that
- Since there exists such that
- Set For both bounds hold, so the triangle inequality gives:
Thus
The quotient rule’s hypothesis is essential and is the most common source of wrong limits. The classic cannot be evaluated by the quotient rule: and so rule 3 does not apply. The correct value is but it must be proved by squeezing, not by algebra [Spivak (4th ed.), Ch. 15, §“The Derivatives of Trigonometric Functions”]. The algebra of limits never resolves a form; that is precisely the case calculus exists to handle.
Verification Check
A proposed calculation posits and concludes the limit does not exist. Evaluate each claim about this calculation:
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
Let be an open interval containing except possibly at itself. Let be functions defined on If for all
and then:
Let be an open interval containing except possibly at itself. Let be functions defined on If for all
and then:
ProofExpand proofCollapse
Let be given.
- Since there exists such that for all
- Since there exists such that for all
- Choose For all satisfying both inequalities hold simultaneously. Combining with the sandwiching hypothesis
Extracting the outer bounds yields:
This establishes that
The Squeeze Theorem is the standard tool for functions that oscillate too fast to control directly. A classic application: (and similarly Since for all multiplying by yields (or Both bounds tend to as so the middle function does too — regardless of how fast it oscillates inside the envelope. The theorem transfers existence, not rates: it says nothing about how fast approaches
Contrast with a function the squeeze cannot rescue: itself has no limit at — no envelope tighter than is available, and the values cycle through all of in every neighborhood of (see the counterexample below).
Continuity
Continuity formalises “no gaps or jumps” — the input–output contract that makes the two structural theorems below possible.
A function is continuous at a point if:
The function is continuous on an interval if it is continuous at every
A function is continuous at a point if:
The function is continuous on an interval if it is continuous at every
Unpacking the definition: continuity at requires (i) is defined, (ii) exists, and (iii) the two are equal. Each requirement fails in a different, characteristic way, giving a taxonomy of discontinuities:
| Type | Definition failure | Canonical example | Continuous extension possible? |
|---|---|---|---|
| Removable | (i) or (iii): limit exists but is undefined or differs | at (limit or at (limit | Yes: (re)define |
| Jump | (ii): one-sided limits exist but differ | at limits | No |
| Essential | (ii): limit does not exist, even one-sided | at | No |
Sums and products of continuous functions are continuous (transfer the Algebra of Limits termwise); quotients are continuous only where the denominator is nonzero — the quotient-rule hypothesis again.
Counterexample: essential discontinuity
Consider for The limit as does not exist, so no definition of can make continuous — the discontinuity is essential.
Verification Check
Consider on . Evaluate each claim regarding its limiting behavior as :
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
Compare with multiplying the wild factor by tames it enough for the Squeeze Theorem, and the extension is continuous. The boundary between “tameable” and “untameable” oscillation is exactly what a squeeze envelope can control — a distinction that returns when derivatives are defined.
The Intermediate Value Theorem (IVT)
Continuous functions on closed intervals cannot skip values. This is the theorem that guarantees roots exist before we compute them.
Builds on:Definition 1.1.4
If is continuous and is any number between and then there exists at least one such that:
If is continuous and is any number between and then there exists at least one such that:
The proof [Spivak (4th ed.), Ch. 8 “Least Upper Bound”, Theorem 1; Rudin, PMA (3rd ed.), Ch. 4, Thm 4.23] constructs — a set that is nonempty and bounded by completeness — and shows continuity forces exactly. Completeness is not decoration: on the theorem fails is continuous on takes endpoint values and but no rational has square
Both hypotheses are load-bearing:
- Discontinuity: on jumps from to and never takes the value between its endpoint values.
- Endpoint values: the theorem cannot even be stated without — this is where “closed interval” enters.
Verification Check
A continuous function on satisfies and . Evaluate each statement:
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
The IVT also gives a numerical algorithm. If is continuous and have opposite signs, the sign change survives on exactly one half of after bisecting at and that half must contain a root. Repeating halves the error each step: after bisections the root is pinned to within so a tolerance is guaranteed by any [Burden & Faires, Numerical Analysis (9th ed.), §2.1 “The Bisection Method”]
Interactive Lab
Verify the error bound. The loop exits when since the interval starts with length and each pass halves it, after passes the length is and So the printed root is within of a true root of — a claim about the real root, justified by the IVT plus halving arithmetic, not by inspecting the output.
The Extreme Value Theorem (EVT)
Continuity on a closed, bounded interval does more than prevent skipped values — it keeps bounded and forces the bounds to be attained. [Spivak (4th ed.), Ch. 7 “Three Hard Theorems”, Thms 1–2; Rudin, PMA (3rd ed.), Ch. 4, Thms 4.16–4.17]
Builds on:Definition 1.1.4
If is continuous, then attains a maximum and a minimum: there exist points such that
If is continuous, then attains a maximum and a minimum: there exist points such that
The theorem has three hypotheses — continuity, closedness, boundedness of the interval — and each is falsifiable by a concrete counterexample:
- Open or half-open interval fails. on is continuous and bounded but no point attains or even more dramatically, on is continuous on its domain but blows up as so it is not even bounded above (shown below).
- Unbounded interval fails. on is continuous but unbounded above.
- Discontinuity fails. Define on the open part and This is bounded on a closed interval, but its values approach from below without ever attaining it: the jump at the endpoints dodges the supremum, so no maximum exists.
Like the IVT, the EVT is a completeness theorem: its proof [Spivak (4th ed.), Ch. 8; Rudin, PMA, Ch. 4, Thm 4.16] shows the set is bounded and that is a value of — both steps requiring least upper bounds.
Verification Check
For on the open interval , evaluate each statement:
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
The IVT and EVT are complementary guarantees: the IVT says the image has no gaps between attained values, the EVT says the image is bounded and contains its own endpoints. Together they make the image of a compact interval a closed, bounded — and, for the derivative-theorems to come, decisive — object.
Deep Practice
Solve these problems to test and consolidate your understanding of epsilon-delta limits, theorem hypotheses, and continuity contracts. Complete worked solutions and verification criteria are available for each problem.
Exercise 1.1.1: Linear Epsilon-Delta Verification
Prove directly from the formal definition of a limit (Definition 1.1.1
HintExpandCollapse
Compute in terms of first; the constant is eliminated before choosing .
Worked solutionExpandCollapse
Given choose Then gives
Verification criteria. A complete derivation requires: (a) an explicit depending on (b) the implication stated for all with not just one; (c) the chain of equalities ending in a quantity A response that verifies the limit only numerically (e.g., plugging in is invalid.
Exercise 1.1.2: Quadratic Sensitivity and Preliminary Bound
Prove from Definition 1.1.1
HintExpandCollapse
Factor and freeze the variable factor with a preliminary bound , as in Worked Example 2.
Worked solutionExpandCollapse
Given choose If then so and
Verification criteria. Any correct (e.g., is valid; a response of without the preliminary bound is a defect, because was used without justification — that inequality needs A response of is falsifiable: with take then
Exercise 1.1.3: Oscillating Squeeze vs Removable Discontinuity
Define for Show that and state where can be extended continuously. Then contrast: does have a limit at
HintExpandCollapse
Bound by a quantity that ignores the sine, then apply the Squeeze Theorem (Theorem 1.1.3
Worked solutionExpandCollapse
Show squeeze diagram(Click to reveal)
For since for all Both bound functions tend to as so the Squeeze Theorem (Theorem 1.1.3
Verification criteria. Requires: (a) the explicit bound invoked with the squeeze; (b) the conclusion stated for the extended function; (c) a falsifying (any works) for Claiming ” is undefined at so no limit” is a failure: undefinedness at does not preclude a limit.
Exercise 1.1.4: Guaranteed vs Unguaranteed Intermediate Values
A continuous function on satisfies and For each value decide whether the Intermediate Value Theorem (Theorem 1.1.5
HintExpandCollapse
Check each against the hypothesis: is between and ?
Worked solutionExpandCollapse
Show IVT root diagram(Click to reveal)
- (a) Yes: so Theorem 1.1.5guarantees some withTheorem 1.1.5Intermediate Value Theorem (IVT)If is continuous and is any number between and , then there exists at least one such that:
- (b) No: is not between and The IVT is silent — a solution may or may not exist depending on (if none exists).
- (c) Yes — but for a different reason: is attained at the endpoint, not guaranteed inside The IVT as stated locates interior points for values strictly between and endpoint values are already in the image by definition.
Verification criteria. Each part scores independently. For (a): correct yes/no with the hypothesis quoted. For (b): a bare “no” without the reason (” not between the endpoint values”) is incomplete; a “no, because is discontinuous” is a failure is continuous by hypothesis). For (c): distinguishing guaranteed by IVT from true but not via IVT is the transfer step.
Exercise 1.1.5: Fixed-Point Existence via Intermediate Values
Prove, using Theorem 1.1.5
HintExpandCollapse
Turn the fixed-point equation into a root-finding problem: move everything to one side and apply the IVT to the resulting continuous function.
Worked solutionExpandCollapse
Let As a difference of continuous functions and is continuous on At the endpoints: and since So lies strictly between and and Theorem 1.1.5
Verification criteria. Requires: (a) an explicitly defined auxiliary function; (b) a stated continuity argument (sum/difference of continuous functions); (c) strict endpoint signs with justification not ""); (d) the IVT invoked on between the endpoint values. Asserting “since is continuous it has a fixed point” without the sign change is a failure — continuity alone on a non-closed or badly-oriented domain does not give fixed points (compare
Exercise 1.1.6: Continuity of Modified Dirichlet Function
Let be defined by if is rational, and if is irrational. At which points is continuous according to Definition 1.1.4
Verification Check
Let for and for . Evaluate each statement about continuity:
Classify each option as correct or incorrect, or leave uncertain options unanswered (“I don't know”) and verify at any time.
Exercise 1.1.7: Logical Negation of the Limit Definition
Formulate the precise logical negation of Definition 1.1.1
HintExpandCollapse
Flipping '' yields ''. Identify a specific that always violates near .
Worked solutionExpandCollapse
Logical Negation: The statement means: There exists such that for every there exists at least one satisfying:
Application to at with Choose Let be arbitrary. Select Then and so We evaluate the distance: Since this holds for every the condition holds and
Verification criteria. Requires: (a) correct quantifier inversion and the conditional negated to (b) an explicit witness (any (c) an explicit witness point as a function of
References & Further Reading
- Spivak, M. (2008). Calculus (4th ed.). Publish or Perish. — - proofs: Ch. 5 “Limits”, §“Delta–Epsilon Proofs”; algebra of limits: Ch. 5, §“Theorems on Limits”; continuity: Ch. 6 “Continuous Functions”; boundedness/IVT/EVT: Ch. 7 “Three Hard Theorems”, Thms 1–3; completeness proofs of IVT/EVT and uniform continuity (beyond this lesson’s scope): Ch. 8 “Least Upper Bound”.
- Rudin, W. (1976). Principles of Mathematical Analysis (3rd ed.). McGraw-Hill. — limits and continuity: Ch. 4, §“Limits of Functions” and §“Continuous Functions”; sequential criterion for limits (Thm 4.12), EVT (Thms 4.16–4.17), IVT (Thm 4.23), and metric-space/compactness generalizations.
- Burden, R. & Faires, J. (2011). Numerical Analysis (9th ed.). Cengage. §2.1 “The Bisection Method” — error bound and halving convergence.
- Abbott, S. (2015). Understanding Analysis (2nd ed.). Springer. — Ch. 4 “Functional Limits and Continuity”: an alternate development of - limits (§4.2), the squeeze theorem, the IVT (§4.5), the EVT (§4.4), and uniform continuity on compact intervals.