Practice problems bridging the first three lessons. These problems demand proof synthesis, hypothesis auditing, and computational tool use across multiple theorems.
Problem 1.P.1: Algebra of Limits: Bounding the Denominator
Complete the proof of the Algebra of Limits (Theorem 1.1.2
HintExpandCollapse
First pin away from with in the limit definition; the preliminary bound then controls the quotient .
Worked solutionExpandCollapse
Step 1 (pin away from zero). Apply Definition 1.1.1
Step 2 (reciprocal). For
Given choose so that for and set Then throughout, so
Step 3 (quotient). The product rule of Theorem 1.1.2
Verification criteria. A complete proof requires all three steps: the preliminary pin (with explicit), the reciprocal estimate with the constant appearing, and the final composition with the product rule.
Problem 1.P.2: Numerical Epsilon-Delta Neighborhood Check
Complete the verifier below so it checks the - condition numerically. Test inputs: (must pass), and the same with (must fail — the sample points falsify it).
Code Exercise
Complete the Epsilon-Delta check
def verify_limit(f, c, L, epsilon, delta, samples=1000, seed=0): # Check random points in the delta-neighborhood of c (excluding c itself) import numpy as np rng = np.random.default_rng(seed) x_vals = c + rng.uniform(-delta, delta, samples) x_vals = x_vals[x_vals != c] # The condition is: 0 < |x - c| < delta implies |f(x) - L| < epsilon satisfied = np.all( < epsilon) return satisfied
HintExpandCollapse
Inspect the vectorized evaluation in NumPy: the test asserts that all points in the punctured neighborhood satisfy the epsilon inequality.
Worked solutionExpandCollapse
The blank must compute the elementwise absolute deviation np.abs(f(x_vals) - L). Passing verifies that for all points For points near the boundaries or yield deviations causing np.all to return False.
Problem 1.P.3: Quantifier Perturbation: The 'Verconges' Definition
Suppose a mathematician proposes an altered definition of limit: a function is said to verconge to at if: There exists such that for every , for all
Characterize all functions that verconge to at What does this reveal about why the order of quantifiers in Definition 1.1.1
HintExpandCollapse
If for every on a fixed interval, what is the only non-negative number that can satisfy that?
Worked solutionExpandCollapse
Characterization: A function verconges to at if and only if identically on the entire punctured neighborhood .
Proof: Suppose verconges to at so there exists a fixed such that for every the distance for every The only non-negative real number that is strictly less than every positive real number is Therefore, for every in the punctured window, which implies Conversely, if on then holds for all
Significance:
In Definition 1.1.1
Problem 1.P.4: Epsilon-Delta Derivative Existence and Lipschitz Bound
Let
- Using Definition 1.1.1, give a rigorous - proof that at an arbitrary fixedDefinition 1.1.1Limit of a FunctionLet with , and let be a limit point of (every neighborhood of contains points of other than ). Then
- Using Theorem 1.3.2, show that for allTheorem 1.3.2Mean Value Theorem (MVT)Let be a function satisfying: 1. is continuous on . 2. is differentiable on . Then there exists at least one such that:
HintExpandCollapse
Expand , factor out , and freeze the variable factor in the difference quotient with a preliminary bound .
Worked solutionExpandCollapse
Part 1: - proof of the derivative.
For
The difference from the candidate limit is:
Impose the preliminary bound Then by the triangle inequality,
Given choose:
Whenever we have and:
This establishes that directly from Definition 1.1.1
Part 2: Lipschitz bound via MVT.
Let with
By Theorem 1.3.2
Problem 1.P.5: Differentiable Function with Discontinuous Derivative
Define by for and Prove that is differentiable everywhere on but the derivative function is discontinuous at
HintExpandCollapse
Use the limit definition directly at . For , use standard differentiation rules and inspect the limit of as .
Worked solutionExpandCollapse
Differentiability at
By Definition 1.2.1
Derivative for
By Theorem 1.2.3
Discontinuity of at As but oscillates between and in every neighborhood of Therefore, does not exist. Since is discontinuous at
Conclusion: Differentiability guarantees is continuous (Theorem 1.2.2
Problem 1.P.6: The False Proof and Flaw in the Chain Rule
A proposed derivation offers the following proof of Theorem 1.2.4
HintExpandCollapse
What happens if for values of arbitrarily close to ? Can we divide by zero in the difference quotient?
Worked solutionExpandCollapse
The Flaw: The proof divides by However, may be constant in a neighborhood of or worse, oscillate infinitely often such that for points (for instance, For such the fraction is undefined One cannot divide by a quantity that may vanish along the limit sequence.
The Resolution (Carathéodory’s approach): Define the auxiliary difference-quotient slope function on the domain of where Because is differentiable at so is continuous at Notice that holds unconditionally for all even when Now substitute Since is differentiable at it is continuous at so Because is continuous at Multiplying limits: This proof never divides by and works unconditionally for all differentiable functions.
Problem 1.P.7: Central Difference Truncation Error Analysis
Suppose is three times differentiable on an open interval containing with continuous at Complete the numerical central difference formula below and prove using Theorem 1.3.5
Code Exercise
Complete the Numerical Derivative (Central Difference)
def central_difference(f, x, h=1e-5): # Central difference formula provides O(h^2) accuracy compared to forward O(h) return ( - f(x - h)) / (2 * h)
HintExpandCollapse
Rewrite the ratio as and apply L'Hôpital's Rule with respect to three times.
Worked solutionExpandCollapse
Derivation of Truncation Error via L’Hôpital’s Rule: Combine the numerator over the common denominator
- First application of Theorem 1.3.5: As both numerator and denominator approach Differentiating with respect to (using Theorem 1.2.4Theorem 1.3.5LLet and be differentiable on an open interval containing (except possibly at ). If , and for , then:onTheorem 1.2.4The Chain RuleIf is differentiable at , and is differentiable at , then the composite function is differentiable at , and:
- Second application of Theorem 1.3.5: At the numerator is and the denominator is Differentiating with respect to again:Theorem 1.3.5LLet and be differentiable on an open interval containing (except possibly at ). If , and for , then:
- Evaluate via Definition 1.2.1(or a third L’Hôpital step): Thus whereas the one-sided forward difference has first-order errorDefinition 1.2.1The DerivativeLet be defined on an open interval containing . The function is said to be **differentiable** at if the limit
Problem 1.P.8: Carathéodory Equivalence Formulation
Carathéodory’s Theorem states: is differentiable at if and only if there exists a function continuous at such that for all Prove that if such a exists, then
HintExpandCollapse
Take the limit as of and use the continuity of .
Worked solutionExpandCollapse
Proof:
Suppose there exists a function continuous at such that:
For any we can divide by
Now evaluate the limit as using Definition 1.2.1
Problem 1.P.9: Second-Order Remainder Bound via Cauchy Mean Value Theorem
Let be twice differentiable on and let be the linear approximation at Prove that for any there exists such that:
HintExpandCollapse
Apply Cauchy's Mean Value Theorem to and on .
Worked solutionExpandCollapse
Define two auxiliary functions on
Evaluate at
and
Evaluate at
and
Now differentiate with respect to
Note that for
By Cauchy’s Mean Value Theorem (Theorem 1.3.4
Problem 1.P.10: Circular Reasoning in Differentiation of Sine
Explain why using Theorem 1.3.5
HintExpandCollapse
How is the derivative of proved in the first place? Inspect the difference quotient of sine.
Worked solutionExpandCollapse
The Circularity:
To apply Theorem 1.3.5
Problem 1.P.11: Failure of Equality in Vector-Valued MVT
Let be given by Explain why there is no point satisfying What inequality replaces the MVT in higher dimensions?
HintExpandCollapse
Compute the secant vector and the velocity vector .
Worked solutionExpandCollapse
- The secant vector is:
- The derivative vector is
- Its Euclidean norm is:
- Since the velocity vector is everywhere of length it is never equal to the zero vector Thus no such exists.
- In vector and multivariable analysis, equality is replaced by the Mean Value Inequality:
Problem 1.P.12: The Open Interval Hypothesis and Disconnected Domains
In Corollary 1.3.3
HintExpandCollapse
Consider a domain that consists of two disjoint intervals, such as .
Worked solutionExpandCollapse
Construction: Let the domain be Define by:
- On is constant, so
- On is constant, so Thus for all However, is not constant on
Why Corollary 1.3.3
Problem 1.P.13: Rigorous Proof of L'Hôpital's Rule for the 0/0 Form
Assume and are differentiable on with and Assume further that Prove that
HintExpandCollapse
Extend and continuously to by defining , then apply Cauchy's Mean Value Theorem on .
Worked solutionExpandCollapse
Extend and to by defining and
Since and both functions are continuous on for every
Both functions are differentiable on and on
By Rolle’s Theorem, (otherwise would vanish).
By Cauchy’s Mean Value Theorem (Theorem 1.3.4
Problem 1.P.14: Root Interlacing Between Function and Derivative
Let be twice differentiable.
- Prove that between any two real roots of there exists at least one real root of
- Deduce that if for all then can have at most two real roots.
HintExpandCollapse
Apply Rolle's Theorem to consecutive roots of , then examine monotonicity of from the sign of .
Worked solutionExpandCollapse
Part 1: Interlacing of roots.
Let be two distinct real roots of so
Since is differentiable on it is continuous on and differentiable on
By Rolle’s Theorem (Theorem 1.3.1
Part 2: Bound on number of roots. Suppose for contradiction that has three or more distinct roots By Part 1, there exists with and there exists with Since we have Now apply Rolle’s Theorem to on since is continuous on and differentiable on with there exists such that: However, the hypothesis states that for all This contradiction proves that cannot have three or more roots; it can have at most two real roots.
References & Further Reading
- Michael Spivak (2008). Calculus (4th ed.), Chapters 5, 9, 11. Publish or Perish.
- Walter Rudin (1976). Principles of Mathematical Analysis (3rd ed.), Chapters 4 and 5. McGraw-Hill.
- Stephen Abbott (2015). Understanding Analysis (2nd ed.), Chapters 4 and 5. Springer.