Return to computing page for the first course APMA0330
Return to computing page for the second course APMA0340
Return to computing page for the fourth course APMA0360
Return to Mathematica tutorial for the first course APMA0330
Return to Mathematica tutorial for the second course APMA0340
Return to Mathematica tutorial for the fourth course APMA0360
Return to the main page for the course APMA0330
Return to the main page for the course APMA0340
Return to the main page for the course APMA0360
Introduction to Linear Algebra with Mathematica

Preface


 

Fourier transform in 𝔏²

Before start working on Fourier transform in the Hilbert space 𝔏², we need a very important inequality that was first proved by Viktor Bunyakovsky in 1859. Thirty years later, Hermann Schwarz in his work on minimal surfaces and variational calculus led him to this inequality. A historical overview of the most fundamental mathematical inequality is given in Kichenassamy's article.

It is a custom to refer a discrete version of this inequality as Cauchy inequality and call its integral version as Bunyakovsky's inequality. When formulated in abstract Hilbert space, the inequality is named after three mathematicians: Cauchy--Bunyakovsky--Schwarz or just CBS inequality. We formulate Bunyakovsky's inequality for real-valued functions; however, it can be extended on complex case without a problem.

Lemma 1 (Bunyakovsky inequality): Let f,g : (𝑎, b) → ℝ be two square–integrable functions on some interval (𝑎, b), finite or not. If their product f·g belongs to 𝔏¹(𝑎, b), then \[ \left( \int _a^b f(x)\, g(x)\, {\text d}x\right) ^2\; \leq \; \left( \int _a^b f(x)^2\, {\text d}x\right) \left( \int _a^bg(x)^2\, {\text d}x\right) . \] Equality holds if and only if f and g are linearly dependent in 𝔏²[𝑎, b], i.e. there exists a constant λ such that f(x) = λ g(x) almost everywhere on [𝑎, b].
Assume first that f and g are real-valued and not both identically zero. For any real parameter λ, consider the integral of the square \( \displaystyle \quad \left( f - \lambda\, g \right)^2 . \quad \) Expanding the square under the integral sign gives \[ \int_a^b \left( f(x) - \lambda\, g(x) \right)^2 {\text d}x = \int_a^b \left( f^2 (x) - 2\lambda\,f(x)\,g(x) + g^2 (x) \right) {\text d}x . \] By linearity of the integral, this becomes \[ \int_a^b f(x)^2\, {\text d}x\; -\; 2\lambda \int_a^b f(x)\,g(x)\, {\text d}x\; +\; \lambda ^2\int_a^b g(x)^2\, {\text d}x\; \geq \; 0. \] Introduce the abbreviations \[ A=\int _a^bg(x)^2\, {\text d}x,\quad B=\int _a^bf(x)g(x)\, {\text d}x,\quad C=\int _a^bf(x)^2\, {\text d}x. \] Then the inequality above reads \[ A\lambda ^2-2B\lambda +C\; \geq \; 0\quad \mathrm{for\ all\ }\lambda \in \mathbb{R}. \] This is a quadratic polynomial in λ. A real quadratic polynomial Aλ² - 2Bλ + C with A ≥ 0 is nonnegative for all λ if and only if its discriminant is nonpositive: \[ (-2B)^2-4AC\; \leq \; 0\quad \Longleftrightarrow \quad 4B^2-4AC\; \leq \; 0\quad \Longleftrightarrow \quad B^2\; \leq \; AC. \] Substituting back the definitions of A,B,C, we obtain \[ \left( \int _a^bf(x)g(x)\, {\text d}x\right) ^2\; \leq \; \left( \int _a^bf(x)^2\, {\text d}x\right) \left( \int _a^bg(x)^2\, {\text d}x\right) , \] which is precisely Bunyakovsky’s inequality.

Equality case: From the argument above, equality holds if and only if the discriminant is zero and the quadratic form \[ A\lambda ^2-2B\lambda +C \] has a unique real root λ₀. Since the integrand is nonnegative, the integral can vanish only if \[ f(x)-\lambda_0 g(x) = 0\quad \mathrm{for\ almost\ every\ }x\in [a,b], \] i.e., f and g are linearly dependent in 𝔏²[𝑎, b].

Bunyakovsky's inequality is naturally extended for inner-product-spaces (conceptual view). In the space 𝔏²[𝑎, b] of square–integrable functions, define a real inner product as \( \displaystyle \quad \langle f, g \rangle = \int f(x)\,g(x)\,{\text d}x . \quad \) Then Bunyakovsky’s inequality becomes exactly the Cauchy–Schwarz inequality in this inner product space: \[ |\langle f,g\rangle |\leq \| f\| \, \| g\| . \] The real-variable proof above is the standard direct proof of Cauchy–Schwarz specialized to this integral inner product.

The interval [𝑎, b] does not need to be finite. Bunyakovsky (Cauchy–Schwarz) holds on any measure space, including infinite intervals such as (-∞, ∞). What is essential is that the functions belong to 𝔏², i.e., their squares are integrable over the domain.

General form of the inequality: Let (X, 𝔐, μ) be any measure space. For any real (or complex) functions \( \displaystyle \quad f,g\in 𝔏^2(X), \quad \) the Bunyakovsky (Cauchy–Schwarz) inequality states: \[ \left| \int _Xf(x)\, g(x)\, d\mu (x)\right| \; \leq \; \left( \int _X|f(x)|^2\, d\mu (x)\right) ^{1/2}\left( \int _X|g(x)|^2\, d\mu (x)\right) ^{1/2}. \] This formulation does not require that X have finite measure.

Why finiteness of [𝑎, b] is irrelevant? The classical textbook statement uses [𝑎, b] simply because:

  • it is the most familiar setting,
  • continuity implies square-integrability on a compact interval.
But the proof itself uses only:
  • the integral of a square is nonnegative,
  • linearity of the integral,
  • the discriminant argument for a quadratic polynomial.
None of these depend on the size of the interval. The only essential hypotheses are:
  • f,g must be square integrable: \[ \int _X|f|^2<\infty ,\qquad \int _X|g|^2<\infty . \]
  • The integral \( \displaystyle \quad \int_X fg \quad \) must be well-defined (which follows automatically from Hölder or from the inequality itself once f,g ∈ 𝔏²).

    Thus, the inequality holds on:

    • [𝑎, b] finite or infinite,
    • (0, ∞),
    • n,
    • any σ-finite measure space,
    • any Hilbert space with an inner product.
   
Example 1: Let us consider an infinite interval (−&unfin;, ∞) and two functions \[ f(x) = e^{-x^2} \quad\mbox{and} \quad g(x) = \frac{1}{1+x^2}, \] both belong to 𝔏²(ℝ). Then \[ \int _{-\infty }^{\infty }f(x)g(x)\, {\text d}x = \int _{-\infty }^{\infty }\frac{e^{-x^2}}{1 + x^2}\, {\text d}x = e\pi\,\mbox{erfc}(1) = e\pi\,\frac{2}{\sqrt{\pi}} \int_1^{\infty} e^{-u^2}{\text d}u \approx 1.34329 , \]
Integrate[Exp[-x^2]/(1 + x^2), {x, -Infinity, Infinity}]
E \[Pi] Erfc[1]
and \[ \int_{-\infty}^{\infty } f(x)^2 {\text d}x = \int_{-\infty}^{\infty } e^{-x^4} {\text d}x = 2\,\Gamma\left( \frac{5}{4} \right) \approx 1.8128 , \]
Integrate[Exp[-x^4], {x, -Infinity, Infinity}]
2 Gamma[5/4]
\[ \int_{-\infty}^{\infty } g(x)^2 {\text d}x = \int_{-\infty}^{\infty } \frac{{\text d}x}{\left( 1 + x^2 \right)^2} = \frac{\pi}{2} \approx 1.5708 . \]
Integrate[1/(1 + x^2)^2, {x, -Infinity, Infinity}]
\[Pi]/2
\[ 1.34329 \approx \left| \int _{-\infty }^{\infty }f(x)g(x)\, {\text d}x\right| \leq \left( \int _{-\infty }^{\infty }e^{-2x^2}\, {\text d}x\right) ^{1/2}\left( \int _{-\infty }^{\infty }\frac{{\text d}x}{(1+x^2)^2}\right) ^{1/2} \approx \sqrt{1.8128 \cdot 1.5708} \approx 1.68747 . \] The domain is infinite, but Bunyakovsky’s inequality holds perfectly.    ■
End of Example 1

Suppose that function f belongs to Hilbert space 𝔏²(ℝ). Therefore, function f is an element of vector space 𝔏²([−N, N]) for any N > 0. Applying Bunyakovsky's inequality to the integral over finite interval [−N, N], we obtain

\[ \int_{-N}^N \left\vert f(x) \right\vert {\text d} x \leqslant \left( \int_{-N}^N {\text d}x \ \int_{-N}^N \left\vert f(x) \right\vert^2 {\text d} x \right)^{1/2} < \infty . \]
This inequality shows that function f also belongs to class 𝔏¹(−N, N). Let us define function fN by
\[ f_N (x) = \begin{cases} f(x) , &\quad \mbox{for }\ |x| \le N , \\ 0. &\quad \mbox{when } \ |x| > N . \end{cases} \]
This function belongs to the space 𝔏¹, so its Fourier transform exits and equal
\[ \hat{f}_N = \int_{-\infty}^{\infty} f_N (x)\, e^{-{\bf j}\xi x} {\text d}x = \int_{-N}^{N} f (x)\, e^{-{\bf j}\xi x} {\text d}x . \]
It could hapen that the sequence \( \displaystyle \quad \left\{ \hat{f}_N \right\} \ \) does not converge when N %rarr; ∞. That is, integral
\[ \mbox{V.P.} \int_{-\infty}^{\infty} f (x)\, e^{-{\bf j}\xi x} {\text d}x \]
diverges. However, we are going to show that the inetgral Fourier for functio f ∈ 𝔏²(ℝ) converges in mean square:
\[ \hat{f}(\xi ) = \underset{n\to\infty}{\mbox{l.i.m.}} \, \mbox{V.P.} \int_{-\infty}^{\infty} f (x)\, e^{-{\bf j}\xi x} {\text d}x . \]
This limit is the Fourier transform of function f ∈ 𝔏² by definition. So the Fourier operator ℱ : 𝔏²(ℝ) → 𝔏²(ℝ).
Lemma 2: If functions f(x) and G(ξ) = ℱ[g] are absolutely integrable, then the following identity holds: \[ 2\pi\,\langle f , g \rangle = \langle \hat{f} , \hat{g} \rangle, \qquad G = \hat{g} . \]
Since the Fourier transform G(ξ) of function g(x) belongs to 𝔏¹(ℝ), then g(x) is bounded as an inverse Fourier transform of G. The same property holds for its complex conjugate f. Hence, its product f·g is absolutely integrable. Let us evaluate its Fourier transform: \begin{align*} ℱ\left[ f^{\ast}\cdot g \right] &= \int_{-\infty}^{\infty} f^{\ast} (x)\,g(x)\, e^{-{\bf j}\xi x} {\text d}x \\ &= \int_{-\infty}^{\infty} f^{\ast} (x)\, e^{-{\bf j}\xi x} {\text d}x\,\frac{1}{2\pi} \int_{-\infty}^{\infty} G(\xi )\,e^{{\bf j}\xi x} {\text d}\xi \\ &= \frac{1}{2\pi} \int_{-\infty}^{\infty} G(\xi )\,{\text d}\xi \, \int_{-\infty}^{\infty} f^{\ast} (x)\, e^{-{\bf j}xi (x-u)} {\text d}x \\ &= \frac{1}{2\pi} \int_{-\infty}^{\infty} G(\xi )\,F^{\ast} (\xi - u)\.{\text d}\xi \end{align*} In the latter, we replaced f by ℱ−1[F] and then used the property regarding complex conjugate of the integral can be transfered into its integrand. Finally, we set u = 0, which leads to the required property.
   
Example 2:    ■
End of Example 2
Corollary 1: If function f ∈ 𝔏 and its Fourier transform F also absolutely integrable. then Parseval's identity holds \[ 2\pi \int_{-\infty}^{\infty}|f(x)|^2 {\text d}x = \int_{-\infty}^{\infty} \left\vert \hat{f} (\xi ) \right\vert^2 {\text d}\xi . \]
It is sufficient to set G(ξ) = F(ξ) in the previous Lemma.
Lemma 3: If function f(x) is bounded and has continuus second derivative on whole line ℝ, then its Fourier transform belongs to class 𝔏.
Note that if both f and its Fourier transform F = ℱ[f], then f ∈ 𝔏²(ℝ). Indeed, f = ℱ−1[F] is bounded and vanish at infinity, so
\[ \left\vert f(x) \right\vert^2 = f(x) \cdot f^{\ast}(x) = f(x) \cdot \overline{f(x)} \]
because f ∈ 𝔏 and f are bounded and vanish at infinity.
It is clear that the second derivative f&prome;′ is bounded and belongs to 𝔏. Its Fourier Fourier is bounded on whole axis ℝ. Let us find its Fourier transform using integration by parts: \begin{align*} ℱ[f;;]_{x\to\xi} &= \int_{-\infty}^{\infty} f'' (x)\, e^{-{\bf j}\xi x} {\text d} x \\ &= \int_{-\infty}^{\infty} f' (x)\, e^{-{\bf j}\xi x} {\text d} x + \left. f' (x)\, e^{-{\bf j}\xi x} \right\vert_{x=-\infty}^{x=\infty} \\ &= \left( {\bf j}\xi \right)^2 \int_{-\infty}^{\infty} f (x)\, e^{-{\bf j}\xi x} {\text d} x = -\xi^2 \hat{f} (\xi ) . \end{align*} So we get an estimate: \[ \left\vert \xi^2 \hat{f} (\xi ) \right\vert = \left\vert ℱ[f''] \right\vert \le c \qquad\iff \qquad \left\vert \hat{f} (\xi ) \right\vert \frac{c}{|\xi |^2} . \] The latter inequality shows that ℱ[f] decreases at infinity as |ξ|−2; moreover, the Fourier transform of function f is a continuous function, so ℱ[f] ∈ 𝔏¹(ℝ).
   
Example 3:    ■
End of Example 3

=============================== to be checked

   

Example 4:    ■

End of Example 4

Theorem 3: The Fourier transform in the Schwartz space of rapid decrease functions 𝒮(ℝ) ⊂ 𝔏²(ℝ) to an isomorphism \[ ℱ\, : \ 𝔏^2(\mathbb{R}) \mapsto 𝔏^2(\mathbb{R}) \] satisfying ∥ℱu∥₂ = (2π)∥u∥₂.
Given the density of 𝒮𝒮(ℝ) in 𝔏²(ℝ). Setting u = v in Parseval’s formula, \[ \int_{-\infty}^{+\infty} \left( \hat{u}(\xi ) \right)^{\ast} \hat{v}(\xi )\,{\text d}\xi = \left( 2\pi \right) \int_{-\infty}^{+\infty} u^{\ast} (x)\,v(x)\,{\text d}x , \] gives
   

Example 3:    ■

End of Example 3
   

 

  1. Bunyakovsky, Viktor (1859), "Sur quelques inegalités concernant les intégrales aux différences finies" (PDF), Mem. Acad. Sci. St. Petersbourg, 7 (1): 6, archived (PDF) from the original on 2022-10-09
  2. Kichenassamy, S., Apodictic discourse and the Cauchy–Bunyakovsky–Schwarz inequality, Gaṇita Bhāratī (Indian Mathematics): Journal of the Indian Society for History of Mathematics, 2020, 42 (1), pp.129- 147. ⟨10.32381/GB.2020.42.1-2.5⟩. ⟨hal-03643571⟩
  3. Schwarz, H. A. (1888), "Über ein Flächen kleinsten Flächeninhalts betreffendes Problem der Variationsrechnung" (PDF), Acta Societatis Scientiarum Fennicae, XV: 318, archived (PDF) from the original on 2022-10-09.
  4. Steele, J.M., The Cauchy-Schwarz Master Class

 

Return to Mathematica page
Return to the main page (APMA0340)
Return to the Part 1 Basic Concepts
Return to the Part 2 Fourier Series
Return to the Part 3 Integral Transformations
Return to the Part 4 Parabolic PDEs
Return to the Part 5 Hyperbolic PDEs
Return to the Part 6 Elliptic PDEs
Return to the Part 6P Potential Theory
Return to the Part 7 Numerical Methods