Frequency-domain (Helmholtz) formulation

Part 4 — Wave equations in PINN form

Learning objectives

  • State the Helmholtz equation as the Fourier transform of the wave equation
  • Recognise the trade-off: time-domain handles broadband, frequency-domain handles narrowband cleanly
  • Train a PINN to solve the Helmholtz equation with a known forced-response source
  • Connect the formulation to seismic FWI (Plessix 2006, Operto 2007, Pratt 1999)

Take the wave equation utt=c22uu_{tt} = c^2 \nabla^2 u and Fourier-transform in time. With u(x,z,t)=Re[U(x,z;ω)eiωt]u(x, z, t) = \textrm{Re}[U(x, z; \omega) e^{-i \omega t}] the result is the Helmholtz equation

2U(x,z)+k2U(x,z)=f(x,z),\nabla^2 U(x, z) + k^2 U(x, z) = f(x, z) ,

where k=ω/ck = \omega / c is the wavenumber and ff is the (frequency-domain) source. The Helmholtz equation has no time variable — it is a steady-state problem at one frequency. The PINN ansatz becomes Uθ(x,z)U_\theta(x, z) (2 inputs); the loss is just PDE + BC.

Why the frequency domain matters in seismic

Industrial seismic FWI codes (Plessix 2006 RAM3D, Operto et al. 2007, Pratt 1999) overwhelmingly use the frequency domain for inversion. Reasons:

  • One frequency at a time means a smaller linear system per iteration.
  • Frequency continuation (§3.6) is the natural fit: invert at low frequency first, warm-start to higher.
  • Cycle-skipping is easier to diagnose by frequency.

The PINN literature followed: Song, Alkhalifah & Waheed 2023 GJI is the modern reference for Helmholtz PINNs in seismic.

The widget setup

To verify against an exact answer we choose a forced source so U(x,z)=sin(πx)sin(πz)U(x, z) = \sin(\pi x) \sin(\pi z) is the analytic solution for any kk:

2U+k2U=(k22π2)sin(πx)sin(πz)f(x,z;k).\nabla^2 U + k^2 U = (k^2 - 2 \pi^2) \sin(\pi x) \sin(\pi z) \equiv f(x, z; k) .

For k=2πk = 2 \pi (one wavelength across the unit-square domain) the source amplitude k22π2=2π219.7k^2 - 2 \pi^2 = 2 \pi^2 \approx 19.7. As k2π4.44k \to \sqrt{2} \pi \approx 4.44 the source amplitude vanishes — that is the (1, 1) resonant eigenmode of the closed box, where the Helmholtz operator becomes singular. Stay safely above or below.

HelmholtzInteractive figure — enable JavaScript to interact.

What you should observe

  • For low kk (1–5) the PINN converges in a few thousand epochs to relative-L² of a few percent.
  • At k4.44k \approx 4.44 (the (1, 1) resonance) the PDE is singular — the PINN may produce arbitrarily large outputs. Step the slider over and around it to see the failure.
  • For high kk (8–12) the wavefield has multiple wavelengths across the domain. Spectral bias of the vanilla Tanh MLP starts to bite; relative-L² grows. Fourier features (§2.2) or SIREN (§2.3) would fix this — modern Helmholtz PINNs use them by default.
  • The compute is much cheaper than time-domain (no time dimension, no IC) — typically 30 seconds for 2000 epochs.

References

  • Pratt, R.G. (1999). Seismic waveform inversion in the frequency domain, Part 1: Theory and verification in a physical scale model. Geophysics 64(3).
  • Plessix, R.-E. (2006). A review of the adjoint-state method for computing the gradient of a functional with geophysical applications. Geophys. J. Int. 167.
  • Operto, S., et al. (2007). 3D finite-difference frequency-domain modeling of visco-acoustic wave propagation using a massively parallel direct solver. Geophysics 72(5).
  • Song, C., Alkhalifah, T., Waheed, U.B. (2023). A versatile framework to solve the Helmholtz equation using physics-informed neural networks. Geophys. J. Int.

This page is prerendered for SEO and accessibility. The interactive widgets above hydrate on JavaScript load.