A unified introduction to the theory and practice of modern, near linear-time, numerical methods for large-scale partial-differential and integral equations. Topics include: preconditioned iterative methods; generalized Fast Fourier Transform and other butterfly-based methods; multiresolution approaches including multigrid algorithms, hierarchical low-rank matrix decompositions, and low and high frequency Fast Multipole Methods. Example applications include: aircraft design, cardiovascular system modeling, electronic structure computation, and tomographic imaging.
Grad H subject. Units: 3-0-9. The class is suitable for graduate students from all departments who have affinities with mathematics.
Topics:
Introduction: PDE vs. integral equations, Fourier-based numerical
methods.
Exterior problems:
- Surface integral equations, layer potentials
- The Fast Multipole Method (FMM)
- Partitioned low-rank methods, skeletons, cross-approximation
- Applications to electrostatics, biomolecules, potential flows
Interior problems and variable media:
- Multigrid and relaxation
- Volume integral equations
- Applications to fluid and heat flows, dieletrics, electronic density
High-frequency problems:
- High-frequency FMM
- Butterfly algorithms
- Applications to acoustic and electromagnetic scattering, radar imaging
Prerequisites: Some familiarity with ordinary differential equations, partial differential equations, Fourier transforms, linear algebra, and basic numerical methods for PDE, at the level of 18.085. The assignments will involve computer programming in the language of your choice (Matlab recommended).
Figures: top-right, the hierarchical tree structure of the butterfly algorithm. Bottom-left, low-rank interactions in the electromagnetic far-field
The material will be inspired from various sources.
We are working on the typeset notes. In the meantime, enjoy the handwritten notes, for 02/09, 02/14, and 02/16.
Good references on the fast multipole method: review article by Ying, review article by Beatson and Greengard, Ying et al. paper on the kernel-independent FMM.
Some basic Matlab scripts for solving PDE:
- Poisson equation: run_poisson.m, solve_poisson_jacobi.m.
- Sparse matrix for the 2D Dirichlet Laplacian: poisson2d_matrix.m.
- Heat and advection equations: heat_EE.m, heat_CN.m, adv_EE.m, adv_LF.m.
Three references books covering backrgound material on numerical methods for PDE.
- R. LeVeque, Finite difference methods for ordinary and partial differential equations, SIAM, 2007.
- N. Trefethen, Spectral methods in Matlab, SIAM, 2000.
- R. LeVeque, Finite volume methods for hyperbolic problems, Cambridge University Press, 2002.
Date and Time: Tu-Th, 2:30-4:00, room 2-135.
Instructors: Laurent Demanet and Jacob White.
Office hours: Laurent Demanet: W-F, 2:00-4:00, room 2-392. Jacob White: TBA
50% homework, 50% course project.
The homework problem sets will consist of both theoretical problems and numerical experiments. No late copy will be allowed. The lowest score will be dropped. Collaboration is allowed, but the codes and copies you turn in must be original and written by you.
- Problem set 1: due 02/23. Sparse solver for the 2D Laplacian: here. DST-I solver for the 2D Laplacian: here, on Per-Olof Persson's webpage.
- Problem set 2: due 04/19. Matlab files for question 2:
- Problem set 3: due 05/10. Matlab files:
The course project will be of a computational or mathematical nature. Each student will have a different project (hopefully tailored to their taste). The project report should be written like a publication: clear and concise. It is a good idea to use LaTeX for the typesetting. Here is a list of possible project topics.