\chapter{Stationary Iterative Methods, Felix Kwok}

\section{Multiphysics problems, Monday May 31st}

Single physics problems have specialized discretizations and solvers to take advantage of the specifics of the problems, ie. fast Poisson solvers for heat transfer, ray tracing for wave propagation., upwinding for advection, etc.

Obviously, this doesn't work if you have multiple physics acting at once, ie. a fast Poisson solver isn't great if there's wave propagation as well as heat transfer.

\subsection{Multiphysics Example Problem: Flow in porous media}

Goal: track the evolution of underground fluids, as well as chemical concentration.

Physics involved: fluid dynamics, diffusion, chemical reactions, capillary action.

\subsubsection{Darcy flow model:}

single phase flow, for one fluid only,

\begin{equation}

\vec{v} = -K(\vec{x}) \Delta p

\end{equation}

Conservation of mass is important: the amount accumulated must equal the mass in minus the mass out.

There are also mass conservation, which leads to momentum equations.

The fluid velocity is determined by Navier-Stokes.

Momentum conservation uses the Cauchy stress tensor.

Change in momentum causes velocity change.

All heat leaving the solid enters the fluid.

Ultimately this gives five coupled equations.

This gives different physics in each region:

\begin{itemize}

\item Navier-Stokes on $\Omega_f$;

\item diffusion on $\Omega_s$;

\item advection-diffusion on $\Omega_f$.

\end{itemize}

Once NS is discretized we get a saddle-point problem:

\begin{equation*}

\begin{bmatrix} A & B \\ B^\top& 0 \end{bmatrix}\begin{bmatrix}\vec{v}\\\vec{p}\end{bmatrix} = \begin{bmatrix}\vec{f}\\\vec{g}\end{bmatrix}

\end{equation*}

where $\vec{v}$ is velocity and $\vec{p}$ is pressure, which are the components of a solution to NS.

\section{Iterative Methods}

Suppose we look for the solution to a nonlinear system $F(\vec{x})$ where $F: D \subset\bbr^n \to\bbr^n$ is Frechet-differentiable.

There are no direct methods for solving this problem for arbitrary $F$.

We use iterative methods, constructing $\set{\vec{x}^i}_i \in\bbn$ starting from an initial guess $\vec{x}^0$ and trending towards the solution $\vec{x}^*$.

ex. Newton's method, fixed point methods, Jacobi and Gauss-Seidel.

Block stationary methods can be applied to the cooling by fluid injection problem described above.

The momentum and pressure can be split into blocks, and also the heat equation into the two domains.

\section{CG and Preconditioning, Tuesday June 1st}

This slideshow is mostly a review of conjugate gradient methods.

Solving $Ax=f$ is same as minimizing $x^\top A x -2 x^\top f$.

%========================================%

\chapter{Domain Decomposition, Victorita Dolean}

\section{Introduction}

Original Schwarz method: solve the problem on a subdomain then take the solution at the interface of a second subdomain as an initial condition to solve the problem there.

Repeat, passing interface conditions back and forth until convergence.

Jacobi Schwarz: same as above, but process is done in parallel.

Rather than wait for the first subdomain to finish, the second subdomain is solved using information from the previous step.

Restricted additive Schwarz:

\begin{equation*}

u^{n+1} = \sum_{i=1}^2 E_i (\chi_i u_i^{n+1})

\end{equation*}

where $\chi_i$ is the respective partition of unity and $E_i$ is the respective extension operator.

Additive Schwarz is the same without the partitions of unity.

\section{Two-Level DDM}

\begin{defn}[Strong scalability]

How the solution time varies with the number of processors for a fixed total problem size.

\end{defn}

\begin{defn}[Weak scalability]

How the solution time varies with the number of processors for a fixed problem size per processor.

\end{defn}

At each stage of Schwarz, add a coarse space correction by finding the parts of the problem that are slowing the procedure down and solving it separately over the ``coarse'' space.

In essence, the problem is split into two, one solved over a coarse space and another solved over the more standard subdomains.

Look up fictitious space lemma, Nepomnyaschikh 1991.

ffddm is an implementation of parallel solvers in FreeFEM, namely overlapping Schwarz domain decomposition methods.

\href{https://doc.freefem.org/_static/html/tutorial-slides.html#1}{Link to a tutorial.}

The authors wish to thank the reviewers for their positive reports. The abstract of this paper follows. The guidelines of DDM state this abstract should only appear on the web and not within the manuscript.

\begin{quote}

"Newton-Raphson preconditioned by Schwarz methods does not have sufficient convergence criteria. We explore an alternating Schwarz method accelerated by Newton-Raphson to find an example where the underlying Schwarz method converges but the Newton-Raphson acceleration fails. Alternating Schwarz is posed as a fixed point iteration to make use of theory for generic root-finding methods. An algorithm is proposed combining several aspects of this theory and others to guarantee convergence."

\end{quote}

To the point made by the second reviewer, the situation is indeed significantly more complicated in higher dimensions. Whereas in 1D cycles can only exist by alternating between two sides of the fixed point, in nD these cycles can reposition themselves anywhere on the hypersphere.