Introduction to Mathematical Physics/Some mathematical problems and their solution/Evolution, numerical time integration

Introduction
There exist very good books (see ([#References|references])) about numerical integration of PDE evolution problem. Note that all methods (finite difference, finite element, spectral methods) contains as a final step the time integration of a ODE system. In this section this time integration is treated. Problem to be solved is the following

We will not present here details about stability and precision calculation of the numerical integration schemes, however the reader should always keep in mind this crucial problem. Generally speaking, knowledge of mathematical properties of solutions should always be used to verify numerical results. For instance, if the solution of problem probmathevovec is known to be bounded, and that the solution obtained numerically diverges, then numerical solution will be obviously considered as bad. This problem of stability is the first that the numerician meet. However, more refined considerations have to be considered. Integrals of movement are a classical way to check accuracy of solutions. For hamiltonian systems for instance, energy conservation should be checked at regular time intervals.

Euler method
Euler method consists in approximating the time derivative

by

However, the way the right-hand term is evaluated is very important for the stability of the integration scheme ([#References|references]). So, explicit scheme:

is unstable if $$F=\frac{\partial u}{\partial x}$$. On another hand, implicit scheme:

is stable. This last scheme is called "implicit" because equation eqimpli have to be solved at each time step. If $$F$$ is linear, this implies to solve a linear system of equations (see ([#References|references])). One can show that the so-called Cranck-Nicholson scheme: is second order in time. Another interesting scheme is the leap-frog scheme: {{IMP/exmp| Let us illustrate Euler method for solving Van der Pol equation: {{IMP/eq|$$ \ddot{x}-\epsilon(1-x^2)\dot{x}+x=0 $$}} which can also be written: $$\begin{matrix} \frac{dx}{dt}&=&y\\ \frac{dy}{dt}&=&\epsilon (1-x^2)y-x \end{matrix}$$

}} {{IMP/exmp|Let us consider the reaction diffusion system: {{IMP/eq|$$\frac{\partial u}{\partial t}=\gamma(a-bu+\frac{u^2}{\nu})+\nabla^2u$$}} {{IMP/eq|$$\frac{\partial v}{\partial t}=\gamma(u^2-v)+d\nabla^2v$$}} Figure figreacd shows results of integration of this system using Euler method (space treatment is achieved using simple finite differences, periodic boundary conditions are used). The lattice has $$100 \times 50$$ sites.

\begin{figure} \begin{tabular}[t]{ccc}

\epsffile{reacdt1ga5e_04ite2} \epsffile{reacdt1ga5e_04ite4}

\epsffile{reacdt1ga5e_04ite6} \epsffile{reacdt1ga5e_04ite8}

\epsffile{reacdt1ga5e_04ite10} \epsffile{reacdt1ga5e_04ite12}

\epsffile{reacdt1ga5e_04ite14} \epsffile{reacdt1ga5e_04ite16}

\epsffile{reacdt1ga5e_04ite18} \epsffile{reacdt1ga5e_04ite20} \end{tabular} | center | frame |Simulation of reaction diffusion system on a lattice of $$100 \times 50u$$ greater than $$(u_{max}-u_{min})/2$$. When time evolves, structures that can model blots on some animals skin.} LABEL figreacd ]] Numerical value of parameters were $$\gamma=5$$, $$a=0.5$$, $$b=2$$, $$D=10$$, $$dt=0.01$$. Initial conditions were random, more precisely $$u(i,j)=0.25+0.001*rand(i,j)$$ and $$v(i,j)=0.6+0.001*rand'(i,j)$$ where $$rand(i,j)$$ and $$rand'(i,j)$$ are random numbers between $$0$$ and $$1$$. Such systems allow to describe spatio temporal systems where two quantities $$u$$ and $$v$$ play a different role: the first is activator of a change in characteristic of the site, the second is inhibitor. They can be used to model evolution of forest fires or blots on the skin of certain animals. }}

Runge-Kutta method
Runge-Kutta formula \index{Runge-Kutta} at fourth order gives $$u_{i+1}$$ as a function of $$y_i$$:

where

Adams method (multiple steps)
Problem:

Find $$u(t)$$ solution of:

with

can be solved by open Adams\index{Adams formula} method order two:

or open Adams method order three:

Open Adams method are multisteps: they can not initiate an integration process. Examples of closed Adams method, are at order two:

and order three:

Closed Adams methods are also multisteps. They are more accurate but are implicit: they imply the solving of equations systems at each time step. Predictor--corrector method provides a practical way to use closed Adams formulas.

Predictor--corrector method
Predictor--corrector methods\index{predictor-corrector} are powerful methods very useful in the case where right--hand side is complex. An first estimation $$\tilde u_{i+1}$$ is done (predictor) using open Adams formula, for instance open Adams formula order three:

Then, $$u_{i+1}$$ is re-evaluated using closed Adams formula where $$\tilde u_{i+1}$$ computed previously is used to avoid implicity:

Symplectic transformation case
Consider\index{symplectic} the following particular case of evolution problem:

Dynamics in this case preserves volume element $$dq.dp$$. Let us define symplectic \index{symplectic}transformation:

Let us giev some examples of symplectic integrating schemes for system of equation eqsymple1 and  eqsymple2.

Figures codefigure1,  codefigure2, and  codefigure3 represent trajectories computed by three methods: Euler, Verlet, and staggered leap--frog method for (linear) system describing harmonic oscillator: {{IMP/eq|$$ \left\{ \begin{array}{lcr} \dot x&=&-y\\ \dot y&=&x \end{array}\right. $$}} \begin{figure}[tbh] EulerOscillo001 | center | frame |\it Euler method with time-step $$h=0.01$$ for harmonic oscillator.} LABEL codefigure1 ]]

\begin{figure}[tbh] VerletOscillo1 | center | frame |\it Verlet method with time step $$h=0.9$$ for harmonic oscillator. Despite a larger time-step than time step used to plot previous figure, energy is well conserved.} LABEL codefigure2 ]]

\begin{figure}[tbh] VerletRecOscillo09 | center | frame |\it Staggered leap--frog method: energy is still well conserved, but space phase is less deformed than in previous case.} LABEL codefigure3 ]]