Applied Mathematics 7400-001

Radial Basis Functions

Spring 2011

Instructor: Office / Office hours:	Bengt Fornberg ECOT 214 /  Office hours to be announced.
Class hours/ location:  Prerequisites:	MWF  1.00-1.50 / MUEN  E114 Recommended:   Numerical analysis (at least undergraduate version), linear algebra, complex variables.
Texts:	Recommended reading (on PS methods): Fornberg, B., A Practical Guide to Pseudospectral methods (Cambridge Univ. Press, 1996)  Recommended reading (on RBF methods): Fasshauer, G.E., Meshfree Approximation Methods with Matlab  (World Scientific Publishing Co., 2007) Additional (optional) good reading: Trefethen, L.N., Spectral Methods in Matlab (SIAM, 2000) Boyd, J.P., Chebyshev and Fourier Spectral Methods (Dover, 2000). Wendland, H., Scattered Data Approximation (Cambridge University Press, 2005)
Some additional course materials:	Slides for presentations:  Oxford 2010 Lecture notes - FD methods:  Brief summary of Finite Difference Methods Lecture notes - PS methods:  Brief summary of Pseudospectral  Methods Additional materials relating to PS methods:  Periodic , Non-periodic, Spherical harmonics, Numerical ODE solvers , Padé approximants, Generation of FD weights, Fourier series and transforms, Some PS notes Lecture notes - RBFs:  Non-singularity, Powell-Five Lectures on RBFs . Some small sets of RBF slides:  Boundary errors,  Contour-Padé method,  Poisson equation, Different flat RBF limits, Small epsilon expansions, Bessel RBFs, RBFs and the Runge phenomenon, Locality, Gibbs phenomenon, RBF-QR on the sphere. Lecture notes - RBF-FD methods: Papers: Codes:  weights.m.
Assignments:	Some regular assignments will be given. However, the course will be largely project based, with studies of research papers and presentations, implementations of small research problems, etc. mainly replacing regular homeworks. Assignment 1:  On page 7 of  the Course Plan ,   12 "topics for study/presentations" are listed. Select one of these (first come, first serve), and give a max 10 minute presentation on it in class, as soon as possible after we have covered similar materials in our review of FD methods.  Assignment 2:  Matlab exercise using FD2 and PS methods for the 1-D heat equation. Due March 4. Assignment 3:  Study one of the listed papers, or find papers on one of the listed topics, and then present in class.
Exam:	Final exam will be held  Saturday April 30, 1.30  - 4.00 pm.   Final Exam Solution
Final Grade:	Based on presentations and other assignments, the midterm exam, and the final exam.
Course Description / Syllabus:	General course description: This course is focused on two powerful numerical methodologies for solving PDEs to high accuracy in any number of dimensions: Pseudospectral (PS) methods and Radial Basis Functions (RBFs).  These methods apply to a wide range of PDEs, arising for example in fluid mechanics, wave motions, astro- and geo-sciences, etc.  While this technically is an upper level graduate course on a numerical topic, one of its primary goals is to give students who are not specializing in numerical methods but who need to solve problems in these areas an up-to-date survey style overview of the methods. Our focus will be on how, when, and why the different approaches work, more by means of examples and heuristic explanations than by any rigorous theoretical arguments. The course assignments will be mostly take the form of small projects and presentations. Four main course topics: Both of the main techniques, PS and RBF methods, can be traced back to finite differences (FD). The present research frontier in the field appears to now be moving towards RBF-generated finite difference (RBF-FD) methods. The natural order for covering these areas follows quite closely how they developed historically. Finite difference methods:   These were first proposed for solving PDEs in 1910, and they have remained a dominant methodology ever since. Generally, they are easy to implement, but more restrictive than for example finite elements in terms of geometric flexibility. Pseudospectral methods:   For applications in very simple geometries (long intervals in 1-D, rectangular or circular domains in 2-D, periodic boxes in 3-D, spherical shells, etc.) it was noted in the early 1970's that the infinite order of accuracy limit of FD methods exists and that it can offer spectacular computational efficiencies. Another way to arrive at the same PS methods is via expansions in orthogonal functions (such as Fourier, Chebyshev, and spherical harmonics). These PS methods soon became prominent for solving PDEs in numerous areas, including fluid dynamics (such as direct numerical simulations of turbulent flows), weather forecasting, long time evolution of linear and nonlinear waves, and computational electromagnetics. Radial basis functions:   Also this methodology has several origins. The theme we will follow is to generalize PS methods away from their geometric limitations and their dependence on very regular node layouts (which for PS methods makes it very complicated to carry out local refinements in critical solution areas). This can be done while preserving their spectral accuracy (beyond any power of the typical node spacing). It transpires that all PS methods can be seen as highly specialized (and typically not optimal) special cases of RBFs. Both the coding effort and the computational cost of RBFs are independent of how simple or complicated the geometry might be. In a recent large-scale 3-D geophysical flow application, an RBF-based code on a standard PCs competed very favorably against all previous methodologies, even when these were implemented on large supercomputer systems. Radial basis function-generated FD methods:   It has very recently been discovered that using RBFs to create generalized FD methods might offer the best opportunity yet for combining the strengths of all the previous approaches. In particular, RBF-FD methods can often reach very high computational speed since they only rely on local approximations, and they also give rise to sparse rather than to full matrix problems.  Preliminary development work on RBF-FD methods is under way at several research centers, including a close collaboration between ourselves and NCAR. Course Plan:

Some General Information about CU Courses:

Students with Disabilities: Students with disabilities who qualify for academic accommodations must provide a letter from Disability Services (DS) and discuss specific needs with the professor, preferably during the first two weeks of class.  DS determines accommodations based on documented disabilities (303-492-8671, Willard 322, www.colorado.edu/sacs/disabilityservices)

Religious Conflicts: Students who have conflicts between religious observance dates and course examinations or assignments please contact me before September 6.  The campus policy can be viewed at (http://www.colorado.edu/policies/index.html).

Student Honor Code: The Student Honor Code may be viewed at (http://www.colorado.edu/academics/honorcode/)