2011 course in neuroinformatics marine biological laboratory woods hole, ma introduction to spline...
TRANSCRIPT
![Page 1: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/1.jpg)
2011 COURSE IN NEUROINFORMATICSMARINE BIOLOGICAL LABORATORY
WOODS HOLE, MA
Introduction to Spline Models
or
Advanced Connect-the-Dots
Uri Eden
BU Department of Mathematics and Statistics
August 16, 2011
Slide acknowledgements: D. Keren, Dept. of Computer Sci, Haifa U.
![Page 2: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/2.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
0 100 200 300 400 500 600 700 800 900 10000
20
40
60
80
100
Time (ms)
Tri
al
![Page 3: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/3.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Fir
ing
Rat
e (
Hz)
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
![Page 4: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/4.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 5: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/5.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 6: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/6.jpg)
Problem Statement
• Given a set of control points, Pi, known to be on a curve, find a parametric function that interpolates or approximates the curve.
![Page 7: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/7.jpg)
• For interpolating 2 points we need a polynomial of degree 1.
Polynomial interpolation
(x1,y1)(x2,y2)
![Page 8: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/8.jpg)
• For interpolating 2 points we need a polynomial of degree 1.
Polynomial interpolation
2 11y y y
1
2 1
x x
x x
(x1,y1)(x2,y2)
![Page 9: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/9.jpg)
• For interpolating 2 points we need a polynomial of degree 1.
• For interpolating 3 points we need a polynomial of degree 2.
• In general, for interpolating n points, we need a polynomial of degree n-1.
Polynomial interpolation
2 11y y y
1
2 1
x x
x x
(x1,y1)(x2,y2)
![Page 10: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/10.jpg)
Polynomial interpolation
• Let’s try it on our example control points:
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
10
20
30
40
50
60
Time (sec)
Firi
ng R
ate
(Hz)
![Page 11: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/11.jpg)
Polynomial interpolation
• Let’s try it on our example control points:
Time (sec)
Firi
ng R
ate
(Hz)
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1-250
-200
-150
-100
-50
0
50
100
![Page 12: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/12.jpg)
Polynomial interpolation• Disadvantages:
– Coefficients are difficult to interpret geometrically
– No local operations – adjusting parameters to change one region will change all others
– If polynomial degree is high: • Resulting function will have unwanted fluctuations• Numerical precision problems may arise.
– If polynomial degree is low, the resulting curve will not interpolate the points
![Page 13: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/13.jpg)
Spline interpolation
• Another approach: Polynomial splines
– Advantages:• Rich, flexible representation• Geometrically meaningful coefficients
– Local, piecewise, low-degree, polynomial curves with continuous, smooth joints
![Page 14: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/14.jpg)
Spline interpolation
• Simplest Example: Zeroth order ‘spline’– Constant function between control points
– Simple mathematical representation
1, if i i iy y x x x
Local
(xi+1,yi+1)
(xi,yi)
![Page 15: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/15.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 16: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/16.jpg)
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
10
20
30
40
50
60
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)
Fir
ing
Rat
e (
Hz)
Local but not continuous
![Page 17: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/17.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’– Linear combination of the two nearest control points
– Simple mathematical representation
1 11 , if i i i iy y y x x x
1
i
i i
x x
x x
where
![Page 18: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/18.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’
0 0.2 0.4 0.6 0.8 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 1 1( ) ( ) , if i i i iy f y f y x x x
1( )f
2 ( )f
![Page 19: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/19.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’
0 0.2 0.4 0.6 0.8 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 1 1( ) ( ) , if i i i iy f y f y x x x
1( )f
2 ( )f 0
![Page 20: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/20.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’
0 0.2 0.4 0.6 0.8 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 1 1( ) ( ) , if i i i iy f y f y x x x
0.2
1( )f
2 ( )f
![Page 21: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/21.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’
0 0.2 0.4 0.6 0.8 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 1 1( ) ( ) , if i i i iy f y f y x x x
0.5
1( )f
2 ( )f
![Page 22: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/22.jpg)
Spline interpolation
• Simple Example: Linear ‘spline’
0 0.2 0.4 0.6 0.8 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 1 1( ) ( ) , if i i i iy f y f y x x x
1
1( )f
2 ( )f
![Page 23: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/23.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 24: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/24.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
Local and continuous, but not smooth
![Page 25: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/25.jpg)
Spline interpolation
• Cubic Splines– Let be cubic functions.
– Produces continuous, differentiable curves– Need to decide how to model derivatives at control points
• Natural Splines: Derivative is zero at endpoints
• Cardinal Splines: Derivative determined by nearby control points
• Hermitian Splines: Derivatives determined by separate parameters
0 1 1 2 1 3 2
1
,
if i i i i
i i
y c y c y c y c y
x x x
0 1 2 3, , , c c c c
![Page 26: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/26.jpg)
Spline interpolation
• Cardinal splines– Linear combination of 4 nearest control points– Features:
• Derivatives determined by adjacent points
• Shape controlled by tension parameter, [0,1]s
![Page 27: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/27.jpg)
Spline interpolation
• Cardinal splines
31
2
11
2
2 2
2 3 3 2, if
0 0
0 1 0 01
T
i
ii i
i
i
ys s s s
ys s s sy x x x
ys s
y
0 1 1 2 1 3 2
1
,
if i i i i
i i
y c y c y c y c y
x x x
![Page 28: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/28.jpg)
Spline interpolation
• Cardinal splines– Basis/blending functions for cardinal spline with s = 0.5.
![Page 29: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/29.jpg)
Spline interpolation
• Cardinal splines
0
0 1 1 2 1 3 2 1, if i i i i i iy c y c y c y c y x x x
![Page 30: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/30.jpg)
Spline interpolation
• Cardinal splines
0.2
0 1 1 2 1 3 2 1, if i i i i i iy c y c y c y c y x x x
![Page 31: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/31.jpg)
Spline interpolation
• Cardinal splines
0.5
0 1 1 2 1 3 2 1, if i i i i i iy c y c y c y c y x x x
![Page 32: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/32.jpg)
Spline interpolation
• Cardinal splines
1
0 1 1 2 1 3 2 1, if i i i i i iy c y c y c y c y x x x
![Page 33: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/33.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 34: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/34.jpg)
Motivating Problem
• Compute a smooth firing rate function from repeated spike train data
Time (sec)0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
10
20
30
40
50
60
Fir
ing
Rat
e (
Hz)
![Page 35: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/35.jpg)
Fitting Spline Models
• To define a spline model, we must specify– Control point locations (x-coordinates)– Tension parameter
• Often these are selected ad-hoc, but adaptive Bayesian procedures (e.g. BARS) to determine optimal values typically produce better results.
![Page 36: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/36.jpg)
Fitting Spline Models
• Under a specified noise model, the spline parameters (heights of control points) can be estimated by maximum likelihood.
– E.g. If , where is Gaussian white noise, and is a spline function, the ML estimator, , can be found by simple linear regression.
– For spike data, ML spline parameters can be estimated using point process models.
t t ty tt tX
ˆML
![Page 37: 2011 COURSE IN NEUROINFORMATICS MARINE BIOLOGICAL LABORATORY WOODS HOLE, MA Introduction to Spline Models or Advanced Connect-the-Dots Uri Eden BU Department](https://reader033.vdocuments.net/reader033/viewer/2022052603/56649f455503460f94c66d0f/html5/thumbnails/37.jpg)
Conclusions
• Splines offer one approach to modeling smooth functional relationships in neuroscience data.
• Cubic splines are local 3rd degree polynomials that are piecewise continuous and differentiable.
• Under common noise distributions, spline models can be fit easily using ML methods.
• Goodness of spline model fits depends on selection of control point locations and tension parameters.