curve fitting p m v subbarao professor mechanical engineering department an optimization method to...
TRANSCRIPT
![Page 1: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/1.jpg)
Curve Fitting
P M V SubbaraoProfessor
Mechanical Engineering Department
An Optimization Method to Develop A Model for Instrument…..
![Page 2: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/2.jpg)
y
x
Less Unknowns & More Equations
![Page 3: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/3.jpg)
Quantifying error in a curve fit
• positive or negative error have the same value (data point is above or below the line)
• Weight greater errors more heavily
![Page 4: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/4.jpg)
y
x
Less Unknowns & More Equations
![Page 5: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/5.jpg)
x
Less Unknowns & More Equations
xfy
![Page 6: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/6.jpg)
Hunting for A Shape & Geometric Model to Represent A Data Set
![Page 7: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/7.jpg)
![Page 8: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/8.jpg)
![Page 9: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/9.jpg)
![Page 10: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/10.jpg)
Minimum Energy Method : Least Squares Method
If our fit is a straight line baxxf
2442
332
222
112 xfyxfyxfyxfydError i
N
iii
N
iii baxyxfyError
1
2
1
2
![Page 11: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/11.jpg)
•The ‘best’ line has minimum error between line and data points•This is called the least squares approach, since square of the error is minimized.
N
iii baxyErrorMinimize
1
2
01
2
a
baxy
a
Error
N
iii
01
2
b
baxy
b
Error
N
iii
Take the derivative of the error with respect to a and b, set each to zero
![Page 12: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/12.jpg)
N
iiii baxyx
a
Error
1
02
N
iii baxy
b
Error
1
02
Solve for the a and b so that the previous two equations both = 0
![Page 13: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/13.jpg)
N
iii
N
ii
N
ii yxxbxa
111
2
N
ii
N
ii ybNxa
11
put these into matrix form
N
iii
N
ii
N
ii
N
ii
N
ii
yx
y
a
b
xx
xN
1
1
1
2
1
1
![Page 14: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/14.jpg)
2
11
2
111
2
1
N
ii
N
ii
N
iii
N
ii
N
ii
N
ii
xxN
yxxxyb
2
11
2
111
N
ii
N
ii
N
ii
N
ii
N
iii
xxN
yxyxNa
![Page 15: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/15.jpg)
Is a straight line suitable for each of these cases ?
![Page 16: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/16.jpg)
The Least-Squares mth Degree Polynomials
When using an mth degree polynomial
mm xaxaxaay .........2
210 to approximate the given set of data, (x1,y1), (x2,y2)…… (xn,yn), where n ≥
m, the best fitting curve has the least square error, i.e.,
n
i ii xfyErrorMinimize1
2
n
i
mimiii xaxaxaayErrorMinimize
1
22210 ......
![Page 17: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/17.jpg)
To obtain the least square error, the unknown coefficients a0, a1, …. and am must yield zero first derivatives.
![Page 18: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/18.jpg)
Expanding the previous equations, we have
The unknown coefficients can hence be obtained by solving the above linear equations.
![Page 19: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/19.jpg)
No matter what the order j, we always get equations LINEAR with respect to the coefficients.This means we can use the following solution method
![Page 20: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/20.jpg)
Selection of Order of Fit
2nd and 6th order look similar, but 6th has a ‘squiggle to it. Is it Required or not?
![Page 21: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/21.jpg)
Under Fit or Over Fit: Picking An appropriate Order
•Underfit - If the order is too low to capture obvious trends in the data•Overfit - over-doing the requirement for the fit to ‘match’ the data trend (order too high)• Polynomials become more ‘squiggly’ as their order increases. •A ‘squiggly’ appearance comes from inflections in function
General rule: pick a polynomial form at least several orders lower than the number of data points.
Start with linear and add extra order until trends are matched.
![Page 22: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/22.jpg)
Linear Regression Analysis
• Linear curve fitting
• Polynomial curve fitting
• Power Law curve fitting: y=axb
• ln(y) = ln(a)+bln(x)
• Exponential curve fitting: y=aebx
• ln(y)=ln(a)+bx
![Page 23: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/23.jpg)
Goodness of fit and the correlation coefficient
• A measure of how good the regression line as a representation of the data.
• It is possible to fit two lines to data by • (a) treating x as the independent variable : y=ax+b, y as
the dependent variable or by• (b) treating y as the independent variable and x as the
dependent variable. • This is described by a relation of the form x= a'y +b'. • The procedure followed earlier can be followed again to
find best values of a’ and b’.
![Page 24: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/24.jpg)
N
iii
N
ii
N
ii yxybya
11
'
1
2'
N
ii
N
ii xNbya
1
'
1
'
put these into matrix form
N
iii
N
ii
N
ii
N
ii
N
ii
yx
x
a
b
yy
yN
1
1
'
'
1
2
1
1
![Page 25: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/25.jpg)
Recast the second fit line as:
'
'
'
1
a
bx
ay
'
1
ais the slope of this second line, which not same as the first line
2
11
2
111'''
N
ii
N
ii
N
ii
N
ii
N
iii
yyN
yxyxNabyax
![Page 26: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/26.jpg)
•The ratio of the slopes of the two lines is a measure of how good the form of the fit is to the data.•In view of this the correlation coefficient ρ defined through the relation
'2
line Regression second of Slope
line Regressionfirst of slopeaa
![Page 27: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/27.jpg)
2
11
2
111'''
N
ii
N
ii
N
ii
N
ii
N
iii
yyN
yxyxNabyax
2
11
2
111
N
ii
N
ii
N
ii
N
ii
N
iii
xxN
yxyxNabaxy
![Page 28: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/28.jpg)
2
11
2
2
11
2
2
1112
N
ii
N
ii
N
ii
N
ii
N
ii
N
ii
N
iii
yyNxxN
yxyxN
2
11
2
2
11
2
111
N
ii
N
ii
N
ii
N
ii
N
ii
N
ii
N
iii
yyNxxN
yxyxN
![Page 29: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/29.jpg)
Correlation Coefficient
• The sign of the correlation coefficient is determined by the sign of the covariance.
• If the regression line has a negative slope the correlation coefficient is negative
• while it is positive if the regression line has a positive slope. • The correlation is said to be perfect if ρ = ± 1.• The correlation is poor if ρ ≈ 0.• Absolute value of the correlation coefficient should be greater
than 0.5 to indicate that y and x are related!• In the case of a non-linear fit a quantity known as the index of
correlation is defined to determine the goodness of the fit. • The fit is termed good if the variance of the deviates is much
less than the variance of the y’s. • It is required that the index of correlation defined below to be
close to ±1 for the fit to be considered good.
![Page 30: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/30.jpg)
N
i
N
ii
i
N
iii
N
yy
xfy
1
2
1
1
2
1
![Page 31: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/31.jpg)
2=1.000 2=0.991 2=0.904
2=0.821 2=0.493 2=0.0526
![Page 32: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/32.jpg)
Multi-Variable Regression Analysis
• Cases considered so far, involved one independent variable and one dependent variable.
• Sometimes the dependent variable may be a function of more than one variable.
• For example, the relation of the form
• is a common type of relationship for flow through an Orifice or Venturi.
• mass flow rate is a dependent variable and others are independent variables.
pipe
orifice
d
dApTpfm ,,,,
![Page 33: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/33.jpg)
Set up a mathematical model as:e
pipe
orificedcb
d
dAp
RT
pam
Taking logarithm both sides
pipe
orifice
d
deAdpc
RT
pbam lnlnlnlnlnln
Simply: eodncmblay ln
where y is the dependent variable, l, m, n, o and p are independent variables and a, b, c, d, e are the fit parameters.
![Page 34: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/34.jpg)
The least square method may be used to determine the fit parameters.
Let the data be available for set of N values of y, l, m, n, o, p values.
The quantity to be minimized is given by
N
iiiiiii fpeodncmblayError
1
2
What is the permissible value of N ?
![Page 35: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/35.jpg)
The normal linear equations are obtained by the usual process of setting the first partial derivatives with respect to the fit parameters to zero.
N
iiiiiii fpeodncmblay
a
Error
1
02
N
iiiiiiii fpeodncmblayl
b
Error
1
02
![Page 36: Curve Fitting P M V Subbarao Professor Mechanical Engineering Department An Optimization Method to Develop A Model for Instrument…](https://reader030.vdocuments.net/reader030/viewer/2022032703/56649cf95503460f949ca3f6/html5/thumbnails/36.jpg)
N
ii
N
ii
N
ii
N
ii
N
ii
N
ii ypfoendmclbNa
111111
N
iii
N
iii
N
iii
N
iii
N
iii
N
ii
N
ii ylplfolenldmlclbla
111111
2
1
These equations are solved simultaneously to get the six fit parameters.
We may also calculate the index of correlation as an indicator of the quality of the fit. This calculation is left to you!