A penalized nonparametric method for nonlinear constrained optimization based on noisy data

Download A penalized nonparametric method for nonlinear constrained optimization based on noisy data

Post on 15-Jul-2016




0 download

Embed Size (px)


<ul><li><p>Comput Optim Appl (2010) 45: 521541DOI 10.1007/s10589-008-9185-6</p><p>A penalized nonparametric method for nonlinearconstrained optimization based on noisy data</p><p>Ronaldo Dias Nancy L. Garcia Adriano Z. Zambom</p><p>Received: 26 October 2007 / Revised: 28 April 2008 / Published online: 14 May 2008 Springer Science+Business Media, LLC 2008</p><p>Abstract The objective of this study is to find a smooth function joining two points Aand B with minimum length constrained to avoid fixed subsets. A penalized nonpara-metric method of finding the best path is proposed. The method is generalized to thesituation where stochastic measurement errors are present. In this case, the proposedestimator is consistent, in the sense that as the number of observations increases thestochastic trajectory converges to the deterministic one. Two applications are imme-diate, searching the optimal path for an autonomous vehicle while avoiding all fixedobstacles between two points and flight planning to avoid threat or turbulence zones.</p><p>Keywords Autonomous vehicle B-splines Consistent estimator Confidenceellipses Constrained optimization Nonparametric method</p><p>1 Introduction</p><p>Finding the shortest path between two points in the presence of obstacles is an im-portant problem in robotics, geographical information systems and in-flight planningof routes. A classical application in robotics is the search for optimal trajectories foran autonomous vehicle which has to move from point A to point B traveling theminimum possible distance while avoiding all fixed obstacles between these points.</p><p>R. Dias () N.L. Garcia A.Z. ZambomDepartamento de Estatstica, Universidade Estadual de Campinas (UNICAMP), Rua Sergio Buarquede Holanda, 651, Cidade Universitaria Zeferino Vaz, Caixa Postal 6065, 13.081-970, Campinas,Sao Paulo, Brazile-mail: dias@ime.unicamp.br</p><p>N.L. Garciae-mail: nancy@ime.unicamp.br</p><p>A.Z. Zambome-mail: adrzzz@yahoo.com</p></li><li><p>522 R. Dias et al.</p><p>A similar problem is to find a flight planning that avoids threat or turbulence zones.This avoidance must be achieved respecting some further constraints. For instance,a safe distance r must be kept at all times between the vehicle and the obstacles,while avoiding further areas like craters. Moreover, the trajectory has to follow asmooth curve because vehicles or planes cannot make abrupt turns. For more de-tails about autonomous vehicles see information about DARPA Grand Challenge(http://www.darpa.mil/grandchallenge).</p><p>A large body of literature has emerged over the past two decades on motionplanning for car-like mobile robots and Unmanned Aerial Vehicles (UAV). See thebooks [6, 13, 19] for introductory material, and [14, 15] for up-to-date results. Manydeterministic approaches have been proposed for obstacle avoidance problems. Theycan be classified into search-based methods, geometric approaches, control theoret-ical methods and artificial potential field methods. Some authors use an exhaustivesearch-based method that explores the configuration space by propagating step mo-tions for some controls, see for example [4]. The usual approach using dynamic pro-gramming divides the state space into cells of specified dimensions and places therestrictions in each cell along prescribed headings. The computational cost of thisapproach increases as the cell sizes decrease and the number of allowed headings in-creases. Moreover, the paths must be smoothed out to avoid abrupt heading changes.When the threat zones are circular, the simplest solution for the problem consists ofstraight line segments and circular arcs. The possible segments are easily enumer-ated by a search algorithm. Asseo [2] proposed an algorithm based on a geometricconstruction that uses linear segments tangent to the threat periphery and circular seg-ments along the threat periphery, to obtain the shortest route between the starting andthe destination points using the principle of optimality. This proposal cannot be gen-eralized to non-circular threat zones. Graph theory has been used lately to constructplanar coverage strategies for autonomous vehicle, see for instance [23].</p><p>Optimization problems posed by paths connecting two points have intrinsic math-ematical interest and appear in a number of applications besides robotics. We men-tion, in particular, the mountain-pass problem, of importance in non-linear analysisand computational chemistry, which has been the object of a vast literature. See [16]for a good introduction to the subject. This problem, however, looks only to criticalpoints of a path, rather than to the determination of the whole path.</p><p>We propose a penalized optimization procedure to obtain an approximate solutionto the problem. We consider functions belonging to a finite-dimensional approxi-mating space generated by B-splines basis and impose a penalization on solutionsthat do not comply with the constrains. Our approach presents several advantages:(i) It transforms an infinite-dimensional problem into a finite-dimensional one and,in practice, only few coefficients have to be computed; (ii) it naturally changes theconstrained optimization into an unconstrained one, and (iii) it can easily deal withpop-up threats without increasing the run-time. However, perhaps the main novelty ofour approach is that it can incorporate non-homogeneous error measurements in thelocation of the obstacles/threat zones, in which case it yields a consistent stochasticpath. That is, it can treat situations in which the avoidance set is not known exactlybut it is observed through a random mechanism that adds a random noise. In thesecases it produces a stochastic solution that converges to the deterministic one as thenumber of independent observations increases.</p></li><li><p>A penalized nonparametric method for nonlinear constrained 523</p><p>In this paper, we will analyze the problem both under the deterministic and sto-chastic scenarios. The former is studied in Sect. 2. There we assume a vehicle/planewith perfect sensors that can find the obstacles/threat zones without error. In this case,the path planning is obtained by solving a penalized optimization problem. In Sect. 3we consider noisy determination of obstacles and find a stochastic solution based onindependent readings. This solution converges, as the number of readings increase,to the former deterministic solution. Furthermore, in Sect. 5 we consider briefly thestepwise case where the region of interest is split into s pieces and the problem has tobe solved sequentially in each sub-region. This corresponds to an obstacle field thatis not entirely known and a vehicle that cannot see the whole space. It also applies tosituations with pop-up threat zones. This partial vision case is important not only perse but also because it allows to construct trajectories that are not graphs of functions.In this case, the trajectory is constructed piecewisely using the same algorithm. Sim-ilar ideas were used in practice during the 2005 DARPA Challenge by Caltech Team,see [7].</p><p>2 An optimization problem</p><p>In this work, we study the following nonlinear constrained optimization problem.Let A = (xa, ya) and B = (xb, yb) be two points in R2, with xa &lt; xb . Without loss ofgenerality, we will consider A = (0,0) and B = (b,0) (if not, a change of coordinatescan be used). We search for a path with minimum length that can be represented asthe graph of a smooth function f</p><p>Graph (f ) = {(x, y) : x [xa, xb] and y = f (x)}.To be precise on what we called a smooth trajectory, we consider only functions fbelonging to a subset of the Sobolev space</p><p>H22 :={f : [xa, xb] R,</p><p>f 2 +</p><p>(f )2 +</p><p>(f )2 &lt; , f (xa) = ya,</p><p>f (xb) = yb}.</p><p>This Sobolev space is convenient for our purposes because it consists of smoothfunctions that can be well approximated by uniform B-splines, see [21]. Moreover,we want to constrain the search to paths that comply with the restriction of avoidingan open region R2 which represents a region around certain obstacles or threatzones. We need open regions in order to have a unique solution for the optimizationproblem (see explanation after (2.5)).</p><p>Therefore, the goal is to find a smooth function f belonging to H22 satisfying:1. The trajectory has to go through the points A = (0,0) and B = (b,0), i.e. f (0) = 0</p><p>and f (b) = 0.2. The trajectory has to avoid some set around the obstacles (or the threat zones),</p><p>that is, Graph (f ) = for some fixed open set .</p></li><li><p>524 R. Dias et al.</p><p>3. The function f minimizes the trajectory in the sense that the length of Graph (f )defined by</p><p>Q(f ) := b</p><p>0</p><p>(1 + f (t)2)dt</p><p>is minimum.</p><p>Notice that the constrained minimization problem can be viewed as a penalizedproblem where the penalty is 0 or according to Graph (f ) = (the path doesnot intercept the obstacle region) or not. That is, we want a solution of</p><p>minfH22</p><p> b0</p><p>(1 + f (t))2dt + J (f ) (2.1)</p><p>where</p><p>J (f ) ={</p><p>0, if Graph (f ) = ,, if Graph (f ) = . (2.2)</p><p>In general, the solution for (2.1) is very difficult to find or even, in some cases,nonexistent depending on the set , because we are restricting ourselves to functionsbelonging to H22.</p><p>For the sake of simplicity in notation, from now on we will consider that wehave L points in R2 with coordinates i = (wi, vi), i = 1, . . . ,L. Denote by N ={1, 2, . . . , L} and</p><p> =L</p><p>i=1B(i, r)</p><p>where B(, r) = {z R2 : d(z, ) &lt; r} and d is the Euclidean distance. It is easy tosee this set up can be generalized in a straightforward manner to more general sets.</p><p>To overcome the problems posed by (2.1), first we approximate the penalizationJ (f ), by the smooth functional</p><p>J,,n(f ) = (Z +</p><p>H(r d(f,N))) (2.3)</p><p>where d(f,N) = inf{d(z, ) : z Graph (f ), N}, is the cumulative standardGaussian distribution, Z is its th percentile and (,,H) are tuning parame-ters. This penalization is convenient since it follows that J,,H (f ) J (f ) when , 0 and H . In Sect. 2.1 we explain the roles of the tuning para-meters.</p><p>Second, it is well-known that H22 is an infinite-dimensional space, but it can bewell approximated by a finite dimensional space which is spanned by K (fixed) basisfunctions, such as Fourier expansion, wavelets, B-splines, natural splines, see forexample [10, 12, 18, 21, 22, 24]. In this work, following [21] we will fix K and asequence t = (t1, . . . , tK2) and consider f belonging to the space HK spanned byB-splines with interior knot sequence t. That is,</p><p>f (x) = f (x) =K</p><p>j=1jBj (x) (2.4)</p></li><li><p>A penalized nonparametric method for nonlinear constrained 525</p><p>Fig. 1 Basis functions with 6knots placed att = (0.0,0.2,0.4,0.6,0.8,1.0)</p><p>where Bj are the well-known cubic B-spline basis (order 4) and = (1, . . . , K) isa vector of unknown coefficients.</p><p>Figure 1 presents 6 B-splines functions for equally spaced knots in [0,1]. It iswell known that B-splines are splines which have smallest possible support. In otherwords, B-splines are zero in a large set. Furthermore, a stable evaluation of B-splineswith the aid of a recurrence relation is possible. For details, see [8].</p><p>Therefore, we want to find f HK , or equivalently = (1, . . . , K) RK whichminimizes</p><p>Q,,r,H () = b</p><p>0</p><p>(1 +</p><p>(K</p><p>j=1jB</p><p>j (t)</p><p>)2)1/2dt</p><p>+ (Z +</p><p>H</p><p>(r d</p><p>(K</p><p>j=1jBj (),N</p><p>))), (2.5)</p><p>subject to f (0) = 0, f (b) = 0. At this point we can see the need to consider onlyopen balls around the obstacles (in general, to be an open set). If not, the minimumin (2.5) is not attainable.</p><p>Notice that the penalized approach is very appealing since it allows us to changethe constrained nonlinear problem of finding a function into an unconstrained non-linear problem of finding a vector on RK2. This problem was solved by using thefunction fminunc from MATLAB which is based on the well-known BFGS Quasi-Newton method with a mixed quadratic and cubic line search procedure.</p><p>2.1 The tuning parameters</p><p>Notice that the functionals J and J,,H depend on the function f only through itsdistance to the obstacle field (d(f,N)), thus with an abuse of notation we introducethe real-valued functions defined for x [0,) as</p><p>J (x) ={</p><p>0, if x r,, if x &lt; r (2.6)</p></li><li><p>526 R. Dias et al.</p><p>and</p><p>J,,n(x) = (Z +</p><p>H(r x)). (2.7)</p><p>The function J,,H is a continuous analog of J . The roles of the tuning parameters(,,H) are = J,,H (r), = maxx0 J,,H (x) and H controls the steepnessof J,,H at the point r . They should be chosen in such way that, when the trajectorytries to violate the constraint (e.g., the distance between the vehicle and the obstacleshave to be bigger than r at all times, the plane has to avoid threat zones) the penaliza-tion is so much bigger than the gain in the distance that this trajectory cannot occur.Figure 2 shows the effect of the tuning parameter H on the penalty J,,H (f ), fora better visualization we fixed = 30. However, for computation and numericalexamples we will use . = 0.05.</p><p>Tables 1 and 2 present some simulation results for sets given by Figs. 3 and 4.Notice that as increases ( decreases, recall that = 0.05/) and/or H increaseswe get closer and closer to the best trajectory until it stabilizes. From these simulatedresults, we choose = 106b, = 0.05/ e H = 106b.How many knots? In fact, in approximation theory, one of the most challengingproblem is how to select the dimension of the approximant space. A similar problemis encountered in the field of image processing where the level of resolution needs tobe determined appropriately. Figure 5 presents several sets with different degrees</p><p>Fig. 2 Effect of the tuningparameter H on the penaltyfunction J,,H (f ), = 100, = 0.3, r = 0.5</p><p>Table 1 Length of the chosentrajectory for presented inFig. 3</p><p>3 105 103 102 101 1</p><p>n 1030.5 15.1311 15.1311 15.1311 15.13111.5 15.1286 15.1288 15.1290 15.1311</p><p>15 15.1241 15.1247 15.1248 15.1248150 15.1237 15.1238 15.1238 15.1241</p><p>1500 15.1220 15.1220 15.1220 15.122115000 15.1211 15.1211 15.1211 15.1211</p></li><li><p>A penalized nonparametric method for nonlinear constrained 527</p><p>Table 2 Length of the chosentrajectory for presented inFig. 4</p><p>6 105 103 102 101 1</p><p>n 1030.5 30.0794 30.0794 30.0794 30.07943 30.0794 30.0794 30.0794 30.0794</p><p>30 30.0766 30.0776 30.0777 30.0778300 30.0778 30.0778 30.0778 30.0778</p><p>3000 30.0757 30.0757 30.0758 30.075830000 30.0756 30.0756 30.0756 30.0757</p><p>Fig. 3 Example of a set</p><p>Fig. 4 Example of a set</p><p>of difficulty for finding a trajectory. These fields were construct to test the strengthof the algorithm since the best route is not easy. We could see that increasing thenumber of interior knots above 4 did not bring any improvement. With 3 or 4 interiorknots we obtain the best possible f . If necessary, the choice of the number of knotscan be very adaptive, see for example [1, 5, 9, 11, 17, 20] and easily implemented.</p><p>3 A stochastic problem. Complete vision</p><p>In the previous section, we assumed that the set is deterministic, in the applicationsthis would mean the sensors of the vehicle/plane can see the whole field and detect</p></li><li><p>528 R. Dias et al.</p><p>Fig. 5 Estimated best trajectory using 4 internal knots</p><p>with certainty the placement of the obstacles/threat zones. This is not realistic, thereis always a measurement error involved. I...</p></li></ul>


View more >