1 / 17

Sampling plans

Sampling plans. Given a domain, we can reduce the prediction error by good choice of the sampling points The choice of sampling locations is called “design of experiments” or DOE

sorena
Télécharger la présentation

Sampling plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sampling plans • Given a domain, we can reduce the prediction error by good choice of the sampling points • The choice of sampling locations is called “design of experiments” or DOE • The simplest DOE is full factorial design where we sample each variable (factor) at a fixed number of values (levels) • Example, with four factors and three levels each we will sample 81 points • Full factorial design is not practical except for low dimensions

  2. Prediction variance for full factorial design • Recall that standard error (square root of prediction variance is • We start with simple design domain: Box • Cheapest full factorial design: two levels (not good for quadratic polynomials) • For a linear polynomial standard error is then • Maximum error at vertices • Why do we get this result?

  3. Designs for linear RS • Traditionally use only two levels • Orthogonal design when XTX is diagonal • Full factorial design is orthogonal, not so easy to produce other orthogonal designs with less points. • Stability: Small variation of prediction variance in domain is also desirable property

  4. Example 4.2.2 • Compare an orthogonal array based on equilateral triangle to right triangle at vertices (both are saturated) • Linear polynomial y=b1+b2x1+b3x2 • For right triangle we obtained

  5. Comparison • Prediction variances for equilateral triangle • The maximum variance at (1,1) is three times larger than the lowest one. • For right triangle • Maximum variance is nine times the lowest • A fairer comparison is when we restrict triangle to lie inside box • The prediction variance is doubled. Maximum error and stability are still better, but variance in coefficients is not as good.

  6. Quadratic RS • Need at least (n+1)(n+2)/2 points • Need at least three points in every direction • Simplest DOE is three-level, full factorial design • Impractical for n>5 • Also unreasonable ratio between number of points and number of coefficients • For example, for n=8 we get 6561 samples for 45 coefficients. • My rule of thumb is that you want twice as many points as coefficients

  7. Central Composite Design • Includes 2n vertices, 2n face points plus ncrepetitions of central point • Distance of face point α varies • Can choose α so to • achieve spherical design • achieve rotatibility (prediction variance is a spherical function) • Stay in box (face centered) FCCCD • Still impractical for n>8

  8. Spherical CCD From Myers and Montgomery’s Response Surface Methodology. Figure 7.4 in 1995 edition (Fig. 7.5 on next slide)

  9. Spherical CCD for n=3

  10. Repeated observations at origin • Unlike linear designs, prediction variance high at origin • Repetition at origin decreases variance there and improves stability • What other rational for choosing the origin for repetition? • Repetition also gives an independent measure of magnitude of noise • Can be used also for lack-of-fit tests

  11. Without repetition (9 points) Contours of prediction variance for spherical CCD design. From Myers and Montgomery’s Response Surface Methodology. Figure 7.10 in 1995 edition (Fig. 7.11 on next slide)

  12. Center repeated 5 times (13 points) d=ccdesign(2,'center', 'uniform') d = -1.0000 -1.0000 -1.0000 1.0000 1.0000 -1.0000 1.0000 1.0000 -1.4142 0 1.4142 0 0 -1.4142 0 1.4142 0 0 0 0 0 0 0 0 0 0 .

  13. Variance optimal designs • Full factorial and CCD are not flexible in number of points • Standard error in coefficients • A key to most optimal DOE methods is moment matrix • A good design of experiments will maximize the terms in this matrix, especially the diagonal elements • D-optimal designs maximize determinant of moment matrix • Inversely proportional to square of volume of confidence region on coefficients

  14. Example • Given the model y=b1x1+b2x2, and the two data points (0,0) and (1,0), find the optimum third data point (p,q) in the unit square. • We have • So that the third point is (p,1), for any value of p • Finding D-optimal design in higher dimensions is a difficult optimization problem often solved heuristically

  15. Matlab example >> ny=6;nbeta=6; >> [dce,x]=cordexch(2,ny,'quadratic'); >> dce' 1 1 -1 -1 0 1 -1 1 1 -1 -1 0 scatter(dce(:,1),dce(:,2),200,'filled') >> det(x'*x)/ny^nbeta ans = 0.0055 With 12 points: >> ny=12; >> [dce,x]=cordexch(2,ny,'quadratic'); >> dce' -1 1 -1 0 1 0 1 -1 1 0 -1 1 1 -1 -1 -1 1 1 -1 -1 0 0 0 1 scatter(dce(:,1),dce(:,2),200,'filled') >> det(x'*x)/ny^nbeta ans =0.0102

  16. Other criteria • A-optimal minimizes trace of inverse of moment matrix, minimizes the sum of the variances of the coefficients • G-optimality minimizes the maximum of the prediction variance.

  17. Example • For the previous example, find the A-optimal design • Minimum at (0,1)

More Related