In previous lecture, we dealt with the unboundedness problem of LPM using the logit model.

1. In previous lecture, we dealt with the unboundedness problem of LPM using the logit model. In this lecture, we will consider another alternative, i.e. the probit model. Adapted from “Introduction to Econometrics” by Christopher Dougherty

2. BINARY CHOICE MODELS: PROBIT ANALYSIS In the case of probit analysis, the sigmoid function is the cumulative standardized normal distribution. The maximum likelihood principle is again used to obtain estimates of the parameters.

3. Estimating the probability of success Suppose that the probit equation yields a Z = +0.2171. Since Z is positive, the area in the larger portion of the curve is 0.5859, or a prediction of a 58.59% success rate [You can use a standard normal table or Excel function NORMSDIST]. Area = 0.5859 Z= + 0.2171

4. Quantifying the Marginal Effect We will do this theoretically for the general case where Z is a function of several explanatory variables. Since p is a function of Z, and Z is a function of the X variables, the marginal effect of Xi on p can be written as:

5. (1) The marginal effect of Z on p is given by the standardized normal distribution. (2) The marginal effect of Xi on Z is given by bi.

6. (3) Hence we obtain an expression for the marginal effect of Xi on p. As with logit analysis, the marginal effects vary with Z. A common procedure is to evaluate them for the value of Z given by the sample means of the explanatory variables.

7. ILLUSTRATION • Why do some people graduate from high school while others drop out? Here we use the same multivariate example as in the case of logit model (see Illustration 2 in logit lecture slides), so as to facilitate comparison.

8. . probit GRAD ASVABC SM SF MALE Iteration 0: log likelihood = -118.67769 Iteration 1: log likelihood = -98.195303 Iteration 2: log likelihood = -96.666096 Iteration 3: log likelihood = -96.624979 Iteration 4: log likelihood = -96.624926 Probit estimates Number of obs = 540 LR chi2(4) = 44.11 Prob > chi2 = 0.0000 Log likelihood = -96.624926 Pseudo R2 = 0.1858 ------------------------------------------------------------------------------ GRAD | Coef. Std. Err. z P>|z| [95% Conf. Interval] -------------+---------------------------------------------------------------- ASVABC | .0648442 .0120378 5.39 0.000 .0412505 .0884379 SM | -.0081163 .0440399 -0.18 0.854 -.094433 .0782004 SF | .0056041 .0359557 0.16 0.876 -.0648677 .0760759 MALE | .0630588 .1988279 0.32 0.751 -.3266368 .4527544 _cons | -1.450787 .5470608 -2.65 0.008 -2.523006 -.3785673 ------------------------------------------------------------------------------

9. . sum GRAD ASVABC SM SF MALE Variable | Obs Mean Std. Dev. Min Max -------------+-------------------------------------------------------- GRAD | 540 .9425926 .2328351 0 1 ASVABC | 540 51.36271 9.567646 25.45931 66.07963 SM | 540 11.57963 2.816456 0 20 SF | 540 11.83704 3.53715 0 20 MALE | 540 .5 .5004636 0 1 As with logit analysis, the coefficients have no direct interpretation. However, we can use them to quantify the marginal effects of the explanatory variables on the probability of graduating from high school. We will estimate the marginal effects, putting all the explanatory variables equal to their sample means.

10. Step 1: Calculate Z, when the X variables are equal to their sample means. ASVABC 51.36 0.065 3.328 SM 11.58 –0.008 –0.094 SF 11.84 0.006 0.066 MALE 0.50 0.063 0.032 Constant 1.00 –1.451–1.451 Total 1.881

11. Step 2: Calculate Step 3: Calculate Note that:

12. ASVABC 0.065 0.068 0.004 SM–0.008 0.068 -0.001 SF 0.006 0.068 0.000 MALE 0.063 0.068 0.004 We see that a one-point increase in ASVABC increases the probability of graduating from high school by about 0.004, i.e. 0.4%. Mother's schooling (SM) has negligible effect and father's schooling (SF) has no discernible effect at all. Males have 0.4 percent higher probability of graduating than females.

13. What is the probability of graduating when ASVABC equal to (a) 30 (b) 50 ? Set the values of other X variables equal to their sample means. ASVABC30 0.065 1.95 SM 11.58 –0.008 –0.094 SF 11.84 0.006 0.066 MALE 0.50 0.063 0.032 Constant 1.00 –1.451–1.451 Total 0.503 NORMSDIST (0.503) =0.6925 When ASVABC = 30, the probability of graduating is 69.25%.

14. When ASVABC = 50, the probability of graduating is 96.43%. ASVABC50 0.065 3.25 SM 11.58 –0.008 –0.094 SF 11.84 0.006 0.066 MALE 0.50 0.063 0.032 Constant 1.00 –1.451–1.451 Total 1.803 NORMSDIST (0.503) =0.9643

15. Logit versus Probit Logit Probit Linear f(Z)b f(Z)b b ASVABC 0.004 0.004 0.007 SM–0.001 –0.001 –0.002 SF 0.000 0.000 0.001 MALE 0.004 0.004 –0.007 The logit and probit results are displayed for comparison. The coefficients in the regressions are very different because different mathematical functions are being fitted. Nevertheless the estimates of the marginal effects are usually similar.

16. However, if the outcomes in the sample are divided between a large majority and a small minority, they can differ. This is because the observations are then concentrated in a tail of the distribution. Although the logit and probit functions share the same sigmoid outline, their tails are somewhat different. This is the case here, but even so the estimates are identical to three decimal places.

17. So, logit or probit? The logit model is easier to compute, and used to be more popular than the probit model. Probit model is theoretically more appealing as it is based on normal distribution. However, it uses more computer time. Given computer technology advanced nowadays, the choice between the logit model and probit model is a matter of taste.