
Generated regressor

In least squares estimation problems, sometimes one or more regressors specified in the model are not observable. One way to circumvent this issue is to estimate or generate regressors from observable data. This generated regressor method is also applicable to unobserved instrumental variables. Under some regularity conditions, consistency and asymptotic normality of least squares estimator is preserved, but asymptotic variance has a different form in general.
Suppose the model of interest is the following:
where g is a conditional mean function and its form is known up to finite-dimensional parameter β. Here formula_2 is not observable, but we know that formula_3 for some function "h" known up to parameter formula_4, and a random sample formula_1 is available. Suppose we have a consistent estimator formula_6 of formula_4 that uses the observation formula_8's. Then, β can be estimated by (Non-Linear) Least Squares using formula_9. Some examples of the above setup include Anderson et al. (1976 and Barro (1977). 
This problem falls into the framework of two-step M-estimator and thus consistency and asymptotic normality of the estimator can be verified using the general theory of two-step M-estimator. As in general two-step M-estimator problem, asymptotic variance of a generated regressor estimator is usually different from that of the estimator with all regressors observed. Yet, in some special cases, the asymptotic variances of the two estimators are identical. To give one such example, consider the setting in which the regression function is linear in parameter and unobserved regressor is a scalar. Denoting the coefficient of unobserved regressor by formula_10 if formula_11 and formula_12 then the asymptotic variance is independent of whether observing the regressor.
With minor modifications in the model, the above formulation is also applicable to Instrumental Variable estimation. Suppose the model of interest is linear in parameter. Error term is correlated with some of the regressors, and the model specifies some instrumental variables, which are not observable but have the representation formula_13. If a consistent estimator of formula_4 of formula_15 is available using formula_16 as instruments, the parameter of interest can be estimated by IV. Similar to the above case, consistency and asymptotic normality follows under mild conditions, and the asymptotic variance has a different form than observed IV case. Yet, there are cases in which the two estimators have the same asymptotic variance. One such case occurs if formula_17In this special case, inference on the estimated parameter can be conducted with the usual IV standard error estimator.