What is the difference between two stage least squares and instrumental variable regression?

Question

I'm doing independent study and I am having trouble understanding the difference between these two estimators.

I get that 2SLS is predicting the endogenous variable, and that instrumental variables are similar to proxy variables, but I don't get how one differs from the other.

Paul · Accepted Answer

IV estimators are 2SLS estimators.
An IV estimator is the sample analog of the form: $beta = frac{Cov(Y, Z)}{Cov(X, Z)}$, where $Y$ is the outcome variable, $X$ is the endogenous variable, and $Z$ is the instrumental variable.
It can be shown that the 2SLS is of the above form. The advantage of 2SLS estimators over other IV estimators is that 2SLS can easily combine multiple instrumental variables, and it also makes including control variables easier.

chan1142 · Answer

The meaning of the words first

Some people use the word "IV estimator" to refer to any estimator that uses instrumental variables. To them, IV estimators contain 2SLS, LIML, k-class estimators, and others, so 2SLS is a special case of IV. For example, the title of Bekker's (1994, Econometrica) paper is "Alternative approximations to the distribution of instrumental variable estimators".

More traditional people mean by IV the particular instrumental variable estimator $(Z'X)^{-1}Z'y$ for the exactly identified case ($Z$ = instrument matrix, $X$ = regressor matrix, $y$ = regressand vector), and 2SLS is a generalization of IV to the overidentified case. But, as Paul says, 2SLS can be expressed as an IV estimator of this second sense because it is $(hat{X}'X)^{-1} hat{X}'y$, where $hat{X} = Z(Z'Z)^{-1}Z'X$ is the instrument matrix.

I personally think it is very fine to leave the meaning of IV estimators ambiguous because the meaning is usually clear in the context and we need not rigorously distinguish them.

As for your question ...

It seems to me that the sentence "2sls is predicting the endogenous variable" means the first stage regression of the endogenous regressor on the instrumental variables (to get $hat{X}$). The expression "instrumental variables are similar to proxy variables" looks more casual. Proxy variables (e.g., IQ for ability) can be used to solve the endogeneity problem. Instrumental variables are another way of solving the endogeneity problem. In that sense they are "similar".

Kenzie · Answer

Generally 2SLS is referred to as IV estimation for models with more than one instrument and with only one endogenous explanatory variable.
You can also use two stage least squares estimation for a model with one instrumental variable. 
It can be shown that IV estimation equals 2SLS estimation when there is one endogenous and one instrumental variable.
Finally 2SLS can be used for models with multiple endogenous explanatory variables as long as we have the same amount of instruments as endogenous variables.

What is the difference between two stage least squares and instrumental variable regression?

3 Answers

Add your own answers!

Ask a Question