What to do tomorrow

1) check why using “cond()” rather than “replace” leads to better rate of convergence.
2) check whether we made any mistake translating code from intreg to our gmm code. (especially the cond() thing)
3) if “cond()” is better than use it instead of “replace”
4) Is code for b/sigma correct? that is, the “cond()” and “replace” thingy.

: 31 Aug 2006 23:51 |  Comments (3) |  Close comments |  Report a problem

Simulation 2

Today I tried to change the moment conditions for the intercept, coefficient and for sigma. I hope that, with modifications, the code might work better. Instead of writting two lines of codes for r = 1 and r = 0, I combine them together using (1–r) and (r). However, this does not change the results.

: 09 Aug 2006 14:55 |  Comments (0) |  Close comments |  Report a problem

Simulation 1

Today, I compared two simulation studies; 40 replications, discrete missing mechanism, but one study uses bb–parameters whereas the other uses bs parameters. It seems that the study with bb–parameters is better. This result againsts the original result from LFS data. There, I concluded that bs–parameter is better.

: 08 Aug 2006 23:37 |  Comments (0) |  Close comments |  Report a problem

The Beginning of The End

(1) Time Line
August : Simulations, Learn Matlab, Chapter 1?
September: Moving out of the office
October
November
December
January
Febuary
March

There are about 8 months left before April!!

What have to be done:
– Simulation Studies ( a lot)
– finish First Chapter with Richard (difficult)
– Tang Little and Rubin's estimator
– Bounds
– Maximum Score for IPW

(_'')

Today, I tried to fix the simulation's programme by changing the "genr"; that is, use the discrete missing–mechanism. However, this does not help the problem. The convergence rate is still poor. why?

: 07 Aug 2006 11:18 |  Comments (0) |  Close comments |  Report a problem

Identification on the theory part

For identification issue. When Y is continuous, Tang Little and Raghunathan (2003) mentions that only a certain type of parametric family can be allowed. We have to argue against this.

We might be able to use Manski's things. But we have to combine the identification in choice-based sampling with missing-data. Show that when P(Y|X) is specified, any model is ok.

Show that when H(Y,X) and f(X) are known, the missing-data mechanism is known. So missing-data becomes choice-based sampling problem. Then, when P(Y|X) is specified, all we have to do is to find an objective function that its unique solution is the true theta. In this second step, we may be able to use some material from Manski's chapter about choice-based sampling.

: 05 Jan 2006 16:32 |  Comments (0) |  Close comments |  Report a problem

Meeting with Mark, Tuesday 22

(1) Tidy up the report by

– find a criteria for cutting or not the outliers

– use pwt03 weight as pwit03 is not exogenous weights

– use pweight instead of fweight

– find in the stat literature on how to adjust extreme weights

– use hetprob model instead of probit, find other binary choice model as well.

– read the paper that Mark gave about weighted OLS

– add some details that Mark asks in the report.
(2) prepare for the Selection model.

: 24 Nov 2005 16:15 |  Comments (0) |  Close comments |  Report a problem

Works to be done in the next week

1 Continue writting Richard's chapter
2 Read Mark's reply and prepare for discussing with him
3 Prepare for teaching next Wednesday
4 Prepare for discussing with Richard about SKinner's paper

There is a possible overlap between (2) and (4).

: 11 Nov 2005 11:00 |  Comments (0) |  Close comments |  Report a problem

Plewis's example and Weighting in Regression Model

Plewise's example of whether to use non-response weights or not is very interesting. How it is related to weighting in a regression context? Can we just adopt it? Maybe not. In conditional model context, we know that if response prob. vary with X then the adjusted mean is better than an unadjusted?

We should try to apply Richard approach to Examples of Plewise.
In this examples, research ignored the information about missing-mechanism. That is, he still clings on to the fact that response rate in stratum 1 is 0.9 and in Stratum 2 is 0.7. How about if we stratify the population according to the values of the binary variable of interest?
So the response rate is not for each stratum, but for each possible values of the variable of interest, which is 0 and 1.

This means that we have to stratify each stratum into two substratum and then apply the Rihcard's method. Very interesting to see what will happen if we use this weight instead.

: 25 Oct 2005 16:00 |  Comments (0) |  Close comments |  Report a problem

An Idea about the future work on Weighting

From the sheet about weighting of ESDS, we know that there are 3 types of weights:
(1) Sample Design or Probability Weights;
(2) Non-response weights ;
(3) Post-stratification weights.
Based on observed variables, one calculate the prob of an observation being included and weight the observation with the inverse of this weight.

Weight (2) is also a type of IPW. However, we use an incomplete set of variables to put observations into different classes and observations in the same class are given the same weight. Thus, we implicitly make an assumption that observations in the same class are of the same characteristic. Of course, this could be wrong.

Weight (3) is just a fequency weight to adjust our sample to represent the real population.

The thing is they normally combine these weights together. As we can see, (1) is like the weight in IPW M-estimtor and (2) is the weight of Richard and Esmeralda. Can we find an optimal way to combine these two weights?? Note that (1) can be continuously vary with observations according to its definition but (2) have to be constant for observations in the same class.

Another point is whether there is a difference between weighting of survey data in general and weighting in a particular study. For example, in a dataset from LFS that we are working on, there are two weights provided. However, "hrrate" is not fully observed and we would like to do IPW M-estimation to take an account of this missingness. So even though the weights provided (pwt03, piwt03) are calculated using non-response weight, we should calculate our own weights and combined them together???

: 25 Oct 2005 11:13 |  Comments (0) |  Close comments |  Report a problem

Meeting wit Mark today

Things to do
(1) plot "lev" against "iprob" as the measure of detacting troblesome observations.
(2) Test whether normality assumption is suitable for our binary choice model or not.
(3) If not, find alternative (note that "unusual" weights aggsigned to observations could happen because we use the wrong model for e of the latent regression)
(4) We do not include "lhourpay" into the structral model because there is not suitable interpretation of the coef of this variable.
(5) we do not include "lhourpay" into the probit model because we would like to use the same set of X's as in the structural model.
(6) Write a report to Mark, showing results of various regression.
(7) Trim the "iprob" using the sample size because this will not affect the asymptotic probperties of the estimator (as the treshold "N" become infinity and we effectively do not trim the weights)
(8) Try Logit instead of Probit to see whether it affects the two observations with high "iprob" or not.
(9) try to code people who study over 30 years as leaving education at 24 to work and then later come back to study. So start calculating work experience from 24 year of age.

: 19 Oct 2005 13:38 |  Comments (0) |  Close comments |  Report a problem