Stats help? Pleeeeeassse?

Avatar for sneaks

I need help with statistical power.

I have 40 participants, 2 groups of 20. I want to compare them, so would want to do either a T-test or ANOVA.

I've used G*power, but can't work out what the hell its going on about. I just want to know whether I have enough people to do a t-test or whether I should do a mann-whitney instead???

Avatar for sneaks

ok I've worked out that if I use a t-test the power will be about .45 which is RUBBISH.

So what do I do now???

Do I just say in my article that "the power was rubbish" or do I do a different test?

From what I've read non-parametric tests have less power. So confused.

C

This is what I'd do:

Do the t-test. If the answer is significant you had sufficient participants.
If the answer in non significant look at the effect size, if it is a reasonable effect size then maybe it is a genuine effect but you had insufficient power to detect it (ie not enough participants). If it is very small then you can argue that it is a genuine finding that there is no difference. t-tests are often done on an n or 20 per group in psychology.

Check in Andy Field's book for how to calcuate effect size and what is a small, medium or large effect.

Avatar for sneaks

Excellent! thank you

I have some non-significant results and some significant. I have run 5 independent t tests, and then another 5 (1 set for positive and 1 set for negative) So - here's my next question.

Do I have to do boneferroni correction .05/5 OR .05/10 because overall there are 10 tests, but only 5 in each set?????

I seem to have some non sig results, some very sig and some approaching signficance - so hopefully i can argue that the non-sig ones would be significant! :-) :-):-)

C

Most papers I read don't seem to bother with bonferroni corrections (even if a statistician would argue they should) so I'd try and get away with doing as few as possible! If you can argue that the positive and negative are independent then you could do each divided by 5 for 5 t-tests in each set ie p of 0.01 (I think but could be wrong)

Avatar for sneaks

I'm just about to get a call from sup - I think she is going to advocate MANOVA :-s which I really don't want to do. I'd rather do t-tests or ANOVA followed by t-tests. I'll wait and see what she says!

C

Quote From sneaks:

ok I've worked out that if I use a t-test the power will be about .45 which is RUBBISH.

So what do I do now???

Do I just say in my article that "the power was rubbish" or do I do a different test?

From what I've read non-parametric tests have less power. So confused.



You can't choose whether you perform a mann whitney or t-test based on power. The choice is made based on whether your data are normally distributed or not.

C

Quote From sneaks:

ok I've worked out that if I use a t-test the power will be about .45 which is RUBBISH.

So what do I do now???

Do I just say in my article that "the power was rubbish" or do I do a different test?

From what I've read non-parametric tests have less power. So confused.


P.S. This web-page is useful: http://www.ats.ucla.edu/stat/spss/whatstat/whatstat.htm

Avatar for sneaks

In the end I went with repeated-measures ANOVA followed up by post-hoc t-tests (dependent or independent, depending on the hypotheses) and I used bootstrapping to help with one of the non-normal variable I had. Transforming didn't help, and I didn't want to lose power with non-parametric tests. I think I'm ok, going to pass it through a stats guru asap though!

14938