Statistical type II error (beta), and power

1 min read

Even though I learned power analysis in elementary statistics class, I totally forget it because I never use it. As we have to put power analysis in our grant, I am forced to relearn this topic.

Definition: type II error:

  • null hypothesis should be rejected but we don’t
  • or, false negative (there is an effect but fail to detect it)

(Null hypothesis is usually boring, e.g. mean=0, or no difference between two samples etc. So null hypothesis usually means no effect, or negative. Rejecting null hypothesis is “finding positive effect” and thus usually “exciting”. )

Definition: the probability of type II error is called beta

Definition: power is 1 – beta

How to calculate beta (or power)?

You need (1) null hypothesis (2) alpha, type I error cut off, usually 0.05 (3) standard deviation (or distribution) of samples

Step:

  1. calculate the decision point (to reject or accept null hypo) based on your null hypo and alpha
  2. calculate beta based on the decision point above and (3)

Example:

You null hypothesis is “mean of A is 0”. You measured A 100 times. The mean is 1 and standard deviation is 10 (and thus the standard deviation of mean is 10/sqrt(100)=1). You are deciding if the null hypothesis should be rejected and what is beta if alpha is 0.05. You calculate and find the p value is 0.1587, which is bigger than 0.05 so you accept the null hypothsis.

Then what is the probability that this decision is indeed wrong (you accept null hypo but indeed null hypo is false)? or beta?

As you make decisions based on alpha = 0.05, that means your decision point of mean of sample is 1.65: if the mean of sample is bigger than 1.65, you reject null; if smaller than 1.65, you accept it (like in our case where mean is 1). So beta equals to the probability that you find mean of sample is <1.65, while the true mean is 1. And this probability is 0.74. And power is thus 0.26.

To increase power, you usually need to increase the sample size. In our case, as the standard deviation of sample is very high, we need a lot more samples. If our N = 400, then our decision point will become 0.83 and the power will increase to 0.63.



写作助手,把中式英语变成专业英文


Want to receive new post notification? 有新文章通知我

第五十期fNIRS Journal Club通知2024/03/30, 10am 王一晖

早期的 STEM 教育对于以后的学习至关重要。现有研究尚未就STEM教学法达成共识,学生先验知识对基于故事的STEM教学法的影响还有待探讨。来自澳门大学张娟教授团队的王一晖将会分享基于fNIRS超扫描
Wanling Zhu
9 sec read

第四十九期fNIRS Journal Club视频 高倩博士

Youtube: https://youtu.be/a2QlCFZUytA优酷: https://v.youku.com/v_show/id_XNjM3MjMyNjUxMg==.html 竞技比赛中,
Wanling Zhu
12 sec read

第四十九期fNIRS Journal Club通知2024/02/24, 10am 高倩博士

竞技比赛中,特别是需要注意高度集中的射击项目中,如何保持稳定的注意控制对运动员的表现至关重要。近期的一项研究调查了赛前短时正念练习是否对运动员在射击比赛中的注意控制具有提升作用。来自北京体育大学心理学
Wanling Zhu
9 sec read

2 Replies to “Statistical type II error (beta), and power”

  1. Hi,
    I came through your article while i was searching on how to answer some statistic questions posted to me. I hope you are generous enough probably to help me out with the questions as statistics are totally beyond my field.

    The questions are: Calculate the coeeficient of variance and use it to determine the power of the study.

    Here is the scenario:
    We have 1 group of 22 subjects which was divided into 2 groups. Each group will be given TEST product or REFERENCE product and blood samples will be taken. The group will be switched to receive the other treatment after 1 week wash out period, hence yielding 22 readings each for TEST & REF.

    For Cmax, Mean TESTcmax = 11.43 ng/ml ; REFcmax = 10.27 ng/ml
    Standard deviation Cmax: TESTstdv = 5.88 ; REFstdv= 7.26

    You can find the Anova table here:
    http://answers.yahoo.com/question/index?qid=20140225204032AA9t1nP

    Hope you have your reply soon.

    TQ

Leave a Reply

Your email address will not be published. Required fields are marked *