Compares and combines effect sizes in original and follow-up studies

Source: R/meta_rep.R

This function can be used to compare and combine any effect size using the effect size estimate and its standard error from the original study and the follow-up study. The confidence level for the difference is 1 – 2*alpha, which is recommended for equivalence testing.

replicate.gen(alpha, est1, se1, est2, se2)

Arguments

alpha

alpha level for 1-alpha confidence

est1

estimated effect size in original study

se1

effect size standard error in original study

est2

estimated effect size in follow-up study

se2

effect size standard error in follow-up study

Value

A 4-row matrix. The rows are:

  • Row 1 summarizes the original study

  • Row 2 summarizes the follow-up study

  • Row 3 estimates the difference in effect sizes

  • Row 4 estimates the average effect size

Columns are:

  • Estimate - effect size estimate (single study, difference, average)

  • SE - standard error

  • z - z-value

  • p - p-value

  • LL - lower limit of the confidence interval

  • UL - upper limit of the confidence interval

References

Bonett DG (2021). “Design and analysis of replication studies.” Organizational Research Methods, 24(3), 513--529. ISSN 1094-4281, doi:10.1177/1094428120911088 .

Examples

replicate.gen(.05, .782, .210, .650, .154)
#>                       Estimate        SE         z            p         LL
#> Original:                0.782 0.2100000 3.7238095 1.962390e-04  0.3704076
#> Follow-up:               0.650 0.1540000 4.2207792 2.434593e-05  0.3481655
#> Original - Follow-up:    0.132 0.2604151 0.5068831 6.122368e-01 -0.2963446
#> Average:                 0.716 0.1302075 5.4989141 3.821373e-08  0.4607979
#>                              UL
#> Original:             1.1935924
#> Follow-up:            0.9518345
#> Original - Follow-up: 0.5603446
#> Average:              0.9712021

# Should return: 
#                      Estimate        SE         z            p         LL        UL
#  Original:              0.782 0.2100000 3.7238095 1.962390e-04  0.3704076 1.1935924
#  Follow-up:             0.650 0.1540000 4.2207792 2.434593e-05  0.3481655 0.9518345
#  Original - Follow-up:  0.132 0.2604151 0.5068831 6.122368e-01 -0.2963446 0.5603446
#  Average:               0.716 0.1302075 5.4989141 3.821373e-08  0.4607979 0.9712021