서브메뉴
검색
Evaluating Selective Reporting Methods in Meta-Analysis: Considering Dependent Effect Sizes When Estimating Adjusted Effect Sizes
Evaluating Selective Reporting Methods in Meta-Analysis: Considering Dependent Effect Sizes When Estimating Adjusted Effect Sizes
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20260311091539.5
- ISBN
- 9798270232054
- DDC
- 000
- 서명/저자
- Evaluating Selective Reporting Methods in Meta-Analysis: Considering Dependent Effect Sizes When Estimating Adjusted Effect Sizes / Melissa A Rodgers
- 발행사항
- [Sl] : The University of Texas at Austin, 2025
- 형태사항
- 1 electronic resource (169 pages)
- 주기사항
- Source: Dissertations Abstracts International, Volume: 87-06, Section: B.
- 주기사항
- Advisors: Beretvas, S. Natasha; Pustejovsky, James E. Committee members: Whittaker, Tiffany; Yan, Veronica.
- 학위논문주기
- - Ph.D. : The University of Texas at Austin, 2025.
- 초록/해제
- 요약Selective reporting detection tests and adjustment methods evaluate the presence of selective reporting and estimate bias-adjusted average effect sizes to address its impact on meta-analytic results. Available tests and adjustment methods are univariate by design, meaning they only handle a single effect size per primary study, but meta-analyses of education research typically include multiple effect sizes per study. Extending previous methodological studies evaluating the performance of detection tests when dependent effect sizes are present, this study evaluates approaches to estimating bias-adjusted average effect sizes in meta-analyses involving dependent effects. This simulation study examines the performance of three adjustment methods (i.e., Regression-based methods, Trim & Fill, and 3-parameter selection models) to estimate bias-adjusted effect sizes under various conditions. In practice, researchers may or may not report adjusted average effect sizes using either a contingent or non-contingent strategy based on the statistical significance of selection bias detection tests. To this end, this simulation study also compares the accuracy of adjusted effect sizes when they are reported if contingent versus non-contingent on the statistical significance of tests for the presence of selection bias. When selective reporting censoring is high, in general, results indicate poor estimation performance for all selective reporting adjustment methods regardless of approach used to handle dependent effect sizes. Variation by study conditions is reported, including: overall average effect size, amount of between-study heterogeneity, within to between-study heterogeneity ratio, and average sample sizes from primary studies. Performance differences between the contingent and non-contingent strategies for adjusted estimates were primarily observed within the regression-based methods - specifically the aggregating and two modeling approaches - with minimal differences identified in the other estimation methods or approaches to dependency. Results can help guide researchers on the best practices for selective reporting tests and methods to use given certain study conditions. Future research is needed to improve current methods or identify new methods to estimate adjusted effect sizes, particularly when the amount of selective reporting is suspected to be at a higher probability.
- 언어주기
- English
- 일반주제명
- Statistics
- 일반주제명
- Information science
- 기타저자
- The University of Texas at Austin Educational Psychology
- 기본자료저록
- Dissertations Abstracts International. 87-06B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008260311s2025 us eng d■001000017361219
■00520260311091539.5
■006m o d
■007cr|nu||||||||
■020 ▼a9798270232054
■040 ▼aMiAaPQD▼beng▼cMiAaPQD▼erda
■082 ▼a000
■1001 ▼aRodgers, Melissa A.▼eauthor.
■24510▼aEvaluating Selective Reporting Methods in Meta-Analysis: Considering Dependent Effect Sizes When Estimating Adjusted Effect Sizes ▼cMelissa A Rodgers
■260 ▼a[Sl]▼bThe University of Texas at Austin▼c2025
■264 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2025
■300 ▼a1 electronic resource (169 pages)
■336 ▼atext▼btxt▼2rdacontent
■337 ▼acomputer▼bc▼2rdamedia
■338 ▼aonline resource▼bcr▼2rdacarrier
■500 ▼aSource: Dissertations Abstracts International, Volume: 87-06, Section: B.
■500 ▼aAdvisors: Beretvas, S. Natasha; Pustejovsky, James E. Committee members: Whittaker, Tiffany; Yan, Veronica.
■5021 ▼bPh.D.▼cThe University of Texas at Austin▼d2025.
■520 ▼aSelective reporting detection tests and adjustment methods evaluate the presence of selective reporting and estimate bias-adjusted average effect sizes to address its impact on meta-analytic results. Available tests and adjustment methods are univariate by design, meaning they only handle a single effect size per primary study, but meta-analyses of education research typically include multiple effect sizes per study. Extending previous methodological studies evaluating the performance of detection tests when dependent effect sizes are present, this study evaluates approaches to estimating bias-adjusted average effect sizes in meta-analyses involving dependent effects. This simulation study examines the performance of three adjustment methods (i.e., Regression-based methods, Trim & Fill, and 3-parameter selection models) to estimate bias-adjusted effect sizes under various conditions. In practice, researchers may or may not report adjusted average effect sizes using either a contingent or non-contingent strategy based on the statistical significance of selection bias detection tests. To this end, this simulation study also compares the accuracy of adjusted effect sizes when they are reported if contingent versus non-contingent on the statistical significance of tests for the presence of selection bias. When selective reporting censoring is high, in general, results indicate poor estimation performance for all selective reporting adjustment methods regardless of approach used to handle dependent effect sizes. Variation by study conditions is reported, including: overall average effect size, amount of between-study heterogeneity, within to between-study heterogeneity ratio, and average sample sizes from primary studies. Performance differences between the contingent and non-contingent strategies for adjusted estimates were primarily observed within the regression-based methods - specifically the aggregating and two modeling approaches - with minimal differences identified in the other estimation methods or approaches to dependency. Results can help guide researchers on the best practices for selective reporting tests and methods to use given certain study conditions. Future research is needed to improve current methods or identify new methods to estimate adjusted effect sizes, particularly when the amount of selective reporting is suspected to be at a higher probability.
■546 ▼aEnglish
■590 ▼aSchool code: 0227
■650 4▼aStatistics
■650 4▼aInformation science
■653 ▼aMeta-analytic results
■653 ▼aHeterogeneity ratio
■653 ▼aRegression-based methods
■653 ▼aStatistical significance
■7102 ▼aThe University of Texas at Austin▼bEducational Psychology.▼edegree granting institution.
■7201 ▼aBeretvas, S. Natasha▼edegree supervisor.
■7201 ▼aPustejovsky, James E.▼edegree supervisor.
■7730 ▼tDissertations Abstracts International▼g87-06B.
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17361219▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.


