서브메뉴
검색
Linking Errors Introduced by Rapid Guessing Responses When Employing Multigroup Concurrent IRT Scaling
Linking Errors Introduced by Rapid Guessing Responses When Employing Multigroup Concurrent IRT Scaling
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211151256
- ISBN
- 9798383163399
- DDC
- 370
- 저자명
- Deng, Jiayi.
- 서명/저자
- Linking Errors Introduced by Rapid Guessing Responses When Employing Multigroup Concurrent IRT Scaling
- 발행사항
- [Sl] : University of Minnesota, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 169 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 85-12, Section: A.
- 주기사항
- Advisor: Davison, Mark L.;Rodriguez, Michael.
- 학위논문주기
- Thesis (Ph.D.)--University of Minnesota, 2024.
- 초록/해제
- 요약Test score comparability in international large-scale assessments (LSA) is of utmost importance in measuring the effectiveness of education systems and understanding the impact of education on economic growth. To effectively compare test scores on an international scale, score linking is widely used to convert raw scores from different linguistic version of test forms into a common score scale. An example is the multigroup concurrent IRT calibration method, which is used for estimating item and ability parameters across multiple linguistic groups of test-takers. The method uses common item parameters to most items and groups, with a select few items allowed to have group-specific parameters. Although prior researchers used empirical data from international LSAs to demonstrate the effectiveness of multigroup concurrent IRT calibration in offering greater global comparability in score scales, it is important to note that they assumed comparable test-taking efforts across cultural and linguistic populations. This assumption may not hold true due to differential rapid guessing (RG) rates, potentially biasing item parameter estimation. To address this gap, I proposed a real data analysis and simulation to explore this area. The objective of the current study is to investigate the linking errors introduced by RG responses when employing multigroup concurrent IRT calibration.In the real data analysis, data from the Arabic and Chinese groups in the PISA 2018 Form 18 science module were linked, with RG responses flagged using response time information. Despite observed differential RG, the linking procedure proved robust to anchor identification and ability estimation. In the simulation, data was generated for two groups with varying motivation levels. These groups were administered two linguistic versions of a test form comprising multiple-choice items. Factors such as differential RG rate, association between ability and RG propensity, group impact, sample size, and model fit criteria were considered. The assessment focused on anchor identification accuracy, item parameter estimation accuracy, and ability parameter estimation accuracy and precision. The findings showed that multigroup concurrent IRT calibration was robust against differential RG, with sample size and group impact being primary factors influencing errors. However, differential RG could affect ability estimation precision and item parameter estimation accuracy.
- 일반주제명
- Educational psychology
- 일반주제명
- Education policy
- 일반주제명
- Linguistics
- 키워드
- Rapid guessing
- 키워드
- Score linking
- 키워드
- IRT calibration
- 기타저자
- University of Minnesota Educational Psychology
- 기본자료저록
- Dissertations Abstracts International. 85-12A.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017161094
■00520250211151256
■006m o d
■007cr#unu||||||||
■020 ▼a9798383163399
■035 ▼a(MiAaPQ)AAI31144267
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a370
■1001 ▼aDeng, Jiayi.
■24510▼aLinking Errors Introduced by Rapid Guessing Responses When Employing Multigroup Concurrent IRT Scaling
■260 ▼a[Sl]▼bUniversity of Minnesota▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a169 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 85-12, Section: A.
■500 ▼aAdvisor: Davison, Mark L.;Rodriguez, Michael.
■5021 ▼aThesis (Ph.D.)--University of Minnesota, 2024.
■520 ▼aTest score comparability in international large-scale assessments (LSA) is of utmost importance in measuring the effectiveness of education systems and understanding the impact of education on economic growth. To effectively compare test scores on an international scale, score linking is widely used to convert raw scores from different linguistic version of test forms into a common score scale. An example is the multigroup concurrent IRT calibration method, which is used for estimating item and ability parameters across multiple linguistic groups of test-takers. The method uses common item parameters to most items and groups, with a select few items allowed to have group-specific parameters. Although prior researchers used empirical data from international LSAs to demonstrate the effectiveness of multigroup concurrent IRT calibration in offering greater global comparability in score scales, it is important to note that they assumed comparable test-taking efforts across cultural and linguistic populations. This assumption may not hold true due to differential rapid guessing (RG) rates, potentially biasing item parameter estimation. To address this gap, I proposed a real data analysis and simulation to explore this area. The objective of the current study is to investigate the linking errors introduced by RG responses when employing multigroup concurrent IRT calibration.In the real data analysis, data from the Arabic and Chinese groups in the PISA 2018 Form 18 science module were linked, with RG responses flagged using response time information. Despite observed differential RG, the linking procedure proved robust to anchor identification and ability estimation. In the simulation, data was generated for two groups with varying motivation levels. These groups were administered two linguistic versions of a test form comprising multiple-choice items. Factors such as differential RG rate, association between ability and RG propensity, group impact, sample size, and model fit criteria were considered. The assessment focused on anchor identification accuracy, item parameter estimation accuracy, and ability parameter estimation accuracy and precision. The findings showed that multigroup concurrent IRT calibration was robust against differential RG, with sample size and group impact being primary factors influencing errors. However, differential RG could affect ability estimation precision and item parameter estimation accuracy.
■590 ▼aSchool code: 0130.
■650 4▼aEducational psychology
■650 4▼aEducational tests & measurements
■650 4▼aEducation policy
■650 4▼aLinguistics
■653 ▼aLarge-scale assessments
■653 ▼aMultigroup concurrent
■653 ▼aRapid guessing
■653 ▼aScore linking
■653 ▼aIRT calibration
■690 ▼a0525
■690 ▼a0288
■690 ▼a0290
■690 ▼a0458
■71020▼aUniversity of Minnesota▼bEducational Psychology.
■7730 ▼tDissertations Abstracts International▼g85-12A.
■790 ▼a0130
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17161094▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.
