본문

서브메뉴

Addressing Current Methodological Challenges in ILSA's Transition to Adaptive Testing- [electronic resource]
Addressing Current Methodological Challenges in ILSA's Transition to Adaptive Testing - [e...
Addressing Current Methodological Challenges in ILSA's Transition to Adaptive Testing- [electronic resource]

상세정보

자료유형  
 학위논문파일 국외
최종처리일시  
20240214101914
ISBN  
9798380607452
DDC  
151
저자명  
Valdivia Medinaceli, Montserrat Beatriz.
서명/저자  
Addressing Current Methodological Challenges in ILSAs Transition to Adaptive Testing - [electronic resource]
발행사항  
[S.l.]: : Indiana University., 2023
발행사항  
Ann Arbor : : ProQuest Dissertations & Theses,, 2023
형태사항  
1 online resource(177 p.)
주기사항  
Source: Dissertations Abstracts International, Volume: 85-04, Section: A.
주기사항  
Advisor: Rutkowski, Leslie Ann.
학위논문주기  
Thesis (Ph.D.)--Indiana University, 2023.
사용제한주기  
This item must not be sold to any third party vendors.
초록/해제  
요약My dissertation examines three current challenges of international large-scale assessments (ILSAs) associated with the transition from linear testing to an adaptive testing design. ILSAs are important for making comparisons among populations and informing countries about the quality of their educational systems. ILSA's results inform policymakers and foreign aid decisions, serve as a data source for secondary research, and inform the public, in general, about the state of educational systems around the world. However, as more developing economies participate in ILSAs, the cultural comparability of the test becomes a pressing design issue. Specifically, educational systems at the ends of the continuum are not well measured because items are either too difficult for low-performing countries or too easy for high-performing countries. Multistage testing (MST) and group adaptive testing (GAT) tailor test difficulty to examinees' proficiency. MST and GAT have been implemented to better measure proficiency at the ends of its continuum, especially for low- and high-performing countries. However, research gaps remain, given the challenges of implementing an adaptive design in ILSAs. My dissertation is a multiple-manuscript approach that addresses three separate and important challenges concerning ILSAs' measurement quality in the transition toward adaptive designs. The first paper aims to study the impact of item bias in country-level proficiency estimates when an MST is used. The second paper takes a critical stance in the transition to adaptive testing design when there is a mismatch between item difficulty and proficiency distribution of countries at the ends of the proficiency continuum. The third paper evaluates the performance of the root mean square deviation (RMSD) when the item local independence assumption of item response theory (IRT) models is violated. Findings reveal the significance of an adequate item pool that matches participants across the proficiency continuum. Effective routing mechanisms, like merit plus probabilistic misrouting, are essential, with bias-free items in early MST stages to mitigate bias effects on routing probabilities. Lastly, findings revealed that the RMSD cannot detect item bias when testlet effects are present. These insights serve as valuable guidance for practitioners and researchers aiming to enhance the fairness and comparability of ILSAs amid the growth of heterogeneous participants.
일반주제명  
Quantitative psychology.
일반주제명  
Educational technology.
일반주제명  
Educational evaluation.
일반주제명  
Developmental psychology.
키워드  
Adaptive testing design
키워드  
Differential item functioning
키워드  
Group adaptive testing
키워드  
International large-scale assessment
키워드  
Multistage testing
기타저자  
Indiana University School of Education
기본자료저록  
Dissertations Abstracts International. 85-04A.
기본자료저록  
Dissertation Abstract International
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008240612s2023      us  |||||||||||||||c||eng  d
■001000016935285
■00520240214101914
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798380607452
■035    ▼a(MiAaPQ)AAI30687539
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a151
■1001  ▼aValdivia  Medinaceli,  Montserrat  Beatriz.▼0(orcid)h0000-0003-2870-8118
■24510▼aAddressing  Current  Methodological  Challenges  in  ILSA's  Transition  to  Adaptive  Testing▼h[electronic  resource]
■260    ▼a[S.l.]:▼bIndiana  University.  ▼c2023
■260  1▼aAnn  Arbor  :▼bProQuest  Dissertations  &  Theses,  ▼c2023
■300    ▼a1  online  resource(177  p.)
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  85-04,  Section:  A.
■500    ▼aAdvisor:  Rutkowski,  Leslie  Ann.
■5021  ▼aThesis  (Ph.D.)--Indiana  University,  2023.
■506    ▼aThis  item  must  not  be  sold  to  any  third  party  vendors.
■520    ▼aMy  dissertation  examines  three  current  challenges  of  international  large-scale  assessments  (ILSAs)  associated  with  the  transition  from  linear  testing  to  an  adaptive  testing  design.  ILSAs  are  important  for  making  comparisons  among  populations  and  informing  countries  about  the  quality  of  their  educational  systems.  ILSA's  results  inform  policymakers  and  foreign  aid  decisions,  serve  as  a  data  source  for  secondary  research,  and  inform  the  public,  in  general,  about  the  state  of  educational  systems  around  the  world.  However,  as  more  developing  economies  participate  in  ILSAs,  the  cultural  comparability  of  the  test  becomes  a  pressing  design  issue.  Specifically,  educational  systems  at  the  ends  of  the  continuum  are  not  well  measured  because  items  are  either  too  difficult  for  low-performing  countries  or  too  easy  for  high-performing  countries.  Multistage  testing  (MST)  and  group  adaptive  testing  (GAT)  tailor  test  difficulty  to  examinees'  proficiency.  MST  and  GAT  have  been  implemented  to  better  measure  proficiency  at  the  ends  of  its  continuum,  especially  for  low-  and  high-performing  countries.  However,  research  gaps  remain,  given  the  challenges  of  implementing  an  adaptive  design  in  ILSAs.  My  dissertation  is  a  multiple-manuscript  approach  that  addresses  three  separate  and  important  challenges  concerning  ILSAs'  measurement  quality  in  the  transition  toward  adaptive  designs.  The  first  paper  aims  to  study  the  impact  of  item  bias  in  country-level  proficiency  estimates  when  an  MST  is  used.  The  second  paper  takes  a  critical  stance  in  the  transition  to  adaptive  testing  design  when  there  is  a  mismatch  between  item  difficulty  and  proficiency  distribution  of  countries  at  the  ends  of  the  proficiency  continuum.  The  third  paper  evaluates  the  performance  of  the  root  mean  square  deviation  (RMSD)  when  the  item  local  independence  assumption  of  item  response  theory  (IRT)  models  is  violated.  Findings  reveal  the  significance  of  an  adequate  item  pool  that  matches  participants  across  the  proficiency  continuum.  Effective  routing  mechanisms,  like  merit  plus  probabilistic  misrouting,  are  essential,  with  bias-free  items  in  early  MST  stages  to  mitigate  bias  effects  on  routing  probabilities.  Lastly,  findings  revealed  that  the  RMSD  cannot  detect  item  bias  when  testlet  effects  are  present.  These  insights  serve  as  valuable  guidance  for  practitioners  and  researchers  aiming  to  enhance  the  fairness  and  comparability  of  ILSAs  amid  the  growth  of  heterogeneous  participants.
■590    ▼aSchool  code:  0093.
■650  4▼aQuantitative  psychology.
■650  4▼aEducational  technology.
■650  4▼aEducational  evaluation.
■650  4▼aDevelopmental  psychology.
■653    ▼aAdaptive  testing  design
■653    ▼aDifferential  item  functioning
■653    ▼aGroup  adaptive  testing
■653    ▼aInternational  large-scale  assessment
■653    ▼aMultistage  testing
■690    ▼a0632
■690    ▼a0620
■690    ▼a0443
■690    ▼a0710
■71020▼aIndiana  University▼bSchool  of  Education.
■7730  ▼tDissertations  Abstracts  International▼g85-04A.
■773    ▼tDissertation  Abstract  International
■790    ▼a0093
■791    ▼aPh.D.
■792    ▼a2023
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T16935285▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.
■980    ▼a202402▼f2024

미리보기

내보내기

chatGPT토론

Ai 추천 관련 도서


    신착도서 더보기
    최근 3년간 통계입니다.

    소장정보

    • 예약
    • 소재불명신고
    • 나의폴더
    • 우선정리요청
    • 비도서대출신청
    • 야간 도서대출신청
    소장자료
    등록번호 청구기호 소장처 대출가능여부 대출정보
    TF06022 전자도서 마이폴더 부재도서신고 비도서대출신청

    * 대출중인 자료에 한하여 예약이 가능합니다. 예약을 원하시면 예약버튼을 클릭하십시오.

    해당 도서를 다른 이용자가 함께 대출한 도서

    관련 인기도서

    로그인 후 이용 가능합니다.