본문

서브메뉴

Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of...
Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics

상세정보

자료유형  
 학위논문 서양
최종처리일시  
20260202104827
ISBN  
9798265408402
DDC  
157
저자명  
Horn, Rachel L.
서명/저자  
Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
발행사항  
[Sl] : Harvard University, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
98 p
주기사항  
Source: Dissertations Abstracts International, Volume: 87-05, Section: B.
주기사항  
Advisor: Weisz, John.
학위논문주기  
Thesis (Ph.D.)--Harvard University, 2024.
초록/해제  
요약Objective: Research has shown dozens of treatment protocols to be effective in addressing mental health problems in youth. However, the research has focused largely on group-level effects, with less research examining which youths respond to a given treatment option. The research that has tested predictors and candidate moderators of treatment effects has largely relied on regression analyses. Recently, psychological treatment research has begun to incorporate various machine learning (ML) techniques, and these methods are presumed to outperform regression analyses; however, few studies have tested this assumption. This dissertation included two studies designed to help fill that gap. Both studies aimed to identify predictors of youth psychotherapy outcomes using traditional regression methods and using ML-random forest, specifically-so that findings with the two methods could be compared. Study 1 used data from youths who were treated with Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). Study 2 used data from youths who were treated with the Modular Approach to Therapy for Children (MATCH). Both studies addressed three questions: (1) Do youth characteristics predict treatment outcomes with random forest? (2) Do clinician factors predict treatment outcome with random forest? and (3) Does random forest outperform traditional regression in the prediction of treatment outcomes from youth characteristics and clinician factors?Method: Participants were youths ages 7-19 who were treated with TF-CBT (N1 = 5503) or MATCH (N2 = 2292) in outpatient clinics in Connecticut between 2012 and 2022. For each treatment, a random forest and regression model were built to predict symptom outcomes using youth demographics (e.g., age at intake), youth clinical features (e.g., baseline symptom severity), clinician demographics (e.g., sex), and clinician professional features (e.g., licensure status). An additional regression model was built to predict symptom outcome using only the baseline severity on the outcome measure to assess whether the additional predictors included in the other two models enhanced predictive accuracy. Variable importance data and a feature selection program, both based in random forest, were used to identify important predictors for answering questions (1) and (2). Root mean squared error and R2 were calculated on a withheld test set to compare model fits for question (3).Results: In study 1, TF-CBT outcomes on the Child PTSD Symptom Scale (CPSS) were predicted by 10 youth features and 4 clinician features. The baseline score on the CPSS was the strongest youth-based predictor, with higher baseline symptoms associated with larger improvement but ultimately higher symptoms after treatment; TF-CBT credential status was the strongest clinician-based predictor, with youths seeing credentialed clinicians demonstrating a poorer symptom outcome compared to those seeing uncredentialed clinicians. The random forest generated a stronger predictive model for the test set than either regression approach (R2 = 0.61, RMSE = 6.48). In study 2, MATCH outcomes on the youth reported Ohio Problem Severity Scale were predicted by 12 youth features and 5 clinician features. The baseline report on the outcome measure was the strongest youth-based predictor of outcome, again with more symptomatic youth at baseline showing larger improvements but ultimately remaining more symptomatic after treatment. Hours of MATCH training completed was the strongest clinician-based predictor of outcome, with youth symptoms declining as clinician MATCH training increased to 70 hours. The random forest generated a stronger predictive model than either regression approach (R2 = 0.45, RMSE = 6.30).Conclusions: In both studies, random forest outperformed traditional regression analyses, but the margin of benefit varied. Psychologists and other statisticians should consider the purpose of their analyses (namely, predictive accuracy versus feature identification versus effect quantification) when selecting between random forest or other machine learning methods and regression, since the "black box" nature of machine learning means its accuracy comes at the expense of model interpretability. Youth clinical features, especially baseline symptom severity, explained much of the outcome variance. Modular, transdiagnostic treatments may be more challenging than more standardized treatments to model accurately because of the individualized course of treatment for each youth. To explain the variance that remains unaccounted for across the two studies, future work may benefit from the inclusion of features that were not measured here, including clinician "soft skills" like warmth and youth features like treatment motivation, as well as the investigation of appropriate outcome measures for analyses of transdiagnostic treatment protocols (i.e., different measures for different presenting problems).
일반주제명  
Clinical psychology
일반주제명  
Mental health
일반주제명  
Behavioral psychology
일반주제명  
Cognitive psychology
키워드  
Evidence-based treatments
키워드  
Machine learning
키워드  
Personalized medicine
키워드  
Cognitive behavioral therapy
키워드  
Youth mental health
기타저자  
Harvard University Psychology
기본자료저록  
Dissertations Abstracts International. 87-05B.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008260126s2024        us                              c    eng  d
■001000017359051
■00520260202104827
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798265408402
■035    ▼a(MiAaPQ)AAI32170018
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a157
■1001  ▼aHorn,  Rachel  L.
■24510▼aIdentifying  Predictors  of  Success  in  Youth  Mental  Health  Care:  A  Random  Forest  Analysis  of  Evidence-Based  Treatment  in  Outpatient  Community  Clinics
■260    ▼a[Sl]▼bHarvard  University▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a98  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  87-05,  Section:  B.
■500    ▼aAdvisor:  Weisz,  John.
■5021  ▼aThesis  (Ph.D.)--Harvard  University,  2024.
■520    ▼aObjective:  Research  has  shown  dozens  of  treatment  protocols  to  be  effective  in  addressing  mental  health  problems  in  youth.  However,  the  research  has  focused  largely  on  group-level  effects,  with  less  research  examining  which  youths  respond  to  a  given  treatment  option.  The  research  that  has  tested  predictors  and  candidate  moderators  of  treatment  effects  has  largely  relied  on  regression  analyses.  Recently,  psychological  treatment  research  has  begun  to  incorporate  various  machine  learning  (ML)  techniques,  and  these  methods  are  presumed  to  outperform  regression  analyses;  however,  few  studies  have  tested  this  assumption.  This  dissertation  included  two  studies  designed  to  help  fill  that  gap.  Both  studies  aimed  to  identify  predictors  of  youth  psychotherapy  outcomes  using  traditional  regression  methods  and  using  ML-random  forest,  specifically-so  that  findings  with  the  two  methods  could  be  compared.  Study  1  used  data  from  youths  who  were  treated  with  Trauma-Focused  Cognitive-Behavioral  Therapy  (TF-CBT).  Study  2  used  data  from  youths  who  were  treated  with  the  Modular  Approach  to  Therapy  for  Children  (MATCH).  Both  studies  addressed  three  questions:  (1)  Do  youth  characteristics  predict  treatment  outcomes  with  random  forest?  (2)  Do  clinician  factors  predict  treatment  outcome  with  random  forest?  and  (3)  Does  random  forest  outperform  traditional regression  in  the  prediction  of  treatment  outcomes  from  youth  characteristics  and  clinician  factors?Method:  Participants  were  youths  ages  7-19  who  were  treated  with  TF-CBT  (N1  =  5503)  or  MATCH  (N2  =  2292)  in  outpatient  clinics  in  Connecticut  between  2012  and  2022.  For  each  treatment,  a  random  forest  and  regression  model  were  built  to  predict  symptom  outcomes  using  youth  demographics  (e.g.,  age  at  intake),  youth  clinical  features  (e.g.,  baseline  symptom  severity),  clinician  demographics  (e.g.,  sex),  and  clinician  professional  features  (e.g.,  licensure  status).  An  additional  regression  model  was  built  to  predict  symptom  outcome  using  only  the  baseline  severity  on  the  outcome  measure  to  assess  whether  the  additional  predictors  included  in  the  other  two  models  enhanced  predictive  accuracy.  Variable  importance  data  and  a  feature  selection  program,  both  based  in  random  forest,  were  used  to  identify  important  predictors  for  answering  questions  (1)  and  (2).  Root  mean  squared  error  and  R2  were  calculated  on  a  withheld  test  set  to  compare  model  fits  for  question  (3).Results:  In  study  1,  TF-CBT  outcomes  on  the  Child  PTSD  Symptom  Scale  (CPSS)  were  predicted  by  10  youth  features  and  4  clinician  features.  The  baseline  score  on  the  CPSS  was  the  strongest  youth-based  predictor,  with  higher  baseline  symptoms  associated  with  larger  improvement  but  ultimately  higher  symptoms  after  treatment;  TF-CBT  credential  status  was  the  strongest  clinician-based  predictor,  with  youths  seeing  credentialed  clinicians  demonstrating  a  poorer  symptom  outcome  compared  to  those  seeing  uncredentialed  clinicians.  The  random  forest  generated  a  stronger  predictive  model  for  the  test  set  than  either  regression  approach  (R2  =  0.61,  RMSE  =  6.48).  In  study  2,  MATCH  outcomes  on  the  youth  reported  Ohio  Problem  Severity  Scale  were  predicted  by  12  youth  features  and  5  clinician  features.  The  baseline  report  on  the  outcome  measure  was  the  strongest  youth-based  predictor  of  outcome,  again  with  more symptomatic  youth  at  baseline  showing  larger  improvements  but  ultimately  remaining  more  symptomatic  after  treatment.  Hours  of  MATCH  training  completed  was  the  strongest  clinician-based  predictor  of  outcome,  with  youth  symptoms  declining  as  clinician  MATCH  training  increased  to  70  hours.  The  random  forest  generated  a  stronger  predictive  model  than  either  regression  approach  (R2  =  0.45,  RMSE  =  6.30).Conclusions:  In  both  studies,  random  forest  outperformed  traditional  regression  analyses,  but  the  margin  of  benefit  varied.  Psychologists  and  other  statisticians  should  consider  the  purpose  of  their  analyses  (namely,  predictive  accuracy  versus  feature  identification  versus  effect  quantification)  when  selecting  between  random  forest  or  other  machine  learning  methods  and  regression,  since  the  "black  box"  nature  of  machine  learning  means  its  accuracy  comes  at  the  expense  of  model  interpretability.  Youth  clinical  features,  especially  baseline  symptom  severity,  explained  much  of  the  outcome  variance.  Modular,  transdiagnostic  treatments  may  be  more  challenging  than  more  standardized  treatments  to  model  accurately  because  of  the  individualized  course  of  treatment  for  each  youth.  To  explain  the  variance  that  remains  unaccounted  for  across  the  two  studies,  future  work  may  benefit  from  the  inclusion  of  features  that  were  not  measured  here,  including  clinician  "soft  skills"  like  warmth  and  youth  features  like  treatment  motivation,  as  well  as  the  investigation  of  appropriate  outcome  measures  for  analyses  of  transdiagnostic  treatment  protocols  (i.e.,  different  measures  for  different  presenting  problems).
■590    ▼aSchool  code:  0084.
■650  4▼aClinical  psychology
■650  4▼aMental  health
■650  4▼aBehavioral  psychology
■650  4▼aCognitive  psychology
■653    ▼aEvidence-based  treatments
■653    ▼aMachine  learning
■653    ▼aPersonalized  medicine
■653    ▼aCognitive  behavioral  therapy
■653    ▼aYouth  mental  health
■690    ▼a0622
■690    ▼a0347
■690    ▼a0633
■690    ▼a0384
■71020▼aHarvard  University▼bPsychology.
■7730  ▼tDissertations  Abstracts  International▼g87-05B.
■790    ▼a0084
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17359051▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

미리보기

내보내기

chatGPT토론

Ai 추천 관련 도서


    신착도서 더보기
    최근 3년간 통계입니다.

    소장정보

    • 예약
    • 소재불명신고
    • 나의폴더
    • 우선정리요청
    • 비도서대출신청
    • 야간 도서대출신청
    소장자료
    등록번호 청구기호 소장처 대출가능여부 대출정보
    TF17290 전자도서 대출가능 마이폴더 부재도서신고 비도서대출신청 야간 도서대출신청

    * 대출중인 자료에 한하여 예약이 가능합니다. 예약을 원하시면 예약버튼을 클릭하십시오.

    해당 도서를 다른 이용자가 함께 대출한 도서

    관련 인기도서

    로그인 후 이용 가능합니다.