서브메뉴
검색
Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20260202104827
- ISBN
- 9798265408402
- DDC
- 157
- 저자명
- Horn, Rachel L.
- 서명/저자
- Identifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
- 발행사항
- [Sl] : Harvard University, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 98 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 87-05, Section: B.
- 주기사항
- Advisor: Weisz, John.
- 학위논문주기
- Thesis (Ph.D.)--Harvard University, 2024.
- 초록/해제
- 요약Objective: Research has shown dozens of treatment protocols to be effective in addressing mental health problems in youth. However, the research has focused largely on group-level effects, with less research examining which youths respond to a given treatment option. The research that has tested predictors and candidate moderators of treatment effects has largely relied on regression analyses. Recently, psychological treatment research has begun to incorporate various machine learning (ML) techniques, and these methods are presumed to outperform regression analyses; however, few studies have tested this assumption. This dissertation included two studies designed to help fill that gap. Both studies aimed to identify predictors of youth psychotherapy outcomes using traditional regression methods and using ML-random forest, specifically-so that findings with the two methods could be compared. Study 1 used data from youths who were treated with Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). Study 2 used data from youths who were treated with the Modular Approach to Therapy for Children (MATCH). Both studies addressed three questions: (1) Do youth characteristics predict treatment outcomes with random forest? (2) Do clinician factors predict treatment outcome with random forest? and (3) Does random forest outperform traditional regression in the prediction of treatment outcomes from youth characteristics and clinician factors?Method: Participants were youths ages 7-19 who were treated with TF-CBT (N1 = 5503) or MATCH (N2 = 2292) in outpatient clinics in Connecticut between 2012 and 2022. For each treatment, a random forest and regression model were built to predict symptom outcomes using youth demographics (e.g., age at intake), youth clinical features (e.g., baseline symptom severity), clinician demographics (e.g., sex), and clinician professional features (e.g., licensure status). An additional regression model was built to predict symptom outcome using only the baseline severity on the outcome measure to assess whether the additional predictors included in the other two models enhanced predictive accuracy. Variable importance data and a feature selection program, both based in random forest, were used to identify important predictors for answering questions (1) and (2). Root mean squared error and R2 were calculated on a withheld test set to compare model fits for question (3).Results: In study 1, TF-CBT outcomes on the Child PTSD Symptom Scale (CPSS) were predicted by 10 youth features and 4 clinician features. The baseline score on the CPSS was the strongest youth-based predictor, with higher baseline symptoms associated with larger improvement but ultimately higher symptoms after treatment; TF-CBT credential status was the strongest clinician-based predictor, with youths seeing credentialed clinicians demonstrating a poorer symptom outcome compared to those seeing uncredentialed clinicians. The random forest generated a stronger predictive model for the test set than either regression approach (R2 = 0.61, RMSE = 6.48). In study 2, MATCH outcomes on the youth reported Ohio Problem Severity Scale were predicted by 12 youth features and 5 clinician features. The baseline report on the outcome measure was the strongest youth-based predictor of outcome, again with more symptomatic youth at baseline showing larger improvements but ultimately remaining more symptomatic after treatment. Hours of MATCH training completed was the strongest clinician-based predictor of outcome, with youth symptoms declining as clinician MATCH training increased to 70 hours. The random forest generated a stronger predictive model than either regression approach (R2 = 0.45, RMSE = 6.30).Conclusions: In both studies, random forest outperformed traditional regression analyses, but the margin of benefit varied. Psychologists and other statisticians should consider the purpose of their analyses (namely, predictive accuracy versus feature identification versus effect quantification) when selecting between random forest or other machine learning methods and regression, since the "black box" nature of machine learning means its accuracy comes at the expense of model interpretability. Youth clinical features, especially baseline symptom severity, explained much of the outcome variance. Modular, transdiagnostic treatments may be more challenging than more standardized treatments to model accurately because of the individualized course of treatment for each youth. To explain the variance that remains unaccounted for across the two studies, future work may benefit from the inclusion of features that were not measured here, including clinician "soft skills" like warmth and youth features like treatment motivation, as well as the investigation of appropriate outcome measures for analyses of transdiagnostic treatment protocols (i.e., different measures for different presenting problems).
- 일반주제명
- Clinical psychology
- 일반주제명
- Mental health
- 일반주제명
- Behavioral psychology
- 일반주제명
- Cognitive psychology
- 키워드
- Machine learning
- 기타저자
- Harvard University Psychology
- 기본자료저록
- Dissertations Abstracts International. 87-05B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008260126s2024 us c eng d■001000017359051
■00520260202104827
■006m o d
■007cr#unu||||||||
■020 ▼a9798265408402
■035 ▼a(MiAaPQ)AAI32170018
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a157
■1001 ▼aHorn, Rachel L.
■24510▼aIdentifying Predictors of Success in Youth Mental Health Care: A Random Forest Analysis of Evidence-Based Treatment in Outpatient Community Clinics
■260 ▼a[Sl]▼bHarvard University▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a98 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 87-05, Section: B.
■500 ▼aAdvisor: Weisz, John.
■5021 ▼aThesis (Ph.D.)--Harvard University, 2024.
■520 ▼aObjective: Research has shown dozens of treatment protocols to be effective in addressing mental health problems in youth. However, the research has focused largely on group-level effects, with less research examining which youths respond to a given treatment option. The research that has tested predictors and candidate moderators of treatment effects has largely relied on regression analyses. Recently, psychological treatment research has begun to incorporate various machine learning (ML) techniques, and these methods are presumed to outperform regression analyses; however, few studies have tested this assumption. This dissertation included two studies designed to help fill that gap. Both studies aimed to identify predictors of youth psychotherapy outcomes using traditional regression methods and using ML-random forest, specifically-so that findings with the two methods could be compared. Study 1 used data from youths who were treated with Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). Study 2 used data from youths who were treated with the Modular Approach to Therapy for Children (MATCH). Both studies addressed three questions: (1) Do youth characteristics predict treatment outcomes with random forest? (2) Do clinician factors predict treatment outcome with random forest? and (3) Does random forest outperform traditional regression in the prediction of treatment outcomes from youth characteristics and clinician factors?Method: Participants were youths ages 7-19 who were treated with TF-CBT (N1 = 5503) or MATCH (N2 = 2292) in outpatient clinics in Connecticut between 2012 and 2022. For each treatment, a random forest and regression model were built to predict symptom outcomes using youth demographics (e.g., age at intake), youth clinical features (e.g., baseline symptom severity), clinician demographics (e.g., sex), and clinician professional features (e.g., licensure status). An additional regression model was built to predict symptom outcome using only the baseline severity on the outcome measure to assess whether the additional predictors included in the other two models enhanced predictive accuracy. Variable importance data and a feature selection program, both based in random forest, were used to identify important predictors for answering questions (1) and (2). Root mean squared error and R2 were calculated on a withheld test set to compare model fits for question (3).Results: In study 1, TF-CBT outcomes on the Child PTSD Symptom Scale (CPSS) were predicted by 10 youth features and 4 clinician features. The baseline score on the CPSS was the strongest youth-based predictor, with higher baseline symptoms associated with larger improvement but ultimately higher symptoms after treatment; TF-CBT credential status was the strongest clinician-based predictor, with youths seeing credentialed clinicians demonstrating a poorer symptom outcome compared to those seeing uncredentialed clinicians. The random forest generated a stronger predictive model for the test set than either regression approach (R2 = 0.61, RMSE = 6.48). In study 2, MATCH outcomes on the youth reported Ohio Problem Severity Scale were predicted by 12 youth features and 5 clinician features. The baseline report on the outcome measure was the strongest youth-based predictor of outcome, again with more symptomatic youth at baseline showing larger improvements but ultimately remaining more symptomatic after treatment. Hours of MATCH training completed was the strongest clinician-based predictor of outcome, with youth symptoms declining as clinician MATCH training increased to 70 hours. The random forest generated a stronger predictive model than either regression approach (R2 = 0.45, RMSE = 6.30).Conclusions: In both studies, random forest outperformed traditional regression analyses, but the margin of benefit varied. Psychologists and other statisticians should consider the purpose of their analyses (namely, predictive accuracy versus feature identification versus effect quantification) when selecting between random forest or other machine learning methods and regression, since the "black box" nature of machine learning means its accuracy comes at the expense of model interpretability. Youth clinical features, especially baseline symptom severity, explained much of the outcome variance. Modular, transdiagnostic treatments may be more challenging than more standardized treatments to model accurately because of the individualized course of treatment for each youth. To explain the variance that remains unaccounted for across the two studies, future work may benefit from the inclusion of features that were not measured here, including clinician "soft skills" like warmth and youth features like treatment motivation, as well as the investigation of appropriate outcome measures for analyses of transdiagnostic treatment protocols (i.e., different measures for different presenting problems).
■590 ▼aSchool code: 0084.
■650 4▼aClinical psychology
■650 4▼aMental health
■650 4▼aBehavioral psychology
■650 4▼aCognitive psychology
■653 ▼aEvidence-based treatments
■653 ▼aMachine learning
■653 ▼aPersonalized medicine
■653 ▼aCognitive behavioral therapy
■653 ▼aYouth mental health
■690 ▼a0622
■690 ▼a0347
■690 ▼a0633
■690 ▼a0384
■71020▼aHarvard University▼bPsychology.
■7730 ▼tDissertations Abstracts International▼g87-05B.
■790 ▼a0084
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17359051▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.


