서브메뉴
검색
Facilitating Human-Machine Teaming in Machine Learning Problem Formulation
Facilitating Human-Machine Teaming in Machine Learning Problem Formulation
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20260202105312
- ISBN
- 9798270290962
- DDC
- 020
- 저자명
- Guo, Mengtian.
- 서명/저자
- Facilitating Human-Machine Teaming in Machine Learning Problem Formulation
- 발행사항
- [Sl] : The University of North Carolina at Chapel Hill, 2025
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2025
- 형태사항
- 107 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 87-07, Section: B.
- 주기사항
- Advisor: Wang, Yue.
- 학위논문주기
- Thesis (Ph.D.)--The University of North Carolina at Chapel Hill, 2025.
- 초록/해제
- 요약The first step in any applied machine learning (ML) task is formulating what needs to be predicted and how to define it, considering the available data. It often takes significant trial-and-errors for practitioners to identify a problem formulation that is both relevant to the task and realistic given the available data. Despite its importance, this process is not well supported by existing tools. This is a task where humans and machines bring complementary expertise, thus potentially amenable to human-machine teaming. My research was focused on answering a core research question: How can we facilitate problem formulation through human-machine teaming and what's the impact of human-machine teaming. We first conducted a study to investigate the impact of two human-machine teaming strategies: 1) Performance First: machines leading the process by recommending problem formulations based on predictive performance, and 2) Relevance First: humans leading the process by selecting relevant proxies. Then, we conducted a second study to understand the impact of different machine recommendation strategies: 1) recommend based on relevance, 2) recommend based on predictive performance, and 3) recommend Pareto optimal problem formulations by considering it as a multi-objective optimization task. Across two studies, introducing automation to facilitate rapid prototyping increases the number of candidates that users can examine. However, we also observed a consistent bias towards quantitative metrics of model quality, risking misalignment with application goals. We show that systems should explicitly support the evaluation of user objectives and facilitate multi-criteria tradeoffs during the problem formulation process. Together, these insights help provide a concrete step toward interactive problem formulation tools that not only accelerate iteration but also support multi-objective exploration.
- 일반주제명
- Information science
- 일반주제명
- Computer engineering
- 일반주제명
- Computer science
- 키워드
- Machine learning
- 기타저자
- The University of North Carolina at Chapel Hill Information and Library Science
- 기본자료저록
- Dissertations Abstracts International. 87-07B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008260126s2025 us c eng d■001000017360156
■00520260202105312
■006m o d
■007cr#unu||||||||
■020 ▼a9798270290962
■035 ▼a(MiAaPQ)AAI32284994
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a020
■1001 ▼aGuo, Mengtian.
■24510▼aFacilitating Human-Machine Teaming in Machine Learning Problem Formulation
■260 ▼a[Sl]▼bThe University of North Carolina at Chapel Hill▼c2025
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2025
■300 ▼a107 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 87-07, Section: B.
■500 ▼aAdvisor: Wang, Yue.
■5021 ▼aThesis (Ph.D.)--The University of North Carolina at Chapel Hill, 2025.
■520 ▼aThe first step in any applied machine learning (ML) task is formulating what needs to be predicted and how to define it, considering the available data. It often takes significant trial-and-errors for practitioners to identify a problem formulation that is both relevant to the task and realistic given the available data. Despite its importance, this process is not well supported by existing tools. This is a task where humans and machines bring complementary expertise, thus potentially amenable to human-machine teaming. My research was focused on answering a core research question: How can we facilitate problem formulation through human-machine teaming and what's the impact of human-machine teaming. We first conducted a study to investigate the impact of two human-machine teaming strategies: 1) Performance First: machines leading the process by recommending problem formulations based on predictive performance, and 2) Relevance First: humans leading the process by selecting relevant proxies. Then, we conducted a second study to understand the impact of different machine recommendation strategies: 1) recommend based on relevance, 2) recommend based on predictive performance, and 3) recommend Pareto optimal problem formulations by considering it as a multi-objective optimization task. Across two studies, introducing automation to facilitate rapid prototyping increases the number of candidates that users can examine. However, we also observed a consistent bias towards quantitative metrics of model quality, risking misalignment with application goals. We show that systems should explicitly support the evaluation of user objectives and facilitate multi-criteria tradeoffs during the problem formulation process. Together, these insights help provide a concrete step toward interactive problem formulation tools that not only accelerate iteration but also support multi-objective exploration.
■590 ▼aSchool code: 0153.
■650 4▼aInformation science
■650 4▼aComputer engineering
■650 4▼aComputer science
■653 ▼aMachine learning
■653 ▼aHuman-machine teaming
■653 ▼aProblem formulations
■653 ▼aMulti-objective exploration
■690 ▼a0723
■690 ▼a0984
■690 ▼a0464
■690 ▼a0800
■71020▼aThe University of North Carolina at Chapel Hill▼bInformation and Library Science.
■7730 ▼tDissertations Abstracts International▼g87-07B.
■790 ▼a0153
■791 ▼aPh.D.
■792 ▼a2025
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17360156▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.
