서브메뉴
검색
Assistive Value Alignment Using In-Situ Naturalistic Human Behaviors
Assistive Value Alignment Using In-Situ Naturalistic Human Behaviors
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211152937
- ISBN
- 9798342754712
- DDC
- 004
- 서명/저자
- Assistive Value Alignment Using In-Situ Naturalistic Human Behaviors
- 발행사항
- [Sl] : Carnegie Mellon University, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 192 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 86-05, Section: B.
- 주기사항
- Advisor: Admoni, Henny;Kitani, Kris.
- 학위논문주기
- Thesis (Ph.D.)--Carnegie Mellon University, 2024.
- 초록/해제
- 요약As collaborative robots are increasingly deployed in personal environments, such as the home, it is critical they take actions to complete tasks consistent with personal preferences. However, determining personal preferences for completing household chores is challenging. Many household chores, such as setting a table or loading a dishwasher, are sequential and open-vocabulary, creating a landscape of almost endless a priori preferences. Taking assistive actions in this domain means that a robot must first determine someone's personal preference from within this expansive space. To do this, robots rely on people to communicate information about their preferences.Communication about preferences is often collected ex situ: A person is presented with an abstract situation with several alternative solutions and gives feedback on which solution they think they would prefer if they were acting in situ. This feedback on the preferred solution, combined with similar responses from multiple people in multiple situations, is then used to train a preference model. These data can be burdensome to collect, are based on ex situ data collection which does not guarantee alignment with in situ preferences, and fails to capture information about changing to preferences that may arise due to the execution of the collaboration.In this thesis, we argue that robots can provide personalized in situ assistance using observations of naturalistic human behaviors. In other words, robotic assistance can be viewed as a process of value alignment and can be achieved during task execution using observations of naturally occurring goal-directed behaviors. To support this argument, we make five main contributions.First, we define assistive robotics as a value alignment problem and identify the main components in defining such a problem: the people involved, the space (or environment) in which the interaction takes place, and the relative timing of the robot and collaborative partners' actions. Second, we introduce a dataset of naturalistic human-robot collaboration behavior collected in a simple collaborative object rearrangement task. Third, we use this data set to highlight the importance of continued personalization in assistive scenarios. Fourth, we present a method for extending these ideas to complex surface rearrangement tasks with naturalistic data using large internet-scale pretrained multi-modal foundation models. Finally, we present a method for continually finetuning these large foundation models using naturalistic in situ behaviors, demonstrating how we can provide seamless robotic assistance from varying sources of in situ human behavior data.
- 일반주제명
- Computer science
- 일반주제명
- Robotics
- 키워드
- Value alignment
- 기타저자
- Carnegie Mellon University Robotics Institute
- 기본자료저록
- Dissertations Abstracts International. 86-05B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017164236
■00520250211152937
■006m o d
■007cr#unu||||||||
■020 ▼a9798342754712
■035 ▼a(MiAaPQ)AAI31563968
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a004
■1001 ▼aNewman, Benjamin A.
■24510▼aAssistive Value Alignment Using In-Situ Naturalistic Human Behaviors
■260 ▼a[Sl]▼bCarnegie Mellon University▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a192 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 86-05, Section: B.
■500 ▼aAdvisor: Admoni, Henny;Kitani, Kris.
■5021 ▼aThesis (Ph.D.)--Carnegie Mellon University, 2024.
■520 ▼aAs collaborative robots are increasingly deployed in personal environments, such as the home, it is critical they take actions to complete tasks consistent with personal preferences. However, determining personal preferences for completing household chores is challenging. Many household chores, such as setting a table or loading a dishwasher, are sequential and open-vocabulary, creating a landscape of almost endless a priori preferences. Taking assistive actions in this domain means that a robot must first determine someone's personal preference from within this expansive space. To do this, robots rely on people to communicate information about their preferences.Communication about preferences is often collected ex situ: A person is presented with an abstract situation with several alternative solutions and gives feedback on which solution they think they would prefer if they were acting in situ. This feedback on the preferred solution, combined with similar responses from multiple people in multiple situations, is then used to train a preference model. These data can be burdensome to collect, are based on ex situ data collection which does not guarantee alignment with in situ preferences, and fails to capture information about changing to preferences that may arise due to the execution of the collaboration.In this thesis, we argue that robots can provide personalized in situ assistance using observations of naturalistic human behaviors. In other words, robotic assistance can be viewed as a process of value alignment and can be achieved during task execution using observations of naturally occurring goal-directed behaviors. To support this argument, we make five main contributions.First, we define assistive robotics as a value alignment problem and identify the main components in defining such a problem: the people involved, the space (or environment) in which the interaction takes place, and the relative timing of the robot and collaborative partners' actions. Second, we introduce a dataset of naturalistic human-robot collaboration behavior collected in a simple collaborative object rearrangement task. Third, we use this data set to highlight the importance of continued personalization in assistive scenarios. Fourth, we present a method for extending these ideas to complex surface rearrangement tasks with naturalistic data using large internet-scale pretrained multi-modal foundation models. Finally, we present a method for continually finetuning these large foundation models using naturalistic in situ behaviors, demonstrating how we can provide seamless robotic assistance from varying sources of in situ human behavior data.
■590 ▼aSchool code: 0041.
■650 4▼aComputer science
■650 4▼aRobotics
■653 ▼aAssistive robotics
■653 ▼aContinual adaptation
■653 ▼aNaturalistic behavior
■653 ▼aPreference learning
■653 ▼aValue alignment
■690 ▼a0800
■690 ▼a0984
■690 ▼a0771
■71020▼aCarnegie Mellon University▼bRobotics Institute.
■7730 ▼tDissertations Abstracts International▼g86-05B.
■790 ▼a0041
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17164236▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.
