서브메뉴
검색
Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211152013
- ISBN
- 9798382831916
- DDC
- 629.8
- 저자명
- Gong, Ran.
- 서명/저자
- Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
- 발행사항
- [Sl] : University of California, Los Angeles, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 210 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
- 주기사항
- Advisor: Terzopoulos, Demetri;Zhu, Song-Chun.
- 학위논문주기
- Thesis (Ph.D.)--University of California, Los Angeles, 2024.
- 초록/해제
- 요약To construct a general artificial intelligence system, embodied agents must be able to perceive their environment, understand human language, engage in complex reasoning, manipulate objects, and collaborate with humans and each other. Cognitive science research suggests that intelligence emerges from sensorimotor experiences and interactions with the physical world. However, learning active perception and sensorimotor control through interaction with the physical environment can be challenging because existing algorithms are too slow for real-time learning, and embodied agents are fragile and expensive. Consequently, there is a pressing need for virtual simulation systems that can mimic complex behaviors and facilitate agent-environment interactions. In addition to mastering basic physical skills, embodied agents also need to engage in long-horizon task planning, coordination, and abstract reasoning to be effective in real-world scenarios.The first line of research reported in this thesis focuses on developing simulation environments in which robots can interact with human users and their surroundings. We introduce a new simulation environment, VRKitchen, which enables the simulation of complex high-level behaviors and state changes. We also collect a dataset featuring human-environment interactions to predict human intentions. Furthermore, we develop a new system, ARNOLD, to simulate intricate low-level physics, including articulated objects and liquids. Using the ARNOLD Dataset, we assess the abilities of robots to comprehend human language and execute complex manipulations under varied visual conditions, thereby evaluating their generalization capabilities in diverse and novel environments.The second line of research addresses multi-agent collaboration and task allocation. We examine how robots of various types can cooperate with each other or with human users to accomplish common tasks. Initially, we propose a joint mind modeling framework based on the theory of mind to enhance the collaboration between humans and robots. Subsequently, we create a suite of multi-robot vision-based collaboration tasks, LEMMA, where robots positioned around a tabletop must collaborate to complete a task based on high-level instructions and also utilize tools. Lastly, leveraging large language models, we introduce a centralized multi-agent dispatcher framework, MindAgent, and its associated benchmarks and infrastructures.
- 일반주제명
- Robotics
- 일반주제명
- Computer engineering
- 일반주제명
- Computer science
- 키워드
- Collaborations
- 키워드
- Embodied AI
- 키워드
- Simulation
- 키워드
- ARNOLD
- 기타저자
- University of California, Los Angeles Computer Science 0201
- 기본자료저록
- Dissertations Abstracts International. 85-12B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017162445
■00520250211152013
■006m o d
■007cr#unu||||||||
■020 ▼a9798382831916
■035 ▼a(MiAaPQ)AAI31331450
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a629.8
■1001 ▼aGong, Ran.
■24510▼aAdvancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
■260 ▼a[Sl]▼bUniversity of California, Los Angeles▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a210 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 85-12, Section: B.
■500 ▼aAdvisor: Terzopoulos, Demetri;Zhu, Song-Chun.
■5021 ▼aThesis (Ph.D.)--University of California, Los Angeles, 2024.
■520 ▼aTo construct a general artificial intelligence system, embodied agents must be able to perceive their environment, understand human language, engage in complex reasoning, manipulate objects, and collaborate with humans and each other. Cognitive science research suggests that intelligence emerges from sensorimotor experiences and interactions with the physical world. However, learning active perception and sensorimotor control through interaction with the physical environment can be challenging because existing algorithms are too slow for real-time learning, and embodied agents are fragile and expensive. Consequently, there is a pressing need for virtual simulation systems that can mimic complex behaviors and facilitate agent-environment interactions. In addition to mastering basic physical skills, embodied agents also need to engage in long-horizon task planning, coordination, and abstract reasoning to be effective in real-world scenarios.The first line of research reported in this thesis focuses on developing simulation environments in which robots can interact with human users and their surroundings. We introduce a new simulation environment, VRKitchen, which enables the simulation of complex high-level behaviors and state changes. We also collect a dataset featuring human-environment interactions to predict human intentions. Furthermore, we develop a new system, ARNOLD, to simulate intricate low-level physics, including articulated objects and liquids. Using the ARNOLD Dataset, we assess the abilities of robots to comprehend human language and execute complex manipulations under varied visual conditions, thereby evaluating their generalization capabilities in diverse and novel environments.The second line of research addresses multi-agent collaboration and task allocation. We examine how robots of various types can cooperate with each other or with human users to accomplish common tasks. Initially, we propose a joint mind modeling framework based on the theory of mind to enhance the collaboration between humans and robots. Subsequently, we create a suite of multi-robot vision-based collaboration tasks, LEMMA, where robots positioned around a tabletop must collaborate to complete a task based on high-level instructions and also utilize tools. Lastly, leveraging large language models, we introduce a centralized multi-agent dispatcher framework, MindAgent, and its associated benchmarks and infrastructures.
■590 ▼aSchool code: 0031.
■650 4▼aRobotics
■650 4▼aComputer engineering
■650 4▼aComputer science
■653 ▼aCollaborations
■653 ▼aEmbodied AI
■653 ▼aSimulation
■653 ▼aARNOLD
■653 ▼aCognitive abilities
■690 ▼a0800
■690 ▼a0771
■690 ▼a0984
■690 ▼a0464
■71020▼aUniversity of California, Los Angeles▼bComputer Science 0201.
■7730 ▼tDissertations Abstracts International▼g85-12B.
■790 ▼a0031
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17162445▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.


