본문

서브메뉴

Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-ag...
Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations

Detailed Information

자료유형  
 학위논문 서양
최종처리일시  
20250211152013
ISBN  
9798382831916
DDC  
629.8
저자명  
Gong, Ran.
서명/저자  
Advancing the Cognitive Abilities of Embodied Agents: Large-Scale Simulations and Multi-agent Collaborations
발행사항  
[Sl] : University of California, Los Angeles, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
210 p
주기사항  
Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
주기사항  
Advisor: Terzopoulos, Demetri;Zhu, Song-Chun.
학위논문주기  
Thesis (Ph.D.)--University of California, Los Angeles, 2024.
초록/해제  
요약To construct a general artificial intelligence system, embodied agents must be able to perceive their environment, understand human language, engage in complex reasoning, manipulate objects, and collaborate with humans and each other. Cognitive science research suggests that intelligence emerges from sensorimotor experiences and interactions with the physical world. However, learning active perception and sensorimotor control through interaction with the physical environment can be challenging because existing algorithms are too slow for real-time learning, and embodied agents are fragile and expensive. Consequently, there is a pressing need for virtual simulation systems that can mimic complex behaviors and facilitate agent-environment interactions. In addition to mastering basic physical skills, embodied agents also need to engage in long-horizon task planning, coordination, and abstract reasoning to be effective in real-world scenarios.The first line of research reported in this thesis focuses on developing simulation environments in which robots can interact with human users and their surroundings. We introduce a new simulation environment, VRKitchen, which enables the simulation of complex high-level behaviors and state changes. We also collect a dataset featuring human-environment interactions to predict human intentions. Furthermore, we develop a new system, ARNOLD, to simulate intricate low-level physics, including articulated objects and liquids. Using the ARNOLD Dataset, we assess the abilities of robots to comprehend human language and execute complex manipulations under varied visual conditions, thereby evaluating their generalization capabilities in diverse and novel environments.The second line of research addresses multi-agent collaboration and task allocation. We examine how robots of various types can cooperate with each other or with human users to accomplish common tasks. Initially, we propose a joint mind modeling framework based on the theory of mind to enhance the collaboration between humans and robots. Subsequently, we create a suite of multi-robot vision-based collaboration tasks, LEMMA, where robots positioned around a tabletop must collaborate to complete a task based on high-level instructions and also utilize tools. Lastly, leveraging large language models, we introduce a centralized multi-agent dispatcher framework, MindAgent, and its associated benchmarks and infrastructures.
일반주제명  
Robotics
일반주제명  
Computer engineering
일반주제명  
Computer science
키워드  
Collaborations
키워드  
Embodied AI
키워드  
Simulation
키워드  
ARNOLD
키워드  
Cognitive abilities
기타저자  
University of California, Los Angeles Computer Science 0201
기본자료저록  
Dissertations Abstracts International. 85-12B.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008250123s2024        us                              c    eng  d
■001000017162445
■00520250211152013
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798382831916
■035    ▼a(MiAaPQ)AAI31331450
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a629.8
■1001  ▼aGong,  Ran.
■24510▼aAdvancing  the  Cognitive  Abilities  of  Embodied  Agents:  Large-Scale  Simulations  and  Multi-agent  Collaborations
■260    ▼a[Sl]▼bUniversity  of  California,  Los  Angeles▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a210  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  85-12,  Section:  B.
■500    ▼aAdvisor:  Terzopoulos,  Demetri;Zhu,  Song-Chun.
■5021  ▼aThesis  (Ph.D.)--University  of  California,  Los  Angeles,  2024.
■520    ▼aTo  construct  a  general  artificial  intelligence  system,  embodied  agents  must  be  able  to  perceive  their  environment,  understand  human  language,  engage  in  complex  reasoning,  manipulate  objects,  and  collaborate  with  humans  and  each  other.  Cognitive  science  research  suggests  that  intelligence  emerges  from  sensorimotor  experiences  and  interactions  with  the  physical  world.  However,  learning  active  perception  and  sensorimotor  control  through  interaction  with  the  physical  environment  can  be  challenging  because  existing  algorithms  are  too  slow  for  real-time  learning,  and  embodied  agents  are  fragile  and  expensive.  Consequently,  there  is  a  pressing  need  for  virtual  simulation  systems  that  can  mimic  complex  behaviors  and  facilitate  agent-environment  interactions.  In  addition  to  mastering  basic  physical  skills,  embodied  agents  also  need  to  engage  in  long-horizon  task  planning,  coordination,  and  abstract  reasoning  to  be  effective  in  real-world  scenarios.The  first  line  of  research  reported  in  this  thesis  focuses  on  developing  simulation  environments  in  which  robots  can  interact  with  human  users  and  their  surroundings.  We  introduce  a  new  simulation  environment,  VRKitchen,  which  enables  the  simulation  of  complex  high-level  behaviors  and  state  changes.  We  also  collect  a  dataset  featuring  human-environment  interactions  to  predict  human  intentions.  Furthermore,  we  develop  a  new  system,  ARNOLD,  to  simulate  intricate  low-level  physics,  including  articulated  objects  and  liquids.  Using  the  ARNOLD  Dataset,  we  assess  the  abilities  of  robots  to  comprehend  human  language  and  execute  complex  manipulations  under  varied  visual  conditions,  thereby  evaluating  their  generalization  capabilities  in  diverse  and  novel  environments.The  second  line  of  research  addresses  multi-agent  collaboration  and  task  allocation.  We  examine  how  robots  of  various  types  can  cooperate  with  each  other  or  with  human  users  to  accomplish  common  tasks.  Initially,  we  propose  a  joint  mind  modeling  framework  based  on  the  theory  of  mind  to  enhance  the  collaboration  between  humans  and  robots.  Subsequently,  we  create  a  suite  of  multi-robot  vision-based  collaboration  tasks,  LEMMA,  where  robots  positioned  around  a  tabletop  must  collaborate  to  complete  a  task  based  on  high-level  instructions  and  also  utilize  tools.  Lastly,  leveraging  large  language  models,  we  introduce  a  centralized  multi-agent  dispatcher  framework,  MindAgent,  and  its  associated  benchmarks  and  infrastructures.
■590    ▼aSchool  code:  0031.
■650  4▼aRobotics
■650  4▼aComputer  engineering
■650  4▼aComputer  science
■653    ▼aCollaborations
■653    ▼aEmbodied  AI
■653    ▼aSimulation
■653    ▼aARNOLD
■653    ▼aCognitive  abilities
■690    ▼a0800
■690    ▼a0771
■690    ▼a0984
■690    ▼a0464
■71020▼aUniversity  of  California,  Los  Angeles▼bComputer  Science  0201.
■7730  ▼tDissertations  Abstracts  International▼g85-12B.
■790    ▼a0031
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17162445▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

Preview

Export

ChatGPT Discussion

AI Recommended Related Books


    New Books MORE
    Statistics for the past 3 years. Go to brief

    Подробнее информация.

    • Бронирование
    • не существует
    • моя папка
    • Первый запрос зрения
    • Non-Book Loan Application
    • Nighttime Book Loan Application
    материал
    Reg No. Количество платежных Местоположение статус Ленд информации
    TF09686 전자도서 대출가능 My Folder 부재도서신고 비도서대출신청 야간 도서대출신청

    * Бронирование доступны в заимствований книги. Чтобы сделать предварительный заказ, пожалуйста, нажмите кнопку бронирование

    Books borrowed together with this book

    Related Popular Books

    Available after logging in.