본문

서브메뉴

Efficient Algorithms for Partial Information Management: Bandit Problems and Graph Neural Networks
Efficient Algorithms for Partial Information Management: Bandit Problems and Graph Neural ...
Efficient Algorithms for Partial Information Management: Bandit Problems and Graph Neural Networks

상세정보

자료유형  
 학위논문 서양
최종처리일시  
20250211153033
ISBN  
9798346723547
DDC  
621.3
저자명  
Dong, Jialin.
서명/저자  
Efficient Algorithms for Partial Information Management: Bandit Problems and Graph Neural Networks
발행사항  
[Sl] : University of California, Los Angeles, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
220 p
주기사항  
Source: Dissertations Abstracts International, Volume: 86-05, Section: B.
주기사항  
Advisor: Yang, Lin.
학위논문주기  
Thesis (Ph.D.)--University of California, Los Angeles, 2024.
초록/해제  
요약This thesis explores the development of efficient algorithms for managing partial information in complex systems, focusing on two key areas: Graph Neural Networks (GNNs) and Bandit Problems. In an era where the boundaries between physical and digital realms are rapidly blurring, these seemingly disparate fields have emerged as integral components in addressing the challenges of modern interconnected systems. The research journey begins with investigations into blind demixing for Internet-of-Things applications, naturally progressing to explorations in nonconvex optimization and high-dimensional statistical analysis. This foundation serves as a springboard for novel contributions in GNNs and Bandit Problems, addressing the pressing need for robust, scalable, and intelligent algorithms capable of handling the complexity of data-driven applications in our increasingly connected world.The work introduces a Global Neighborhood Sampling algorithm for efficient GNN training on giant graphs, specifically optimized for mixed CPU-GPU hardware setups. This innovation significantly reduces data movement between CPU and GPU, leading to substantial performance improvements over existing state-of-the-art sampling methods. Building on this, the thesis presents G-RAG, a graph-based reranking approach for Retrieval Augmented Generation systems. GRAG leverages both the connections between retrieved documents and their semantic information, providing a context-informed reranker that outperforms current methods while maintaining a smaller computational footprint.Delving into the realm of bandit problems, the thesis explores sparse bandit learning with misspecified linear features. This investigation provides valuable insights into how structural assumptions can aid in misspecified bandit learning, demonstrating that algorithms can obtain near-optimal actions by querying a number of actions that scale exponentially with the sparsity parameter rather than the ambient dimension. Furthermore, the research presents a novel feature-mapping framework for solving Markov Decision Processes with delayed feedback, where the agent's observations are delayed by multiple time steps. By carefully addressing the statistical challenges introduced by overlapping action sequences, this approach achieves a regret bound that is independent of the size of the state and action spaces.The thesis also develops an online stochastic gradient descent (SGD)-based algorithm for stochastic bandit problems with general parametric reward functions. This method employs an action-elimination strategy and a uniform action-selection approach, providing high-probability regret guarantees and effectively handling the bias introduced by greedy action selection. This contribution extends the applicability of bandit algorithms to a broader class of problems with complex reward structures.Throughout the research, a common thread emerges: the importance of understanding and leveraging the inherent structure in complex systems. This realization serves as a bridge between the work on GNNs and bandit problems, highlighting their complementary nature in modeling and decision-making within large-scale, interconnected systems. The synthesis of these areas leads to novel insights and methodologies with the potential to impact a wide range of applications, from improving recommendation systems and enhancing financial modeling to optimizing large-scale infrastructure networks and advancing human-AI interaction. This thesis stands at the intersection of several critical domains in computer science and applied mathematics, building upon foundational work in optimization, statistical learning, and network analysis while addressing the pressing needs of emerging technologies in AI and IoT. By bridging theoretical and empirical perspectives, the research advances the state-of-the-art in efficient algorithms for partial information management. The developed techniques not only push the boundaries of our understanding but also offer practical solutions to real-world challenges in managing and leveraging partial information in complex systems.In conclusion, this work contributes to the development of more robust, scalable, and intelligent systems capable of navigating the complexities of our data-driven world. As we continue to face challenges in areas such as large-scale graph learning, decision-making under uncertainty, and human-AI interaction, the algorithms and insights presented in this thesis pave the way for future advancements in the field, offering a foundation for more adaptive and efficient approaches to partial information management in the ever-evolving landscape of interconnected systems.
일반주제명  
Electrical engineering
일반주제명  
Computer engineering
키워드  
Graph Neural Networks
키워드  
Bandit Problems
키워드  
Large-scale infrastructure networks
기타저자  
University of California, Los Angeles Electrical and Computer Engineering 0333
기본자료저록  
Dissertations Abstracts International. 86-05B.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008250123s2024        us                              c    eng  d
■001000017164705
■00520250211153033
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798346723547
■035    ▼a(MiAaPQ)AAI31637132
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a621.3
■1001  ▼aDong,  Jialin.
■24510▼aEfficient  Algorithms  for  Partial  Information  Management:  Bandit  Problems  and  Graph  Neural  Networks
■260    ▼a[Sl]▼bUniversity  of  California,  Los  Angeles▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a220  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  86-05,  Section:  B.
■500    ▼aAdvisor:  Yang,  Lin.
■5021  ▼aThesis  (Ph.D.)--University  of  California,  Los  Angeles,  2024.
■520    ▼aThis  thesis  explores  the  development  of  efficient  algorithms  for  managing  partial  information  in  complex  systems,  focusing  on  two  key  areas:  Graph  Neural  Networks  (GNNs)  and  Bandit  Problems.  In  an  era  where  the  boundaries  between  physical  and  digital  realms  are  rapidly  blurring,  these  seemingly  disparate  fields  have  emerged  as  integral  components  in  addressing  the  challenges  of  modern  interconnected  systems.  The  research  journey  begins  with  investigations  into  blind  demixing  for  Internet-of-Things  applications,  naturally  progressing  to  explorations  in  nonconvex  optimization  and  high-dimensional  statistical  analysis.  This  foundation  serves  as  a  springboard  for  novel  contributions  in  GNNs  and  Bandit  Problems,  addressing  the  pressing  need  for  robust,  scalable,  and  intelligent  algorithms  capable  of  handling  the  complexity  of  data-driven  applications  in  our  increasingly  connected  world.The  work  introduces  a  Global  Neighborhood  Sampling  algorithm  for  efficient  GNN  training  on  giant  graphs,  specifically  optimized  for  mixed  CPU-GPU  hardware  setups.  This  innovation  significantly  reduces  data  movement  between  CPU  and  GPU,  leading  to  substantial  performance  improvements  over  existing  state-of-the-art  sampling  methods.  Building  on  this,  the  thesis  presents  G-RAG,  a  graph-based  reranking  approach  for  Retrieval  Augmented  Generation  systems.  GRAG  leverages  both  the  connections  between  retrieved  documents  and  their  semantic  information,  providing  a  context-informed  reranker  that  outperforms  current  methods  while  maintaining  a  smaller  computational  footprint.Delving  into  the  realm  of  bandit  problems,  the  thesis  explores  sparse  bandit  learning  with  misspecified  linear  features.  This  investigation  provides  valuable  insights  into  how  structural  assumptions  can  aid  in  misspecified  bandit  learning,  demonstrating  that  algorithms  can  obtain  near-optimal  actions  by  querying  a  number  of  actions  that  scale  exponentially  with  the  sparsity  parameter  rather  than  the  ambient  dimension.  Furthermore,  the  research  presents  a  novel  feature-mapping  framework  for  solving  Markov  Decision  Processes  with  delayed  feedback,  where  the  agent's  observations  are  delayed  by  multiple  time  steps.  By  carefully  addressing  the  statistical  challenges  introduced  by  overlapping  action  sequences,  this  approach  achieves  a  regret  bound  that  is  independent  of  the  size  of  the  state  and  action  spaces.The  thesis  also  develops  an  online  stochastic  gradient  descent  (SGD)-based  algorithm  for  stochastic  bandit  problems  with  general  parametric  reward  functions.  This  method  employs  an  action-elimination  strategy  and  a  uniform  action-selection  approach,  providing  high-probability  regret  guarantees  and  effectively  handling  the  bias  introduced  by  greedy  action  selection.  This  contribution  extends  the  applicability  of  bandit  algorithms  to  a  broader  class  of  problems  with  complex  reward  structures.Throughout  the  research,  a  common  thread  emerges:  the  importance  of  understanding  and  leveraging  the  inherent  structure  in  complex  systems.  This  realization  serves  as  a  bridge  between  the  work  on  GNNs  and  bandit  problems,  highlighting  their  complementary  nature  in  modeling  and  decision-making  within  large-scale,  interconnected  systems.  The  synthesis  of  these  areas  leads  to  novel  insights  and  methodologies  with  the  potential  to  impact  a  wide  range  of  applications,  from  improving  recommendation  systems  and  enhancing  financial  modeling  to  optimizing  large-scale  infrastructure  networks  and  advancing  human-AI  interaction.  This  thesis  stands  at  the  intersection  of  several  critical  domains  in  computer  science  and  applied  mathematics,  building  upon  foundational  work  in  optimization,  statistical  learning,  and  network  analysis  while  addressing  the  pressing  needs  of  emerging  technologies  in  AI  and  IoT.  By  bridging  theoretical  and  empirical  perspectives,  the  research  advances  the  state-of-the-art  in  efficient  algorithms  for  partial  information  management.  The  developed  techniques  not  only  push  the  boundaries  of  our  understanding  but  also  offer  practical  solutions  to  real-world  challenges  in  managing  and  leveraging  partial  information  in  complex  systems.In  conclusion,  this  work  contributes  to  the  development  of  more  robust,  scalable,  and  intelligent  systems  capable  of  navigating  the  complexities  of  our  data-driven  world.  As  we  continue  to  face  challenges  in  areas  such  as  large-scale  graph  learning,  decision-making  under  uncertainty,  and  human-AI  interaction,  the  algorithms  and  insights  presented  in  this  thesis  pave  the  way  for  future  advancements  in  the  field,  offering  a  foundation  for  more  adaptive  and  efficient  approaches  to  partial  information  management  in  the  ever-evolving  landscape  of  interconnected  systems.
■590    ▼aSchool  code:  0031.
■650  4▼aElectrical  engineering
■650  4▼aComputer  engineering
■653    ▼aGraph  Neural  Networks
■653    ▼aBandit  Problems
■653    ▼aLarge-scale  infrastructure  networks
■690    ▼a0544
■690    ▼a0464
■690    ▼a0800
■71020▼aUniversity  of  California,  Los  Angeles▼bElectrical  and  Computer  Engineering  0333.
■7730  ▼tDissertations  Abstracts  International▼g86-05B.
■790    ▼a0031
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17164705▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

미리보기

내보내기

chatGPT토론

Ai 추천 관련 도서


    신착도서 더보기
    최근 3년간 통계입니다.

    소장정보

    • 예약
    • 소재불명신고
    • 나의폴더
    • 우선정리요청
    • 비도서대출신청
    • 야간 도서대출신청
    소장자료
    등록번호 청구기호 소장처 대출가능여부 대출정보
    TF13796 전자도서 대출가능 마이폴더 부재도서신고 비도서대출신청 야간 도서대출신청

    * 대출중인 자료에 한하여 예약이 가능합니다. 예약을 원하시면 예약버튼을 클릭하십시오.

    해당 도서를 다른 이용자가 함께 대출한 도서

    관련 인기도서

    로그인 후 이용 가능합니다.