본문

서브메뉴

Fine-Grained Analysis of Select Statistical Problems
Fine-Grained Analysis of Select Statistical Problems
Fine-Grained Analysis of Select Statistical Problems

상세정보

자료유형  
 학위논문 서양
최종처리일시  
20250211152039
ISBN  
9798384050216
DDC  
310
저자명  
Xi, Xumei.
서명/저자  
Fine-Grained Analysis of Select Statistical Problems
발행사항  
[Sl] : Cornell University, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
238 p
주기사항  
Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
주기사항  
Advisor: Chen, Yudong.
학위논문주기  
Thesis (Ph.D.)--Cornell University, 2024.
초록/해제  
요약In this work, we delve into two statistical models: Gaussian mixture models and matrix completion, aiming to unravel intricate phenomena and develop effective algorithms with provable guarantees.First, our investigation discovers a nuanced phenomenon named Mode Melding in over-specified Gaussian mixture models, where we show that, under a covariance condition, the maximum likelihood estimator can achieve zero statistical error, in contrast to the slow non-parametric error rate usually present in over-specified models. By studying the landscape of the empirical log-likelihood function, we observe that the zero error corresponds to the case where the local maxima of the log-likelihood merge into one. This discovery not only helps us better understand over-specification but also inspires the design of our ReScaledGD optimization algorithm, highlighting the need for tailored methodologies in finite-sample scenarios.In the realm of low-rank matrix completion, we consider estimating unobserved entries in a low-rank matrix based on a sparse set of observed entries. Specifically, we study entry-specific guarantees to recover a low-rank matrix under highly non-uniform sampling, where the observed entries are sampled with highly varying probabilities, potentially with different asymptotic scalings. We demonstrate the efficacy of leveraging smaller but more densely observed submatrices under structured sampling probabilities, thereby advancing our understanding of fine-grained estimation difficulty through entry-specific error bounds dependent on local observation patterns.In additive models, we develop an estimator defined by the electrical flow in the bipartite graph generated by the sampling pattern, achieving minimax entry-specific error bounds proportional to the effective resistance, related to the connectivity in the underlying graph. This discovery not only deepens our understanding of additive models but also holds practical implications for real-world applications, particularly in domains requiring entry-specific characterization of estimation quality. Our results have applications in estimating individual causal effects with panel data assuming two-way fixed effects, illuminating the relative estimation difficulty as a function of the connectivity between vertices.Last but not least, we discuss an interesting application of matrix completion to the problem of offline Reinforcement Learning. We develop efficient offline algorithms by leveraging latent structures resulting in Q functions with a low-rank matrix representation. We introduce an offline policy evaluation algorithm that utilizes this low-rank characteristic to estimate values for state-action pairs that are not covered. Remarkably, our approach operates without needing a known feature representation, and our finite-sample error bound depends on a novel spectral discrepancy metric between the behavior and target policies. In addition, we demonstrate specific cases where our algorithm provides accurate estimates, even when traditional coverage conditions are not met. 
일반주제명  
Statistics
일반주제명  
Information science
일반주제명  
Mathematics
일반주제명  
Computer science
키워드  
Gaussian mixture model
키워드  
Machine learning
키워드  
Matrix completion
키워드  
Reinforcement learning
키워드  
Zero statistical error
기타저자  
Cornell University Operations Research and Information Engineering
기본자료저록  
Dissertations Abstracts International. 86-03B.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008250123s2024        us                              c    eng  d
■001000017162667
■00520250211152039
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798384050216
■035    ▼a(MiAaPQ)AAI31336150
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a310
■1001  ▼aXi,  Xumei.▼0(orcid)0000-0002-1521-391X
■24510▼aFine-Grained  Analysis  of  Select  Statistical  Problems
■260    ▼a[Sl]▼bCornell  University▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a238  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  86-03,  Section:  B.
■500    ▼aAdvisor:  Chen,  Yudong.
■5021  ▼aThesis  (Ph.D.)--Cornell  University,  2024.
■520    ▼aIn  this  work,  we  delve  into  two  statistical  models:  Gaussian  mixture  models  and  matrix  completion,  aiming  to  unravel  intricate  phenomena  and  develop  effective  algorithms  with  provable  guarantees.First,  our  investigation  discovers  a  nuanced  phenomenon  named  Mode  Melding  in  over-specified  Gaussian  mixture  models,  where  we  show  that,  under  a  covariance  condition,  the  maximum  likelihood  estimator  can  achieve  zero  statistical  error,  in  contrast  to  the  slow  non-parametric  error  rate  usually  present  in  over-specified  models.  By  studying  the  landscape  of  the  empirical  log-likelihood  function,  we  observe  that  the  zero  error  corresponds  to  the  case  where  the  local  maxima  of  the  log-likelihood  merge  into  one.  This  discovery  not  only  helps  us  better  understand  over-specification  but  also  inspires  the  design  of  our  ReScaledGD  optimization  algorithm,  highlighting  the  need  for  tailored  methodologies  in  finite-sample  scenarios.In  the  realm  of  low-rank  matrix  completion,  we  consider  estimating  unobserved  entries  in  a  low-rank  matrix  based  on  a  sparse  set  of  observed  entries.  Specifically,  we  study  entry-specific  guarantees  to  recover  a  low-rank  matrix  under  highly  non-uniform  sampling,  where  the  observed  entries  are  sampled  with  highly  varying  probabilities,  potentially  with  different  asymptotic  scalings.  We  demonstrate  the  efficacy  of  leveraging  smaller  but  more  densely  observed  submatrices  under  structured  sampling  probabilities,  thereby  advancing  our  understanding  of  fine-grained  estimation  difficulty  through  entry-specific  error  bounds  dependent  on  local  observation  patterns.In  additive  models,  we  develop  an  estimator  defined  by  the  electrical  flow  in  the  bipartite  graph  generated  by  the  sampling  pattern,  achieving  minimax  entry-specific  error  bounds  proportional  to  the  effective  resistance,  related  to  the  connectivity  in  the  underlying  graph.  This  discovery  not  only  deepens  our  understanding  of  additive  models  but  also  holds  practical  implications  for  real-world  applications,  particularly  in  domains  requiring  entry-specific  characterization  of  estimation  quality.  Our  results  have  applications  in  estimating  individual  causal  effects  with  panel  data  assuming  two-way  fixed  effects,  illuminating  the  relative  estimation  difficulty  as  a  function  of  the  connectivity  between  vertices.Last  but  not  least,  we  discuss  an  interesting  application  of  matrix  completion  to  the  problem  of  offline  Reinforcement  Learning.  We  develop  efficient  offline  algorithms  by  leveraging  latent  structures  resulting  in  Q  functions  with  a  low-rank  matrix  representation.  We  introduce  an  offline  policy  evaluation  algorithm  that  utilizes  this  low-rank  characteristic  to  estimate  values  for  state-action  pairs  that  are  not  covered.  Remarkably,  our  approach  operates  without  needing  a  known  feature  representation,  and  our  finite-sample  error  bound  depends  on  a  novel  spectral  discrepancy  metric  between  the  behavior  and  target  policies.  In  addition,  we  demonstrate  specific  cases  where  our  algorithm  provides  accurate  estimates,  even  when  traditional  coverage  conditions  are  not  met. 
■590    ▼aSchool  code:  0058.
■650  4▼aStatistics
■650  4▼aInformation  science
■650  4▼aMathematics
■650  4▼aComputer  science
■653    ▼aGaussian  mixture  model
■653    ▼aMachine  learning
■653    ▼aMatrix  completion
■653    ▼aReinforcement  learning
■653    ▼aZero  statistical  error
■690    ▼a0463
■690    ▼a0723
■690    ▼a0405
■690    ▼a0984
■71020▼aCornell  University▼bOperations  Research  and  Information  Engineering.
■7730  ▼tDissertations  Abstracts  International▼g86-03B.
■790    ▼a0058
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17162667▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

미리보기

내보내기

chatGPT토론

Ai 추천 관련 도서


    신착도서 더보기
    최근 3년간 통계입니다.

    소장정보

    • 예약
    • 소재불명신고
    • 나의폴더
    • 우선정리요청
    • 비도서대출신청
    • 야간 도서대출신청
    소장자료
    등록번호 청구기호 소장처 대출가능여부 대출정보
    TF14300 전자도서 대출가능 마이폴더 부재도서신고 비도서대출신청 야간 도서대출신청

    * 대출중인 자료에 한하여 예약이 가능합니다. 예약을 원하시면 예약버튼을 클릭하십시오.

    해당 도서를 다른 이용자가 함께 대출한 도서

    관련 인기도서

    로그인 후 이용 가능합니다.