서브메뉴
검색
Fine-Grained Analysis of Select Statistical Problems
Fine-Grained Analysis of Select Statistical Problems
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211152039
- ISBN
- 9798384050216
- DDC
- 310
- 저자명
- Xi, Xumei.
- 서명/저자
- Fine-Grained Analysis of Select Statistical Problems
- 발행사항
- [Sl] : Cornell University, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 238 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
- 주기사항
- Advisor: Chen, Yudong.
- 학위논문주기
- Thesis (Ph.D.)--Cornell University, 2024.
- 초록/해제
- 요약In this work, we delve into two statistical models: Gaussian mixture models and matrix completion, aiming to unravel intricate phenomena and develop effective algorithms with provable guarantees.First, our investigation discovers a nuanced phenomenon named Mode Melding in over-specified Gaussian mixture models, where we show that, under a covariance condition, the maximum likelihood estimator can achieve zero statistical error, in contrast to the slow non-parametric error rate usually present in over-specified models. By studying the landscape of the empirical log-likelihood function, we observe that the zero error corresponds to the case where the local maxima of the log-likelihood merge into one. This discovery not only helps us better understand over-specification but also inspires the design of our ReScaledGD optimization algorithm, highlighting the need for tailored methodologies in finite-sample scenarios.In the realm of low-rank matrix completion, we consider estimating unobserved entries in a low-rank matrix based on a sparse set of observed entries. Specifically, we study entry-specific guarantees to recover a low-rank matrix under highly non-uniform sampling, where the observed entries are sampled with highly varying probabilities, potentially with different asymptotic scalings. We demonstrate the efficacy of leveraging smaller but more densely observed submatrices under structured sampling probabilities, thereby advancing our understanding of fine-grained estimation difficulty through entry-specific error bounds dependent on local observation patterns.In additive models, we develop an estimator defined by the electrical flow in the bipartite graph generated by the sampling pattern, achieving minimax entry-specific error bounds proportional to the effective resistance, related to the connectivity in the underlying graph. This discovery not only deepens our understanding of additive models but also holds practical implications for real-world applications, particularly in domains requiring entry-specific characterization of estimation quality. Our results have applications in estimating individual causal effects with panel data assuming two-way fixed effects, illuminating the relative estimation difficulty as a function of the connectivity between vertices.Last but not least, we discuss an interesting application of matrix completion to the problem of offline Reinforcement Learning. We develop efficient offline algorithms by leveraging latent structures resulting in Q functions with a low-rank matrix representation. We introduce an offline policy evaluation algorithm that utilizes this low-rank characteristic to estimate values for state-action pairs that are not covered. Remarkably, our approach operates without needing a known feature representation, and our finite-sample error bound depends on a novel spectral discrepancy metric between the behavior and target policies. In addition, we demonstrate specific cases where our algorithm provides accurate estimates, even when traditional coverage conditions are not met.
- 일반주제명
- Statistics
- 일반주제명
- Information science
- 일반주제명
- Mathematics
- 일반주제명
- Computer science
- 키워드
- Machine learning
- 기타저자
- Cornell University Operations Research and Information Engineering
- 기본자료저록
- Dissertations Abstracts International. 86-03B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017162667
■00520250211152039
■006m o d
■007cr#unu||||||||
■020 ▼a9798384050216
■035 ▼a(MiAaPQ)AAI31336150
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a310
■1001 ▼aXi, Xumei.▼0(orcid)0000-0002-1521-391X
■24510▼aFine-Grained Analysis of Select Statistical Problems
■260 ▼a[Sl]▼bCornell University▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a238 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 86-03, Section: B.
■500 ▼aAdvisor: Chen, Yudong.
■5021 ▼aThesis (Ph.D.)--Cornell University, 2024.
■520 ▼aIn this work, we delve into two statistical models: Gaussian mixture models and matrix completion, aiming to unravel intricate phenomena and develop effective algorithms with provable guarantees.First, our investigation discovers a nuanced phenomenon named Mode Melding in over-specified Gaussian mixture models, where we show that, under a covariance condition, the maximum likelihood estimator can achieve zero statistical error, in contrast to the slow non-parametric error rate usually present in over-specified models. By studying the landscape of the empirical log-likelihood function, we observe that the zero error corresponds to the case where the local maxima of the log-likelihood merge into one. This discovery not only helps us better understand over-specification but also inspires the design of our ReScaledGD optimization algorithm, highlighting the need for tailored methodologies in finite-sample scenarios.In the realm of low-rank matrix completion, we consider estimating unobserved entries in a low-rank matrix based on a sparse set of observed entries. Specifically, we study entry-specific guarantees to recover a low-rank matrix under highly non-uniform sampling, where the observed entries are sampled with highly varying probabilities, potentially with different asymptotic scalings. We demonstrate the efficacy of leveraging smaller but more densely observed submatrices under structured sampling probabilities, thereby advancing our understanding of fine-grained estimation difficulty through entry-specific error bounds dependent on local observation patterns.In additive models, we develop an estimator defined by the electrical flow in the bipartite graph generated by the sampling pattern, achieving minimax entry-specific error bounds proportional to the effective resistance, related to the connectivity in the underlying graph. This discovery not only deepens our understanding of additive models but also holds practical implications for real-world applications, particularly in domains requiring entry-specific characterization of estimation quality. Our results have applications in estimating individual causal effects with panel data assuming two-way fixed effects, illuminating the relative estimation difficulty as a function of the connectivity between vertices.Last but not least, we discuss an interesting application of matrix completion to the problem of offline Reinforcement Learning. We develop efficient offline algorithms by leveraging latent structures resulting in Q functions with a low-rank matrix representation. We introduce an offline policy evaluation algorithm that utilizes this low-rank characteristic to estimate values for state-action pairs that are not covered. Remarkably, our approach operates without needing a known feature representation, and our finite-sample error bound depends on a novel spectral discrepancy metric between the behavior and target policies. In addition, we demonstrate specific cases where our algorithm provides accurate estimates, even when traditional coverage conditions are not met.
■590 ▼aSchool code: 0058.
■650 4▼aStatistics
■650 4▼aInformation science
■650 4▼aMathematics
■650 4▼aComputer science
■653 ▼aGaussian mixture model
■653 ▼aMachine learning
■653 ▼aMatrix completion
■653 ▼aReinforcement learning
■653 ▼aZero statistical error
■690 ▼a0463
■690 ▼a0723
■690 ▼a0405
■690 ▼a0984
■71020▼aCornell University▼bOperations Research and Information Engineering.
■7730 ▼tDissertations Abstracts International▼g86-03B.
■790 ▼a0058
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17162667▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.


