본문

서브메뉴

Data-Driven Decision-Making: New Insights on Algorithm Performance and Data Value
Data-Driven Decision-Making: New Insights on Algorithm Performance and Data Value
Data-Driven Decision-Making: New Insights on Algorithm Performance and Data Value

Detailed Information

자료유형  
 학위논문 서양
최종처리일시  
20250211152023
ISBN  
9798383163702
DDC  
004
저자명  
Mouchtaki, Omar.
서명/저자  
Data-Driven Decision-Making: New Insights on Algorithm Performance and Data Value
발행사항  
[Sl] : Columbia University, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
240 p
주기사항  
Source: Dissertations Abstracts International, Volume: 85-12, Section: A.
주기사항  
Advisor: Besbes, Omar;Ma, Will.
학위논문주기  
Thesis (Ph.D.)--Columbia University, 2024.
초록/해제  
요약With the rise of data-driven algorithms, both industrial practitioners and academicians have aimed at understanding how one can use past information to make better future decisions. This question is particularly challenging, as any answer necessarily depends on several parameters, such as the features of the data used (e.g., the quantity and relevance of data), the downstream problem being solved, and the type of algorithms deployed to leverage the data. Most of the current literature analyzes the value of data by anchoring their methods in the large data regime, making the implicit assumption that data is widely available in practice. In this work, we depart from this implicit assumption and posit that, in fact, relevant data is a scarce resource in many practical settings. For instance, data is usually aggregated across different times, product categories, and geographies, and therefore the effective size of datasets is orders of magnitude lower than it may appear to be. The goal of this thesis is to bridge the gap between the theoretical understanding of data-driven decisions and practical performance by developing a problem-centric theory of data-driven decision-making in which we assess the value of data by quantifying its impact on our downstream decisions. In particular, we design methodological tools tailored to the problem at hand and derive fine-grained and problem-specific guarantees for algorithms. In the first chapter, we study the data-driven newsvendor problem under the modeling assumption that data is identically and independently distributed. We are interested in analyzing central policies in the literature, such as Sample Average Approximation (SAA), along with optimal ones, and in characterizing the performance achievable across data sizes, both small and large. Specifically, we characterize exactly the performance of SAA and uncover novel fundamental insights on the value of data. Indeed, our analysis reveals that tens of samples are sufficient to perform very efficiently, but also that more data can lead to worse out-of-sample performance for SAA. In turn, we derive an optimal algorithm in the minimax sense, enhancing decision quality with limited data.The second chapter explores the impact of data relevance on decision quality, addressing the challenge of using historical data from varying sources that may not be fully indicative of the future. We quantify the performance of SAA in these heterogeneous environments and design rate-optimal policies in settings where SAA falters. We illustrate the versatility of our framework by analyzing several prototypical problems across various fields: the newsvendor, pricing, and ski rental problems. Our analysis shows that the type of achievable asymptotic performance varies significantly across different problem classes and heterogeneity notions. Finally, the third chapter develops a framework for contextual decision-making, examining how past data relevance and quantity affect policy performance. Focusing on the contextual newsvendor problem, we analyze the wide class of Weighted Empirical Risk Minimization (WERM) policies, which weigh past data according to their relevance. This class of policies includes the SAA policy (also referred to as ERM), k-Nearest Neighbors, and kernel-based methods. While past literature focuses on upper bounds via concentration inequalities, we instead take an optimization approach and isolate a structure in the newsvendor loss function that allows us to reduce the infinite-dimensional optimization problem over worst-case distributions to a simple line search. In addition to this methodological contribution, our exact analysis offers new granular insights into the learning curve of algorithms in contextual settings. Through these contributions, the thesis advances our understanding of data-driven decision-making, offering both theoretical foundations and practical insights for diverse operational applications.
일반주제명  
Computer science
일반주제명  
Information science
키워드  
Data-driven decision-making
키워드  
Distribution shift
키워드  
Empirical optimization
키워드  
Limited data
키워드  
Stochastic optimization
기타저자  
Columbia University Operations Research
기본자료저록  
Dissertations Abstracts International. 85-12A.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008250123s2024        us                              c    eng  d
■001000017162529
■00520250211152023
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798383163702
■035    ▼a(MiAaPQ)AAI31332563
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a004
■1001  ▼aMouchtaki,  Omar.
■24510▼aData-Driven  Decision-Making:  New  Insights  on  Algorithm  Performance  and  Data  Value
■260    ▼a[Sl]▼bColumbia  University▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a240  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  85-12,  Section:  A.
■500    ▼aAdvisor:  Besbes,  Omar;Ma,  Will.
■5021  ▼aThesis  (Ph.D.)--Columbia  University,  2024.
■520    ▼aWith  the  rise  of  data-driven  algorithms,  both  industrial  practitioners  and  academicians  have  aimed  at  understanding  how  one  can  use  past  information  to  make  better  future  decisions.  This  question  is  particularly  challenging,  as  any  answer  necessarily  depends  on  several  parameters,  such  as  the  features  of  the  data  used  (e.g.,  the  quantity  and  relevance  of  data),  the  downstream  problem  being  solved,  and  the  type  of  algorithms  deployed  to  leverage  the  data.  Most  of  the  current  literature  analyzes  the  value  of  data  by  anchoring  their  methods  in  the  large  data  regime,  making  the  implicit  assumption  that  data  is  widely  available  in  practice.  In  this  work,  we  depart  from  this  implicit  assumption  and  posit  that,  in  fact,  relevant  data  is  a  scarce  resource  in  many  practical  settings.  For  instance,  data  is  usually  aggregated  across  different  times,  product  categories,  and  geographies,  and  therefore  the  effective  size  of  datasets  is  orders  of  magnitude  lower  than  it  may  appear  to  be.  The  goal  of  this  thesis  is  to  bridge  the  gap  between  the  theoretical  understanding  of  data-driven  decisions  and  practical  performance  by  developing  a  problem-centric  theory  of  data-driven  decision-making  in  which  we  assess  the  value  of  data  by  quantifying  its  impact  on  our  downstream  decisions.  In  particular,  we  design  methodological  tools  tailored  to  the  problem  at  hand  and  derive  fine-grained  and  problem-specific  guarantees  for  algorithms.  In  the  first  chapter,  we  study  the  data-driven  newsvendor  problem  under  the  modeling  assumption  that  data  is  identically  and  independently  distributed.  We  are  interested  in  analyzing  central  policies  in  the  literature,  such  as  Sample  Average  Approximation  (SAA),  along  with  optimal  ones,  and  in  characterizing  the  performance  achievable  across  data  sizes,  both  small  and  large.  Specifically,  we  characterize  exactly  the  performance  of  SAA  and  uncover  novel  fundamental  insights  on  the  value  of  data.  Indeed,  our  analysis  reveals  that  tens  of  samples  are  sufficient  to  perform  very  efficiently,  but  also  that  more  data  can  lead  to  worse  out-of-sample  performance  for  SAA.  In  turn,  we  derive  an  optimal  algorithm  in  the  minimax  sense,  enhancing  decision  quality  with  limited  data.The  second  chapter  explores  the  impact  of  data  relevance  on  decision  quality,  addressing  the  challenge  of  using  historical  data  from  varying  sources  that  may  not  be  fully  indicative  of  the  future.  We  quantify  the  performance  of  SAA  in  these  heterogeneous  environments  and  design  rate-optimal  policies  in  settings  where  SAA  falters.  We  illustrate  the  versatility  of  our  framework  by  analyzing  several  prototypical  problems  across  various  fields:  the  newsvendor,  pricing,  and  ski  rental  problems.  Our  analysis  shows  that  the  type  of  achievable  asymptotic  performance  varies  significantly  across  different  problem  classes  and  heterogeneity  notions.  Finally,  the  third  chapter  develops  a  framework  for  contextual  decision-making,  examining  how  past  data  relevance  and  quantity  affect  policy  performance.  Focusing  on  the  contextual  newsvendor  problem,  we  analyze  the  wide  class  of  Weighted  Empirical  Risk  Minimization  (WERM)  policies,  which  weigh  past  data  according  to  their  relevance.  This  class  of  policies  includes  the  SAA  policy  (also  referred  to  as  ERM),  k-Nearest  Neighbors,  and  kernel-based  methods.  While  past  literature  focuses  on  upper  bounds  via  concentration  inequalities,  we  instead  take  an  optimization  approach  and  isolate  a  structure  in  the  newsvendor  loss  function  that  allows  us  to  reduce  the  infinite-dimensional  optimization  problem  over  worst-case  distributions  to  a  simple  line  search.  In  addition  to  this  methodological  contribution,  our  exact  analysis  offers  new  granular  insights  into  the  learning  curve  of  algorithms  in  contextual  settings.  Through  these  contributions,  the  thesis  advances  our  understanding  of  data-driven  decision-making,  offering  both  theoretical  foundations  and  practical  insights  for  diverse  operational  applications.
■590    ▼aSchool  code:  0054.
■650  4▼aComputer  science
■650  4▼aInformation  science
■653    ▼aData-driven  decision-making
■653    ▼aDistribution  shift
■653    ▼aEmpirical  optimization
■653    ▼aLimited  data
■653    ▼aStochastic  optimization
■690    ▼a0796
■690    ▼a0984
■690    ▼a0723
■71020▼aColumbia  University▼bOperations  Research.
■7730  ▼tDissertations  Abstracts  International▼g85-12A.
■790    ▼a0054
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17162529▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

Preview

Export

ChatGPT Discussion

AI Recommended Related Books


    New Books MORE
    Statistics for the past 3 years. Go to brief

    Подробнее информация.

    • Бронирование
    • не существует
    • моя папка
    • Первый запрос зрения
    • Non-Book Loan Application
    • Nighttime Book Loan Application
    материал
    Reg No. Количество платежных Местоположение статус Ленд информации
    TF11438 전자도서 대출가능 My Folder 부재도서신고 비도서대출신청 야간 도서대출신청

    * Бронирование доступны в заимствований книги. Чтобы сделать предварительный заказ, пожалуйста, нажмите кнопку бронирование

    Books borrowed together with this book

    Related Popular Books

    Available after logging in.