본문

서브메뉴

Orchestration Systems to Support Deep Learning at Scale
Orchestration Systems to Support Deep Learning at Scale
Orchestration Systems to Support Deep Learning at Scale

상세정보

자료유형  
 학위논문 서양
최종처리일시  
20250211151008
ISBN  
9798384458265
DDC  
004
저자명  
Nagrecha, Kabir.
서명/저자  
Orchestration Systems to Support Deep Learning at Scale
발행사항  
[Sl] : University of California, San Diego, 2024
발행사항  
Ann Arbor : ProQuest Dissertations & Theses, 2024
형태사항  
201 p
주기사항  
Source: Dissertations Abstracts International, Volume: 86-04, Section: B.
주기사항  
Advisor: Kumar, Arun;Zhang, Hao.
학위논문주기  
Thesis (Ph.D.)--University of California, San Diego, 2024.
초록/해제  
요약Deep learning (DL)'s dramatic rise in popularity across the domain sciences and industry has been accompanied by a correspondingly aggressive increase in the scale and computational complexity of DL workloads. In order to adopt state-of-the-art techniques, practitioners must wrestle with systems challenges of performance, cost, and scalability. In this dissertation, we identify the need for orchestration systems, which ease scaling burdens across the DL lifecycle through holistic, workload-aware optimizations. Drawing on both established techniques from data management research and new bespoke algorithms, we build practical orchestration engines to optimize three common DL workloads in the large-scale setting: model selection, data processing, and high-throughput serving. Our systems - which exploit workload- and context- specific opportunities - address a new layer of the large-scale DL optimization stack, more granular than current cluster managers and data systems, but still abstracted away low-level kernel & compiler optimizations. Empirical evaluations show that our orchestration techniques and systems can accelerate large-scale DL workloads by a large margin, even in complex, real-world settings. Our approach introduces a new technical lens, unifying systems, databases, and DL research, ultimately focused on democratizing and amplifying state-of-the-art DL innovations. Some of the systems proposed in this dissertation have already been adopted in production-scale industry pipelines, demonstrating the value of such orchestration optimizers for real-world DL.
일반주제명  
Computer science
일반주제명  
Computer engineering
키워드  
Databases
키워드  
Deep learning
키워드  
Large language models
키워드  
Machine learning
키워드  
Orchestration systems
기타저자  
University of California, San Diego Computer Science and Engineering
기본자료저록  
Dissertations Abstracts International. 86-04B.
전자적 위치 및 접속  
로그인 후 원문을 볼 수 있습니다.

MARC

 008250123s2024        us                              c    eng  d
■001000017160383
■00520250211151008
■006m          o    d                
■007cr#unu||||||||
■020    ▼a9798384458265
■035    ▼a(MiAaPQ)AAI30995136
■040    ▼aMiAaPQ▼cMiAaPQ
■0820  ▼a004
■1001  ▼aNagrecha,  Kabir.
■24510▼aOrchestration  Systems  to  Support  Deep  Learning  at  Scale
■260    ▼a[Sl]▼bUniversity  of  California,  San  Diego▼c2024
■260  1▼aAnn  Arbor▼bProQuest  Dissertations  &  Theses▼c2024
■300    ▼a201  p
■500    ▼aSource:  Dissertations  Abstracts  International,  Volume:  86-04,  Section:  B.
■500    ▼aAdvisor:  Kumar,  Arun;Zhang,  Hao.
■5021  ▼aThesis  (Ph.D.)--University  of  California,  San  Diego,  2024.
■520    ▼aDeep  learning  (DL)'s  dramatic  rise  in  popularity  across  the  domain  sciences  and  industry  has  been  accompanied  by  a  correspondingly  aggressive  increase  in  the  scale  and  computational  complexity  of  DL  workloads.  In  order  to  adopt  state-of-the-art  techniques,  practitioners  must  wrestle  with  systems  challenges  of  performance,  cost,  and  scalability.  In  this  dissertation,  we  identify  the  need  for  orchestration  systems,  which  ease  scaling  burdens  across  the  DL  lifecycle  through  holistic,  workload-aware  optimizations.  Drawing  on  both  established  techniques  from  data  management  research  and  new  bespoke  algorithms,  we  build  practical  orchestration  engines  to  optimize  three  common  DL  workloads  in  the  large-scale  setting:  model  selection,  data  processing,  and  high-throughput  serving.  Our  systems  -  which  exploit  workload-  and  context-  specific  opportunities  -  address  a  new  layer  of  the  large-scale  DL  optimization  stack,  more  granular  than  current  cluster  managers  and  data  systems,  but  still  abstracted  away  low-level  kernel  &  compiler  optimizations.  Empirical  evaluations  show  that  our  orchestration  techniques  and  systems  can  accelerate  large-scale  DL  workloads  by  a  large  margin,  even  in  complex,  real-world  settings.  Our  approach  introduces  a  new  technical  lens,  unifying  systems,  databases,  and  DL  research,  ultimately  focused  on  democratizing  and  amplifying  state-of-the-art  DL  innovations.  Some  of  the  systems  proposed  in  this  dissertation  have  already  been  adopted  in  production-scale  industry  pipelines,  demonstrating  the  value  of  such  orchestration  optimizers  for  real-world  DL.
■590    ▼aSchool  code:  0033.
■650  4▼aComputer  science
■650  4▼aComputer  engineering
■653    ▼aDatabases
■653    ▼aDeep  learning
■653    ▼aLarge  language  models
■653    ▼aMachine  learning
■653    ▼aOrchestration  systems
■690    ▼a0984
■690    ▼a0464
■690    ▼a0800
■71020▼aUniversity  of  California,  San  Diego▼bComputer  Science  and  Engineering.
■7730  ▼tDissertations  Abstracts  International▼g86-04B.
■790    ▼a0033
■791    ▼aPh.D.
■792    ▼a2024
■793    ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17160383▼nKERIS▼z이  자료의  원문은  한국교육학술정보원에서  제공합니다.

미리보기

내보내기

chatGPT토론

Ai 추천 관련 도서


    신착도서 더보기
    최근 3년간 통계입니다.

    소장정보

    • 예약
    • 소재불명신고
    • 나의폴더
    • 우선정리요청
    • 비도서대출신청
    • 야간 도서대출신청
    소장자료
    등록번호 청구기호 소장처 대출가능여부 대출정보
    TF14127 전자도서 대출가능 마이폴더 부재도서신고 비도서대출신청 야간 도서대출신청

    * 대출중인 자료에 한하여 예약이 가능합니다. 예약을 원하시면 예약버튼을 클릭하십시오.

    해당 도서를 다른 이용자가 함께 대출한 도서

    관련 인기도서

    로그인 후 이용 가능합니다.