서브메뉴
검색
Orchestration Systems to Support Deep Learning at Scale
Orchestration Systems to Support Deep Learning at Scale
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211151008
- ISBN
- 9798384458265
- DDC
- 004
- 저자명
- Nagrecha, Kabir.
- 서명/저자
- Orchestration Systems to Support Deep Learning at Scale
- 발행사항
- [Sl] : University of California, San Diego, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 201 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 86-04, Section: B.
- 주기사항
- Advisor: Kumar, Arun;Zhang, Hao.
- 학위논문주기
- Thesis (Ph.D.)--University of California, San Diego, 2024.
- 초록/해제
- 요약Deep learning (DL)'s dramatic rise in popularity across the domain sciences and industry has been accompanied by a correspondingly aggressive increase in the scale and computational complexity of DL workloads. In order to adopt state-of-the-art techniques, practitioners must wrestle with systems challenges of performance, cost, and scalability. In this dissertation, we identify the need for orchestration systems, which ease scaling burdens across the DL lifecycle through holistic, workload-aware optimizations. Drawing on both established techniques from data management research and new bespoke algorithms, we build practical orchestration engines to optimize three common DL workloads in the large-scale setting: model selection, data processing, and high-throughput serving. Our systems - which exploit workload- and context- specific opportunities - address a new layer of the large-scale DL optimization stack, more granular than current cluster managers and data systems, but still abstracted away low-level kernel & compiler optimizations. Empirical evaluations show that our orchestration techniques and systems can accelerate large-scale DL workloads by a large margin, even in complex, real-world settings. Our approach introduces a new technical lens, unifying systems, databases, and DL research, ultimately focused on democratizing and amplifying state-of-the-art DL innovations. Some of the systems proposed in this dissertation have already been adopted in production-scale industry pipelines, demonstrating the value of such orchestration optimizers for real-world DL.
- 일반주제명
- Computer science
- 일반주제명
- Computer engineering
- 키워드
- Databases
- 키워드
- Deep learning
- 키워드
- Machine learning
- 기타저자
- University of California, San Diego Computer Science and Engineering
- 기본자료저록
- Dissertations Abstracts International. 86-04B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017160383
■00520250211151008
■006m o d
■007cr#unu||||||||
■020 ▼a9798384458265
■035 ▼a(MiAaPQ)AAI30995136
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a004
■1001 ▼aNagrecha, Kabir.
■24510▼aOrchestration Systems to Support Deep Learning at Scale
■260 ▼a[Sl]▼bUniversity of California, San Diego▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a201 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 86-04, Section: B.
■500 ▼aAdvisor: Kumar, Arun;Zhang, Hao.
■5021 ▼aThesis (Ph.D.)--University of California, San Diego, 2024.
■520 ▼aDeep learning (DL)'s dramatic rise in popularity across the domain sciences and industry has been accompanied by a correspondingly aggressive increase in the scale and computational complexity of DL workloads. In order to adopt state-of-the-art techniques, practitioners must wrestle with systems challenges of performance, cost, and scalability. In this dissertation, we identify the need for orchestration systems, which ease scaling burdens across the DL lifecycle through holistic, workload-aware optimizations. Drawing on both established techniques from data management research and new bespoke algorithms, we build practical orchestration engines to optimize three common DL workloads in the large-scale setting: model selection, data processing, and high-throughput serving. Our systems - which exploit workload- and context- specific opportunities - address a new layer of the large-scale DL optimization stack, more granular than current cluster managers and data systems, but still abstracted away low-level kernel & compiler optimizations. Empirical evaluations show that our orchestration techniques and systems can accelerate large-scale DL workloads by a large margin, even in complex, real-world settings. Our approach introduces a new technical lens, unifying systems, databases, and DL research, ultimately focused on democratizing and amplifying state-of-the-art DL innovations. Some of the systems proposed in this dissertation have already been adopted in production-scale industry pipelines, demonstrating the value of such orchestration optimizers for real-world DL.
■590 ▼aSchool code: 0033.
■650 4▼aComputer science
■650 4▼aComputer engineering
■653 ▼aDatabases
■653 ▼aDeep learning
■653 ▼aLarge language models
■653 ▼aMachine learning
■653 ▼aOrchestration systems
■690 ▼a0984
■690 ▼a0464
■690 ▼a0800
■71020▼aUniversity of California, San Diego▼bComputer Science and Engineering.
■7730 ▼tDissertations Abstracts International▼g86-04B.
■790 ▼a0033
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17160383▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.


