서브메뉴
검색
Neural Circuit Mechanisms Underlying Contingency Learning
Neural Circuit Mechanisms Underlying Contingency Learning
상세정보
- 자료유형
- 학위논문 서양
- 최종처리일시
- 20250211151051
- ISBN
- 9798382781594
- DDC
- 616
- 저자명
- Qian, Lechen.
- 서명/저자
- Neural Circuit Mechanisms Underlying Contingency Learning
- 발행사항
- [Sl] : Harvard University, 2024
- 발행사항
- Ann Arbor : ProQuest Dissertations & Theses, 2024
- 형태사항
- 108 p
- 주기사항
- Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
- 주기사항
- Advisor: Uchida, Naoshige;Murthy, Venkatesh.
- 학위논문주기
- Thesis (Ph.D.)--Harvard University, 2024.
- 초록/해제
- 요약Studies on animal learning have shown that the efficacy of both associative learning and responding depends on contingency, the extent to which the likelihood of an outcome changes by a presentation of a stimulus. However, how neural representations in the mesolimbic dopamine system and ventral striatum are modulated by contingency remain unclear. Chapter I of my dissertation focuses on this by examining mice trained in a Pavlovian conditioning degradation task. I observed that anticipatory licking for odors previously associated with rewards significantly diminished when unpredicted rewards were introduced but remained stable with predicted additional rewards. Furthermore, dopamine (DA) axonal signals in the Olfactory Tubercle (OT) and Nucleus Accumbens (NAc), measured using photometry, mirrored these behavioral changes. While dopamine signals are commonly thought to resemble the temporal difference (TD) error in TD learning models, previous studies suggested these models couldn't explain the contingency degradation phenomenon. However, our findings indicated that DA responses in various experimental conditions align closely with a TD learning model incorporating state transitions reflective of task structure. Furthermore, we showed that recurrent neural networks (RNNs) trained in the task using a TD learning framework recapitulate dopamine responses and develop state representations consistent with the task states, merely from observations. Based on these results, we provided a theoretical framework linking TD errors to contingency and causal learning.Many studies of reinforcement learning in rodents have involved the olfactory system. Previous studies have indicated that neural activity related to the odor valence have been observed in the OT, a relatively understudied structure situated in both the olfactory pathway and the ventral striatum. In Chapter II, I examined how valence representations of odor cues evolve over time in the two distinct neuronal populations in the OT, and how stable these representations are under different conditions in contingency learning using 2-photon microscopy. As the idea of representational stability and drift are vigorously debated, this study will add valuable biological data to inform conceptual ideas of neural representations in the brain.Together, these results provided new insights into the neural circuits involved in the representation of contingency in the mammalian brain.
- 일반주제명
- Neurosciences
- 일반주제명
- Cellular biology
- 일반주제명
- Molecular biology
- 키워드
- Contingency
- 키워드
- Dopamine
- 키워드
- Ventral striatum
- 키워드
- TD-learning
- 기타저자
- Harvard University Biology Molecular and Cellular
- 기본자료저록
- Dissertations Abstracts International. 85-12B.
- 전자적 위치 및 접속
- 로그인 후 원문을 볼 수 있습니다.
MARC
008250123s2024 us c eng d■001000017160626
■00520250211151051
■006m o d
■007cr#unu||||||||
■020 ▼a9798382781594
■035 ▼a(MiAaPQ)AAI31141429
■040 ▼aMiAaPQ▼cMiAaPQ
■0820 ▼a616
■1001 ▼aQian, Lechen.▼0(orcid)0000-0001-6767-9773
■24510▼aNeural Circuit Mechanisms Underlying Contingency Learning
■260 ▼a[Sl]▼bHarvard University▼c2024
■260 1▼aAnn Arbor▼bProQuest Dissertations & Theses▼c2024
■300 ▼a108 p
■500 ▼aSource: Dissertations Abstracts International, Volume: 85-12, Section: B.
■500 ▼aAdvisor: Uchida, Naoshige;Murthy, Venkatesh.
■5021 ▼aThesis (Ph.D.)--Harvard University, 2024.
■520 ▼aStudies on animal learning have shown that the efficacy of both associative learning and responding depends on contingency, the extent to which the likelihood of an outcome changes by a presentation of a stimulus. However, how neural representations in the mesolimbic dopamine system and ventral striatum are modulated by contingency remain unclear. Chapter I of my dissertation focuses on this by examining mice trained in a Pavlovian conditioning degradation task. I observed that anticipatory licking for odors previously associated with rewards significantly diminished when unpredicted rewards were introduced but remained stable with predicted additional rewards. Furthermore, dopamine (DA) axonal signals in the Olfactory Tubercle (OT) and Nucleus Accumbens (NAc), measured using photometry, mirrored these behavioral changes. While dopamine signals are commonly thought to resemble the temporal difference (TD) error in TD learning models, previous studies suggested these models couldn't explain the contingency degradation phenomenon. However, our findings indicated that DA responses in various experimental conditions align closely with a TD learning model incorporating state transitions reflective of task structure. Furthermore, we showed that recurrent neural networks (RNNs) trained in the task using a TD learning framework recapitulate dopamine responses and develop state representations consistent with the task states, merely from observations. Based on these results, we provided a theoretical framework linking TD errors to contingency and causal learning.Many studies of reinforcement learning in rodents have involved the olfactory system. Previous studies have indicated that neural activity related to the odor valence have been observed in the OT, a relatively understudied structure situated in both the olfactory pathway and the ventral striatum. In Chapter II, I examined how valence representations of odor cues evolve over time in the two distinct neuronal populations in the OT, and how stable these representations are under different conditions in contingency learning using 2-photon microscopy. As the idea of representational stability and drift are vigorously debated, this study will add valuable biological data to inform conceptual ideas of neural representations in the brain.Together, these results provided new insights into the neural circuits involved in the representation of contingency in the mammalian brain.
■590 ▼aSchool code: 0084.
■650 4▼aNeurosciences
■650 4▼aCellular biology
■650 4▼aMolecular biology
■653 ▼aContingency
■653 ▼aDopamine
■653 ▼aVentral striatum
■653 ▼aTD-learning
■653 ▼aTemporal difference
■690 ▼a0317
■690 ▼a0379
■690 ▼a0307
■71020▼aHarvard University▼bBiology, Molecular and Cellular.
■7730 ▼tDissertations Abstracts International▼g85-12B.
■790 ▼a0084
■791 ▼aPh.D.
■792 ▼a2024
■793 ▼aEnglish
■85640▼uhttp://www.riss.kr/pdu/ddodLink.do?id=T17160626▼nKERIS▼z이 자료의 원문은 한국교육학술정보원에서 제공합니다.
