Martin Klissarov

I am a PhD student supervised by Prof. Doina Precup at McGill University and Mila. I am particularly interested in scalable human-inspired approaches to intelligence.

Humans are able to learn new skills and adapt to changes in a sample efficiency way, can RL agents do the same? My recent research is currently centered on meta reinforcement learning, together with temporal abstractions and off-policy methods, as a way to answer this question.

Email  |  Google Scholar  |  LinkedIn  |  Twitter  |  CV

profile photo



News
Research
sym

Flexible Option Learning
Martin Klissarov and Doina Precup
Neural Information Processing Systems (NeurIPS), 2021, Spotlight

sym

Reward Propagation using Graph Convolutional Networks
Martin Klissarov and Doina Precup
Neural Information Processing Systems (NeurIPS), 2020, Spotlight

sym

Options of Interest: Temporal Abstraction with Interest Functions
Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup
Association for the Advancement of Artificial Intelligence (AAAI), 2020

sym

Variational State Encoding

Martin Klissarov*, Riashat Islam*, Khimya Khetarpal, Doina Precup
The Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM), 2019

sym

Diffusion-Based Approximate Value Functions

Martin Klissarov, Doina Precup
International Conference on Machine Learning (ICML) Efficient Credit Assignemnt Workshop, 2018, Oral

sym

When Waiting is not an Option: Learning Options using the Deliberation Cost

Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup
Association for the Advancement of Artificial Intelligence (AAAI), 2018

sym

Learning Options End-to-End for Continuous Action Tasks

Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup
Neural Information Processing Systems (NIPS) Hierarchichal Reinforcement Learning Workshop, 2017

Education
mcgill

McGill University2020 - Present
PhD in Computer Science
Supervisor: Prof. Doina Precup

mcgill

McGill University2018 - 2020
MSc in Computer Science
Supervisor: Prof. Doina Precup

poly

Polytechnique Montréal2014 - 2018
BEng in Electrical Engineering
Supervisor: Prof. Christophe Caloz

Reviewing
  • NeurIPS: 2020 / 2021
  • ICML: 2021
  • AAAI: 2021 / 2022
  • ICLR: 2022
Selected Awards
  • Natural Sciences and Engineering Research Council of Canada (NSERC) Alexander Graham Bell Canada Graduate Scholarship (2020-2023)
  • Fonds de Recherche du Québec - Nature et Technologie (FRQNT) Masters Research Scholarship (2018-2020)
  • McGill Graduate Excellence Award (2018-2020)
  • Ordre des Ingénieurs Foundation Excellence Scholarship (2016)

A special thanks to this template.