Martin Klissarov

I am a first year PhD student supervised by Prof. Doina Precup at McGill University and Mila.

I am particularly interested devising sound and effective reinforcement learning algorithms. I have worked mostly on temporal abstractions, the exploitation/exploration dilemma and off-policy/batch RL methods.

Email  |  Google Scholar  |  LinkedIn  |  Twitter  |  CV

profile photo

Reward Propagation using Graph Convolutional Networks
Martin Klissarov and Doina Precup
Neural Information Processing Systems (NeurIPS), 2020, Spotlight


Options of Interest: Temporal Abstraction with Interest Functions
Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup
Association for the Advancement of Artificial Intelligence (AAAI), 2020


Variational State Encoding

Martin Klissarov*, Riashat Islam*, Khimya Khetarpal, Doina Precup
The Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM), 2019


Diffusion-Based Approximate Value Functions

Martin Klissarov, Doina Precup
International Conference on Machine Learning (ICML) Efficient Credit Assignemnt Workshop, 2018, Oral


When Waiting is not an Option: Learning Options using the Deliberation Cost

Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup
Association for the Advancement of Artificial Intelligence (AAAI), 2018


Learning Options End-to-End for Continuous Action Tasks

Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup
Neural Information Processing Systems (NIPS) Hierarchichal Reinforcement Learning Workshop, 2017


McGill University2018 - Present
MSc in Computer Science
Supervisor: Prof. Doina Precup


Polytechnique Montréal2014 - 2017
BEng in Electrical Engineering
Supervisor: Prof. Christophe Caloz

Selected Awards
  • Natural Sciences and Engineering Research Council of Canada (NSERC) Alexander Graham Bell Canada Graduate Scholarship (2020-2023)
  • Fonds de Recherche du Québec - Nature et Technologie (FRQNT) Masters Research Scholarship (2018-2020)
  • McGill Graduate Excellence Award (2018-2020)
  • Ordre des Ingénieurs Foundation Excellence Scholarship (2016)

A special thanks to this template.