Martin Klissarov

I am a PhD student supervised by Prof. Doina Precup at McGill University and Mila. I am particularly interested in scalable human-inspired approaches to intelligence.

Humans are able to learn new skills and adapt to changes in a sample efficiency way, can RL agents do the same? My recent research is currently centered on meta reinforcement learning, together with temporal abstractions and off-policy methods, as a way to answer this question.

Email | Google Scholar | LinkedIn | Twitter | CV

News

15/10/2021 Selected as an Oustanding Reviewer (top 8%) for NeurIPS 2021! Amazing to be recognized for the time and thought put into the reviewing service.

28/09/2021 "Flexible Option Learning" has been accepted as a Spotlight to NeurIPS 2021! The paper and code will be out soon.

23/09/2021 Started a research internship at Amazon Web Services under the supervision of Alex Smola and Rasool Fakoor.

01/04/2021 Started a research internship at Microsoft Research Montreal under the supervision of Mehdi Fatemi and Romain Laroche.

Research

	Flexible Option Learning Martin Klissarov and Doina Precup Neural Information Processing Systems (NeurIPS), 2021, Spotlight pdf \| bibtex \| code
	Reward Propagation using Graph Convolutional Networks Martin Klissarov and Doina Precup Neural Information Processing Systems (NeurIPS), 2020, Spotlight pdf \| bibtex \| code
	Options of Interest: Temporal Abstraction with Interest Functions Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup Association for the Advancement of Artificial Intelligence (AAAI), 2020 webpage \| pdf \| bibtex \| code
	Variational State Encoding Martin Klissarov, Riashat Islam, Khimya Khetarpal, Doina Precup The Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM), 2019 pdf \| bibtex
	Diffusion-Based Approximate Value Functions Martin Klissarov, Doina Precup International Conference on Machine Learning (ICML) Efficient Credit Assignemnt Workshop, 2018, Oral pdf \| bibtex
	When Waiting is not an Option: Learning Options using the Deliberation Cost Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup Association for the Advancement of Artificial Intelligence (AAAI), 2018 pdf \| bibtex \| code
	Learning Options End-to-End for Continuous Action Tasks Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup Neural Information Processing Systems (NIPS) Hierarchichal Reinforcement Learning Workshop, 2017 pdf \| bibtex \| code

Education

	McGill University2020 - Present PhD in Computer Science Supervisor: Prof. Doina Precup
	McGill University2018 - 2020 MSc in Computer Science Supervisor: Prof. Doina Precup
	Polytechnique Montréal2014 - 2018 BEng in Electrical Engineering Supervisor: Prof. Christophe Caloz

Reviewing

NeurIPS: 2020 / 2021
ICML: 2021
AAAI: 2021 / 2022
ICLR: 2022

Selected Awards

Natural Sciences and Engineering Research Council of Canada (NSERC) Alexander Graham Bell Canada Graduate Scholarship (2020-2023)
Fonds de Recherche du Québec - Nature et Technologie (FRQNT) Masters Research Scholarship (2018-2020)
McGill Graduate Excellence Award (2018-2020)
Ordre des Ingénieurs Foundation Excellence Scholarship (2016)

A special thanks to this template.