Martin Klissarov

Martin Klissarov

I am a PhD student supervised by Prof. Doina Precup at McGill University and Mila. I am particularly interested in scalable human-inspired approaches to intelligence.

Humans are able to learn new skills and adapt to changes in a sample efficient way, can reinforcement learning agents do the same? My research is currently centered on meta reinforcement learning, together with temporal abstractions and off-policy methods, as a way to answer this question.

Email | Google Scholar | LinkedIn | Twitter | CV

News

05/06/2023 Started a research intern at Meta Montreal with Shagun Sodhani, Mikael Henaff and Amy Zhang!

25/04/2023 Our work with Marlos, Deep Laplacian-based Options, has been accepted to ICML 2023! 🏝

31/01/2023 The project we worked on with Marlos C. Machado during my DeepMind intern has been released on arXiv! We scale up a promising approach for option discovery that yields strong exploration performance.

08/10/2022 Selected as a Top Reviewer at NeurIPS 2022! We all have a part to play in making our research community better, as much as time allows us.

14/09/2022 Our work on leveraging meta learning for emphatic algorithms was accepted at NeurIPS 2022!

11/07/2022 Started a research internship at DeepMind Alberta with Marlos C. Machado!

16/04/2022 Selected as an Highlighted Reviewer for ICLR 2022! Hopefully those reviews helped the authors.

15/10/2021 Selected as an Oustanding Reviewer (top 8%) for NeurIPS 2021! Amazing to be recognized for the time and thought put into the reviewing service.

28/09/2021 "Flexible Option Learning" has been accepted as a Spotlight to NeurIPS 2021! The paper and code will be out soon.

23/09/2021 Started a research internship at Amazon Web Services under the supervision of Alex Smola and Rasool Fakoor.

01/04/2021 Started a research internship at Microsoft Research Montreal under the supervision of Mehdi Fatemi and Romain Laroche.

Research

	Deep Laplacian-Based Options for Temporally-Extended Exploration Martin Klissarov and Marlos C. Machado International Conference on Machine Learning (ICML), 2023 pdf \| bibtex \| Twitter
	Adaptive Interest for Emphatic Reinforcement Learning Martin Klissarov, Rasool Fakoor, Jonas Mueller, Kavosh Asadi, Taesup Kim and Alex Smola Neural Information Processing Systems (NeurIPS), 2022 DARL workshop at ICML 2022, Spotlight pdf \| bibtex
	Flexible Option Learning Martin Klissarov and Doina Precup Neural Information Processing Systems (NeurIPS), 2021, Spotlight pdf \| bibtex \| code
	Reward Propagation using Graph Convolutional Networks Martin Klissarov and Doina Precup Neural Information Processing Systems (NeurIPS), 2020, Spotlight pdf \| bibtex \| code
	Options of Interest: Temporal Abstraction with Interest Functions Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup Association for the Advancement of Artificial Intelligence (AAAI), 2020 webpage \| pdf \| bibtex \| code
	Variational State Encoding Martin Klissarov, Riashat Islam, Khimya Khetarpal, Doina Precup The Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM), 2019 pdf \| bibtex
	Diffusion-Based Approximate Value Functions Martin Klissarov, Doina Precup International Conference on Machine Learning (ICML) Efficient Credit Assignemnt Workshop, 2018, Oral pdf \| bibtex
	When Waiting is not an Option: Learning Options using the Deliberation Cost Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup Association for the Advancement of Artificial Intelligence (AAAI), 2018 pdf \| bibtex \| code
	Learning Options End-to-End for Continuous Action Tasks Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup Neural Information Processing Systems (NIPS) Hierarchichal Reinforcement Learning Workshop, 2017 pdf \| bibtex \| code

Education

	McGill University2020 - Present PhD in Computer Science Supervisor: Prof. Doina Precup
	McGill University2018 - 2020 MSc in Computer Science Supervisor: Prof. Doina Precup

Reviewing

TMLR: 2022
NeurIPS: 2020 / 2021 (Outstanding reviewer) / 2022 (Top reviewer)
ICML: 2021 / 2022
AAAI: 2021 / 2022
ICLR: 2022 (Highlighted reviewer)
CoLLAs: 2022

Organisation Comittee

CoLLAs: 2022

Selected Awards

Natural Sciences and Engineering Research Council of Canada (NSERC) Alexander Graham Bell Canada Graduate Scholarship (2020-2023)
Fonds de Recherche du Québec - Nature et Technologie (FRQNT) Masters Research Scholarship (2018-2020)
McGill Graduate Excellence Award (2018-2020)
Ordre des Ingénieurs Foundation Excellence Scholarship (2016)

A special thanks to this template.