Academic

Special Issue Editor The Knowledge Engineering Review, Special Issue on Adaptive and Learning Agents, 2017
Co-chair 8th Adaptive Learning Agents Workshop (ALA) at AAMAS 2016
7th Adaptive Learning Agents Workshop (ALA) at AAMAS 2015
Co-organiser Dutch-Belgian Reinforcement Learning workshop, 2013
SPC member AAMAS 2021, ECAI 2020
PC member AAAI 2016, AAMAS 2016/17/18/19/20, ALA 2013/14/20/21, IJCAI 2015/16/17/18/19, MALIC 2016/18, TAROS 2015, PRICAI 2018, COMARL 2020
Reviewer Computational Intelligence
Games – Open Access Game Theory Journal
IEEE Systems Journal
IEEE Transactions on Cybernetics
Journal of Autonomous Agents and Multi-Agent Systems
Journal of Artificial Intelligence Research
The Knowledge Engineering Review
Lecturer Tutorial on Multi-Agent Reinforcement Learning and Dynamics of Learning at the 20th European Agent Systems Summer School in Maastricht, NL, June 2018
Tutorial on Multi-Agent Reinforcement Learning and Dynamics of Learning at the 19th European Agent Systems Summer School in Gdansk, Poland, August 2017
Reinforcement Learning tutorial at AAMAS 2016
Multi-agent Reinforcement Learning tutorials at ALA 2014, ECML 2013, and AAMAS 2013
Local org. 9th European Workshop on Multi-agent Systems (EUMAS 2011), Maastricht, The Netherlands.

Teaching

Module Co-ordinator, COMP532 Machine Learning and BioInspired Optimisation, M.Sc, Department of Computer Science, University of Liverpool, 2016/17.
Teaching Assistant, Computer Science, introduction to JAVA programming. B.Sc. Knowledge Engineering, Maastricht University, 2013/14, 2012/13, 2011/12.
Teaching Assistant, Theoretical Computer Science, introduction to automata, formal languages, computability, and complexity. B.Sc. Knowledge Engineering, Maastricht University, 2013/12, 2011/12.

Thesis supervision

Henning Metzmacher (January 2013), “Semi-Automatic 3D Object Extraction from Image Collections”, M.Sc. Artificial Intelligence, Maastricht University.
Bernhard Cleven (October 2012), “Gesture Recognition for Human-Robot Interaction”, M.Sc. Artificial Intelligence, Maastricht University.
Sara van de Moosdijk (June 2012), “The Influence of Risk Preference on Social Dilemmas: Comparing Prisoners’ Dilemma to Stag Hunt”, B.Sc. Knowledge Engineering, Maastricht University.

Internship supervision

Raymond Koopmanschap (2020), “Distributional Lenient Multi-Agent Deep Reinforcement Learning”, Centrum Wiskunde & Informatica.
Tim de Boer (2019/20), “The Effect of Clustered Interactions on the Development of Fairness in the Ultimatum Game”, Centrum Wiskunde & Informatica.
Jim Hoekstra (2019), “Learning to Coordinate by Implicit Communication in Hanabi”, Centrum Wiskunde & Informatica.
Hugo Heemskerk (2019), “Curiosity Driven Deep Multi-Agent Reinforcement Learning”, Centrum Wiskunde & Informatica.
Jasper Bakker & Aron Hammond (2018), “RLBOA: A Modular Reinforcement Learning Framework for Autonomous Negotiating Agents”, Centrum Wiskunde & Informatica.

Other

Chairman, PhD Academy Maastricht, organises social, educative and fun activities for all PhD candidates of Maastricht University, 2013/14.
Social events coordinator, PhD Academy Maastricht, 2012/13.
Chairman, Study Association Incognito, organises social and academic activities for all bachelor and master students at the Department of Knowledge Engineering, Maastricht
University, 2008/09.
Activities Committee member, Study Association Incognito, 2006/07.