publications

2026

1. Distributional Active Inference

   Abdullah Akgül, Gülçin Baykal, M. Haussmann, and 2 more authors

   In Forty-third International Conference on Machine Learning, 2026

   Bib

   @inproceedings{akgul2026distributional,
     title = {Distributional Active Inference},
     author = {Akg{\"u}l, Abdullah and Baykal, G{\"u}l{\c{c}}in and Haussmann, M. and {\c{C}}elikok, Mustafa Mert and Kandemir, M.},
     booktitle = {Forty-third International Conference on Machine Learning},
     year = {2026},
     url = {https://openreview.net/forum?id=m3O4qYQ5hu},
   }

2. Hitting Time Isomorphism for Multi-Stage Planning with Foundation Policies

   Magnus V. Boock, Abdullah Akgül, Mustafa Mert Çelikok, and 1 more author

   arXiv preprint arXiv:2605.06470, 2026
3. A Measure-Theoretic Finite-Sample Theory for Adaptive-Data Fitted Q-Iteration

   M. Haussmann, Mustafa Mert Çelikok, and M. Kandemir

   arXiv preprint arXiv:2605.05791, 2026
4. The Arbiter Agent: Continually Monitoring Multi-Agent Conversations to Detect Emergent Misalignment

   F. Tonini, F. Torrielli, A. D. Lautrup, and 3 more authors

   arXiv preprint arXiv:2606.10747, 2026

   Bib

   @article{tonini2026arbiter,
     title = {The Arbiter Agent: Continually Monitoring Multi-Agent Conversations to Detect Emergent Misalignment},
     author = {Tonini, F. and Torrielli, F. and Lautrup, A. D. and Schneider-Kamp, P. and {\c{C}}elikok, Mustafa Mert and Poech, L. G.},
     journal = {arXiv preprint arXiv:2606.10747},
     year = {2026},
   }

2025

1. On the Complexity of Learning to Cooperate with Populations of Socially Rational Agents

   Saptarashmi Bandhopadhyay^*, Mustafa Mert Çelikok^*, and R. Loftin^*

   In Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems, 2025

   Bib

   @inproceedings{bandyopadhyay2025complexity,
     title = {On the Complexity of Learning to Cooperate with Populations of Socially Rational Agents},
     author = {Bandhopadhyay, Saptarashmi and {\c{C}}elikok, Mustafa Mert and Loftin, R.},
     booktitle = {Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems},
     year = {2025},
   }

2. Social Cooperation in Conversational AI Agents

   Mustafa Mert Çelikok, Saptarashmi Bandhopadhyay, and R. Loftin

   In The 6th Multi-disciplinary Conference on Reinforcement Learning and Decision-Making (RLDM), 2025
3. Value Improved Actor Critic Algorithms

   Y. Oren, M. A. Zanger, P. R. Van der Vaart, and 3 more authors

   In Advances in Neural Information Processing Systems (NeurIPS), 2025

   Bib

   @inproceedings{oren2025value,
     title = {Value Improved Actor Critic Algorithms},
     author = {Oren, Y. and Zanger, M. A. and {Van der Vaart}, P. R. and {\c{C}}elikok, Mustafa Mert and Spaan, M. T. J. and Bohmer, W.},
     booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
     year = {2025},
   }

4. Abstraction for Bayesian Reinforcement Learning in Factored POMDPs

   Rolf A. N. Starre, S. Katt, Mustafa Mert Çelikok, and 2 more authors

   Transactions on Machine Learning Research, 2025

2024

1. Inverse Concave-Utility Reinforcement Learning is Inverse Game Theory

   Mustafa Mert Çelikok, F. A. Oliehoek, and J.-W. van de Meent

   . Under review, see URL for up-to-date version , 2024
2. Uncoupled Learning of Differential Stackelberg Equilibria with Commitments

   R. Loftin^*, Mustafa Mert Çelikok^*, H. Van Hoof, and 2 more authors

   In Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems, 2024

   Bib

   @inproceedings{loftin2024uncoupled,
     title = {Uncoupled Learning of Differential Stackelberg Equilibria with Commitments},
     author = {Loftin, R. and {\c{C}}elikok, Mustafa Mert and {Van Hoof}, H. and Kaski, Samuel and Oliehoek, F. A.},
     booktitle = {Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems},
     year = {2024},
     pages = {1265--1273},
   }

2023

1. Model-based Multi-agent Reinforcement Learning for AI Assistants

   Mustafa Mert Çelikok

   Aalto University, 2023

   Bib

   @phdthesis{celikok2023thesis,
     title = {Model-based Multi-agent Reinforcement Learning for AI Assistants},
     author = {{\c{C}}elikok, Mustafa Mert},
     school = {Aalto University},
     address = {Espoo, Finland},
     year = {2023},
     url = {https://aaltodoc.aalto.fi/handle/123456789/120725}
   }

2. Modelling Needs User Modelling

   Mustafa Mert Çelikok, Pierre-Alexandre Murena, and Samuel Kaski

   Frontiers in Artificial Intelligence, 2023
3. Teaching to Learn: Sequential Teaching of Learners with Internal States

   Mustafa Mert Çelikok, Pierre-Alexandre Murena, and Samuel Kaski

   In Proceedings of the AAAI Conference on Artificial Intelligence, 2023
4. Differentiable User Models

   A. Hämäläinen, Mustafa Mert Çelikok, and Samuel Kaski

   In The 39th Conference on Uncertainty in Artificial Intelligence (UAI), 2023
5. Towards a Unifying Model of Rationality in Multiagent Systems

   R. Loftin, Mustafa Mert Çelikok, and F. A. Oliehoek

   In The 14th Workshop on Optimization and Learning in Multiagent Systems, Workshop at the 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023), 2023

2022

1. Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs

   Mustafa Mert Çelikok, F. A. Oliehoek, and Samuel Kaski

   In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, 2022

   Bib

   @inproceedings{celikok2022bestresponse,
     title = {Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs},
     author = {{\c{C}}elikok, Mustafa Mert and Oliehoek, F. A. and Kaski, Samuel},
     booktitle = {Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems},
     pages = {235--243},
     year = {2022},
   }

2. Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems

   M. Suau, J. He, Mustafa Mert Çelikok, and 2 more authors

   In Advances in Neural Information Processing Systems (NeurIPS), 2022

2019

1. Interactive AI with a Theory of Mind

   Mustafa Mert Çelikok, T. Peltola, P. Daee, and 1 more author

   In Computational Modeling in Human-Computer Interaction, ACM CHI Workshop, 2019
2. Agent Robustness to Negative Interruptions: A Multi-agent Learning Approach

   Mustafa Mert Çelikok, T. Peltola, and Samuel Kaski

   In Bridging Game Theory and Deep Learning Workshop, NeurIPS, 2019
3. Machine Teaching of Active Sequential Learners

   T. Peltola, Mustafa Mert Çelikok, P. Daee, and 1 more author

   In Advances in Neural Information Processing Systems (NeurIPS), 2019
4. Modelling User’s Theory of AI’s Mind in Interactive Intelligent Systems

   T. Peltola, Mustafa Mert Çelikok, P. Daee, and 1 more author

   In The 4th Multi-disciplinary Conference on Reinforcement Learning and Decision-Making (RLDM), 2019