Matteo Bortoletto

I am a PhD Student in Computer Science at the University of Stuttgart, Germany, advised by Prof. Andreas Bulling. My research focuses on computational theory of mind, with a specific emphasis on deep learning approaches. The ultimate goal is improving human-AI collaboration.

Research Interests

• Designing and assessing AI models for theory of mind tasks that span multiple modalities, including vision and natural language
• Probing and manipulating LLMs' internal representations of mental states
• Stress-testing theory of mind on LLMs and VLMs.
• Planning using theory of mind

I maintain a page where I summarize every new paper involving theory of mind and LLMs.

News

[04.07.2024] 🔥 Paper accepted at ECAI 2024 (Santiago de Compostela, Spain)

[24.06.2024] 🔥 Paper accepted at ICML 2024 Workshop on Mechanistic Interpretability (Vienna, Austria)

[16.05.2024] 🔥 Paper accepted at ACL 2024 (Bangkok, Thailand)

[01.05.2024] ☀️ I got accepted at the CoGenAI Summer School (Aalto University, Finland)

[25.03.2024] 👨🏼‍🏫 Constantin Ruhdorfer, Anna Penzkofer and I are organising a new course titled “Computational Theory of Mind and Cognition”

[01.03.2024] 🏆 My student Constantin Ruhdorfer's master's thesis was awarded the Rul Gunzenhäuser Award

[18.12.2023] 🏅 I have been selected as volunteer for AAAI 2024

[09.12.2023] 🔥 Paper accepted at AAAI 2024 (Vancouver, Canada)

[29.09.2023] 📑 Reviewing for CHI 2024

[07.04.2023] 🔥 Paper accepted at CogSci 2023 (Sydney, Australia)

[27.03.2023] 🔥 Paper accepted at INTERACT 2023 (York, UK)

Publications

Peer Reviewed

Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions
M Bortoletto, C Ruhdorfer, L Shi, A Bulling
ECAI 2024 (Oral) [Paper] [Project]

Benchmarking Mental State Representations in Language Models
M Bortoletto, C Ruhdorfer, L Shi, A Bulling
ICML 2024 Workshop on Mechanistic Interpretability [Paper] [Project] [Poster]

Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition
M Bortoletto, C Ruhdorfer, A Abdessaied, L Shi, A Bulling
ACL 2024 [Paper] [Project] [Poster]

Neural Reasoning about Agents' Goals, Preferences, and Actions
M Bortoletto, L Shi, A Bulling
AAAI 2024 [Paper] [Project] [Poster]

Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention
E Sood, L Shi, M Bortoletto, Y Wang, P Müller, A Bulling
CogSci 2023 [Paper]

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling
G Zhang, M Bortoletto, Z Hu, L Shi, M Bâce, A Bulling
INTERACT 2023 [Paper]

Preprints

The Overcooked Generalisation Challenge
C Ruhdorfer, M Bortoletto, A Penzkofer, A Bulling
arXiv:2406.17949 [Paper]

Students

I regularly supervise Master and Bachelor theses. If you have an idea for your thesis, feel free to contact me. If you are looking for available projects, check if there are Open Thesis Projects here.