Contact
mc191@hw.ac.uk
CV
Linkedin
Twitter (@MirunaClinciu)
Github
About

I am a Postgraduate Research Student in Robotics and Autonomous Systems (CDT-RAS) at the Edinburgh Centre of Robotics, a joint degree between Heriot-Watt University and the University of Edinburgh.
My Research Project "Explainable AI via Bayesian Learning" is sponsored by Schlumberger Cambridge Research Center, under the academic supervision of Helen Hastie and Arash Eshghi.

Previously, I completed a MSc in Artificial Intelligence at the University of Aberdeen, UK and a BSc in Mechatronics and Robotics at "Politehnica" University of Bucharest, Romania. Also, I hold a MSc in Advanced Engineering in Offshore Oil and Gas industry, Constanta, Romania.

My research interests lie within the broad area of Explainable AI. More specifically, my research focus on generating and evaluating Natural Language Explanations. I am also very interested in causality and commonsense.

News

2025
  • Organizer GEM2 Workshop: Generation, Evaluation & Metrics - ACL 2025
  • Learning Facilitator 
    • MIT xPRO’s Designing and Building AI Products and Service
    Imperial Business Analytics: From Data to Decisions


Research

See Google Scholar or Semantic Scholar for latests preprints.

Publications
* below indicates equal contribution

2025
SHADES: Towards a multilingual assessment of stereotypes in large language models
Margaret Mitchell, Giuseppe Attanasio, Ioana Baldini,Miruna Clinciu, Jordan Clive, Pieter Delobelle, Manan Dey, Sil Hamilton, Timm Dill, Jad Doughman, Ritam Dutt, Avijit Ghosh, Jessica Zosa Forde, Carolin Holtermann, Lucie-Aimée Kaffee, Tanmay Laud, Anne Lauscher, Roberto L Lopez-Davila, Maraim Masoud, Nikita Nangia, Anaelia Ovalle, Giada Pistilli, Dragomir Radev, Beatrice Savoldi, Vipul Raheja, Jeremy Qin, Esther Ploeger, Arjun Subramonian, Kaustubh Dhole, Kaiser Sun, Amirbek Djanibekov, Jonibek Mansurov, Kayo Yin, Emilio Villa Cueva, Sagnik Mukherjee, Jerry Huang, Xudong Shen, Jay Gala, Hamdan Al-Ali, Tair Djanibekov, Nurdaulet Mukhituly, Shangrui Nie, Shanya Sharma, Karolina Stańczak, Eliza Szczechla, Tiago Timponi Torrent, Deepak Tunuguntla, Marcelo Viridiano, Oskar Van Der Wal, Adina Yakefu, Aurélie Névéol, Mike Zhang, Sydney Zink, Zeerak Talat
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)

pdf

 

2024
The 2024 GEM Shared Task on Multilingual Data-to-Text Generation and Summarization: Overview and Preliminary Results
Simon Mille, João Sedoc, Yixin Liu, Elizabeth Clark, Agnes Johanna Axelsson, Miruna Adriana Clinciu, Yufang Hou, Saad Mahamood, Ishmael Nyunya Obonyo, Lining Zhang
Proceedings of the 17th International Natural Language Generation Conference: Generation Challenges

pdf

 

On the Role of Summary Content Units in Text Summarization Evaluation
Marcel Nawrath, Agnieszka Nowak, Tristan Ratz, Danilo Walenta, Juri Opitz, Leonardo Ribeiro, João Sedoc, Daniel Deutsch, Simon Mille, Yixin Liu, Sebastian Gehrmann, Lining Zhang, Saad Mahamood, Miruna Clinciu, Khyathi Chandu, Yufang Hou
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)

pdf

 

2023
Barriers and enabling factors for error analysis in NLG research
Emiel van Miltenburg, Miruna Clinciu, Ondrej Dusek, Dimitra Gkatzia, Stephanie Inglis, Leo Leppänen, Saad Mahamood, S. Schoch, Craig Thomson, Luou Wen
NEJLT: Northern European Journal of Language Technology
pdf

2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ili'c ... Miruna Clinciu ... (please check full list of authors)
BigScience Workshop
pdf

You reap what you sow: On the Challenges of Bias Evaluation Under Multilingual Settings
Zeerak Talat, Aurélie Névéol, Stella Biderman, Miruna Clinciu, Manan Dey, Shayne Longpre, Sasha Luccioni, Maraim Masoud, Margaret Mitchell, Dragomir Radev, Shanya Sharma, Arjun Subramonian, Jaesung Tae, Samson Tan, Deepak Tunuguntla, Oskar Van Der Wal
In Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models
pdf

Emergent Structures and Training Dynamics in Large Language Models
Ryan Teehan, Miruna Clinciu, Oleg Serikov, Eliza Szczechla, Natasha Seelam, Shachar Mirkin, Aaron Gokaslan
In Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models
pdf

A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization
Lining Zhang, Simon Mille, Yufang Hou, Daniel Deutsch, Elizabeth Clark, Yixin Liu, Saad Mahamood, Sebastian Gehrmann, Miruna Clinciu, Khyathi Raghavi Chandu, João Sedoc
In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers.
pdf

2021
Underreporting of errors in NLG output, and what to do about it
Emiel van Miltenburg, Miruna Clinciu, Ondřej Dušek, Dimitra Gkatzia, Stephanie Inglis, Leo Leppänen, Saad Mahamood, Emma Manning, Stephanie Schoch, Craig Thomson, Luou Wen
In Proceedings of the 14th International Conference on Natural Language Generation, August, 2021.
pdf

I don't understand! Evaluation Methods for Natural Language Explanations
Miruna Clinciu, Arash Eshghi and Helen Hastie
In Proceedings of the SICSA eXplainable Artifical Intelligence Workshop 2021 (SICSA XAI 2021), Aberdeen, United Kingdom, June 1st, 2021.
pdf | slides

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna Clinciu, Dipanjan Das, Kaustubh D Dhole, Wanyu Du, Esin Durmus, Ondřej Dušek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou
pdf | website

A Study of Automatic Metrics for the Evaluation of Natural Language Explanations
Miruna Adriana Clinciu, Arash Eshghi, H. Hastie
In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (EACL), 2021.
pdf | code | poster | slides

It’s Common Sense, isn’t it? Demystifying Human Evaluations in Commonsense-enhanced NLG systems
Miruna Clinciu*, Dimitra Gkatzia* and Saad Mahamood*
In Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval, EACL), 2021.
pdf | code | website | poster | presentation | video

2020
Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definition
David Howcroft, Anya Belz, Miruna Clinciu, Dimitra Gkatzia, Sadid A. Hasan, Saad Mahamood, Simon Mille, Emiel van Miltenburg, Sashank Santhanam, and Verena Rieser
In Proceedings of the 13th International Conference on Natural Language Generation (INLG), 2020.
pdf | code

Let's Evaluate Explanations!
Miruna-Adriana Clinciu and Helen Hastie
In Proceedings of HRI 2020 Workshop on Test Methods and Metrics for Effective HRI in Real World Human-Robot Teams (Extended Abstract), 2020.
pdf

2019
A Survey of Explainable AI Terminology
Miruna-Adriana Clinciu and Helen Hastie
In Proceedings of the 1st Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (NL4XAI, INLG), 2019.
pdf | slides