Publications

2024

• Lexin Zhou, Wout Schellaert, Fernando Martínez-Plumed, Moros-Daval, Y., Cèsar Ferri, & José Hernández-Orallo: “Larger and more instructable language models become less reliable”, Nature 634, 61–68, 2024

• Fernando Martínez-Plumed, Gonzalo Jaimovitch-López, Cèsar Ferri, José Hernández-Orallo, Maria José Ramírez-Quintana,: “A General Supply-Inspect Cost Framework to Regulate the Reliability-Usability Trade-Offs for Few-Shot Inference”. Complex & Intelligent Systems Journal, Springer.

• Raül Fabra-Boluda, Cesar Ferri, Maria Jose Ramírez-Quintana, Fernando Martínez-Plumed “Unveiling the Robustness of Machine Learning Families”. Machine Learning: Science and Technology Journal, IOPScience, pp. 1-21 (to appear), 2024

• Raül Fabra-Boluda, Cesar Ferri, José Hernández-Orallo, Maria Jose Ramírez-Quintana, Fernando Martínez-Plumed “Cracking black-box models: Revealing hidden machine learning techniques behind their predictions”. Intelligent Data Analysis Journal, IOS Press, pp. 1-21 (pre-press), 2024

• Behzad Mehrbakhsh; Fernando Martínez-Plumed, Jose Hernández-Orallo, “Distilling the Effects of Language Model Contamination”, Proceedings of the 27th European Conference on Artificial Intelligence (ECAI 2024), Santiago de Compostela, Spain, 2024

• Yael Moros-Daval; Fernando Martínez-Plumed, Jose Hernández-Orallo, “Language Task Difficulty Prediction through LLM-Annotated Meta-Features”, Proceedings of the 27th European Conference on Artificial Intelligence (ECAI 2024), Santiago de Compostela, Spain, 2024

• Wout Schellaert, Fernando Martínez-Plumed , Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Sean Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo: “Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint)”, 38th AAAI Conference on Artificial Intelligence, pp 22712-22712, Vancouver, Canada, 2024

• Daniel Romero, José Hernández-Orallo, Fernando Martínez-Plumed: “How Resilient are Language Models to Text Perturbations?”, The 25th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2024), November 20-22, 2024, LNCS 15346, Valencia, Spain, 2024

• Cristina Padro-Ferragut, M. José Ramírez-Quintana, Fernando Martínez-Plumed: “Noise tolerance and robustness ranking in Machine Learning models”, The 25th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2024), November 20-22, 2024, LNCS 15346, Valencia, Spain, 2024

• Sócrates Llácer Luna, Dario Garigliotti, Fernando Martínez-Plumed, Cèsar Ferri: “Automatic PDF Document Classification with Machine Learning”, The 25th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2024), November 20-22, 2024, LNCS 15346, Valencia, Spain, 2024

• Wout Schellaert, Ronan Hamon, Fernando Martínez-Plumed, Jose Hernandez-Orallo “A Proposal for Scaling the Scaling Laws”. Workshop on the Scaling Behavior of Large Language Models (SCALE-LLM), Malta, 22 March 2024, co-located with EACL 2024, Association for Computational Linguistic, 2024

• Behzad Mehrbakhsh, Dario Garigliotti, Fernando Martínez-Plumed, Jose Hernandez-Orallo “Confounders in Instance Variation for the Analysis of Data Contamination”. Workshop on Data Contamination @ ACL 2024, Bangkok, Thailand, August 11th to 16th, 2024

2023

• Ryan Burnell, Wout Schellaert, John Burden, Tomer D. Ullman, Fernando Martínez-Plumed, Joshua B. Tenenbaum, Danaja Rutar, Lucy G. Cheke, Jascha Sohl-Dickstein, Melanie Mitchell, Douwe Kiela, Murray Shanahan, Ellen M. Voorhees, Anthony G. Cohn, Joel Z. Leibo, & Jose Hernandez-Orallo: “Rethink reporting of evaluation results in AI”. Science. Vol 380, Issue 6641, pp. 136-138, 2023.

• Radosvet Desislavov, Fernando Martínez-Plumed, José Hernández-Orallo, J.: “Trends in AI Inference Energy Consumption: Beyond the Performance-vs-Parameter Laws of Deep Learning”. Sustainable Computing: Informatics and Systems, Elsevier, Vol 38, 2023.

• Gonzalo Jaimovitch-López, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, Maria José Ramírez-Quintana,: “Can language models automate data wrangling?”. Machine Learning Journal, Springer, Vol. 112, 2053–2082, 2023.

• Wout Schellaert, Fernando Martínez-Plumed , Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Sean Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo: “Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models”, Journal of Artificial Intelligence Research (JAIR). Vol. 77, 377-394, 2023.

• Aarohi Srivastava, …, Fernando Martínez-Plumed, …, Ziyi Wu, Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. Transactions on Machine Learning Research, ISSN 2835-8856, May 2023.

• Behzad Mehrbakhsh; Fernando Martínez-Plumed, Jose Hernández-Orallo, “Adversarial Benchmark Evaluation Rectified by Controlling for Difficulty”, Proceedings of the 26th European Conference on Artificial Intelligence (ECAI 2023), Kraków, Poland, 2023. (Technical Appendix)

• Fernando Martínez-Plumed, Jose Hernández-Orallo, “Training Data Scientists through Project-based Learning” IEEE Latin-American Journal of Learning Technologie (IEEE RITA) Vol 18 (3), 2023.

• Mila Staneva, …, Fernando Martinez-Plumed, …, Michael Wooldridge, “Assessing AI capabilities with education tests”, AI and the Future of Skills, Volume 2 Methods for Evaluating AI Capabilities, 2023.

• Lexin Zhou, Pablo A. Moreno-Casares, Fernando Martínez-Plumed, John Burden, Ryan Burnell, Lucy Cheke, Cèsar Ferri, Alexandru Marcoci, Behzad Mehrbakhsh, Yael Moros-Daval, Seán Ó hÉigeartaigh, Danaja Rutar, Wout Schellaert, Konstantinos Voudouris, José Hernández-Orallo “Predictable Artificial Intelligence” arXiv:2310.06167, 2023.

2022

• Fernando Martínez-Plumed, David Castellano-Falcón, Carlos Monserrat, José Hernández-Orallo: “When AI Difficulty is Easy: The Explanatory Power of Predicting IRT Difficulty”, 36th AAAI Conference on Artificial Intelligence (AAAI 2022), Feb 22 - March 1, Vancouver, Canada, 2022.

• José Hernández-Orallo, Wout Schellaert, Fernando Martínez-Plumed, : “Training on the Test Set: Mapping the System-Problem Space in AI”, 36th AAAI Conference on Artificial Intelligence (AAAI 2022), Feb 22 - March 1, Vancouver, Canada, 2022.

• Songul Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernandez-Macias, José Hernández-Orallo & Emilia Gómez: “Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks (Extended Abstract)”, Proceedings of the 31st International Joint Conference on Artificial Intelligence, Vienna, Austria, 2022.

• Lexin Zhou, Fernando Martínez-Plumed, José Hernández-Orallo, Cèsar Ferri and Wout Schellaert, Reject Before You Run: Small Assessors Anticipate Big, 1st International Workshop on AI Evaluation Beyond Metrics (EBeM 2022) @ IJCAI 2022, Vienna, Austria, 2022.

• Raül Fabra-Boluda, Cesar Ferri, Fernando Martínez-Plumed and Maria Jose Ramirez-Quintana, Robustness Testing of Machine Learning Families using Instance-Level IRT-Difficulty, 1st International Workshop on AI Evaluation Beyond Metrics (EBeM 2022) @ IJCAI 2022, Vienna, Austria, 2022.

• Fernando Martinez Plumed, Fernando Caballero Benítez, David Castellano Falcón, David Fernandez Llorca, Emilia Gomez, Isabelle Hupont Torres, Luis Merino, Carlos Monserrat, José Hernández Orallo: “AI Watch: Revisiting Technology Readiness Levels for relevant Artificial Intelligence technologies”, Publications Office of the European Union, Luxembourg, ISBN 978-92-76-52328-4.

• Marina Estevez Almenzar, David Fernández-Llorca, Emilia Gómez, Fernando Martínez Plumed, “Glossary of human-centric artificial intelligence”, Publications Office of the European Union, Luxembourg, 2022, ISBN 978-92-76-53432-7, doi:10.2760/860665, JRC129614.

• Aarohi Srivastava, …, Fernando Martínez-Plumed, …, Ziyi Wu, Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. arXiv:2206.04615

• Fernando Martínez-Plumed, Shahar Avin, Miles Brundage, Allan Dafoe, Seán Ó hÉigeartaigh, José Hernández-Orallo: “Between Progress and Potential Impact of AI: the Neglected Dimensions”, CoRR abs/1806.00610, 2022.

• Fernando Martínez-Plumed, Hernández-Orallo: “Trabajos Finales de Grado y Máster orientados a investigación como caso de éxito”, Jornadas sobre la Enseñanza Universitaria de la Informática (JENUI), A Coruña (Spain), June 2022.

2021

• Martínez-Plumed, F., Barredo, P., hÉigeartaigh, S.Ó., Hernández-Orallo, J.: Research community dynamics behind popular AI benchmarks. Nature Machine Intelligence, Vol. 3, pp 581–589, 2021.

• José Hernández‑Orallo, Bao Sheng Loe, Lucy Cheke, Fernando Martínez‑Plumed, & Seán Ó hÉigeartaigh: General intelligence disentangled via a generality metric for natural and artificial intelligence. Nature Scientific Reports, 2021.

• Fernando Martínez-Plumed, Cèsar Ferri, David Nieves, José Hernández-Orallo: “Missing the missing values: The ugly duckling of fairness in machine learning”, International Journal of Intelligent Systems, Wiley, published as OnlineOpen, 2021.

• Songul Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernandez-Macias, José Hernández-Orallo & Emilia Gómez: “Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks”, Journal of Artificial Intelligence Research (JAIR), Volume: 71, pp 191-236, 2021.

• Fernando Martínez-Plumed, Emilia Gómez, José Hernández-Orallo: “Futures of Artificial Intelligence through Technology Readiness Levels”, Telematics and Informatics, Elsevier, Volume 58, May 2021.

• Fernando Martínez-Plumed, José Hernández-Orallo: “Project-Based Learning for Scaffolding Data Scientists’ Skills”, IEEE 16th International Conference on Computer Science & Education (ICCSE 2021), 17-21, August, Lancaster, United Kingdom, 2021. [Best Poster Award]

• Grubanov-Boskovic, S., Ghio, D., Goujon, A., Kalantaryan, S., Belmonte, M., Scipioni, M., Conte, A., Gómez-González, E., Gomez Gutierrez, E., Tolan, S., Martinez Plumed, F., Pesole, A., Fernandez Macias, E. and Hernandez-Orallo, J., Healthcare and long-term care workforce: demographic challenges and potential contribution of migration and digital technology, Publications Office of the European Union, Luxembourg, ISBN 978-92-76-30233-9 (online), 978-92-76-30232-2 (print), 2021.

• Gomez Gutierrez, E., Charisi, V., Tolan, S., Miron, M., Martinez Plumed, F. and Escobar Planas, M., “HUMAINT: Understanding the impact of Artificial Intelligence on human behaviour, Amran, G. editor(s), Publications Office of the European Union, Luxembourg, 2021, ISBN 978-92-76-28212-9 (online),978-92-76-28211-2 (print).

• Sofia Samoili, Montserrat Lopez Cobo, Blagoj Delipetrev, Fernando Martinez-Plumed, Emilia Gomez, Giuditta De Prato: “Defining Artificial Intelligence 2.0. Towards an operational definition and taxonomy of AI for the AI landscape”, Publications Office of the European Union, Luxembourg, 2021, ISBN 978-92-76-42648-6 (online), doi:10.2760/019901 (online), JRC126426, 2021.

• Gonzalo Jaimovitch-Lopez, Cesar Ferri, Jose Hernandez-Orallo, Fernando Martínez-Plumed and María José Ramírez-Quintana: “Can language models automate data wrangling?”, ECMLPKDD Workshop on Automating Data Science (ADS 2021), September 2021.

• Fernando Martínez-Plumed, José Hernández-Orallo: “Aprender haciendo para los futuros científicos de datos”. Jornadas de Innovación Docente en Ingeniería Informática (JIDINF 2021), July 5, Valencia, Spain, 2021.

2020

• Fernando Martínez-Plumed, Lidia Contreras-Ochando, Cèsar Ferri, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche and M. José Ramírez-Quintana, Peter Flach: “CRISP-DM Twenty Years Later: From Data Mining Processes to Data Science Trajectories”, IEEE Transactions on Knowledge and Data Engineering (Early Access), 2020.

• Fernando Martínez-Plumed, José Hernández-Orallo, “Dual Indicators to Analyse AI Benchmarks: Difficulty, Discrimination, Ability and Generality”, IEEE Transactions on Games Volume: 12 (2), pp 121 - 131, June 2020.

• Fernando Martínez-Plumed, Jose Hernández-Orallo, Emilia Gómez, “Tracking AI: The Capability is (Not) Near”, Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020), Santiago de Compostela, Spain, September 2020.

• Jose Hernández-Orallo, Fernando Martínez-Plumed, Shahar Avin, Jess Whittlestone, Seán Ó hÉigeartaigh, “AI Paradigms and AI Safety:Mapping Artefacts and Techniques to Safety Issues”, Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020), Santiago de Compostela, Spain, September 2020.

• Raül Fabra-Boluda, Cèsar Ferri, Fernando Martínez-Plumed, Jose Hernández-Orallo, Mª José Ramírez-Quintana, “Family and Prejudice: A Behavioural Taxonomy ofMachine Learning Techniques”, Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020), Santiago de Compostela, Spain, September 2020.

• Fernando Martínez-Plumed, Songül Tolan, Annarosa Pesole, José Hernández-Orallo, Enrique Fernández-Macias, Emilia Gómez: “Does AI Qualify for the Job? A Biderectional Model Mapping Labour and AI intensities”, Proceedings of the AAAI/ACM conference on Artificial Intelligence, Ethics and Society (AIES 2020), New York, USA, February 7-8, 2020.

• Songul Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernandez-Macias, José Hernández-Orallo & Emilia Gómez, “Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks”, JRC Working Papers on Labour, Education and Technology 2020-02, Joint Research Centre (Seville site). Presented at 1st LISER-IAB Conference on Digital Transformations and the Future of Work, Luxembourg, Feb 13-14, 2020.

• Fernando Martínez Plumed, Emilia Gómez, José Hernández-Orallo: “AI Watch: Assessing Technology Readiness Levels for Artificial Intelligence”, Publications Office of the European Union, Luxembourg, 2020, ISBN 978-92-76-22987-2 (online), EUR 30401 EN, JRC122014, 2020.

• Sofia Samoili, Montserrat Lopez Cobo, Emilia Gomez, Giuditta De Prato, Fernando Martinez-Plumed, Blagoj Delipetrev: “AI WATCH. Defining Artificial Intelligence”, Publications Office of the European Union, Luxembourg, 2020, ISBN 978-92-76-17045-7 (online), doi:10.2760/382730 (online), JRC118163, 2020.

• Fernando Martínez Plumed, Jose Hernández-Orallo, Emilia Gómez, “AI Watch: Methodology to Monitor the Evolution of AI Technologies”, Publications Office of the European Union, Seville, 2020, ISBN 978-92-76-17153-9 (online), doi:10.2760/643950 (online), JRC120090, 2020.

• Delipetrev, B., Tsinaraki, C., Nepelski, D., Gomez Gutierrez, E., Martinez Plumed, F., Misuraca, G., De Prato, G., Fullerton, K., Craglia, M., Duch Brown, N., Nativi, S. and Van Roy, V., “AI Watch 2019 Activity Report”, Desruelle, P. editor(s), EUR 30254 EN, Publications Office of the European Union, Luxembourg, 2020, ISBN 978-92-76-19515-3 (online), doi:10.2760/007745 (online)

• Nativi, S., Anastasakis, K., Asturiol Bofill, D., Balahur-Dobrescu, A., Barbaglia, L., Baumann, K., Beslay, L., Bremer, S., Cardona, M., Castillo, C., Charisi, V., Consoli, S., Corban, C., D’andrimont, R., De Prato, G., Deceuninck, P., Delipetrev, B., Devos, W., Dottori, F., Duch Brown, N., Ferrara, P., Ferri, S., Gomez Gutierrez, E., Gomez Losada, A., Halamoda Kenzaoui, B., Halkia, S., Hamon, R., Hradec, J., Jenkinson, G., Junklewitz, H., Kalas, M., Kemper, T., Lemoine, G., Lopez Cobo, M., Lorini, V., Manzan, S., Martinez Sanchez, L., Martínez Plumed , F., Milenov, P., Nai Fovino, I., Nappo, D., Noce, L., Papazoglou, M., Petrillo, M., Piovesan, J., Puertas Gallardo, A., Righi, R., Rolland, E., Sabo, F., Salamon, P., Samoili, S., Sanchez Martin, J., Sanchez Belenguer, C., Sequeira, V., Soille, P., Syrris, V., Thomakos, D., Tolan, S., Tosetti, E., Van Damme, M., Van Der Velde, M., Vazquez-Prada Baillet, M., Whelan, M., Wittwehr, C., Wolfart, E., Worth, A. and Yordanov, M., “Artificial Intelligence at the JRC”, 2nd workshop on Artificial Intelligence at the JRC, Ispra 5th July 2019, Nativi, S. editor(s), Publications Office of the European Union, Luxembourg, 2020, ISBN 978-92-76-18943-5 (online), 978-92-76-18998-5, doi:10.2760/511755 (online), JRC120539.

• Fernando Martínez-Plumed , Jose Hernandez-Orallo and Emilia Gómez, “Tracking the Impact and Evolution of AI: The AIcollaboratory”, 1st International Workshop on Evaluating Progress in Artificial Intelligence (EPAI 2020) @ ECAI 2020, Santiago de Compostela, Spain, September 4, 2020.

• Pablo Barredo, Jose Hernandez-Orallo, Fernando Martínez-Plumed and Sean O Heigeartaigh, ” The Scientometrics of AI Benchmarks: Unveiling the Underlying Mechanics of AI Research”, 1st International Workshop on Evaluating Progress in Artificial Intelligence (EPAI 2020) @ ECAI 2020, Santiago de Compostela, Spain, September 4, 2020.

• Sofia Samoili, Montserrat López Cobo, Emilia Gómez, Giuditta De Prato, Fernando Martínez-Plumed and Blagoj Delipetrev, “Setting the Boundaries of the AI Landscape: An Operational Definition for the European Commission’s AI Watch”, 1st International Workshop on Evaluating Progress in Artificial Intelligence (EPAI 2020) @ ECAI 2020, Santiago de Compostela, Spain, September 4, 2020.

2019

• Fernando Martínez-Plumed, Ricardo B. C. Prudêncio, Adolfo Martínez-Uso, José Hernández-Orallo: “Item Response Theory in AI: Analysing Machine Learning Classifiers at the Instance Level”, Artificial Intelligence Journal, Elsevier Publications, Volume 271, pp 18-42, 2019.

• Lidia Contreras-Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, M. José Ramírez-Quintana: “Automated Data Transformation with Inductive Programming and Dynamic Background Knowledge”, Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD 2019), Würzburg, Germany, September 16-20, 2019.

• Lidia Contreras-Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, M. José Ramírez-Quintana: “ABK-ADAPT: Dynamic Background Knowledge for Automating Data Transformation”, Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD 2019), Würzburg, Germany, September 16-20, 2019.

• José Hernández-Orallo, Fernando Martínez-Plumed, Shahar Avin and Seán Ó HÉigeartaigh: “Surveying Safety-relevant AI Characteristics”, The AAAI’s Workshop on Artificial Intelligence Safety (SafeAI), Honolulu, Hawaii, USA, January 27, 2019. Best Paper Award Runner-up

• Songül Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernández-Macías, José Hernández-Orallo, Emilia Gomez: “Artificial Intelligence and Jobs: From Tasks to Cognitive Abilities”, RENIR Workshop on the impact of automation and AI in regional economies, Turin, May 27-28, 2019.

• Fernando Martínez-Plumed, Cèsar Ferri, David Nieves, José Hernández-Orallo: “Fairness and Missing Values”, CoRR abs/1905.12728, 2019.

2018

• Fernando Martínez-Plumed , Bao Sheng Loe, Peter Flach, Seán Ó hÉigeartaigh, Karina Vold, José Hernández-Orallo, “The Facets of Artificial Intelligence: A Framework to Track the Evolution of AI”, Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018), pp 5180-5187, Stockholm, Sweden, July 13-19, 2018.

• Sankalp Bhatnagar, Anna Alexandrova, Shahar Avin, Stephen Cave, Lucy Cheke, Matthew Crosby, Jan Feyereis, Marta Halina, Bao Sheng Loe, Seán Ó hÉigeartaigh, Fernando Martínez-Plumed, Huw Price, Henry Shevlin, Adrian Weller, Alan Wineld, and José Hernández-Orallo, “Mapping Intelligence: Requirements and Possibilities”, In: Müller, Vincent C. (ed.), Philosophy and Theory of Artificial Intelligence 2017, Studies in Applied Philosophy, Epistemology and Rational Ethics (SAPERE), Vol 44, ISBN 978-3-319-96447-8, Springer, 2018.

• Raul Fabra-Boluda, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed and M. José Ramírez-Quintana, “Modelling Machine Learning Models”, In: Müller, Vincent C. (ed.), Philosophy and Theory of Artificial Intelligence 2017, Studies in Applied Philosophy, Epistemology and Rational Ethics (SAPERE), Vol 44, ISBN 978-3-319-96447-8, Springer, 2018.

• Raul Fabra-Boluda, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed and M. José Ramírez-Quintana, “Identifying the Machine Learning Family from Black-Box Models”, in Herrera F. et al. (eds) Advances in Artificial Intelligence: Proceedings of the 18th Conference of the Spanish Association for Artificial Intelligence (CAEPIA 2018), Lecture Notes in Artificial Intelligence (LNAI), volumen 11160, 55–65, Granada, Spain, October 23–26, 2018.

• Fernando Martínez-Plumed, Juan Carlos Casamayor, Cèsar Ferri, Jon Ander Gómez, Eduardo Vendrell, “SALER: a Data Science solution to detect and prevent corruption in public administration”, in C. Alzate et al. (Eds.): ECML PKDD 2018 Workshops: 3rd International Workshop on Data Science for Social Good (SoGood 2018 Lecture Notes in Artificial Intelligence (LNAI), 11329, pp. 1–15, Dublin, Ireland, September 10–14, 2018.

• Enrique Fernández-Macías , Emilia Gomez, José Hernández-Orallo, Bao Sheng Loe, Bertin Martens, Fernando Martínez-Plumed, Songül Tolan, “A multidisciplinary task-based perspective for evaluating the impact of AI autonomy and generality on the future of work”, 1st International Workshop on Architectures and Evaluation for Generality, Autonomy & Progress in AI (AEGAP 2018 @ IJCAI 2018), Stockholm, Sweden, July 15, 2018. (Also in arXiv)

• Lidia Contreras-Ochando, Cristina I. Font-Julián, David Nieves, Fernando Martínez-Plumed, “How Data Science helps build Smart Cities. Valencia as a use case”, Cantó Colomina, B. (ed.), Proceedings of the Congress on Small and Medium Smart Cities, ISBN 978-84-09-02970-9, pp 3-11, Alcoy, Spain, February 14-15, 2018.

• Fernando Martínez-Plumed, Jon Ander Gómez, Cèsar Ferri, “El uso de las herramientas big data en la lucha contra la corrupción - Sistema de Alertas Tempranas de la Generalitat Valenciana: La estructura informática del sistema de alertas tempranas”, XXIII Congreso Internacional del CLAD sobre la Reforma del Estado y de la Administración Pública, Guadalajara, México, 6-9 November, 2018.

• Fernando Martínez-Plumed: “Applying Data Science to Fraud Prevention and Detection: SALER Analytics”,X Jornadas de usuarios R (XJUR), Murcia, Spain, 22-23 November, 2018.

• Fernando Martínez-Plumed, Shahar Avin, Miles Brundage, Allan Dafoe, Seán Ó hÉigeartaigh, José Hernández-Orallo: “Accounting for the Neglected Dimensions of AI Progress”, CoRR abs/1806.00610, 2018.

• Fernando Martínez-Plumed, José Hernández-Orallo: “Analysing Results from AI Benchmarks: Key Indicators and How to Obtain Them”, CoRR abs/1811.08186, 2018.

• Enrique Fernández-Macías, Emilia Gómez, José Hernández-Orallo, Bao Sheng Loe, Bertin Martens, Fernando Martínez-Plumed, Songül Tolan: “A multidisciplinary task-based perspective for evaluating the impact of AI autonomy and generality on the future of work”, CoRR abs/1807.02416, 2018.

• Lidia Contreras-Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed and M. José Ramírez-Quintana: “General-purpose Declarative Inductive Programming with Domain-Specific Background Knowledge for Data Wrangling Automation”, CoRR abs/1809.10054, 2018.

• Sankalp Bhatnagar, Anna Alexandrova, Shahar Avin, Stephen Cave, Lucy Cheke, Matthew Crosby, Jan Feyereis, Marta Halina, Bao Sheng Loe, Seán Ó hÉigeartaigh, Fernando Martínez-Plumed, Huw Price, Henry Shevlin, Adrian Weller, Alan Wineld, and José Hernández-Orallo, “A First Survey on an Atlas of Intelligence”, Technical Report, 2018.

2017

• José Hernández-Orallo, Marco Baroni, Jordi Bieger, Nader Chmait, David L. Dowe, Katja Hofmann, Fernando Martínez-Plumed, Claes Strannegård, Kristinn R. Thórisson, "A New AI Evaluation Cosmos: Ready to Play the Game?", AI Magazine, Association for the Advancement of Artificial Intelligence, Vol. 38, No 3, Fall 2017.
• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "A Computational Analysis of General Intelligence Tests for Evaluating Cognitive Development", Cognitive Systems Research, Elsevier Publications, 43, pp 100-118, 2017.
• Fernando Martínez-Plumed, "Incremental and developmental perspectives for general-purpose learning systems", Inteligencia Artificial, Iberamia, 20(60), 24-27, 2017.
• José Hernández-Orallo, Fernando Martínez-Plumed, Ute Schmid, Michael Siebers, David L. Dowe "Computer models solving intelligence test problems: progress and implications (Extended Abstract)", Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp 5005-5009, Melbourne, Australia, 2017.
• José Hernández-Orallo, Raul Fabra-Boluda, Cèsar Ferri, Fernando Martínez-Plumed, M. José Ramírez-Quintana, "Modelling machine learning models" , 3rd Conference on Philosophy & Theory of Artificial Intelligence (PT-AI 2017), Leeds, UK, November, 2017.
• Fernando Martínez-Plumed, "Incremental and developmental perspectives for general-purpose learning systems (Dissertation Briefing)", AI Matters, ACM SIGAI, 3(2), pp 24-25, 2017.
• Fernando Martínez-Plumed, "Incremental and developmental perspectives for general-purpose learning systems (Selected Ph.D. Thesis Abstracts)", The IEEE Intelligent Informatics Bulletin, IEEE Computer Society, 18(1), pp 26-27, 2017.
• Fernando Martínez-Plumed, José Hernández-Orallo, "AI results for the Atari 2600 games: difficulty and discrimination using IRT", 2nd International Workshop Evaluating General-Purpose AI (EGPAI 2017 @ IJCAI 2017), Melbourne, Australia, 2017.
• Lidia Contreras-Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, M. J. Ramírez-Quintana and Susumu Katayama, "Domain specific induction for data wrangling automation (Demo)", Automatic Machine Learning Workshop (AutomML) @ ICML 2017, Sídney, Australia, 2017.
• Fernando Martínez-Plumed, Lidia Contreras-Ochando, Cèsar Ferri, Peter Flach, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche and M. José Ramírez-Quintana, "CASP-DM: Context Aware Standard Process for Data Mining", CoRR, abs/1709.09003, 2017. [More info about CASP-DM]

2016

• Fernando Martínez-Plumed, "Incremental and developmental perspectives for general-purpose learning systems", Ph.D Thesis, Technical University of Valencia, Spain, April 2016. [BibTex | Slides]
• José Hernández-Orallo, Fernando Martínez-Plumed, Ute Schmid, Michael Siebers, David L. Dowe "Computer models solving intelligence test problems: progress and implications", Artificial Intelligence Journal, Elsevier Publications, 230, 74-107, 2016. [BibTex]
• Fernando Martínez-Plumed, Ricardo B. C. Prudêncio, Adolfo Martínez-Uso, José Hernández-Orallo, "Making sense of item response theory in machine learning", 22nd European Conference on Artificial Intelligence (ECAI 2016), The Hague, The Netherlands, pp 1140-1148, 2016. [Best Paper Award] [Paper | BibTex]
• Fernando Martínez-Plumed, José Hernández-Orallo, Ute Schmid, Michael Siebers, D. L. Dowe "Historical account of computer models solving IQ test problems", EGPAI 2016 - Evaluating General-Purpose AI @ ECAI 2016, The Hague, The Netherlands, pp 20-21, 2016.
• Fernando Martínez-Plumed, Cèsar Ferri, and Lidia Contreras-Ochando, "Cycling network projects: a decision-making aid approach", SoGood 2016 @ ECML 2016, Riva del Garda, Italy, pp 96-109, 2016.
• Hana Alouaoui, Lidia Contreras-Ochando, Cèsar Ferri, Peter Flach, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche, Fernando Martínez-Plumed and M. José Ramírez-Quintana, "CASP-DM: Bringing a Context-Aware Standard Process for Data Mining to Data Science", European Data Science Conference (ECDS 2016), Luxembourg, 2016. [More info about CASP-DM]
• Lidia Contreras-Ochando, Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo and M. José Ramírez-Quintana, "General-Purpose Inductive Programming for Data Wrangling Automation", Artificial Intelligence for Data Science (AI4DataSci) @ NIPS 2016. [Poster]
• Lidia Contreras-Ochando, Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo and M. José Ramírez-Quintana, "Logging Data Scientists: Collecting Evidence for Data Science Automation", Artificial Intelligence for Data Science (AI4DataSci) @ NIPS 2016.

2015

• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, “Knowledge acquisition with forgetting: an incremental and developmental setting”, Adaptive Behavior, SAGE Publications, vol. 23 no. 5, pp 283-299, 2015. [BibTex]

• Fernando Martínez-Plumed, “Knowledge Acquisition & Forgetting in Rule-based systems”, Approaches and Applications of Inductive Programming (AAIP’15), Dagstuhl Seminar 15442, Germany, 2015. [BibTex, Slides]

• Adolfo Martínez-Us&oacute, José Hernández-Orallo, M.José Ramírez-Quintana, and Fernando Martínez-Plumed, “Pentaho + R: An integral view for multidimensional prediction models”, Advances in Artificial Intelligence: Proceedings of the 16th Conference of the Spanish Association for Artificial Intelligence (CAEPIA 2015), Albacete, Spain, November 9–12, 2015, Lecture Notes in Artificial Intelligence (LNAI), Volume 9422, pp 234-244. [BibTex]

• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, “Forgetting and consolidation for incremental and cumulative knowledge acquisition systems”, CoRR, abs/1502.05615, 2015. [BibTex]

2014

• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Knowledge acquisition with forgetting: an incremental and developmental setting", In IEEE 13th International Conference on Machine Learning and Applications (ICMLA'14), Detroit, USA on December 3-6, 2014 pp. 111-116. [BibTex | Slides]

2013

• Fernando Martínez-Plumed, "gErl: an Inductive Programming System with user-defined operators", Approaches and Applications of Inductive Programming (AAIP'13), Dagstuhl Seminar 13502, Germany, 2013. [BibTex | Slides]
• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Policy Reuse in a General Learning Framework", 15th Conference of the Spanish Association for Artificial Intelligence, CAEPIA'13 (CEDI 2013) , Madrid, Spain, September 2013, ISBN 978-84-695-8348-7, pp 183-190, 2013. [BibTex | Slides]
• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Incremental learning with state features in gErl", In Alicia Troncoso, Jose C. Riquelme (eds) VII Symposium on Theory and Applications of Data Mining, TAMIDA 2013 (CEDI 2013), Madrid, Spain, September 2013, ISBN 978-84-695-8348-7, pp 1383-1392, 2013. [BibTex | Slides]
• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "On the definition of a general learning system with user-defined operators", CoRR, abs/1311.4235, 2013. [BibTex]

2012

• Fernando Martínez-Plumed, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, Learning with configurable operators and rl-based heuristics, First International Workshop, NFMCP 2012, Held in Conjunction with ECML/PKDD 2012, Bristol, UK, September 24, 2012. Revised Selected Papers, volume 7765 of Lecture Notes in Computer Science (LNCS), pp 1-16. Springer-Verlag, 2012. [BibTex | Slides]

2011

• Fernando Martínez-Plumed, Vicent Estruch, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, Newton Trees, In Jiuyong Li (eds) 23rd Australasian Joint Conference on Artificial Intelligence (AI), Adelaide, South Australia, December 2010, LNCS series, Springer, vol 6464, pp 174-183, 2011 [BibTex | Slides]

2010

• Fernando Martínez-Plumed, Vicent Estruch, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Árboles de estimación estocástica de probabilidades: Newton Trees", Master Thesis, Technical University of Valencia, September 2010. [Slides]
• Fernando Martínez-Plumed, Vicent Estruch, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Valores Faltantes en Newton Trees", In Alicia Troncoso, Jose C. Riquelme (eds) V Symposium on Theory and Applications of Data Mining, TAMIDA 2010 (CEDI 2010) Valencia, Spain, September 2010, ISBN 978-84-92812-60-8, Garceta Grupo Editorial, pp 183-190, 2010 [BibTex | Slides]
• Fernando Martínez-Plumed, Vicent Estruch, Cèsar Ferri, José Hernández-Orallo, M. José Ramírez-Quintana, "Newton Trees: Extended Report", Technical report DSIC-II/09/10, UPV, 2010.