Attention Mechanisms in Process Mining: A Systematic Literature Review

Gonzalo Rivera-Lazo, Hernan Astudillo, Ricardo Nanculef

Producción científica: Contribución a los tipos de informe/libroContribución a la conferenciarevisión exhaustiva


Process Mining (PM) focuses on monitoring and optimizing long-running business processes by examining their execution event logs (usually complex and heterogeneous) to obtain insights and enable data-driven decisions. Several Machine Learning (ML) techniques have been recently proposed to exploit these logs as learning datasets and enable examination of past events and predict future ones, but their black-box nature makes hard for human analysts to interpret their results and recognize the key parts of input data. Attention mechanisms (AM) is an ML technique that does address these shortcomings, but it has been little used for PM. This article describes the design, results and findings of a systematic literature review of attention mechanisms for PM. We addressed three research questions: (a) for which applications are AM used? (b) which kinds of AM are used? and (c) how are AM combined with other ML techniques? An initial search yield 73 papers, and inclusion/exclusion criteria left sixteen, published between 2017 and 2023. Key finding are that: (1) the most common application is sequence prediction, (2) most studies combine global and item-wise attention, added as layers after an encoder generates the continuous representation, and (3) emerging research topics include anomaly detection and data representation. This study shows that attention mechanisms can help process analysts to get some sense of interpretability, and showcases the bright potential for process mining of attention mechanisms, which paradoxically have received little attention themselves.

Idioma originalInglés
Título de la publicación alojadaProceedings - 2023 49th Latin American Computing Conference, CLEI 2023
EditorialInstitute of Electrical and Electronics Engineers Inc.
ISBN (versión digital)9798350318876
EstadoPublicada - 2023
Evento49th Latin American Computing Conference, CLEI 2023 - La Paz, Estado Plurinacional de Bolivia
Duración: 16 oct. 202320 oct. 2023

Serie de la publicación

NombreProceedings - 2023 49th Latin American Computing Conference, CLEI 2023


Conferencia49th Latin American Computing Conference, CLEI 2023
País/TerritorioEstado Plurinacional de Bolivia
CiudadLa Paz

Áreas temáticas de ASJC Scopus

  • Inteligencia artificial
  • Redes de ordenadores y comunicaciones
  • Informática aplicada
  • Matemática computacional
  • Radiología, medicina nuclear y obtención de imágenes


Profundice en los temas de investigación de 'Attention Mechanisms in Process Mining: A Systematic Literature Review'. En conjunto forman una huella única.

Citar esto