Automatic assessment of creativity in heuristic problem-solving based on query diversity

Cristian Olivares-Rodríguez, Mariluz Guenaga, Pablo Garaizar

Resultado de la investigación: Article

Resumen

Research, development and innovation are the pillars on which companies rely to offer new products and services capable of attracting consumer demand. This is why creative problem-solving emerges as one of the most relevant skills of the 21st century. Fortunately, there are many creativity training programs that have proven effective. However, many of these programs and methods base on a previous measurement of creativity and require experienced reviewers, they consume time for being manual, and they are far from everyday activities. In this study, we propose a model to estimate the creative quality of users' solutions dealing with heuristic problems, based on the automatic analysis of query patterns issued during the information search to solve the problem. This model has been able to predict the creative quality of solutions produced by 226 users, reaching a sensitivity of 78.43%. Likewise, the level of agreement among reviewers in relation to the creative characteristics is evaluated through two rubrics, and thereby, observing the difficulties of the manual evaluation: subjectivity and effort. The proposed model could be used to foster prompt detection of non-creative solutions and it could be implemented in diverse industrial processes that can range from the recruitment of talent to the evaluation of performance in R&D&I processes.

Idioma originalEnglish
Páginas (desde-hasta)449-455
Número de páginas7
PublicaciónDyna (Spain)
Volumen92
N.º4
DOI
EstadoPublished - 1 jul 2017
Publicado de forma externa

Huella dactilar

Innovation
Industry

ASJC Scopus subject areas

  • Engineering(all)

Citar esto

Olivares-Rodríguez, Cristian ; Guenaga, Mariluz ; Garaizar, Pablo. / Automatic assessment of creativity in heuristic problem-solving based on query diversity. En: Dyna (Spain). 2017 ; Vol. 92, N.º 4. pp. 449-455.
@article{425428eeb8ef4ae789b7e826c52ee3e4,
title = "Automatic assessment of creativity in heuristic problem-solving based on query diversity",
abstract = "Research, development and innovation are the pillars on which companies rely to offer new products and services capable of attracting consumer demand. This is why creative problem-solving emerges as one of the most relevant skills of the 21st century. Fortunately, there are many creativity training programs that have proven effective. However, many of these programs and methods base on a previous measurement of creativity and require experienced reviewers, they consume time for being manual, and they are far from everyday activities. In this study, we propose a model to estimate the creative quality of users' solutions dealing with heuristic problems, based on the automatic analysis of query patterns issued during the information search to solve the problem. This model has been able to predict the creative quality of solutions produced by 226 users, reaching a sensitivity of 78.43{\%}. Likewise, the level of agreement among reviewers in relation to the creative characteristics is evaluated through two rubrics, and thereby, observing the difficulties of the manual evaluation: subjectivity and effort. The proposed model could be used to foster prompt detection of non-creative solutions and it could be implemented in diverse industrial processes that can range from the recruitment of talent to the evaluation of performance in R&D&I processes.",
keywords = "Complex problem solving, Information search, Innovation, Machine learning, Query pattern",
author = "Cristian Olivares-Rodr{\'i}guez and Mariluz Guenaga and Pablo Garaizar",
year = "2017",
month = "7",
day = "1",
doi = "10.6036/8243",
language = "English",
volume = "92",
pages = "449--455",
journal = "Dyna (Spain)",
issn = "0012-7361",
publisher = "Federacion de Asociaciones de Ingenieros Industriales de Espana",
number = "4",

}

Olivares-Rodríguez, C, Guenaga, M & Garaizar, P 2017, 'Automatic assessment of creativity in heuristic problem-solving based on query diversity', Dyna (Spain), vol. 92, n.º 4, pp. 449-455. https://doi.org/10.6036/8243

Automatic assessment of creativity in heuristic problem-solving based on query diversity. / Olivares-Rodríguez, Cristian; Guenaga, Mariluz; Garaizar, Pablo.

En: Dyna (Spain), Vol. 92, N.º 4, 01.07.2017, p. 449-455.

Resultado de la investigación: Article

TY - JOUR

T1 - Automatic assessment of creativity in heuristic problem-solving based on query diversity

AU - Olivares-Rodríguez, Cristian

AU - Guenaga, Mariluz

AU - Garaizar, Pablo

PY - 2017/7/1

Y1 - 2017/7/1

N2 - Research, development and innovation are the pillars on which companies rely to offer new products and services capable of attracting consumer demand. This is why creative problem-solving emerges as one of the most relevant skills of the 21st century. Fortunately, there are many creativity training programs that have proven effective. However, many of these programs and methods base on a previous measurement of creativity and require experienced reviewers, they consume time for being manual, and they are far from everyday activities. In this study, we propose a model to estimate the creative quality of users' solutions dealing with heuristic problems, based on the automatic analysis of query patterns issued during the information search to solve the problem. This model has been able to predict the creative quality of solutions produced by 226 users, reaching a sensitivity of 78.43%. Likewise, the level of agreement among reviewers in relation to the creative characteristics is evaluated through two rubrics, and thereby, observing the difficulties of the manual evaluation: subjectivity and effort. The proposed model could be used to foster prompt detection of non-creative solutions and it could be implemented in diverse industrial processes that can range from the recruitment of talent to the evaluation of performance in R&D&I processes.

AB - Research, development and innovation are the pillars on which companies rely to offer new products and services capable of attracting consumer demand. This is why creative problem-solving emerges as one of the most relevant skills of the 21st century. Fortunately, there are many creativity training programs that have proven effective. However, many of these programs and methods base on a previous measurement of creativity and require experienced reviewers, they consume time for being manual, and they are far from everyday activities. In this study, we propose a model to estimate the creative quality of users' solutions dealing with heuristic problems, based on the automatic analysis of query patterns issued during the information search to solve the problem. This model has been able to predict the creative quality of solutions produced by 226 users, reaching a sensitivity of 78.43%. Likewise, the level of agreement among reviewers in relation to the creative characteristics is evaluated through two rubrics, and thereby, observing the difficulties of the manual evaluation: subjectivity and effort. The proposed model could be used to foster prompt detection of non-creative solutions and it could be implemented in diverse industrial processes that can range from the recruitment of talent to the evaluation of performance in R&D&I processes.

KW - Complex problem solving

KW - Information search

KW - Innovation

KW - Machine learning

KW - Query pattern

UR - http://www.scopus.com/inward/record.url?scp=85021999473&partnerID=8YFLogxK

U2 - 10.6036/8243

DO - 10.6036/8243

M3 - Article

AN - SCOPUS:85021999473

VL - 92

SP - 449

EP - 455

JO - Dyna (Spain)

JF - Dyna (Spain)

SN - 0012-7361

IS - 4

ER -