Using SME to build a method for usability and accessibility evaluation in small software development companies. Status: peer-review process

Main Article Content

Carlos Casas
Vanessa Agredo Delgado
Pablo Ruiz Melenje


Usability guarantees that a software application is effective, efficient, and satisfactory; meanwhile, accessibility ensures that the developed software can be used by all types of people regardless of their qualities and/or abilities. These two characteristics are key to providing quality software products. However, small software development companies do not have the personnel, knowledge, tools, and time necessary to carry out the evaluation process of these characteristics, resulting in the omission of these evaluations in the software development processes. The purpose of building a lightweight method is that within the software development process of small companies, it is possible to execute in a guided, simple, and correct way the usability and accessibility evaluations. For the construction of this method, the Situational Method Engineering-SME was used, resulting in the structure of the method, which consists of 5 activities with their respective tasks and formats, being subjected to expert evaluation validating its ease of use, usefulness, and completeness, obtaining as a result that it is a method moderately easy to use, useful, and complete, with elements of its structure that should be improved. Additionally, its ease of use and completeness were validated in a case study, obtaining an optimal response in the process.


Download data is not yet available.

Article Details

How to Cite
Casas, C., Agredo Delgado, V., & Ruiz Melenje, P. . (2024). Using SME to build a method for usability and accessibility evaluation in small software development companies.: Status: peer-review process. I+ T+ C- Research, Technology and Science - Unicomfacauca, 1(18). Retrieved from


Sandra M. Hurtado, Jessica Pimentel, y Gabriel E. Chanchí, “Estudio comparativo de métodos de evaluación de usabilidad para sitios web”, DIALNET, pp. 126–136, 2018.

Andrés Paniagua L, Diana Bedoya R, y Carlos Mera, “Un método para la evaluación de la accesibilidad y la usabilidad en aplicaciones móviles”, TecnoLógicas, vol. 23, pp. 99–117, 2020.

Víctor Chimarro C, Bertha Mazón O, y Joffre Cartuche C, “La usabilidad en el desarrollo del software”, Utmach, 2015.

U. Nacional, A. De, M. México, A. Hintelholher, y R. Marissa, “Estudios Políticos”, 2011, [En línea]. Disponible en:

A. De Lima Salgado, F. M. Federici, R. P. De Mattos Fortes, y V. G. Motti, “Startupworkplace, mobilegames,andolderadults:A practical guide on UX, usability, and accessibility evaluation”, en SIGDOC 2019 - Proceedings of the 37th ACM International Conference on the Design of Communication, Association for Computing Machinery, Inc, oct. 2019. doi: 10.1145/3328020.3353948.

A. Nemeth y A. Bekmukhambetova, “Achieving Usability: Looking for Connections between User-Centred Design Practices and Resultant Usability Metrics in Agile Software Development”, Periodica Polytechnica Social and Management Sciences, dic. 2022, doi: 10.3311/ppso.20512.

Esmeralda Serrano Mascaraque, “Accesibilidad vs usabilidad web: evaluación y correlación”, BIBLIOTECOLÓGICA, vol. 23, núm. 0187-358X, pp. 61–103, 2009.

D. A. Mateus, C. A. Silva, M. M. Eler, y A. P. Freire, “Accessibility of mobile applications: Evaluation by users with visual impairment and by automated tools”, en IHC 2020 - Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, Association for Computing Machinery, Inc, oct. 2020. doi: 10.1145/3424953.3426633.

P. Angeleri, A. Blanco, J. Ceballos, y R. 2019 Titiosky, “Línea de investigación en evaluación de productos software: dificultades encontradas”. Red de Universidades con Carreras en Informática, 2019.

D. M. B. Paiva, A. P. Freire, y R. P. de Mattos Fortes, “Accessibility and Software Engineering Processes: A Systematic Literature Review”, Journal of Systems and Software, vol. 171, ene. 2021, doi: 10.1016/j.jss.2020.110819.

H. W. Alomari, V. Ramasamy, J. D. Kiper, y G. Potvin, “A User Interface (UI) and User eXperience (UX) evaluation framework for cyberlearning environments in computer science and software engineering education”, Heliyon, vol. 6, núm. 5, may 2020, doi: 10.1016/j.heliyon.2020.e03917.

M. Ahmad, S. Kanwal, M. A. Habib, y C. N. Faisal, “Usability and Accessibility Based Quality Evaluation of Apparel Websites in Pakistan”, en Proceedings - 2020 23rd IEEE International Multi-Topic Conference, INMIC 2020, Institute of Electrical and Electronics Engineers Inc., nov. 2020. doi: 10.1109/INMIC50486.2020.9318163.

G. Delgado-Quesada, J. Porras-Fernandez, K. Araya-Orozco, y M. Chacon-Rivas, “Good Practices in Usability Testing on People with Disabilities”, en Proceedings - 2019 International Conference on Inclusive Technologies and Education, CONTIE 2019, Institute of Electrical and Electronics Engineers Inc., oct. 2019, pp. 187–190. doi: 10.1109/CONTIE49246.2019.00043.

A. Bin Deraman y A. Salman, “Usability evaluation practices within agile development: engaging with usability agile practitioners’ concerns”, J Theor Appl Inf Technol, vol. 15, núm. 21, 2022, [En línea]. Disponible en:

C. Quintal y J. A. Macías, “Measuring and improving the quality of development processes based on usability and accessibility”, Univers Access Inf Soc, vol. 20, núm. 2, pp. 203–221, jun. 2021, doi: 10.1007/s10209-020-00726-7.

B. Henderson Sellers, J. Ralyté, P. J. Ågerfalk, y M. Rossi, Situational Method Engineering. 2014. doi: 10.1007/978-3-642-41467-1.

M. Kapyaho y M. Kauppinen, Agile Requirements Engineering with Prototyping: A Case Study. 2015.

H. Hayat y R. Cerradura, “Usability Evaluation in Practice: Selecting the Appropriate Method”, en : ICHCIUEM 2020?: International Conference on Human-Computer Interaction and Usability Evaluation Methods, 2020.

T. Alahmadi, “A multi-method evaluation of university website accessibility: Foregrounding user-centred design, mining source code and using a quantitative metric”, en Proceedings of the 14th Web for All Conference, W4A 2017, Association for Computing Machinery, Inc, abr. 2017. doi: 10.1145/3058555.3058580.

L. A. Do Amaral, R. P. De Mattos Fortes, y T. J. Bittar, “A4U - An approach to evaluation considering accessibility and usability guidelines”, en WebMedia 2018 - Proceedings of the 24th Brazilian Symposium on Multimedia and the Web, Association for Computing Machinery, Inc, oct. 2018, pp. 295–298. doi: 10.1145/3243082.3264666.

“Ingenieria de métodos situacionales”, pp. 36–85.

T. Zaki, M. N. Islam, y T. Zaki, “Neurological and physiological measures to evaluate the usability and user-experience (UX) of information systems: A systematic literature review”, Computer Science Review, vol. 40. Elsevier Ireland Ltd, el 1 de mayo de 2021. doi: 10.1016/j.cosrev.2021.100375.

T. X. De Godoi, L. S. Garcia, y N. M. C. Valentim, “Evaluating a usability, user experience and accessibility checklist for assistive technologies for deaf people in a context of mobile applications”, en IHC 2020 - Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, Association for Computing Machinery, Inc, oct. 2020. doi: 10.1145/3424953.3426631.

F. Paz, Pow-Sang, y José Antonio, “A systematic mapping review of usability evaluation methods for software development process”, International Journal of Software Engineering and its Applications, vol. 10, núm. 1, pp. 165–178, 2016, doi: 10.14257/ijseia.2016.10.1.16.

A. I. Khan, Z. Al-Khanjari, y M. Sarrab, “Crowd sourced evaluation process for mobile learning application quality”, en Proceedings - 2017 2nd International Conference on Information Systems Engineering, ICISE 2017, Institute of Electrical and Electronics Engineers Inc., dic. 2017, pp. 1–5. doi: 10.1109/ICISE.2017.17.

R. Sobrino-Duque, N. Martínez-Rojo, J. M. Carrillo-de-Gea, J. J. López-Jiménez, J. Nicolás, y J. L. Fernández-Alemán, “Evaluating a gamification proposal for learning usability heuristics: Heureka”, International Journal of Human Computer Studies, vol. 161, may 2022, doi: 10.1016/j.ijhcs.2022.102774.

E. Fundingsland et al., “Website usability analysis of United States emergency medicine residencies”, AEM Educ Train, vol. 5, núm. 3, jul. 2021, doi: 10.1002/aet2.10604.

Fabián. Coelho, “SIGNIFICADOS”. Consultado: el 10 de diciembre de 2023. [En línea]. Disponible en:

S. Song et al., “Crowdsourcing-based web accessibility evaluation with golden maximum likelihood inference”, Proc ACM Hum Comput Interact, vol. 2, núm. CSCW, nov. 2018, doi: 10.1145/3274432.

B. Kitchenham y P. Brereton, “A systematic review of systematic review process research in software engineering”, Information and Software Technology, vol. 55, núm. 12. Elsevier B.V., pp. 2049–2075, 2013. doi: 10.1016/j.infsof.2013.07.010.

L. Codina, “Revisiones bibliográficas sistematizadas Procedimientos generales y Framework para Ciencias Humanas y Sociales”, Master Universitario en Comunicación Social, 2018, Consultado: el 8 de julio de 2023. [En línea]. Disponible en:

E. G. Maida y J. Pacienzia, “Metodologías de desarrollo de software”, Pontificia Universidad Católica Argentina (UCA), 2015. Consultado: el 11 de julio de 2023. [En línea]. Disponible en: chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/

J. César y S. González, “Métodos de Evaluación de Usabilidad para Sistemas de Información Web: Una revisión”, 2018.

J. Carlos et al., “Accesibilidad y usabilidad web para la inclusion de personas con discapacidad Accessibility and usability web for the inclusion of people with disabilities”. [En línea]. Disponible en:

T. Alahmadi y S. Drew, “Subjective evaluation of website accessibility and usability: A survey for people with sensory disabilities”, en Proceedings of the 14th Web for All Conference, W4A 2017, Association for Computing Machinery, Inc, abr. 2017. doi: 10.1145/3058555.3058579.

M. A. Mascheroni, C. L. Greiner, G. N. Dapozo, y M. G. Estayno, “Ingeniería de Usabilidad. Una Propuesta Tecnológica para Contribuir a la Evaluación de la Usabilidad del Software”, 2013.

L. L. Constantine y L. A. D. Lockwood, “Usage-centered engineering for Web applications”, IEEE Distributed Systems Online, vol. 3, núm. 3, 2002, doi: 10.1109/52.991331.

M. Kraeling y L. Tania, “Software Development Process”, en Software Engineering for Embedded Systems, Elsevier, 2019, pp. 33–87. doi: 10.1016/B978-0-12-809448-8.00002-3.

K. Toshihiro, F. Shin’ichi, A. Motoei, W. Hironori, y T. Naohiko, “Usability of Software–Intensive Systems from Developers’ Point of View”, en Human-Computer Interaction. Design and User Experience, M. Kurosu, Ed., Cham: Springer International Publishing, 2020, pp. 450–463.

J. Delgado, N. Medina, M. Becerra, J. R. Delgado Fernández, N. M. Medina Cepeda, y M. X. Becerra de Romero, “La evaluación por pares. Una alternativa de evaluación entre estudiantes universitarios”, [En línea]. Disponible en:

R. E. Stake, Investigacio?n con estudio de casos.