Simulation Environment for User-Robot Voice Interaction in Product Handling and Packaging Systems

Vista sencilla de ítem
dc.creatorGuachetá-Alba, Juan C.
dc.creatorJimenez-Moreno, Robinson
dc.creatorEspitia-Cubillos, Anny Astrid
dc.date2026-04-06
dc.descriptionAdvances in artificial intelligence, robotics, and human-machine interaction have permeated industrial processes, making them smarter, more flexible, and more autonomous. Voice interaction is a natural medium that has become a key factor in improving production systems, applicable to processes such as order picking. In this context, this article aimed to develop an intelligent voice-controlled packaging system that integrates natural language processing, computer vision, and robotic product handling, which was then evaluated in a virtual simulation environment. The methodology consisted of designing a simulated environment, developing and integrating voice recognition and synthesis algorithms into an automated workflow that allows the selection and manipulation of finished products to prepare orders. The system was implemented using a robotic platform, a conveyor belt, and a finished goods storage area. An interface was created to facilitate control of the packaging process through a chatbot capable of understanding voice commands and responding to the user utilizing voice recognition and synthesis algorithms. The system's accuracy and robustness were evaluated using 20 commands, analyzed with recordings generated for 13 user profiles with different accents, ages, and vocal characteristics. The results showed an average accuracy of 85.7% in command transcription, with robust performance against voice variations, although the lowest accuracy was observed when using children's voices. Additionally, the packaging and sorting system was validated in the virtual environment, demonstrating its efficient operation in managing box space and available shelf inventory. Thanks to the results obtained, it is possible to conclude that the designed system allows for almost natural and flexible interaction through voice commands, effectively integrating language recognition and robotic manipulation in a simulated environment, which demonstrates its potential application in supply chain automation and Industry 5.0.en-US
dc.descriptionEl avance en inteligencia artificial, robótica e interacción hombre-máquina ha permeado los procesos industriales para que sean más inteligentes, flexibles y autónomos. La interacción por voz es un medio natural que se constituye como un factor clave para mejorar los sistemas productivos, que puede aplicarse a procesos como el alistamiento de pedidos. En ese contexto, el presente artículo tuvo como objetivo desarrollar un sistema inteligente de empaquetado controlado por voz que integra herramientas de procesamiento de lenguaje natural, visión por computador y manipulación robótica de productos, el cual fue evaluado en un entorno virtual de simulación. La metodología consistió en diseñar un entorno simulado, desarrollar e integrar los algoritmos de reconocimiento y síntesis de voz en un flujo de trabajo automatizado, que permite seleccionar y manipular los productos terminados para preparar los pedidos. Para ello, se implementó el sistema con una plataforma robótica, una banda transportadora y el área de almacenamiento de productos terminados y se creó una interfaz que facilita el control del proceso de empaquetado, mediante un chatbot capaz de entender comandos de voz y responder al usuario gracias a algoritmos de reconocimiento y síntesis de voz. Se evaluó la precisión y robustez del sistema usando 20 comandos, analizados con grabaciones generadas para 13 perfiles de usuarios con distintos acentos, edades y características vocales. Los resultados mostraron una precisión promedio del 85.7 % en la transcripción de comandos, con un desempeño robusto frente a variaciones de voz, pese a presentar la menor precisión cuando se usan voces de niños. Adicionalmente, se validó en el entorno virtual que el sistema de empaquetado y clasificación funciona eficazmente, gestionando el espacio de las cajas y el inventario disponible en el estante. Gracias a los resultados obtenidos, es posible concluir que el sistema diseñado permite la interacción casi natural y flexible mediante comandos de voz, integrando de forma efectiva el reconocimiento de lenguaje y la manipulación robótica en un entorno simulado, lo que evidencia su potencial de aplicación en la automatización de cadenas de suministro y la industria 5.0.es-ES
dc.formatapplication/pdf
dc.formattext/xml
dc.formatapplication/zip
dc.identifierhttps://revistas.itm.edu.co/index.php/tecnologicas/article/view/3601
dc.identifier10.22430/22565337.3601
dc.languageeng
dc.publisherInstituto Tecnológico Metropolitano (ITM)en-US
dc.relationhttps://revistas.itm.edu.co/index.php/tecnologicas/article/view/3601/4015
dc.relationhttps://revistas.itm.edu.co/index.php/tecnologicas/article/view/3601/4129
dc.relationhttps://revistas.itm.edu.co/index.php/tecnologicas/article/view/3601/4130
dc.relation/*ref*/X.-X. Liu, C.-Y. Yin, and M.-R. Li, "The power of voice! The impact of robot receptionists’ voice pitch and communication style on customer value cocreation intention," Int. J. Hosp. Manag., vol. 122, no. 12, p. 103819, Sep. 2024. https://doi.org/10.1016/j.ijhm.2024.103819
dc.relation/*ref*/C. Liu, L. Zhang, S. L. Xin Liu, and T. Zhu, "Speaking versus touching: How consumers respond to robot communication modality in hospitality services," Int. J. Hosp. Manag. vol. 126, p. 104017, Apr. 2025. https://doi.org/10.1016/j.ijhm.2024.104017
dc.relation/*ref*/S. Feng, N. Yamato, H. Ishiguro, M. Shiomi, and H. Sumioka, "Baby schema in human-robot physical interaction: Influence of baby likeness in a communication robot on caregiving behavior," Comput. Human Behav., vol. 4, p. 100150, May. 2025. https://doi.org/10.1016/j.chbah.2025.100150
dc.relation/*ref*/M. Li, F. Guo, X. Wang, J. Chen, and J. Ham, "Effects of robot gaze and voice human-likeness on users’ subjective perception, visual attention, and cerebral activity in voice conversations," Comput. Human Behav., vol. 141, p. 107645, Apr. 2023. https://doi.org/10.1016/j.chb.2022.107645
dc.relation/*ref*/H. Ka, "Voice-Controlled Vision-based Semi-Autonomous Assistive Robotic Manipulation Assistance," Arch. Phys. Med. Rehab., vol. 96, no. 10, pp. e10-e11, Oct. 2015. https://doi.org/10.1016/j.apmr.2015.08.028
dc.relation/*ref*/M. T. Tariq, Y. Hussain, and C. Wang, "Robust mobile robot path planning via LLM-based dynamic waypoint generation," Expert Syst. Appl. vol. 282, p. 127600, Jul. 2025. https://doi.org/10.1016/j.eswa.2025.127600
dc.relation/*ref*/M. Bakouri, "Development of Voice Control Algorithm for Robotic Wheelchair Using MIN and LSTM Models," Comput. Mat. Contin., vol. 73, no. 2, pp. 2441-2456, Jun. 2022. https://doi.org/10.32604/cmc.2022.025106
dc.relation/*ref*/M. Meghana et al., "Hand gesture recognition and voice controlled robot," Mater. Today Proc., vol. 33, no. 7, pp. 4121-4123, Jun. 2020. https://doi.org/10.1016/j.matpr.2020.06.553
dc.relation/*ref*/M. H. Haider et al., "Robust mobile robot navigation in cluttered environments based on hybrid adaptive neuro-fuzzy inference and sensor fusion," J. King Saud Univ. Comput. Inf. Sci., vol. 34, no. 10, Part B, pp. 9060-9070, Nov. 2022. https://doi.org/10.1016/j.jksuci.2022.08.031
dc.relation/*ref*/S. Jamshidi, A. Nikanjam, K. W. Nafi, F. Khomh, and R. Rasta, "Application of deep reinforcement learning for intrusion detection in Internet of Things: A systematic review," Internet of Things, vol. 31, no. 8, p. 101531, May. 2025. https://doi.org/10.1016/j.iot.2025.101531
dc.relation/*ref*/B. Bogaerts, S. Sels, S. Vanlanduit, and R. Penne, "Connecting the CoppeliaSim robotics simulator to virtual reality," SoftwareX, vol. 11, p. 100426, Jan. 2020. https://doi.org/10.1016/j.softx.2020.100426
dc.relation/*ref*/A. Farley, J. Wang, and J. A. Marshall, "How to pick a mobile robot simulator: A quantitative comparison of CoppeliaSim, Gazebo, MORSE and Webots with a focus on accuracy of motion," Simul. Model. Pract. Theor., vol. 120, p. 102629, Nov. 2022. https://doi.org/10.1016/j.simpat.2022.102629
dc.relation/*ref*/R. Rajendran, and J. Arockia Dhanraj, "Measurement of payload under variable adhesive force through coppeliasim and validating the design of a wall climbing robot," Measur. Sensors, vol. 29, p. 100872, Oct. 2023. https://doi.org/10.1016/j.measen.2023.100872
dc.relation/*ref*/R. Duarte Lamperti, and L. V. Ramos de Arruda, "A strategy based on Wave Swarm for the formation task inspired by the Traveling Salesman Problem," Eng. Appl. Artif. Intell., vol. 126, no. Part B, p. 106884, Nov. 2023. https://doi.org/10.1016/j.engappai.2023.106884
dc.relation/*ref*/M. Rinaldi, V. Di Pasquale, P. Farina, R. Iannone, R. Macchiaroli, and E. H. Grosse, "Human–robot interaction in industry: a tertiary study," Procedia Comput. Sci., vol. 253, no. 22, pp. 1691-1701, 2025. https://doi.org/10.1016/j.procs.2025.01.231
dc.relation/*ref*/J. Liu, H. Luo, and D. Wu, "Human–Robot collaboration in construction: Robot design, perception and Interaction, and task allocation and execution," Adv. Engin. Inform., vol. 65, no. Part A, p. 103109, May. 2025. https://doi.org/10.1016/j.aei.2025.103109
dc.relation/*ref*/S. Guan, J. Wang, X. Wang, C. Ding, H. Liang, and Q. Wei, "Dynamic gesture recognition during human–robot interaction in autonomous earthmoving machinery used for construction," Adv. Engin. Inform., vol. 65, no. Part C, p. 103315, May. 2025. https://doi.org/10.1016/j.aei.2025.103315
dc.relation/*ref*/W. T. Lima Junior, R. A. Welter, W. Pacheco Ferreira, R. Ferreira Souza, and T. Eduardo, "Human robot interaction (HRI): An artificial cognitive autonomy approach to enhance Decision-Making," Cogn. Syst. Res., vol. 91, p. 101336, Jun. 2025. https://doi.org/10.1016/j.cogsys.2025.101336
dc.relation/*ref*/B. Feng, Z. Wang, L. Yuan, Q. Zhou, Y. Chen, and Y. Bi, "Towards safe motion planning for industrial human-robot interaction: A co-evolution approach based on human digital twin and mixed reality," Robot. Comput-Int. Manuf., vol. 95, p. 103012, Oct. 2025. https://doi.org/10.1016/j.rcim.2025.103012
dc.relation/*ref*/D. Udekwe, and H. Seyyedhasani, "Virtual Reality-Enabled remote Human-Robot interaction for strawberry cultivation in greenhouses," Comput. Electron. Agric., vol. 237, no. Part A, p. 110567, Oct. 2025. https://doi.org/10.1016/j.compag.2025.110567
dc.relation/*ref*/A. Apraiz et al., "The user experience in industrial human-robot interaction: A comparative analysis of Unimodal and Multimodal interfaces for disassembly tasks," Robot. Comput.-Int. Manuf., vol. 95, p. 103045, Oct. 2025. https://doi.org/10.1016/j.rcim.2025.103045
dc.relation/*ref*/A. Bonello, E. Francalanza, C. A. Brown, and P. Refalo, "Cognitive Design of Collaborative Human-Robot workstations in Industry 5.0: A Kansei Engineering approach to quantifying emotions in problem decomposition," Procedia Comput. Sci., vol. 253, pp. 2811-2820, Jan. 2025. https://doi.org/10.1016/j.procs.2025.02.005
dc.relation/*ref*/P. Novák, J. Vyskočil, J. Kubalík, P. Kadera, M. Jílek, and V. Jirkovský, "Smart Counting Machines for Modular Industry 4.0 Packing Lines," IFAC-PapersOnLine, vol. 56, no. 2, pp. 2976-2981, 2023. https://doi.org/10.1016/j.ifacol.2023.10.1422
dc.relation/*ref*/C. Liu, J. Lyu, and K. Fang, "Integrated packing and routing: A model and its solutions," Comput. Oper. Res., vol. 172, p. 106790, Dec. 2024. https://doi.org/10.1016/j.cor.2024.106790
dc.relation/*ref*/X. Liu et al., "Design, integration, and evaluation of a low-cost system for automatic apple picking and infield sorting," Comput. Electron. Agric., vol. 239, no. Part A, pp. 110933, Dec. 2025. https://doi.org/10.1016/j.compag.2025.110933
dc.relation/*ref*/Y. Zhang, L. Chen, X. Li, Q. Li, and J. Li, "Multi-arm robotic system and strategy for the automatic packaging of apples," Artif. Intell. Agric., vol. 16, no. 1, pp. 578-591, Mar. 2026. https://doi.org/10.1016/j.aiia.2025.11.006
dc.relation/*ref*/A. Baevski, H. Zhou, A. Mohamed, and M. Auli, "wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations," Adv. Neural Inf. Proces. Syst., vol. 33, pp. 12449-12460, Oct. 2020. https://doi.org/10.48550/arXiv.2006.11477
dc.relation/*ref*/Y. Shi et al., "Emformer: Efficient Memory Transformer for Streaming Speech Recognition," in IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, Toronto, ON, Canada, 2021, p. 6783-6787. https://doi.org/10.1109/ICASSP39728.2021.9414560
dc.relation/*ref*/P. Taylor, Text-to-Speech Synthesis, Cambridge, U.K.: Cambridge University Press, 2012. https://books.google.com.co/books/about/Text_to_Speech_Synthesis.html?id=T0O-NHZx7kIC&redir_esc=y#:~:text=Text%2Dto%2DSpeech%20Synthesis%20provides,assumes%20no%20specialised%20prior%20knowledge
dc.relation/*ref*/P. G. Shivakumar, and P. Georgiou, “Transfer learning from adult to children for speech recognition: Evaluation, analysis and recommendations,” Computer speech & language, vol. 63, p. 101077, Sep. 2020. https://doi.org/10.1016/j.csl.2020.101077
dc.relation/*ref*/M. Malik, M. Malik, K. Mehmood, and I. Makhdoom, “Automatic speech recognition: a survey,” Multimedia Tools and Applications, vol. 80, no. 6, p. 9411–9457, Mar. 2021. https://doi.org/10.1007/s11042-020-10073-7
dc.relation/*ref*/R. Jiménez-Moreno, and R. A. Castillo. “Deep learning speech recognition for residential assistant robot,” IAES Int. J. Artif. Intell., vol. 12, no. 2, pp. 585-592, Jun. 2023. https://doi.org/10.11591/ijai.v12.i2.pp585-592
dc.relation/*ref*/
dc.rightsCopyright (c) 2026 TecnoLógicasen-US
dc.rightshttps://creativecommons.org/licenses/by-nc-sa/4.0en-US
dc.sourceTecnoLógicas; Vol. 29 No. 65 (2026); e3601en-US
dc.sourceTecnoLógicas; Vol. 29 Núm. 65 (2026); e3601es-ES
dc.source2256-5337
dc.source0123-7799
dc.subjectinteligencia artificiales-ES
dc.subjectsimulación computacionales-ES
dc.subjectvisión por computadores-ES
dc.subjectindustria 5.0es-ES
dc.subjectprocesamiento de lenguaje naturales-ES
dc.subjectartificial intelligenceen-US
dc.subjectcomputer simulationen-US
dc.subjectcomputer visionen-US
dc.subjectindustry 5.0en-US
dc.subjectnatural language processingen-US
dc.titleSimulation Environment for User-Robot Voice Interaction in Product Handling and Packaging Systemsen-US
dc.titleEntorno de simulación para interacción por voz usuario-robot en sistemas de manipulación y empaquetado de productoses-ES
dc.typeinfo:eu-repo/semantics/article
dc.typeinfo:eu-repo/semantics/publishedVersion
dc.typeResearch Papersen-US
dc.typeArtículos de investigaciónes-ES

Archivos

Bloque original

Mostrando 1 - 1 de 1
Miniatura
Nombre:
3601_v29n66.pdf
Tamaño:
1.02 MB
Formato:
Adobe Portable Document Format
Descargar

Colecciones

Revista TecnoLógicas - Cosecha Portal de Revistas