TY - GEN
T1 - A Study on a Framework for Initial Counseling for Vulnerable Populations in Welfare Blind Spots Based on LLM
AU - Sung, Siyoon
AU - Kim, Jemin
AU - Kim, Junhyuk
AU - Park, Sangeun
AU - Jeong, Junho
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - This study proposes a method to enhance the quality of counseling and automate initial counseling in welfare counseling systems by utilizing Large Language Models (LLMs) to correct errors occurring in the Speech-to-Text (STT) process. The Silver framework consists of an STT correction and evaluation model, a conversation model, and a summary model, aiming to simultaneously improve the flexibility and accuracy of counseling. In this study, the STT correction and evaluation model improved the quality of text correction, while the conversation model enabled natural conversation. Additionally, the summary model effectively organized and verified counseling content. Experimental results demonstrated that the STT correction model achieved 82 % accuracy in evaluation and 74 % accuracy in correction, while the conversation progress and summary models recorded 68 % and 92 % accuracy, respectively. These findings highlight the effective applicability of LLM-based technologies in welfare counseling.
AB - This study proposes a method to enhance the quality of counseling and automate initial counseling in welfare counseling systems by utilizing Large Language Models (LLMs) to correct errors occurring in the Speech-to-Text (STT) process. The Silver framework consists of an STT correction and evaluation model, a conversation model, and a summary model, aiming to simultaneously improve the flexibility and accuracy of counseling. In this study, the STT correction and evaluation model improved the quality of text correction, while the conversation model enabled natural conversation. Additionally, the summary model effectively organized and verified counseling content. Experimental results demonstrated that the STT correction model achieved 82 % accuracy in evaluation and 74 % accuracy in correction, while the conversation progress and summary models recorded 68 % and 92 % accuracy, respectively. These findings highlight the effective applicability of LLM-based technologies in welfare counseling.
KW - conversation summarization
KW - domain-specific chatbot
KW - natural language processing
KW - STT Correction
UR - https://www.scopus.com/pages/publications/105007552799
U2 - 10.1109/KST65016.2025.11003300
DO - 10.1109/KST65016.2025.11003300
M3 - Conference contribution
AN - SCOPUS:105007552799
T3 - 2025 17th International Conference on Knowledge and Smart Technology, KST 2025
SP - 433
EP - 436
BT - 2025 17th International Conference on Knowledge and Smart Technology, KST 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 17th International Conference on Knowledge and Smart Technology, KST 2025
Y2 - 26 February 2025 through 1 March 2025
ER -