TY - GEN
T1 - On-Device Neural Language Model based Word Prediction
AU - Yu, Seunghak
AU - Kulkarni, Nilesh
AU - Lee, Haejun
AU - Kim, Jihie
N1 - Publisher Copyright:
© COLING 2018.All right reserved.
PY - 2018
Y1 - 2018
N2 - Recent developments in deep learning with application to language modeling have led to success in tasks of text processing, summarizing and machine translation. However, deploying huge language models on mobile devices for on-device keyboards poses computation as a bottle-neck due to their puny computation capacities. In this work, we propose an on-device neural language model based word prediction method that optimizes run-time memory and also provides a real-time prediction environment. Our model size is 7.40MB and has average prediction time of 6.47 ms. The proposed model outperforms existing methods for word prediction in terms of keystroke savings and word prediction rate and has been successfully commercialized.
AB - Recent developments in deep learning with application to language modeling have led to success in tasks of text processing, summarizing and machine translation. However, deploying huge language models on mobile devices for on-device keyboards poses computation as a bottle-neck due to their puny computation capacities. In this work, we propose an on-device neural language model based word prediction method that optimizes run-time memory and also provides a real-time prediction environment. Our model size is 7.40MB and has average prediction time of 6.47 ms. The proposed model outperforms existing methods for word prediction in terms of keystroke savings and word prediction rate and has been successfully commercialized.
UR - http://www.scopus.com/inward/record.url?scp=85072019122&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85072019122
T3 - COLING 2018 - 27th International Conference on Computational Linguistics, Proceedings of System Demonstrations
SP - 128
EP - 131
BT - COLING 2018 - 27th International Conference on Computational Linguistics, Proceedings of System Demonstrations
PB - Association for Computational Linguistics (ACL)
T2 - 27th International Conference on Computational Linguistics, COLING 2018
Y2 - 20 August 2018 through 26 August 2018
ER -