Analyzing User Sentiment Toward the Stimuler AI: English Fluency Application Through Google Play Store Reviews

Mufidatul Azmi; Muh. Nurfadel Hamzah; Chairunnisaa M. Z. Huzaen

doi:10.69693/ijmst.v4i2.9033

Authors

Mufidatul Azmi Universitas Negeri Makassar https://orcid.org/0009-0006-0205-8531
Muh. Nurfadel Hamzah Universitas Negeri Makassar
Chairunnisaa M. Z. Huzaen Universitas Negeri Makassar

DOI:

https://doi.org/10.69693/ijmst.v4i2.9033

Keywords:

Sentiment Analysis, IndoBERT, Google Play Store Reviews, AI Learning Application, Stimuler AI

Abstract

This study aims to analyze user sentiment toward the Stimuler AI: English Fluency application based on reviews collected from the Google Play Store using the IndoBERT model. The increasing popularity of AI-based language learning applications has generated numerous user reviews containing opinions, experiences, and complaints. Therefore, sentiment analysis is needed to understand user perceptions and evaluate application quality efficiently. This research employed a quantitative approach using sentiment analysis techniques. User reviews were collected through web scraping using Python and the google-play-scraper library. A total of 3,640 reviews were initially collected, and after language filtering, 1,653 Indonesian-language reviews were selected as the final dataset. The preprocessing stages included case folding, cleaning, stopword removal, and slang normalization. Exploratory data analysis and topic analysis were also conducted to identify dominant sentiment patterns and user concerns. The sentiment classification process utilized the IndoBERT model with three sentiment classes: positive, neutral, and negative. The results showed that positive sentiment dominated the dataset, indicating that most users were satisfied with the application’s learning features and speaking practice capabilities. Meanwhile, the main negative issues included bugs, subscription problems, and voice detection issues. Furthermore, the IndoBERT model achieved an accuracy score of 90.57% and an F1-score of 89.01%, indicating effective performance in classifying Indonesian-language application reviews.

References

Abadi, M., Pratama, Y. B., & Wahyuzi, Z. (2026). Analisis Pengaruh Komentar Tiktok Terhadap Citra Merek dan Popularitas Erigo Serta Uniqlo di Pasar Indonesia Menggunakan Algoritma Indobert. INOMATEC: Jurnal Inovasi …, 01(03), 721–743. https://portalpublikasi.com/index.php/inomatec/article/view/796%0

Adhim, N. F., & Cahyono, N. (2025). Optimization of IndoBERT for Sentiment Analysis of FOMO on Social Media Through Fine-Tuning and Hybrid Labeling. Journal of Applied Informatics & Computing, 9(6), 3786–3797.

Albedah, F. (2025). Artificial Intelligence in Language Education: A Systematic Review of Multilingual Applications, Large Language Models, and Emerging Challenges. Language Teaching Research Quarterly, 49, 247–268. https://doi.org/10.32038/ltrq.2025.49.13

Amrullah, R. F., Mahardika, F., & Junaedi, D. I. (2026). Aspect-Based Sentiment Analysis on Webtoon Reviews Using Ensemble Learning. Journal of Intelligent System and Machine Learning, 1(1), 42–56.

Dermawan, K. J., Sabrina, N. A., Michelle, G. F., & Ayunda, A. T. (2026). Sentiment Analysis of Roblox Genres on TikTok : Roleplay , RPG , and Horror using Naïve Bayes. 5(1), 425–438.

Du, J., & Daniel, B. K. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers and Education: Artificial Intelligence, 6(April), 100230. https://doi.org/10.1016/j.caeai.2024.100230

Giganti, P., Errichiello, G., & Marcello, P. (2025). Exploring public discourse on green hydrogen via YouTube comments : A comparative sentiment analysis using VADER and ChatGPT. Economic Analysis and Policy, 88(April), 2012–2030. https://doi.org/10.1016/j.eap.2025.11.014

Jantakoon, T., Jantakun, T., Jantakun, K., Pongpanich, W., Pasmala, R., Wannapiroon, P., & Nilsook, P. (2025). The effectiveness of artificial intelligence in English instruction for speaking and listening skills: A meta-analysis. Contemporary Educational Technology, 17(4). https://doi.org/10.30935/cedtech/17310

Jati, H., Indrihapsari, Y., Setialana, P., Wijaya, D., & Ardy, S. A. (2026). IndoBERT for educational assessment : comparative analysis of transformer models in Indonesian question generation. IAES International Journal of Artificial Intellegence, 15(2), 1804–1813. https://doi.org/10.11591/ijai.v15.i2.pp1804-1813

Koto, F., Rahimi, A., Lau, J. H., & Baldwin, T. (2020). IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP. COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference, 757–770. https://doi.org/10.18653/v1/2020.coling-main.66

Kustiyahningsih, Y., & Permana, Y. (2024). Penggunaan Latent Dirichlet Allocation (LDA) dan Support-Vector Machine (SVM) Untuk Menganalisis Sentimen Berdasarkan Aspek Dalam Ulasan Aplikasi EdLink. Teknika, 13(1), 127–136. https://doi.org/10.34148/teknika.v13i1.746

Lee, H.-H., & T. N. Nguyen, M. (2023). Topic Modelling and Sentiment Analysis on YouTube Sustainable Fashion Comments. Journal of New Media, 5(1), 65–80. https://doi.org/10.32604/jnm.2023.045792

López-Minotta, K. L., Chiappe, A., & Mella-Norambuena, J. (2025). Implementation of Artificial Intelligence to Improve English Oral Expression. Multidisciplinary Journal of Educational Research, 15(1), 43–71. https://doi.org/10.17583/remie.16188

Marliana, R., Sakinah, N., Selvi, & Rahmat. (2024). Students’ Perceptions of AI-based Speech Recognition in the ELSA Speak Application for Pronunciation Practice. Proceedings of The 2nd National Seminar on English Language Teaching (NELT), 35–44.

Reynald Manoppo, M. (2025). Analisis Sentimen Publik Di Media Sosial Terhadap Kenaikan Ppn 12% Di Indonesia Menggunakan Indobert. Jurnal Kecerdasan Buatan Dan Teknologi Informasi, 4(2), 152–163. https://doi.org/https://doi.prg/10.69916/jkbti.v4i2.322

Sahut, J. M., & Laroche, M. (2025). Using artificial intelligence (AI) to enhance customer experience and to develop strategic marketing: An integrative synthesis. Computers in Human Behavior, 170(April). https://doi.org/10.1016/j.chb.2025.108684

Saputra, M. A. A., Alamsyah, A., Ramadhani, D. P., Siadari, T. S., & Fakhrurroja, H. (2026). IndoBERT-Sentiment: Context-Conditioned Sentiment Classification for Indonesian Text. 1–8. http://arxiv.org/abs/2604.07057

Setiawan, V. D., Iswavigra, D. U., & Anggiratih, E. (2025). Implementation of IndoBERT for Sentiment Analysis of the Constitutional Court’s Decision Regarding the Minimum Age of Vice Presidential Candidates. Scientific Journal of Informatics, 12(3), 397–406. https://doi.org/10.15294/sji.v12i3.26320

Shakira, F. D., Redjeki, I. S., Furqan, M., Education, E., & Program, S. (2026). THE USE OF STIMULER APP TO SUPPORT THE LEARNING OF ENGLISH. The 6th Bogor English Student and Teacher (BEST) Conference 2026, 290–295.

Simarmata, A. A. P. (2025). Sentiment Analysis on BRImo Application Reviews Using IndoBERT. Journal of Applied Informatics and Computing, 9(3), 851–862.

Singgalen, Y. A. (2025). Performance Analysis of IndoBERT for Sentiment Classification in Indonesian Hotel Review Data. Journal of Information System Research (JOSH), 6(2), 976–986. https://doi.org/10.47065/josh.v6i2.6505

Tang, W. K. W., & Zhang, X. Y. (2026). Artificial Intelligence in English as a foreign language learning: A systematic review of technologies, tools, and their impacts. Computers and Education: Artificial Intelligence, 10(April), 100595. https://doi.org/10.1016/j.caeai.2026.100595

Tedja, B., Al Musadieq, M., Kusumawati, A., & Yulianto, E. (2024). Systematic literature review using PRISMA: exploring the influence of service quality and perceived value on satisfaction and intention to continue relationship. Future Business Journal, 10(1), 1–9. https://doi.org/10.1186/s43093-024-00326-4

Xu, Z. (2024). AI in education: Enhancing learning experiences and student outcomes. Applied and Computational Engineering, 51(1), 104–111. https://doi.org/10.54254/2755-2721/51/20241187