Transformer-Based Classification of Indonesian Public Service Complaints

A Case Study of a Municipal Online Reporting Channel

Andi Wijaya, Siti Rahmawati

Jurnal Teknologi dan Inovasi, Vol. 1 No. 2 (2026), pp. 1-8

Abstract

Municipal reporting channels receive thousands of free-text complaints every month, and manual routing to the responsible agency delays follow-up. This study fine-tunes a multilingual transformer model to classify Indonesian complaints into twelve service categories. A dataset of 18,400 anonymised complaints was split into training, validation, and test sets, and the transformer was compared with TF-IDF logistic regression and a bidirectional LSTM. The transformer reached a macro F1-score of 0.87, against 0.78 for logistic regression and 0.82 for the LSTM, with the largest gains in categories that share vocabulary, such as roads and drainage. Error analysis shows that most remaining mistakes involve complaints that mention several services at once. The results indicate that transformer-based routing can shorten the time a complaint waits before it reaches the right agency.

Keywords: text classification; transformer; Indonesian language; public service; complaint management

1. Introduction

This section introduces the problem of natural language processing addressed in this study, reviews the main approaches reported in prior work, and states the research objectives.

2. Methods

We describe the data, the proposed approach, the baselines, and the evaluation protocol used to assess the results summarised in the abstract.

3. Results and Discussion

The results are presented and compared with the baselines. Limitations and practical implications for deployment are discussed.

4. Conclusion

The study shows that the proposed approach is effective for the stated objectives and outlines directions for future work.

References

  1. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
  2. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT 2019, 4171–4186.
  3. Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
  4. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv:1301.3781.
  5. Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT Press.