Research Project Topic Recommender System Using Generative Language Model

Debby Erce Sondakh, S.Kom, M.T, Ph.D; Semmy Wellem Taju; Jian Kezia Tesalonica  Yuune; Anjelita Ferensca Kaminang; Syalom Gabriela Wagey

doi:10.31154/cogito.v10i1.678.654-666

Authors

Debby Erce Sondakh, S.Kom, M.T, Ph.D Universitas Klabat
Semmy Wellem Taju Universitas Klabat
Jian Kezia Tesalonica Yuune Universitas Klabat
Anjelita Ferensca Kaminang Universitas Klabat
Syalom Gabriela Wagey Universitas Klabat

DOI:

https://doi.org/10.31154/cogito.v10i1.678.654-666

Keywords:

Recommendation System, Research Project Topics, Artificial Intelligence, Generative Language Model, GPT-3

Abstract

Education has become a driver of a person's continuous innovation to improve their quality. Currently, the use of artificial intelligence determines progress in education. In this research, artificial intelligence technology was applied to develop a web-based recommendation system to help students at the Faculty of Computer Science, Klabat University, choose appropriate research topics for their final assignments. To provide personalized and contextually relevant suggestions, the recommendation system leverages deep learning and generative language models, specifically GPT-3. The Rapid Application Development process model is employed to develop the system. Its key components include semantic search, rapid engineering, and an advanced vector database for effective data management and retrieval. The functions provided by the system include user account registration, login, input of major subject grades and research preferences, and personalized recommendation results. Some additional features such as profile management, previous recommendation history, and password reset options are also provided. All these functions have been tested using the black box method.

References

K. L. A. Yau et al., “Augmented Intelligence: Surveys of Literature and Expert Opinion to Understand Relations between Human Intelligence and Artificial Intelligence,” IEEE Access, vol. 9, pp. 136744–136761, 2021, doi: 10.1109/ACCESS.2021.3115494.

K. M. Fitria, “Implementasi Model Bahasa OpenAI GPT-3 untuk Aplikasi Text Content Generator Berbasis Web dan Aplikasi Mobile,” Jurusan Teknik Elektro, Universitas Lampung, 2022.

N. G. Polson and V. O. Sokolov, “Deep Learning,” Wiley StatsRef: Statistics Reference Online, pp. 1–12, May 2019, doi: 10.1002/9781118445112.stat08171.

A. A. Ningrum, I. Syarif, A. I. Gunawan, E. Satriyanto, and R. Muchtar, “Algoritma Deep Learning-LSTM untuk Memprediksi Umur Transformator,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 8, no. 3, pp. 539–548, Jun. 2021, doi: 10.25126/jtiik.2021834587.

J. A. Goldstein, G. Sastry, M. Musser, R. DiResta, M. Gentzel, and K. Sedova, “Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations,” Jan. 2023. [Online]. Available: http://arxiv.org/abs/2301.04246

Q. Zhu and J. Luo, “Generative Pre-Trained Transformer for Design Concept Generation: An Exploration,” in Proceedings of the Design Society, Cambridge University Press, May 2022, pp. 1825–1834. doi: 10.1017/pds.2022.185.

N. Sofi, T. Sulistyorini, and M. Nazaruddin, “Analisis Sentimen Masyarakat Pengguna Media Sosial Twitter Terhadap Motogp Mandalika Lombok Menggunakan Metode Bidirectional Encoder Representation From Transformers (BERT),” Jurnal Informasi, Sains, dan Teknologi, vol. 6, no. 1, pp. 120–130, 2023.

S. Kublik and S. Saboo, Gpt-3 : The Ultimate Guide to Building NLP Products with OpenAI API. United States of America, 2022.

A. Vaswani et al., “Attention Is All You Need,” in 31st Conference on Neural Information Processing System, Long Beach, 2017, pp. 2–11.

A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, “Improving Language Understanding by Generative Pre-Training.” 2022. [Online]. Available: https://gluebenchmark.com/leaderboard

E. Sezgin, J. Sirrianni, and S. L. Linwood, “Operationalizing and Implementing Pretrained, Large Artificial Intelligence Linguistic Models in the US Health Care System: Outlook of Generative Pretrained Transformer 3 (GPT-3) as a Service Model,” JMIR Med Inform, vol. 10, no. 2, Feb. 2022, doi: 10.2196/32875.

M. M. El-Gayar, N. E. Mekky, A. Atwan, and H. Soliman, “Enhanced search engine using proposed framework and ranking algorithm based on semantic relations,” IEEE Access, vol. 7, pp. 139337–139349, 2019, doi: 10.1109/ACCESS.2019.2941937.

J. Oppenlaender, “A Taxonomy of Prompt Modifiers for Text-To-Image Generation,” University of Jyväskylä, Findland, 2022. [Online]. Available: http://arxiv.org/abs/2204.13988

V. Liu and L. B. Chilton, “Design Guidelines for Prompt Engineering Text-to-Image Generative Models,” in Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, Apr. 2022. doi: 10.1145/3491102.3501825.

R. Guo et al., “Manu: A Cloud Native Vector Database Management System,” Proceedings of the VLDB Endowment, vol. 15, no. 12, pp. 1–14, Jun. 2022, [Online]. Available: http://arxiv.org/abs/2206.13843

S. K. Nigam, S. K. Mishra, A. K. Mishra, N. Shallum, and A. Bhattacharya, “Legal Question-Answering in the Indian Context: Efficacy, Challenges, and Potential of Modern AI Models,” Sep. 2023. [Online]. Available: http://arxiv.org/abs/2309.14735

L. Hillebrand et al., “Improving Zero-Shot Text Matching for Financial Auditing with Large Language Models,” in Proceedings of the ACM Symposium on Document Engineering 2023, Association for Computing Machinery (ACM), Aug. 2023, pp. 1–4. doi: 10.1145/3573128.3609344.

M. Șorecău and E. Șorecău, “An Alternative Application to CHATGPT that Uses Reliable Sources to Enhance the Learning Process,” International conference KNOWLEDGE- BASED ORGANIZATION, vol. 29, no. 3, pp. 113–119, Jun. 2023, doi: 10.2478/kbo-2023-0084.

I. Sholihah and C. Darujati, “Sistem Replikasi Basis Data berdasarkan MySQL menggunakan Container Docker,” Majalah Ilmiah Teknologi Elektro, vol. 21, no. 2, p. 209, Dec. 2022, doi: 10.24843/mite.2022.v21i02.p08.

A. Lutfi, “Sistem Informasi Akademik Mardrasah Aliyah Salafiyah Syafi’iyah menggunakan PHP dan MySQL,” AiTech, vol. 3, no. 2, pp. 104–112, Oct. 2017.

D. Gusrion, “Membuat Aplikasi Penyimpanan dan Pengolahan Data dengan VB.Net,” Jurnal KomTekInfo, vol. 5, no. 1, pp. 150–163, 2018.

T. Pricillia and Zulfachmi, “Survey Paper: Perbandingan Metode Pengembangan Perangkat Lunak (Waterfall, Prototype, RAD),” Bangkit Indonesia, vol. 10, no. 1, pp. 6– 12, Mar. 2021.