Azmain, Md. AquibAnwar, Md. TawhidAdor, Muntasir AhmedHasan, FahimMahamud, Syed AshikNazmin, Iffat AraMuntasir Arin, Md. Mahim2025-06-182025-06-1820252025-02ID: 20101259ID: 20201144ID: 20301124ID: 21101106ID:24141109http://hdl.handle.net/10361/26078Cataloged from PDF version of thesis.Includes bibliographical references (pages 31-34).This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2025.The arrival of large language models (LLMs) have been a game-changer in natural language processing (NLP). It revolutionized the way we comprehend and generate content. However, LLMs can hallucinate-that is, contradict the reality or input provided by the user. This is a big problem because these models are being used these days in many diverse industries, including for medical and legal purposes where accuracy is paramount. Hallucinations can damage user trust and lead to the spread of incorrect facts. Although it is not a major issue in ordinary situations, it raises serious concerns in sensitive areas like healthcare and legal advice. Also it can inadvertently become part of the training corpus for future models if not carefully filtered. This creates a feedback loop where errors in one generation of models can propagate and potentially amplify in subsequent iterations. To solve this problem, we have created an all-rounded dataset with questions from SQuAD (Stanford Question Answering Dataset), HotpotQA, and TriviaQA, among other datasets. We will use the state-of-the-art LLM GPT-4o mini to generate answers. Finally, to this end, the paper describes several rules for the annotation of a corresponding dataset, its resulting characteristic properties and the classification quality that can be achieved when using the dataset for fine-tuning different models.34 pagesenBRAC University theses reports are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission.Machine learningNatural language processingLarge language modelsAI hallucinationGPTTransformerALBERTNatural language processing (Computer science).Artificial intelligence.Thesis