AI-driven context-aware trimming and segmentation of educational video content for focused learning
Loading...
Date
Publisher
BRAC University
Citation
Abstract
Recorded class lectures and tutorials are essential learning resources, but unedited
raw videos generally contain significant non-instructional content, such as silence,
administrative discussions, off-topic instructions, making effective navigation and
revision difficult. This study presents a framework which is open-source, contextaware
and can automatically detect and remove irrelevant or off-topic segments from
long, unedited educational videos. Most of the existing related solutions rely heavily
on large, closed-source models or fixed-length video segmentation with no context
awareness, which are computationally expensive and prone to breaking semantic continuity.
To address these limitations, we propose a modular, four-stage orchestration
pipeline designed to run entirely on consumer-grade GPUs using small, open-weight
models. The framework uses automatic speech recognition (Parakeet TDT 0.6B)
to perform dynamic, sentence-level video segmentation, ensuring that each segment
represents a complete semantic unit. A lightweight vision language model then generates
structured textual descriptions for each segment using both visual frames and
subtitles, augmented with rolling local context to preserve chronological coherence.
Finally, a small language model (Qwen3-4B-instruct) is used to perform classification
on the generated descriptions rather than on raw video input. The proposed
orchestrator pipeline achieves 96.85% accuracy, 89.04% precision, 92.77% recall,
and 90.86% F1 for irrelevant-segment detection on a human-annotated benchmark
of 20 educational videos (total duration 09:13:47). This results in a significant
improvement in content preservation over a one-shot Gemini-3 baseline, with precision
increasing from 45.98% to 89.04% and accuracy from 81.63% to 96.85%. The
entire system runs locally via quantized inference, offering a practical and privacypreserving
alternative to cloud-based solutions.
Description
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 47-50).
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2026.
Includes bibliographical references (pages 47-50).
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2026.
Publisher Link
Type
Thesis