Sakib, Tauhidur RahmanTamim, Md. Yasin ArafatPriota, Mysha SamihaImam-Ur-RashidAhmed, S.M. ShakilShabbir, LotifurSarker M.R.Alam, Md. Iftiajul2026-08-302026-08-302025-01-01T. R. Sakib et al., "Operationally Robust Machine Learning for PreLaunch Missile Failure Prediction," 2025 IEEE International Conference on Agentic AI (ICA), Wuhan, China, 2025, pp. 196-201, doi: 10.1109/ICA67499.2025.00050.97983315563412-s2.0-105033360405https://hdl.handle.net/10361/29604Pre-launch missile strike failure prediction is a critical defense analytics challenge that requires accurate and trustworthy classification methods. This study introduces a leakage-safe ensemble learning framework that integrates frequency and one-hot encoding, temporal scaling, and SMOTE within cross-validation to address class imbalance (77.1% failures, 22.9% successes). Five classifiers-Random Forest, XGBoost, LightGBM, CatBoost, and stacked ensembles-were evaluated under identical conditions. Random Forest achieved the highest F1-score (96.9%), accuracy (95.3%), and calibration (Brier Score =0.082, ECE=0.038), while stacked ensembles provided a marginal improvement in ROC-AUC (97.5%) but weaker F1 performance. Robustness was further validated through paired statistical tests across 5-fold cross-validation, which confirmed that differences were not statistically significant (p>0.05). Random Forest consistently showed advantages in F 1 and calibration, whereas stacking excelled in ranking. These findings demonstrate that tree-based ensembles are robust and effective for noisy, imbalanced defense data, with Random Forest offering the most reliable and interpretable balance for operational deployment.196-201en-USAccuracyRobustnessEncodingStability analysisCalibrationRandom forestsThermal stabilityStandardsPre-launch predictionSynthetic minority oversampling techniqueImbalanced learningMissile operationsGuided missiles--Testing.Guided missiles--Reliability.Conference Proceeding10.1109/ICA67499.2025.00050