Maggie Mashaly | Searcharxiv

arXiv2026

AutoCluster, AutoTopicModeling, AutoTrendAnalysis: A Complete AutoML Pipeline for Predicting Emerging Trends

Predicting emerging trends is vital for businesses, researchers, and policymakers; yet traditional approaches often lack scalability and adaptability. This paper presents a trend prediction framework based on Automated Machine Learning (AutoML), designed to extract insights from textual datasets with temporal attributes. The system ingests subject-specific textual entries accompanied by a date field. The pipeline begins with preprocessing and embedding, followed by AutoClustering, which uses meta-learning to select the optimal clustering algorithm. AutoTopicModeling then applies successive halving to identify the best topic modeling method: Latent Dirichlet Allocation (LDA), Latent Semantic Analysis (LSA), BERTopic, or Non-negative Matrix Factorization (NMF) based on the coherence score for each cluster. For trend forecasting, AutoTrendAnalysis evaluates multiple models: Facebook Prophet, AutoRegressive Integrated Moving Average (ARIMA), Seasonal-Trend decomposition using Loess (STL), and Long Short-Term Memory (LSTM) selecting the most accurate based on Root Mean Square Error (RMSE), either through successive halving or exhaustive comparison. Topics are classified as strong signals, weak signals, or noise based on forecasting outcomes, enabling the identification of emerging trends. By automating clustering, topic modeling, and time series forecasting, this research enhances trend prediction accuracy while reducing manual effort. The proposed system offers a scalable and user-friendly solution suitable for real-time applications and stakeholders with limited machine learning expertise. Experimental results demonstrate that the proposed system's best trial achieves a final RMSE of 7.099, indicating high predictive accuracy.

cs.DL↗

arXiv2026

Forecasting Technological Directions in Wireless Networks and Mobile Computing via AutoML Framework

The exponential increase in scientific publications has driven the emergence of new trends. Accurate forecasting of these developments is essential for researchers and professionals to stay updated with advancements in the field. This study presents an automated pipeline for trend prediction in the wireless networks and mobile computing domain by integrating clustering, topic modeling, and time series analysis. The process begins with the collection of 127,820 abstracts from high-impact journals and conferences, followed by extensive preprocessing and semantic embedding using the SPECTER model. AutoCluster applies meta-learning to select the most suitable clustering algorithm based on the dataset meta-features, ensuring semantically coherent groupings. AutoTopicModeling then employs a successive halving strategy to identify the best-performing topic model per cluster, followed by LLM-assisted topic labeling and optional label generalization. Finally, AutoTrendAnalysis transforms topic-labeled data into time series and applies forecasting models -ARIMA, STL, Prophet, or LSTM - to predict future topic popularity. Topics are classified as strong, weak, or noise signals based on forecast trajectories, offering interpretable insights into emerging and declining research themes. The framework is scalable, adaptive, and designed for robust trend analysis across scientific domains. Experimental results demonstrated high predictive accuracy, achieving a Root Mean Square Error (RMSE) of 36.76.

cs.DL↗