SearcharxivSearch

arXiv subjects

Taekhyun Park

Publications and source records attributed to Taekhyun Park.

6 recordsLinked to original sources

Trie-Constrained Token Prediction with Hierarchy-Aware Semantic Alignment for HS Code Prediction

Harmonized System (HS) code prediction (HSP) from commodity text is essential to international trade, and its importance continues to grow in port logistics. For the purposes of such prediction, recently, large language models (LLMs) have been actively investigated, owing especially to their strong language-understanding capabilities. However, their high computational cost limits deployment in constrained environments such as container terminals. Small language models (SLMs) offer a practical alternative, but their smaller scale makes them prone to generating invalid HS codes and to overlooking the hierarchical semantics between commodity text and HS codes. To address these limitations, this study proposes TRIE-HSA, which combines trie-constrained token prediction with hierarchy-aware semantic alignment (HSA). This method constrains the SLM to predict only valid digits under the HS taxonomy and aligns commodity text representations with the hierarchical structure of HS codes. In extensive experiments on data collected from an operational container terminal, TRIE-HSA improved average HS6 accuracy by 49.96 %p over zero-shot inference and exceeded the strongest task-specific benchmark by 11.94 %p. These results demonstrate that accurate and structurally valid HSP is achievable with fewer than 10 billion parameters. Therefore, TRIE-HSA offers a practical basis for deployment of HSP in port logistics operations that cannot support largescale LLMs.

cs.CE

Generative AI and Machine Learning Collaboration for Container Dwell Time Prediction via Data Standardization

Import container dwell time (ICDT) prediction is a key task for improving productivity in container terminals, as accurate predictions enable the reduction of container re-handling operations by yard cranes. Achieving this objective requires accurately predicting the dwell time of individual containers. However, the primary determinants of dwell time-owner information and cargo information-are recorded as unstructured text, which limits their effective use in machine learning models. This study addresses this limitation by proposing a collaborative framework that integrates generative artificial intelligence (Gen AI) with machine learning. The proposed framework employs Gen AI to standardize unstructured information into standard international codes, with dynamic re-prediction triggered by electronic data interchange state updates, enabling the machine learning model to predict ICDT accurately. Extensive experiments conducted on real container terminal data demonstrate that the proposed methodology achieves a 13.88% improvement in mean absolute error compared to conventional models that do not utilize standardized information. Furthermore, applying the improved predictions to container stacking strategies achieves up to 14.68% reduction in the number of relocations, thereby empirically validating the potential of Gen AI to enhance productivity in container terminal operations. Overall, this study provides both technical and methodological insights into the adoption of Gen AI in port logistics and its effectiveness.

cs.CE

Variable-Horizon Workforce Demand Forecasting with an Aggregate Demand Constraint for Construction Workforce Planning

Workforce planning is a recurring operational decision during construction projects that requires accurate forecasts of the future workforce demand for individual tasks. However, in practice, tasks have different completion dates, resulting in variable forecast horizons. In addition, the sum of the predicted daily workforce demands must equal the total workforce allocation specified in advance. Most existing machine-learning (ML)-based forecasting models assume fixed-length outputs and do not explicitly impose an aggregate demand constraint, making them unsuitable for these operational requirements. To address this problem, this study proposes constraint-preserving residual allocation forecasting (CP-RAF). The CP-RAF represents an observed workforce demand time series as a coefficient vector and retrieves completed tasks with similar temporal shapes. Then, it estimates the allocation profile over the remaining task duration using similarity-weight averaging. The predefined remaining workforce demand for each task was distributed according to the estimated profile, and the forecast horizon was adjusted while retaining profile characteristics. This procedure accommodates variable forecast horizons while preserving the aggregate demand constraints. CP-RAF was evaluated using workforce demand field data. The results showed that CP-RAF outperformed eight baseline models in medium- and long-horizon fixed-length forecasting and maintained low forecast errors under variable-length forecasting. By directly incorporating operational constraints into the forecasting procedure, the proposed method provides a framework suitable for workforce allocation in construction practices.

cs.CE

Rewarding Structural Conformance of Reasoning using Process Mining

Recent advances in sparse reward policy gradient methods have enabled effective reinforcement learning (RL)-based language model post-training. However, for reasoning tasks such as mathematical problem solving, binarized outcome rewards provide limited feedback on intermediate reasoning steps. While some studies have attempted to address this issue by estimating overall reasoning quality, it remains unclear whether these rewards are reliable proxies for the quality of stepwise reasoning. In this study, we consider reasoning as a structured process and propose TACReward, the reward model that can be seamlessly integrated into sparse reward policy gradient methods without additional human annotation costs or architectural modifications. TACReward aggregates stepwise structural deviations between teacher and policy reasoning using process mining techniques, producing a scalar output reward range of [0, 1] to indicate reasoning quality. Experiments on multiple mathematical reasoning benchmarks demonstrate that integrating the TACReward into sparse reward frameworks encourages the policy model to improve the structural quality of reasoning. Consequently, this leads to consistent performance improvements over existing sparse reward frameworks. Our code and checkpoints are publicly available at https://github.com/Thrillcrazyer/TACReward and https://huggingface.co/Thrillcrazyer/TACReward7B.

cs.AI

LoopUS: Recasting Pretrained LLMs into Looped Latent Refinement Models

Looped computation shows promise in improving the reasoning-oriented performance of LLMs by scaling test-time compute. However, existing approaches typically require either training recurrent models from scratch or applying disruptive retrofits, which involve substantial computational costs and may compromise pretrained capabilities. To address these limitations, we introduce \textbf{Looped Depth Up-Scaling} (LoopUS), a post-training framework that converts a standard pretrained LLM into a looped architecture. As a key technical contribution, LoopUS recasts the pretrained LLM into an encoder, a looped reasoning block, and a decoder. It operationalizes this latent-refinement architecture through four core components: (1) block decomposition, guided by staged representation dynamics; (2) an input-dependent selective gate to mitigate hidden-state drift; (3) random deep supervision for memory-efficient learning over long recursive horizons; and (4) a confidence head for adaptive early exiting. Collectively, these mechanisms transform a standard non-looped model into a looped form while stabilizing it against both computational bottlenecks and representation collapse. Through stable latent looping, LoopUS improves reasoning-oriented performance without extending the generated traces or requiring recurrent training from scratch. For more details, see https://thrillcrazyer.github.io/LoopUS

cs.LG

Application of Large Language Models for Container Throughput Forecasting: Incorporating Contextual Information in Port Logistics

Recent advancements in generative artificial intelligence (AI) have demonstrated its substantial potential in various fields. However, its application in port logistics remains underexplored. Ports are complex operational environments where diverse types of contextual information coexist, making them a promising domain for the implementation of generative AI and highlighting the urgency of related research. In this study, we applied a large language model (LLM)-a leading generative AI technique-to forecast container throughput, which is a critical challenge in port logistics. To this end, we adopted a state-of-the-art LLM approach and proposed a novel prompt structure designed to incorporate the contextual characteristics of port operations. Extensive experiments confirm the superiority of our method, showing that the proposed approach outperforms competitive benchmark models. Furthermore, additional experiments revealed that LLMs can effectively learn and utilize multiple layers of contextual information for inference in port logistics. Based on these findings, we explore the key constraints affecting LLM adoption in this domain and outline future research directions aimed at addressing them. Accordingly, we offer both technical and practical insights to support the effective deployment of generative AI in port logistics.

cs.CE