arXiv subjects

Bin Ning

Publications and source records attributed to Bin Ning.

3 recordsLinked to original sources

arXiv2023

Evaluating the Generation Capabilities of Large Chinese Language Models

This paper unveils CG-Eval, the first-ever comprehensive and automated evaluation framework designed for assessing the generative capabilities of large Chinese language models across a spectrum of academic disciplines. CG-Eval stands out for its automated process, which critically assesses models based on their proficiency in generating precise and contextually relevant responses to a diverse array of questions within six key domains: Science and Engineering, Humanities and Social Sciences, Mathematical Calculations, Medical Practitioner Qualification Examination, Judicial Examination, and Certified Public Accountant Examination. Alongside this, we introduce Gscore, an innovative composite index developed from a weighted sum of multiple metrics. Gscore uniquely automates the quality measurement of a model's text generation against reference standards, providing a detailed and nuanced assessment of model performance. This automation not only enhances the efficiency and scalability of the evaluation process but also ensures objective and consistent assessment across various models. The detailed test data and results, highlighting the robust capabilities and comparative performance of the evaluated models, are accessible at http://cgeval.besteasy.com/.

cs.CL↗

arXiv2013

Finite-State Markov Modeling of Tunnel Channels in Communication-based Train Control (CBTC) Systems

Communication-based train control (CBTC) is gradually adopted in urban rail transit systems, as it can significantly enhance railway network efficiency, safety and capacity. Since CBTC systems are mostly deployed in underground tunnels and trains move in high speed, building a train-ground wireless communication system for CBTC is a challenging task. Modeling the tunnel channels is very important to design and evaluate the performance of CBTC systems. Most of existing works on channel modeling do not consider the unique characteristics in CBTC systems, such as high mobility speed, deterministic moving direction, and accurate train location information. In this paper, we develop a finite state Markov channel (FSMC) model for tunnel channels in CBTC systems. The proposed FSMC model is based on real field CBTC channel measurements obtained from a business operating subway line. Unlike most existing channel models, which are not related to specific locations, the proposed FSMC channel model takes train locations into account to have a more accurate channel model. The distance between the transmitter and the receiver is divided into intervals, and an FSMC model is applied in each interval. The accuracy of the proposed FSMC model is illustrated by the simulation results generated from the model and the real field measurement results.

cs.DM↗

arXiv2013

Finite-State Markov Modeling of Leaky Waveguide Channels in Communication-based Train Control (CBTC) Systems

Leaky waveguide has been adopted in communication based train control (CBTC) systems, as it can significantly enhance railway network efficiency, safety and capacity. Since CBTC systems have high requirements for the train ground communications, modeling the leaky waveguide channels is very important to design the wireless networks and evaluate the performance of CBTC systems. In the letter, we develop a finite-state Markov channel (FSMC) model for leaky waveguide channels in CBTC systems based on real field channel measurements obtained from a business operating subway line. The proposed FSMC channel model takes train locations into account to have a more accurate channel model. The overall leaky waveguide is divided into intervals, and an FSMC model is applied in each interval. The accuracy of the proposed FSMC model is illustrated by the simulation results generated from the model and the real field measurement results.

cs.DM↗