arXiv subjects

Hanyuan Zhang

Publications and source records attributed to Hanyuan Zhang.

24 records · Page 2Linked to original sources

arXiv2024

Can We Trust LLMs? Mitigate Overconfidence Bias in LLMs through Knowledge Transfer

The study explores mitigating overconfidence bias in LLMs to improve their reliability. We introduce a knowledge transfer (KT) method utilizing chain of thoughts, where "big" LLMs impart knowledge to "small" LLMs via detailed, sequential reasoning paths. This method uses advanced reasoning of larger models to fine-tune smaller models, enabling them to produce more accurate predictions with calibrated confidence. Experimental evaluation using multiple-choice questions and sentiment analysis across diverse datasets demonstrated the KT method's superiority over the vanilla and question-answer pair (QA) fine-tuning methods. The most significant improvement in three key metrics, where the KT method outperformed the vanilla and QA methods by an average of 55.3% and 43.1%, respectively. These findings underscore the KT method's potential in enhancing model trustworthiness and accuracy, offering precise outputs with well-matched confidence levels across various contexts.

cs.CL↗

arXiv2024

The Pristine Inner Galaxy Survey (PIGS) VIII: Characterising the orbital properties of the ancient, very metal-poor inner Milky Way

The oldest stars in the Milky Way (born in the first few billion years) are expected to have a high density in the inner few kpc, spatially overlapping with the Galactic bulge. We use spectroscopic data from the Pristine Inner Galaxy Survey (PIGS) to study the dynamical properties of ancient, metal-poor inner Galaxy stars. We compute distances using StarHorse, and orbital properties in a barred Galactic potential. With this paper, we release the spectroscopic AAT/PIGS catalogue (13 235 stars). We find that most PIGS stars have orbits typical for a pressure-supported population. The fraction of stars confined to the inner Galaxy decreases with decreasing metallicity, but many very metal-poor stars (VMP, [Fe/H] < -2.0) stay confined (~ 60% stay within 5 kpc). The azimuthal velocity v$_ϕ$ also decreases between [Fe/H] = -1.0 and -2.0, but is constant for VMP stars (at ~ 40 km/s). The carbon-enhanced metal-poor (CEMP) stars in PIGS appear to have similar orbital properties compared to normal VMP stars. Our results suggest a possible transition between two spheroidal components - a more metal-rich, more concentrated, faster rotating component, and a more metal-poor, more extended and slower/non-rotating component. We propose that the former may be connected to pre-disc in-situ stars (or those born in large building blocks), whereas the latter may be dominated by contributions from smaller galaxies. This is an exciting era where large metal-poor samples, such as in this work (as well as upcoming surveys, e.g., 4MOST), shed light on the earliest evolution of our Galaxy.

astro-ph.GA↗

arXiv2023

A kinematic calibration of the O-rich Mira variable period-age relation from Gaia

Empirical and theoretical studies have demonstrated that the periods of Mira variable stars are related to their ages. This, together with their brightness in the infrared, makes them powerful probes of the formation and evolution of highly-extincted or distant parts of the Local Group. Here we utilise the Gaia DR3 catalogue of long-period variable candidates to calibrate the period-age relation of the Mira variables. Dynamical models are fitted to the O-rich Mira variable population across the extended solar neighbourhood and then the resulting solar neighbourhood period-kinematic relations are compared to external calibrations of the age-kinematic relations to derive a Mira variable period-age relation of $τ\approx(6.9\pm0.3)\,\mathrm{Gyr}(1+\tanh((330\,\mathrm{d}-P)/(400\pm90)\mathrm{d})$. Our results compare well with previous calibrations using smaller datasets as well as the period-age properties of Local Group cluster members. This calibration opens the possibility of accurately characterising the star formation and the impact of different evolutionary processes throughout the Local Group.

astro-ph.SR↗

arXiv2022

RNTrajRec: Road Network Enhanced Trajectory Recovery with Spatial-Temporal Transformer

GPS trajectories are the essential foundations for many trajectory-based applications, such as travel time estimation, traffic prediction and trajectory similarity measurement. Most applications require a large amount of high sample rate trajectories to achieve a good performance. However, many real-life trajectories are collected with low sample rate due to energy concern or other constraints.We study the task of trajectory recovery in this paper as a means for increasing the sample rate of low sample trajectories. Currently, most existing works on trajectory recovery follow a sequence-to-sequence diagram, with an encoder to encode a trajectory and a decoder to recover real GPS points in the trajectory. However, these works ignore the topology of road network and only use grid information or raw GPS points as input. Therefore, the encoder model is not able to capture rich spatial information of the GPS points along the trajectory, making the prediction less accurate and lack spatial consistency. In this paper, we propose a road network enhanced transformer-based framework, namely RNTrajRec, for trajectory recovery. RNTrajRec first uses a graph model, namely GridGNN, to learn the embedding features of each road segment. It next develops a spatial-temporal transformer model, namely GPSFormer, to learn rich spatial and temporal features along with a Sub-Graph Generation module to capture the spatial features for each GPS point in the trajectory. It finally forwards the outputs of encoder model into a multi-task decoder model to recover the missing GPS points. Extensive experiments based on three large-scale real-life trajectory datasets confirm the effectiveness of our approach.

cs.LG↗

arXiv2020

DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories

Automatic map extraction is of great importance to urban computing and location-based services. Aerial image and GPS trajectory data refer to two different data sources that could be leveraged to generate the map, although they carry different types of information. Most previous works on data fusion between aerial images and data from auxiliary sensors do not fully utilize the information of both modalities and hence suffer from the issue of information loss. We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map. We design a gated fusion module to explicitly control the information flows from both modalities in a complementary-aware manner. Moreover, we propose a novel densely supervised refinement decoder to generate the prediction in a coarse-to-fine way. Our comprehensive experiments demonstrate that DeepDualMapper can fuse the information of images and trajectories much more effectively than existing approaches, and is able to generate maps with higher accuracy.

cs.CV↗

arXiv2018

DeepTravel: a Neural Network Based Travel Time Estimation Model with Auxiliary Supervision

Estimating the travel time of a path is of great importance to smart urban mobility. Existing approaches are either based on estimating the time cost of each road segment which are not able to capture many cross-segment complex factors, or designed heuristically in a non-learning-based way which fail to utilize the existing abundant temporal labels of the data, i.e., the time stamp of each trajectory point. In this paper, we leverage on new development of deep neural networks and propose a novel auxiliary supervision model, namely DeepTravel, that can automatically and effectively extract different features, as well as make full use of the temporal labels of the trajectory data. We have conducted comprehensive experiments on real datasets to demonstrate the out-performance of DeepTravel over existing approaches.

cs.LG↗