Searcharxiv⌕ Search

arXiv subjects

Zhiyong Zhang

Publications and source records attributed to Zhiyong Zhang.

At least 55 records · Page 3Linked to original sources

Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality ground-truth data hinders their applications due to the generalization problem. Recently, Implicit Neural Representation (INR) has appeared as a powerful DL-based tool for solving the inverse problem by characterizing the attributes of a signal as a continuous function of corresponding coordinates in an unsupervised manner. In this work, we proposed an INR-based method to improve dynamic MRI reconstruction from highly undersampled k-space data, which only takes spatiotemporal coordinates as inputs. Specifically, the proposed INR represents the dynamic MRI images as an implicit function and encodes them into neural networks. The weights of the network are learned from sparsely-acquired (k, t)-space data itself only, without external training datasets or prior images. Benefiting from the strong implicit continuity regularization of INR together with explicit regularization for low-rankness and sparsity, our proposed method outperforms the compared scan-specific methods at various acceleration factors. E.g., experiments on retrospective cardiac cine datasets show an improvement of 5.5 ~ 7.1 dB in PSNR for extremely high accelerations (up to 41.6-fold). The high-quality and inner continuity of the images provided by INR has great potential to further improve the spatiotemporal resolution of dynamic MRI, without the need of any training data.

eess.IV↗

An atrium segmentation network with location guidance and siamese adjustment

The segmentation of atrial scan images is of great significance for the three-dimensional reconstruction of the atrium and the surgical positioning. Most of the existing segmentation networks adopt a 2D structure and only take original images as input, ignoring the context information of 3D images and the role of prior information. In this paper, we propose an atrium segmentation network LGSANet with location guidance and siamese adjustment, which takes adjacent three slices of images as input and adopts an end-to-end approach to achieve coarse-to-fine atrial segmentation. The location guidance(LG) block uses the prior information of the localization map to guide the encoding features of the fine segmentation stage, and the siamese adjustment(SA) block uses the context information to adjust the segmentation edges. On the atrium datasets of ACDC and ASC, sufficient experiments prove that our method can adapt to many classic 2D segmentation networks, so that it can obtain significant performance improvements.

eess.IV↗

Study of Hybrid MicroPattern Gas Detector with CsI Photocathode For Super Tau-Charm Factory RICH

Super tau-Charm facility(STCF) is a future electron-position collider operating at tau-Charm energy region aimed to study hadron structure and spectroscopy. The baseline design of the STCF barrel particle identification(PID) detector in the momentum range up to 2 GeV/c is provided by a Ring Imaging Cherenkov Counter(RICH). The architecture of the RICH is an approximately focusing design with liquid perfluorohexane sealed in the quartz container as radiator and a hybrid combination of a CsI coated layers of THGEMs and a Micromegas as the photo-electron detector. A 16*16 cm^2 prototype with quartz radiator has been built and tested at DESY. It was stably operated with 10^5 effective gain. In this paper, the design, the performance, the reconstruction algorithm and the systematic error for single photon electron angular resolution in the aspect of RICH detectors are discusses.

physics.ins-det↗

Linguistic-Enhanced Transformer with CTC Embedding for Speech Recognition

The recent emergence of joint CTC-Attention model shows significant improvement in automatic speech recognition (ASR). The improvement largely lies in the modeling of linguistic information by decoder. The decoder joint-optimized with an acoustic encoder renders the language model from ground-truth sequences in an auto-regressive manner during training. However, the training corpus of the decoder is limited to the speech transcriptions, which is far less than the corpus needed to train an acceptable language model. This leads to poor robustness of decoder. To alleviate this problem, we propose linguistic-enhanced transformer, which introduces refined CTC information to decoder during training process, so that the decoder can be more robust. Our experiments on AISHELL-1 speech corpus show that the character error rate (CER) is relatively reduced by up to 7%. We also find that in joint CTC-Attention ASR model, decoder is more sensitive to linguistic information than acoustic information.

cs.CL↗

An Iterative Labeling Method for Annotating Fisheries Imagery

In this paper, we present a methodology for fisheries-related data that allows us to converge on a labeled image dataset by iterating over the dataset with multiple training and production loops that can exploit crowdsourcing interfaces. We present our algorithm and its results on two separate sets of image data collected using the Seabed autonomous underwater vehicle. The first dataset comprises of 2,026 completely unlabeled images, while the second consists of 21,968 images that were point annotated by experts. Our results indicate that training with a small subset and iterating on that to build a larger set of labeled data allows us to converge to a fully annotated dataset with a small number of iterations. Even in the case of a dataset labeled by experts, a single iteration of the methodology improves the labels by discovering additional complicated examples of labels associated with fish that overlap, are very small, or obscured by the contrast limitations associated with underwater imagery.

cs.LG↗

Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigm

Medical image segmentation based on deep learning is often faced with the problems of insufficient datasets and long time-consuming labeling. In this paper, we introduce the self-supervised method MAE(Masked Autoencoders) into knee joint images to provide a good initial weight for the segmentation model and improve the adaptability of the model to small datasets. Secondly, we propose a weakly supervised paradigm for meniscus segmentation based on the combination of point and line to reduce the time of labeling. Based on the weak label ,we design a region growing algorithm to generate pseudo-label. Finally we train the segmentation network based on pseudo-labels with weight transfer from self-supervision. Sufficient experimental results show that our proposed method combining self-supervision and weak supervision can almost approach the performance of purely fully supervised models while greatly reducing the required labeling time and dataset size.

cs.CV↗

Towards A COLREGs Compliant Autonomous Surface Vessel in a Constrained Channel

In this paper, we look at the role of autonomous navigation in the maritime domain. Specifically, we examine how an Autonomous Surface Vessel(ASV) can achieve obstacle avoidance based on the Convention on the International Regulations for Preventing Collisions at Sea (1972), or COLREGs, in real-world environments. Our ASV is equipped with a broadband marine radar, an Inertial Navigation System (INS), and uses official Electronic Navigational Charts (ENC). These sensors are used to provide situational awareness and, in series of well-defined steps, we can exclude land objects from the radar data, extract tracks associated with moving vessels within range of the radar, and then use a Kalman Filter to track and predict the motion of other moving vessels in the vicinity. A Constant Velocity model for the Kalman Filter allows us to solve the data association to build a consistent model between successive radar scans. We account for multiple COLREGs situations based on the predicted relative motion. Finally, an efficient path planning algorithm is presented to find a path and publish waypoints to perform real-time COLREGs compliant autonomous navigation within highly constrained environments. We demonstrate the results of our framework with operational results collected over the course of a 3.4 nautical mile mission on the Charles River in Boston in which the ASV encountered and successfully navigated multiple scenarios and encounters with other moving vessels at close quarters.

cs.RO↗

MPGDs for TPCs at future lepton colliders

This submission will focus on advancements and advantages of Micro Pattern Gas Detector (MPGD) technologies and their applications to the construction of a dedicated Time Projection Chamber (TPC) that can serve as an excellent main tracker for any multipurpose detector that can be foreseen to operate at a future lepton collider. The first portion of the report will be the executive summary. It will be followed by sections detailing the applications of MPGDs specifically to the construction of the LCTPC for the ILD at ILC, for a possible upgrade of the Belle II detector at SuperKEKB and for the design of a TPC for a detector at CEPC. MPGD technologies offer synergies with other detector R&D and several application domains; a few examples will be provided in the context of the ongoing Snowmass long range planning exercise in the USA. Links to industrial partnership and work with institutions in the USA will be highlighted when appropriate.

physics.ins-det↗

A High Spatial Resolution Muon Tomography Prototype System based on Micromegas Detector

Cosmic ray muon has strong penetrating power and no ionizing radiation hazards, which makes it an ideal probe for detecting special nuclear materials. In this paper, a high spatial resolution muon tomography system based on Micromegas detectors is proposed to optimize the imaging time and quality. The proposed system includes eight Micromegas detectors based on the thermal bonding technique and a scalable readout system. In addition, a multiplexing method based on position encoding is developed to reduce the number of electronics channels by order of magnitude. The spatial resolution of the proposed system with encoding readout can reach a value of hundred micrometers. Finally, a tomography test is performed, and test results show that this proposed system can image 2-cm objects and distinguish different materials.

physics.ins-det↗

FakeTransformer: Exposing Face Forgery From Spatial-Temporal Representation Modeled By Facial Pixel Variations

With the rapid development of generation model, AI-based face manipulation technology, which called DeepFakes, has become more and more realistic. This means of face forgery can attack any target, which poses a new threat to personal privacy and property security. Moreover, the misuse of synthetic video shows potential dangers in many areas, such as identity harassment, pornography and news rumors. Inspired by the fact that the spatial coherence and temporal consistency of physiological signal are destroyed in the generated content, we attempt to find inconsistent patterns that can distinguish between real videos and synthetic videos from the variations of facial pixels, which are highly related to physiological information. Our approach first applies Eulerian Video Magnification (EVM) at multiple Gaussian scales to the original video to enlarge the physiological variations caused by the change of facial blood volume, and then transform the original video and magnified videos into a Multi-Scale Eulerian Magnified Spatial-Temporal map (MEMSTmap), which can represent time-varying physiological enhancement sequences on different octaves. Then, these maps are reshaped into frame patches in column units and sent to the vision Transformer to learn the spatio-time descriptors of frame levels. Finally, we sort out the feature embedding and output the probability of judging whether the video is real or fake. We validate our method on the FaceForensics++ and DeepFake Detection datasets. The results show that our model achieves excellent performance in forgery detection, and also show outstanding generalization capability in cross-data domain.

cs.CV↗

Radiation-hardened and Repairable MoS$_2$ Field Effect Devices with Polymer Solid Electrolyte Gates

As human activities expand into naturally or man-made radiation-prone environment, the need for radiation-hardened (Rad-Hard) electronic hardware surged. The state-of-the-art silicon-based and two-dimensional (2D) materials based Rad-Hard transistors can withstand up to 1 Mrad (Si) of total ionization dose (TID), while higher TID tolerance is being heatedly sought after. Here we present few-layer MoS$_2$ Rad-Hard field-effect transistors (FETs) with polymer solid electrolyte (PSE) gate dielectrics. The MoS$_2$ PSE-FETs exhibit a TID tolerance of up to 3.75 Mrad (Si) at a dose rate of 523 rad (Si) s$^{-1}$ and can be repaired with a moderate thermal annealing at 100 $^{\circ}$C for 5 minutes. Combining the excellent intrinsic radiation tolerance and the reparability, the MoS$_2$ PSE-FETs reach a TID tolerance of up to 10 Mrad (Si). Complementary metal-oxide-semiconductor (CMOS)-like MoS$_2$ PSE-inverters have been built and show similar high radiation tolerance. Furthermore, the feasibility of wafer-scale Rad-Hard PSE-inverter array has been demonstrated using chemical vapor deposition (CVD) grown monolayer MoS$_2$. Our studies uncover the potential of 2D materials based PSE devices in future Rad-Hard integrated circuits (ICs).

cond-mat.mtrl-sci↗

Solar observation with the Fourier transform spectrometer I : Preliminary results of the visible and near-infrared solar spectrum

The Fourier transform spectrometer (FTS) is a core instrument for solar observation with high spectral resolution, especially in the infrared. The Infrared System for the Accurate Measurement of Solar Magnetic Field (AIMS), working at 10-13 $μm$, will use a FTS to observe the solar spectrum. The Bruker IFS-125HR, which meets the spectral resolution requirement of AIMS but just equips with a point source detector, is employed to carry out preliminary experiment for AIMS. A sun-light feeding experimental system is further developed. Several experiments are taken with them during 2018 and 2019 to observe the solar spectrum in the visible and near infrared wavelength, respectively. We also proposed an inversion method to retrieve the solar spectrum from the observed interferogram and compared it with the standard solar spectrum atlas. Although there is a wavelength limitation due to the present sun-light feeding system, the results in the wavelength band from 0.45-1.0 $μm$ and 1.0-2.2 $μm$ show a good consistence with the solar spectrum atlas, indicating the validity of our observing configuration, the data analysis method and the potential to work in longer wavelength. The work provided valuable experience for the AIMS not only for the operation of a FTS but also for the development of its scientific data processing software.

astro-ph.SR↗

A thermal bonding method for manufacturing Micromegas detectors

For manufacturing Micromegas detectors, the "bulk" method based on photoetching, was successfully developed and widely used in nuclear and particle physics experiments. However, the complexity of the method requires a considerable number of advanced instruments and processing, limiting the accessibility of this method for production of Micromegas detectors. In view of these limitations with the bulk method, a new method based on thermal bonding technique (TBM) has been developed to manufacture Micromegas detectors in a much simplified and efficient way without etching. This paper describes the TBM in detail and presents performance of the Micromegas detectors built with the TBM. The effectiveness of this method was investigated by testing Micromegas detector prototypes built with the method. Both X-rays and electron beams were used to characterize the prototypes in a gas mixture of argon and CO2 (7%). A typical energy resolution of ~16% (full width at half maximum, FWHM) and an absolute gain greater than 10^4 were obtained with 5.9 keV X-rays. Detection efficiency greater than 98% and a spatial resolution of ~65 μm were achieved using a 5 GeV electron beam at the DESY test-beam facility. The gas gain of a Micromegas detector could reach up to 10^5 with a uniformity of better than 10% when the size of the avalanche gap was optimized thanks to the flexibility of the TBM in defining the gap. Additionally, the TBM facilitates the exploration of new detector structures based on Micromegas owing to the much-simplified operation with the method.

physics.ins-det↗

Quantum Algorithm for a Convergent Series of Approximations towards the Exact Solution of the Lowest Eigenstates of a Hamiltonian

We present quantum algorithms, for Hamiltonians of linear combinations of local unitary operators, for Hamiltonian matrix-vector products and for preconditioning with the inverse of shifted reduced Hamiltonian operator that contributes to the diagonal matrix elements only. The algorithms implement a convergent series of approximations towards the exact solution of the full CI (configuration interaction) problem. The algorithm scales with O(m^5 ), with m the number of one-electron orbitals in the case of molecular electronic structure calculations. Full CI results can be obtained with a scaling of O(nm^5 ), with n the number of electrons and a prefactor on the order of 10 to 20. With low orders of Hamiltonian matrix-vector products, a whole repertoire of approximations widely used in modern electronic structure theory, including various orders of perturbation theory and/or truncated CI at different orders of excitations can be implemented for quantum computing for both routine and benchmark results at chemical accuracy. The lowest order matrix-vector product with preconditioning, basically the second-order perturbation theory, is expected to be a leading algorithm for demonstrating quantum supremacy for Ab Initio simulations, one of the most anticipated real world applications. The algorithm is also applicable for the hybrid variational quantum eigensolver.

quant-ph↗

Large-scale Transfer Learning for Low-resource Spoken Language Understanding

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a major challenge in SLU tasks due to the limitation of available data. In this paper, we propose an attention-based SLU model together with three encoder enhancement strategies to overcome data sparsity challenge. The first strategy focuses on the transferlearning approach to improve feature extraction capability of the encoder. It is implemented by pre-training the encoder component with a quantity of Automatic Speech Recognition annotated data relying on the standard Transformer architecture and then fine-tuning the SLU model with a small amount of target labelled data. The second strategy adopts multitask learning strategy, the SLU model integrates the speech recognition model by sharing the same underlying encoder, such that improving robustness and generalization ability. The third strategy, learning from Component Fusion (CF) idea, involves a Bidirectional Encoder Representation from Transformer (BERT) model and aims to boost the capability of the decoder with an auxiliary network. It hence reduces the risk of over-fitting and augments the ability of the underlying encoder, indirectly. Experiments on the FluentAI dataset show that cross-language transfer learning and multi-task strategies have been improved by up to 4:52% and 3:89% respectively, compared to the baseline.

eess.AS↗

Social Network Mediation Analysis: a Latent Space Approach

Social networks contain data on both actor attributes and social connections among them. Such connections reflect the dependence among social actors, which is important for individual's mental health and social development. To investigate the potential mediation role of a social network, we propose a mediation model with a social network as a mediator. In the model, dependence among actors is accounted by a few mutually orthogonal latent dimensions. The scores on these dimensions are directly involved in the intervention process between an independent variable and a dependent variable. Because all the latent dimensions are equivalent in terms of their relationship to social networks, it is hardly to name them. The intervening effect through an individual dimension is thus of little practical interest. Therefore, we would rather focus on the mediation effect of a network. Although the scores are not unique, we rigorously articulate that the proposed network mediation effect is still well-defined. To estimate the model, we adopt a Bayesian estimation method. This modeling framework and the Bayesian estimation method is evaluated through a simulation study under representative conditions. Its usefulness is demonstrated through an empirical application to a college friendship network.

stat.ME↗

Energy correction based on fluorescence attenuation of DAMPE

The major scientific goals of DArk Matter Particle Explorer (DAMPE) are to study cosmic-ray electrons (including positrons) and gamma rays from 5 GeV to 10 TeV and nuclei from Z = 1 to 26 up to 100 TeV. The deposited energy measured by the Bismuth Germanate Oxide (BGO) calorimeter of DAMPE is affected by fluorescence attenuation in BGO crystals that are 600 mm long. In this work, an in-orbit attenuation calibration method is reported, and energy correction of the sensitive detector unit of the BGO calorimeter is also presented.

physics.ins-det↗

Timing Performance of a Micro-Channel-Plate Photomultiplier Tube

The spatial dependence of the timing performance of the R3809U-50 Micro-Channel-Plate PMT (MCP-PMT) by Hamamatsu was studied in high energy muon beams. Particle position information is provided by a GEM tracker telescope, while timing is measured relative to a second MCP-PMT, identical in construction. In the inner part of the circular active area (radius r$<$5.5\,mm) the time resolution of the two MCP-PMTs combined is better than 10~ps. The signal amplitude decreases in the outer region due to less light reaching the photocathode, resulting in a worse time resolution. The observed radial dependence is in quantitative agreement with a dedicated simulation. With this characterization, the suitability of MCP-PMTs as $\text{t}_\text{0}$ reference detectors has been validated.

physics.ins-det↗