SearcharxivSearch

arXiv subjects

Shaokang Yang

Publications and source records attributed to Shaokang Yang.

6 recordsLinked to original sources

Residual Decoding: Mitigating Hallucinations in Large Vision-Language Models via History-Aware Residual Guidance

Large Vision-Language Models (LVLMs) can reason from image-text inputs and perform well in various multimodal tasks. Despite this success, they are affected by language priors and often produce hallucinations. Hallucinations denote generated content that is grammatically and syntactically coherent, yet bears no match or direct relevance to visual input. To address this problem, we propose Residual Decoding (ResDec). It is a novel training-free method that uses historical information to aid decoding. The method relies on the internal implicit reasoning mechanism and token logits evolution mechanism of LVLMs to correct biases. Extensive experiments demonstrate that ResDec effectively suppresses hallucinations induced by language priors, significantly improves visual grounding, and reduces object hallucinations. In addition to mitigating hallucinations, ResDec also performs exceptionally well on comprehensive LVLM benchmarks, highlighting its broad applicability.

cs.CV

Inhomogeneous plane waves in attenuative anisotropic porous media

We investigate the propagation of inhomogeneous plane waves in poro-viscoelastic media, explicitly incorporating both velocity and attenuation anisotropy. Starting from classical Biot theory, we present a fractional differential equation describing wave propagation in attenuative anisotropic porous media that accommodates arbitrary anisotropy in both velocity and attenuation. Then, instead of relying on the traditional complex wave vector approach, we derive new Christoffel and energy balance equations for general inhomogeneous waves by employing an alternative formulation based on the complex slowness vector. The phase velocities and complex slownesses of inhomogeneous fast and slow quasi-compressional (qP1 and qP2) and quasi-shear (qS1 and qS2) waves are determined by solving an eighth-degree algebraic equation. By invoking the derived energy balance equation along with the computed complex slowness, we present explicit and concise expressions for energy velocities. Additionally, we analyze dissipation factors defined by two alternative measures: the ratio of average dissipated energy density to either average strain energy density or average stored energy density. We clarify and discuss the implications of these definitional differences in the context of general poro-viscoelastic anisotropic media. Finally, our expressions are degenerated to give their counterparts of the homogeneous waves as a special case, and the reduced forms are identical to those presented by the existing poro-viscoelastic theory. Several examples are provided to illustrate the propagation characteristics of inhomogeneous plane waves in unbounded attenuative vertical transversely isotropic porous media.

physics.geo-ph

Defining the relationship between cathepsin B and esophageal adenocarcinoma: conjoint analysis of Mendelian randomization, transcriptome-wide association studies, and single-cell RNA sequencing data

Background: Esophageal cancer poses a significant global health challenge, with the incidence of esophageal adenocarcinoma (EAC), a predominant subtype, increasing notably in Western countries. Cathepsins, a family of lysosomal proteolytic enzymes, have been implicated in the progression of various tumors. However, the causal relationship between the cathepsin family and EAC remains unresolved. Methods: To evaluate these potential causal associations, integrative analyses were conducted, integrating Mendelian randomization (MR), transcriptome-wide association study (TWAS), single-cell RNA sequencing (scRNA-seq), and single-cell expression quantitative trait locus (sc-eQTL) analyses. Results: Univariable and multivariable MR analyses demonstrated that elevated levels of cathepsin B (CTSB) were associated with a reduced risk of EAC. The TWAS analysis identified a negative association between CTSB expression in esophageal tissue and EAC, consistent with experimental validation using immunohistochemistry. The scRNA-seq data analysis indicated that CTSB expression was predominantly localized in macrophages infiltrating EAC. Colocalization analysis incorporating sc-eQTL data specific to macrophages confirmed a shared causal variant between CTSB and macrophages. Additionally, MR analysis of CTSB and macrophage scavenger receptor (MSR) types I and II established their interrelationship, suggesting that CTSB may influence the proinflammatory phenotype of macrophages, ultimately affecting EAC risk. Conclusions: This integrative analysis, utilizing MR, TWAS, scRNA-seq, and sc-eQTL data, identified a significant causal association between CTSB and EAC, potentially mediated through macrophage MSR regulation. These findings suggest that targeting cathepsin B could represent a novel strategy for the diagnosis and treatment of EAC.

q-bio.TO

PartImageNet: A Large, High-Quality Dataset of Parts

It is natural to represent objects in terms of their parts. This has the potential to improve the performance of algorithms for object recognition and segmentation but can also help for downstream tasks like activity recognition. Research on part-based models, however, is hindered by the lack of datasets with per-pixel part annotations. This is partly due to the difficulty and high cost of annotating object parts so it has rarely been done except for humans (where there exists a big literature on part-based models). To help address this problem, we propose PartImageNet, a large, high-quality dataset with part segmentation annotations. It consists of $158$ classes from ImageNet with approximately $24,000$ images. PartImageNet is unique because it offers part-level annotations on a general set of classes including non-rigid, articulated objects, while having an order of magnitude larger size compared to existing part datasets (excluding datasets of humans). It can be utilized for many vision tasks including Object Segmentation, Semantic Part Segmentation, Few-shot Learning and Part Discovery. We conduct comprehensive experiments which study these tasks and set up a set of baselines. The dataset and scripts are released at https://github.com/TACJu/PartImageNet.

cs.CV

Rethinking Re-Sampling in Imbalanced Semi-Supervised Learning

Semi-Supervised Learning (SSL) has shown its strong ability in utilizing unlabeled data when labeled data is scarce. However, most SSL algorithms work under the assumption that the class distributions are balanced in both training and test sets. In this work, we consider the problem of SSL on class-imbalanced data, which better reflects real-world situations. In particular, we decouple the training of the representation and the classifier, and systematically investigate the effects of different data re-sampling techniques when training the whole network including a classifier as well as fine-tuning the feature extractor only. We find that data re-sampling is of critical importance to learn a good classifier as it increases the accuracy of the pseudo-labels, in particular for the minority classes in the unlabeled data. Interestingly, we find that accurate pseudo-labels do not help when training the feature extractor, rather contrariwise, data re-sampling harms the training of the feature extractor. This finding is against the general intuition that wrong pseudo-labels always harm the model performance in SSL. Based on these findings, we suggest to re-think the current paradigm of having a single data re-sampling strategy and develop a simple yet highly effective Bi-Sampling (BiS) strategy for SSL on class-imbalanced data. BiS implements two different re-sampling strategies for training the feature extractor and the classifier and integrates this decoupled training into an end-to-end framework. In particular, BiS progressively changes the data distribution during training such that in the beginning the feature extractor is trained effectively, while towards the end of the training the data is re-balanced such that the classifier is trained reliably. We benchmark our proposed bi-sampling strategy extensively on popular datasets and achieve state-of-the-art performances.

cs.CV

Re-rank Coarse Classification with Local Region Enhanced Features for Fine-Grained Image Recognition

Fine-grained image recognition is very challenging due to the difficulty of capturing both semantic global features and discriminative local features. Meanwhile, these two features are not easy to be integrated, which are even conflicting when used simultaneously. In this paper, a retrieval-based coarse-to-fine framework is proposed, where we re-rank the TopN classification results by using the local region enhanced embedding features to improve the Top1 accuracy (based on the observation that the correct category usually resides in TopN results). To obtain the discriminative regions for distinguishing the fine-grained images, we introduce a weakly-supervised method to train a box generating branch with only image-level labels. In addition, to learn more effective semantic global features, we design a multi-level loss over an automatically constructed hierarchical category structure. Experimental results show that our method achieves state-of-the-art performance on three benchmarks: CUB-200-2011, Stanford Cars, and FGVC Aircraft. Also, visualizations and analysis are provided for better understanding.

cs.CV