Searcharxiv⌕ Search

arXiv subjects

Jianhao Chen

Publications and source records attributed to Jianhao Chen.

30 records · Page 2Linked to original sources

Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Compute

This paper presents a simple, effective, and cost-efficient strategy to improve LLM performance by scaling test-time compute. Our strategy builds upon the repeated-sampling-then-voting framework, with a novel twist: incorporating multiple models, even weaker ones, to leverage their complementary strengths that potentially arise from diverse training data and paradigms. By using consistency as a signal, our strategy dynamically switches between models. Theoretical analysis highlights the efficiency and performance advantages of our strategy. Extensive experiments on six datasets demonstrate that our strategy not only outperforms self-consistency and state-of-the-art multi-agent debate approaches, but also significantly reduces inference costs. Additionally, ModelSwitch requires only a few comparable LLMs to achieve optimal performance and can be extended with verification methods, demonstrating the potential of leveraging multiple LLMs in the generation-verification paradigm.

cs.AI↗

Toxicity Detection towards Adaptability to Changing Perturbations

Toxicity detection is crucial for maintaining the peace of the society. While existing methods perform well on normal toxic contents or those generated by specific perturbation methods, they are vulnerable to evolving perturbation patterns. However, in real-world scenarios, malicious users tend to create new perturbation patterns for fooling the detectors. For example, some users may circumvent the detector of large language models (LLMs) by adding `I am a scientist' at the beginning of the prompt. In this paper, we introduce a novel problem, i.e., continual learning jailbreak perturbation patterns, into the toxicity detection field. To tackle this problem, we first construct a new dataset generated by 9 types of perturbation patterns, 7 of them are summarized from prior work and 2 of them are developed by us. We then systematically validate the vulnerability of current methods on this new perturbation pattern-aware dataset via both the zero-shot and fine tuned cross-pattern detection. Upon this, we present the domain incremental learning paradigm and the corresponding benchmark to ensure the detector's robustness to dynamically emerging types of perturbed toxic text. Our code and dataset are provided in the appendix and will be publicly available at GitHub, by which we wish to offer new research opportunities for the security-relevant communities.

cs.CR↗

Reasoning based on symbolic and parametric knowledge bases: a survey

Reasoning is fundamental to human intelligence, and critical for problem-solving, decision-making, and critical thinking. Reasoning refers to drawing new conclusions based on existing knowledge, which can support various applications like clinical diagnosis, basic education, and financial analysis. Though a good number of surveys have been proposed for reviewing reasoning-related methods, none of them has systematically investigated these methods from the viewpoint of their dependent knowledge base. Both the scenarios to which the knowledge bases are applied and their storage formats are significantly different. Hence, investigating reasoning methods from the knowledge base perspective helps us better understand the challenges and future directions. To fill this gap, this paper first classifies the knowledge base into symbolic and parametric ones. The former explicitly stores information in human-readable symbols, and the latter implicitly encodes knowledge within parameters. Then, we provide a comprehensive overview of reasoning methods using symbolic knowledge bases, parametric knowledge bases, and both of them. Finally, we identify the future direction toward enhancing reasoning capabilities to bridge the gap between human and machine intelligence.

cs.CL↗

Flat Band and Many-body Gap in Chirally Twisted Triple Bilayer Graphene

We experimentally investigate the band structures of chirally twisted triple bilayer graphene. The new kind of moiré structure, formed by three pieces of helically stacked Bernal bilayer graphene, has flat bands at charge neutral point based on the continuum approximation. We experimentally confirm the existence of flat bands and directly acquire the gap in-between flat bands as well as between the flat bands and dispersive bands from the capacitance measurements. We discover a finite gap even at zero perpendicular electric field, possibly induced by the Coulomb interaction and ferromagnetism. Our quantitative study not only provides solid evidence for the flat-band and interesting physics, but also introduces a quantitative approach to explore phenomena of similar moiré systems.

cond-mat.mes-hall↗

Timeline-based Sentence Decomposition with In-Context Learning for Temporal Fact Extraction

Facts extraction is pivotal for constructing knowledge graphs. Recently, the increasing demand for temporal facts in downstream tasks has led to the emergence of the task of temporal fact extraction. In this paper, we specifically address the extraction of temporal facts from natural language text. Previous studies fail to handle the challenge of establishing time-to-fact correspondences in complex sentences. To overcome this hurdle, we propose a timeline-based sentence decomposition strategy using large language models (LLMs) with in-context learning, ensuring a fine-grained understanding of the timeline associated with various facts. In addition, we evaluate the performance of LLMs for direct temporal fact extraction and get unsatisfactory results. To this end, we introduce TSDRE, a method that incorporates the decomposition capabilities of LLMs into the traditional fine-tuning of smaller pre-trained language models (PLMs). To support the evaluation, we construct ComplexTRED, a complex temporal fact extraction dataset. Our experiments show that TSDRE achieves state-of-the-art results on both HyperRED-Temporal and ComplexTRED datasets.

cs.CL↗

Prominent Josephson tunneling between twisted single copper oxide planes of Bi$_2$Sr$_{2-x}$LaxCuO$_{6+y}$

Josephson tunneling in twisted cuprate junctions provides a litmus test for the pairing symmetry, which is fundamental for understanding the microscopic mechanism of high temperature superconductivity. This issue is rekindled by experimental advances in van der Waals stacking and the proposal of an emergent d+id-wave. So far, all experiments have been carried out on Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ (Bi-2212) with double CuO$_2$ planes but show controversial results. Here, we investigate junctions made of Bi$_2$Sr$_{2-x}$La$_x$CuO$_{6+y}$ (Bi-2201) with single CuO$_2$ planes. Our on-site cold stacking technique ensures uncompromised crystalline quality and stoichiometry at the interface. Junctions with carefully calibrated twist angles around 45° show strong Josephson tunneling and conventional temperature dependence. Furthermore, we observe standard Fraunhofer diffraction patterns and integer Fiske steps in a junction with a twist angle of 45.0$\pm$0.2°. Together, these results pose strong constraints on the d or d+id-wave pairing and suggest an indispensable isotropic pairing component.

cond-mat.supr-con↗

PaTeCon: A Pattern-Based Temporal Constraint Mining Method for Conflict Detection on Knowledge Graphs

Temporal facts, the facts for characterizing events that hold in specific time periods, are attracting rising attention in the knowledge graph (KG) research communities. In terms of quality management, the introduction of time restrictions brings new challenges to maintaining the temporal consistency of KGs and detecting potential temporal conflicts. Previous studies rely on manually enumerated temporal constraints to detect conflicts, which are labor-intensive and may have granularity issues. We start from the common pattern of temporal facts and constraints and propose a pattern-based temporal constraint mining method, PaTeCon. PaTeCon uses automatically determined graph patterns and their relevant statistical information over the given KG instead of human experts to generate time constraints. Specifically, PaTeCon dynamically attaches class restriction to candidate constraints according to their measuring scores.We evaluate PaTeCon on two large-scale datasets based on Wikidata and Freebase respectively. The experimental results show that pattern-based automatic constraint mining is powerful in generating valuable temporal constraints.

cs.AI↗

Automatic Rule Generation for Time Expression Normalization

The understanding of time expressions includes two sub-tasks: recognition and normalization. In recent years, significant progress has been made in the recognition of time expressions while research on normalization has lagged behind. Existing SOTA normalization methods highly rely on rules or grammars designed by experts, which limits their performance on emerging corpora, such as social media texts. In this paper, we model time expression normalization as a sequence of operations to construct the normalized temporal value, and we present a novel method called ARTime, which can automatically generate normalization rules from training data without expert interventions. Specifically, ARTime automatically captures possible operation sequences from annotated data and generates normalization rules on time expressions with common surface forms. The experimental results show that ARTime can significantly surpass SOTA methods on the Tweets benchmark, and achieves competitive results with existing expert-engineered rule methods on the TempEval-3 benchmark.

cs.CL↗

Realization of graphene logics in an exciton-enhanced insulating phase

For two decades, two-dimensional carbon species, including graphene, have been the core of research in pursuing next-generation logic applications beyond the silicon technology. Yet the opening of a gap in a controllable range of doping, whilst keeping high conductance outside of this gapped state, has remained a grand challenge in them thus far. Here we show that, by bringing Bernal-stacked bilayer graphene in contact with an anti-ferromagnetic insulator CrOCl, a strong insulating behavior is observed in a wide range of positive total electron doping $n_\mathrm{tot}$ and effective displacement field $D_\mathrm{eff}$ at low temperatures. Transport measurements further prove that such an insulating phase can be well described by the picture of an inter-layer excitonic state in bilayer graphene owing to electron-hole interactions. The consequential over 1 $\mathrm{GΩ}$ excitonic insulator can be readily killed by tuning $D_\mathrm{eff}$ and/or $n_\mathrm{tot}$, and the system recovers to a high mobility graphene with a sheet resistance of less than 100 $\mathrmΩ$. It thus yields transistors with "ON-OFF" ratios reaching 10$^{7}$, and a CMOS-like graphene logic inverter is demonstrated. Our findings of the robust insulating phase in bilayer graphene may be a leap forward to fertilize the future carbon computing.

cond-mat.mes-hall↗

Gate tunable giant anisotropic resistance in ultra-thin GaTe

In crystals, the duplication of atoms often follows different periodicity along different directions. It thus gives rise to the so called anisotropy, which is usually even more pronounced in two dimensional (2D) materials due to the absence of $\textbf{z}$ dimension. Indeed, in the emerging 2D materials, electrical anisotropy has been one of the focuses in recent experimental efforts. However, key understandings of the in-plane anisotropic resistance in low-symmetry 2D materials, as well as demonstrations of model devices taking advantage of it, have proven difficult. Here, we show that, in few-layered semiconducting GaTe, electrical conductivity along $\textbf{x}$ and $\textbf{y}$ directions of the 2D crystal can be gate tuned from a ratio of less than one order to as large as 10$^{3}$. This effect is further demonstrated to yield an anisotropic memory resistor behaviour in ultra-thin GaTe, when equipped with an architecture of van der Waals floating gate. Our findings of gate tunable giant anisotropic resistance (GAR) effect pave the way for potential applications in nano-electronics such as multifunctional directional memories in the 2D limit.

cond-mat.mes-hall↗

Gate-controlled reversible rectifying behaviour in tunnel contacted atomically-thin MoS$_{2}$ transistor

Atomically-thin 2D semiconducting materials integrated into van der Waals heterostructures have enabled architectures that hold great promise for next generation nanoelectronics. However, challenges still remain to enable their full acceptance as compliant materials for integration in logic devices. Two key-components to master are the barriers at metal/semiconductor interfaces and the mobility of the semiconducting channel, which endow the building-blocks of ${pn}$ diode and field effect transistor. Here, we have devised a reverted stacking technique to intercalate a wrinkle-free h-BN tunnel layer between MoS$_{2}$ channel and contacting electrodes. Vertical tunnelling of electrons therefore makes it possible to suppress the Schottky barriers and Fermi level pinning, leading to homogeneous gate-control of the channel chemical potential across the bandgap edges. The observed unprecedented features of ambipolar ${pn}$ to ${np}$ diode, which can be reversibly gate tuned, paves the way for future logic applications and high performance switches based on atomically thin semiconducting channel.

physics.app-ph↗

High-fidelity conformation of graphene to SiO2 topographic features

Strain engineering of graphene through interaction with a patterned substrate offers the possibility of tailoring its electronic properties, but will require detailed understanding of how graphene's morphology is determined by the underlying substrate. However, previous experimental reports have drawn conflicting conclusions about the structure of graphene on SiO2. Here we show that high-resolution non-contact atomic force microscopy of SiO2 reveals roughness at the few-nm length scale unresolved in previous measurements, and scanning tunneling microscopy of graphene on SiO2 shows it to be slightly smoother than the supporting SiO2 substrate. Quantitative analysis of the competition between bending rigidity of the graphene and adhesion to the substrate explains the observed roughness of monolayer graphene on SiO2 as extrinsic, and provides a natural, intuitive description in terms of highly conformal adhesion. The analysis indicates that graphene adopts the conformation of the underlying substrate down to the smallest features with nearly 99% fidelity.

cond-mat.mes-hall↗