SearcharxivSearch

arXiv subjects

Fei Ren

Publications and source records attributed to Fei Ren.

At least 19 recordsLinked to original sources

Frobenius--Cartier duality via lax equalizers

We prove a duality theorem for lax equalizers of stable $\infty$-categories, and we apply it to Frobenius and Cartier modules on a Noetherian $F$-finite scheme $X$ of characteristic $p$ with a unit dualizing complex. When $X$ has affine diagonal, comparison with the derived categories of coherent modules and passage to homotopy categories recovers Baudin's derived Hom duality. The duality of coherent modules exchanges the standard $t$-structure on one side with the perverse $t$-structure determined by the dualizing complex on the other. In particular, it identifies the abelian category of coherent Cartier modules with a perverse heart of coherent Frobenius modules, and conversely.

math.AG

The effect of investor-driven information diffusion on excess comovement: Evidence from retail and institutional investors in China and the United States

This study investigates how cross-stock information diffusion, driven by both retail and institutional investors, influences excess comovement in the Chinese retail-dominated market and the U.S. institution-dominated market. Using data from 4,533 Chinese stocks and 4,517 U.S. stocks from 2010 to 2022, we identify three key findings. First, the dominant investor group in each market significantly drives excess comovement. Specifically, in China, compared with institution-driven diffusion, retail-driven information diffusion has a notably stronger effect on excess comovement. In contrast, in the U.S., institution-driven diffusion is the primary driver of excess comovement, surpassing the influence of retail-driven diffusion. Second, we identify investors' trading behavior as the underlying mechanism through which information diffusion affects excess comovement. Third, we observe a lead-lag relationship: stocks with faster retail-driven information diffusion exhibit comovement that precedes those with slower diffusion. Based on this finding, we further demonstrate that the predictive power of information diffusion varies across markets. In China, retail-driven diffusion shows strong and persistent predictability for excess comovement, whereas in the U.S., institution-driven diffusion exhibits similarly robust predictive capacity.

q-fin.GN

Corporate transparency and the disposition effect

The disposition effect describes investors' irrational behavior of selling profitable assets too soon while holding onto losing assets for too long. This study examines the impact of transparency at the firm level on the disposition effect of individual investors who hold that company's stock. Our results show that an increase in corporate transparency significantly reduces the disposition effect. Further analysis reveals that for companies with greater transparency, when the held stock is profitable, investors' confidence in holding it increases, leading to a reduced bias toward selling profitable stocks. When the stock is held at a loss, investors' confidence in holding it weakens, but they often perceive the loss as temporary and maintain confidence in the company's long-term prospects, thus exacerbating the bias toward holding losing stocks. The effect of increased transparency on the selling behavior of profitable stocks is greater than its effect on the selling behavior of losing stocks. Overall, an increase in corporate transparency significantly reduces the disposition effect.

q-fin.GN

Does social media information affect individual investor disposition effect? Evidence from Xueqiu

The irrational behavior of investors selling profitable assets too early while holding onto losing assets for too long is known as the disposition effect. Due to the development of the Internet, the information environment for individual investors has been greatly improved. As an important source of information for individual investors, whether social media can improve investors' behavioral biases and return to rational expectations is a question worth studying. Based on the post data and actual trading data of the social investment platform Xueqiu.com, this paper studies the impact of social media information on the disposition effect of individual investors. The research results show that social media information can significantly reduce the disposition effect. Furthermore, it is through negative information that social media information reduces the disposition effect. When presented with negative information, individual investors will gradually become more rational in adjusting their positions. At the individual level, factors such as investment experience, users followed, region, and gender can all influence the effectiveness of the information acquired by individual investors in reducing the disposition effect.

q-fin.GN

ES-dLLM: Efficient Inference for Diffusion Large Language Models by Early-Skipping

Diffusion large language models (dLLMs) are emerging as a promising alternative to autoregressive models (ARMs) due to their ability to capture bidirectional context and the potential for parallel generation. Despite the advantages, dLLM inference remains computationally expensive as the full input context is processed at every iteration. In this work, we analyze the generation dynamics of dLLMs and find that intermediate representations, including key, value, and hidden states, change only subtly across successive iterations. Leveraging this insight, we propose \textbf{ES-dLLM}, a training-free inference acceleration framework for dLLM that reduces computation by skipping tokens in early layers based on the estimated importance. Token importance is computed with intermediate tensor variation and confidence scores of previous iterations. Experiments on LLaDA-8B and Dream-7B demonstrate that ES-dLLM achieves throughput of up to 226.57 and 308.51 tokens per second (TPS), respectively, on an NVIDIA H200 GPU, delivering 5.6$\times$ to 16.8$\times$ speedup over the vanilla implementation and up to 1.85$\times$ over the state-of-the-art caching method, while preserving generation quality.

cs.LG

Structure theorems for the heart of LCA

Cohomology theories with values in LCA (locally compact abelian) groups suffer from the problem that the latter do not form an abelian category. However, the category LCA has a canonical abelian category envelope, the heart of a suitable t-structure. It adds formal cokernel objects. We show the surprising result that these abstract cokernels can also be interpreted as Hausdorff topological abelian groups, at least up to lattice isogenies. These need not be locally compact.

math.CT

Physics-Informed Extreme Learning Machine (PIELM): Opportunities and Challenges

We are delighted to see the recent development of physics-informed extreme learning machine (PIELM) for its higher computational efficiency and accuracy compared to other physics-informed machine learning (PIML) paradigms. Since a comprehensive summary or review of PIELM is currently unavailable, we would like to take this opportunity to share our perspectives and experiences on this promising research direction. We can see that many efforts have been made to solve ordinary/partial differential equations (ODEs/PDEs) characterized by sharp gradients, nonlinearities, high-frequency behavior, hard constraints, uncertainty, multiphysics coupling, and interpretability. Despite these encouraging successes, many pressing challenges remain to be tackled, which also provides opportunities to develop more robust, interpretable, and generalizable PIELM frameworks for scientific and engineering applications.

cs.LG

A Rapid Physics-Informed Machine Learning Framework Based on Extreme Learning Machine for Inverse Stefan Problems

The inverse Stefan problem, as a typical phase-change problem with moving boundaries, finds extensive applications in science and engineering. Recent years have seen the applications of physics-informed neural networks (PINNs) to solving Stefan problems, yet they still exhibit shortcomings in hyperparameter dependency, training efficiency, and prediction accuracy. To address this, this paper develops a physics-informed extreme learning machine (PIELM), a rapid physics-informed learning method framework for inverse Stefan problems. PIELM replaces conventional deep neural networks with an extreme learning machine network. The input weights are fixed in the PIELM framework, and the output weights are determined by optimizing a loss vector of physical laws composed by initial and boundary conditions and governing partial differential equations (PDEs). Then, solving inverse Stefan problems is transformed into finding the Moore-Penrose generalized inverse by the least squares method. Case studies show that the PIELM can increase the prediction accuracy by 3-7 order of magnitude in terms of the relative L2 error, and meanwhile saving more than 94% training time, compared to conventional PINNs.

cs.LG

General Fourier Feature Physics-Informed Extreme Learning Machine (GFF-PIELM) for High-Frequency PDEs

Conventional physics-informed extreme learning machine (PIELM) often faces challenges in solving partial differential equations (PDEs) involving high-frequency and variable-frequency behaviors. To address these challenges, we propose a general Fourier feature physics-informed extreme learning machine (GFF-PIELM). We demonstrate that directly concatenating multiple Fourier feature mappings (FFMs) and an extreme learning machine (ELM) network makes it difficult to determine frequency-related hyperparameters. Fortunately, we find an alternative to establish the GFF-PIELM in three main steps. First, we integrate a variation of FFM into ELM as the Fourier-based activation function, so there is still one hidden layer in the GFF-PIELM framework. Second, we assign a set of frequency coefficients to the hidden neurons, which enables ELM network to capture diverse frequency components of target solutions. Finally, we develop an innovative, straightforward initialization method for these hyperparameters by monitoring the distribution of ELM output weights. GFF-PIELM not only retains the high accuracy, efficiency, and simplicity of the PIELM framework but also inherits the ability of FFMs to effectively handle high-frequency problems. We carry out five case studies with a total of ten numerical examples to highlight the feasibility and validity of the proposed GFF-PIELM, involving high frequency, variable frequency, multi-scale behaviour, irregular boundary and inverse problems. Compared to conventional PIELM, the GFF-PIELM approach significantly improves predictive accuracy without additional cost in training time and architecture complexity. Our results confirm that that PIELM can be extended to solve high-frequency and variable-frequency PDEs with high accuracy, and our initialization strategy may further inspire advances in other physics-informed machine learning (PIML) frameworks.

cs.LG

Physics-Informed Extreme Learning Machine (PIELM) for Tunnelling-Induced Soil-Pile Interactions

Physics-informed machine learning has been a promising data-driven and physics-informed approach in geotechnical engineering. This study proposes a physics-informed extreme learning machine (PIELM) framework for analyzing tunneling-induced soil-pile interactions. The pile foundation is modeled as an Euler-Bernoulli beam, and the surrounding soil is modeled as a Pasternak foundation. The soil-pile interaction is formulated into a fourth-order ordinary differential equation (ODE) that constitutes the physics-informed component, while measured data are incorporated into PIELM as the data-driven component. Combining physics and data yields a loss vector of the extreme learning machine (ELM) network, which is trained within 1 second by the least squares method. After validating the PIELM approach by the boundary element method (BEM) and finite difference method (FDM), parametric studies are carried out to examine the effects of ELM network architecture, data monitoring locations and numbers on the performance of PIELM. The results indicate that monitored data should be placed at positions where the gradients of pile deflections are significant, such as at the pile tip/top and near tunneling zones. Two application examples highlight the critical role of physics-informed and data-driven approach for tunnelling-induced soil-pile interactions. The proposed approach shows great potential for real-time monitoring and safety assessment of pile foundations, and benefits for intelligent early-warning systems in geotechnical engineering.

cs.LG

SpeCa: Accelerating Diffusion Transformers with Speculative Feature Caching

Diffusion models have revolutionized high-fidelity image and video synthesis, yet their computational demands remain prohibitive for real-time applications. These models face two fundamental challenges: strict temporal dependencies preventing parallelization, and computationally intensive forward passes required at each denoising step. Drawing inspiration from speculative decoding in large language models, we present SpeCa, a novel 'Forecast-then-verify' acceleration framework that effectively addresses both limitations. SpeCa's core innovation lies in introducing Speculative Sampling to diffusion models, predicting intermediate features for subsequent timesteps based on fully computed reference timesteps. Our approach implements a parameter-free verification mechanism that efficiently evaluates prediction reliability, enabling real-time decisions to accept or reject each prediction while incurring negligible computational overhead. Furthermore, SpeCa introduces sample-adaptive computation allocation that dynamically modulates resources based on generation complexity, allocating reduced computation for simpler samples while preserving intensive processing for complex instances. Experiments demonstrate 6.34x acceleration on FLUX with minimal quality degradation (5.5% drop), 7.3x speedup on DiT while preserving generation fidelity, and 79.84% VBench score at 6.1x acceleration for HunyuanVideo. The verification mechanism incurs minimal overhead (1.67%-3.5% of full inference costs), establishing a new paradigm for efficient diffusion model inference while maintaining generation quality even at aggressive acceleration ratios. Our codes have been released in Github: \textbf{https://github.com/Shenyi-Z/Cache4Diffusion}

cs.LG

Coherent six-functor formalisms: Pro vs Solid

In the classical theory for coherent sheaves, the only missing piece in the Grothendieck six-functor formalism picture is $j_!$ for an open immersion $j$. Towards fixing this gap, Deligne proposed a construction of $j_!$ by extending the sheaf class to pro sheaves, while Clausen-Scholze provided another solution by extending the sheaf class to solid modules. In this work, we prove that Deligne's construction coincides with the Clausen-Scholze construction via a natural functor, whose restriction to the full subcategory of Mittag-Leffler pro-systems is fully faithful.

math.AG

Physics-informed extreme learning machine for Terzaghi consolidation problems and interpretation of coefficient of consolidation based on CPTu data

This paper conducts a preliminary study to investigate the feasibility of a physics-informed extreme learning machine (PIELM) for solving the Terzaghi consolidation equation and interpreting the coefficient of consolidation of soil from piezocone penetration tests (CPTu). In the PIELM framework, the target solution is approximated by a single-layer feed-forward extreme learning machine (ELM) network, instead of the deep neural networks typically employed in physics-informed neural networks (PINNs). Physical laws and measured data are integrated into a loss vector, which is minimized via least squares methods during ELM training. As a result, training efficiency is significantly improved by avoiding the gradient-descent optimisation commonly used in PINNs. The performance of PIELM is evaluated using three forward-problem case studies. Notably, a time-stepping strategy is incorporated into the PIELM framework to alleviate sharp gradients caused by inconsistent initial and boundary conditions. This paper further applies PIELM to estimate the soil consolidation coefficient, given that initial distributions of excess water pressure are often unavailable in CPTu dissipation tests (conducted following the pauses of penetration). By combining physical laws (excluding initial conditions) with measured data (i.e., excess pore-water pressure at the probe surface), the results demonstrate that PIELM is an effective tool for interpreting CPTu dissipation tests, owing to its ability to fuse data with physical constraints. This study contributes to the interpretation of consolidation coefficients from CPTu dissipation tests, particularly in scenarios where initial distributions of excess water pressure are not prior-known.

physics.geo-ph

Structure theorem for log de Rham-Witt sheaves with vanishing

We prove an elegant structure theorem for log de Rham-Witt sheaves with vanishing along an effective Cartier divisor $D$ defined in arXiv:2403.18763, answering a question of Shuji Saito during the Mainz conference and a question of Yigeng Zhao during a short visit of the author last summer. Our structural result for the log forms also lays the foundation for the study of Milnor $K$-theory with vanishing along $D$ in the paper to come.

math.AG

IoT-Based 3D Pose Estimation and Motion Optimization for Athletes: Application of C3D and OpenPose

This study proposes the IoT-Enhanced Pose Optimization Network (IE-PONet) for high-precision 3D pose estimation and motion optimization of track and field athletes. IE-PONet integrates C3D for spatiotemporal feature extraction, OpenPose for real-time keypoint detection, and Bayesian optimization for hyperparameter tuning. Experimental results on NTURGB+D and FineGYM datasets demonstrate superior performance, with AP\(^p50\) scores of 90.5 and 91.0, and mAP scores of 74.3 and 74.0, respectively. Ablation studies confirm the essential roles of each module in enhancing model accuracy. IE-PONet provides a robust tool for athletic performance analysis and optimization, offering precise technical insights for training and injury prevention. Future work will focus on further model optimization, multimodal data integration, and developing real-time feedback mechanisms to enhance practical applications.

cs.CV

DELIA: Diversity-Enhanced Learning for Instruction Adaptation in Large Language Models

Although instruction tuning is widely used to adjust behavior in Large Language Models (LLMs), extensive empirical evidence and research indicates that it is primarily a process where the model fits to specific task formats, rather than acquiring new knowledge or capabilities. We propose that this limitation stems from biased features learned during instruction tuning, which differ from ideal task-specfic features, leading to learn less underlying semantics in downstream tasks. However, ideal features are unknown and incalculable, constraining past work to rely on prior knowledge to assist reasoning or training, which limits LLMs' capabilities to the developers' abilities, rather than data-driven scalable learning. In our paper, through our novel data synthesis method, DELIA (Diversity-Enhanced Learning for Instruction Adaptation), we leverage the buffering effect of extensive diverse data in LLMs training to transform biased features in instruction tuning into approximations of ideal features, without explicit prior ideal features. Experiments show DELIA's better performance compared to common instruction tuning and other baselines. It outperforms common instruction tuning by 17.07%-33.41% on Icelandic-English translation bleurt score (WMT-21 dataset, gemma-7b-it) and improves accuracy by 36.1% on formatted text generation (Llama2-7b-chat). Notably, among knowledge injection methods we've known, DELIA uniquely align the internal representations of new special tokens with their prior semantics.

cs.AI

Additive cycle complex and coherent duality

Let $k$ be a field of positive characteristic $p$, and $X$ be a separated of finite type $k$-scheme of dimension $d$. We construct a cycle map from the additive cycle complex to the residual complex of Serre-Grothendieck coherent duality theory. This map is compatible with a cubical version of the map constructed in [Ren23] arXiv:2104.09662 when $k$ is perfect. As a corollary, we get injectivity statements for (additive) higher Chow groups as well as for motivic cohomology (with modulus) with $\mathbb{Z}/p$ coefficients when $k$ is algebraically closed.

math.AG

Duality for Hodge-Witt cohomology with modulus

Given an effective Cartier divisor D with simple normal crossing support on a smooth and proper scheme X over a perfect field of positive characteristic p, there is a natural notion of de Rham-Witt sheaves on X with zeros along D. We show that these sheaves correspond under Grothendieck duality for coherent sheaves to de Rham-Witt sheaves on X with modulus (X,D), as defined in the theory of cube invariant modulus sheaves with transfers developed by Kahn-Miyazaki-Saito-Yamazaki. From this we deduce refined versions of Ekedahl - and Poincar\'e duality for crystalline cohomology generalizing results of Mokrane and Nakkajima for reduced D, and a modulus version of Milne-Kato duality for \'etale motivic cohomology with p-primary torsion coefficients, which refines a result of Jannsen-Saito-Zhao. We furthermore get new integral models for rigid cohomology with compact supports on the complement of D and a modulus version of Milne's perfect Brauer group pairing for smooth projective surfaces over finite fields.

math.AG