arXiv subjects

Hongbin Sun

Publications and source records attributed to Hongbin Sun.

At least 55 records · Page 3Linked to original sources

arXiv2023

Smart Meters Integration in Distribution System State Estimation with Collaborative Filtering and Deep Gaussian Process

The problem of state estimations for electric distribution system is considered. A collaborative filtering approach is proposed in this paper to integrate the slow time-scale smart meter measurements in the distribution system state estimation, in which the deep Gaussian process is incorporated to infer the fast time-scale pseudo measurements and avoid anomalies. Numerical tests have demonstrated the higher estimation accuracy of the proposed method.

eess.SY↗

arXiv2023

Short-Term Voltage Security Constrained UC to Prevent Trip Faults in High Wind Power Penetrated Power Systems

For high wind power-penetrated power systems, the multiple renewable energy station short-circuit ratio (MRSCR) is often insufficient due to weak grid structures. Additionally, transient voltage sag/overvoltage issues may cause trip faults of wind turbines (WTs). Due to the time delay in WTs' controllers, it is difficult for WTs alone to meet the reactive power demands in different stages of the transient process. Some synchronous machines (SMs) must be retained through unit commitment (UC) scheduling to improve MRSCR and prevent trip faults of WTs. The MRSCR and short-term voltage security constrained-UC model is a mixed integer nonlinear programming (MINLP) problem with differential algebraic equations (DAEs) and symbolic matrix inversion, which is intractable to solve. Based on the dynamic characteristics of different devices, the original model is simplified as a general MINLP model without DAEs. Then, generalized Benders decomposition is applied to improve the solution efficiency. The relaxed MRSCR constraints are formulated in the master problem to improve the convergence, and the precise MRSCR constraints are formulated in the subproblems to consider the impact of voltage profiles. Case studies based on several benchmark systems and a provincial power grid verify the validity and efficiency of the proposed method

eess.SY↗

arXiv2023

Encoding Carbon Emission Flow in Energy Management: A Compact Constraint Learning Approach

Decarbonizing the energy supply is essential and urgent to mitigate the increasingly visible climate change. Its basis is identifying emission responsibility during power allocation by the carbon emission flow (CEF) model. However, the main challenge of CEF application is the intractable nonlinear relationship between carbon emission and power allocation. So this paper leverages the high approximation capability and the mixed-integer linear programming (MILP) representability of the deep neural networks to tackle the complex CEF model in carbon-electricity coordinated optimization. The compact constraint learning approach is proposed to learn the mapping from power injection to bus emission with sparse neural networks (SNNs). Then the trained SNNs are transformed equivalently as MILP constraints in the downstream optimization. In light of the ``high emission with high price'' principle, the blocked carbon price mechanism is designed to price emissions from the demand side. Based on the constraint learning and mechanism design, this paper proposes the carbon-aware energy management model in the tractable MILP form to unlock the carbon reduction potential from the demand side. The case study verifies the approximation accuracy and sparsity of SNN with fewer parameters for accelerating optimization solution and reduction effectiveness of demand-side capability for mitigating emission.

eess.SY↗

arXiv2023

Maps from 3-manifolds to 4-manifolds that induce isomorphisms on $π_1$

In this paper, we prove that any closed orientable 3-manifold $M$ other than $\#^k S^1\times S^2$ and $S^3$ satisfies the following properties: (1) For any compact orientable 4-manifold $N$ bounded by $M$, the inclusion does not induce an isomorphism on their fundamental groups $π_1$. (2) For any map $f:M\to N$ from $M$ to a closed orientable 4-manifold $N$, $f$ does not induce an isomorphism on $π_1$. Relevant results on higher dimensional manifolds are also obtained.

math.GT↗

arXiv2023

Electricity Price Prediction for Energy Storage System Arbitrage: A Decision-focused Approach

Electricity price prediction plays a vital role in energy storage system (ESS) management. Current prediction models focus on reducing prediction errors but overlook their impact on downstream decision-making. So this paper proposes a decision-focused electricity price prediction approach for ESS arbitrage to bridge the gap from the downstream optimization model to the prediction model. The decision-focused approach aims at utilizing the downstream arbitrage model for training prediction models. It measures the difference between actual decisions under the predicted price and oracle decisions under the true price, i.e., decision error, by regret, transforms it into the tractable surrogate regret, and then derives the gradients to predicted price for training prediction models. Based on the prediction and decision errors, this paper proposes the hybrid loss and corresponding stochastic gradient descent learning method to learn prediction models for prediction and decision accuracy. The case study verifies that the proposed approach can efficiently bring more economic benefits and reduce decision errors by flattening the time distribution of prediction errors, compared to prediction models for only minimizing prediction errors.

cs.LG↗

arXiv2023

Conservative Sparse Neural Network Embedded Frequency-Constrained Unit Commitment With Distributed Energy Resources

The increasing penetration of distributed energy resources (DERs) will decrease the rotational inertia of the power system and further degrade the system frequency stability. To address the above issues, this paper leverages the advanced neural network (NN) to learn the frequency dynamics and incorporates NN to facilitate system reliable operation. This paper proposes the conservative sparse neural network (CSNN) embedded frequency-constrained unit commitment (FCUC) with converter-based DERs, including the learning and optimization stages. In the learning stage, it samples the inertia parameters, calculates the corresponding frequency, and characterizes the stability region of the sampled parameters using the convex hulls to ensure stability and avoid extrapolation. For conservativeness, the positive prediction error penalty is added to the loss function to prevent possible frequency requirement violation. For the sparsity, the NN topology pruning is employed to eliminate unnecessary connections for solving acceleration. In the optimization stage, the trained CSNN is transformed into mixed-integer linear constraints using the big-M method and then incorporated to establish the data-enhanced model. The case study verifies 1) the effectiveness of the proposed model in terms of high accuracy, fewer parameters, and significant solving acceleration; 2) the stable system operation against frequency violation under contingency.

eess.SY↗

arXiv2023

Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond

Recently, fine-tuning pre-trained code models such as CodeBERT on downstream tasks has achieved great success in many software testing and analysis tasks. While effective and prevalent, fine-tuning the pre-trained parameters incurs a large computational cost. In this paper, we conduct an extensive experimental study to explore what happens to layer-wise pre-trained representations and their encoded code knowledge during fine-tuning. We then propose efficient alternatives to fine-tune the large pre-trained code model based on the above findings. Our experimental study shows that (1) lexical, syntactic and structural properties of source code are encoded in the lower, intermediate, and higher layers, respectively, while the semantic property spans across the entire model. (2) The process of fine-tuning preserves most of the code properties. Specifically, the basic code properties captured by lower and intermediate layers are still preserved during fine-tuning. Furthermore, we find that only the representations of the top two layers change most during fine-tuning for various downstream tasks. (3) Based on the above findings, we propose Telly to efficiently fine-tune pre-trained code models via layer freezing. The extensive experimental results on five various downstream tasks demonstrate that training parameters and the corresponding time cost are greatly reduced, while performances are similar or better. Replication package including source code, datasets, and online Appendix is available at: \url{https://github.com/DeepSoftwareAnalytics/Telly}.

cs.SE↗

arXiv2023

DBQ-SSD: Dynamic Ball Query for Efficient 3D Object Detection

Many point-based 3D detectors adopt point-feature sampling strategies to drop some points for efficient inference. These strategies are typically based on fixed and handcrafted rules, making it difficult to handle complicated scenes. Different from them, we propose a Dynamic Ball Query (DBQ) network to adaptively select a subset of input points according to the input features, and assign the feature transform with a suitable receptive field for each selected point. It can be embedded into some state-of-the-art 3D detectors and trained in an end-to-end manner, which significantly reduces the computational cost. Extensive experiments demonstrate that our method can increase the inference speed by 30%-100% on KITTI, Waymo, and ONCE datasets. Specifically, the inference speed of our detector can reach 162 FPS on KITTI scene, and 30 FPS on Waymo and ONCE scenes without performance degradation. Due to skipping the redundant points, some evaluation metrics show significant improvements. Codes will be released at https://github.com/yancie-yjr/DBQ-SSD.

cs.CV↗

arXiv2023

Optimal scheduling of park-level integrated energy system considering ladder-type carbon trading mechanism and flexible load

In an attempt to improve the utilization efficiency of multi-energy coupling in park-level integrated energy system (PIES), promote wind power consumption and reduce carbon emissions, a low-carbon economic operation optimization model of PIES integrating flexible load and carbon trading mechanism is constructed. Firstly, according to the characteristics of load response, the demand response is divided into four types: which can be shifted, transferred, reduced and replaced. Secondly, the PIES basic architecture is given by considering the combined heat and power generation coupling equipment, new energy and flexible load in the park. Finally, introducing the ladder-type carbon trading mechanism into the system and minimize the total operating cost, the low-carbon economic operation optimization model of PIES is established. The YALMIP toolbox and CPLEX solver are used to solve the example, the simulation results show that the participation of electrical and thermal coupled scheduling and flexible electric or thermal loads can significantly reduce the system operating cost, reduce the load peak-to-valley difference and relieve peak power consumption pressure.

eess.SY↗

arXiv2023

CoCoSoDa: Effective Contrastive Learning for Code Search

Code search aims to retrieve semantically relevant code snippets for a given natural language query. Recently, many approaches employing contrastive learning have shown promising results on code representation learning and greatly improved the performance of code search. However, there is still a lot of room for improvement in using contrastive learning for code search. In this paper, we propose CoCoSoDa to effectively utilize contrastive learning for code search via two key factors in contrastive learning: data augmentation and negative samples. Specifically, soft data augmentation is to dynamically masking or replacing some tokens with their types for input sequences to generate positive samples. Momentum mechanism is used to generate large and consistent representations of negative samples in a mini-batch through maintaining a queue and a momentum encoder. In addition, multimodal contrastive learning is used to pull together representations of code-query pairs and push apart the unpaired code snippets and queries. We conduct extensive experiments to evaluate the effectiveness of our approach on a large-scale dataset with six programming languages. Experimental results show that: (1) CoCoSoDa outperforms 14 baselines and especially exceeds CodeBERT, GraphCodeBERT, and UniXcoder by 13.3%, 10.5%, and 5.9% on average MRR scores, respectively. (2) The ablation studies show the effectiveness of each component of our approach. (3) We adapt our techniques to several different pre-trained models such as RoBERTa, CodeBERT, and GraphCodeBERT and observe a significant boost in their performance in code search. (4) Our model performs robustly under different hyper-parameters. Furthermore, we perform qualitative and quantitative analyses to explore reasons behind the good performance of our model.

cs.SE↗

arXiv2023

Dynamic Grained Encoder for Vision Transformers

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the intrinsic spatial redundancy of natural images and save computational costs. Specifically, we propose a Dynamic Grained Encoder for vision transformers, which can adaptively assign a suitable number of queries to each spatial region. Thus it achieves a fine-grained representation in discriminative regions while keeping high efficiency. Besides, the dynamic grained encoder is compatible with most vision transformer frameworks. Without bells and whistles, our encoder allows the state-of-the-art vision transformers to reduce computational complexity by 40%-60% while maintaining comparable performance on image classification. Extensive experiments on object detection and segmentation further demonstrate the generalizability of our approach. Code is available at https://github.com/StevenGrove/vtpack.

cs.CV↗

arXiv2022

Minimal Euler Characteristics of 4-manifolds with 3-manifold groups

Let $π=π_1(M)$ for a compact 3-manifold $M$, and let $χ_4$, $p$ and $q^*$ be the invariants of Hausmann-Weinberger, Kotschick and Hillman respectively. For certain class of compact 3-manifolds $M$, including all those not containing two-sided $RP^2$, we determine $χ_4(π)$. We address when does $χ_4(π)=p(π)$, when does $χ_4(π)=q^*(π)$, and answer a question raised by Hillman.

math.GT↗

arXiv2022

Deep Reinforcement Learning Microgrid Optimization Strategy Considering Priority Flexible Demand Side

As an efficient way to integrate multiple distributed energy resources and the user side, a microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs. The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid. In response to this problem, the overall environment of wind power, thermostatically controlled loads, energy storage systems, price-responsive loads and the main grid is proposed. Secondly, the centralized control of the microgrid operation is convenient for the control of the reactive power and voltage of the distributed power supply and the adjustment of the grid frequency. However, there is a problem in that the flexible loads aggregate and generate peaks during the electricity price valley. The existing research takes into account the power constraints of the microgrid and fails to ensure a sufficient supply of electric energy for a single flexible load. This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid so as to ensure the power supply of the flexible load of the microgrid and save the power input cost to the greatest extent. Finally, the simulation optimization of the environment can be expressed as a Markov decision process process. It combines two stages of offline and online operations in the training process. The addition of multiple threads with the lack of historical data learning leads to low learning efficiency. The asynchronous advantage actor-critic with the experience replay pool memory library is added to solve the data correlation and nonstatic distribution problems during training.

cs.LG↗

arXiv2022

Appendix for Nonparametric Multivariate Probability Density Forecast in Smart Grids With Deep Learning

This paper proposes a nonparametric multivariate density forecast model based on deep learning. It not only offers the whole marginal distribution of each random variable in forecasting targets, but also reveals the future correlation between them. Differing from existing multivariate density forecast models, the proposed method requires no a priori hypotheses on the forecasted joint probability distribution of forecasting targets. In addition, based on the universal approximation capability of neural networks, the real joint cumulative distribution functions of forecasting targets are well-approximated by a special positive-weighted deep neural network in the proposed method. Numerical tests from different scenarios were implemented under a comprehensive verification framework for evaluation, including the very short-term forecast of the wind speed, wind power, and the day-ahead forecast of the aggregated electricity load. Testing results corroborate the superiority of the proposed method over current multivariate density forecast models considering the accordance with reality, prediction interval width, and correlations between different random variables.

eess.SY↗

arXiv2022

RACE: Retrieval-Augmented Commit Message Generation

Commit messages are important for software development and maintenance. Many neural network-based approaches have been proposed and shown promising results on automatic commit message generation. However, the generated commit messages could be repetitive or redundant. In this paper, we propose RACE, a new retrieval-augmented neural commit message generation method, which treats the retrieved similar commit as an exemplar and leverages it to generate an accurate commit message. As the retrieved commit message may not always accurately describe the content/intent of the current code diff, we also propose an exemplar guider, which learns the semantic similarity between the retrieved and current code diff and then guides the generation of commit message based on the similarity. We conduct extensive experiments on a large public dataset with five programming languages. Experimental results show that RACE can outperform all baselines. Furthermore, RACE can boost the performance of existing Seq2Seq models in commit message generation.

cs.SE↗

arXiv2022

Energy Circuit-based Integrated Energy Management System: Theory, Implementation, and Application

Integrated energy systems (IESs), in which various energy flows are interconnected and coordinated to release potential flexibility for more efficient and secure operation, have drawn increasing attention in recent years. In this article, an integrated energy management system (IEMS) that performs online analysis and optimization on coupling energy flows in an IES is comprehensively introduced. From the theory perspective, an energy circuit method (ECM) that models natural gas networks and heating networks in the frequency domain is discussed. This method extends the electric circuit modeling of power systems to IESs and enables the IEMS to manage large-scale IESs. From the implementation perspective, the architecture design and function development of the IEMS are presented. Tutorial examples with illustrative case studies are provided to demonstrate its functions of dynamic state estimation, energy flow analysis, security assessment and control, and optimal energy flow. From the application perspective, real-world engineering demonstrations that apply IEMSs in managing building-scale, park-scale, and city-scale IESs are reported. The economic and environmental benefits obtained in these demonstration projects indicate that the IEMS has broad application prospects for a low/zero-carbon future energy system.

eess.SY↗

arXiv2022

Reducing Action Space: Reference-Model-Assisted Deep Reinforcement Learning for Inverter-based Volt-Var Control

Reference-model-assisted deep reinforcement learning (DRL) for inverter-based Volt-Var Control (IB-VVC) in active distribution networks is proposed. We investigate that a large action space increases the learning difficulties of DRL and degrades the optimization performance in the process of generating data and training neural networks. To reduce the action space of DRL, we design a reference-model-assisted DRL approach. We introduce definitions of the reference model, reference-model-based optimization, and reference actions. The reference-model-assisted DRL learns the residual actions between the reference actions and optimal actions, rather than learning the optimal actions directly. Since the residual actions are considerably smaller than the optimal actions for a reference model, we can design a smaller action space for the reference-model-assisted DRL. It reduces the learning difficulties of DRL and optimises the performance of the reference-model-assisted DRL approach. It is noteworthy that the reference-model-assisted DRL approach is compatible with any policy gradient DRL algorithms for continuous action problems. This work takes the soft actor-critic algorithm as an example and designs a reference-model-assisted soft actor-critic algorithm. Simulations show that 1) large action space degrades the performance of DRL in the whole training stage, and 2) reference-model-assisted DRL requires fewer iteration times and returns a better optimization performance.

eess.SY↗

arXiv2022

Virtual Domination of 3-manifolds III

We prove that for any oriented cusped hyperbolic 3-manifold $M$ and any compact oriented 3-manifold $N$ with tori boundary, there exists a finite cover $M'$ of $M$ that admits a degree-8 map $f:M'\to N$, i.e. $M$ virtually 8-dominates $N$.

math.GT↗