arXiv subjects

Fengyu Zhou

Publications and source records attributed to Fengyu Zhou.

14 recordsLinked to original sources

arXiv2025

Embodied Perception for Test-time Grasping Detection Adaptation with Knowledge Infusion

It has always been expected that a robot can be easily deployed to unknown scenarios, accomplishing robotic grasping tasks without human intervention. Nevertheless, existing grasp detection approaches are typically off-body techniques and are realized by training various deep neural networks with extensive annotated data support. {In this paper, we propose an embodied test-time adaptation framework for grasp detection that exploits the robot's exploratory capabilities.} The framework aims to improve the generalization performance of grasping skills for robots in an unforeseen environment. Specifically, we introduce embodied assessment criteria based on the robot's manipulation capability to evaluate the quality of the grasp detection and maintain suitable samples. This process empowers the robots to actively explore the environment and continuously learn grasping skills, eliminating human intervention. Besides, to improve the efficiency of robot exploration, we construct a flexible knowledge base to provide context of initial optimal viewpoints. Conditioned on the maintained samples, the grasp detection networks can be adapted in the test-time scene. When the robot confronts new objects, it will undergo the same adaptation procedure mentioned above to realize continuous learning. Extensive experiments conducted on a real-world robot demonstrate the effectiveness and generalization of our proposed framework.

cs.RO↗

arXiv2025

Intelligent Spatial Perception by Building Hierarchical 3D Scene Graphs for Indoor Scenarios with the Help of LLMs

This paper addresses the high demand in advanced intelligent robot navigation for a more holistic understanding of spatial environments, by introducing a novel system that harnesses the capabilities of Large Language Models (LLMs) to construct hierarchical 3D Scene Graphs (3DSGs) for indoor scenarios. The proposed framework constructs 3DSGs consisting of a fundamental layer with rich metric-semantic information, an object layer featuring precise point-cloud representation of object nodes as well as visual descriptors, and higher layers of room, floor, and building nodes. Thanks to the innovative application of LLMs, not only object nodes but also nodes of higher layers, e.g., room nodes, are annotated in an intelligent and accurate manner. A polling mechanism for room classification using LLMs is proposed to enhance the accuracy and reliability of the room node annotation. Thorough numerical experiments demonstrate the system's ability to integrate semantic descriptions with geometric data, creating an accurate and comprehensive representation of the environment instrumental for context-aware navigation and task planning.

cs.RO↗

arXiv2023

Joint embedding in Hierarchical distance and semantic representation learning for link prediction

The link prediction task aims to predict missing entities or relations in the knowledge graph and is essential for the downstream application. Existing well-known models deal with this task by mainly focusing on representing knowledge graph triplets in the distance space or semantic space. However, they can not fully capture the information of head and tail entities, nor even make good use of hierarchical level information. Thus, in this paper, we propose a novel knowledge graph embedding model for the link prediction task, namely, HIE, which models each triplet (\textit{h}, \textit{r}, \textit{t}) into distance measurement space and semantic measurement space, simultaneously. Moreover, HIE is introduced into hierarchical-aware space to leverage rich hierarchical information of entities and relations for better representation learning. Specifically, we apply distance transformation operation on the head entity in distance space to obtain the tail entity instead of translation-based or rotation-based approaches. Experimental results of HIE on four real-world datasets show that HIE outperforms several existing state-of-the-art knowledge graph embedding methods on the link prediction task and deals with complex relations accurately.

cs.CL↗

arXiv2022

Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic Consistency

The knowledge graph (KG) stores a large amount of structural knowledge, while it is not easy for direct human understanding. Knowledge graph-to-text (KG-to-text) generation aims to generate easy-to-understand sentences from the KG, and at the same time, maintains semantic consistency between generated sentences and the KG. Existing KG-to-text generation methods phrase this task as a sequence-to-sequence generation task with linearized KG as input and consider the consistency issue of the generated texts and KG through a simple selection between decoded sentence word and KG node word at each time step. However, the linearized KG order is commonly obtained through a heuristic search without data-driven optimization. In this paper, we optimize the knowledge description order prediction under the order supervision extracted from the caption and further enhance the consistency of the generated sentences and KG through syntactic and semantic regularization. We incorporate the Part-of-Speech (POS) syntactic tags to constrain the positions to copy words from the KG and employ a semantic context scoring function to evaluate the semantic fitness for each word in its local context when decoding each word in the generated sentence. Extensive experiments are conducted on two datasets, WebNLG and DART, and achieve state-of-the-art performances.

cs.AI↗

arXiv2021

Conditions for Exact Convex Relaxation and No Spurious Local Optima

Non-convex optimization problems can be approximately solved via relaxation or local algorithms. For many practical problems such as optimal power flow (OPF) problems, both approaches tend to succeed in the sense that relaxation is usually exact and local algorithms usually converge to a global optimum. In this paper, we study conditions which are sufficient or necessary for such non-convex problems to simultaneously have exact relaxation and no spurious local optima. Those conditions help us explain the widespread empirical experience that local algorithms for OPF problems often work extremely well.

math.OC↗

arXiv2020

Sufficient Conditions for Exact Semidefinite Relaxation of Optimal Power Flow in Unbalanced Multiphase Radial Networks

This paper proves that in an unbalanced multi-phase network with a tree topology, the semidefinite programming relaxation of optimal power flow problems is exact when critical buses are not adjacent to each other. Here a critical bus either contributes directly to the cost function or is where an injection constraint is tight at optimality. Our result generalizes a sufficient condition for exact relaxation in single-phase tree networks to tree networks with arbitrary number of phases.

math.OC↗

arXiv2020

Exactness of OPF Relaxation on Three-phase Radial Networks with Delta Connections

Simulations have shown that while semi-definite relaxations of AC optimal power flow (AC-OPF) on three-phase radial networks with only wye connections tend to be exact, the presence of delta connections seem to render them inexact. This paper shows that such inexactness originates from the non-uniqueness of relaxation solutions and numerical errors amplified by the non-uniqueness. This finding motivates two algorithms to recover the exact solution of AC-OPF in the presence of delta connections. In simulations using IEEE 13, 37 and 123-bus systems, the proposed algorithms provide exact optimal solutions up to numerical precision.

math.OC↗

arXiv2020

Worst-Case Sensitivity of DC Optimal Power Flow Problems

In this paper we consider the problem of analyzing the effect a change in the load vector can have on the optimal power generation in a DC power flow model. The methodology is based upon the recently introduced concept of the $\mathcal{OPF}$ operator. It is shown that for general network topologies computing the worst-case sensitivities is computationally intractable. However, we show that certain problems involving the $\mathcal{OPF}$ operator can be equivalently converted to a graphical discrete optimization problem. Using the discrete formulation, we provide a decomposition algorithm that reduces the computational cost of computing the worst-case sensitivity. A 27-bus numerical example is used to illustrate our results.

math.OC↗

arXiv2020

A Note on Branch Flow Models with Line Shunts

When the shunt elements in the Pi circuit line model are assumed zero, it has been proved that branch flow models are equivalent to bus injection models and that the second-order cone relaxation of optimal power flow problems on a radial network is exact under certain conditions. In this note we propose a branch flow model that includes nonzero line shunts and prove that the equivalence and the exactness of relaxation continue to hold under essentially the same conditions as for zero shunt elements.

math.OC↗

arXiv2020

The Optimal Power Flow Operator: Theory and Computation

Optimal power flow problems (OPFs) are mathematical programs used to determine how to distribute power over networks subject to network operation constraints and the physics of power flows. In this work, we take the view of treating an OPF problem as an operator which maps user demand to generated power, and allow the network parameters (such as generator and power flow limits) to take values in some admissible set. The contributions of this paper are to formalize this operator theoretic approach, define and characterize restricted parameter sets under which the mapping has a singleton output, independent binding constraints, and is differentiable. In contrast to related results in the optimization literature, we do not rely on introducing auxiliary slack variables. Indeed, our approach provides results that have a clear interpretation with respect to the power network under study. We further provide a closed-form expression for the Jacobian matrix of the OPF operator and describe how various derivatives can be computed using a recently proposed scheme based on homogenous self-dual embedding. Our framework of treating a mathematical program as an operator allows us to pose sensitivity and robustness questions from a completely different mathematical perspective and provide new insights into well studied problems.

math.OC↗

arXiv2019

An Energy Sharing Game with Generalized Demand Bidding: Model and Properties

This paper proposes a novel energy sharing mechanism for prosumers who can produce and consume. Different from most existing works, the role of individual prosumer as a seller or buyer in our model is endogenously determined. Several desirable properties of the proposed mechanism are proved based on a generalized game-theoretic model. We show that the Nash equilibrium exists and is the unique solution of an equivalent convex optimization problem. The sharing price at the Nash equilibrium equals to the average marginal disutility of all prosumers. We also prove that every prosumer has the incentive to participate in the sharing market, and prosumers' total cost decreases with increasing absolute value of price sensitivity. Furthermore, the Nash equilibrium approaches the social optimal as the number of prosumers grows, and competition can improve social welfare.

math.OC↗

arXiv2019

Differential Privacy of Aggregated DC Optimal Power Flow Data

We consider the problem of privately releasing aggregated network statistics obtained from solving a DC optimal power flow (OPF) problem. It is shown that the mechanism that determines the noise distribution parameters are linked to the topology of the power system and the monotonicity of the network. We derive a measure of "almost" monotonicity and show how it can be used in conjunction with a linear program in order to release aggregated OPF data using the differential privacy framework.

cs.CR↗

arXiv2018

PID2018 Benchmark Challenge: learning feedforward control

The design and application of learning feedforward controllers (LFFC) for the one-staged refrigeration cycle model described in the PID2018 Benchmark Challenge is presented, and its effectiveness is evaluated. The control system consists of two components: 1) a preset PID component and 2) a learning feedforward component which is a function approximator that is adapted on the basis of the feedback signal. A B-spline network based LFFC and a low-pass filter based LFFC are designed to track the desired outlet temperature of evaporator secondary flux and the superheating degree of refrigerant at evaporator outlet. Encouraging simulation results are included. Qualitative and quantitative comparison results evaluations show that, with little effort, a high-performance control system can be obtained with this approach. Our initial simple attempt of low-pass filter based LFFC and B-spline network based LFFC give J=0.4902 and J=0.6536 relative to the decentralized PID controller, respectively. Besides, the initial attempt of a combination controller of our optimized PI controller and low-pass filter LFFC gives J=0.6947 relative to the multi-variable PID controller.

eess.SY↗

arXiv2017

On the Outage Probability of Localization in Randomly Deployed Wireless Networks

This paper analyzes the localization outage probability (LOP), the probability that the position error exceeds a given threshold, in randomly deployed wireless networks. Two typical cases are considered: a mobile agent uses all the neighboring anchors or select the best pair of anchors for self-localization. We derive the exact LOP for the former case and tight bounds for the LOP for the latter case. The comparison between the two cases reveals the advantage of anchor selection in terms of LOP versus complexity tradeoff, providing insights into the design of efficient localization systems.

cs.NI↗