arXiv subjects

Alisina Bayati

Publications and source records attributed to Alisina Bayati.

4 recordsLinked to original sources

arXiv2025

Orthogonal Nonnegative Matrix Factorization with Sparsity Constraints

This article presents a novel approach to solving the sparsity-constrained Orthogonal Nonnegative Matrix Factorization (SCONMF) problem, which requires decomposing a non-negative data matrix into the product of two lower-rank non-negative matrices, X=WH, where the mixing matrix H has orthogonal rows HH^T=I, while also satisfying an upper bound on the number of nonzero elements in each row. By reformulating SCONMF as a capacity-constrained facility-location problem (CCFLP), the proposed method naturally integrates non-negativity, orthogonality, and sparsity constraints. Specifically, our approach integrates control-barrier function (CBF) based framework used for dynamic optimal control design problems with maximum-entropy-principle-based framework used for facility location problems to enforce these constraints while ensuring robust factorization. Additionally, this work introduces a quantitative approach for determining the ``true" rank of W or H, equivalent to the number of ``true" features - a critical aspect in ONMF applications where the number of features is unknown. Simulations on various datasets demonstrate significantly improved factorizations with low reconstruction errors (as small as by 150 times) while strictly satisfying all constraints, outperforming existing methods that struggle with balancing accuracy and constraint adherence.

cs.DS↗

arXiv2025

A Control Barrier Function Approach to Constrained Resource Allocation Problems in a Maximum Entropy Principle Framework

This paper presents a novel approach to solve capacitated facility location problems (FLP) that encompass various resource allocation problems. FLPs are a class of NP-hard combinatorial optimization problems, involving optimal placement and assignment of a small number of facilities over a large number of demand points, with each facility subject to upper and lower bounds on its resource utilization (e.g., the number of demand points it can serve). To address the challenges posed by inequality constraints and the combinatorial nature of the solution space, we reformulate the problem as a dynamic control design problem, enabling structured constraint handling and enhanced solution efficiency. Our method integrates a Control Barrier Function (CBF) and Control Lyapunov Function (CLF)-based framework with a maximum-entropy principle-based framework to ensure feasibility, optimality, and improved exploration of solutions. Numerical experiments demonstrate that this approach significantly enhances computational efficiency, yielding better solutions and showing negligible growth in computation time with problem size as compared to existing solvers. These results highlight the potential of control-theoretic and entropy-based methods for large-scale facility location problems.

math.OC↗

arXiv2023

Sparse Linear Regression with Constraints: A Flexible Entropy-based Framework

This work presents a new approach to solve the sparse linear regression problem, i.e., to determine a k-sparse vector w in R^d that minimizes the cost ||y - Aw||^2_2. In contrast to the existing methods, our proposed approach splits this k-sparse vector into two parts -- (a) a column stochastic binary matrix V, and (b) a vector x in R^k. Here, the binary matrix V encodes the location of the k non-zero entries in w. Equivalently, it encodes the subset of k columns in the matrix A that map w to y. We demonstrate that this enables modeling several non-trivial application-specific structural constraints on w as constraints on V. The vector x comprises of the actual non-zero values in w. We use Maximum Entropy Principle (MEP) to solve the resulting optimization problem. In particular, we ascribe a probability distribution to the set of all feasible binary matrices V, and iteratively determine this distribution and the vector x such that the associated Shannon entropy gets minimized, and the regression cost attains a pre-specified value. The resulting algorithm employs homotopy from the convex entropy function to the non-convex cost function to avoid poor local minimum. We demonstrate the efficacy and flexibility of our proposed approach in incorporating a variety of practical constraints, that are otherwise difficult to model using the existing benchmark methods.

eess.SY↗

arXiv2023

Towards Efficient Modularity in Industrial Drying: A Combinatorial Optimization Viewpoint

The industrial drying process consumes approximately 12% of the total energy used in manufacturing, with the potential for a 40% reduction in energy usage through improved process controls and the development of new drying technologies. To achieve cost-efficient and high-performing drying, multiple drying technologies can be combined in a modular fashion with optimal sequencing and control parameters for each. This paper presents a mathematical formulation of this optimization problem and proposes a framework based on the Maximum Entropy Principle (MEP) to simultaneously solve for both optimal values of control parameters and optimal sequence. The proposed algorithm addresses the combinatorial optimization problem with a non-convex cost function riddled with multiple poor local minima. Simulation results on drying distillers dried grain (DDG) products show up to 12% improvement in energy consumption compared to the most efficient single-stage drying process. The proposed algorithm converges to local minima and is designed heuristically to reach the global minimum.

eess.SY↗