SearcharxivSearch

arXiv subjects

Dewei Zhang

Publications and source records attributed to Dewei Zhang.

5 recordsLinked to original sources

Hybrid-Integrated DFB-Laser-Coupled 1 * 8 Thin-Film Lithium Niobate Modulator Array for High-Speed Parallel Optical Transmitters

Thin-film lithium niobate (TFLN) electro-optic modulators are attractive for high-speed optical interconnects, but scalable transmitter architectures require not only high modulation bandwidth but also multi-channel optical power distribution and practical laser-to-chip integration. Here, we demonstrate a hybrid-integrated 1 * 8 TFLN electro-optic modulator array passively butt-coupled to a 1550 nm distributed-feedback laser. The chip integrates a three-stage cascaded 1 * 2 multimode-interference splitter, spot-size converters, eight traveling-wave Mach-Zehnder modulators, thermal tuning electrodes, and on-chip 50 {\Omega} terminations. The cascaded splitter provides uniform optical power distribution with a maximum normalized power deviation of 9.7%, while the optimized electrodes enable electro-optic 3 dB bandwidths exceeding 40 GHz for all channels. The measured half-wave voltages are 3.60-3.83 V, corresponding to V{\pi}L products of 2.52-2.68 V cm for a 7 mm modulation length, and the extinction ratio reaches approximately 25 dB. The bare-chip insertion loss is 15.19-16.55 dB, and DFB laser bonding introduces an additional coupling loss of approximately 5 dB while preserving channel uniformity. These results establish a practical TFLN-based multi-channel modulator platform and represent a step toward compact hybrid-integrated optical transmitters for high-speed parallel interconnects.

physics.optics

Achieving Linear Speedup in Non-IID Federated Bilevel Learning

Federated bilevel optimization has received increasing attention in various emerging machine learning and communication applications. Recently, several Hessian-vector-based algorithms have been proposed to solve the federated bilevel optimization problem. However, several important properties in federated learning such as the partial client participation and the linear speedup for convergence (i.e., the convergence rate and complexity are improved linearly with respect to the number of sampled clients) in the presence of non-i.i.d.~datasets, still remain open. In this paper, we fill these gaps by proposing a new federated bilevel algorithm named FedMBO with a novel client sampling scheme in the federated hypergradient estimation. We show that FedMBO achieves a convergence rate of $\mathcal{O}\big(\frac{1}{\sqrt{nK}}+\frac{1}{K}+\frac{\sqrt{n}}{K^{3/2}}\big)$ on non-i.i.d.~datasets, where $n$ is the number of participating clients in each round, and $K$ is the total number of iteration. This is the first theoretical linear speedup result for non-i.i.d.~federated bilevel optimization. Extensive experiments validate our theoretical results and demonstrate the effectiveness of our proposed method.

cs.LG

Riemannian Stochastic Gradient Method for Nested Composition Optimization

This work considers optimization of composition of functions in a nested form over Riemannian manifolds where each function contains an expectation. This type of problems is gaining popularity in applications such as policy evaluation in reinforcement learning or model customization in meta-learning. The standard Riemannian stochastic gradient methods for non-compositional optimization cannot be directly applied as stochastic approximation of inner functions create bias in the gradients of the outer functions. For two-level composition optimization, we present a Riemannian Stochastic Composition Gradient Descent (R-SCGD) method that finds an approximate stationary point, with expected squared Riemannian gradient smaller than $\epsilon$, in $O(\epsilon^{-2})$ calls to the stochastic gradient oracle of the outer function and stochastic function and gradient oracles of the inner function. Furthermore, we generalize the R-SCGD algorithms for problems with multi-level nested compositional structures, with the same complexity of $O(\epsilon^{-2})$ for the first-order stochastic oracle. Finally, the performance of the R-SCGD method is numerically evaluated over a policy evaluation problem in reinforcement learning.

math.OC

A first-order optimization algorithm for statistical learning with hierarchical sparsity structure

In many statistical learning problems, it is desired that the optimal solution conforms to an a priori known sparsity structure represented by a directed acyclic graph. Inducing such structures by means of convex regularizers requires nonsmooth penalty functions that exploit group overlapping. Our study focuses on evaluating the proximal operator of the Latent Overlapping Group lasso developed by Jacob et al. (2009). We implemented an Alternating Direction Method of Multiplier with a sharing scheme to solve large-scale instances of the underlying optimization problem efficiently. In the absence of strong convexity, global linear convergence of the algorithm is established using the error bound theory. More specifically, the paper contributes to establishing primal and dual error bounds when the nonsmooth component in the objective function does not have a polyhedral epigraph. We also investigate the effect of the graph structure on the speed of convergence of the algorithm. Detailed numerical simulation studies over different graph structures supporting the proposed algorithm and two applications in learning are provided.

math.OC

Riemannian Stochastic Variance-Reduced Cubic Regularized Newton Method for Submanifold Optimization

We propose a stochastic variance-reduced cubic regularized Newton algorithm to optimize the finite-sum problem over a Riemannian submanifold of the Euclidean space. The proposed algorithm requires a full gradient and Hessian update at the beginning of each epoch while it performs stochastic variance-reduced updates in the iterations within each epoch. The iteration complexity of $O(\epsilon^{-3/2})$ to obtain an $(\epsilon,\sqrt{\epsilon})$-second-order stationary point, i.e., a point with the Riemannian gradient norm upper bounded by $\epsilon$ and minimum eigenvalue of Riemannian Hessian lower bounded by $-\sqrt{\epsilon}$, is established when the manifold is embedded in the Euclidean space. Furthermore, the paper proposes a computationally more appealing modification of the algorithm which only requires an inexact solution of the cubic regularized Newton subproblem with the same iteration complexity. The proposed algorithm is evaluated and compared with three other Riemannian second-order methods over two numerical studies on estimating the inverse scale matrix of the multivariate t-distribution on the manifold of symmetric positive definite matrices and estimating the parameter of a linear classifier on the Sphere manifold.

math.OC