arXiv subjects

Kevin Li

Publications and source records attributed to Kevin Li.

At least 55 records · Page 3Linked to original sources

arXiv2023

Optical pumping of electronic quantum Hall states with vortex light

A fundamental requirement for quantum technologies is the ability to coherently control the interaction between electrons and photons. However, in many scenarios involving the interaction between light and matter, the exchange of linear or angular momentum between electrons and photons is not feasible, a condition known as the dipole-approximation limit. An example of a case beyond this limit that has remained experimentally elusive is when the interplay between chiral electrons and vortex light is considered, where the orbital angular momentum of light can be transferred to electrons. Here, we present a novel mechanism for such an orbital angular momentum transfer from optical vortex beams to electronic quantum Hall states. Specifically, we identify a robust contribution to the radial photocurrent, in an annular graphene sample within the quantum Hall regime, that depends on the vorticity of light. This phenomenon can be interpreted as an optical pumping scheme, where the angular momentum of photons is transferred to electrons, generating a radial current, and the current direction is determined by the vorticity of the light. Our findings offer fundamental insights into the optical probing and manipulation of quantum coherence, with wide-ranging implications for advancing quantum coherent optoelectronics.

cond-mat.mes-hall↗

arXiv2023

Trigonometric Quadrature Fourier Features for Scalable Gaussian Process Regression

Fourier feature approximations have been successfully applied in the literature for scalable Gaussian Process (GP) regression. In particular, Quadrature Fourier Features (QFF) derived from Gaussian quadrature rules have gained popularity in recent years due to their improved approximation accuracy and better calibrated uncertainty estimates compared to Random Fourier Feature (RFF) methods. However, a key limitation of QFF is that its performance can suffer from well-known pathologies related to highly oscillatory quadrature, resulting in mediocre approximation with limited features. We address this critical issue via a new Trigonometric Quadrature Fourier Feature (TQFF) method, which uses a novel non-Gaussian quadrature rule specifically tailored for the desired Fourier transform. We derive an exact quadrature rule for TQFF, along with kernel approximation error bounds for the resulting feature map. We then demonstrate the improved performance of our method over RFF and Gaussian QFF in a suite of numerical experiments and applications, and show the TQFF enjoys accurate GP approximations over a broad range of length-scales using fewer features.

stat.ML↗

arXiv2023

Catenoid limits of singly periodic minimal surfaces with Scherk-type ends

We construct families of embedded, singly periodic minimal surfaces of any genus $g$ in the quotient with any even number $2n>2$ of almost parallel Scherk ends. A surface in such a family looks like $n$ parallel planes connected by $n-1+g$ small catenoid necks. In the limit, the family converges to an $n$-sheeted vertical plane with $n-1+g$ singular points termed nodes in the quotient. For the nodes to open up into catenoid necks, their locations must satisfy a set of balance equations whose solutions are given by the roots of Stieltjes polynomials.

math.DG↗

arXiv2023

Explainable machine learning identifies multi-omics signatures of muscle response to spaceflight in mice

The adverse effects of microgravity exposure on mammalian physiology during spaceflight necessitate a deep understanding of the underlying mechanisms to develop effective countermeasures. One such concern is muscle atrophy, which is partly attributed to the dysregulation of calcium levels due to abnormalities in SERCA pump functioning. To identify potential biomarkers for this condition, multi-omics data and physiological data available on the NASA Open Science Data Repository (osdr.nasa.gov) were used, and machine learning methods were employed. Specifically, we used multi-omics (transcriptomic, proteomic, and DNA methylation) data and calcium reuptake data collected from C57BL/6J mouse soleus and tibialis anterior tissues during several 30+ day-long missions on the international space station. The QLattice symbolic regression algorithm was introduced to generate highly explainable models that predict either experimental conditions or calcium reuptake levels based on multi-omics features. The list of candidate models established by QLattice was used to identify key features contributing to the predictive capability of these models, with Acyp1 and Rps7 proteins found to be the most predictive biomarkers related to the resilience of the tibialis anterior muscle in space. These findings could serve as targets for future interventions aiming to reduce the extent of muscle atrophy during space travel.

q-bio.QM↗

arXiv2023

Robust Principles: Architectural Design Principles for Adversarially Robust CNNs

Our research aims to unify existing works' diverging opinions on how architectural components affect the adversarial robustness of CNNs. To accomplish our goal, we synthesize a suite of three generalizable robust architectural design principles: (a) optimal range for depth and width configurations, (b) preferring convolutional over patchify stem stage, and (c) robust residual block design through adopting squeeze and excitation blocks and non-parametric smooth activation functions. Through extensive experiments across a wide spectrum of dataset scales, adversarial training methods, model parameters, and network design spaces, our principles consistently and markedly improve AutoAttack accuracy: 1-3 percentage points (pp) on CIFAR-10 and CIFAR-100, and 4-9 pp on ImageNet. The code is publicly available at https://github.com/poloclub/robust-principles.

cs.CV↗

arXiv2023

Concept Evolution in Deep Learning Training: A Unified Interpretation Framework and Discoveries

We present ConceptEvo, a unified interpretation framework for deep neural networks (DNNs) that reveals the inception and evolution of learned concepts during training. Our work addresses a critical gap in DNN interpretation research, as existing methods primarily focus on post-training interpretation. ConceptEvo introduces two novel technical contributions: (1) an algorithm that generates a unified semantic space, enabling side-by-side comparison of different models during training, and (2) an algorithm that discovers and quantifies important concept evolutions for class predictions. Through a large-scale human evaluation and quantitative experiments, we demonstrate that ConceptEvo successfully identifies concept evolutions across different models, which are not only comprehensible to humans but also crucial for class predictions. ConceptEvo is applicable to both modern DNN architectures, such as ConvNeXt, and classic DNNs, such as VGGs and InceptionV3.

cs.LG↗

arXiv2023

Additive Multi-Index Gaussian process modeling, with application to multi-physics surrogate modeling of the quark-gluon plasma

The Quark-Gluon Plasma (QGP) is a unique phase of nuclear matter, theorized to have filled the Universe shortly after the Big Bang. A critical challenge in studying the QGP is that, to reconcile experimental observables with theoretical parameters, one requires many simulation runs of a complex physics model over a high-dimensional parameter space. Each run is computationally very expensive, requiring thousands of CPU hours, thus limiting physicists to only several hundred runs. Given limited training data for high-dimensional prediction, existing surrogate models often yield poor predictions with high predictive uncertainties, leading to imprecise scientific findings. To address this, we propose a new Additive Multi-Index Gaussian process (AdMIn-GP) model, which leverages a flexible additive structure on low-dimensional embeddings of the parameter space. This is guided by prior scientific knowledge that the QGP is dominated by multiple distinct physical phenomena (i.e., multiphysics), each involving a small number of latent parameters. The AdMIn-GP models for such embedded structures within a flexible Bayesian nonparametric framework, which facilitates efficient model fitting via a carefully constructed variational inference approach with inducing points. We show the effectiveness of the AdMIn-GP via a suite of numerical experiments and our QGP application, where we demonstrate considerably improved surrogate modeling performance over existing models.

nucl-th↗

arXiv2023

Charge and Energy Transfer Dynamics of Hybridized Exciton-Polaritons in 2D Halide Perovskites

Excitons, bound electron-hole pairs, in Two-Dimensional Hybrid Organic Inorganic Perovskites (2D HOIPs) are capable of forming hybrid light-matter states known as exciton-polaritons (E-Ps) when the excitonic medium is confined in an optical cavity. In the case of 2D HOIPs, they can self-hybridize into E-Ps at specific thicknesses of the HOIP crystals that form a resonant optical cavity with the excitons. However, the fundamental properties of these self-hybridized E-Ps in 2D HOIPs, including their role in ultrafast energy and/or charge transfer at interfaces, remain unclear. Here, we demonstrate that > 0.5 um thick 2D HOIP crystals on Au substrates are capable of supporting multiple-orders of self-hybridized E-P modes. These E-Ps have high Q factors (> 100) and modulate the optical dispersion for the crystal to enhance sub-gap absorption and emission. Through varying excitation energy and ultrafast measurements, we also confirm energy transfer from higher energy upper E-Ps to lower energy, lower E-Ps. Finally, we also demonstrate that E-Ps are capable of charge transport and transfer at interfaces. Our findings provide new insights into charge and energy transfer in E-Ps opening new opportunities towards their manipulation for polaritonic devices.

cond-mat.mes-hall↗

arXiv2023

Comparison of equivariant cohomological dimensions

We compare three definitions of the equivariant cohomological dimension of a group with operators, coming from Takasu, Adamson and Bredon relative group cohomologies, giving examples of strict inequality in all cases where it can occur. We prove and make use of Stallings--Swan type results which characterise the groups of equivariant cohomological dimension one. Some of our examples are relevant to Farber's problem which asks for an algebraic characterisation of the topological complexity of discrete groups. In particular, the topological complexity of a group is not in general given by a relative cohomological dimension of the product relative to the diagonal subgroup.

math.AT↗

arXiv2023

RobArch: Designing Robust Architectures against Adversarial Attacks

Adversarial Training is the most effective approach for improving the robustness of Deep Neural Networks (DNNs). However, compared to the large body of research in optimizing the adversarial training process, there are few investigations into how architecture components affect robustness, and they rarely constrain model capacity. Thus, it is unclear where robustness precisely comes from. In this work, we present the first large-scale systematic study on the robustness of DNN architecture components under fixed parameter budgets. Through our investigation, we distill 18 actionable robust network design guidelines that empower model developers to gain deep insights. We demonstrate these guidelines' effectiveness by introducing the novel Robust Architecture (RobArch) model that instantiates the guidelines to build a family of top-performing models across parameter capacities against strong adversarial attacks. RobArch achieves the new state-of-the-art AutoAttack accuracy on the RobustBench ImageNet leaderboard. The code is available at $\href{https://github.com/ShengYun-Peng/RobArch}{\text{this url}}$.

cs.CV↗

arXiv2022

Evaluation of Argo Scholar with Observational Study

Discovering and making sense of relevant literature is fundamental in any scientific field. Node-link diagram-based visualization tools can aid this process; however, existing tools have been evaluated only on small scales. This paper evaluates Argo Scholar, an open-source visualization tool designed for interactive exploration of literature and easy sharing of exploration results. A large-scale user study of 122 participants from diverse backgrounds and experiences showed that Argo Scholar is effective at helping users find related work and understand paper connections, and incremental graph-based exploration is effective across diverse disciplines. Based on the user study and user feedback, we provide design considerations and feature suggestions for future work.

cs.HC↗

arXiv2022

NeuroMapper: In-browser Visualizer for Neural Network Training

We present our ongoing work NeuroMapper, an in-browser visualization tool that helps machine learning (ML) developers interpret the evolution of a model during training, providing a new way to monitor the training process and visually discover reasons for suboptimal training. While most existing deep neural networks (DNNs) interpretation tools are designed for already-trained model, NeuroMapper scalably visualizes the evolution of the embeddings of a model's blocks across training epochs, enabling real-time visualization of 40,000 embedded points. To promote the embedding visualizations' spatial coherence across epochs, NeuroMapper adapts AlignedUMAP, a recent nonlinear dimensionality reduction technique to align the embeddings. With NeuroMapper, users can explore the training dynamics of a Resnet-50 model, and adjust the embedding visualizations' parameters in real time. NeuroMapper is open-sourced at https://github.com/poloclub/NeuroMapper and runs in all modern web browsers. A demo of the tool in action is available at: https://poloclub.github.io/NeuroMapper/.

cs.HC↗

arXiv2022

Beyond Bayes-optimality: meta-learning what you know you don't know

Meta-training agents with memory has been shown to culminate in Bayes-optimal agents, which casts Bayes-optimality as the implicit solution to a numerical optimization problem rather than an explicit modeling assumption. Bayes-optimal agents are risk-neutral, since they solely attune to the expected return, and ambiguity-neutral, since they act in new situations as if the uncertainty were known. This is in contrast to risk-sensitive agents, which additionally exploit the higher-order moments of the return, and ambiguity-sensitive agents, which act differently when recognizing situations in which they lack knowledge. Humans are also known to be averse to ambiguity and sensitive to risk in ways that aren't Bayes-optimal, indicating that such sensitivity can confer advantages, especially in safety-critical situations. How can we extend the meta-learning protocol to generate risk- and ambiguity-sensitive agents? The goal of this work is to fill this gap in the literature by showing that risk- and ambiguity-sensitivity also emerge as the result of an optimization problem using modified meta-training algorithms, which manipulate the experience-generation process of the learner. We empirically test our proposed meta-training algorithms on agents exposed to foundational classes of decision-making experiments and demonstrate that they become sensitive to risk and ambiguity.

cs.AI↗

arXiv2022

Spectral Analysis of Scattering Resonances with Application on High Contrast Nanospheres

In this paper we provide further spectral analysis of the general asymptotic scattering resonances formula of small high contrast 3D dielectrics of arbitrary shape, initially derived to a first order approximation. To investigate the components of a full expansion of such resonances, a breakdown is presented for the case of high contrast nanospheres. We also derive, for radially symmetric fields, an exact resonance formula for a spherical scatterer in terms of its radius, not necessarily small, and dielectric susceptibility coefficient, not necessarily high. Formula that is useful in imaging applications to identify objects' properties from frequency measurements. The latter formula is further developed and simplified in the case of high contrast nanospheres.

math-ph↗

arXiv2022

Amenable covers of right-angled Artin groups

Let $A_L$ be the right-angled Artin group associated to a finite flag complex $L$. We show that the amenable category of $A_L$ equals the virtual cohomological dimension of the right-angled Coxeter group $W_L$. In particular, right-angled Artin groups satisfy a question of Capovilla--Löh--Moraschini proposing an inequality between the amenable category and Farber's topological complexity.

math.GR↗

arXiv2022

Bounded acyclicity and relative simplicial volume

We provide new vanishing and glueing results for relative simplicial volume, following up on two current themes in bounded cohomology: The passage from amenable groups to boundedly acyclic groups and the use of equivariant topology. More precisely, we consider equivariant nerve pairs and relative classifying spaces for families of subgroups. Typically, we apply this to uniformly boundedly acyclic families of subgroups. Our methods also lead to vanishing results for $\ell^2$-Betti numbers of aspherical CW-pairs with small relative amenable category and to a relative version of a result by Dranishnikov and Rudyak concerning mapping degrees and the inheritance of freeness of fundamental groups.

math.AT↗

arXiv2021

Argo Scholar: Interactive Visual Exploration of Literature in Browsers

Discovering and making sense of relevant research literature is fundamental to becoming knowledgeable in any scientific discipline. Visualization can aid this process; however, existing tools' adoption and impact have often been constrained, such as by their reliance on small curated paper datasets that quickly become outdated or a lack of support for personalized exploration. We introduce Argo Scholar, an open-source, web-based visualization tool for interactive exploration of literature and easy sharing of exploration results. Argo Scholar queries and visualizes Semantic Scholar's live data of almost 200 million papers, enabling users to generate personalized literature exploration results in real-time through flexible, incremental exploration, a common and effective method for researchers to discover relevant work. Our tool allows users to easily share their literature exploration results as a URL or web-embedded IFrame application. Argo Scholar is open-sourced and available at https://poloclub.github.io/argo-scholar/.

cs.HC↗

arXiv2021

Higher topological complexity of hyperbolic groups

We prove for non-elementary torsion-free hyperbolic groups $Γ$ and all $r\ge 2$ that the higher topological complexity ${\sf{TC}}_r(Γ)$ is equal to $r\cdot \mathrm{cd}(Γ)$. In particular, hyperbolic groups satisfy the rationality conjecture on the $\sf{TC}$-generating function, giving an affirmative answer to a question of Farber and Oprea. More generally, we consider certain toral relatively hyperbolic groups.

math.AT↗