arXiv subjects

Ren Liu

Publications and source records attributed to Ren Liu.

17 recordsLinked to original sources

arXiv2026

DWS-based microrheology of triblock copolymers

The thermally reversible phase transitions in aqueous solutions of the triblock copolymers known as Pluronic and their related textures are well-researched. However, their corresponding rheological properties are less studied. In particular, their high-temperature behavior is difficult to access with classical rheology. Here we demonstrated that Diffusing Wave Spectroscopy (DWS)-based microrheology allows us to study the phase transition and the associated viscoelastic properties of Pluronic F127 solutions for temperatures from 5 C to 80 C. From the measured intensity-autocorrelation functions we can extract effective viscosities and determine the critical micellization temperature and concentration. Moreover,the high EO/PO (arm-to-core) ratio of F127 and its polydispersity play a critical role in the high-temperature re-entrant liquid phase, due to decreasing solubility of PEO along with the dehydration of the PPO core. The microscopic viscoelastic moduli G'({\omega}) and G''({\omega}) help to determine these phase transitions and provide mechanical properties in the solid phase that are not readily accessible with standard multi-particle tracking techniques due to limited Brownian motion.

cond-mat.soft↗

arXiv2026

Adapting Reinforcement Learning for Path Planning in Constrained Parking Scenarios

Real-time path planning in constrained environments remains a fundamental challenge for autonomous systems. Traditional classical planners, while effective under perfect perception assumptions, are often sensitive to real-world perception constraints and rely on online search procedures that incur high computational costs. In complex surroundings, this renders real-time deployment prohibitive. To overcome these limitations, we introduce a Deep Reinforcement Learning (DRL) framework for real-time path planning in parking scenarios. In particular, we focus on challenging scenes with tight spaces that require a high number of reversal maneuvers and adjustments. Unlike classical planners, our solution does not require ideal and structured perception, and in principle, could avoid the need for additional modules such as localization and tracking, resulting in a simpler and more practical implementation. Also, at test time, the policy generates actions through a single forward pass at each step, which is lightweight enough for real-time deployment. The task is formulated as a sequential decision-making problem grounded in a bicycle model dynamics, enabling the agent to directly learn navigation policies that respect vehicle kinematics and environmental constraints in the closed-loop setting. A new benchmark is developed to support both training and evaluation, capturing diverse and challenging scenarios. Our approach achieves state-of-the-art success rates and efficiency, surpassing classical planner baselines by +96% in success rate and +52% in efficiency. Furthermore, we release our benchmark as an open-source resource for the community to foster future research in autonomous systems. The benchmark and accompanying tools are available at https://github.com/dqm5rtfg9b-collab/Constrained_Parking_Scenarios.

cs.RO↗

arXiv2023

Learning a Single Policy for Diverse Behaviors on a Quadrupedal Robot using Scalable Motion Imitation

Learning various motor skills for quadrupedal robots is a challenging problem that requires careful design of task-specific mathematical models or reward descriptions. In this work, we propose to learn a single capable policy using deep reinforcement learning by imitating a large number of reference motions, including walking, turning, pacing, jumping, sitting, and lying. On top of the existing motion imitation framework, we first carefully design the observation space, the action space, and the reward function to improve the scalability of the learning as well as the robustness of the final policy. In addition, we adopt a novel adaptive motion sampling (AMS) method, which maintains a balance between successful and unsuccessful behaviors. This technique allows the learning algorithm to focus on challenging motor skills and avoid catastrophic forgetting. We demonstrate that the learned policy can exhibit diverse behaviors in simulation by successfully tracking both the training dataset and out-of-distribution trajectories. We also validate the importance of the proposed learning formulation and the adaptive motion sampling scheme by conducting experiments.

cs.RO↗

arXiv2023

Towards New Liquid Crystal Phases of DNA mesogens

Short, partially complementary, single-stranded (ss)DNA strands can form nanostructures with a wide variety of shapes and mechanical properties. It is well known that semiflexible, linear dsDNA can undergo an isotropic to nematic (IN) phase transition and that sufficiently bent structures can form a biaxial nematic phase. Here we use numerical simulations to explore how the phase behaviour of linear DNA constructs changes as we tune the mechanical properties of the constituent DNA by changing the nucleotide sequence. The IN phase transition can be suppressed in so-called DNA 'nunchakus': structures consisting of two rigid dsDNA arms, separated by a sufficiently flexible spacer. In this paper, we use simulations to explore what phase behavior to expect for different linear DNA constructs. To this end, we first performed numerical simulations exploring the structural properties of a number of different DNA oligonucleotides, using the oxDNA package. We then used the structural information generated in the oxDNA simulations to construct more coarse-grained models of the rodlike, bent-core, and nunchaku DNA. These coarse-grained models were used to explore the phase behavior of suspensions of the various DNA constructs. The approach explored in this paper makes it possible to 'design' the phase behavior of DNA constructs by a suitable choice of the constituent nucleotide sequence.

cond-mat.soft↗

arXiv2022

Dynamic Light Scattering based microrheology of End-functionalised triblock copolymer solutions

'Soft' patchy surfactant micelles have become an additional building tool in self-assembling systems. The triblock copolymer, Pluronic F108, forms spherical micelles in aqueous solutions upon heating leading to a simple phase diagram with a micellar crystalline solid at higher temperatures and concentrations. Here we report the strong influence of end-functionalising the chain ends either with an azide or azide-DNA complex on the systems' phase behaviour. We find that the azide(N3)- functionalisation renders the chain ends weakly hydrophobic at lower temperatures, causing them to self-assemble into flower-micelles. This hydrophobicity increases with increasing temperature and poses a competing self-assembling mechanism to the solvent induces hydrophobic interactions between the middle-blocks of F108 at higher temperatures and leads to a macroscopic phase separation that is absent in the pure F108 system. However, when we attached short, hydrophilic single-stranded (ss)DNA to the azide groups via click chemistry the chain ends became 'sticky' due to DNA hybridisation below the melting temperature of the complementary ssDNA ends while reverting to hydrophilic behaviour above. We characterise their structural and rheological properties via Dynamic Light Scattering (DLS) and DLS-based passive microrheology with an improved time-frequency domain inversion step. We present the structural behaviour of dilute and semi-dilute solutions of the original F108 system and compare the results with solutions containing either the F108- azide (F108-N3) or partially DNA-functionalised F108-azide chains. Our DLS and microrheology studies inform us on how the attachment of azide groups on F108 changes the mechanical and structural properties of micellar fluids pioneering further characterisation and design of these hybrid systems.

cond-mat.soft↗

arXiv2022

A stochastic three-block splitting algorithm and its application to quantized deep neural networks

Deep neural networks (DNNs) have made great progress in various fields. In particular, the quantized neural network is a promising technique making DNNs compatible on resource-limited devices for memory and computation saving. In this paper, we mainly consider a non-convex minimization model with three blocks to train quantized DNNs and propose a new stochastic three-block alternating minimization (STAM) algorithm to solve it. We develop a convergence theory for the STAM algorithm and obtain an $\epsilon$-stationary point with optimal convergence rate $\mathcal{O}(\epsilon^{-4})$. Furthermore, we apply our STAM algorithm to train DNNs with relaxed binary weights. The experiments are carried out on three different network structures, namely VGG-11, VGG-16 and ResNet-18. These DNNs are trained using two different data sets, CIFAR-10 and CIFAR-100, respectively. We compare our STAM algorithm with some classical efficient algorithms for training quantized neural networks. The test accuracy indicates the effectiveness of STAM algorithm for training relaxed binary quantization DNNs.

math.OC↗

arXiv2021

PM-FSM: Policies Modulating Finite State Machine for Robust Quadrupedal Locomotion

Deep reinforcement learning (deep RL) has emerged as an effective tool for developing controllers for legged robots. However, vanilla deep RL often requires a tremendous amount of training samples and is not feasible for achieving robust behaviors. Instead, researchers have investigated a novel policy architecture by incorporating human experts' knowledge, such as Policies Modulating Trajectory Generators (PMTG). This architecture builds a recurrent control loop by combining a parametric trajectory generator (TG) and a feedback policy network to achieve more robust behaviors. To take advantage of human experts' knowledge but eliminate time-consuming interactive teaching, researchers have investigated a novel architecture, Policies Modulating Trajectory Generators (PMTG), which builds a recurrent control loop by combining a parametric trajectory generator (TG) and a feedback policy network to achieve more robust behaviors using intuitive prior knowledge. In this work, we propose Policies Modulating Finite State Machine (PM-FSM) by replacing TGs with contact-aware finite state machines (FSM), which offer more flexible control of each leg. Compared with the TGs, FSMs offer high-level management on each leg motion generator and enable a flexible state arrangement, which makes the learned behavior less vulnerable to unseen perturbations or challenging terrains. This invention offers an explicit notion of contact events to the policy to negotiate unexpected perturbations. We demonstrated that the proposed architecture could achieve more robust behaviors in various scenarios, such as challenging terrains or external perturbations, on both simulated and real robots. The supplemental video can be found at: https://youtu.be/78cboMqTkJQ.

cs.RO↗

arXiv2021

Ultra-Sharp Nanowire Arrays Natively Permeate, Record, and Stimulate Intracellular Activity in Neuronal and Cardiac Networks

Intracellular access with high spatiotemporal resolution can enhance our understanding of how neurons or cardiomyocytes regulate and orchestrate network activity, and how this activity can be affected with pharmacology or other interventional modalities. Nanoscale devices often employ electroporation to transiently permeate the cell membrane and record intracellular potentials, which tend to decrease rapidly to extracellular potential amplitudes with time. Here, we report innovative scalable, vertical, ultra-sharp nanowire arrays that are individually addressable to enable long-term, native recordings of intracellular potentials. We report large action potential amplitudes that are indicative of intracellular access from 3D tissue-like networks of neurons and cardiomyocytes across recording days and that do not decrease to extracellular amplitudes for the duration of the recording of several minutes. Our findings are validated with cross-sectional microscopy, pharmacology, and electrical interventions. Our experiments and simulations demonstrate that individual electrical addressability of nanowires is necessary for high-fidelity intracellular electrophysiological recordings. This study advances our understanding of and control over high-quality multi-channel intracellular recordings, and paves the way toward predictive, high-throughput, and low-cost electrophysiological drug screening platforms.

cond-mat.mtrl-sci↗

arXiv2021

Application of Yolo on Mask Detection Task

2020 has been a year marked by the COVID-19 pandemic. This event has caused disruptions to many aspects of normal life. An important aspect in reducing the impact of the pandemic is to control its spread. Studies have shown that one effective method in reducing the transmission of COVID-19 is to wear masks. Strict mask-wearing policies have been met with not only public sensation but also practical difficulty. We cannot hope to manually check if everyone on a street is wearing a mask properly. Existing technology to help automate mask checking uses deep learning models on real-time surveillance camera footages. The current dominant method to perform real-time mask detection uses Mask-RCNN with ResNet as the backbone. While giving good detection results, this method is computationally intensive and its efficiency in real-time face mask detection is not ideal. Our research proposes a new approach to mask detection by replacing Mask-R-CNN with a more efficient model "YOLO" to increase the processing speed of real-time mask detection and not compromise on accuracy. Besides, given the small volume as well as extreme imbalance of the mask detection datasets, we adopt a latest progress made in few-shot visual classification, simple CNAPs, to improve the classification performance.

cs.CV↗

arXiv2020

Semi-Implicit Back Propagation

Neural network has attracted great attention for a long time and many researchers are devoted to improve the effectiveness of neural network training algorithms. Though stochastic gradient descent (SGD) and other explicit gradient-based methods are widely adopted, there are still many challenges such as gradient vanishing and small step sizes, which leads to slow convergence and instability of SGD algorithms. Motivated by error back propagation (BP) and proximal methods, we propose a semi-implicit back propagation method for neural network training. Similar to BP, the difference on the neurons are propagated in a backward fashion and the parameters are updated with proximal mapping. The implicit update for both hidden neurons and parameters allows to choose large step size in the training algorithm. Finally, we also show that any fixed point of convergent sequences produced by this algorithm is a stationary point of the objective loss function. The experiments on both MNIST and CIFAR-10 demonstrate that the proposed semi-implicit BP algorithm leads to better performance in terms of both loss decreasing and training/validation accuracy, compared to SGD and a similar algorithm ProxBP.

math.OC↗

arXiv2019

On the Role of Flexibility in Linker-Mediated DNA Hydrogels

Three-dimensional DNA networks, composed of tri- or higher valent nanostars with sticky, single-stranded DNA overhangs, have been previously studied in the context of designing thermally responsive, viscoelastic hydrogels. In this work, we use linker-mediated gels, where the sticky ends of two trivalent nanostars are connected through the complementary sticky ends of a linear DNA duplex. We can design this connection to be either rigid or flexible by introducing flexible, non-binding bases. The additional flexiblity provided by these non-binding bases influences the effective elasticity of the percolating gel formed at low temperatures. Here we show that by choosing the right length of the linear duplex and non-binding flexible joints, we obtain a completely different phase behaviour to that observed for rigid linkers. In particular, we use dynamic light scattering as microrheological tool to monitor the self-assembly of DNA nanostars with linear linkers as a function of temperature. While we observe classical gelation when using rigid linkers, the presence of flexible joints leads to a cluster fluid with reduced viscosity. Using both the oxDNA model and a coarse-grained simulation to investigate the nanostar-linker topology, we hypothesise on the possible structure formed by the DNA clusters.

physics.bio-ph↗

arXiv2019

Fast Calculation of Probabilistic Optimal Power Flow: A Deep Learning Approach

Probabilistic optimal power flow (POPF) is an important analytical tool to ensure the secure and economic operation of power systems. POPF needs to solve enormous nonlinear and nonconvex optimization problems. The huge computational burden has become the major bottleneck for the practical application. This paper presents a deep learning approach to solve the POPF problem efficiently and accurately. Taking advantage of the deep structure and reconstructive strategy of stacked denoising auto encoders (SDAE), a SDAE-based optimal power flow (OPF) is developed to extract the high-level nonlinear correlations between the system operating condition and the OPF solution. A training process is designed to learn the feature of POPF. The trained SDAE network can be utilized to conveniently calculate the OPF solution of random samples generated by Monte-Carlo simulation (MCS) without the need of optimization. A modified IEEE 118-bus power system is simulated to demonstrate the effectiveness of the proposed method.

eess.SP↗

arXiv2017

Rebalancing with Linear and Quadratic Costs

We consider a market consisting of one safe and one risky asset, which offer constant investment opportunities. Taking into account both proportional transaction costs and linear price impact, we derive optimal rebalancing policies for representative investors with constant relative risk aversion and a long horizon.

q-fin.PM↗

arXiv2017

Optimal Rebalancing Frequencies for Multidimensional Portfolios

We study optimal investment with multiple assets in the presence of small proportional transaction costs. Rather than computing an asymptotically optimal no-trade region, we optimize over suitable trading frequencies. We derive explicit formulas for these and the associated welfare losses due to small transaction costs in a general, multidimensional diffusion setting, and compare their performance to a number of alternatives using Monte Carlo simulations.

q-fin.PM↗

arXiv2015

Detection efficiency evaluation for a large area neutron sensitive microchannel plate detector

In this paper, the detection efficiency of a large area neutron sensitive microchannel plate detector has been evaluated. A 6LiF/ZnS detector was employed as the benchmark detector, the TOF spectra of these two detectors were simultaneously measured and the energy spectra were then deduced to calculate the detection efficiency curve of the nMCP detector. Tests show the detection efficiency@25.3 meV thermal neutron is 34% for this nMCP detector.

physics.ins-det↗

arXiv2013

Portfolio Choice with Stochastic Investment Opportunities: a User's Guide

This survey reviews portfolio choice in settings where investment opportunities are stochastic due to, e.g., stochastic volatility or return predictability. It is explained how to heuristically compute candidate optimal portfolios using tools from stochastic control, and how to rigorously verify their optimality by means of convex duality. Special emphasis is placed on long-horizon asymptotics, that lead to particularly tractable results.

q-fin.PM↗

arXiv2013

Portfolio Selection with Small Transaction Costs and Binding Portfolio Constraints

An investor with constant relative risk aversion and an infinite planning horizon trades a risky and a safe asset with constant investment opportunities, in the presence of small transaction costs and a binding exogenous portfolio constraint. We explicitly derive the optimal trading policy, its welfare, and implied trading volume. As an application, we study the problem of selecting a prime broker among alternatives with different lending rates and margin requirements. Moreover, we discuss how changing regulatory constraints affect the deposit rates offered for illiquid loans.

q-fin.PM↗