SearcharxivSearch

arXiv subjects

Pouria Mistani

Publications and source records attributed to Pouria Mistani.

4 recordsLinked to original sources

Preference optimization of protein language models as a multi-objective binder design paradigm

We present a multi-objective binder design paradigm based on instruction fine-tuning and direct preference optimization (DPO) of autoregressive protein language models (pLMs). Multiple design objectives are encoded in the language model through direct optimization on expert curated preference sequence datasets comprising preferred and dispreferred distributions. We show the proposed alignment strategy enables ProtGPT2 to effectively design binders conditioned on specified receptors and a drug developability criterion. Generated binder samples demonstrate median isoelectric point (pI) improvements by $17\%-60\%$.

physics.bio-ph

JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuities

We present a scalable strategy for development of mesh-free hybrid neuro-symbolic partial differential equation solvers based on existing mesh-based numerical discretization methods. Particularly, this strategy can be used to efficiently train neural network surrogate models of partial differential equations by (i) leveraging the accuracy and convergence properties of advanced numerical methods, solvers, and preconditioners, as well as (ii) better scalability to higher order PDEs by strictly limiting optimization to first order automatic differentiation. The presented neural bootstrapping method (hereby dubbed NBM) is based on evaluation of the finite discretization residuals of the PDE system obtained on implicit Cartesian cells centered on a set of random collocation points with respect to trainable parameters of the neural network. Importantly, the conservation laws and symmetries present in the bootstrapped finite discretization equations inform the neural network about solution regularities within local neighborhoods of training points. We apply NBM to the important class of elliptic problems with jump conditions across irregular interfaces in three spatial dimensions. We show the method is convergent such that model accuracy improves by increasing number of collocation points in the domain and predonditioning the residuals. We show NBM is competitive in terms of memory and training speed with other PINN-type frameworks. The algorithms presented here are implemented using \texttt{JAX} in a software package named \texttt{JAX-DIPS} (https://github.com/JAX-DIPS/JAX-DIPS), standing for differentiable interfacial PDE solver. We open sourced \texttt{JAX-DIPS} to facilitate research into use of differentiable algorithms for developing hybrid PDE solvers.

math.NA

Neuro-symbolic partial differential equation solver

We present a highly scalable strategy for developing mesh-free neuro-symbolic partial differential equation solvers from existing numerical discretizations found in scientific computing. This strategy is unique in that it can be used to efficiently train neural network surrogate models for the solution functions and the differential operators, while retaining the accuracy and convergence properties of state-of-the-art numerical solvers. This neural bootstrapping method is based on minimizing residuals of discretized differential systems on a set of random collocation points with respect to the trainable parameters of the neural network, achieving unprecedented resolution and optimal scaling for solving physical and biological systems.

math.NA

A parallel Voronoi-based approach for mesoscale simulations of cell aggregate electropermeabilization

We introduce a numerical framework that enables unprecedented direct numerical studies of the electropermeabilization effects of a cell aggregate at the meso-scale. Our simulations qualitatively replicate the shadowing effect observed in experiments and reproduce the time evolution of the impedance of the cell sample in agreement with the trends observed in experiments. This approach sets the scene for performing homogenization studies for understanding the effect of tissue environment on the efficiency of electropermeabilization. We employ a forest of Octree grids along with a Voronoi mesh in a parallel environment that exhibits excellent scalability. We exploit the electric interactions between the cells through a nonlinear phenomenological model that is generalized to account for the permeability of the cell membranes. We use the Voronoi Interface Method (VIM) to accurately capture the sharp jump in the electric potential on the cell boundaries. The case study simulation covers a volume of $(1\ mm)^3$ with more than $27,000$ well-resolved cells with a heterogeneous mix of morphologies that are randomly distributed throughout a spheroid region.

physics.comp-ph