SearcharxivSearch

arXiv subjects

Filip Pawlowski

Publications and source records attributed to Filip Pawlowski.

4 recordsLinked to original sources

Faster Distributed Inference-Only Recommender Systems via Bounded Lag Synchronous Collectives

Recommender systems are enablers of personalized content delivery, and therefore revenue, for many large companies. In the last decade, deep learning recommender models (DLRMs) are the de-facto standard in this field. The main bottleneck in DLRM inference is the lookup of sparse features across huge embedding tables, which are usually partitioned across the aggregate RAM of many nodes. In state-of-the-art recommender systems, the distributed lookup is implemented via irregular all-to-all (alltoallv) communication, and often presents the main bottleneck. Today, most related work sees this operation as a given; in addition, every collective is synchronous in nature. In this work, we propose a novel bounded lag synchronous (BLS) version of the alltoallv operation. The bound can be a parameter allowing slower processes to lag behind entire iterations before the fastest processes block. In special applications such as inference-only DLRM, the accuracy of the application is fully preserved. We implement BLS alltoallv in a new PyTorch Distributed backend and evaluate it with a BLS version of the reference DLRM code. We show that for well balanced, homogeneous-access DLRM runs our BLS technique does not offer notable advantages. But for unbalanced runs, e.g. runs with strongly irregular embedding table accesses or with delays across different processes, our BLS technique improves both the latency and throughput of inference-only DLRM. In the best-case scenario, the proposed reduced synchronisation can mask the delays across processes altogether.

cs.DC

Femtosecond two-photon photoassociation of hot magnesium atoms: A quantum dynamical study using thermal random phase wavefunctions

Two-photon photoassociation of hot magnesium atoms by femtosecond laser pulses, creating electronically excited magnesium dimer molecules, is studied from first principles, combining \textit{ab initio} quantum chemistry and molecular quantum dynamics. This theoretical framework allows for rationalizing the generation of molecular rovibrational coherence from thermally hot atoms [L. Rybak \textit{et al.}, Phys. Rev. Lett. {\bf 107}, 273001 (2011)]. Random phase thermal wave functions are employed to model the thermal ensemble of hot colliding atoms. Comparing two different choices of basis functions, random phase wavefunctions built from eigenstates are found to have the fastest convergence for the photoassociation yield. The interaction of the colliding atoms with a femtosecond laser pulse is modeled non-perturbatively to account for strong-field effects.

quant-ph

Rovibrational dynamics of the strontium molecule in the A^1Σ_u^+, c^3Π_u, and a^3Σ_u^+ manifold from state-of-the-art ab initio calculations

State-of-the-art ab initio techniques have been applied to compute the potential energy curves for the electronic states in the A^1Σ_u^+, c^3Π_u, and a^3Σ_u^+ manifold of the strontium dimer, the spin-orbit and nonadiabatic coupling matrix elements between the states in the manifold, and the electric transition dipole moment from the ground X^1Σ_g^+ to the nonrelativistic and relativistic states in the A+c+a manifold. The potential energy curves and transition moments were obtained with the linear response (equation of motion) coupled cluster method limited to single, double, and linear triple excitations for the potentials and limited to single and double excitations for the transition moments. The spin-orbit and nonadiabatic coupling matrix elements were computed with the multireference configuration interaction method limited to single and double excitations. Our results for the nonrelativistic and relativistic (spin-orbit coupled) potentials deviate substantially from recent ab initio calculations. The potential energy curve for the spectroscopically active (1)0_u^+ state is in quantitative agreement with the empirical potential fitted to high-resolution Fourier transform spectra [A. Stein, H. Knoeckel, and E. Tiemann, Eur. Phys. J. D 64, 227 (2011)]. The computed ab initio points were fitted to physically sound analytical expressions, and used in converged coupled channel calculations of the rovibrational energy levels in the A+c+a manifold and line strengths for the A^1Σ_u^+ <-- X^1Σ_g^+ transitions. Positions and lifetimes of quasi-bound Feshbach resonances lying above the ^1S + ^3P_1 dissociation limit were also obtained. Our results reproduce (semi)quantitatively the experimental data observed thus far. Predictions for on-going and future experiments are also reported.

physics.chem-ph

Formation of ultracold SrYb molecules in an optical lattice by photoassociation spectroscopy: theoretical prospects

State-of-the-art {\em ab initio} techniques have been applied to compute the potential energy curves for the SrYb molecule in the Born-Oppenheimer approximation for the ground state and first fifteen excited singlet and triplet states within the coupled-cluster framework. The leading long-range coefficients describing the dispersion interactions at large interatomic distances are also reported. The electric transition dipole moments have been obtained as the first residue of the polarization propagator computed with the linear response coupled-cluster method restricted to single and double excitations. Spin-orbit coupling matrix elements have been evaluated using the multireference configuration interaction method restricted to single and double excitations with a large active space. The electronic structure data was employed to investigate the possibility of forming deeply bound ultracold SrYb molecules in an optical lattice in a photoassociation experiment using continuous-wave lasers. Photoassociation near the intercombination line transition of atomic strontium into the vibrational levels of the strongly spin-orbit mixed $b^3Σ^+$, $a^3Π$, $A^1Π$, and $C^1Π$ states with subsequent efficient stabilization into the $v^{\prime\prime}=1$ vibrational level of the electronic ground state is proposed. Ground state SrYb molecules can be accumulated by making use of collisional decay from $v^{\prime\prime}=1$ to $v^{\prime\prime}=0$. Alternatively, photoassociation and stabilization to $v^{\prime\prime}=0$ can proceed via stimulated Raman adiabatic passage provided that the trapping frequency of the optical lattice is large enough and phase coherence between the pulses can be maintained over at least tens of microseconds.

physics.atom-ph