Searcharxiv⌕ Search

arXiv subjects

Ilia Petrov

Publications and source records attributed to Ilia Petrov.

15 recordsLinked to original sources

Bringing Data Transformations Near-Memory for Low-Latency Analytics in HTAP Environments

In this paper we propose an approach for executing data transformations near- or in-storage on intelligent storage systems. The currently prevailing approach of extracting the data and then transforming it to a target format suffers degraded performance during transformation and causes heavy data movement. Our results show robust performance of foreground workloads and lower resource contention. Our vision draws architectural opportunities in multi-engine and multi-system settings, as well as for reuse.

cs.DB↗

PUL: Pre-load in Software for Caches Wouldn't Always Play Along

Memory latencies and bandwidth are major factors, limiting system performance and scalability. Modern CPUs aim at hiding latencies by employing large caches, out-of-order execution, or complex hardware prefetchers. However, software-based prefetching exhibits higher efficiency, improving with newer CPU generations. In this paper we investigate software-based, post-Moore systems that offload operations to intelligent memories. We show that software-based prefetching has even higher potential in near-data processing settings by maximizing compute utilization through compute/IO interleaving.

cs.DB↗

Development of crystal optics for Multi-Projection X-ray Imaging for synchrotron and XFEL sources

X-ray Multi-Projection Imaging (XMPI) is an emerging technology that allows for the acquisition of millions of 3D images per second in samples opaque to visible light. This breakthrough capability enables volumetric observation of fast stochastic phenomena, which were inaccessible due to the lack of a volumetric X-ray imaging probe with kHz to MHz repetition rate. These include phenomena of industrial and societal relevance such as fractures in solids, propagation of shock waves, laser-based 3D printing, or even fast processes in the biological domain. Indeed, the speed of traditional tomography is limited by the shear forces caused by rotation, to a maximum of 1000 Hz in state-of-the-art tomography. Moreover, the shear forces can disturb the phenomena in observation, in particular with soft samples or sensitive phenomena such as fluid dynamics. XMPI is based on splitting an X-ray beam to generate multiple simultaneous views of the sample, therefore eliminating the need for rotation. The achievable performances depend on the characteristics of the X-ray source, the detection system, and the X-ray optics used to generate the multiple views. The increase in power density of the X-ray sources around the world now enables 3D imaging with sampling speeds in the kilohertz range at synchrotrons and megahertz range at X-ray Free-Electron Lasers (XFELs). Fast detection systems are already available, and 2D MHz imaging was already demonstrated at synchrotron and XFEL. In this work, we explore the properties of X-ray splitter optics and XMPI schemes that are compatible with synchrotron insertion devices and XFEL X-ray beams. We describe two possible schemes designed to permit large samples and complex sample environments. Then, we present experimental proof of the feasibility of MHz-rate XMPI at the European XFEL.

physics.ins-det↗

Development towards high-resolution kHz-speed rotation-free volumetric imaging

X-ray multi-projection imaging (XMPI) provides rotation-free 3D movies of optically opaque samples. The absence of rotation enables superior imaging speed and preserves fragile sample dynamics by avoiding the shear forces introduced by conventional rotary tomography. Here, we present our XMPI observations at the ID19 beamline (ESRF, France) of 3D dynamics in melted aluminum with 1000 frames per second and 8 $μ$m resolution per projection using the full dynamical range of our detectors. Since XMPI is a method under development, we also provide different tests for the instrumentation of up to 3000 frames per second. As the flux of X-ray sources grows globally, XMPI is a promising technique for current and future X-ray imaging instruments.

physics.ins-det↗

Megahertz X-ray Multi-projection imaging

X-ray time-resolved tomography is one of the most popular X-ray techniques to probe dynamics in three dimensions (3D). Recent developments in time-resolved tomography opened the possibility of recording kilohertz-rate 3D movies. However, tomography requires rotating the sample with respect to the X-ray beam, which prevents characterization of faster structural dynamics. Here, we present megahertz (MHz) X-ray multi-projection imaging (MHz-XMPI), a technique capable of recording volumetric information at MHz rates and micrometer resolution without scanning the sample. We achieved this by harnessing the unique megahertz pulse structure and intensity of the European X-ray Free-electron Laser with a combination of novel detection and reconstruction approaches that do not require sample rotations. Our approach enables generating multiple X-ray probes that simultaneously record several angular projections for each pulse in the megahertz pulse burst. We provide a proof-of-concept demonstration of the MHz-XMPI technique's capability to probe 4D (3D+time) information on stochastic phenomena and non-reproducible processes three orders of magnitude faster than state-of-the-art time-resolved X-ray tomography, by generating 3D movies of binary droplet collisions. We anticipate that MHz-XMPI will enable in-situ and operando studies that were impossible before, either due to the lack of temporal resolution or because the systems were opaque (such as for MHz imaging based on optical microscopy).

eess.IV↗

Absolute spectral metrology of XFEL pulses using diffraction in crystals

At modern X-ray sources, such as synchrotrons and X-ray Free-Electron Lasers (XFELs), it is important to measure the absolute value of the photon energy directly. Here, a method for absolute spectral metrology is presented. A photon energy estimation method based on the spectral measurements and rocking of diffracting crystals is presented. The photon energy of SASE1 channel of the European XFEL was measured, and the benefits and applications of the precise photon energy evaluation are discussed.

physics.ins-det↗

Storage Management with Multi-Version Partitioned B-Trees

Database Management Systems and K/V-Stores operate on updatable datasets -- massively exceeding the size of available main memory. Tree-based K/V storage management structures became particularly popular in storage engines. B+ Trees allow constant search performance, however write-heavy workloads yield in inefficient write patterns to secondary storage devices and poor performance characteristics. LSM-Trees overcome this issue by horizontal partitioning fractions of data - small enough to fully reside in main memory, but require frequent maintenance to sustain search performance. Firstly, we propose Multi-Version Partitioned BTrees (MV-PBT) as sole storage and index management structure in key-sorted storage engines like K/V-Stores. Secondly, we compare MV-PBT against LSM-Trees. The logical horizontal partitioning in MV-PBT allows leveraging recent advances in modern B$^+$-Tree techniques in a small transparent and memory resident portion of the structure. Structural properties sustain steady read performance, yielding efficient write patterns and reducing write amplification. We integrated MV-PBT in the WiredTiger KV storage engine. MV-PBT offers an up to 2x increased steady throughput in comparison to LSM-Trees and several orders of magnitude in comparison to B+ Trees in a YCSB workload.

cs.DB↗

bloomRF: On Performing Range-Queries in Bloom-Filters with Piecewise-Monotone Hash Functions and Prefix Hashing

We introduce bloomRF as a unified method for approximate membership testing that supports both point- and range-queries. As a first core idea, bloomRF introduces novel prefix hashing to efficiently encode range information in the hash-code of the key itself. As a second key concept, bloomRF proposes novel piecewise-monotone hash-functions that preserve local order and support fast range-lookups with fewer memory accesses. bloomRF has near-optimal space complexity and constant query complexity. Although, bloomRF is designed for integer domains, it supports floating-points, and can serve as a multi-attribute filter. The evaluation in RocksDB and in a standalone library shows that it is more efficient and outperforms existing point-range-filters by up to 4x across a range of settings and distributions, while keeping the false-positive rate low.

cs.DB↗

bloomRF: On Performing Range-Queries with Bloom-Filters based on Piecewise-Monotone Hash Functions and Dyadic Trace-Trees

We introduce bloomRF as a unified method for approximate membership testing that supports both point- and range-queries on a single data structure. bloomRF extends Bloom-Filters with range query support and may replace them. The core idea is to employ a dyadic interval scheme to determine the set of dyadic intervals covering a data point, which are then encoded and inserted. bloomRF introduces Dyadic Trace-Trees as novel data structure that represents those covering intervals implicitly. A Trace-Tree encoding scheme represents the set of covering intervals efficiently, in a compact bit representation. Furthermore, bloomRF introduces novel piecewise-monotone hash functions that are locally order-preserving and thus support range querying. We present an efficient membership computation method for range-queries. Although, bloomRF is designed for integers it also supports string and floating-point data types. It can also handle multiple attributes and serve as multi-attribute filter. We evaluate bloomRF in RocksDB and in a standalone library. bloomRF is more efficient and outperforms existing point-range-filters by up to 4x across a range of settings.

cs.DB↗

AnyDB: An Architecture-less DBMS for Any Workload

In this paper, we propose a radical new approach for scale-out distributed DBMSs. Instead of hard-baking an architectural model, such as a shared-nothing architecture, into the distributed DBMS design, we aim for a new class of so-called architecture-less DBMSs. The main idea is that an architecture-less DBMS can mimic any architecture on a per-query basis on-the-fly without any additional overhead for reconfiguration. Our initial results show that our architecture-less DBMS AnyDB can provide significant speed-ups across varying workloads compared to a traditional DBMS implementing a static architecture.

cs.DB↗

f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentation

Deep neural networks have become a mainstream approach to interactive segmentation. As we show in our experiments, while for some images a trained network provides accurate segmentation result with just a few clicks, for some unknown objects it cannot achieve satisfactory result even with a large amount of user input. Recently proposed backpropagating refinement (BRS) scheme introduces an optimization problem for interactive segmentation that results in significantly better performance for the hard cases. At the same time, BRS requires running forward and backward pass through a deep network several times that leads to significantly increased computational budget per click compared to other methods. We propose f-BRS (feature backpropagating refinement scheme) that solves an optimization problem with respect to auxiliary variables instead of the network inputs, and requires running forward and backward pass just for a small part of a network. Experiments on GrabCut, Berkeley, DAVIS and SBD datasets set new state-of-the-art at an order of magnitude lower time per click compared to original BRS. The code and trained models are available at https://github.com/saic-vul/fbrs_interactive_segmentation .

cs.CV↗

Resolution of a bent-crystal spectrometer for X-ray free electron laser pulses: diamond vs. silicon

The resolution function of a spectrometer based on a strongly bent single crystal (bending radius of 10 cm or less) is evaluated. It is shown that the resolution is controlled by two parameters, (i) the ratio of the lattice spacing of the chosen reflection to the crystal thickness and (ii) a single parameter comprising crystal thickness, its bending radius, and anisotropic elastic constants of the chosen crystal. Diamond, due to its unique elastic properties, can provide notably higher resolution than silicon. The results allow to optimize the parameters of bent crystal spectrometers for the hard X-ray free electron laser sources.

physics.ins-det↗

MV-PBT: Multi-Version Index for Large Datasets and HTAP Workloads

Modern mixed (HTAP) workloads execute fast update-transactions and long-running analytical queries on the same dataset and system. In multi-version (MVCC) systems, such workloads result in many short-lived versions and long version-chains as well as in increased and frequent maintenance overhead. Consequently, the index pressure increases significantly. Firstly, the frequent modifications cause frequent creation of new versions, yielding a surge in index maintenance overhead. Secondly and more importantly, index-scans incur extra I/O overhead to determine, which of the resulting tuple-versions are visible to the executing transaction (visibility-check) as current designs only store version/timestamp information in the base table -- not in the index. Such index-only visibility-check is critical for HTAP workloads on large datasets. In this paper we propose the Multi-Version Partitioned B-Tree (MV-PBT) as a version-aware index structure, supporting index-only visibility checks and flash-friendly I/O patterns. The experimental evaluation indicates a 2x improvement for analytical queries and 15% higher transactional throughput under HTAP workloads (CH-Benchmark). MV-PBT offers 40% higher transactional throughput compared to WiredTiger's LSM-Tree implementation under YCSB.

cs.DB↗

X-ray diffraction from strongly bent crystals and spectroscopy of XFEL pulses

The use of strongly bent crystals in spectrometers for pulses of a hard x-ray free-electron laser is explored theoretically. Diffraction is calculated in both dynamical and kinematical theories. It is shown that diffraction can be treated kinematically when the bending radius is small compared to the critical radius given by the ratio of the Bragg-case extinction length for the actual reflection to the Darwin width of this reflection. As a result, the spectral resolution is limited by the crystal thickness, rather than the extinction length, and can become better than the resolution of a planar dynamically diffracting crystal. As an example, we demonstrate that spectra of the 12 keV pulses can be resolved in 440 reflection from a 20 micron thick diamond crystal bent to a radius of 10 cm.

physics.ins-det↗

Moving Processing to Data: On the Influence of Processing in Memory on Data Management

Near-Data Processing refers to an architectural hardware and software paradigm, based on the co-location of storage and compute units. Ideally, it will allow to execute application-defined data- or compute-intensive operations in-situ, i.e. within (or close to) the physical data storage. Thus, Near-Data Processing seeks to minimize expensive data movement, improving performance, scalability, and resource-efficiency. Processing-in-Memory is a sub-class of Near-Data processing that targets data processing directly within memory (DRAM) chips. The effective use of Near-Data Processing mandates new architectures, algorithms, interfaces, and development toolchains.

cs.DB↗