SearcharxivSearch

arXiv subjects

Taichi Nakamura

Publications and source records attributed to Taichi Nakamura.

11 recordsLinked to original sources

BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOT

Real-time 3D trajectory player tracking in sports plays a crucial role in tactical analysis, performance evaluation, and enhancing spectator experience. Traditional systems rely on multi-camera setups, but are constrained by the inherently two-dimensional nature of video data and the need for complex 3D reconstruction processing, making real-time analysis challenging. Basketball, in particular, represents one of the most difficult scenarios in the MOT field, as ten players move rapidly and complexly within a confined court space, with frequent occlusions caused by intense physical contact. To address these challenges, this paper constructs BasketLiDAR, the first multimodal dataset in the sports MOT field that combines LiDAR point clouds with synchronized multi-view camera footage in a professional basketball environment, and proposes a novel MOT framework that simultaneously achieves improved tracking accuracy and reduced computational cost. The BasketLiDAR dataset contains a total of 4,445 frames and 3,105 player IDs, with fully synchronized IDs between three LiDAR sensors and three multi-view cameras. We recorded 5-on-5 and 3-on-3 game data from actual professional basketball players, providing complete 3D positional information and ID annotations for each player. Based on this dataset, we developed a novel MOT algorithm that leverages LiDAR's high-precision 3D spatial information. The proposed method consists of a real-time tracking pipeline using LiDAR alone and a multimodal tracking pipeline that fuses LiDAR and camera data. Experimental results demonstrate that our approach achieves real-time operation, which was difficult with conventional camera-only methods, while achieving superior tracking performance even under occlusion conditions. The dataset is available upon request at: https://sites.google.com/keio.jp/keio-csg/projects/basket-lidar

cs.CV

Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks

The recent development of high-performance computing enables us to generate spatio-temporal high-resolution data of nonlinear dynamical systems and to analyze them for a deeper understanding of their complex nature. This trend can be found in a wide range of science and engineering, which suggests that detailed investigations on efficient data handling in physical science must be required in the future. This study considers the use of convolutional neural networks (CNNs) to achieve efficient data storage and estimation of scientific big data derived from nonlinear dynamical systems. The CNN is used to reconstruct three-dimensional data from a few numbers of two-dimensional sections in a computationally friendly manner. The present model is a combination of two- and three-dimensional CNNs, which allows users to save only some of the two-dimensional sections to reconstruct the volumetric data. As examples, we consider a flow around a square cylinder at the diameter-based Reynolds number $Re_D = 300$. We demonstrate that volumetric fluid flow data can be reconstructed with the present method from as few as five sections. Furthermore, we propose a combination of the present CNN-based reconstruction with an adaptive sampling-based super-resolution analysis to augment the data compressibility. Our report can serve as a bridge toward practical data handling for not only fluid mechanics but also a broad range of physical sciences.

physics.flu-dyn

Spoken Dialogue System Based on Attribute Vector for Travel Agent Robot

In this study, we develop a dialogue system for a dialogue robot competition. In the system, the characteristics of sightseeing spots are expressed as "attribute vectors" in advance, and the user is questioned on the different attributes of the two candidate spots. Consequently, the system can make recommendations based on user intentions. A dialogue experiment is conducted during a preliminary round of competition. The overall satisfaction score obtained is 40.1 out of 63 points, which is a reasonable result. Analysis of the relationship between the system behavior and satisfaction scores reveals that satisfaction increases when the system correctly understands the user intention and responds appropriately. However, a negative correlation is observed between the number of user utterances and the satisfaction score. This implies that inappropriate responses reduce the usefulness of the system as a consultation partner.

cs.HC

Catalog of High Velocity Dispersion Compact Clouds in the Central Molecular Zone of Our Galaxy

This study developed an automated identification procedure for compact clouds with broad velocity widths in the spectral line data cubes of highly crowded regions. The procedure was applied to the CO J=3-2 line data, obtained using the James Clerk Maxwell Telescope, to identify 184 high velocity dispersion compact clouds (HVCCs), which is a category of peculiar molecular clouds found in the central molecular zone of our galaxy. A list of HVCCs in the area -1.4°<l<+2.0°, -0.25°<b<+0.25° was presented with their physical parameters, CO J=3-2/J=1-0 intensity ratios, and morphological classifications. Consequently, the list provides several intriguing sources that may have been driven by encounters with point-like massive objects, local energetic events, or cloud-to-cloud collisions.

astro-ph.GA

Robust training approach of neural networks for fluid flow state estimations

State estimation from limited sensor measurements is ubiquitously found as a common challenge in a broad range of fields including mechanics, astronomy, and geophysics. Fluid mechanics is no exception -- state estimation of fluid flows is particularly important for flow control and processing of experimental data. However, strong nonlinearities and spatio-temporal high degrees of freedom of fluid flows cause difficulties in reasonable estimations. To handle these issues, neural networks (NNs) have recently been applied to the fluid flow estimation instead of conventional linear methods. The present study focuses on the capability of NNs to various fluid flow estimation problems from a practical viewpoint regarding robust training. Three types of unsteady laminar and turbulent flows are considered for the present demonstration: 1. square cylinder wake, 2. turbulent channel flow, and 3. laminar to turbulent transitional boundary layer. We utilize a convolutional neural network (CNN) to estimate velocity fields from sectional sensor measurements. To assess the practicability of the CNN models, physical quantities required for the input and robustness against lack of sensors are investigated. We also examine the effectiveness of several considerable approaches for model training to gain more robustness against the lack of sensors. The knowledge acquired through the present study in terms of effective training approaches can be transferred towards practical machine learning in fluid flow modeling.

physics.flu-dyn

Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions

Neural networks (NNs) and linear stochastic estimation (LSE) have widely been utilized as powerful tools for fluid-flow regressions. We investigate fundamental differences between them considering two canonical fluid-flow problems: 1. the estimation of high-order proper orthogonal decomposition coefficients from low-order their counterparts for a flow around a two-dimensional cylinder, and 2. the state estimation from wall characteristics in a turbulent channel flow. In the first problem, we compare the performance of LSE to that of a multi-layer perceptron (MLP). With the channel flow example, we capitalize on a convolutional neural network (CNN) as a nonlinear model which can handle high-dimensional fluid flows. For both cases, the nonlinear NNs outperform the linear methods thanks to nonlinear activation functions. We also perform error-curve analyses regarding the estimation error and the response of weights inside models. Our analysis visualizes the robustness against noisy perturbation on the error-curve domain while revealing the fundamental difference of the covered tools for fluid-flow regressions.

physics.flu-dyn

Model order reduction with neural networks: Application to laminar and turbulent flows

We investigate the capability of neural network-based model order reduction, i.e., autoencoder (AE), for fluid flows. As an example model, an AE which comprises of a convolutional neural network and multi-layer perceptrons is considered in this study. The AE model is assessed with four canonical fluid flows, namely: (1) two-dimensional cylinder wake, (2) its transient process, (3) NOAA sea surface temperature, and (4) $y-z$ sectional field of turbulent channel flow, in terms of a number of latent modes, a choice of nonlinear activation functions, and a number of weights contained in the AE model. We find that the AE models are sensitive against the choice of the aforementioned parameters depending on the target flows. Finally, we foresee the extensional applications and perspectives of machine learning based order reduction for numerical and experimental studies in fluid dynamics community.

physics.flu-dyn

Inserting machine-learned virtual wall velocity for large-eddy simulation of turbulent channel flows

We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall ($\sim$ 10 wall units), while still resolving the near-wall region, to present a new path to save the computational cost. Convolutional neural network (CNN) is utilized to estimate a virtual wall-surface velocity from $x-z$ sectional fields near the wall, whose training data are generated by a direct numerical simulation (DNS) at ${\rm Re}_τ=180$. The virtual wall-surface velocity is prepared with the extrapolation of the DNS data near the wall. This idea enables us to give a proper wall condition to correct a velocity gradient near the wall. The estimation ability of the model from near wall information is first investigated as a priori test. The estimated velocity fields by the present CNN model are in statistical agreement with the reference DNS data. The model trained in a priori test is then combined with the LES as a posteriori test. We find that the LES can successfully be augmented using the present model at both the friction Reynolds number ${\rm Re}_τ=180$ used for training and the unseen Reynolds number ${\rm Re}_τ=360$ even when the first grid point is located at 5 wall units off the wall. We also investigate the robustness of the present model for the choice of sub-grid scale model and the possibility of transfer learning in a local domain. The observations through the paper suggest that the present model is a promising tool for recovering the accuracy of LES with a coarse grid near the wall.

physics.flu-dyn

Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow

We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_τ=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed by combining a three-dimensional convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM). The CNN-AE works to map high-dimensional flow fields into a low-dimensional latent space. The LSTM is then utilized to predict a temporal evolution of the latent vectors obtained by the CNN-AE. The combination of CNN-AE and LSTM can represent the spatio-temporal high-dimensional dynamics of flow fields by only integrating the temporal evolution of the low-dimensional latent dynamics. The turbulent flow fields reproduced by the present ML-ROM show statistical agreement with the reference DNS data in time-ensemble sense, which can also be found through an orbit-based analysis. Influences of the population of vortical structures contained in the domain and the time interval used for temporal prediction on the ML- ROM performance are also investigated. The potential and limitation of the present ML-ROM for turbulence analysis are discussed at the end of our presentation.

physics.flu-dyn

Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data

We propose a customized convolutional neural network based autoencoder called a hierarchical autoencoder, which allows us to extract nonlinear autoencoder modes of flow fields while preserving the contribution order of the latent vectors. As preliminary tests, the proposed method is first applied to a cylinder wake at $Re_D$ = 100 and its transient process. It is found that the proposed method can extract the features of these laminar flow fields as the latent vectors while keeping the order of their energy content. The present hierarchical autoencoder is further assessed with a two-dimensional $y-z$ cross-sectional velocity field of turbulent channel flow at $Re_τ$ = 180 in order to examine its applicability to turbulent flows. It is demonstrated that the turbulent flow field can be efficiently mapped into the latent space by utilizing the hierarchical model with a concept of ordered autoencoder mode family. The present results suggest that the proposed concept can be extended to meet various demands in fluid dynamics including reduced order modeling and its combination with linear theory-based methods by using its ability to arrange the order of the extracted nonlinear modes.

physics.comp-ph

Quantum self-learning Monte Carlo with quantum Fourier transform sampler

The self-learning Metropolis-Hastings algorithm is a powerful Monte Carlo method that, with the help of machine learning, adaptively generates an easy-to-sample probability distribution for approximating a given hard-to-sample distribution. This paper provides a new self-learning Monte Carlo method that utilizes a quantum computer to output a proposal distribution. In particular, we show a novel subclass of this general scheme based on the quantum Fourier transform circuit; this sampler is classically simulable while having a certain advantage over conventional methods. The performance of this "quantum inspired" algorithm is demonstrated by some numerical simulations.

quant-ph