SearcharxivSearch

arXiv subjects

Li Pu

Publications and source records attributed to Li Pu.

4 recordsLinked to original sources

ReflectWorld-MM: An Entity-Oriented Multimodal Memory System for Open-Ended Video Streams

Building assistants that can continually watch the world, remember what they see, and reason over their accumulated experience is a long-standing goal, and recently multimodal agents equipped with long-term memory over video streams have attracted increasing interest. Unfortunately, existing systems either keep their memory inside the model context or in a flat feature store, and organize it around frames rather than around the persistent entities a stream is really about, which confines them to bounded videos and weakens their ability to track who and what reappears over time. In this paper, we propose ReflectWorld-MM, an entity-oriented multimodal memory system for open-ended video streams. It consists of three parts. The first is a perception front-end that turns an audiovisual stream into entity-resolved observations under a bounded short-term memory. The second is a hierarchical long-term memory, grounded in human memory theory, that couples a multi-scale episodic memory, an evolving entity-centric semantic memory, and a procedural memory. The third is a complete realization, built for real-world operation, that ingests arbitrary streams and plugs into off-the-shelf assistants. Across six long-video and lifelong-memory benchmarks, ReflectWorld-MM achieves the best accuracy on all six, outperforming strong memory agents and a frontier model.

cs.CV

A high entropy alloy as very low melting point solder for advanced electronic packaging

SnBiInZn based high entropy alloy (HEA) was studied as a low reflow temperature solder with melting point around 80 oC. The wetting angle is about 52o after reflow at 100 oC for 10 min. The interfacial intermetallic compound (IMC) growth kinetics was measured to be ripening-control with a low activation energy about 18.0 kJ/mol, however, the interfacial reaction rate is very slow, leading to the formation of a very thin IMC layer. The low melting point HEA solder has potential applications in advanced electronic packaging technology, especially for bio-medical devices.

physics.app-ph

Matrix Computations and Optimization in Apache Spark

We describe matrix computations available in the cluster programming framework, Apache Spark. Out of the box, Spark provides abstractions and implementations for distributed matrices and optimization routines using these matrices. When translating single-node algorithms to run on a distributed cluster, we observe that often a simple idea is enough: separating matrix operations from vector operations and shipping the matrix operations to be ran on the cluster, while keeping vector operations local to the driver. In the case of the Singular Value Decomposition, by taking this idea to an extreme, we are able to exploit the computational power of a cluster, while running code written decades ago for a single core. Another example is our Spark port of the popular TFOCS optimization package, originally built for MATLAB, which allows for solving Linear programs as well as a variety of other convex programs. We conclude with a comprehensive set of benchmarks for hardware accelerated matrix computations from the JVM, which is interesting in its own right, as many cluster programming frameworks use the JVM. The contributions described in this paper are already merged into Apache Spark and available on Spark installations by default, and commercially supported by a slew of companies which provide further services.

cs.DC

The Experiment and results of Laser Ranging to Space Debris

Space debris is a major problem for all space-active nations. Adopting high precision measuring techniques will help to produce the reliable and accurate catalogue for space debris and collision avoidance. Laser Ranging is a kind of real-time measuring technology with high precision for space debris observation. The first experiment of laser ranging to the space debris in China was performed at the Shanghai Observatory in July 2008 at the ranging precision of about 60- 80cm. The experiment results show that the return signals from the targets with the range of 900 km were quite strong with the power of 40W (2J@20Hz), 10ns pulse width laser at 532nm wavelength. The performances of preliminary laser ranging system and the observed results in 2008 and 2010 are introduced in the paper.

astro-ph.IM