Showing 1–50 of 10,557 results for author: Liu, J

Exploring User-level Gradient Inversion with a Diffusion Prior

Authors: Zhuohang Li, Andrew Lowy, Jing Liu, Toshiaki Koike-Akino, Bradley Malin, Kieran Parsons, Ye Wang

Abstract: We explore user-level gradient inversion as a new attack surface in distributed learning. We first investigate existing attacks on their ability to make inferences about private information beyond training data reconstruction. Motivated by the low reconstruction quality of existing methods, we propose a novel gradient inversion attack that applies a denoising diffusion model as a strong image prio… ▽ More We explore user-level gradient inversion as a new attack surface in distributed learning. We first investigate existing attacks on their ability to make inferences about private information beyond training data reconstruction. Motivated by the low reconstruction quality of existing methods, we propose a novel gradient inversion attack that applies a denoising diffusion model as a strong image prior in order to enhance recovery in the large batch setting. Unlike traditional attacks, which aim to reconstruct individual samples and suffer at large batch and image sizes, our approach instead aims to recover a representative image that captures the sensitive shared semantic information corresponding to the underlying user. Our experiments with face images demonstrate the ability of our methods to recover realistic facial images along with private user attributes. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Comments: Presented at the International Workshop on Federated Learning in the Age of Foundation Models in conjunction with NeurIPS 2023

Symplectic singularities arising from algebras of symmetric tensors

Authors: Baohua Fu, Jie Liu

Abstract: The algebra of symmetric tensors $S(X):= H^0(X, \sf{S}^{\bullet} T_X)$ of a projective manifold $X$ leads to a natural dominant affinization morphism $$ \varphi_X: T^*X \longrightarrow \mathcal{Z}_X:= \text{Spec} S(X). $$ It is shown that $\varphi_X$ is birational if and only if $T_X$ is big. We prove that if $\varphi_X$ is birational, then $\mathcal{Z}_X$ is a symplectic variety endowed with… ▽ More The algebra of symmetric tensors $S(X):= H^0(X, \sf{S}^{\bullet} T_X)$ of a projective manifold $X$ leads to a natural dominant affinization morphism $$ \varphi_X: T^*X \longrightarrow \mathcal{Z}_X:= \text{Spec} S(X). $$ It is shown that $\varphi_X$ is birational if and only if $T_X$ is big. We prove that if $\varphi_X$ is birational, then $\mathcal{Z}_X$ is a symplectic variety endowed with the Schouten--Nijenhuis bracket if and only if $\mathbb{P} T_X$ is of Fano type, which is the case for smooth projective toric varieties, smooth horospherical varieties with small boundary and the quintic del Pezzo threefold. These give examples of a distinguished class of conical symplectic varieties, which we call symplectic orbifold cones. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Comments: 39 pages. Any comments are welcome

MSC Class: 14B05; 14J42; 14J45; 14M17; 14M25

Measurements of the $CP$-even fractions of $D^0\toπ^{+}π^{-}π^{0}$ and $D^0\to K^{+}K^{-}π^{0}$ at BESIII

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (648 additional authors not shown)

Abstract: The $CP$-even fractions ($F_{+}$) of the decays $D^0\toπ^{+}π^{-}π^{0}$ and $D^0\to K^{+}K^{-}π^{0}$ are measured with a quantum-correlated $ψ(3770)\to D\bar{D}$ data sample collected by the BESIII experiment corresponding to an integrated luminosity of 7.93 $\mathrm{fb}^{-1}$. The results are $F_{+}^{π^{+}π^{-}π^{0}}=0.9406\pm0.0036\pm0.0021$ and $F_{+}^{K^{+}K^{-}π^{0}}=0.631\pm0.014\pm0.011$, w… ▽ More The $CP$-even fractions ($F_{+}$) of the decays $D^0\toπ^{+}π^{-}π^{0}$ and $D^0\to K^{+}K^{-}π^{0}$ are measured with a quantum-correlated $ψ(3770)\to D\bar{D}$ data sample collected by the BESIII experiment corresponding to an integrated luminosity of 7.93 $\mathrm{fb}^{-1}$. The results are $F_{+}^{π^{+}π^{-}π^{0}}=0.9406\pm0.0036\pm0.0021$ and $F_{+}^{K^{+}K^{-}π^{0}}=0.631\pm0.014\pm0.011$, where the first uncertainties are statistical and the second systematic. These measurements are consistent with the previous determinations, and the uncertainties for $F_{+}^{π^{+}π^{-}π^{0}}$ and $F_{+}^{K^{+}K^{-}π^{0}}$ are reduced by factors of 3.9 and 2.6, respectively. The reported results provide important inputs for the precise measurement of the angle $γ$ of the Cabibbo-Kobayashi-Maskawa matrix and indirect $CP$ violation in charm mixing. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Comments: 19 pages, 8 figures

FuXi-2.0: Advancing machine learning weather forecasting model for practical applications

Authors: Xiaohui Zhong, Lei Chen, Xu Fan, Wenxu Qian, Jun Liu, Hao Li

Abstract: Machine learning (ML) models have become increasingly valuable in weather forecasting, providing forecasts that not only lower computational costs but often match or exceed the accuracy of traditional numerical weather prediction (NWP) models. Despite their potential, ML models typically suffer from limitations such as coarse temporal resolution, typically 6 hours, and a limited set of meteorologi… ▽ More Machine learning (ML) models have become increasingly valuable in weather forecasting, providing forecasts that not only lower computational costs but often match or exceed the accuracy of traditional numerical weather prediction (NWP) models. Despite their potential, ML models typically suffer from limitations such as coarse temporal resolution, typically 6 hours, and a limited set of meteorological variables, limiting their practical applicability. To overcome these challenges, we introduce FuXi-2.0, an advanced ML model that delivers 1-hourly global weather forecasts and includes a comprehensive set of essential meteorological variables, thereby expanding its utility across various sectors like wind and solar energy, aviation, and marine shipping. Our study conducts comparative analyses between ML-based 1-hourly forecasts and those from the high-resolution forecast (HRES) of the European Centre for Medium-Range Weather Forecasts (ECMWF) for various practical scenarios. The results demonstrate that FuXi-2.0 consistently outperforms ECMWF HRES in forecasting key meteorological variables relevant to these sectors. In particular, FuXi-2.0 shows superior performance in wind power forecasting compared to ECMWF HRES, further validating its efficacy as a reliable tool for scenarios demanding precise weather forecasts. Additionally, FuXi-2.0 also integrates both atmospheric and oceanic components, representing a significant step forward in the development of coupled atmospheric-ocean models. Further comparative analyses reveal that FuXi-2.0 provides more accurate forecasts of tropical cyclone intensity than its predecessor, FuXi-1.0, suggesting that there are benefits of an atmosphere-ocean coupled model over atmosphere-only models. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Legal Fact Prediction: Task Definition and Dataset Construction

Authors: Junkai Liu, Yujie Tong, Hui Huang, Shuyuan Zheng, Muyun Yang, Peicheng Wu, Makoto Onizuka, Chuan Xiao

Abstract: Legal facts refer to the facts that can be proven by acknowledged evidence in a trial. They form the basis for the determination of court judgments. This paper introduces a novel NLP task: legal fact prediction, which aims to predict the legal fact based on a list of evidence. The predicted facts can instruct the parties and their lawyers involved in a trial to strengthen their submissions and opt… ▽ More Legal facts refer to the facts that can be proven by acknowledged evidence in a trial. They form the basis for the determination of court judgments. This paper introduces a novel NLP task: legal fact prediction, which aims to predict the legal fact based on a list of evidence. The predicted facts can instruct the parties and their lawyers involved in a trial to strengthen their submissions and optimize their strategies during the trial. Moreover, since real legal facts are difficult to obtain before the final judgment, the predicted facts also serve as an important basis for legal judgment prediction. We construct a benchmark dataset consisting of evidence lists and ground-truth legal facts for real civil loan cases, LFPLoan. Our experiments on this dataset show that this task is non-trivial and requires further considerable research efforts. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Improving Anomalous Sound Detection via Low-Rank Adaptation Fine-Tuning of Pre-Trained Audio Models

Authors: Xinhu Zheng, Anbai Jiang, Bing Han, Yanmin Qian, Pingyi Fan, Jia Liu, Wei-Qiang Zhang

Abstract: Anomalous Sound Detection (ASD) has gained significant interest through the application of various Artificial Intelligence (AI) technologies in industrial settings. Though possessing great potential, ASD systems can hardly be readily deployed in real production sites due to the generalization problem, which is primarily caused by the difficulty of data collection and the complexity of environmenta… ▽ More Anomalous Sound Detection (ASD) has gained significant interest through the application of various Artificial Intelligence (AI) technologies in industrial settings. Though possessing great potential, ASD systems can hardly be readily deployed in real production sites due to the generalization problem, which is primarily caused by the difficulty of data collection and the complexity of environmental factors. This paper introduces a robust ASD model that leverages audio pre-trained models. Specifically, we fine-tune these models using machine operation data, employing SpecAug as a data augmentation strategy. Additionally, we investigate the impact of utilizing Low-Rank Adaptation (LoRA) tuning instead of full fine-tuning to address the problem of limited data for fine-tuning. Our experiments on the DCASE2023 Task 2 dataset establish a new benchmark of 77.75% on the evaluation set, with a significant improvement of 6.48% compared with previous state-of-the-art (SOTA) models, including top-tier traditional convolutional networks and speech pre-trained models, which demonstrates the effectiveness of audio pre-trained models with LoRA tuning. Ablation studies are also conducted to showcase the efficacy of the proposed scheme. △ Less

Submitted 11 September, 2024; originally announced September 2024.

LIME-M: Less Is More for Evaluation of MLLMs

Authors: Kang Zhu, Qianbo Zang, Shian Jia, Siwei Wu, Feiteng Fang, Yizhi Li, Shuyue Guo, Tianyu Zheng, Bo Li, Haoning Wu, Xingwei Qu, Jian Yang, Zachary Liu, Xiang Yue, J. H. Liu, Chenghua Lin, Min Yang, Shiwen Ni, Wenhao Huang, Ge Zhang

Abstract: With the remarkable success achieved by Multimodal Large Language Models (MLLMs), numerous benchmarks have been designed to assess MLLMs' ability to guide their development in image perception tasks (e.g., image captioning and visual question answering). However, the existence of numerous benchmarks results in a substantial computational burden when evaluating model performance across all of them.… ▽ More With the remarkable success achieved by Multimodal Large Language Models (MLLMs), numerous benchmarks have been designed to assess MLLMs' ability to guide their development in image perception tasks (e.g., image captioning and visual question answering). However, the existence of numerous benchmarks results in a substantial computational burden when evaluating model performance across all of them. Moreover, these benchmarks contain many overly simple problems or challenging samples, which do not effectively differentiate the capabilities among various MLLMs. To address these challenges, we propose a pipeline to process the existing benchmarks, which consists of two modules: (1) Semi-Automated Screening Process and (2) Eliminating Answer Leakage. The Semi-Automated Screening Process filters out samples that cannot distinguish the model's capabilities by synthesizing various MLLMs and manually evaluating them. The Eliminate Answer Leakage module filters samples whose answers can be inferred without images. Finally, we curate the LIME-M: Less Is More for Evaluation of Multimodal LLMs, a lightweight Multimodal benchmark that can more effectively evaluate the performance of different models. Our experiments demonstrate that: LIME-M can better distinguish the performance of different MLLMs with fewer samples (24% of the original) and reduced time (23% of the original); LIME-M eliminates answer leakage, focusing mainly on the information within images; The current automatic metric (i.e., CIDEr) is insufficient for evaluating MLLMs' capabilities in captioning. Moreover, removing the caption task score when calculating the overall score provides a more accurate reflection of model performance differences. All our codes and data are released at https://github.com/kangreen0210/LIME-M. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Analog Beamforming Aided by Full-Dimension One-Bit Chains

Authors: Lina Liu, Weimin Xiao, Jialing Liu, Zhigang Rong

Abstract: This paper investigates the design of analog beamforming at the receiver in millimeter-wave (mmWave) multiple-input multiple-output (MIMO) systems, aided by full digital chains featuring 1-bit ADCs. We advocate utilizing these full digital chains to facilitate rapid channel estimation and beam acquisition for subsequent communication, even without prior knowledge of the training pilots. To balance… ▽ More This paper investigates the design of analog beamforming at the receiver in millimeter-wave (mmWave) multiple-input multiple-output (MIMO) systems, aided by full digital chains featuring 1-bit ADCs. We advocate utilizing these full digital chains to facilitate rapid channel estimation and beam acquisition for subsequent communication, even without prior knowledge of the training pilots. To balance energy consumption and implementation costs, we opt for 1-bit ADCs. We propose a two-stage maximum likelihood (ML)-based algorithm to estimate angles of arrival (AoAs) and facilitate the design of analog beamforming to maximize the received signal-to-noise ratio (SNR). We validate our proposed beamforming schemes in narrowband coherent channels through synthetic testing and in wideband coherent channels, particularly under the 3GPP clustered-delay-line (CDL)-C channel model. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Comments: This paper will be presented at the 2024 Asilomar Conference on Signals, Systems, and Computers

Dynamic Decoupling of Placid Terminal Attractor-based Gradient Descent Algorithm

Authors: Jinwei Zhao, Marco Gori, Alessandro Betti, Stefano Melacci, Hongtao Zhang, Jiedong Liu, Xinhong Hei

Abstract: Gradient descent (GD) and stochastic gradient descent (SGD) have been widely used in a large number of application domains. Therefore, understanding the dynamics of GD and improving its convergence speed is still of great importance. This paper carefully analyzes the dynamics of GD based on the terminal attractor at different stages of its gradient flow. On the basis of the terminal sliding mode t… ▽ More Gradient descent (GD) and stochastic gradient descent (SGD) have been widely used in a large number of application domains. Therefore, understanding the dynamics of GD and improving its convergence speed is still of great importance. This paper carefully analyzes the dynamics of GD based on the terminal attractor at different stages of its gradient flow. On the basis of the terminal sliding mode theory and the terminal attractor theory, four adaptive learning rates are designed. Their performances are investigated in light of a detailed theoretical investigation, and the running times of the learning procedures are evaluated and compared. The total times of their learning processes are also studied in detail. To evaluate their effectiveness, various simulation results are investigated on a function approximation problem and an image classification problem. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Comments: 8 pages, 4 figures

Exploring the Integration of Large Language Models in Industrial Test Maintenance Processes

Authors: Ludvig Lemner, Linnea Wahlgren, Gregory Gay, Nasser Mohammadiha, Jingxiong Liu, Joakim Wennerberg

Abstract: Much of the cost and effort required during the software testing process is invested in performing test maintenance - the addition, removal, or modification of test cases to keep the test suite in sync with the system-under-test or to otherwise improve its quality. Tool support could reduce the cost - and improve the quality - of test maintenance by automating aspects of the process or by providin… ▽ More Much of the cost and effort required during the software testing process is invested in performing test maintenance - the addition, removal, or modification of test cases to keep the test suite in sync with the system-under-test or to otherwise improve its quality. Tool support could reduce the cost - and improve the quality - of test maintenance by automating aspects of the process or by providing guidance and support to developers. In this study, we explore the capabilities and applications of large language models (LLMs) - complex machine learning models adapted to textual analysis - to support test maintenance. We conducted a case study at Ericsson AB where we explored the triggers that indicate the need for test maintenance, the actions that LLMs can take, and the considerations that must be made when deploying LLMs in an industrial setting. We also proposed and demonstrated implementations of two multi-agent architectures that can predict which test cases require maintenance following a change to the source code. Collectively, these contributions advance our theoretical and practical understanding of how LLMs can be deployed to benefit industrial test maintenance processes. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Comments: Under submission to ACM TOSEM

SDF-Net: A Hybrid Detection Network for Mediastinal Lymph Node Detection on Contrast CT Images

Authors: Jiuli Xiong, Lanzhuju Mei, Jiameng Liu, Dinggang Shen, Zhong Xue, Xiaohuan Cao

Abstract: Accurate lymph node detection and quantification are crucial for cancer diagnosis and staging on contrast-enhanced CT images, as they impact treatment planning and prognosis. However, detecting lymph nodes in the mediastinal area poses challenges due to their low contrast, irregular shapes and dispersed distribution. In this paper, we propose a Swin-Det Fusion Network (SDF-Net) to effectively dete… ▽ More Accurate lymph node detection and quantification are crucial for cancer diagnosis and staging on contrast-enhanced CT images, as they impact treatment planning and prognosis. However, detecting lymph nodes in the mediastinal area poses challenges due to their low contrast, irregular shapes and dispersed distribution. In this paper, we propose a Swin-Det Fusion Network (SDF-Net) to effectively detect lymph nodes. SDF-Net integrates features from both segmentation and detection to enhance the detection capability of lymph nodes with various shapes and sizes. Specifically, an auto-fusion module is designed to merge the feature maps of segmentation and detection networks at different levels. To facilitate effective learning without mask annotations, we introduce a shape-adaptive Gaussian kernel to represent lymph node in the training stage and provide more anatomical information for effective learning. Comparative results demonstrate promising performance in addressing the complex lymph node detection problem. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Comments: 10 pages, 4 figures

The Black-Box Simulation Barrier Persists in a Fully Quantum World

Authors: Nai-Hui Chia, Kai-Min Chung, Xiao Liang, Jiahui Liu

Abstract: Zero-Knowledge (ZK) protocols have been intensely studied due to their fundamental importance and versatility. However, quantum information's inherent differences significantly alter the landscape, necessitating a re-examination of ZK designs. A crucial aspect is round complexity, linked to $\textit{simulation}$, which forms the foundation of ZK definition and security proofs. In the… ▽ More Zero-Knowledge (ZK) protocols have been intensely studied due to their fundamental importance and versatility. However, quantum information's inherent differences significantly alter the landscape, necessitating a re-examination of ZK designs. A crucial aspect is round complexity, linked to $\textit{simulation}$, which forms the foundation of ZK definition and security proofs. In the $\textit{post-quantum}$ setting, where honest parties and channels are classical but adversaries quantum, Chia et al. [FOCS'21] showed constant-round $\textit{black-box-simulatable}$ ZK arguments (BBZK) for $\mathbf{NP}$ are impossible unless $\mathbf{NP} \subseteq \mathbf{BQP}$. But this problem remains open when all parties and communication are quantum. Indeed, this problem interests the broader theory of quantum computing. Investigating how quantum power alters tasks like the $\textit{unconditional}$ security of QKD and incorporating OT in MiniQCrypt has been crucial. Moreover, quantum communication has enabled round compression for commitments and interactive arguments. Along this line, understanding if quantum computing could fundamentally change ZK protocols is vital. We resolved this problem by proving that only languages in $\mathbf{BQP}$ admit constant-round $\textit{fully-quantum}$ BBZK. This result holds significant implications. Firstly, it illuminates the nature of quantum zero-knowledge and provides valuable insights for designing future protocols in the quantum realm. Secondly, it relates ZK round complexity with the intriguing problem of $\mathbf{BQP}$ vs $\mathbf{QMA}$, which is out of the reach of previous analogue impossibility results in the classical or post-quantum setting. Lastly, it justifies the need for the $\textit{non-black-box}$ simulation techniques or the relaxed security notions employed in existing constant-round fully-quantum BBZK protocols. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Enhancing Long Video Understanding via Hierarchical Event-Based Memory

Authors: Dingxin Cheng, Mingda Li, Jingyu Liu, Yongxin Guo, Bin Jiang, Qingbin Liu, Xi Chen, Bo Zhao

Abstract: Recently, integrating visual foundation models into large language models (LLMs) to form video understanding systems has attracted widespread attention. Most of the existing models compress diverse semantic information within the whole video and feed it into LLMs for content comprehension. While this method excels in short video understanding, it may result in a blend of multiple event information… ▽ More Recently, integrating visual foundation models into large language models (LLMs) to form video understanding systems has attracted widespread attention. Most of the existing models compress diverse semantic information within the whole video and feed it into LLMs for content comprehension. While this method excels in short video understanding, it may result in a blend of multiple event information in long videos due to coarse compression, which causes information redundancy. Consequently, the semantics of key events might be obscured within the vast information that hinders the model's understanding capabilities. To address this issue, we propose a Hierarchical Event-based Memory-enhanced LLM (HEM-LLM) for better understanding of long videos. Firstly, we design a novel adaptive sequence segmentation scheme to divide multiple events within long videos. In this way, we can perform individual memory modeling for each event to establish intra-event contextual connections, thereby reducing information redundancy. Secondly, while modeling current event, we compress and inject the information of the previous event to enhance the long-term inter-event dependencies in videos. Finally, we perform extensive experiments on various video understanding tasks and the results show that our model achieves state-of-the-art performances. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Particle-Laden Fluid on Flow Maps

Authors: Zhiqi Li, Duowen Chen, Candong Lin, Jinyuan Liu, Bo Zhu

Abstract: We propose a novel framework for simulating ink as a particle-laden flow using particle flow maps. Our method addresses the limitations of existing flow-map techniques, which struggle with dissipative forces like viscosity and drag, thereby extending the application scope from solving the Euler equations to solving the Navier-Stokes equations with accurate viscosity and laden-particle treatment. O… ▽ More We propose a novel framework for simulating ink as a particle-laden flow using particle flow maps. Our method addresses the limitations of existing flow-map techniques, which struggle with dissipative forces like viscosity and drag, thereby extending the application scope from solving the Euler equations to solving the Navier-Stokes equations with accurate viscosity and laden-particle treatment. Our key contribution lies in a coupling mechanism for two particle systems, coupling physical sediment particles and virtual flow-map particles on a background grid by solving a Poisson system. We implemented a novel path integral formula to incorporate viscosity and drag forces into the particle flow map process. Our approach enables state-of-the-art simulation of various particle-laden flow phenomena, exemplified by the bulging and breakup of suspension drop tails, torus formation, torus disintegration, and the coalescence of sedimenting drops. In particular, our method delivered high-fidelity ink diffusion simulations by accurately capturing vortex bulbs, viscous tails, fractal branching, and hierarchical structures. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Comments: 13 pages, 16 figures, SIGGRAPH Asia 2024

Involution matrix loci and orbit harmonics

Authors: Moxuan J. Liu, Yichen Ma, Brendon Rhoades, Hai Zhu

Abstract: Let $\mathrm{Mat}_{n \times n}(\mathbb{C})$ be the affine space of $n \times n$ complex matrices with coordinate ring $\mathbb{C}[\mathbf{x}_{n \times n}]$. We define graded quotients of $\mathbb{C}[\mathbf{x}_{n \times n}]$ which carry an action of the symmetric group $\mathfrak{S}_n$ by simultaneous permutation of rows and columns. These quotient rings are obtained by applying the orbit harmonic… ▽ More Let $\mathrm{Mat}_{n \times n}(\mathbb{C})$ be the affine space of $n \times n$ complex matrices with coordinate ring $\mathbb{C}[\mathbf{x}_{n \times n}]$. We define graded quotients of $\mathbb{C}[\mathbf{x}_{n \times n}]$ which carry an action of the symmetric group $\mathfrak{S}_n$ by simultaneous permutation of rows and columns. These quotient rings are obtained by applying the orbit harmonics method to matrix loci corresponding to all involutions in $\mathfrak{S}_n$ and the conjugacy classes of involutions in $\mathfrak{S}_n$ with a given number of fixed points. In the case of perfect matchings on $\{1, \dots, n\}$ with $n$ even, the Hilbert series of our quotient ring is related to Tracy-Widom distributions and its graded Frobenius image gives a refinement of the plethysm $s_{n/2}[s_2]$. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Comments: 33 pages

LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation

Authors: Henghui Ding, Lingyi Hong, Chang Liu, Ning Xu, Linjie Yang, Yuchen Fan, Deshui Miao, Yameng Gu, Xin Li, Zhenyu He, Yaowei Wang, Ming-Hsuan Yang, Jinming Chai, Qin Ma, Junpei Zhang, Licheng Jiao, Fang Liu, Xinyu Liu, Jing Zhang, Kexin Zhang, Xu Liu, LingLing Li, Hao Fang, Feiyu Pan, Xiankai Lu , et al. (8 additional authors not shown)

Abstract: Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in conjunction with ECCV 2024 workshop. This year's challenge includes two tasks: Video Object Segmentation (VOS) and Referring Video Object Segmentation (RVOS). In… ▽ More Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in conjunction with ECCV 2024 workshop. This year's challenge includes two tasks: Video Object Segmentation (VOS) and Referring Video Object Segmentation (RVOS). In this year, we replace the classic YouTube-VOS and YouTube-RVOS benchmark with latest datasets MOSE, LVOS, and MeViS to assess VOS under more challenging complex environments. This year's challenge attracted 129 registered teams from more than 20 institutes across over 8 countries. This report include the challenge and dataset introduction, and the methods used by top 7 teams in two tracks. More details can be found in our homepage https://lsvos.github.io/. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Comments: ECCV 2024 LSVOS Challenge Report: https://lsvos.github.io/

Urban Sensing Using Existing Fiber-Optic Networks

Authors: Jingxiao Liu, Haipeng Li, Hae Young Noh, Paolo Santi, Biondo Biondi, Carlo Ratti

Abstract: The analysis of urban seismic sources offers valuable insights into urban environments, including seismic hazards, infrastructure conditions, human mobility, and cultural life. Yet, accurate detection and localization of seismic sources at the urban scale with conventional seismic sensing networks is unavailable due to the prohibitive costs of ultra-dense seismic arrays required for imaging high-f… ▽ More The analysis of urban seismic sources offers valuable insights into urban environments, including seismic hazards, infrastructure conditions, human mobility, and cultural life. Yet, accurate detection and localization of seismic sources at the urban scale with conventional seismic sensing networks is unavailable due to the prohibitive costs of ultra-dense seismic arrays required for imaging high-frequency anthropogenic seismic sources. Here, we leverage existing fiber-optic networks as a distributed acoustic sensing system to accurately locate urban seismic sources and estimate how their intensity varies with time. By repurposing a 50-kilometer telecommunication fiber into an ultra-dense seismic array with 50,000 channels, we generate high-resolution spatiotemporal maps of seismic source power (SSP) across San Jose, California. Our approach overcomes the proximity limitations of urban seismic sensing, enabling accurate localization of remote seismic sources generated by urban activities. Examples of detected activities are vehicle movements and operations at construction sites and schools. We also show strong correlations between SSP values and noise level measurements, as well as various persistent urban features, including point of interest density, land use patterns, and demographics. Our study shows how spatiotemporal SSP maps can be turned into novel urban data that effectively captures urban dynamics across multiple features, thus opening the way towards the use of fiber-optic networks as a ubiquitous and general-purpose urban sensing platform, with wide-ranging applications in urban and environmental studies. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

Authors: Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun

Abstract: The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL me… ▽ More The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL methods still have limitations in dealing with cooperative decision-making of multiple connected autonomous vehicles (CAVs), ensuring safety during exploration, and simulating realistic human driver behaviors. In this paper, a novel and efficient algorithm, Multi-Agent Game-prior Attention Deep Deterministic Policy Gradient (MA-GA-DDPG), is proposed to address these limitations. Our proposed algorithm formulates the decision-making problem of CAVs at unsignalized intersections as a decentralized multi-agent reinforcement learning problem and incorporates an attention mechanism to capture interaction dependencies between ego CAV and other agents. The attention weights between the ego vehicle and other agents are then used to screen interaction objects and obtain prior hierarchical game relations, based on which a safety inspector module is designed to improve the traffic safety. Furthermore, both simulation and hardware-in-the-loop experiments were conducted, demonstrating that our method outperforms other baseline approaches in terms of driving safety, efficiency, and comfort. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Hitting the mark: Optimising Marked Power Spectra for Cosmology

Authors: Jessica A. Cowell, David Alonso, Jia Liu

Abstract: Marked power spectra provide a computationally efficient way to extract non-Gaussian information from the matter density field using the usual analysis tools developed for the power spectrum without the need for explicit calculation of higher-order correlators. In this work, we explore the optimal form of the mark function used for re-weighting the density field, to maximally constrain cosmology.… ▽ More Marked power spectra provide a computationally efficient way to extract non-Gaussian information from the matter density field using the usual analysis tools developed for the power spectrum without the need for explicit calculation of higher-order correlators. In this work, we explore the optimal form of the mark function used for re-weighting the density field, to maximally constrain cosmology. We show that adding to the mark function or multiplying it by a constant leads to no additional information gain, which significantly reduces our search space for optimal marks. We quantify the information gain of this optimal function and compare it against mark functions previously proposed in the literature. We find that we can gain around $\sim2$ times smaller errors in $σ_8$ and $\sim4$ times smaller errors in $Ω_m$ compared to using the traditional power spectrum alone, an improvement of $\sim60\%$ compared to other proposed marks when applied to the same dataset. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Comments: To be submitted to MNRAS. Comments welcome

Neural Surface Reconstruction and Rendering for LiDAR-Visual Systems

Authors: Jianheng Liu, Chunran Zheng, Yunfei Wan, Bowen Wang, Yixi Cai, Fu Zhang

Abstract: This paper presents a unified surface reconstruction and rendering framework for LiDAR-visual systems, integrating Neural Radiance Fields (NeRF) and Neural Distance Fields (NDF) to recover both appearance and structural information from posed images and point clouds. We address the structural visible gap between NeRF and NDF by utilizing a visible-aware occupancy map to classify space into the fre… ▽ More This paper presents a unified surface reconstruction and rendering framework for LiDAR-visual systems, integrating Neural Radiance Fields (NeRF) and Neural Distance Fields (NDF) to recover both appearance and structural information from posed images and point clouds. We address the structural visible gap between NeRF and NDF by utilizing a visible-aware occupancy map to classify space into the free, occupied, visible unknown, and background regions. This classification facilitates the recovery of a complete appearance and structure of the scene. We unify the training of the NDF and NeRF using a spatial-varying scale SDF-to-density transformation for levels of detail for both structure and appearance. The proposed method leverages the learned NDF for structure-aware NeRF training by an adaptive sphere tracing sampling strategy for accurate structure rendering. In return, NeRF further refines structural in recovering missing or fuzzy structures in the NDF. Extensive experiments demonstrate the superior quality and versatility of the proposed method across various scenarios. To benefit the community, the codes will be released at \url{https://github.com/hku-mars/M2Mapping}. △ Less

Submitted 8 September, 2024; originally announced September 2024.

Can OOD Object Detectors Learn from Foundation Models?

Authors: Jiahui Liu, Xin Wen, Shizhen Zhao, Yingxian Chen, Xiaojuan Qi

Abstract: Out-of-distribution (OOD) object detection is a challenging task due to the absence of open-set OOD data. Inspired by recent advancements in text-to-image generative models, such as Stable Diffusion, we study the potential of generative models trained on large-scale open-set data to synthesize OOD samples, thereby enhancing OOD object detection. We introduce SyncOOD, a simple data curation method… ▽ More Out-of-distribution (OOD) object detection is a challenging task due to the absence of open-set OOD data. Inspired by recent advancements in text-to-image generative models, such as Stable Diffusion, we study the potential of generative models trained on large-scale open-set data to synthesize OOD samples, thereby enhancing OOD object detection. We introduce SyncOOD, a simple data curation method that capitalizes on the capabilities of large foundation models to automatically extract meaningful OOD data from text-to-image generative models. This offers the model access to open-world knowledge encapsulated within off-the-shelf foundation models. The synthetic OOD samples are then employed to augment the training of a lightweight, plug-and-play OOD detector, thus effectively optimizing the in-distribution (ID)/OOD decision boundaries. Extensive experiments across multiple benchmarks demonstrate that SyncOOD significantly outperforms existing methods, establishing new state-of-the-art performance with minimal synthetic data usage. △ Less

Submitted 8 September, 2024; originally announced September 2024.

Comments: 19 pages, 4 figures

Journal ref: European Conference on Computer Vision (ECCV) 2024

A Survey on Diffusion Models for Recommender Systems

Authors: Jianghao Lin, Jiaqi Liu, Jiachen Zhu, Yunjia Xi, Chengkai Liu, Yangtian Zhang, Yong Yu, Weinan Zhang

Abstract: While traditional recommendation techniques have made significant strides in the past decades, they still suffer from limited generalization performance caused by factors like inadequate collaborative signals, weak latent representations, and noisy data. In response, diffusion models (DMs) have emerged as promising solutions for recommender systems due to their robust generative capabilities, soli… ▽ More While traditional recommendation techniques have made significant strides in the past decades, they still suffer from limited generalization performance caused by factors like inadequate collaborative signals, weak latent representations, and noisy data. In response, diffusion models (DMs) have emerged as promising solutions for recommender systems due to their robust generative capabilities, solid theoretical foundations, and improved training stability. To this end, in this paper, we present the first comprehensive survey on diffusion models for recommendation, and draw a bird's-eye view from the perspective of the whole pipeline in real-world recommender systems. We systematically categorize existing research works into three primary domains: (1) diffusion for data engineering & encoding, focusing on data augmentation and representation enhancement; (2) diffusion as recommender models, employing diffusion models to directly estimate user preferences and rank items; and (3) diffusion for content presentation, utilizing diffusion models to generate personalized content such as fashion and advertisement creatives. Our taxonomy highlights the unique strengths of diffusion models in capturing complex data distributions and generating high-quality, diverse samples that closely align with user preferences. We also summarize the core characteristics of the adapting diffusion models for recommendation, and further identify key areas for future exploration, which helps establish a roadmap for researchers and practitioners seeking to advance recommender systems through the innovative application of diffusion models. To further facilitate the research community of recommender systems based on diffusion models, we actively maintain a GitHub repository for papers and other related resources in this rising direction https://github.com/CHIANGEL/Awesome-Diffusion-for-RecSys. △ Less

Submitted 8 September, 2024; originally announced September 2024.

Comments: Under Review

HelmetPoser: A Helmet-Mounted IMU Dataset for Data-Driven Estimation of Human Head Motion in Diverse Conditions

Authors: Jianping Li, Qiutong Leng, Jinxing Liu, Xinhang Xu, Tongxin Jin, Muqing Cao, Thien-Minh Nguyen, Shenghai Yuan, Kun Cao, Lihua Xie

Abstract: Helmet-mounted wearable positioning systems are crucial for enhancing safety and facilitating coordination in industrial, construction, and emergency rescue environments. These systems, including LiDAR-Inertial Odometry (LIO) and Visual-Inertial Odometry (VIO), often face challenges in localization due to adverse environmental conditions such as dust, smoke, and limited visual features. To address… ▽ More Helmet-mounted wearable positioning systems are crucial for enhancing safety and facilitating coordination in industrial, construction, and emergency rescue environments. These systems, including LiDAR-Inertial Odometry (LIO) and Visual-Inertial Odometry (VIO), often face challenges in localization due to adverse environmental conditions such as dust, smoke, and limited visual features. To address these limitations, we propose a novel head-mounted Inertial Measurement Unit (IMU) dataset with ground truth, aimed at advancing data-driven IMU pose estimation. Our dataset captures human head motion patterns using a helmet-mounted system, with data from ten participants performing various activities. We explore the application of neural networks, specifically Long Short-Term Memory (LSTM) and Transformer networks, to correct IMU biases and improve localization accuracy. Additionally, we evaluate the performance of these methods across different IMU data window dimensions, motion patterns, and sensor types. We release a publicly available dataset, demonstrate the feasibility of advanced neural network approaches for helmet-based localization, and provide evaluation metrics to establish a baseline for future studies in this field. Data and code can be found at \url{https://lqiutong.github.io/HelmetPoser.github.io/}. △ Less

Submitted 8 September, 2024; originally announced September 2024.

Marginal Structural Modeling of Representative Treatment Trajectories

Authors: Jiewen Liu, Todd A. Miano, Stephen Griffiths, Michael G. S. Shashaty, Wei Yang

Abstract: Marginal structural models (MSMs) are widely used in observational studies to estimate the causal effect of time-varying treatments. Despite its popularity, limited attention has been paid to summarizing the treatment history in the outcome model, which proves particularly challenging when individuals' treatment trajectories exhibit complex patterns over time. Commonly used metrics such as the ave… ▽ More Marginal structural models (MSMs) are widely used in observational studies to estimate the causal effect of time-varying treatments. Despite its popularity, limited attention has been paid to summarizing the treatment history in the outcome model, which proves particularly challenging when individuals' treatment trajectories exhibit complex patterns over time. Commonly used metrics such as the average treatment level fail to adequately capture the treatment history, hindering causal interpretation. For scenarios where treatment histories exhibit distinct temporal patterns, we develop a new approach to parameterize the outcome model. We apply latent growth curve analysis to identify representative treatment trajectories from the observed data and use the posterior probability of latent class membership to summarize the different treatment trajectories. We demonstrate its use in parameterizing the MSMs, which facilitates the interpretations of the results. We apply the method to analyze data from an existing cohort of lung transplant recipients to estimate the effect of Tacrolimus concentrations on the risk of incident chronic kidney disease. △ Less

Submitted 7 September, 2024; originally announced September 2024.

FePd2Te2: An Anisotropic Two-Dimensional Ferromagnet with One-Dimensional Fe Chains

Authors: Bingxian Shi, Yanyan Geng, Hengning Wang, Jianhui Yang, Chenglin Shang, Manyu Wang, Shuo Mi, Jiale Huang, Feihao Pan, Xuejuan Gui, Jinchen Wang, Juanjuan Liu, Daye Xu, Hongxia Zhang, Jianfei Qin, Hongliang Wang, Lijie Hao, Mingliang Tian, Zhihai Cheng, Guolin Zheng, Peng Cheng

Abstract: Two-dimensional (2D) magnets have attracted significant attentions in recent years due to their importance in the research on both fundamental physics and spintronic applications. Here, we report the discovery of a new ternary compound FePd2Te2. It features a layered quasi-2D crystal structure with one-dimensional Fe zigzag chains extending along the b-axis in the cleavage plane. Single crystals o… ▽ More Two-dimensional (2D) magnets have attracted significant attentions in recent years due to their importance in the research on both fundamental physics and spintronic applications. Here, we report the discovery of a new ternary compound FePd2Te2. It features a layered quasi-2D crystal structure with one-dimensional Fe zigzag chains extending along the b-axis in the cleavage plane. Single crystals of FePd2Te2 with centimeter-size could be grown. Density functional theory calculations, mechanical exfoliation and atomic force microscopy on these crystals reveal that they are 2D materialsthat can be thinned down to 5 nm. Magnetic characterization shows that FePd2Te2 is an easy-plane ferromagnet with Tc 183 K and strong in-plane uniaxial magnetic anisotropy. Magnetoresistance and anomalous Hall effect demonstrate that ferromagnetism could maintain in FePd2Te2 flakes with large coercivity. A crystal twinning effect is observed by scanning tunneling microscopy which makes the Fe chains right-angle bent in the cleavage plane and creates an intriguing spin texture. Our results show that FePd2Te2 is a correlated anisotropic 2D magnets that may attract multidisciplinary research interests. △ Less

Submitted 7 September, 2024; originally announced September 2024.

Journal ref: J.Am.Chem.Soc.2024,146,21546-21554

A new unified dark sector model and its implications on the $σ_8$ and $S_8$ tensions

Authors: Yan-Hong Yao, Jian-Qi Liu, Zhi-Qi Huang, Jun-Chao Wang, Yan Su

Abstract: In this paper, we introduced the Unified Three-Form Dark Sector (UTFDS) model, a unified dark sector model that combines dark energy and dark matter through a three-form field. In this framework, the potential of the three-form field acts as dark matter, while the kinetic term represents dark energy. The interaction between dark matter and dark energy is driven by the energy exchange between these… ▽ More In this paper, we introduced the Unified Three-Form Dark Sector (UTFDS) model, a unified dark sector model that combines dark energy and dark matter through a three-form field. In this framework, the potential of the three-form field acts as dark matter, while the kinetic term represents dark energy. The interaction between dark matter and dark energy is driven by the energy exchange between these two terms. Given the dynamical equations of UTFDS, we provide an autonomous system of evolution equations for UTFDS and perform a stability analysis of its fixed points. The result aligns with our expectations for a unified dark sector. Furthermore, we discover that the dual Lagrangian of the UTFDS Lagrangian is equivalent to a Dirac-Born-Infeld (DBI) Lagrangian. By fixing the parameter $κX_0$ to 250, 500, 750, we refer to the resulting models as the $\overline{\rm UTFDS}$ model with $κX_0$=250, 500, 750, respectively. We then place constraints on these three $\overline{\rm UTFDS}$ models and the $Λ$CDM model in light of the Planck 2018 Cosmic Microwave Background (CMB) anisotropies, Redshift Space Distortions (RSD) observations, Baryon Acoustic Oscillation (BAO) measurements, and the $S_8$ prior chosen according to the KiDS1000 Weak gravitational Lensing (WL) measuement. We find that the $\overline{\rm UTFDS}$ model with $κX_0$=500 is the only one among the four models where both $σ_8$ and $S_8$ tensions, between CMB and RSD+BAO+WL datasets, are below 2.0$σ$. Furthermore, the tensions are relieved without exacerbating the $H_0$ tension. Although both the CMB and RSD+BAO+WL datasets provide definite/positive evidence favoring $Λ$CDM over the $\overline{\rm UTFDS}$ model with $κX_0$=500, the evidence is not strong enough to rule out further study of this model. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Comments: 16 pages, 6 tables, 5 figures

Enhancing Quantum Security over Federated Learning via Post-Quantum Cryptography

Authors: Pingzhi Li, Tianlong Chen, Junyu Liu

Abstract: Federated learning (FL) has become one of the standard approaches for deploying machine learning models on edge devices, where private training data are distributed across clients, and a shared model is learned by aggregating locally computed updates from each client. While this paradigm enhances communication efficiency by only requiring updates at the end of each training epoch, the transmitted… ▽ More Federated learning (FL) has become one of the standard approaches for deploying machine learning models on edge devices, where private training data are distributed across clients, and a shared model is learned by aggregating locally computed updates from each client. While this paradigm enhances communication efficiency by only requiring updates at the end of each training epoch, the transmitted model updates remain vulnerable to malicious tampering, posing risks to the integrity of the global model. Although current digital signature algorithms can protect these communicated model updates, they fail to ensure quantum security in the era of large-scale quantum computing. Fortunately, various post-quantum cryptography algorithms have been developed to address this vulnerability, especially the three NIST-standardized algorithms - Dilithium, FALCON, and SPHINCS+. In this work, we empirically investigate the impact of these three NIST-standardized PQC algorithms for digital signatures within the FL procedure, covering a wide range of models, tasks, and FL settings. Our results indicate that Dilithium stands out as the most efficient PQC algorithm for digital signature in federated learning. Additionally, we offer an in-depth discussion of the implications of our findings and potential directions for future research. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Comments: Submission for IEEE 2024 IEEE Workshop on Quantum IntelLigence, Learning & Security (QUILLS), https://sites.google.com/pitt.edu/quills/home

Multi-Modal Diffusion for Hand-Object Grasp Generation

Authors: Jinkun Cao, Jingyuan Liu, Kris Kitani, Yi Zhou

Abstract: In this work, we focus on generating hand grasp over objects. Compared to previous works of generating hand poses with a given object, we aim to allow the generalization of both hand and object shapes by a single model. Our proposed method Multi-modal Grasp Diffusion (MGD) learns the prior and conditional posterior distribution of both modalities from heterogeneous data sources. Therefore it relie… ▽ More In this work, we focus on generating hand grasp over objects. Compared to previous works of generating hand poses with a given object, we aim to allow the generalization of both hand and object shapes by a single model. Our proposed method Multi-modal Grasp Diffusion (MGD) learns the prior and conditional posterior distribution of both modalities from heterogeneous data sources. Therefore it relieves the limitation of hand-object grasp datasets by leveraging the large-scale 3D object datasets. According to both qualitative and quantitative experiments, both conditional and unconditional generation of hand grasp achieve good visual plausibility and diversity. The proposed method also generalizes well to unseen object shapes. The code and weights will be available at \url{https://github.com/noahcao/mgd}. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Comments: 8-page paper, 7-page appendix and 10 pages

Statistical Characteristics of the Proton Isotropy Boundary

Authors: Colin Wilkins, Vassilis Angelopoulos, Anton Artemyev, Andrei Runov, Xiao-Jia Zhang, Jiang Liu, Ethan Tsai

Abstract: Using particle data from the ELFIN satellites, we present a statistical study of 284 proton isotropy boundary events on the nightside magnetosphere, characterizing their occurrence and distribution in local time, latitude (L-shell), energy, and precipitating energy flux, as a function of geomagnetic activity. For a given charged particle species and energy, its isotropy boundary (IB) is the magnet… ▽ More Using particle data from the ELFIN satellites, we present a statistical study of 284 proton isotropy boundary events on the nightside magnetosphere, characterizing their occurrence and distribution in local time, latitude (L-shell), energy, and precipitating energy flux, as a function of geomagnetic activity. For a given charged particle species and energy, its isotropy boundary (IB) is the magnetic latitude poleward of which persistently isotropic pitch-angle distributions ($J_{prec}/J_{perp}\sim 1$) are first observed to occur. This isotropization is interpreted as resulting from magnetic field-line curvature (FLC) scattering in the equatorial magnetosphere. We find that proton IBs are observed under all observed activity levels, spanning 16 to 05 MLT with $\sim$100% occurrence between 19 and 03 MLT, trending toward 60% at dawn/dusk. These results are also compared with electron IB properties observed using ELFIN, where we find similar trends across local time and activity, with the onset in $\geq$50 keV proton IB occurring on average 2 L-shells lower, and providing between 3 and 10 times as much precipitating power. Proton IBs typically span $64^\circ$-$66^\circ$ in magnetic latitude (5-6 in L-shell), corresponding to the outer edge of the ring current, tending toward lower IGRF latitudes as geomagnetic activity increases. The IBs were found to commonly occur 0.3-2.1 Re beyond the plasmapause. Proton IBs typically span $<$50 keV to $\sim$1 MeV in energy, maximizing near 22 MLT, and decreasing to a typical upper limit of 300-400 keV toward dawn and dusk, with peak observed isotropic energy increasing by $\sim$500 keV during active intervals. These results suggest that FLC in the vicinity of IBs can provide a substantial depletion mechanism for energetic protons, with the total nightside precipitating power from FLC-scattering found to be on the order of 100 MW, at times $\geq$10 GW. △ Less

Submitted 6 September, 2024; originally announced September 2024.

CoxKAN: Kolmogorov-Arnold Networks for Interpretable, High-Performance Survival Analysis

Authors: William Knottenbelt, Zeyu Gao, Rebecca Wray, Woody Zhidong Zhang, Jiashuai Liu, Mireia Crispin-Ortuzar

Abstract: Survival analysis is a branch of statistics used for modeling the time until a specific event occurs and is widely used in medicine, engineering, finance, and many other fields. When choosing survival models, there is typically a trade-off between performance and interpretability, where the highest performance is achieved by black-box models based on deep learning. This is a major problem in field… ▽ More Survival analysis is a branch of statistics used for modeling the time until a specific event occurs and is widely used in medicine, engineering, finance, and many other fields. When choosing survival models, there is typically a trade-off between performance and interpretability, where the highest performance is achieved by black-box models based on deep learning. This is a major problem in fields such as medicine where practitioners are reluctant to blindly trust black-box models to make important patient decisions. Kolmogorov-Arnold Networks (KANs) were recently proposed as an interpretable and accurate alternative to multi-layer perceptrons (MLPs). We introduce CoxKAN, a Cox proportional hazards Kolmogorov-Arnold Network for interpretable, high-performance survival analysis. We evaluate the proposed CoxKAN on 4 synthetic datasets and 9 real medical datasets. The synthetic experiments demonstrate that CoxKAN accurately recovers interpretable symbolic formulae for the hazard function, and effectively performs automatic feature selection. Evaluation on the 9 real datasets show that CoxKAN consistently outperforms the Cox proportional hazards model and achieves performance that is superior or comparable to that of tuned MLPs. Furthermore, we find that CoxKAN identifies complex interactions between predictor variables that would be extremely difficult to recognise using existing survival methods, and automatically finds symbolic formulae which uncover the precise effect of important biomarkers on patient risk. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Study of the decay $D^0\rightarrow ρ(770)^-e^+ν_e$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (646 additional authors not shown)

Abstract: We present a study of the semileptonic decay $D^0\rightarrow π^-π^0e^{+}ν_{e}$ using an $e^+e^-$ annihilation data sample of $7.93~\mathrm{fb}^{-1}$ collected at the center-of-mass energy of 3.773 GeV with the BESIII detector. The branching fraction of $D^0\to ρ(770)^-e^+ν_e$ is measured to be $(1.439 \pm 0.033(\rm stat.) \pm 0.027(\rm syst.)) \times10^{-3}$, which is a factor 1.6 more precise tha… ▽ More We present a study of the semileptonic decay $D^0\rightarrow π^-π^0e^{+}ν_{e}$ using an $e^+e^-$ annihilation data sample of $7.93~\mathrm{fb}^{-1}$ collected at the center-of-mass energy of 3.773 GeV with the BESIII detector. The branching fraction of $D^0\to ρ(770)^-e^+ν_e$ is measured to be $(1.439 \pm 0.033(\rm stat.) \pm 0.027(\rm syst.)) \times10^{-3}$, which is a factor 1.6 more precise than previous measurements. By performing an amplitude analysis, we measure the hadronic form-factor ratios of $D^0\to ρ(770)^-e^+ν_e$ at $q^2=0$ assuming the single-pole-dominance parametrization: $r_{V}=V(0)/A_1(0)=1.548\pm0.079(\rm stat.)\pm0.041(\rm syst.)$ and $r_{2}=A_2(0)/A_1(0)=0.823\pm0.056(\rm stat.)\pm0.026(\rm syst.)$. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Comments: 12 pages, 3 figures

Hermes: Memory-Efficient Pipeline Inference for Large Models on Edge Devices

Authors: Xueyuan Han, Zinuo Cai, Yichu Zhang, Chongxin Fan, Junhan Liu, Ruhui Ma, Rajkumar Buyya

Abstract: The application of Transformer-based large models has achieved numerous success in recent years. However, the exponential growth in the parameters of large models introduces formidable memory challenge for edge deployment. Prior works to address this challenge mainly focus on optimizing the model structure and adopting memory swapping methods. However, the former reduces the inference accuracy, an… ▽ More The application of Transformer-based large models has achieved numerous success in recent years. However, the exponential growth in the parameters of large models introduces formidable memory challenge for edge deployment. Prior works to address this challenge mainly focus on optimizing the model structure and adopting memory swapping methods. However, the former reduces the inference accuracy, and the latter raises the inference latency. This paper introduces PIPELOAD, a novel memory-efficient pipeline execution mechanism. It reduces memory usage by incorporating dynamic memory management and minimizes inference latency by employing parallel model loading. Based on PIPELOAD mechanism, we present Hermes, a framework optimized for large model inference on edge devices. We evaluate Hermes on Transformer-based models of different sizes. Our experiments illustrate that Hermes achieves up to 4.24 X increase in inference speed and 86.7% lower memory consumption than the state-of-the-art pipeline mechanism for BERT and ViT models, 2.58 X increase in inference speed and 90.3% lower memory consumption for GPT-style models. △ Less

Submitted 9 September, 2024; v1 submitted 6 September, 2024; originally announced September 2024.

Comments: Accepted by the 42nd IEEE International Conference on Computer Design (ICCD 2024)

Reprojection Errors as Prompts for Efficient Scene Coordinate Regression

Authors: Ting-Ru Liu, Hsuan-Kung Yang, Jou-Min Liu, Chun-Wei Huang, Tsung-Chih Chiang, Quan Kong, Norimasa Kobori, Chun-Yi Lee

Abstract: Scene coordinate regression (SCR) methods have emerged as a promising area of research due to their potential for accurate visual localization. However, many existing SCR approaches train on samples from all image regions, including dynamic objects and texture-less areas. Utilizing these areas for optimization during training can potentially hamper the overall performance and efficiency of the mod… ▽ More Scene coordinate regression (SCR) methods have emerged as a promising area of research due to their potential for accurate visual localization. However, many existing SCR approaches train on samples from all image regions, including dynamic objects and texture-less areas. Utilizing these areas for optimization during training can potentially hamper the overall performance and efficiency of the model. In this study, we first perform an in-depth analysis to validate the adverse impacts of these areas. Drawing inspiration from our analysis, we then introduce an error-guided feature selection (EGFS) mechanism, in tandem with the use of the Segment Anything Model (SAM). This mechanism seeds low reprojection areas as prompts and expands them into error-guided masks, and then utilizes these masks to sample points and filter out problematic areas in an iterative manner. The experiments demonstrate that our method outperforms existing SCR approaches that do not rely on 3D information on the Cambridge Landmarks and Indoor6 datasets. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Comments: ECCV2024

Active-Passive Federated Learning for Vertically Partitioned Multi-view Data

Authors: Jiyuan Liu, Xinwang Liu, Siqi Wang, Xingchen Hu, Qing Liao, Xinhang Wan, Yi Zhang, Xin Lv, Kunlun He

Abstract: Vertical federated learning is a natural and elegant approach to integrate multi-view data vertically partitioned across devices (clients) while preserving their privacies. Apart from the model training, existing methods requires the collaboration of all clients in the model inference. However, the model inference is probably maintained for service in a long time, while the collaboration, especial… ▽ More Vertical federated learning is a natural and elegant approach to integrate multi-view data vertically partitioned across devices (clients) while preserving their privacies. Apart from the model training, existing methods requires the collaboration of all clients in the model inference. However, the model inference is probably maintained for service in a long time, while the collaboration, especially when the clients belong to different organizations, is unpredictable in real-world scenarios, such as concellation of contract, network unavailablity, etc., resulting in the failure of them. To address this issue, we, at the first attempt, propose a flexible Active-Passive Federated learning (APFed) framework. Specifically, the active client is the initiator of a learning task and responsible to build the complete model, while the passive clients only serve as assistants. Once the model built, the active client can make inference independently. In addition, we instance the APFed framework into two classification methods with employing the reconstruction loss and the contrastive loss on passive clients, respectively. Meanwhile, the two methods are tested in a set of experiments and achieves desired results, validating their effectiveness. △ Less

Submitted 6 September, 2024; originally announced September 2024.

Can We Theoretically Quantify the Impacts of Local Updates on the Generalization Performance of Federated Learning?

Authors: Peizhong Ju, Haibo Yang, Jia Liu, Yingbin Liang, Ness Shroff

Abstract: Federated Learning (FL) has gained significant popularity due to its effectiveness in training machine learning models across diverse sites without requiring direct data sharing. While various algorithms along with their optimization analyses have shown that FL with local updates is a communication-efficient distributed learning framework, the generalization performance of FL with local updates ha… ▽ More Federated Learning (FL) has gained significant popularity due to its effectiveness in training machine learning models across diverse sites without requiring direct data sharing. While various algorithms along with their optimization analyses have shown that FL with local updates is a communication-efficient distributed learning framework, the generalization performance of FL with local updates has received comparatively less attention. This lack of investigation can be attributed to the complex interplay between data heterogeneity and infrequent communication due to the local updates within the FL framework. This motivates us to investigate a fundamental question in FL: Can we quantify the impact of data heterogeneity and local updates on the generalization performance for FL as the learning process evolves? To this end, we conduct a comprehensive theoretical study of FL's generalization performance using a linear model as the first step, where the data heterogeneity is considered for both the stationary and online/non-stationary cases. By providing closed-form expressions of the model error, we rigorously quantify the impact of the number of the local updates (denoted as $K$) under three settings ($K=1$, $K<\infty$, and $K=\infty$) and show how the generalization performance evolves with the number of rounds $t$. Our investigation also provides a comprehensive understanding of how different configurations (including the number of model parameters $p$ and the number of training samples $n$) contribute to the overall generalization performance, thus shedding new insights (such as benign overfitting) for implementing FL over networks. △ Less

Submitted 5 September, 2024; originally announced September 2024.

Comments: Published in MobiHoc 2024

A "Staircase" formula for the Chern-Schwartz-MacPherson cycle of a matroid

Authors: Franquiz Caraballo Alba, Jeffery Liu

Abstract: We provide a formula for the Poincaré dual of the Chern-Schwartz-MacPherson (CSM) cycle of a matroid in the Chow ring of the matroid. We derive the formula from the case of matroids realizable over the complex numbers and prove that it satisfies a contraction-deletion formula. From this fact, we prove it holds for all matroids, confirming a conjecture of Fife and Rincón. We provide a formula for the Poincaré dual of the Chern-Schwartz-MacPherson (CSM) cycle of a matroid in the Chow ring of the matroid. We derive the formula from the case of matroids realizable over the complex numbers and prove that it satisfies a contraction-deletion formula. From this fact, we prove it holds for all matroids, confirming a conjecture of Fife and Rincón. △ Less

Submitted 5 September, 2024; originally announced September 2024.

MSC Class: 14C17 (Primary) 14N20; 05B35

A Dual-Path Framework with Frequency-and-Time Excited Network for Anomalous Sound Detection

Authors: Yucong Zhang, Juan Liu, Yao Tian, Haifeng Liu, Ming Li

Abstract: In contrast to human speech, machine-generated sounds of the same type often exhibit consistent frequency characteristics and discernible temporal periodicity. However, leveraging these dual attributes in anomaly detection remains relatively under-explored. In this paper, we propose an automated dual-path framework that learns prominent frequency and temporal patterns for diverse machine types. On… ▽ More In contrast to human speech, machine-generated sounds of the same type often exhibit consistent frequency characteristics and discernible temporal periodicity. However, leveraging these dual attributes in anomaly detection remains relatively under-explored. In this paper, we propose an automated dual-path framework that learns prominent frequency and temporal patterns for diverse machine types. One pathway uses a novel Frequency-and-Time Excited Network (FTE-Net) to learn the salient features across frequency and time axes of the spectrogram. It incorporates a Frequency-and-Time Chunkwise Encoder (FTC-Encoder) and an excitation network. The other pathway uses a 1D convolutional network for utterance-level spectrum. Experimental results on the DCASE 2023 task 2 dataset show the state-of-the-art performance of our proposed method. Moreover, visualizations of the intermediate feature maps in the excitation network are provided to illustrate the effectiveness of our method. △ Less

Submitted 5 September, 2024; originally announced September 2024.

Comments: This Paper has been accepted to ICASSP 2024

Euclid preparation. Simulations and nonlinearities beyond $Λ$CDM. 4. Constraints on $f(R)$ models from the photometric primary probes

Authors: Euclid Collaboration, K. Koyama, S. Pamuk, S. Casas, B. Bose, P. Carrilho, I. Sáez-Casares, L. Atayde, M. Cataneo, B. Fiorini, C. Giocoli, A. M. C. Le Brun, F. Pace, A. Pourtsidou, Y. Rasera, Z. Sakr, H. -A. Winther, E. Altamura, J. Adamek, M. Baldi, M. -A. Breton, G. Rácz, F. Vernizzi, A. Amara, S. Andreon , et al. (253 additional authors not shown)

Abstract: We study the constraint on $f(R)$ gravity that can be obtained by photometric primary probes of the Euclid mission. Our focus is the dependence of the constraint on the theoretical modelling of the nonlinear matter power spectrum. In the Hu-Sawicki $f(R)$ gravity model, we consider four different predictions for the ratio between the power spectrum in $f(R)$ and that in $Λ$CDM: a fitting formula,… ▽ More We study the constraint on $f(R)$ gravity that can be obtained by photometric primary probes of the Euclid mission. Our focus is the dependence of the constraint on the theoretical modelling of the nonlinear matter power spectrum. In the Hu-Sawicki $f(R)$ gravity model, we consider four different predictions for the ratio between the power spectrum in $f(R)$ and that in $Λ$CDM: a fitting formula, the halo model reaction approach, ReACT and two emulators based on dark matter only $N$-body simulations, FORGE and e-Mantis. These predictions are added to the MontePython implementation to predict the angular power spectra for weak lensing (WL), photometric galaxy clustering and their cross-correlation. By running Markov Chain Monte Carlo, we compare constraints on parameters and investigate the bias of the recovered $f(R)$ parameter if the data are created by a different model. For the pessimistic setting of WL, one dimensional bias for the $f(R)$ parameter, $\log_{10}|f_{R0}|$, is found to be $0.5 σ$ when FORGE is used to create the synthetic data with $\log_{10}|f_{R0}| =-5.301$ and fitted by e-Mantis. The impact of baryonic physics on WL is studied by using a baryonification emulator BCemu. For the optimistic setting, the $f(R)$ parameter and two main baryon parameters are well constrained despite the degeneracies among these parameters. However, the difference in the nonlinear dark matter prediction can be compensated by the adjustment of baryon parameters, and the one-dimensional marginalised constraint on $\log_{10}|f_{R0}|$ is biased. This bias can be avoided in the pessimistic setting at the expense of weaker constraints. For the pessimistic setting, using the $Λ$CDM synthetic data for WL, we obtain the prior-independent upper limit of $\log_{10}|f_{R0}|< -5.6$. Finally, we implement a method to include theoretical errors to avoid the bias. △ Less

Submitted 5 September, 2024; originally announced September 2024.

Comments: 24 pages, 16 figures, submitted on behalf of the Euclid Collaboration

Reinforcement-Learning-Enabled Beam Alignment for Water-Air Direct Optical Wireless Communications

Authors: Jiayue Liu, Tianqi Mao, Dongxuan He, Yang Yang, Zhen Gao, Dezhi Zheng, Jun Zhang

Abstract: The escalating interests on underwater exploration/reconnaissance applications have motivated high-rate data transmission from underwater to airborne relaying platforms, especially under high-sea scenarios. Thanks to its broad bandwidth and superior confidentiality, Optical wireless communication has become one promising candidate for water-air transmission. However, the optical signals inevitably… ▽ More The escalating interests on underwater exploration/reconnaissance applications have motivated high-rate data transmission from underwater to airborne relaying platforms, especially under high-sea scenarios. Thanks to its broad bandwidth and superior confidentiality, Optical wireless communication has become one promising candidate for water-air transmission. However, the optical signals inevitably suffer from deviations when crossing the highly-dynamic water-air interfaces in the absence of relaying ships/buoys. To address the issue, this article proposes one novel beam alignment strategy based on deep reinforcement learning (DRL) for water-air direct optical wireless communications. Specifically, the dynamic water-air interface is mathematically modeled using sea-wave spectrum analysis, followed by characterization of the propagation channel with ray-tracing techniques. Then the deep deterministic policy gradient (DDPG) scheme is introduced for DRL-based transceiving beam alignment. A logarithm-exponential (LE) nonlinear reward function with respect to the received signal strength is designed for high-resolution rewarding between different actions. Simulation results validate the superiority of the proposed DRL-based beam alignment scheme. △ Less

Submitted 5 September, 2024; originally announced September 2024.

Comments: 6 pages, 6 figures, published to ICCC 2024

TC-LLaVA: Rethinking the Transfer from Image to Video Understanding with Temporal Considerations

Authors: Mingze Gao, Jingyu Liu, Mingda Li, Jiangtao Xie, Qingbin Liu, Bo Zhao, Xi Chen, Hui Xiong

Abstract: Multimodal Large Language Models (MLLMs) have significantly improved performance across various image-language applications. Recently, there has been a growing interest in adapting image pre-trained MLLMs for video-related tasks. However, most efforts concentrate on enhancing the vision encoder and projector components, while the core part, Large Language Models (LLMs), remains comparatively under… ▽ More Multimodal Large Language Models (MLLMs) have significantly improved performance across various image-language applications. Recently, there has been a growing interest in adapting image pre-trained MLLMs for video-related tasks. However, most efforts concentrate on enhancing the vision encoder and projector components, while the core part, Large Language Models (LLMs), remains comparatively under-explored. In this paper, we propose two strategies to enhance the model's capability in video understanding tasks by improving inter-layer attention computation in LLMs. Specifically, the first approach focuses on the enhancement of Rotary Position Embedding (RoPE) with Temporal-Aware Dual RoPE, which introduces temporal position information to strengthen the MLLM's temporal modeling capabilities while preserving the relative position relationships of both visual and text tokens. The second approach involves enhancing the Attention Mask with the Frame-wise Block Causal Attention Mask, a simple yet effective method that broadens visual token interactions within and across video frames while maintaining the causal inference mechanism. Based on these proposed methods, we adapt LLaVA for video understanding tasks, naming it Temporal-Considered LLaVA (TC-LLaVA). Our TC-LLaVA achieves new state-of-the-art performance across various video understanding benchmarks with only supervised fine-tuning (SFT) on video-related datasets. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Wrapped Gaussian Process Functional Regression Model for Batch Data on Riemannian Manifolds

Authors: Jinzhao Liu, Chao Liu, Jian Qing Shi, Tom Nye

Abstract: Regression is an essential and fundamental methodology in statistical analysis. The majority of the literature focuses on linear and nonlinear regression in the context of the Euclidean space. However, regression models in non-Euclidean spaces deserve more attention due to collection of increasing volumes of manifold-valued data. In this context, this paper proposes a concurrent functional regress… ▽ More Regression is an essential and fundamental methodology in statistical analysis. The majority of the literature focuses on linear and nonlinear regression in the context of the Euclidean space. However, regression models in non-Euclidean spaces deserve more attention due to collection of increasing volumes of manifold-valued data. In this context, this paper proposes a concurrent functional regression model for batch data on Riemannian manifolds by estimating both mean structure and covariance structure simultaneously. The response variable is assumed to follow a wrapped Gaussian process distribution. Nonlinear relationships between manifold-valued response variables and multiple Euclidean covariates can be captured by this model in which the covariates can be functional and/or scalar. The performance of our model has been tested on both simulated data and real data, showing it is an effective and efficient tool in conducting functional data regression on Riemannian manifolds. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models

Authors: Jie Ma, Zhitao Gao, Qi Chai, Wangchun Sun, Pinghui Wang, Hongbin Pei, Jing Tao, Lingyun Song, Jun Liu, Chen Zhang, Lizhen Cui

Abstract: Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic facts. Consequently, integrating LLMs with knowledge graphs has been extensively explored, with Knowledge Graph Question Answering (KGQA) serving as a critical… ▽ More Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic facts. Consequently, integrating LLMs with knowledge graphs has been extensively explored, with Knowledge Graph Question Answering (KGQA) serving as a critical touchstone for the integration. This task requires LLMs to answer natural language questions by retrieving relevant triples from knowledge graphs. However, existing methods face two significant challenges: \textit{excessively long reasoning paths distracting from the answer generation}, and \textit{false-positive relations hindering the path refinement}. In this paper, we propose an iterative interactive KGQA framework that leverages the interactive learning capabilities of LLMs to perform reasoning and Debating over Graphs (DoG). Specifically, DoG employs a subgraph-focusing mechanism, allowing LLMs to perform answer trying after each reasoning step, thereby mitigating the impact of lengthy reasoning paths. On the other hand, DoG utilizes a multi-role debate team to gradually simplify complex questions, reducing the influence of false-positive relations. This debate mechanism ensures the reliability of the reasoning process. Experimental results on five public datasets demonstrate the effectiveness and superiority of our architecture. Notably, DoG outperforms the state-of-the-art method ToG by 23.7\% and 9.1\% in accuracy on WebQuestions and GrailQA, respectively. Furthermore, the integration experiments with various LLMs on the mentioned datasets highlight the flexibility of DoG. Code is available at \url{https://github.com/reml-group/DoG}. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Comments: 12 pages

ACM Class: I.2.4

Large Language Model-Based Agents for Software Engineering: A Survey

Authors: Junwei Liu, Kaixin Wang, Yixuan Chen, Xin Peng, Zhenpeng Chen, Lingming Zhang, Yiling Lou

Abstract: The recent advance in Large Language Models (LLMs) has shaped a new paradigm of AI agents, i.e., LLM-based agents. Compared to standalone LLMs, LLM-based agents substantially extend the versatility and expertise of LLMs by enhancing LLMs with the capabilities of perceiving and utilizing external resources and tools. To date, LLM-based agents have been applied and shown remarkable effectiveness in… ▽ More The recent advance in Large Language Models (LLMs) has shaped a new paradigm of AI agents, i.e., LLM-based agents. Compared to standalone LLMs, LLM-based agents substantially extend the versatility and expertise of LLMs by enhancing LLMs with the capabilities of perceiving and utilizing external resources and tools. To date, LLM-based agents have been applied and shown remarkable effectiveness in Software Engineering (SE). The synergy between multiple agents and human interaction brings further promise in tackling complex real-world SE problems. In this work, we present a comprehensive and systematic survey on LLM-based agents for SE. We collect 106 papers and categorize them from two perspectives, i.e., the SE and agent perspectives. In addition, we discuss open challenges and future directions in this critical domain. The repository of this survey is at https://github.com/FudanSELab/Agent4SE-Paper-List. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Reply to Comment on "A slightly oblate dark matter halo revealed by a retrograde precessing Galactic disk warp"

Authors: Yang Huang, Qikang Feng, Tigran Khachaturyants, Huawei Zhang, Jifeng Liu, Juntai Shen, Timothy C. Beers, Youjun Lu, Song Wang, Haibo Yuan

Abstract: In this reply, we present a comprehensive analysis addressing the concerns raised by Dehnen et al. (2024) regarding our recent measurement of the disk warp precession using the `motion-picture' method (Huang et al. 2024). We carefully examine the impact of ignoring the twist of the disk warp and the so-called $R$-$τ$ correlation on the estimation of the precession rate. The results indicate that t… ▽ More In this reply, we present a comprehensive analysis addressing the concerns raised by Dehnen et al. (2024) regarding our recent measurement of the disk warp precession using the `motion-picture' method (Huang et al. 2024). We carefully examine the impact of ignoring the twist of the disk warp and the so-called $R$-$τ$ correlation on the estimation of the precession rate. The results indicate that the effect is minor and does not exceed the systematic and statistical uncertainties. Using N-body+SPH simulation data, we confirm that the `motion-picture' technique is effective in measuring retrograde precession of disk warp in stellar populations younger than 170 Myr, similar to classical Cepheids. Therefore, the overall conclusions of Huang et al. (2024) remain robust. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Comments: 4 pages, 2 figures, 1 table, in response to Dehnen et al. (arXiv:2407.06341)

Surgical Task Automation Using Actor-Critic Frameworks and Self-Supervised Imitation Learning

Authors: Jingshuai Liu, Alain Andres, Yonghang Jiang, Xichun Luo, Wenmiao Shu, Sotirios A. Tsaftaris

Abstract: Surgical robot task automation has recently attracted great attention due to its potential to benefit both surgeons and patients. Reinforcement learning (RL) based approaches have demonstrated promising ability to provide solutions to automated surgical manipulations on various tasks. To address the exploration challenge, expert demonstrations can be utilized to enhance the learning efficiency via… ▽ More Surgical robot task automation has recently attracted great attention due to its potential to benefit both surgeons and patients. Reinforcement learning (RL) based approaches have demonstrated promising ability to provide solutions to automated surgical manipulations on various tasks. To address the exploration challenge, expert demonstrations can be utilized to enhance the learning efficiency via imitation learning (IL) approaches. However, the successes of such methods normally rely on both states and action labels. Unfortunately action labels can be hard to capture or their manual annotation is prohibitively expensive owing to the requirement for expert knowledge. It therefore remains an appealing and open problem to leverage expert demonstrations composed of pure states in RL. In this work, we present an actor-critic RL framework, termed AC-SSIL, to overcome this challenge of learning with state-only demonstrations collected by following an unknown expert policy. It adopts a self-supervised IL method, dubbed SSIL, to effectively incorporate demonstrated states into RL paradigms by retrieving from demonstrates the nearest neighbours of the query state and utilizing the bootstrapping of actor networks. We showcase through experiments on an open-source surgical simulation platform that our method delivers remarkable improvements over the RL baseline and exhibits comparable performance against action based IL methods, which implies the efficacy and potential of our method for expert demonstration-guided learning scenarios. △ Less

Submitted 11 September, 2024; v1 submitted 4 September, 2024; originally announced September 2024.

Comments: 8 pages,7 figures, 62 conferences

GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering

Authors: Lingling Zhang, Muye Huang, QianYing Wang, Yaxian Wang, Wenjun Wu, Jun Liu

Abstract: Chart Question Answering (CQA) aims at answering questions based on the visual chart content, which plays an important role in chart sumarization, business data analysis, and data report generation. CQA is a challenging multi-modal task because of the strong context dependence and complex reasoning requirement. The former refers to answering this question strictly based on the analysis of the visu… ▽ More Chart Question Answering (CQA) aims at answering questions based on the visual chart content, which plays an important role in chart sumarization, business data analysis, and data report generation. CQA is a challenging multi-modal task because of the strong context dependence and complex reasoning requirement. The former refers to answering this question strictly based on the analysis of the visual content or internal data of the given chart, while the latter emphasizes the various logical and numerical reasoning involved in answer prediction process. In this paper, we pay more attention on the complex reasoning in CQA task, and propose a novel Graph-of-Thought (GoT) guided compositional reasoning model called GoT-CQA to overcome this problem. At first, we transform the chart-oriented question into a directed acyclic GoT composed of multiple operator nodes, including localization, numerical and logical operator. It intuitively reflects the human brain's solution process to this question. After that, we design an efficient auto-compositional reasoning framework guided by the GoT, to excute the multi-step reasoning operations in various types of questions. Comprehensive experiments on ChartQA and PlotQA-D datasets show that GoT-CQA achieves outstanding performance, especially in complex human-written and reasoning questions, comparing with the latest popular baselines. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Object Gaussian for Monocular 6D Pose Estimation from Sparse Views

Authors: Luqing Luo, Shichu Sun, Jiangang Yang, Linfang Zheng, Jinwei Du, Jian Liu

Abstract: Monocular object pose estimation, as a pivotal task in computer vision and robotics, heavily depends on accurate 2D-3D correspondences, which often demand costly CAD models that may not be readily available. Object 3D reconstruction methods offer an alternative, among which recent advancements in 3D Gaussian Splatting (3DGS) afford a compelling potential. Yet its performance still suffers and tend… ▽ More Monocular object pose estimation, as a pivotal task in computer vision and robotics, heavily depends on accurate 2D-3D correspondences, which often demand costly CAD models that may not be readily available. Object 3D reconstruction methods offer an alternative, among which recent advancements in 3D Gaussian Splatting (3DGS) afford a compelling potential. Yet its performance still suffers and tends to overfit with fewer input views. Embracing this challenge, we introduce SGPose, a novel framework for sparse view object pose estimation using Gaussian-based methods. Given as few as ten views, SGPose generates a geometric-aware representation by starting with a random cuboid initialization, eschewing reliance on Structure-from-Motion (SfM) pipeline-derived geometry as required by traditional 3DGS methods. SGPose removes the dependence on CAD models by regressing dense 2D-3D correspondences between images and the reconstructed model from sparse input and random initialization, while the geometric-consistent depth supervision and online synthetic view warping are key to the success. Experiments on typical benchmarks, especially on the Occlusion LM-O dataset, demonstrate that SGPose outperforms existing methods even under sparse view constraints, under-scoring its potential in real-world applications. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Searching for the massless dark photon in $c\to uγ'$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere, A. Brueggemann , et al. (648 additional authors not shown)

Abstract: In the effective field theory, the massless dark photon $γ'$ can only couple with the Standard Model particle through operators of dimension higher than four, thereby offering a high sensitivity to the new physics energy scale. Using $7.9~\rm{fb^{-1}}$ of $e^+e^-$ collision data collected at $\sqrt{s}=3.773$ GeV with the BESIII detector at the BEPCII collider, we measure the effective flavor-chang… ▽ More In the effective field theory, the massless dark photon $γ'$ can only couple with the Standard Model particle through operators of dimension higher than four, thereby offering a high sensitivity to the new physics energy scale. Using $7.9~\rm{fb^{-1}}$ of $e^+e^-$ collision data collected at $\sqrt{s}=3.773$ GeV with the BESIII detector at the BEPCII collider, we measure the effective flavor-changing neutral current coupling of $cuγ'$ in $D^0\toωγ'$ and $D^0\toγγ'$ processes to search for the massless dark photon. No significant signals are observed, and the upper limits at the 90% confidence level on the massless dark photon branching fraction are set to be $1.1\times10^{-5}$ and $2.0\times10^{-6}$ for $D^0\toωγ'$ and $D^0\toγγ'$, respectively. These results provide the most stringent constraint on the new physics energy scale associated with $cuγ'$ coupling in the world, with the new physics energy scale related parameter $|\mathbb{C}|^2+|\mathbb{C}_5|^2<8.2\times10^{-17}~\rm{GeV}^{-2}$ at the 90% confidence level, playing a unique role in the dark sector search with the charm sector. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Comments: 9 pages, 4 figures

Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems

Authors: Jeongmin Liu, Eunwoo Song

Abstract: While universal vocoders have achieved proficient waveform generation across diverse voices, their integration into text-to-speech (TTS) tasks often results in degraded synthetic quality. To address this challenge, we present a novel augmentation technique for training universal vocoders. Our training scheme randomly applies linear smoothing filters to input acoustic features, facilitating vocoder… ▽ More While universal vocoders have achieved proficient waveform generation across diverse voices, their integration into text-to-speech (TTS) tasks often results in degraded synthetic quality. To address this challenge, we present a novel augmentation technique for training universal vocoders. Our training scheme randomly applies linear smoothing filters to input acoustic features, facilitating vocoder generalization across a wide range of smoothings. It significantly mitigates the training-inference mismatch, enhancing the naturalness of synthetic output even when the acoustic model produces overly smoothed features. Notably, our method is applicable to any vocoder without requiring architectural modifications or dependencies on specific acoustic models. The experimental results validate the superiority of our vocoder over conventional methods, achieving 11.99% and 12.05% improvements in mean opinion scores when integrated with Tacotron 2 and FastSpeech 2 TTS acoustic models, respectively. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Comments: 4 pages, 4 figures, for demo samples, see https://sytronik.github.io/demos/voc_smth_aug/

Local map Construction Methods with SD map: A Novel Survey

Authors: Jiaqi Li, Pingfan Jia, Jiaxing Chen, Jiaxi Liu, Lei He

Abstract: In recent years, significant academic advancements have been made in the field of autonomous vehicles, with Local maps emerging as a crucial component of autonomous driving technology. Local maps not only provide intricate details of road networks but also serve as fundamental inputs for critical tasks such as vehicle localization, navigation, and decision-making. Given the characteristics of SD m… ▽ More In recent years, significant academic advancements have been made in the field of autonomous vehicles, with Local maps emerging as a crucial component of autonomous driving technology. Local maps not only provide intricate details of road networks but also serve as fundamental inputs for critical tasks such as vehicle localization, navigation, and decision-making. Given the characteristics of SD map (Standard Definition Map), which include low cost, ease of acquisition, and high versatility, perception methods that integrate SD map as prior information have demonstrated significant potential in the field of Local map perception. The purpose of this paper is to provide researchers with a comprehensive overview and summary of the latest advancements in the integration of SD map as prior information for Local map perception methods. This review begins by introducing the task definition and general pipeline of local map perception methods that incorporate SD maps as prior information, along with relevant public datasets. And then it focuses on the representation and encoding methods of multi-source information, as well as the methods for fusing multi-source information. In response to this burgeoning trend, this article presents a comprehensive and meticulous overview of the diverse research efforts in this particular field. Finally, the article addresses pertinent issues and future challenges with the aim of guiding researchers in understanding the current trends and methodologies prevalent in the field. △ Less

Submitted 3 September, 2024; originally announced September 2024.

Comments: 14 pages, 11 figures