-
Harnessing Business and Media Insights with Large Language Models
Authors:
Yujia Bao,
Ankit Parag Shah,
Neeru Narang,
Jonathan Rivers,
Rajeev Maksey,
Lan Guan,
Louise N. Barrere,
Shelley Evenson,
Rahul Basole,
Connie Miao,
Ankit Mehta,
Fabien Boulay,
Su Min Park,
Natalie E. Pearson,
Eldhose Joy,
Tiger He,
Sumiran Thakur,
Koustav Ghosal,
Josh On,
Phoebe Morrison,
Tim Major,
Eva Siqi Wang,
Gina Escobar,
Jiaheng Wei,
Tharindu Cyril Weerasooriya
, et al. (8 additional authors not shown)
Abstract:
This paper introduces Fortune Analytics Language Model (FALM). FALM empowers users with direct access to comprehensive business analysis, including market trends, company performance metrics, and expert insights. Unlike generic LLMs, FALM leverages a curated knowledge base built from professional journalism, enabling it to deliver precise and in-depth answers to intricate business questions. Users…
▽ More
This paper introduces Fortune Analytics Language Model (FALM). FALM empowers users with direct access to comprehensive business analysis, including market trends, company performance metrics, and expert insights. Unlike generic LLMs, FALM leverages a curated knowledge base built from professional journalism, enabling it to deliver precise and in-depth answers to intricate business questions. Users can further leverage natural language queries to directly visualize financial data, generating insightful charts and graphs to understand trends across diverse business sectors clearly. FALM fosters user trust and ensures output accuracy through three novel methods: 1) Time-aware reasoning guarantees accurate event registration and prioritizes recent updates. 2) Thematic trend analysis explicitly examines topic evolution over time, providing insights into emerging business landscapes. 3) Content referencing and task decomposition enhance answer fidelity and data visualization accuracy. We conduct both automated and human evaluations, demonstrating FALM's significant performance improvements over baseline methods while prioritizing responsible AI practices. These benchmarks establish FALM as a cutting-edge LLM in the business and media domains, with exceptional accuracy and trustworthiness.
△ Less
Submitted 2 June, 2024;
originally announced June 2024.
-
Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions
Authors:
Cheng Tan,
Dongxin Lyu,
Siyuan Li,
Zhangyang Gao,
Jingxuan Wei,
Siqi Ma,
Zicheng Liu,
Stan Z. Li
Abstract:
Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limited to static review generation based on submitted papers, which fail to capture the dynamic and iterative nature of real-world peer reviews. In this paper, we reformulate the peer-r…
▽ More
Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limited to static review generation based on submitted papers, which fail to capture the dynamic and iterative nature of real-world peer reviews. In this paper, we reformulate the peer-review process as a multi-turn, long-context dialogue, incorporating distinct roles for authors, reviewers, and decision makers. We construct a comprehensive dataset containing over 26,841 papers with 92,017 reviews collected from multiple sources, including the top-tier conference and prestigious journal. This dataset is meticulously designed to facilitate the applications of LLMs for multi-turn dialogues, effectively simulating the complete peer-review process. Furthermore, we propose a series of metrics to evaluate the performance of LLMs for each role under this reformulated peer-review setting, ensuring fair and comprehensive evaluations. We believe this work provides a promising perspective on enhancing the LLM-driven peer-review process by incorporating dynamic, role-based interactions. It aligns closely with the iterative and interactive nature of real-world academic peer review, offering a robust foundation for future research and development in this area. We open-source the dataset at https://github.com/chengtan9907/ReviewMT.
△ Less
Submitted 9 June, 2024;
originally announced June 2024.
-
Memorization in deep learning: A survey
Authors:
Jiaheng Wei,
Yanjun Zhang,
Leo Yu Zhang,
Ming Ding,
Chao Chen,
Kok-Leong Ong,
Jun Zhang,
Yang Xiang
Abstract:
Deep Learning (DL) powered by Deep Neural Networks (DNNs) has revolutionized various domains, yet understanding the intricacies of DNN decision-making and learning processes remains a significant challenge. Recent investigations have uncovered an interesting memorization phenomenon in which DNNs tend to memorize specific details from examples rather than learning general patterns, affecting model…
▽ More
Deep Learning (DL) powered by Deep Neural Networks (DNNs) has revolutionized various domains, yet understanding the intricacies of DNN decision-making and learning processes remains a significant challenge. Recent investigations have uncovered an interesting memorization phenomenon in which DNNs tend to memorize specific details from examples rather than learning general patterns, affecting model generalization, security, and privacy. This raises critical questions about the nature of generalization in DNNs and their susceptibility to security breaches. In this survey, we present a systematic framework to organize memorization definitions based on the generalization and security/privacy domains and summarize memorization evaluation methods at both the example and model levels. Through a comprehensive literature review, we explore DNN memorization behaviors and their impacts on security and privacy. We also introduce privacy vulnerabilities caused by memorization and the phenomenon of forgetting and explore its connection with memorization. Furthermore, we spotlight various applications leveraging memorization and forgetting mechanisms, including noisy label learning, privacy preservation, and model enhancement. This survey offers the first-in-kind understanding of memorization in DNNs, providing insights into its challenges and opportunities for enhancing AI development while addressing critical ethical concerns.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Enhanced Semantic Segmentation Pipeline for WeatherProof Dataset Challenge
Authors:
Nan Zhang,
Xidan Zhang,
Jianing Wei,
Fangjun Wang,
Zhiming Tan
Abstract:
This report describes the winning solution to the WeatherProof Dataset Challenge (CVPR 2024 UG2+ Track 3). Details regarding the challenge are available at https://cvpr2024ug2challenge.github.io/track3.html. We propose an enhanced semantic segmentation pipeline for this challenge. Firstly, we improve semantic segmentation models, using backbone pretrained with Depth Anything to improve UperNet mod…
▽ More
This report describes the winning solution to the WeatherProof Dataset Challenge (CVPR 2024 UG2+ Track 3). Details regarding the challenge are available at https://cvpr2024ug2challenge.github.io/track3.html. We propose an enhanced semantic segmentation pipeline for this challenge. Firstly, we improve semantic segmentation models, using backbone pretrained with Depth Anything to improve UperNet model and SETRMLA model, and adding language guidance based on both weather and category information to InternImage model. Secondly, we introduce a new dataset WeatherProofExtra with wider viewing angle and employ data augmentation methods, including adverse weather and super-resolution. Finally, effective training strategies and ensemble method are applied to improve final performance further. Our solution is ranked 1st on the final leaderboard. Code will be available at https://github.com/KaneiGi/WeatherProofChallenge.
△ Less
Submitted 6 June, 2024; v1 submitted 6 June, 2024;
originally announced June 2024.
-
Simulation of DAMPE silicon microstrip detectors in the $\rm Allpix^{2}$ framework
Authors:
Yu-Xin Cui,
Xiang Li,
Shen Wang,
Chuan Yue,
Qiang Wan,
Shi-Jun Lei,
Guan-Wen Yuan,
Yi-Ming Hu,
Jia-Ju Wei,
Jian-Hua Guo
Abstract:
Silicon strip detectors have been widely utilized in space experiments for gamma-ray and cosmic-ray detections thanks to their high spatial resolution and stable performance. For a silicon micro-strip detector, the Monte Carlo simulation is recognized as a practical and cost-effective approach to verify the detector performance. In this study, a technique for the simulation of the silicon micro-st…
▽ More
Silicon strip detectors have been widely utilized in space experiments for gamma-ray and cosmic-ray detections thanks to their high spatial resolution and stable performance. For a silicon micro-strip detector, the Monte Carlo simulation is recognized as a practical and cost-effective approach to verify the detector performance. In this study, a technique for the simulation of the silicon micro-strip detector with the $\rm Allpix^{2}$ framework is developed. By incorporating the electric field into the particle transport simulation based on Geant4, this framework could precisely emulate the carrier drift in the silicon micro-strip detector. The simulation results are validated using the beam test data as well as the flight data of the DAMPE experiment, which suggests that the $\rm Allpix^{2}$ framework is a powerful tool to obtain the performance of the silicon micro-strip detector.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
Detection of Acetone as a Gas Biomarker for Diabetes Based on Gas Sensor Technology
Authors:
Jiaming Wei,
Tong Liu,
Jipeng Huang,
Xiaowei Li,
Yurui Qi,
Gangyin Luo
Abstract:
With the continuous development and improvement of medical services, there is a growing demand for improving diabetes diagnosis. Exhaled breath analysis, characterized by its speed, convenience, and non-invasive nature, is leading the trend in diagnostic development. Studies have shown that the acetone levels in the breath of diabetes patients are higher than normal, making acetone a basis for dia…
▽ More
With the continuous development and improvement of medical services, there is a growing demand for improving diabetes diagnosis. Exhaled breath analysis, characterized by its speed, convenience, and non-invasive nature, is leading the trend in diagnostic development. Studies have shown that the acetone levels in the breath of diabetes patients are higher than normal, making acetone a basis for diabetes breath analysis. This provides a more readily accepted method for early diabetes prevention and monitoring. Addressing issues such as the invasive nature, disease transmission risks, and complexity of diabetes testing, this study aims to design a diabetes gas biomarker acetone detection system centered around a sensor array using gas sensors and pattern recognition algorithms. The research covers sensor selection, sensor preparation, circuit design, data acquisition and processing, and detection model establishment to accurately identify acetone. Titanium dioxide was chosen as the nano gas-sensitive material to prepare the acetone gas sensor, with data collection conducted using STM32. Filtering was applied to process the raw sensor data, followed by feature extraction using principal component analysis. A recognition model based on support vector machine algorithm was used for qualitative identification of gas samples, while a recognition model based on backpropagation neural network was employed for quantitative detection of gas sample concentrations. Experimental results demonstrated recognition accuracies of 96% and 97.5% for acetone-ethanol and acetone-methanol mixed gases, and 90% for ternary acetone, ethanol, and methanol mixed gases.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
Real-space tilting method for atomic resolution STEM imaging of nanocrystalline materials
Authors:
Jiake Wei,
Zhangze Xu,
Wenjie Shen,
Bin Feng,
Ryo Ishikawa,
Naoya Shibata,
Yuichi Ikuhara,
Xuedong Bai
Abstract:
Atomic-resolution scanning transmission electron microscopy (STEM) characterization requires precise tilting of the specimen to high symmetric zone axis, which is usually processed in reciprocal space by following the diffraction patterns. However, for small-sized nanocrystalline materials, their diffraction patterns are too faint to guide the tilting process. Here, a simple and effective tilting…
▽ More
Atomic-resolution scanning transmission electron microscopy (STEM) characterization requires precise tilting of the specimen to high symmetric zone axis, which is usually processed in reciprocal space by following the diffraction patterns. However, for small-sized nanocrystalline materials, their diffraction patterns are too faint to guide the tilting process. Here, a simple and effective tilting method is developed based on the diffraction contrast change of the shadow image in the Ronchigram. We can calculate the misorientation angle of the specimen and tilt it to the zone axis based on the position of the shadow image with lowest intensity. This method requires no prior knowledge of the sample and the maximum misorientation angle we can correct is greater than +-6.9 degree with sub-mrad accuracy. It is processed in real space, without recording the diffraction patterns of the specimens, which can effectively apply to nanocrystalline materials. Combined with the scripting to control the microscope, we can automatically tilt the sample to the zone axis under low dose condition (<0.17 e-/A2/s), which could facilitate the imaging of beam sensitive materials such as zeolites or metal organic frameworks. This automated tilting method could contribute to the atomic-scale characterization of the nanocrystalline materials by STEM imaging.
△ Less
Submitted 2 June, 2024;
originally announced June 2024.
-
Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning
Authors:
Cheng Tan,
Jingxuan Wei,
Linzhuang Sun,
Zhangyang Gao,
Siyuan Li,
Bihui Yu,
Ruifeng Guo,
Stan Z. Li
Abstract:
Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only models has been extensively explored, its adaptation into multimodal vision-language models remains nascent. Going beyond mere answer generation, the primary goal of…
▽ More
Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only models has been extensively explored, its adaptation into multimodal vision-language models remains nascent. Going beyond mere answer generation, the primary goal of multimodal RAG is to cultivate the models' ability to reason in response to relevant queries. To this end, we introduce a novel multimodal RAG framework named RMR (Retrieval Meets Reasoning). The RMR framework employs a bi-modal retrieval module to identify the most relevant question-answer pairs, which then serve as scaffolds for the multimodal reasoning process. This training-free approach not only encourages the model to engage deeply with the reasoning processes inherent in the retrieved content but also facilitates the generation of answers that are precise and richly interpretable. Surprisingly, utilizing solely the ScienceQA dataset, collected from elementary and high school science curricula, RMR significantly boosts the performance of various vision-language models across a spectrum of benchmark datasets, including A-OKVQA, MMBench, and SEED. These outcomes highlight the substantial potential of our multimodal retrieval and reasoning mechanism to improve the reasoning capabilities of vision-language models.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Why Larger Language Models Do In-context Learning Differently?
Authors:
Zhenmei Shi,
Junyi Wei,
Zhuoyan Xu,
Yingyu Liang
Abstract:
Large language models (LLM) have emerged as a powerful tool for AI, with the key ability of in-context learning (ICL), where they can perform well on unseen tasks based on a brief series of task examples without necessitating any adjustments to the model parameters. One recent interesting mysterious observation is that models of different scales may have different ICL behaviors: larger models tend…
▽ More
Large language models (LLM) have emerged as a powerful tool for AI, with the key ability of in-context learning (ICL), where they can perform well on unseen tasks based on a brief series of task examples without necessitating any adjustments to the model parameters. One recent interesting mysterious observation is that models of different scales may have different ICL behaviors: larger models tend to be more sensitive to noise in the test context. This work studies this observation theoretically aiming to improve the understanding of LLM and ICL. We analyze two stylized settings: (1) linear regression with one-layer single-head linear transformers and (2) parity classification with two-layer multiple attention heads transformers (non-linear data and non-linear model). In both settings, we give closed-form optimal solutions and find that smaller models emphasize important hidden features while larger ones cover more hidden features; thus, smaller models are more robust to noise while larger ones are more easily distracted, leading to different ICL behaviors. This sheds light on where transformers pay attention to and how that affects ICL. Preliminary experimental results on large base and chat models provide positive support for our analysis.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applications
Authors:
Dingkang Yang,
Jinjie Wei,
Dongling Xiao,
Shunli Wang,
Tong Wu,
Gang Li,
Mingcheng Li,
Shuaibing Wang,
Jiawei Chen,
Yue Jiang,
Qingyao Xu,
Ke Li,
Peng Zhai,
Lihua Zhang
Abstract:
Developing intelligent pediatric consultation systems offers promising prospects for improving diagnostic efficiency, especially in China, where healthcare resources are scarce. Despite recent advances in Large Language Models (LLMs) for Chinese medicine, their performance is sub-optimal in pediatric applications due to inadequate instruction data and vulnerable training procedures. To address the…
▽ More
Developing intelligent pediatric consultation systems offers promising prospects for improving diagnostic efficiency, especially in China, where healthcare resources are scarce. Despite recent advances in Large Language Models (LLMs) for Chinese medicine, their performance is sub-optimal in pediatric applications due to inadequate instruction data and vulnerable training procedures. To address the above issues, this paper builds PedCorpus, a high-quality dataset of over 300,000 multi-task instructions from pediatric textbooks, guidelines, and knowledge graph resources to fulfil diverse diagnostic demands. Upon well-designed PedCorpus, we propose PediatricsGPT, the first Chinese pediatric LLM assistant built on a systematic and robust training pipeline. In the continuous pre-training phase, we introduce a hybrid instruction pre-training mechanism to mitigate the internal-injected knowledge inconsistency of LLMs for medical domain adaptation. Immediately, the full-parameter Supervised Fine-Tuning (SFT) is utilized to incorporate the general medical knowledge schema into the models. After that, we devise a direct following preference optimization to enhance the generation of pediatrician-like humanistic responses. In the parameter-efficient secondary SFT phase, a mixture of universal-specific experts strategy is presented to resolve the competency conflict between medical generalist and pediatric expertise mastery. Extensive results based on the metrics, GPT-4, and doctor evaluations on distinct doctor downstream tasks show that PediatricsGPT consistently outperforms previous Chinese medical LLMs. Our model and dataset will be open-source for community development.
△ Less
Submitted 3 June, 2024; v1 submitted 29 May, 2024;
originally announced May 2024.
-
Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation
Authors:
Zhoujie Fu,
Jiacheng Wei,
Wenhao Shen,
Chaoyue Song,
Xiaofeng Yang,
Fayao Liu,
Xulei Yang,
Guosheng Lin
Abstract:
In this work, we introduce a novel approach for creating controllable dynamics in 3D-generated Gaussians using casually captured reference videos. Our method transfers the motion of objects from reference videos to a variety of generated 3D Gaussians across different categories, ensuring precise and customizable motion transfer. We achieve this by employing blend skinning-based non-parametric shap…
▽ More
In this work, we introduce a novel approach for creating controllable dynamics in 3D-generated Gaussians using casually captured reference videos. Our method transfers the motion of objects from reference videos to a variety of generated 3D Gaussians across different categories, ensuring precise and customizable motion transfer. We achieve this by employing blend skinning-based non-parametric shape reconstruction to extract the shape and motion of reference objects. This process involves segmenting the reference objects into motion-related parts based on skinning weights and establishing shape correspondences with generated target shapes. To address shape and temporal inconsistencies prevalent in existing methods, we integrate physical simulation, driving the target shapes with matched motion. This integration is optimized through a displacement loss to ensure reliable and genuine dynamics. Our approach supports diverse reference inputs, including humans, quadrupeds, and articulated objects, and can generate dynamics of arbitrary length, providing enhanced fidelity and applicability. Unlike methods heavily reliant on diffusion video generation models, our technique offers specific and high-quality motion transfer, maintaining both shape integrity and temporal consistency.
△ Less
Submitted 7 July, 2024; v1 submitted 27 May, 2024;
originally announced May 2024.
-
Analytical photoresponses of Schottky contact MoS2 phototransistors
Authors:
Jianyong Wei,
Yumeng Liu,
Yizhuo Wang,
Kai Li,
Zhentao Lian,
Maosong Xie,
Xinhan Yang,
Seyed Saleh Mousavi Khaleghi,
Fuxing Dai,
Weida Hu,
Xuejiao Gao,
Rui Yang,
Yaping Dan
Abstract:
High-gain photodetectors based on two-dimensional (2D) semiconductors, in particular those in photoconductive mode, have been extensively investigated in the past decade. However, the classical photoconductive theory was derived on two misplaced assumptions. In this work, we established an explicit analytical device model for Schottky contact MoS2 phototransistors that fits well with experimental…
▽ More
High-gain photodetectors based on two-dimensional (2D) semiconductors, in particular those in photoconductive mode, have been extensively investigated in the past decade. However, the classical photoconductive theory was derived on two misplaced assumptions. In this work, we established an explicit analytical device model for Schottky contact MoS2 phototransistors that fits well with experimental data. From the fitting results, we found that the Richardson constant of the MoS2 Schottky contact is temperature dependent, indicating that the Schottky contacts for the 2D material is best described by the mixed thermionic emission and diffusion model. Based on this device model, we further established an analytical photoresponse for the few-layer MoS2 phototransistors, from which we found the voltage distribution on the two Schottky contacts and the channel, and extracted the minority carrier recombination lifetimes. The lifetimes are comparable with the values found from transient photoluminescence measurements, which therefore validates our analytical photoresponses for Schottky contact 2D semiconducting phototransistors.
△ Less
Submitted 25 May, 2024;
originally announced May 2024.
-
Rocket Landing Control with Grid Fins and Path-following using MPC
Authors:
Junhao Yu,
Jiarun Wei
Abstract:
In this project, we attempt to optimize a landing trajectory of a rocket. The goal is to minimize the total fuel consumption during the landing process using different techniques. Once the optimal and feasible trajectory is generated using batch approach, we attempt to follow the path using a Model Predictive Control (MPC) based algorithm, called Trajectory Optimizing Path following Estimation fro…
▽ More
In this project, we attempt to optimize a landing trajectory of a rocket. The goal is to minimize the total fuel consumption during the landing process using different techniques. Once the optimal and feasible trajectory is generated using batch approach, we attempt to follow the path using a Model Predictive Control (MPC) based algorithm, called Trajectory Optimizing Path following Estimation from Demonstration (TOPED), in order to generalize to similar initial states and models, where we introduce a novel cost function for the MPC to solve. We further show that TOPED can follow a demonstration trajectory well in practice under model mismatch and different initial states.
△ Less
Submitted 25 May, 2024;
originally announced May 2024.
-
Efficient Temporal Action Segmentation via Boundary-aware Query Voting
Authors:
Peiyao Wang,
Yuewei Lin,
Erik Blasch,
Jie Wei,
Haibin Ling
Abstract:
Although the performance of Temporal Action Segmentation (TAS) has improved in recent years, achieving promising results often comes with a high computational cost due to dense inputs, complex model structures, and resource-intensive post-processing requirements. To improve the efficiency while keeping the performance, we present a novel perspective centered on per-segment classification. By harne…
▽ More
Although the performance of Temporal Action Segmentation (TAS) has improved in recent years, achieving promising results often comes with a high computational cost due to dense inputs, complex model structures, and resource-intensive post-processing requirements. To improve the efficiency while keeping the performance, we present a novel perspective centered on per-segment classification. By harnessing the capabilities of Transformers, we tokenize each video segment as an instance token, endowed with intrinsic instance segmentation. To realize efficient action segmentation, we introduce BaFormer, a boundary-aware Transformer network. It employs instance queries for instance segmentation and a global query for class-agnostic boundary prediction, yielding continuous segment proposals. During inference, BaFormer employs a simple yet effective voting strategy to classify boundary-wise segments based on instance segmentation. Remarkably, as a single-stage approach, BaFormer significantly reduces the computational costs, utilizing only 6% of the running time compared to state-of-the-art method DiffAct, while producing better or comparable accuracy over several popular benchmarks. The code for this project is publicly available at https://github.com/peiyao-w/BaFormer.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Ultrafast Broadband Strong-Field Tunnelling in Asymmetric Nanogaps for Time-Resolved Nanoscopy
Authors:
Haoqing Ning,
Marios Maimaris,
Jiewen Wei,
Emilie Gérouville,
Evangelos Moutoulas,
Zhu Meng,
Clement Ferchaud,
Dmitry Maslennikov,
Navendu Mondal,
Tong Wang,
Colin Chow,
Aleksandar P. Ivanov,
Joshua B. Edel,
Saif A. Haque,
Misha Ivanov,
Jon P. Marangos,
Dimitra G. Georgiadou,
Artem A. Bakulin
Abstract:
Femtosecond-fast and nanometre-size pulses of electrons are emerging as unique probes for ultrafast dynamics at the nanoscale. Presently, such pulses are achievable only in highly sophisticated ultrafast electron microscopes or equally complex setups involving few-cycle-pulsed lasers with stable carrier-envelope phase (CEP) and nanotip probes. Here, we show that the generation of femtosecond pulse…
▽ More
Femtosecond-fast and nanometre-size pulses of electrons are emerging as unique probes for ultrafast dynamics at the nanoscale. Presently, such pulses are achievable only in highly sophisticated ultrafast electron microscopes or equally complex setups involving few-cycle-pulsed lasers with stable carrier-envelope phase (CEP) and nanotip probes. Here, we show that the generation of femtosecond pulses of nanoscale tunnelling electrons can be achieved in any ultrafast optical laboratory, using any (deep-UV to mid-IR) femtosecond laser in combination with photosensitive asymmetric nanogap (PAN) diodes fabricated via easy-to-scale adhesion lithography. The dominant mechanism producing tunnelling electrons in PANs is strong-field emission, which is easily achievable without CEP locking or external bias voltage. We employ PANs to demonstrate ultrafast nanoscopy of metal-halide perovskite quantum dots immobilised inside a 10-nm Al/Au nanogap and to characterise laser pulses across the entire optical region (266-6700 nm). Short electron pulses in PANs open the way towards scalable on-chip femtosecond electron measurements and novel design approaches for integrated ultrafast sensing nanodevices.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Age of massive galaxies at redshift 8
Authors:
M. Lopez-Corredoira,
F. Melia,
J. -J. Wei,
C. -Y. Gao
Abstract:
Recent James Webb Space Telescope (JWST) data analyses have shown that massive red galaxies existed at redshifts $z>6$, a discovery that is difficult to understand in the context of standard cosmology ($Λ$CDM). Here we analyze these observations more deeply by fitting a stellar population model to the optical and near-infrared photometric data. These fits include a main stellar population in addit…
▽ More
Recent James Webb Space Telescope (JWST) data analyses have shown that massive red galaxies existed at redshifts $z>6$, a discovery that is difficult to understand in the context of standard cosmology ($Λ$CDM). Here we analyze these observations more deeply by fitting a stellar population model to the optical and near-infrared photometric data. These fits include a main stellar population in addition to a residual younger population and with the same extinction for both (a lower extinction for the younger population is unphysical). Extra stellar populations or the inclusion of an AGN component do not significantly improve the fits. These galaxies are being viewed at very high redshifts, with an average $\langle z\rangle \approx 8.2$, when the $Λ$CDM Universe was only $\approx 600$ Myr old. This result conflicts with the inferred ages of these galaxies, however, which were on average between 0.9 and 2.4 Gyr old within 95% CL. Given the sequence of star formation and galaxy assembly in the standard model, these galaxies should instead be even younger than 290 Myr on average, for which our analysis assigns a probability of only $<3\times 10^{-4}$ ($\gtrsim 3.6σ$ tension). This outcome may indicate the need to consider non-standard cosmologies. Nevertheless, our conclusions result from several approximations in stellar astrophysics and extinction, so they should be taken with a grain of salt. Further research is necessary to corroborate the possible existence of galaxies older than the $Λ$CDM universe at their observed redshifts.
△ Less
Submitted 22 May, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
iHERO: Interactive Human-oriented Exploration and Supervision Under Scarce Communication
Authors:
Zhuoli Tian,
Yuyang Zhang,
Jinsheng Wei,
Meng Guo
Abstract:
Exploration of unknown scenes before human entry is essential for safety and efficiency in numerous scenarios, e.g., subterranean exploration, reconnaissance, search and rescue missions. Fleets of autonomous robots are particularly suitable for this task, via concurrent exploration, multi-sensory perception and autonomous navigation. Communication however among the robots can be severely restricte…
▽ More
Exploration of unknown scenes before human entry is essential for safety and efficiency in numerous scenarios, e.g., subterranean exploration, reconnaissance, search and rescue missions. Fleets of autonomous robots are particularly suitable for this task, via concurrent exploration, multi-sensory perception and autonomous navigation. Communication however among the robots can be severely restricted to only close-range exchange via ad-hoc networks. Although some recent works have addressed the problem of collaborative exploration under restricted communication, the crucial role of the human operator has been mostly neglected. Indeed, the operator may: (i) require timely update regarding the exploration progress and fleet status; (ii) prioritize certain regions; and (iii) dynamically move within the explored area; To facilitate these requests, this work proposes an interactive human-oriented online coordination framework for collaborative exploration and supervision under scarce communication (iHERO). The robots switch smoothly and optimally among fast exploration, intermittent exchange of map and sensory data, and return to the operator for status update. It is ensured that these requests are fulfilled online interactively with a pre-specified latency. Extensive large-scale human-in-the-loop simulations and hardware experiments are performed over numerous challenging scenes, which signify its performance such as explored area and efficiency, and validate its potential applicability to real-world scenarios. The videos are available on https://zl-tian.github.io/iHERO/.
△ Less
Submitted 7 June, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
SN 2019tua : A Type IIb Supernova with Multiple Bumps in the Light Curves
Authors:
Xin-Bo Huang,
Xiang-Gao Wang,
Long Li,
Li-Ping Xin,
Jing Wang,
Tian-Ci Zheng,
Qi Wang,
Hui-Ya Liu,
Zi-Min Zhou,
Xiao-meng Lu,
jian-yan Wei,
En-Wei Liang
Abstract:
We present photometric and spectroscopic observations and analysis of the type IIb supernova (SN) SN 2019tua, which exhibits multiple bumps in its declining light curves between 40 and 65 days after discovery. SN 2019tua shows a time to peak of about 25 days similar to other type IIb SNe. Our observations indicate a decrease in its brightness of about 1 magnitude in the 60 days after the peak. At…
▽ More
We present photometric and spectroscopic observations and analysis of the type IIb supernova (SN) SN 2019tua, which exhibits multiple bumps in its declining light curves between 40 and 65 days after discovery. SN 2019tua shows a time to peak of about 25 days similar to other type IIb SNe. Our observations indicate a decrease in its brightness of about 1 magnitude in the 60 days after the peak. At about days 50, and 60, its multiband light curves exhibit bumpy behavior. The complex luminosity evolution of SN 2019tua could not be well modeled with a single currently popular energy source model, e.g., radioactive decay of $^{56}$Ni, magnetar, interaction between the ejecta and a circumstellar shell. Even though the magnetar model has a smaller $χ^2 / \text{dof}$ value, the complex changes in SN 2019tua's brightness suggest that more than one physical process might be involved. We propose a hybrid CSM interaction plus $^{56}$Ni model to explain the bolometric light curve (LC) of SN 2019tua. The fitting results show that the ejecta mass $M_{\rm ej} \approx 2.4~M_\odot$, the total CSM mass $M_{\rm CSM} \approx 1.0~M_\odot$, and the $^{56}$Ni mass $M_{\rm Ni} \approx 0.4~M_\odot$. The total kinetic energy of the ejecta is $E_k\approx 0.5 \times 10^{51}\rm~erg$. Pre-existing multiple shells suggest that the progenitor of SN 2019tua experienced mass ejections within approximately $\sim6 - 44$ years prior to the explosion.
△ Less
Submitted 23 May, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
Neighborhood Attention Transformer with Progressive Channel Fusion for Speaker Verification
Authors:
Nian Li,
Jianguo Wei
Abstract:
Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which can achieve competitive results when trained on VoxCeleb2 alone. The network alternates between neighborhood attention and global attention to capture local and g…
▽ More
Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which can achieve competitive results when trained on VoxCeleb2 alone. The network alternates between neighborhood attention and global attention to capture local and global features, then aggregates features of different hierarchical levels, and finally performs attentive statistics pooling. Additionally, we employ a progressive channel fusion strategy to expand the receptive field in the channel dimension as the network deepens. We trained the proposed PCF-NAT model on VoxCeleb2 and evaluated it on VoxCeleb1 and the validation sets of VoxSRC. The EER and minDCF of the shallow PCF-NAT are on average more than 20% lower than those of similarly sized ECAPA-TDNN. Deep PCF-NAT achieves an EER lower than 0.5% on VoxCeleb1-O. The code and models are publicly available at https://github.com/ChenNan1996/PCF-NAT.
△ Less
Submitted 29 May, 2024; v1 submitted 20 May, 2024;
originally announced May 2024.
-
Data quality control system and long-term performance monitor of the LHAASO-KM2A
Authors:
Zhen Cao,
F. Aharonian,
Axikegu,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
W. Bian,
A. V. Bukevich,
Q. Cao,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
A. M. Chen,
E. S. Chen,
H. X. Chen,
Liang Chen,
Lin Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. Chen
, et al. (263 additional authors not shown)
Abstract:
The KM2A is the largest sub-array of the Large High Altitude Air Shower Observatory (LHAASO). It consists of 5216 electromagnetic particle detectors (EDs) and 1188 muon detectors (MDs). The data recorded by the EDs and MDs are used to reconstruct primary information of cosmic ray and gamma-ray showers. This information is used for physical analysis in gamma-ray astronomy and cosmic ray physics. To…
▽ More
The KM2A is the largest sub-array of the Large High Altitude Air Shower Observatory (LHAASO). It consists of 5216 electromagnetic particle detectors (EDs) and 1188 muon detectors (MDs). The data recorded by the EDs and MDs are used to reconstruct primary information of cosmic ray and gamma-ray showers. This information is used for physical analysis in gamma-ray astronomy and cosmic ray physics. To ensure the reliability of the LHAASO-KM2A data, a three-level quality control system has been established. It is used to monitor the status of detector units, stability of reconstructed parameters and the performance of the array based on observations of the Crab Nebula and Moon shadow. This paper will introduce the control system and its application on the LHAASO-KM2A data collected from August 2021 to July 2023. During this period, the pointing and angular resolution of the array were stable. From the observations of the Moon shadow and Crab Nebula, the results achieved using the two methods are consistent with each other. According to the observation of the Crab Nebula at energies from 25 TeV to 100 TeV, the time averaged pointing errors are estimated to be $-0.003^{\circ} \pm 0.005^{\circ}$ and $0.001^{\circ} \pm 0.006^{\circ}$ in the R.A. and Dec directions, respectively.
△ Less
Submitted 13 June, 2024; v1 submitted 20 May, 2024;
originally announced May 2024.
-
Instability of Circumnuclear Gas Supply as An Origin of "Changing-look" Phenomenon of Supermassive Blackholes
Authors:
J. Wang,
D. W. Xu,
Xinwu Cao,
C. Gao,
C. H. Xie,
J. Y. Wei
Abstract:
The origin of the "Changing-look" (CL) phenomenon in supermassive black holes (SMBHs) remains an open issue. This study aims to shed light on this phenomenon by focusing on a sample that encompasses all known repeating CL active galactic nuclei (AGNs). Through the identification of a characteristic time scale for the CL phenomenon, it was observed that larger SMBHs possess shorter characteristic t…
▽ More
The origin of the "Changing-look" (CL) phenomenon in supermassive black holes (SMBHs) remains an open issue. This study aims to shed light on this phenomenon by focusing on a sample that encompasses all known repeating CL active galactic nuclei (AGNs). Through the identification of a characteristic time scale for the CL phenomenon, it was observed that larger SMBHs possess shorter characteristic timescales, while smaller SMBHs exhibit longer timescales. These findings reveal a significant contrast to the traditional AGN variability that has been adequately explained by the AGN's disk instability model. This stark discrepancy highlights a distinct origin of the CL phenomenon, distinguishing it from traditional AGN variability. By properly predicting the characteristic time scale and its dependence on SMBH mass, we propose that the CL phenomenon is likely a result of a variation in accretion rate caused by a sudden change in the supply of circumnuclear gas during the transition between active and passive SMBH fueling stages.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Treatment Effect Estimation for User Interest Exploration on Recommender Systems
Authors:
Jiaju Chen,
Wenjie Wang,
Chongming Gao,
Peng Wu,
Jianxiong Wei,
Qingsong Hua
Abstract:
Recommender systems learn personalized user preferences from user feedback like clicks. However, user feedback is usually biased towards partially observed interests, leaving many users' hidden interests unexplored. Existing approaches typically mitigate the bias, increase recommendation diversity, or use bandit algorithms to balance exploration-exploitation trade-offs. Nevertheless, they fail to…
▽ More
Recommender systems learn personalized user preferences from user feedback like clicks. However, user feedback is usually biased towards partially observed interests, leaving many users' hidden interests unexplored. Existing approaches typically mitigate the bias, increase recommendation diversity, or use bandit algorithms to balance exploration-exploitation trade-offs. Nevertheless, they fail to consider the potential rewards of recommending different categories of items and lack the global scheduling of allocating top-N recommendations to categories, leading to suboptimal exploration. In this work, we propose an Uplift model-based Recommender (UpliftRec) framework, which regards top-N recommendation as a treatment optimization problem. UpliftRec estimates the treatment effects, i.e., the click-through rate (CTR) under different category exposure ratios, by using observational user feedback. UpliftRec calculates group-level treatment effects to discover users' hidden interests with high CTR rewards and leverages inverse propensity weighting to alleviate confounder bias. Thereafter, UpliftRec adopts a dynamic programming method to calculate the optimal treatment for overall CTR maximization. We implement UpliftRec on different backend models and conduct extensive experiments on three datasets. The empirical results validate the effectiveness of UpliftRec in discovering users' hidden interests while achieving superior recommendation accuracy.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Discovery of Very-high-energy Gamma-ray Emissions from the Low Luminosity AGN NGC 4278 by LHAASO
Authors:
Zhen Cao,
F. Aharonian,
Q. An,
Axikegu,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
J. T. Cai,
Q. Cao,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
A. M. Chen,
E. S. Chen,
Liang Chen,
Lin Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. H. Chen,
S. Z. Chen
, et al. (255 additional authors not shown)
Abstract:
The first source catalog of Large High Altitude Air Shower Observatory reported the detection of a very-high-energy gamma ray source, 1LHAASO J1219+2915. In this paper a further detailed study of the spectral and temporal behavior of this point-like source have been carried. The best-fit position of the TeV source ($\rm{RA}=185.05^{\circ}\pm0.04^{\circ}$, $\rm{Dec}=29.25^{\circ}\pm0.03^{\circ}$) i…
▽ More
The first source catalog of Large High Altitude Air Shower Observatory reported the detection of a very-high-energy gamma ray source, 1LHAASO J1219+2915. In this paper a further detailed study of the spectral and temporal behavior of this point-like source have been carried. The best-fit position of the TeV source ($\rm{RA}=185.05^{\circ}\pm0.04^{\circ}$, $\rm{Dec}=29.25^{\circ}\pm0.03^{\circ}$) is compatible with NGC 4278 within $\sim0.03$ degree. Variation analysis shows an indication of the variability at a few months level in the TeV band, which is consistent with low frequency observations. Based on these observations, we report the detection of TeV $γ$-ray emissions from this low-luminosity AGN NGC 4278. The observations by LHAASO-WCDA during active period has a significance level of 8.8\,$σ$ with best-fit photon spectral index $\varGamma=2.56\pm0.14$ and a flux $f_{1-10\,\rm{TeV}}=(7.0\pm1.1_{\rm{sta}}\pm0.35_{\rm{syst}})\times10^{-13}\,\rm{photons\,cm^{-2}\,s^{-1}}$, or approximately $5\%$ of the Crab Nebula. The discovery of VHE from NGC 4278 indicates that the compact, weak radio jet can efficiently accelerate particles and emit TeV photons.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Convergence analysis of three semi-discrete numerical schemes for nonlocal geometric flows including perimeter terms
Authors:
Jiang Wei,
Su Chunmei,
Zhang Ganghui
Abstract:
We present and analyze three distinct semi-discrete schemes for solving nonlocal geometric flows incorporating perimeter terms. These schemes are based on the finite difference method, the finite element method, and the finite element method with a specific tangential motion. We offer rigorous proofs of quadratic convergence under $H^1$-norm for the first scheme and linear convergence under $H^1$-…
▽ More
We present and analyze three distinct semi-discrete schemes for solving nonlocal geometric flows incorporating perimeter terms. These schemes are based on the finite difference method, the finite element method, and the finite element method with a specific tangential motion. We offer rigorous proofs of quadratic convergence under $H^1$-norm for the first scheme and linear convergence under $H^1$-norm for the latter two schemes. All error estimates rely on the observation that the error of the nonlocal term can be controlled by the error of the local term. Furthermore, we explore the relationship between the convergence under $L^\infty$-norm and manifold distance. Extensive numerical experiments are conducted to verify the convergence analysis, and demonstrate the accuracy of our schemes under various norms for different types of nonlocal flows.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Bridging the Gap: Protocol Towards Fair and Consistent Affect Analysis
Authors:
Guanyu Hu,
Eleni Papadopoulou,
Dimitrios Kollias,
Paraskevi Tzouveli,
Jie Wei,
Xinyu Yang
Abstract:
The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across diverse subpopulation groups, including age, gender, and race, becomes paramount. Automatic affect analysis, at the intersection of physiology, psychology, and machin…
▽ More
The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across diverse subpopulation groups, including age, gender, and race, becomes paramount. Automatic affect analysis, at the intersection of physiology, psychology, and machine learning, has seen significant development. However, existing databases and methodologies lack uniformity, leading to biased evaluations. This work addresses these issues by analyzing six affective databases, annotating demographic attributes, and proposing a common protocol for database partitioning. Emphasis is placed on fairness in evaluations. Extensive experiments with baseline and state-of-the-art methods demonstrate the impact of these changes, revealing the inadequacy of prior assessments. The findings underscore the importance of considering demographic attributes in affect analysis research and provide a foundation for more equitable methodologies. Our annotations, code and pre-trained models are available at: https://github.com/dkollias/Fair-Consistent-Affect-Analysis
△ Less
Submitted 16 May, 2024; v1 submitted 10 May, 2024;
originally announced May 2024.
-
Critical Mass Phenomena and Blow-up behavior of Ground States in stationary second order Mean-Field Games systems with decreasing cost
Authors:
Marco Cirant,
Fanze Kong,
Juncheng Wei,
Xiaoyu Zeng
Abstract:
This paper is devoted to the study of Mean-field Games (MFG) systems in the mass critical exponent case. We firstly establish the optimal Gagliardo-Nirenberg type inequality associated with the potential-free MFG system. Then, under some mild assumptions on the potential function, we show that there exists a critical mass $M^*$ such that the MFG system admits a least energy solution if and only if…
▽ More
This paper is devoted to the study of Mean-field Games (MFG) systems in the mass critical exponent case. We firstly establish the optimal Gagliardo-Nirenberg type inequality associated with the potential-free MFG system. Then, under some mild assumptions on the potential function, we show that there exists a critical mass $M^*$ such that the MFG system admits a least energy solution if and only if the total mass of population density $M$ satisfies $M<M^*$. Moreover, the blow-up behavior of energy minimizers are captured as $M\nearrow M^*$. In particular, given the precise asymptotic expansions of the potential, we establish the refined blow-up behavior of ground states as $M\nearrow M^*.$ While studying the existence of least energy solutions, we establish new local $W^{2,p}$ estimates of solutions to Hamilton-Jacobi equations with superlinear gradient terms.
△ Less
Submitted 2 August, 2024; v1 submitted 8 May, 2024;
originally announced May 2024.
-
GUing: A Mobile GUI Search Engine using a Vision-Language Model
Authors:
Jialiang Wei,
Anne-Lise Courbis,
Thomas Lambolais,
Binbin Xu,
Pierre Louis Bernard,
Gérard Dray,
Walid Maalej
Abstract:
App developers use the Graphical User Interface (GUI) of other apps as an important source of inspiration to design and improve their own apps. In recent years, research suggested various approaches to retrieve GUI designs that fit a certain text query from screenshot datasets acquired through automated GUI exploration. However, such text-to-GUI retrieval approaches only leverage the textual infor…
▽ More
App developers use the Graphical User Interface (GUI) of other apps as an important source of inspiration to design and improve their own apps. In recent years, research suggested various approaches to retrieve GUI designs that fit a certain text query from screenshot datasets acquired through automated GUI exploration. However, such text-to-GUI retrieval approaches only leverage the textual information of the GUI elements in the screenshots, neglecting visual information such as icons or background images. In addition, the retrieved screenshots are not steered by app developers and often lack important app features, e.g. whose UI pages require user authentication. To overcome these limitations, this paper proposes GUing, a GUI search engine based on a vision-language model called UIClip, which we trained specifically for the app GUI domain. For this, we first collected app introduction images from Google Play, which usually display the most representative screenshots selected and often captioned (i.e. labeled) by app vendors. Then, we developed an automated pipeline to classify, crop, and extract the captions from these images. This finally results in a large dataset which we share with this paper: including 303k app screenshots, out of which 135k have captions. We used this dataset to train a novel vision-language model, which is, to the best of our knowledge, the first of its kind in GUI retrieval. We evaluated our approach on various datasets from related work and in manual experiment. The results demonstrate that our model outperforms previous approaches in text-to-GUI retrieval achieving a Recall@10 of up to 0.69 and a HIT@10 of 0.91. We also explored the performance of UIClip for other GUI tasks including GUI classification and Sketch-to-GUI retrieval with encouraging results.
△ Less
Submitted 30 April, 2024;
originally announced May 2024.
-
Real-Time Convolutional Neural Network-Based Star Detection and Centroiding Method for CubeSat Star Tracker
Authors:
Hongrui Zhao,
Michael F. Lembeck,
Adrian Zhuang,
Riya Shah,
Jesse Wei
Abstract:
Star trackers are one of the most accurate celestial sensors used for absolute attitude determination. The devices detect stars in captured images and accurately compute their projected centroids on an imaging focal plane with subpixel precision. Traditional algorithms for star detection and centroiding often rely on threshold adjustments for star pixel detection and pixel brightness weighting for…
▽ More
Star trackers are one of the most accurate celestial sensors used for absolute attitude determination. The devices detect stars in captured images and accurately compute their projected centroids on an imaging focal plane with subpixel precision. Traditional algorithms for star detection and centroiding often rely on threshold adjustments for star pixel detection and pixel brightness weighting for centroid computation. However, challenges like high sensor noise and stray light can compromise algorithm performance. This article introduces a Convolutional Neural Network (CNN)-based approach for star detection and centroiding, tailored to address the issues posed by noisy star tracker images in the presence of stray light and other artifacts. Trained using simulated star images overlayed with real sensor noise and stray light, the CNN produces both a binary segmentation map distinguishing star pixels from the background and a distance map indicating each pixel's proximity to the nearest star centroid. Leveraging this distance information alongside pixel coordinates transforms centroid calculations into a set of trilateration problems solvable via the least squares method. Our method employs efficient UNet variants for the underlying CNN architectures, and the variants' performances are evaluated. Comprehensive testing has been undertaken with synthetic image evaluations, hardware-in-the-loop assessments, and night sky tests. The tests consistently demonstrated that our method outperforms several existing algorithms in centroiding accuracy and exhibits superior resilience to high sensor noise and stray light interference. An additional benefit of our algorithms is that they can be executed in real-time on low-power edge AI processors.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Distributed Source Coding for Parametric and Non-Parametric Regression
Authors:
Jiahui Wei,
Elsa Dupraz,
Philippe Mary
Abstract:
The design of communication systems dedicated to machine learning tasks is one key aspect of goal-oriented communications. In this framework, this article investigates the interplay between data reconstruction and learning from the same compressed observations, particularly focusing on the regression problem. We establish achievable rate-generalization error regions for both parametric and non-par…
▽ More
The design of communication systems dedicated to machine learning tasks is one key aspect of goal-oriented communications. In this framework, this article investigates the interplay between data reconstruction and learning from the same compressed observations, particularly focusing on the regression problem. We establish achievable rate-generalization error regions for both parametric and non-parametric regression, where the generalization error measures the regression performance on previously unseen data. The analysis covers both asymptotic and finite block-length regimes, providing fundamental results and practical insights for the design of coding schemes dedicated to regression. The asymptotic analysis relies on conventional Wyner-Ziv coding schemes which we extend to study the convergence of the generalization error. The finite-length analysis uses the notions of information density and dispersion with additional term for the generalization error. We further investigate the trade-off between reconstruction and regression in both asymptotic and non-asymptotic regimes. Contrary to the existing literature which focused on other learning tasks, our results state that in the case of regression, there is no trade-off between data reconstruction and regression in the asymptotic regime. We also observe the same absence of trade-off for the considered achievable scheme in the finite-length regime, by analyzing correlation between distortion and generalization error.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Cosmology-independent Photon Mass Limits from Localized Fast Radio Bursts by using Artificial Neural Networks
Authors:
Jing-Yu Ran,
Bao Wang,
Jun-Jie Wei
Abstract:
A hypothetical photon mass, $m_γ$, can produce a frequency-dependent vacuum dispersion of light, which leads to an additional time delay between photons with different frequencies when they propagate through a fixed distance. The dispersion measure--redshift measurements of fast radio bursts (FRBs) have been widely used to constrain the rest mass of the photon. However, all current studies analyze…
▽ More
A hypothetical photon mass, $m_γ$, can produce a frequency-dependent vacuum dispersion of light, which leads to an additional time delay between photons with different frequencies when they propagate through a fixed distance. The dispersion measure--redshift measurements of fast radio bursts (FRBs) have been widely used to constrain the rest mass of the photon. However, all current studies analyzed the effect of the frequency-dependent dispersion for massive photons in the standard $Λ$CDM cosmological context. In order to alleviate the circularity problem induced by the presumption of a specific cosmological model based on the fundamental postulate of the masslessness of photons, here we employ a new model-independent smoothing technique, Artificial Neural Network (ANN), to reconstruct the Hubble parameter $H(z)$ function from 34 cosmic-chronometer measurements. By combining observations of 32 well-localized FRBs and the $H(z)$ function reconstructed by ANN, we obtain an upper limit of $m_γ \le 3.5 \times 10^{-51}\;\rm{kg}$, or equivalently $m_γ \le 2.0 \times 10^{-15}\;\rm{eV/c^2}$ ($m_γ \le 6.5 \times 10^{-51}\;\rm{kg}$, or equivalently $m_γ \le 3.6 \times 10^{-15}\;\rm{eV/c^2}$) at the $1σ$ ($2σ$) confidence level. This is the first cosmology-independent photon mass limit derived from extragalactic sources.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
The Third Monocular Depth Estimation Challenge
Authors:
Jaime Spencer,
Fabio Tosi,
Matteo Poggi,
Ripudaman Singh Arora,
Chris Russell,
Simon Hadfield,
Richard Bowden,
GuangYuan Zhou,
ZhengXin Li,
Qiang Rao,
YiPing Bao,
Xiao Liu,
Dohyeong Kim,
Jinseong Kim,
Myunghyun Kim,
Mykola Lavreniuk,
Rui Li,
Qing Mao,
Jiang Wu,
Yu Zhu,
Jinqiu Sun,
Yanning Zhang,
Suraj Patni,
Aradhye Agarwal,
Chetan Arora
, et al. (16 additional authors not shown)
Abstract:
This paper discusses the results of the third edition of the Monocular Depth Estimation Challenge (MDEC). The challenge focuses on zero-shot generalization to the challenging SYNS-Patches dataset, featuring complex scenes in natural and indoor settings. As with the previous edition, methods can use any form of supervision, i.e. supervised or self-supervised. The challenge received a total of 19 su…
▽ More
This paper discusses the results of the third edition of the Monocular Depth Estimation Challenge (MDEC). The challenge focuses on zero-shot generalization to the challenging SYNS-Patches dataset, featuring complex scenes in natural and indoor settings. As with the previous edition, methods can use any form of supervision, i.e. supervised or self-supervised. The challenge received a total of 19 submissions outperforming the baseline on the test set: 10 among them submitted a report describing their approach, highlighting a diffused use of foundational models such as Depth Anything at the core of their method. The challenge winners drastically improved 3D F-Score performance, from 17.51% to 23.72%.
△ Less
Submitted 27 April, 2024; v1 submitted 25 April, 2024;
originally announced April 2024.
-
Soft X-ray prompt emission from a high-redshift gamma-ray burst EP240315a
Authors:
Y. Liu,
H. Sun,
D. Xu,
D. S. Svinkin,
J. Delaunay,
N. R. Tanvir,
H. Gao,
C. Zhang,
Y. Chen,
X. -F. Wu,
B. Zhang,
W. Yuan,
J. An,
G. Bruni,
D. D. Frederiks,
G. Ghirlanda,
J. -W. Hu,
A. Li,
C. -K. Li,
J. -D. Li,
D. B. Malesani,
L. Piro,
G. Raman,
R. Ricci,
E. Troja
, et al. (170 additional authors not shown)
Abstract:
Long gamma-ray bursts (GRBs) are believed to originate from core collapse of massive stars. High-redshift GRBs can probe the star formation and reionization history of the early universe, but their detection remains rare. Here we report the detection of a GRB triggered in the 0.5--4 keV band by the Wide-field X-ray Telescope (WXT) on board the Einstein Probe (EP) mission, designated as EP240315a,…
▽ More
Long gamma-ray bursts (GRBs) are believed to originate from core collapse of massive stars. High-redshift GRBs can probe the star formation and reionization history of the early universe, but their detection remains rare. Here we report the detection of a GRB triggered in the 0.5--4 keV band by the Wide-field X-ray Telescope (WXT) on board the Einstein Probe (EP) mission, designated as EP240315a, whose bright peak was also detected by the Swift Burst Alert Telescope and Konus-Wind through off-line analyses. At a redshift of $z=4.859$, EP240315a showed a much longer and more complicated light curve in the soft X-ray band than in gamma-rays. Benefiting from a large field-of-view ($\sim$3600 deg$^2$) and a high sensitivity, EP-WXT captured the earlier engine activation and extended late engine activity through a continuous detection. With a peak X-ray flux at the faint end of previously known high-$z$ GRBs, the detection of EP240315a demonstrates the great potential for EP to study the early universe via GRBs.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models
Authors:
Jiawei Chen,
Dingkang Yang,
Yue Jiang,
Mingcheng Li,
Jinjie Wei,
Xiaolu Hou,
Lihua Zhang
Abstract:
In the realm of Medical Visual Language Models (Med-VLMs), the quest for universal efficient fine-tuning mechanisms remains paramount, especially given researchers in interdisciplinary fields are often extremely short of training resources, yet largely unexplored. Given the unique challenges in the medical domain, such as limited data scope and significant domain-specific requirements, evaluating…
▽ More
In the realm of Medical Visual Language Models (Med-VLMs), the quest for universal efficient fine-tuning mechanisms remains paramount, especially given researchers in interdisciplinary fields are often extremely short of training resources, yet largely unexplored. Given the unique challenges in the medical domain, such as limited data scope and significant domain-specific requirements, evaluating and adapting Parameter-Efficient Fine-Tuning (PEFT) methods specifically for Med-VLMs is essential. Most of the current PEFT methods on Med-VLMs have yet to be comprehensively investigated but mainly focus on adding some components to the model's structure or input. However, fine-tuning intrinsic model components often yields better generality and consistency, and its impact on the ultimate performance of Med-VLMs has been widely overlooked and remains understudied. In this paper, we endeavour to explore an alternative to traditional PEFT methods, especially the impact of fine-tuning LayerNorm layers, FFNs and Attention layers on the Med-VLMs. Our comprehensive studies span both small-scale and large-scale Med-VLMs, evaluating their performance under various fine-tuning paradigms across tasks such as Medical Visual Question Answering and Medical Imaging Report Generation. The findings reveal unique insights into the effects of intrinsic parameter fine-tuning methods on fine-tuning Med-VLMs to downstream tasks and expose fine-tuning solely the LayerNorm layers not only surpasses the efficiency of traditional PEFT methods but also retains the model's accuracy and generalization capabilities across a spectrum of medical downstream tasks. The experiments show LayerNorm fine-tuning's superior adaptability and scalability, particularly in the context of large-scale Med-VLMs.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation
Authors:
Jingxuan Wei,
Linzhuang Sun,
Yichong Leng,
Xu Tan,
Bihui Yu,
Ruifeng Guo
Abstract:
Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation encompasses two primary methods: sentence-level distillation and token-level distillation. In sentence-level distillation, the student model is trained to align with t…
▽ More
Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation encompasses two primary methods: sentence-level distillation and token-level distillation. In sentence-level distillation, the student model is trained to align with the output of the teacher model, which can alleviate the training difficulty and give student model a comprehensive understanding of global structure. Differently, token-level distillation requires the student model to learn the output distribution of the teacher model, facilitating a more fine-grained transfer of knowledge. Studies have revealed divergent performances between sentence-level and token-level distillation across different scenarios, leading to the confusion on the empirical selection of knowledge distillation methods. In this study, we argue that token-level distillation, with its more complex objective (i.e., distribution), is better suited for ``simple'' scenarios, while sentence-level distillation excels in ``complex'' scenarios. To substantiate our hypothesis, we systematically analyze the performance of distillation methods by varying the model size of student models, the complexity of text, and the difficulty of decoding procedure. While our experimental results validate our hypothesis, defining the complexity level of a given scenario remains a challenging task. So we further introduce a novel hybrid method that combines token-level and sentence-level distillation through a gating mechanism, aiming to leverage the advantages of both individual methods. Experiments demonstrate that the hybrid method surpasses the performance of token-level or sentence-level distillation methods and the previous works by a margin, demonstrating the effectiveness of the proposed hybrid method.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
DreamPBR: Text-driven Generation of High-resolution SVBRDF with Multi-modal Guidance
Authors:
Linxuan Xin,
Zheng Zhang,
Jinfu Wei,
Wei Gao,
Duan Gao
Abstract:
Prior material creation methods had limitations in producing diverse results mainly because reconstruction-based methods relied on real-world measurements and generation-based methods were trained on relatively small material datasets. To address these challenges, we propose DreamPBR, a novel diffusion-based generative framework designed to create spatially-varying appearance properties guided by…
▽ More
Prior material creation methods had limitations in producing diverse results mainly because reconstruction-based methods relied on real-world measurements and generation-based methods were trained on relatively small material datasets. To address these challenges, we propose DreamPBR, a novel diffusion-based generative framework designed to create spatially-varying appearance properties guided by text and multi-modal controls, providing high controllability and diversity in material generation. Key to achieving diverse and high-quality PBR material generation lies in integrating the capabilities of recent large-scale vision-language models trained on billions of text-image pairs, along with material priors derived from hundreds of PBR material samples. We utilize a novel material Latent Diffusion Model (LDM) to establish the mapping between albedo maps and the corresponding latent space. The latent representation is then decoded into full SVBRDF parameter maps using a rendering-aware PBR decoder. Our method supports tileable generation through convolution with circular padding. Furthermore, we introduce a multi-modal guidance module, which includes pixel-aligned guidance, style image guidance, and 3D shape guidance, to enhance the control capabilities of the material LDM. We demonstrate the effectiveness of DreamPBR in material creation, showcasing its versatility and user-friendliness on a wide range of controllable generation and editing applications.
△ Less
Submitted 1 July, 2024; v1 submitted 22 April, 2024;
originally announced April 2024.
-
Future Perspectives for Gamma-ray Burst Detection from Space
Authors:
Enrico Bozzo,
Lorenzo Amati,
Wayne Baumgartner,
Tzu-Ching Chang,
Bertrand Cordier,
Nicolas De Angelis,
Akihiro Doi,
Marco Feroci,
Cynthia Froning,
Jessica Gaskin,
Adam Goldstein,
Diego Götz,
Jon E. Grove,
Sylvain Guiriec,
Margarita Hernanz,
C. Michelle Hui,
Peter Jenke,
Daniel Kocevski,
Merlin Kole,
Chryssa Kouveliotou,
Thomas Maccarone,
Mark L. McConnell,
Hideo Matsuhara,
Paul O'Brien,
Nicolas Produit
, et al. (13 additional authors not shown)
Abstract:
Since their first discovery in the late 1960s, Gamma-ray bursts have attracted an exponentially growing interest from the international community due to their central role in the most highly debated open questions of the modern research of astronomy, astrophysics, cosmology, and fundamental physics. These range from the intimate nuclear composition of high density material within the core of ultra…
▽ More
Since their first discovery in the late 1960s, Gamma-ray bursts have attracted an exponentially growing interest from the international community due to their central role in the most highly debated open questions of the modern research of astronomy, astrophysics, cosmology, and fundamental physics. These range from the intimate nuclear composition of high density material within the core of ultra-dense neuron stars, to stellar evolution via the collapse of massive stars, the production and propagation of gravitational waves, as well as the exploration of the early Universe by unveiling first stars and galaxies (assessing also their evolution and cosmic re-ionization). GRBs have stimulated in the past $\sim$50 years the development of cutting-edge technological instruments for observations of high energy celestial sources from space, leading to the launch and successful operations of many different scientific missions (several of them still in data taking mode nowadays). In this review, we provide a brief description of the GRB-dedicated missions from space being designed and developed for the future. The list of these projects, not meant to be exhaustive, shall serve as a reference to interested readers to understand what is likely to come next to lead the further development of GRB research and associated phenomenology.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
REACTO: Reconstructing Articulated Objects from a Single Video
Authors:
Chaoyue Song,
Jiacheng Wei,
Chuan-Sheng Foo,
Guosheng Lin,
Fayao Liu
Abstract:
In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals from videos, but face challenges with piece-wise rigid general articulated objects due to limitations in their deformation models. To tackle this, we propose Qu…
▽ More
In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals from videos, but face challenges with piece-wise rigid general articulated objects due to limitations in their deformation models. To tackle this, we propose Quasi-Rigid Blend Skinning, a novel deformation model that enhances the rigidity of each part while maintaining flexible deformation of the joints. Our primary insight combines three distinct approaches: 1) an enhanced bone rigging system for improved component modeling, 2) the use of quasi-sparse skinning weights to boost part rigidity and reconstruction fidelity, and 3) the application of geodesic point assignment for precise motion and seamless deformation. Our method outperforms previous works in producing higher-fidelity 3D reconstructions of general articulated objects, as demonstrated on both real and synthetic datasets. Project page: https://chaoyuesong.github.io/REACTO.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Co-existence of Type II blow-ups with multiple blow-up rates for five-dimensional heat equation with critical nonlinear boundary conditions
Authors:
Juncheng Wei,
Zikai Ye,
Xiaoyu Zeng,
Qidi Zhang
Abstract:
We consider the following five-dimensional heat equation with critical boundary condition \begin{equation*}
\partial_t u=Δu
\mbox{ \ in \ } \mathbb{R}_+^5\times (0,T) ,
\quad
-\partial_{x_5}u =|u|^\frac{2}{3}u \mbox{ \ on \ } \pp \mathbb{R}^5_+ \times (0,T) . \end{equation*} Given $\mathfrak{o}$ distinct boundary points $q^{[i]} \in \partial \mathbb{R}_+^5$, and $\mathfrak{o}$ integers…
▽ More
We consider the following five-dimensional heat equation with critical boundary condition \begin{equation*}
\partial_t u=Δu
\mbox{ \ in \ } \mathbb{R}_+^5\times (0,T) ,
\quad
-\partial_{x_5}u =|u|^\frac{2}{3}u \mbox{ \ on \ } \pp \mathbb{R}^5_+ \times (0,T) . \end{equation*} Given $\mathfrak{o}$ distinct boundary points $q^{[i]} \in \partial \mathbb{R}_+^5$, and $\mathfrak{o}$ integers $l_i\in \mathbb{N}$ (possibly duplicated), $i=1,2,\dots, \mathfrak{o}$, for $T>0$ sufficiently small, we construct a finite-time blow-up solution $u$ with a type II blow-up rate $(T-t)^{-3l_i -3}$ for $x$ near $q^{[i]}$. This seems to be the first result of the co-existence of type II blowups with different blow-up rates. To accommodate highly unstable blowups with different blowup rates, we first develop a unified linear theory for the inner problem with more time decay in the blow-up scheme through restriction on the spatial growth of the right-hand side, and then use vanishing adjustment functions for deriving multiple rates at distinct points. This paper is inspired by [25, 52, 60].
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
CanvasPic: An Interactive Tool for Freely Generating Facial Images Based on Spatial Layout
Authors:
Jiafu Wei,
Chia-Ming Chang,
Xi Yang,
Takeo Igarashi
Abstract:
In real-world usage, existing GAN image generation tools come up short due to their lack of intuitive interfaces and limited flexibility. To overcome these limitations, we developed CanvasPic, an innovative tool for flexible GAN image generation. Our tool introduces a novel 2D layout design that allows users to intuitively control image attributes based on real-world images. By interacting with th…
▽ More
In real-world usage, existing GAN image generation tools come up short due to their lack of intuitive interfaces and limited flexibility. To overcome these limitations, we developed CanvasPic, an innovative tool for flexible GAN image generation. Our tool introduces a novel 2D layout design that allows users to intuitively control image attributes based on real-world images. By interacting with the distances between images in the spatial layout, users are able to conveniently control the influence of each attribute on the target image and explore a wide range of generated results. Considering practical application scenarios, a user study involving 24 participants was conducted to compare our tool with existing tools in GAN image generation. The results of the study demonstrate that our tool significantly enhances the user experience, enabling more effective achievement of desired generative results.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Best Practices and Lessons Learned on Synthetic Data
Authors:
Ruibo Liu,
Jerry Wei,
Fangyu Liu,
Chenglei Si,
Yanzhe Zhang,
Jinmeng Rao,
Steven Zheng,
Daiyi Peng,
Diyi Yang,
Denny Zhou,
Andrew M. Dai
Abstract:
The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution by generating artificial data that mimics real-world patterns. This paper provides an overview of synthetic data research, discussing its applications, challeng…
▽ More
The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution by generating artificial data that mimics real-world patterns. This paper provides an overview of synthetic data research, discussing its applications, challenges, and future directions. We present empirical evidence from prior art to demonstrate its effectiveness and highlight the importance of ensuring its factuality, fidelity, and unbiasedness. We emphasize the need for responsible use of synthetic data to build more powerful, inclusive, and trustworthy language models.
△ Less
Submitted 10 August, 2024; v1 submitted 11 April, 2024;
originally announced April 2024.
-
O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation
Authors:
Muer Tie,
Julong Wei,
Zhengjun Wang,
Ke Wu,
Shansuai Yuan,
Kaizhao Zhang,
Jie Jia,
Jieru Zhao,
Zhongxue Gan,
Wenchao Ding
Abstract:
Online construction of open-ended language scenes is crucial for robotic applications, where open-vocabulary interactive scene understanding is required. Recently, neural implicit representation has provided a promising direction for online interactive mapping. However, implementing open-vocabulary scene understanding capability into online neural implicit mapping still faces three challenges: lac…
▽ More
Online construction of open-ended language scenes is crucial for robotic applications, where open-vocabulary interactive scene understanding is required. Recently, neural implicit representation has provided a promising direction for online interactive mapping. However, implementing open-vocabulary scene understanding capability into online neural implicit mapping still faces three challenges: lack of local scene updating ability, blurry spatial hierarchical semantic segmentation and difficulty in maintaining multi-view consistency. To this end, we proposed O2V-mapping, which utilizes voxel-based language and geometric features to create an open-vocabulary field, thus allowing for local updates during online training process. Additionally, we leverage a foundational model for image segmentation to extract language features on object-level entities, achieving clear segmentation boundaries and hierarchical semantic features. For the purpose of preserving consistency in 3D object properties across different viewpoints, we propose a spatial adaptive voxel adjustment mechanism and a multi-view weight selection method. Extensive experiments on open-vocabulary object localization and semantic segmentation demonstrate that O2V-mapping achieves online construction of language scenes while enhancing accuracy, outperforming the previous SOTA method.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
Hierarchy of Exchange-Correlation Functionals in Computing Lattice Thermal Conductivities of Rocksalt and Zincblende Semiconductors
Authors:
Jiacheng Wei,
Zhonghao Xia,
Yi Xia,
Jiangang He
Abstract:
Lattice thermal conductivity ($κ_{\rm L}$) is a crucial characteristic of crystalline solids with significant implications for practical applications. While the higher order of anharmonicity of phonon gas model is commonly used for explaining extraordinary heat transfer behaviors in crystals, the impact of exchange-correlation (XC) functionals in DFT on describing anharmonicity has been largely ov…
▽ More
Lattice thermal conductivity ($κ_{\rm L}$) is a crucial characteristic of crystalline solids with significant implications for practical applications. While the higher order of anharmonicity of phonon gas model is commonly used for explaining extraordinary heat transfer behaviors in crystals, the impact of exchange-correlation (XC) functionals in DFT on describing anharmonicity has been largely overlooked. Most XC functionals in solids focus on ground state properties that mainly involve the harmonic approximation, neglecting temperature effects, and their reliability in studying anharmonic properties remains insufficiently explored. In this study, we systematically investigate the room-temperature $κ_{\rm L}$ of 16 binary compounds with rocksalt and zincblende structures using 8 XC functionals such as LDA, PBE, PBEsol, optB86b, revTPSS, SCAN, rSCAN, r$^2$SCAN in combination with three perturbation orders, including phonon within harmonic approximation (HA) plus three-phonon scattering (HA+3ph), phonon calculated using self-consistent phonon theory (SCPH) plus three-phonon scattering (SCPH+3ph), and SCPH phonon plus three- and four-phonon scattering (SCPH+3,4ph). Our results show that the XC functional exhibits strong entanglement with perturbation order and the mean relative absolute error (MRAE) of the computed $κ_{\rm L}$ is strongly influenced by both the XC functional and perturbation order, leading to error cancellation or amplification. The minimal (maximal) MRAE is achieved with revTPSS (rSCAN) at the HA+3ph level, SCAN (r$^2$SCAN) at the SCPH+3ph level, and PBEsol (rSCAN) at the SCPH+3,4ph level. Among these functionals, PBEsol exhibits the highest accuracy at the highest perturbation order. The SCAN-related functionals demonstrate moderate accuracy but are suffer from numerical instability and high computational costs.
△ Less
Submitted 9 April, 2024;
originally announced April 2024.
-
LHAASO-KM2A detector simulation using Geant4
Authors:
Zhen Cao,
F. Aharonian,
Q. An,
Axikegu,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
J. T. Cai,
Q. Cao,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
A. M. Chen,
E. S. Chen,
Liang Chen,
Lin Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. H. Chen,
S. Z. Chen
, et al. (254 additional authors not shown)
Abstract:
KM2A is one of the main sub-arrays of LHAASO, working on gamma ray astronomy and cosmic ray physics at energies above 10 TeV. Detector simulation is the important foundation for estimating detector performance and data analysis. It is a big challenge to simulate the KM2A detector in the framework of Geant4 due to the need to track numerous photons from a large number of detector units (>6000) with…
▽ More
KM2A is one of the main sub-arrays of LHAASO, working on gamma ray astronomy and cosmic ray physics at energies above 10 TeV. Detector simulation is the important foundation for estimating detector performance and data analysis. It is a big challenge to simulate the KM2A detector in the framework of Geant4 due to the need to track numerous photons from a large number of detector units (>6000) with large altitude difference (30 m) and huge coverage (1.3 km^2). In this paper, the design of the KM2A simulation code G4KM2A based on Geant4 is introduced. The process of G4KM2A is optimized mainly in memory consumption to avoid memory overffow. Some simpliffcations are used to signiffcantly speed up the execution of G4KM2A. The running time is reduced by at least 30 times compared to full detector simulation. The particle distributions and the core/angle resolution comparison between simulation and experimental data of the full KM2A array are also presented, which show good agreement.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning
Authors:
Jingxuan Wei,
Nan Xu,
Guiyong Chang,
Yin Luo,
BiHui Yu,
Ruifeng Guo
Abstract:
In the fields of computer vision and natural language processing, multimodal chart question-answering, especially involving color, structure, and textless charts, poses significant challenges. Traditional methods, which typically involve either direct multimodal processing or a table-to-text conversion followed by language model analysis, have limitations in effectively handling these complex scen…
▽ More
In the fields of computer vision and natural language processing, multimodal chart question-answering, especially involving color, structure, and textless charts, poses significant challenges. Traditional methods, which typically involve either direct multimodal processing or a table-to-text conversion followed by language model analysis, have limitations in effectively handling these complex scenarios. This paper introduces a novel multimodal chart question-answering model, specifically designed to address these intricate tasks. Our model integrates visual and linguistic processing, overcoming the constraints of existing methods. We adopt a dual-phase training approach: the initial phase focuses on aligning image and text representations, while the subsequent phase concentrates on optimizing the model's interpretative and analytical abilities in chart-related queries. This approach has demonstrated superior performance on multiple public datasets, particularly in handling color, structure, and textless chart questions, indicating its effectiveness in complex multimodal tasks.
△ Less
Submitted 1 April, 2024;
originally announced April 2024.
-
Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation
Authors:
Chuan Huang,
Jia Wei,
Rui Li
Abstract:
Multi-modal brain images from MRI scans are widely used in clinical diagnosis to provide complementary information from different modalities. However, obtaining fully paired multi-modal images in practice is challenging due to various factors, such as time, cost, and artifacts, resulting in modality-missing brain images. To address this problem, unsupervised multi-modal brain image translation has…
▽ More
Multi-modal brain images from MRI scans are widely used in clinical diagnosis to provide complementary information from different modalities. However, obtaining fully paired multi-modal images in practice is challenging due to various factors, such as time, cost, and artifacts, resulting in modality-missing brain images. To address this problem, unsupervised multi-modal brain image translation has been extensively studied. Existing methods suffer from the problem of brain tumor deformation during translation, as they fail to focus on the tumor areas when translating the whole images. In this paper, we propose an unsupervised tumor-aware distillation teacher-student network called UTAD-Net, which is capable of perceiving and translating tumor areas precisely. Specifically, our model consists of two parts: a teacher network and a student network. The teacher network learns an end-to-end mapping from source to target modality using unpaired images and corresponding tumor masks first. Then, the translation knowledge is distilled into the student network, enabling it to generate more realistic tumor areas and whole images without masks. Experiments show that our model achieves competitive performance on both quantitative and qualitative evaluations of image quality compared with state-of-the-art methods. Furthermore, we demonstrate the effectiveness of the generated images on downstream segmentation tasks. Our code is available at https://github.com/scut-HC/UTAD-Net.
△ Less
Submitted 24 April, 2024; v1 submitted 29 March, 2024;
originally announced March 2024.
-
HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes
Authors:
Ke Wu,
Kaizhao Zhang,
Zhiwei Zhang,
Shanshuai Yuan,
Muer Tie,
Julong Wei,
Zijun Xu,
Jieru Zhao,
Zhongxue Gan,
Wenchao Ding
Abstract:
Online dense mapping of urban scenes forms a fundamental cornerstone for scene understanding and navigation of autonomous vehicles. Recent advancements in mapping methods are mainly based on NeRF, whose rendering speed is too slow to meet online requirements. 3D Gaussian Splatting (3DGS), with its rendering speed hundreds of times faster than NeRF, holds greater potential in online dense mapping.…
▽ More
Online dense mapping of urban scenes forms a fundamental cornerstone for scene understanding and navigation of autonomous vehicles. Recent advancements in mapping methods are mainly based on NeRF, whose rendering speed is too slow to meet online requirements. 3D Gaussian Splatting (3DGS), with its rendering speed hundreds of times faster than NeRF, holds greater potential in online dense mapping. However, integrating 3DGS into a street-view dense mapping framework still faces two challenges, including incomplete reconstruction due to the absence of geometric information beyond the LiDAR coverage area and extensive computation for reconstruction in large urban scenes. To this end, we propose HGS-Mapping, an online dense mapping framework in unbounded large-scale scenes. To attain complete construction, our framework introduces Hybrid Gaussian Representation, which models different parts of the entire scene using Gaussians with distinct properties. Furthermore, we employ a hybrid Gaussian initialization mechanism and an adaptive update method to achieve high-fidelity and rapid reconstruction. To the best of our knowledge, we are the first to integrate Gaussian representation into online dense mapping of urban scenes. Our approach achieves SOTA reconstruction accuracy while only employing 66% number of Gaussians, leading to 20% faster reconstruction speed.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Towards Human-Centered Construction Robotics: An RL-Driven Companion Robot For Contextually Assisting Carpentry Workers
Authors:
Yuning Wu,
Jiaying Wei,
Jean Oh,
Daniel Cardoso Llach
Abstract:
In the dynamic construction industry, traditional robotic integration has primarily focused on automating specific tasks, often overlooking the complexity and variability of human aspects in construction workflows. This paper introduces a human-centered approach with a "work companion rover" designed to assist construction workers within their existing practices, aiming to enhance safety and workf…
▽ More
In the dynamic construction industry, traditional robotic integration has primarily focused on automating specific tasks, often overlooking the complexity and variability of human aspects in construction workflows. This paper introduces a human-centered approach with a "work companion rover" designed to assist construction workers within their existing practices, aiming to enhance safety and workflow fluency while respecting construction labor's skilled nature. We conduct an in-depth study on deploying a robotic system in carpentry formwork, showcasing a prototype that emphasizes mobility, safety, and comfortable worker-robot collaboration in dynamic environments through a contextual Reinforcement Learning (RL)-driven modular framework. Our research advances robotic applications in construction, advocating for collaborative models where adaptive robots support rather than replace humans, underscoring the potential for an interactive and collaborative human-robot workforce.
△ Less
Submitted 28 March, 2024; v1 submitted 27 March, 2024;
originally announced March 2024.
-
Long-form factuality in large language models
Authors:
Jerry Wei,
Chengrun Yang,
Xinying Song,
Yifeng Lu,
Nathan Hu,
Jie Huang,
Dustin Tran,
Daiyi Peng,
Ruibo Liu,
Da Huang,
Cosmo Du,
Quoc V. Le
Abstract:
Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate LongFact, a prompt set comprising thousands of questions spanning 38 topics. We then propose that LLM agents can be used as automated evaluators for long-form factua…
▽ More
Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate LongFact, a prompt set comprising thousands of questions spanning 38 topics. We then propose that LLM agents can be used as automated evaluators for long-form factuality through a method which we call Search-Augmented Factuality Evaluator (SAFE). SAFE utilizes an LLM to break down a long-form response into a set of individual facts and to evaluate the accuracy of each fact using a multi-step reasoning process comprising sending search queries to Google Search and determining whether a fact is supported by the search results. Furthermore, we propose extending F1 score as an aggregated metric for long-form factuality. To do so, we balance the percentage of supported facts in a response (precision) with the percentage of provided facts relative to a hyperparameter representing a user's preferred response length (recall).
Empirically, we demonstrate that LLM agents can outperform crowdsourced human annotators - on a set of ~16k individual facts, SAFE agrees with crowdsourced human annotators 72% of the time, and on a random subset of 100 disagreement cases, SAFE wins 76% of the time. At the same time, SAFE is more than 20 times cheaper than human annotators. We also benchmark thirteen language models on LongFact across four model families (Gemini, GPT, Claude, and PaLM-2), finding that larger language models generally achieve better long-form factuality. LongFact, SAFE, and all experimental code are available at https://github.com/google-deepmind/long-form-factuality.
△ Less
Submitted 3 April, 2024; v1 submitted 27 March, 2024;
originally announced March 2024.
-
Dark matter effects on the properties of neutron stars: compactness and tidal deformability
Authors:
Hong-Ming Liu,
Jin-Biao Wei,
Zeng-Hua Li,
G. F. Burgio,
H. C. Das,
H. -J. Schulze
Abstract:
We systematically study the observable properties of dark-matter admixed neutron stars, employing a realistic nuclear EOS in combination with self-interacting fermionic dark matter respecting constraints on the self-interaction cross section. Deviations from universal relations valid for nucleonic neutron stars are analyzed over the whole parameter space of the model and unequivocal signals for th…
▽ More
We systematically study the observable properties of dark-matter admixed neutron stars, employing a realistic nuclear EOS in combination with self-interacting fermionic dark matter respecting constraints on the self-interaction cross section. Deviations from universal relations valid for nucleonic neutron stars are analyzed over the whole parameter space of the model and unequivocal signals for the presence of dark matter in neutron stars are identified.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Two Algorithms for Computing Rational Univariate Representations of Zero-Dimensional Ideals with Parameters
Authors:
Dingkang Wang,
Jingjing Wei,
Fanghui Xiao,
Xiaopeng Zheng
Abstract:
Based on the partition of parameter space, two algorithms for computing the rational univariate representation of zero-dimensional ideals with parameters are presented in the paper. Unlike the rational univariate representation of zero-dimensional ideals without parameters, the number of zeros of zero-dimensional ideals with parameters under various specializations is different, which leads to cho…
▽ More
Based on the partition of parameter space, two algorithms for computing the rational univariate representation of zero-dimensional ideals with parameters are presented in the paper. Unlike the rational univariate representation of zero-dimensional ideals without parameters, the number of zeros of zero-dimensional ideals with parameters under various specializations is different, which leads to choosing and checking the separating element, the key to computing the rational univariate representation, is difficult. In order to pick out the separating element, we first ensure that under each branch the ideal has the same number of zeros by partitioning the parameter space. Subsequently two ideas are given to choose and check the separating element. One idea is that by extending the subresultant theorem to parametric cases, we utilize the extended subresultant theorem to choose the separating element with the further partition of parameter space and then with the help of parametric greatest common divisor theory compute rational univariate representations. Another one is that we go straight to choose and check the separating element by the computation of parametric greatest common divisors, then immediately get the rational univariate representations. Based on these, we design two different algorithms for computing rational univariate representations of zero-dimensional ideals with parameters. Furthermore, the algorithms have been implemented on Singular and the performance comparison are presented.
△ Less
Submitted 24 July, 2024; v1 submitted 25 March, 2024;
originally announced March 2024.