Showing 251–300 of 1,318 results for author: Wei, J

Multi-Granularity Archaeological Dating of Chinese Bronze Dings Based on a Knowledge-Guided Relation Graph

Authors: Rixin Zhou, Jiafu Wei, Qian Zhang, Ruihua Qi, Xi Yang, Chuntao Li

Abstract: The archaeological dating of bronze dings has played a critical role in the study of ancient Chinese history. Current archaeology depends on trained experts to carry out bronze dating, which is time-consuming and labor-intensive. For such dating, in this study, we propose a learning-based approach to integrate advanced deep learning techniques and archaeological knowledge. To achieve this, we firs… ▽ More The archaeological dating of bronze dings has played a critical role in the study of ancient Chinese history. Current archaeology depends on trained experts to carry out bronze dating, which is time-consuming and labor-intensive. For such dating, in this study, we propose a learning-based approach to integrate advanced deep learning techniques and archaeological knowledge. To achieve this, we first collect a large-scale image dataset of bronze dings, which contains richer attribute information than other existing fine-grained datasets. Second, we introduce a multihead classifier and a knowledge-guided relation graph to mine the relationship between attributes and the ding era. Third, we conduct comparison experiments with various existing methods, the results of which show that our dating method achieves a state-of-the-art performance. We hope that our data and applied networks will enrich fine-grained classification research relevant to other interdisciplinary areas of expertise. The dataset and source code used are included in our supplementary materials, and will be open after submission owing to the anonymity policy. Source codes and data are available at: https://github.com/zhourixin/bronze-Ding. △ Less

Submitted 2 June, 2023; v1 submitted 27 March, 2023; originally announced March 2023.

Comments: CVPR2023 accepted

TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision

Authors: Jiacheng Wei, Hao Wang, Jiashi Feng, Guosheng Lin, Kim-Hui Yap

Abstract: In this paper, we investigate an open research task of generating controllable 3D textured shapes from the given textual descriptions. Previous works either require ground truth caption labeling or extensive optimization time. To resolve these issues, we present a novel framework, TAPS3D, to train a text-guided 3D shape generator with pseudo captions. Specifically, based on rendered 2D images, we… ▽ More In this paper, we investigate an open research task of generating controllable 3D textured shapes from the given textual descriptions. Previous works either require ground truth caption labeling or extensive optimization time. To resolve these issues, we present a novel framework, TAPS3D, to train a text-guided 3D shape generator with pseudo captions. Specifically, based on rendered 2D images, we retrieve relevant words from the CLIP vocabulary and construct pseudo captions using templates. Our constructed captions provide high-level semantic supervision for generated 3D shapes. Further, in order to produce fine-grained textures and increase geometry diversity, we propose to adopt low-level image regularization to enable fake-rendered images to align with the real ones. During the inference phase, our proposed model can generate 3D textured shapes from the given text without any additional optimization. We conduct extensive experiments to analyze each of our proposed components and show the efficacy of our framework in generating high-fidelity 3D textured and text-relevant shapes. △ Less

Submitted 23 March, 2023; originally announced March 2023.

Comments: Accepted to CVPR2023

Fairness Improves Learning from Noisily Labeled Long-Tailed Data

Authors: Jiaheng Wei, Zhaowei Zhu, Gang Niu, Tongliang Liu, Sijia Liu, Masashi Sugiyama, Yang Liu

Abstract: Both long-tailed and noisily labeled data frequently appear in real-world applications and impose significant challenges for learning. Most prior works treat either problem in an isolated way and do not explicitly consider the coupling effects of the two. Our empirical observation reveals that such solutions fail to consistently improve the learning when the dataset is long-tailed with label noise… ▽ More Both long-tailed and noisily labeled data frequently appear in real-world applications and impose significant challenges for learning. Most prior works treat either problem in an isolated way and do not explicitly consider the coupling effects of the two. Our empirical observation reveals that such solutions fail to consistently improve the learning when the dataset is long-tailed with label noise. Moreover, with the presence of label noise, existing methods do not observe universal improvements across different sub-populations; in other words, some sub-populations enjoyed the benefits of improved accuracy at the cost of hurting others. Based on these observations, we introduce the Fairness Regularizer (FR), inspired by regularizing the performance gap between any two sub-populations. We show that the introduced fairness regularizer improves the performances of sub-populations on the tail and the overall learning performance. Extensive experiments demonstrate the effectiveness of the proposed solution when complemented with certain existing popular robust or class-balanced methods. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Comments: Paper under review

PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing

Authors: Xiaozhe Ren, Pingyi Zhou, Xinfan Meng, Xinjing Huang, Yadao Wang, Weichao Wang, Pengfei Li, Xiaoda Zhang, Alexander Podolskiy, Grigory Arshinov, Andrey Bout, Irina Piontkovskaya, Jiansheng Wei, Xin Jiang, Teng Su, Qun Liu, Jun Yao

Abstract: The scaling of large language models has greatly improved natural language understanding, generation, and reasoning. In this work, we develop a system that trained a trillion-parameter language model on a cluster of Ascend 910 AI processors and MindSpore framework, and present the language model with 1.085T parameters named PanGu-Σ. With parameter inherent from PanGu-α, we extend the dense Transfo… ▽ More The scaling of large language models has greatly improved natural language understanding, generation, and reasoning. In this work, we develop a system that trained a trillion-parameter language model on a cluster of Ascend 910 AI processors and MindSpore framework, and present the language model with 1.085T parameters named PanGu-Σ. With parameter inherent from PanGu-α, we extend the dense Transformer model to sparse one with Random Routed Experts (RRE), and efficiently train the model over 329B tokens by using Expert Computation and Storage Separation(ECSS). This resulted in a 6.3x increase in training throughput through heterogeneous computing. Our experimental findings show that PanGu-Σ provides state-of-the-art performance in zero-shot learning of various Chinese NLP downstream tasks. Moreover, it demonstrates strong abilities when fine-tuned in application data of open-domain dialogue, question answering, machine translation and code generation. △ Less

Submitted 19 March, 2023; originally announced March 2023.

CCTV-Gun: Benchmarking Handgun Detection in CCTV Images

Authors: Srikar Yellapragada, Zhenghong Li, Kevin Bhadresh Doshi, Purva Makarand Mhasakar, Heng Fan, Jie Wei, Erik Blasch, Bin Zhang, Haibin Ling

Abstract: Gun violence is a critical security problem, and it is imperative for the computer vision community to develop effective gun detection algorithms for real-world scenarios, particularly in Closed Circuit Television (CCTV) surveillance data. Despite significant progress in visual object detection, detecting guns in real-world CCTV images remains a challenging and under-explored task. Firearms, espec… ▽ More Gun violence is a critical security problem, and it is imperative for the computer vision community to develop effective gun detection algorithms for real-world scenarios, particularly in Closed Circuit Television (CCTV) surveillance data. Despite significant progress in visual object detection, detecting guns in real-world CCTV images remains a challenging and under-explored task. Firearms, especially handguns, are typically very small in size, non-salient in appearance, and often severely occluded or indistinguishable from other small objects. Additionally, the lack of principled benchmarks and difficulty collecting relevant datasets further hinder algorithmic development. In this paper, we present a meticulously crafted and annotated benchmark, called \textbf{CCTV-Gun}, which addresses the challenges of detecting handguns in real-world CCTV images. Our contribution is three-fold. Firstly, we carefully select and analyze real-world CCTV images from three datasets, manually annotate handguns and their holders, and assign each image with relevant challenge factors such as blur and occlusion. Secondly, we propose a new cross-dataset evaluation protocol in addition to the standard intra-dataset protocol, which is vital for gun detection in practical settings. Finally, we comprehensively evaluate both classical and state-of-the-art object detection algorithms, providing an in-depth analysis of their generalizing abilities. The benchmark will facilitate further research and development on this topic and ultimately enhance security. Code, annotations, and trained models are available at https://github.com/srikarym/CCTV-Gun. △ Less

Submitted 11 July, 2023; v1 submitted 19 March, 2023; originally announced March 2023.

DialogPaint: A Dialog-based Image Editing Model

Authors: Jingxuan Wei, Shiyu Wu, Xin Jiang, Yequan Wang

Abstract: We introduce DialogPaint, a novel framework that bridges conversational interactions with image editing, enabling users to modify images through natural dialogue. By integrating a dialogue model with the Stable Diffusion image transformation technique, DialogPaint offers a more intuitive and interactive approach to image modifications. Our method stands out by effectively interpreting and executin… ▽ More We introduce DialogPaint, a novel framework that bridges conversational interactions with image editing, enabling users to modify images through natural dialogue. By integrating a dialogue model with the Stable Diffusion image transformation technique, DialogPaint offers a more intuitive and interactive approach to image modifications. Our method stands out by effectively interpreting and executing both explicit and ambiguous instructions, handling tasks such as object replacement, style transfer, and color modification. Notably, DialogPaint supports iterative, multi-round editing, allowing users to refine image edits over successive interactions. Comprehensive evaluations highlight the robustness and versatility of our approach, marking a significant advancement in dialogue-driven image editing. △ Less

Submitted 17 October, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: 10 pages, 8 figures

Optical and Near-infrared Observations of the Distant but Bright 'New Year's Burst' GRB 220101A

Authors: Zi-Pei Zhu, Wei-Hua Lei, Daniele B. Malesani, Shao-Yu Fu, Dong-Jie Liu, Dong Xu, Paolo D'Avanzo, José Feliciano Agüí Fernández, Johan P. U. Fynbo, Xing Gao, Ana Nicuesa Guelbenzu, Shuai-Qing Jiang, David Alexander Kann, Sylvio Klose, Jin-Zhong Liu, Xing Liu, Massimiliano De Pasquale, Antonio de Ugarte Postigo, Bringfried Stecklum, Christina Th, Joonas Kari Markku Viuho, Yi-Nan Zhu, Jing-Da Li, He Gao, Tian-Hua Lu , et al. (4 additional authors not shown)

Abstract: High-redshift gamma-ray bursts (GRBs) provide a powerful tool to probe the early universe, but still for relatively few do we have good observations of the afterglow. We here report the optical and near-infrared observations of the afterglow of a relatively high-redshift event, GRB\,220101A, triggered on New Year's Day of 2022. With the optical spectra obtained at XL2.16/BFOSC and NOT/ALFOSC, we d… ▽ More High-redshift gamma-ray bursts (GRBs) provide a powerful tool to probe the early universe, but still for relatively few do we have good observations of the afterglow. We here report the optical and near-infrared observations of the afterglow of a relatively high-redshift event, GRB\,220101A, triggered on New Year's Day of 2022. With the optical spectra obtained at XL2.16/BFOSC and NOT/ALFOSC, we determine the redshift of the burst at $z= 4.615$. Based on our optical and near-infrared data, combined with the X-ray data, we perform multiband fit with the python package \emph{afterglowpy}. A jet-break at $\sim$ 0.7 day post-burst is found to constrain the opening angle of the jet as $\sim$ 3.4 degree. We also determine circumburst density of $n_0 = 0.15\ {\rm cm}^{-3}$ as well as kinetic energy $E_{\rm K, iso} = 3.52\times 10^{54}$ erg. The optical afterglow is among the most luminous ever detected. We also find a ``mirror'' feature in the lightcurve during the prompt phase of the burst from 80 s to 120 s. The physical origin of such mirror feature is unclear. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Comments: 15 pages, 10 figures, submitted to ApJ

TypeT5: Seq2seq Type Inference using Static Analysis

Authors: Jiayi Wei, Greg Durrett, Isil Dillig

Abstract: There has been growing interest in automatically predicting missing type annotations in programs written in Python and JavaScript. While prior methods have achieved impressive accuracy when predicting the most common types, they often perform poorly on rare or complex types. In this paper, we present a new type inference method that treats type prediction as a code infilling task by leveraging Cod… ▽ More There has been growing interest in automatically predicting missing type annotations in programs written in Python and JavaScript. While prior methods have achieved impressive accuracy when predicting the most common types, they often perform poorly on rare or complex types. In this paper, we present a new type inference method that treats type prediction as a code infilling task by leveraging CodeT5, a state-of-the-art seq2seq pre-trained language model for code. Our method uses static analysis to construct dynamic contexts for each code element whose type signature is to be predicted by the model. We also propose an iterative decoding scheme that incorporates previous type predictions in the model's input context, allowing information exchange between related code elements. Our evaluation shows that the proposed approach, TypeT5, not only achieves a higher overall accuracy (particularly on rare and complex types) but also produces more coherent results with fewer type errors -- while enabling easy user intervention. △ Less

Submitted 16 March, 2023; originally announced March 2023.

Comments: Published as a conference paper at ICLR 2023

Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations

Authors: Long Chen, Jingrong Wei

Abstract: A class of monotone operator equations, which can be decomposed into sum of a gradient of a strongly convex function and a linear and skew-symmetric operator, is considered in this work. Based on discretization of the generalized gradient flow, gradient and skew-symmetric splitting (GSS) methods are proposed and proved to convergent in linear rate. To further accelerate the convergence, an acceler… ▽ More A class of monotone operator equations, which can be decomposed into sum of a gradient of a strongly convex function and a linear and skew-symmetric operator, is considered in this work. Based on discretization of the generalized gradient flow, gradient and skew-symmetric splitting (GSS) methods are proposed and proved to convergent in linear rate. To further accelerate the convergence, an accelerated gradient flow is proposed and accelerated gradient and skew-symmetric splitting (AGSS) methods are developed, which extends the acceleration among the existing works on the convex minimization to a more general class of monotone operator equations. In particular, when applied to smooth saddle point systems with bilinear coupling, an accelerated transformed primal-dual (ATPD) method is proposed and shown to achieve linear rates with optimal lower iteration complexity. △ Less

Submitted 15 March, 2023; originally announced March 2023.

MSC Class: 37N40 47H05 47J25 65B99 65J15 65L20

GPT-4 Technical Report

Authors: OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher Berner, Lenny Bogdonoff, Oleg Boiko , et al. (256 additional authors not shown)

Abstract: We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based mo… ▽ More We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4. △ Less

Submitted 4 March, 2024; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: 100 pages; updated authors list; fixed author names and added citation

Non-radial oscillations and gravitational wave emission of hybrid neutron stars

Authors: Zi-Yue Zheng, Ting-Ting Sun, Huan Chen, Jin-Biao Wei, G. F. Burgio, H. -J. Schulze

Abstract: We investigate non-radial oscillations of pure and hybrid neutron stars, employing equations of state of nuclear matter from Brueckner-Hartree-Fock theory, and of quark matter from the Dyson-Schwinger quark model, performing a Gibbs construction for the mixed phase in hybrid stars. Characteristic differences between neutron-star and hybrid-star $g_1$-mode oscillation frequencies, damping times, an… ▽ More We investigate non-radial oscillations of pure and hybrid neutron stars, employing equations of state of nuclear matter from Brueckner-Hartree-Fock theory, and of quark matter from the Dyson-Schwinger quark model, performing a Gibbs construction for the mixed phase in hybrid stars. Characteristic differences between neutron-star and hybrid-star $g_1$-mode oscillation frequencies, damping times, and gravitational wave strains are pointed out. Prospects of observations are also discussed. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Comments: 11 pages, 8 figures

Surface step induced bending in two-dimensional oxide nanosheet

Authors: Jiake Wei, Masato Yoshiya, Feng Bin, Naoya Shibata, Yuichi Ikuhara

Abstract: The surface steps play dramatic roles in surface dominated processes and the related properties, in which these roles would be significantly enhanced for the low-dimensional nano or quantum materials since the ratio of surface atoms is largely increased. However, the atomic structures of surface steps in the nano/quantum systems are poorly understood because it is extremely difficult to controllab… ▽ More The surface steps play dramatic roles in surface dominated processes and the related properties, in which these roles would be significantly enhanced for the low-dimensional nano or quantum materials since the ratio of surface atoms is largely increased. However, the atomic structures of surface steps in the nano/quantum systems are poorly understood because it is extremely difficult to controllably introduce these defects experimentally. Here, by utilizing the focused sub-Angstrom high energy electron beam induced atomic precise etching in a scanning transmission electron microscope, we fabricate MgO two-dimensional (100) nanosheet as thin as 2 atomic layers, and controllably introduced the surface steps in the nanosheet. It is found that the surface steps could bend the MgO nanosheet and such step-induced bending becomes more pronounced for the nanosheet with less layer numbers. We reveal that the bending of the nanosheets is originated from the step induced step force and the reduced bending stiffness in the nanosheet system. △ Less

Submitted 12 March, 2023; originally announced March 2023.

Comments: 5 figures

Foundation Models for Decision Making: Problems, Methods, and Opportunities

Authors: Sherry Yang, Ofir Nachum, Yilun Du, Jason Wei, Pieter Abbeel, Dale Schuurmans

Abstract: Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other entities and agents. For example, language models are often used to interact with human beings through dialogue, and visual perception models are used to autono… ▽ More Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other entities and agents. For example, language models are often used to interact with human beings through dialogue, and visual perception models are used to autonomously navigate neighborhood streets. In response to these developments, new paradigms are emerging for training foundation models to interact with other agents and perform long-term reasoning. These paradigms leverage the existence of ever-larger datasets curated for multimodal, multitask, and generalist interaction. Research at the intersection of foundation models and decision making holds tremendous promise for creating powerful new systems that can interact effectively across a diverse range of applications such as dialogue, autonomous driving, healthcare, education, and robotics. In this manuscript, we examine the scope of foundation models for decision making, and provide conceptual tools and technical background for understanding the problem space and exploring new research directions. We review recent approaches that ground foundation models in practical decision making applications through a variety of methods such as prompting, conditional generative modeling, planning, optimal control, and reinforcement learning, and discuss common challenges and open problems in the field. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Larger language models do in-context learning differently

Authors: Jerry Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma

Abstract: We study how in-context learning (ICL) in language models is affected by semantic priors versus input-label mappings. We investigate two setups-ICL with flipped labels and ICL with semantically-unrelated labels-across various model families (GPT-3, InstructGPT, Codex, PaLM, and Flan-PaLM). First, experiments on ICL with flipped labels show that overriding semantic priors is an emergent ability of… ▽ More We study how in-context learning (ICL) in language models is affected by semantic priors versus input-label mappings. We investigate two setups-ICL with flipped labels and ICL with semantically-unrelated labels-across various model families (GPT-3, InstructGPT, Codex, PaLM, and Flan-PaLM). First, experiments on ICL with flipped labels show that overriding semantic priors is an emergent ability of model scale. While small language models ignore flipped labels presented in-context and thus rely primarily on semantic priors from pretraining, large models can override semantic priors when presented with in-context exemplars that contradict priors, despite the stronger semantic priors that larger models may hold. We next study semantically-unrelated label ICL (SUL-ICL), in which labels are semantically unrelated to their inputs (e.g., foo/bar instead of negative/positive), thereby forcing language models to learn the input-label mappings shown in in-context exemplars in order to perform the task. The ability to do SUL-ICL also emerges primarily with scale, and large-enough language models can even perform linear classification in a SUL-ICL setting. Finally, we evaluate instruction-tuned models and find that instruction tuning strengthens both the use of semantic priors and the capacity to learn input-label mappings, but more of the former. △ Less

Submitted 8 March, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

Prior Information based Decomposition and Reconstruction Learning for Micro-Expression Recognition

Authors: Jinsheng Wei, Haoyu Chen, Guanming Lu, Jingjie Yan, Yue Xie, Guoying Zhao

Abstract: Micro-expression recognition (MER) draws intensive research interest as micro-expressions (MEs) can infer genuine emotions. Prior information can guide the model to learn discriminative ME features effectively. However, most works focus on researching the general models with a stronger representation ability to adaptively aggregate ME movement information in a holistic way, which may ignore the pr… ▽ More Micro-expression recognition (MER) draws intensive research interest as micro-expressions (MEs) can infer genuine emotions. Prior information can guide the model to learn discriminative ME features effectively. However, most works focus on researching the general models with a stronger representation ability to adaptively aggregate ME movement information in a holistic way, which may ignore the prior information and properties of MEs. To solve this issue, driven by the prior information that the category of ME can be inferred by the relationship between the actions of facial different components, this work designs a novel model that can conform to this prior information and learn ME movement features in an interpretable way. Specifically, this paper proposes a Decomposition and Reconstruction-based Graph Representation Learning (DeRe-GRL) model to effectively learn high-level ME features. DeRe-GRL includes two modules: Action Decomposition Module (ADM) and Relation Reconstruction Module (RRM), where ADM learns action features of facial key components and RRM explores the relationship between these action features. Based on facial key components, ADM divides the geometric movement features extracted by the graph model-based backbone into several sub-features, and learns the map matrix to map these sub-features into multiple action features; then, RRM learns weights to weight all action features to build the relationship between action features. The experimental results demonstrate the effectiveness of the proposed modules, and the proposed method achieves competitive performance. △ Less

Submitted 3 March, 2023; originally announced March 2023.

Comments: The article has been accepted by IEICE TRANS. Information and Systems

Programmatic Imitation Learning from Unlabeled and Noisy Demonstrations

Authors: Jimmy Xin, Linus Zheng, Kia Rahmani, Jiayi Wei, Jarrett Holtz, Isil Dillig, Joydeep Biswas

Abstract: Imitation Learning (IL) is a promising paradigm for teaching robots to perform novel tasks using demonstrations. Most existing approaches for IL utilize neural networks (NN), however, these methods suffer from several well-known limitations: they 1) require large amounts of training data, 2) are hard to interpret, and 3) are hard to repair and adapt. There is an emerging interest in programmatic i… ▽ More Imitation Learning (IL) is a promising paradigm for teaching robots to perform novel tasks using demonstrations. Most existing approaches for IL utilize neural networks (NN), however, these methods suffer from several well-known limitations: they 1) require large amounts of training data, 2) are hard to interpret, and 3) are hard to repair and adapt. There is an emerging interest in programmatic imitation learning (PIL), which offers significant promise in addressing the above limitations. In PIL, the learned policy is represented in a programming language, making it amenable to interpretation and repair. However, state-of-the-art PIL algorithms assume access to action labels and struggle to learn from noisy real-world demonstrations. In this paper, we propose PLUNDER, a novel PIL algorithm that integrates a probabilistic program synthesizer in an iterative Expectation-Maximization (EM) framework to address these shortcomings. Unlike existing PIL approaches, PLUNDER synthesizes probabilistic programmatic policies that are particularly well-suited for modeling the uncertainties inherent in real-world demonstrations. Our approach leverages an EM loop to simultaneously infer the missing action labels and the most likely probabilistic policy. We benchmark PLUNDER against several established IL techniques, and demonstrate its superiority across five challenging imitation learning tasks under noise. PLUNDER policies achieve 95% accuracy in matching the given demonstrations, outperforming the next best baseline by 19%. Additionally, policies generated by PLUNDER successfully complete the tasks 17% more frequently than the nearest baseline. △ Less

Submitted 4 April, 2024; v1 submitted 2 March, 2023; originally announced March 2023.

Model-Independent Determination of $H_0$ and $Ω_{K,0}$ using Time-Delay Galaxy Lenses and Gamma-Ray Bursts

Authors: Shen-Shi Du, Jun-Jie Wei, Zhi-Qiang You, Zu-Cheng Chen, Zong-Hong Zhu, En-Wei Liang

Abstract: Combining the `time-delay distance' ($D_{Δt}$) measurements from galaxy lenses and other distance indicators provides model-independent determinations of the Hubble constant ($H_0$) and spatial curvature ($Ω_{K,0}$), only based on the validity of the Friedmann-Lemaître-Robertson-Walker (FLRW) metric and geometrical optics. To take the full merit of combining $D_{Δt}$ measurements in constraining… ▽ More Combining the `time-delay distance' ($D_{Δt}$) measurements from galaxy lenses and other distance indicators provides model-independent determinations of the Hubble constant ($H_0$) and spatial curvature ($Ω_{K,0}$), only based on the validity of the Friedmann-Lemaître-Robertson-Walker (FLRW) metric and geometrical optics. To take the full merit of combining $D_{Δt}$ measurements in constraining $H_0$, we use gamma-ray burst (GRB) distances to extend the redshift coverage of lensing systems much higher than that of Type Ia Supernovae (SNe Ia) and even higher than quasars, whilst the general cosmography with a curvature component is implemented for the GRB distance parametrizations. Combining Lensing+GRB yields $H_0=71.5^{+4.4}_{-3.0}$~km s$^{-1}$Mpc$^{-1}$ and $Ω_{K,0} = -0.07^{+0.13}_{-0.06}$ (1$σ$). A flat-universe prior gives slightly an improved $H_0 = 70.9^{+4.2}_{-2.9}$~km s$^{-1}$Mpc$^{-1}$. When combining Lensing+GRB+SN Ia, the error bar $ΔH_0$ falls by 25\%, whereas $Ω_{K,0}$ is not improved due to the degeneracy between SN Ia absolute magnitude, $M_B$, and $H_0$ along with the mismatch between the SN Ia and GRB Hubble diagrams at $z\gtrsim 1.4$. Future increment of GRB observations can help to moderately eliminate the $M_B-H_0$ degeneracy in SN Ia distances and ameliorate the restrictions on cosmographic parameters along with $Ω_{K,0}$ when combining Lensing+SN Ia+GRB. We conclude that there is no evidence of significant deviation from a (an) flat (accelerating) universe and $H_0$ is currently determined at 3\% precision. The measurements show great potential to arbitrate the $H_0$ tension between the local distance ladder and cosmic microwave background measurements and provide a relevant consistency test of the FLRW metric. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: Accepted for publication in MNRAS

Spike Solutions to the Supercritical Fractional Gierer-Meinhardt System

Authors: Daniel Gomez, Markus De Medeiros, Jun-cheng Wei, Wen Yang

Abstract: Localized solutions are known to arise in a variety of singularly perturbed reaction-diffusion systems. The Gierer-Meinhardt (GM) system is one such example and has been the focus of numerous rigorous and formal studies. A more recent focus has been the study of localized solutions in systems exhibiting anomalous diffusion, particularly with Lévy flights. In this paper we investigate localized sol… ▽ More Localized solutions are known to arise in a variety of singularly perturbed reaction-diffusion systems. The Gierer-Meinhardt (GM) system is one such example and has been the focus of numerous rigorous and formal studies. A more recent focus has been the study of localized solutions in systems exhibiting anomalous diffusion, particularly with Lévy flights. In this paper we investigate localized solutions to a one-dimensional fractional GM system for which the inhibitor's fractional order is supercritical. Using the method of matched asymptotic expansions we reduce the construction of multi-spike solutions to solving a nonlinear algebraic system. The linear stability of the resulting multi-spike solutions is then addressed by studying a globally coupled eigenvalue problem. In addition to these formal results we also rigorously establish the existence and stability of ground-state solutions when the inhibitor's fractional order is nearly critical. The fractional Green's function, for which we present a rapidly converging series expansion, is prominently featured throughout both the formal and rigorous analysis in this paper. Moreover, we emphasize that the striking similarities between the one-dimensional supercritical GM system and the classical three-dimensional GM system can be attributed to the leading order singular behaviour of the fractional Green's function. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: 41 pages, 10 figures

MSC Class: 35B25 (Primary) 60K50; 35K57; 35B36 (Secondary)

Dilemma in All-optical Characterization of Single-layer NiI2 Multiferroics

Authors: Yucheng Jiang, Yangliu Wu, Jinlei Zhang, Jingxuan Wei, Bo Peng, Cheng-Wei Qiu

Abstract: Matters Arising in Nature on "Evidence for a single layer van der Waals multiferroic". The search for two dimensional multiferroic materials is an exciting yet challenging endeavor. Recently, Song reported the exciting discovery of type II multiferroic order in an antiferromagnetic (AFM) NiI2 single layer and concluded the ferroelectric (FE) polarization induced by a helical magnetic order1. Their… ▽ More Matters Arising in Nature on "Evidence for a single layer van der Waals multiferroic". The search for two dimensional multiferroic materials is an exciting yet challenging endeavor. Recently, Song reported the exciting discovery of type II multiferroic order in an antiferromagnetic (AFM) NiI2 single layer and concluded the ferroelectric (FE) polarization induced by a helical magnetic order1. Their finding was presented from all optical experimental evidence, based on the methods of second harmonic generation (SHG) and linear dichroism (LD). However, the all optical characterizations cannot serve as unanimous evidence of the FE existence, particularly in conjunction with magnetic orders in a single layer NiI2 multiferroic. We have designed and built a Magneto-Optical-Electric Joint-measurement Scanning Imaging system (MOEJSI) for identification of two-dimensional vdW multiferroic. △ Less

Submitted 20 June, 2023; v1 submitted 26 February, 2023; originally announced February 2023.

Comments: 7 pages

Journal ref: Nature, 2023, 619, E40

Photometric and Spectroscopic Observations of GRB 190106A: Emission from Reverse and Forward Shocks with Late-time Energy Injection

Authors: Zi-Pei Zhu, Dong Xu, Johan P. U. Fynbo, Shao-Yu Fu, Xing Liu, Shuai-Qing Jiang, Shuo Xiao, Wei Xie, Yuan-Chuan Zou, He Gao, Dieter Hartmann, Antonio de Ugarte Postigo, David Alexander Kann, Massimo Della Valle, Pall Jakobsson, Tayabba Zafar, Valerio D'Elia, Li-Ping Xin, Jian-Yan Wei, Xing Gao, Jin-Zhong Liu, Tian-Hua Lu, Wei-Hua Lei

Abstract: Early optical observations of gamma-ray bursts can significantly contribute to the study of the central engine and physical processes therein. However, of the thousands observed so far, still only a few have data at optical wavelengths in the first minutes after the onset of the prompt emission. Here we report on GRB\,190106A, whose afterglow was observed in optical bands just 36 s after the {\em… ▽ More Early optical observations of gamma-ray bursts can significantly contribute to the study of the central engine and physical processes therein. However, of the thousands observed so far, still only a few have data at optical wavelengths in the first minutes after the onset of the prompt emission. Here we report on GRB\,190106A, whose afterglow was observed in optical bands just 36 s after the {\em Swift}/BAT trigger, i.e., during the prompt emission phase. The early optical afterglow exhibits a bimodal structure followed by a normal decay, with a faster decay after $\sim \rm T_{0}+$1 day. We present optical photometric and spectroscopic observations of GRB\,190106A. We derive the redshift via metal absorption lines from Xinglong 2.16-m/BFOSC spectroscopic observations. From the BFOSC spectrum, we measure $z= 1.861\pm0.002$. The double-peak optical light curve is a significant feature predicted by the reverse-forward external shock model. The shallow decay followed by a normal decay in both the X-ray and optical light curves is well explained with the standard forward-shock model with late-time energy injection. Therefore, GRB\,190106A offers a case study for GRBs emission from both reverse and forward shocks. △ Less

Submitted 21 February, 2023; v1 submitted 19 February, 2023; originally announced February 2023.

Comments: 17 pages, 9 figures. Accepted for publication in ApJ

Enable High-resolution, Real-time Ensemble Simulation and Data Assimilation of Flood Inundation using Distributed GPU Parallelization

Authors: Junyu Wei, Xiangyu Luo, Weihong Liao, Xiaohui Lei, Jianshi Zhao, Haocheng Huang, Hao Wang

Abstract: Numerical modeling of the intensity and evolution of flood events are affected by multiple sources of uncertainty such as precipitation and land surface conditions. To quantify and curb these uncertainties, an ensemble-based simulation and data assimilation model for pluvial flood inundation is constructed. The shallow water equation is decoupled in the x and y directions, and the inertial form of… ▽ More Numerical modeling of the intensity and evolution of flood events are affected by multiple sources of uncertainty such as precipitation and land surface conditions. To quantify and curb these uncertainties, an ensemble-based simulation and data assimilation model for pluvial flood inundation is constructed. The shallow water equation is decoupled in the x and y directions, and the inertial form of the Saint-Venant equation is chosen to realize fast computation. The probability distribution of the input and output factors is described using Monte Carlo samples. Subsequently, a particle filter is incorporated to enable the assimilation of hydrological observations and improve prediction accuracy. To achieve high-resolution, real-time ensemble simulation, heterogeneous computing technologies based on CUDA (compute unified device architecture) and a distributed storage multi-GPU (graphics processing unit) system are used. Multiple optimization skills are employed to ensure the parallel efficiency and scalability of the simulation program. Taking an urban area of Fuzhou, China as an example, a model with a 3-m spatial resolution and 4.0 million units is constructed, and 8 Tesla P100 GPUs are used for the parallel calculation of 96 model instances. Under these settings, the ensemble simulation of a 1-hour hydraulic process takes 2.0 minutes, which achieves a 2680 estimated speedup compared with a single-thread run on CPU. The calculation results indicate that the particle filter method effectively constrains simulation uncertainty while providing the confidence intervals of key hydrological elements such as streamflow, submerged area, and submerged water depth. The presented approaches show promising capabilities in handling the uncertainties in flood modeling as well as enhancing prediction efficiency. △ Less

Submitted 16 February, 2023; originally announced February 2023.

Compactness of singular solutions to the sixth order GJMS equation

Authors: João Henrique Andrade, João Marcos do Ò, Jesse Ratzkin, Juncheng Wei

Abstract: We study compactness properties of the set of conformally flat singular metrics with constant, positive sixth order Q-curvature on a finitely punctured sphere. Based on a recent classification of the local asymptotic behavior near isolated singularities, we introduce a notion of necksize for these metrics in our moduli space, which we use to characterize compactness. More precisely, we prove that… ▽ More We study compactness properties of the set of conformally flat singular metrics with constant, positive sixth order Q-curvature on a finitely punctured sphere. Based on a recent classification of the local asymptotic behavior near isolated singularities, we introduce a notion of necksize for these metrics in our moduli space, which we use to characterize compactness. More precisely, we prove that if the punctures remain separated and the necksize at each puncture is bounded away from zero along a sequence of metrics, then a subsequence converges with respect to the Gromov--Hausdorff metric. Our proof relies on an upper bound estimate which is proved using moving planes and a blow-up argument. This is combined with a lower bound estimate which is a consequence of a removable singularity theorem. We also introduce a homological invariant which may be of independent interest for upcoming research. △ Less

Submitted 11 February, 2023; originally announced February 2023.

Comments: 20 pages, 1 figure

On lattice hexagonal crystallization for non-monotone potentials

Authors: Senping Luo, Juncheng Wei

Abstract: Let $L =\sqrt{\frac{1}{\Im(z)}}\Big({\mathbb Z}\oplus z{\mathbb Z}\Big)$ where $z \in \mathbb{H}=\{z= x+ i y\;\hbox{or}\;(x,y)\in\mathbb{C}: y>0\}$ be the two dimensional lattices with unit density. Assuming that $α\geq1$, we prove that \begin{equation}\aligned\nonumber \min_{L}\sum_{\mathbb{P}\in L, |L|=1}|\mathbb{P}|^2 e^{- πα|\mathbb{P}|^2} \endaligned\end{equation} is achieved at hexagonal lat… ▽ More Let $L =\sqrt{\frac{1}{\Im(z)}}\Big({\mathbb Z}\oplus z{\mathbb Z}\Big)$ where $z \in \mathbb{H}=\{z= x+ i y\;\hbox{or}\;(x,y)\in\mathbb{C}: y>0\}$ be the two dimensional lattices with unit density. Assuming that $α\geq1$, we prove that \begin{equation}\aligned\nonumber \min_{L}\sum_{\mathbb{P}\in L, |L|=1}|\mathbb{P}|^2 e^{- πα|\mathbb{P}|^2} \endaligned\end{equation} is achieved at hexagonal lattice. More generally we prove that for $α\geq 1$ \begin{equation}\aligned\nonumber \min_{L}\sum_{\mathbb{P}\in L, |L|=1}(|\mathbb{P}|^2-\frac{b}α) e^{- πα|\mathbb{P}|^2} \endaligned\end{equation} is achieved at hexagonal lattice for $b\leq\frac{1}{2π}$ and does not exist for $b>\frac{1}{2π}$. As a consequence, we provide two classes of non-monotone potentials which lead to hexagonal crystallization among lattices. Our results partially answer some questions raised in \cite{Oreport, Bet2016, Bet2018, Bet2019AMP} and extend the main results in \cite{LW2022} on minima of difference of two theta functions. △ Less

Submitted 9 February, 2023; originally announced February 2023.

Comments: 33 pages; comments welcome

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

Authors: Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts

Abstract: We study the design decisions of publicly available instruction tuning methods, and break down the development of Flan 2022 (Chung et al., 2022). Through careful ablation studies on the Flan Collection of tasks and methods, we tease apart the effect of design decisions which enable Flan-T5 to outperform prior work by 3-17%+ across evaluation settings. We find task balancing and enrichment techniqu… ▽ More We study the design decisions of publicly available instruction tuning methods, and break down the development of Flan 2022 (Chung et al., 2022). Through careful ablation studies on the Flan Collection of tasks and methods, we tease apart the effect of design decisions which enable Flan-T5 to outperform prior work by 3-17%+ across evaluation settings. We find task balancing and enrichment techniques are overlooked but critical to effective instruction tuning, and in particular, training with mixed prompt settings (zero-shot, few-shot, and chain-of-thought) actually yields stronger (2%+) performance in all settings. In further experiments, we show Flan-T5 requires less finetuning to converge higher and faster than T5 on single downstream tasks, motivating instruction-tuned models as more computationally-efficient starting checkpoints for new tasks. Finally, to accelerate research on instruction tuning, we make the Flan 2022 collection of datasets, templates, and methods publicly available at https://github.com/google-research/FLAN/tree/main/flan/v2. △ Less

Submitted 14 February, 2023; v1 submitted 31 January, 2023; originally announced January 2023.

BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing

Authors: Jiali Wei, Ming Fan, Wenjing Jiao, Wuxia Jin, Ting Liu

Abstract: Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the adversary injects a backdoor into the model during the training phase, so that input samples with backdoor triggers are classified as the target class. Some atta… ▽ More Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the adversary injects a backdoor into the model during the training phase, so that input samples with backdoor triggers are classified as the target class. Some attacks have achieved high attack success rates on the pre-trained language models (LMs), but there have yet to be effective defense methods. In this work, we propose a defense method based on deep model mutation testing. Our main justification is that backdoor samples are much more robust than clean samples if we impose random mutations on the LMs and that backdoors are generalizable. We first confirm the effectiveness of model mutation testing in detecting backdoor samples and select the most appropriate mutation operators. We then systematically defend against three extensively studied backdoor attack levels (i.e., char-level, word-level, and sentence-level) by detecting backdoor samples. We also make the first attempt to defend against the latest style-level backdoor attacks. We evaluate our approach on three benchmark datasets (i.e., IMDB, Yelp, and AG news) and three style transfer datasets (i.e., SST-2, Hate-speech, and AG news). The extensive experimental results demonstrate that our approach can detect backdoor samples more efficiently and accurately than the three state-of-the-art defense approaches. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Trichotomy dynamics of the 1-equivariant harmonic map flow

Authors: Juncheng Wei, Qidi Zhang, Yifu Zhou

Abstract: For the 1-equivariant harmonic map flow from $ R^2$ into $S^2$ \begin{equation*} \left\{ \begin{aligned} &v_t=v_{rr}+\frac{v_r}{r} - \frac{\sin(2v)}{2r^2} , ~\quad(r,t)\in R_+\times (t_0,+\infty),\\ &v(r,t_0)=v_0, \qquad\qquad\qquad\quad r\in R_+, \end{aligned} \right. \end{equation*} we construct global growing, bounded and decaying solutions with the initial data $v_0(r)$ satisfying… ▽ More For the 1-equivariant harmonic map flow from $ R^2$ into $S^2$ \begin{equation*} \left\{ \begin{aligned} &v_t=v_{rr}+\frac{v_r}{r} - \frac{\sin(2v)}{2r^2} , ~\quad(r,t)\in R_+\times (t_0,+\infty),\\ &v(r,t_0)=v_0, \qquad\qquad\qquad\quad r\in R_+, \end{aligned} \right. \end{equation*} we construct global growing, bounded and decaying solutions with the initial data $v_0(r)$ satisfying $$v_0(0)=π~\mbox{ and }~ v_0(r)\sim r^{1-γ} ~\mbox{ as }~ r\to+\infty, \quad γ>1.$$ These global solutions exhibit the following trichotomy long-time asymptotic behavior \begin{equation*} \| v_r(\cdot,t) \|_{L^\infty ([0,\infty))} \sim \begin{cases} t^{\frac{γ-2}{2}}\ln t ~&\mbox{ if }~ 1<γ<2,\\ 1 ~&\mbox{ if }~ γ=2,\\ \ln t ~&\mbox{ if }~ γ>2,\\ \end{cases} ~\mbox{ as }~ t\to +\infty. \end{equation*} △ Less

Submitted 22 January, 2023; originally announced January 2023.

Comments: 30 pages; comments welcome

Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data

Authors: Jing Wei, Sungdong Kim, Hyunhoon Jung, Young-Ho Kim

Abstract: Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on naturalistic conversations while pursuing a given goal, such as collecting self-report data from users. We explore what design factors of prompts can help steer chatbots to talk naturally and collect data reliably. To this ai… ▽ More Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on naturalistic conversations while pursuing a given goal, such as collecting self-report data from users. We explore what design factors of prompts can help steer chatbots to talk naturally and collect data reliably. To this aim, we formulated four prompt designs with different structures and personas. Through an online study (N = 48) where participants conversed with chatbots driven by different designs of prompts, we assessed how prompt designs and conversation topics affected the conversation flows and users' perceptions of chatbots. Our chatbots covered 79% of the desired information slots during conversations, and the designs of prompts and topics significantly influenced the conversation flows and the data collection performance. We discuss the opportunities and challenges of building chatbots with LLMs. △ Less

Submitted 22 September, 2023; v1 submitted 14 January, 2023; originally announced January 2023.

Comments: 22 pages including Appendix, 7 figures, 7 tables. Accepted to PACM HCI (CSCW 2024)

Report number: 87 ACM Class: H.5.2; I.2.7

Journal ref: Proceedings of the ACM on Human-Computer Interaction, 2024, Volume 8, Issue CSCW1, Article No. 87

An optical-ultraviolet flare with absolute AB magnitude of -39.4 detected in GRB 220101A

Authors: Zhi-Ping Jin, Hao Zhou, Yun Wang, Jin-Jun Geng, Stefano Covino, Xue-Feng Wu, Xiang Li, Yi-Zhong Fan, Da-Ming Wei, Jian-Yan Wei

Abstract: Hyperluminous optical-ultraviolet fares have been detected in gamma-ray bursts and the luminosity record was held by naked-eye event GRB 080319B. Such fares are widely attributed to internal shock or external reverse shock radiation. Here, with a new method developed to derive reliable photometry from saturated sources of Swift/UVOT, we carry out time-resolved analysis of the initial white-band 15… ▽ More Hyperluminous optical-ultraviolet fares have been detected in gamma-ray bursts and the luminosity record was held by naked-eye event GRB 080319B. Such fares are widely attributed to internal shock or external reverse shock radiation. Here, with a new method developed to derive reliable photometry from saturated sources of Swift/UVOT, we carry out time-resolved analysis of the initial white-band 150s exposure of GRB 220101A, a burst at a redshift of 4.618, and report a rapidly evolving optical-ultraviolet fare with a high absolute AB magnitude of -39.4$\pm$0.2. In contrast to GRB 080319B, the temporal behaviour of this new fare does not trace the gamma-ray activity. Instead of either internal shocks or reverse shock, this extremely energetic optical-ultraviolet fare is most likely to originate from the refreshed shocks induced by the late-ejected extremely energetic material catching up with the earlier-launched decelerating outflow. This finding reveals the diverse origins of the extremely energetic optical-ultraviolet fares and demonstrates the necessity of high-time-resolution observations at early times. △ Less

Submitted 5 June, 2024; v1 submitted 6 January, 2023; originally announced January 2023.

Comments: Published in Nature Astronomy, the definitive version is available at https://www.nature.com/articles/s41550-023-02005-w

Journal ref: Nature Astronomy, Volume 7, p.1108-1115 (2023)

Modeling unsteady loads on wind-turbine blade sections from periodic structural oscillations and impinging gusts

Authors: Nathaniel J. Wei, Omkar B. Shende

Abstract: Many traditional methods for wind turbine design and analysis assume quasi-steady aerodynamics, but atmospheric flows are inherently unsteady and modern turbine blades are susceptible to aeroelastic deformations. This study therefore evaluates the effectiveness of simple analytical models for capturing the effects of such unsteady conditions on wind-turbine blades. We consider a pitching and plung… ▽ More Many traditional methods for wind turbine design and analysis assume quasi-steady aerodynamics, but atmospheric flows are inherently unsteady and modern turbine blades are susceptible to aeroelastic deformations. This study therefore evaluates the effectiveness of simple analytical models for capturing the effects of such unsteady conditions on wind-turbine blades. We consider a pitching and plunging airfoil in a periodic transverse gust as an idealization of unsteady loading scenarios on a blade section. A potential-flow model derived from a linear combination of canonical problems is proposed to predict the unsteady lift on a two-dimensional airfoil in the small-perturbation limit. We then perform high-fidelity two-dimensional numerical simulations of a NACA-0012 airfoil over a range of periodic pitch, plunge, and gust disturbances, and quantify the amplitude and phase of the unsteady lift response. Good agreement with the model predictions is found for low to moderate forcing amplitudes and frequencies, while deviations are observed when the angle-of-attack amplitudes approach the static flow-separation limit of the airfoil. Potential explanations are given for the cases in which the ideal-flow theory proves insufficient. This theoretical framework and numerical evaluation motivate the inclusion of unsteady flow models in design and simulation tools in order to increase the robustness and operational lifespans of wind turbine blades in real flow conditions. △ Less

Submitted 15 June, 2024; v1 submitted 29 December, 2022; originally announced December 2022.

Semantic Enhanced Knowledge Graph for Large-Scale Zero-Shot Learning

Authors: Jiwei Wei, Yang Yang, Zeyu Ma, Jingjing Li, Xing Xu, Heng Tao Shen

Abstract: Zero-Shot Learning has been a highlighted research topic in both vision and language areas. Recently, most existing methods adopt structured knowledge information to model explicit correlations among categories and use deep graph convolutional network to propagate information between different categories. However, it is difficult to add new categories to existing structured knowledge graph, and de… ▽ More Zero-Shot Learning has been a highlighted research topic in both vision and language areas. Recently, most existing methods adopt structured knowledge information to model explicit correlations among categories and use deep graph convolutional network to propagate information between different categories. However, it is difficult to add new categories to existing structured knowledge graph, and deep graph convolutional network suffers from over-smoothing problem. In this paper, we provide a new semantic enhanced knowledge graph that contains both expert knowledge and categories semantic correlation. Our semantic enhanced knowledge graph can further enhance the correlations among categories and make it easy to absorb new categories. To propagate information on the knowledge graph, we propose a novel Residual Graph Convolutional Network (ResGCN), which can effectively alleviate the problem of over-smoothing. Experiments conducted on the widely used large-scale ImageNet-21K dataset and AWA2 dataset show the effectiveness of our method, and establish a new state-of-the-art on zero-shot learning. Moreover, our results on the large-scale ImageNet-21K with various feature extraction networks show that our method has better generalization and robustness. △ Less

Submitted 26 December, 2022; originally announced December 2022.

Large Language Models Encode Clinical Knowledge

Authors: Karan Singhal, Shekoofeh Azizi, Tao Tu, S. Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, Perry Payne, Martin Seneviratne, Paul Gamble, Chris Kelly, Nathaneal Scharli, Aakanksha Chowdhery, Philip Mansfield, Blaise Aguera y Arcas, Dale Webster, Greg S. Corrado, Yossi Matias, Katherine Chou, Juraj Gottweis, Nenad Tomasev, Yun Liu , et al. (5 additional authors not shown)

Abstract: Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge typically rely on automated evaluations on limited benchmarks. There is no standard to evaluate model predictions and reasoning across a breadth of tasks. To a… ▽ More Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge typically rely on automated evaluations on limited benchmarks. There is no standard to evaluate model predictions and reasoning across a breadth of tasks. To address this, we present MultiMedQA, a benchmark combining six existing open question answering datasets spanning professional medical exams, research, and consumer queries; and HealthSearchQA, a new free-response dataset of medical questions searched online. We propose a framework for human evaluation of model answers along multiple axes including factuality, precision, possible harm, and bias. In addition, we evaluate PaLM (a 540-billion parameter LLM) and its instruction-tuned variant, Flan-PaLM, on MultiMedQA. Using a combination of prompting strategies, Flan-PaLM achieves state-of-the-art accuracy on every MultiMedQA multiple-choice dataset (MedQA, MedMCQA, PubMedQA, MMLU clinical topics), including 67.6% accuracy on MedQA (US Medical License Exam questions), surpassing prior state-of-the-art by over 17%. However, human evaluation reveals key gaps in Flan-PaLM responses. To resolve this we introduce instruction prompt tuning, a parameter-efficient approach for aligning LLMs to new domains using a few exemplars. The resulting model, Med-PaLM, performs encouragingly, but remains inferior to clinicians. We show that comprehension, recall of knowledge, and medical reasoning improve with model scale and instruction prompt tuning, suggesting the potential utility of LLMs in medicine. Our human evaluations reveal important limitations of today's models, reinforcing the importance of both evaluation frameworks and method development in creating safe, helpful LLM models for clinical applications. △ Less

Submitted 26 December, 2022; originally announced December 2022.

Prospects of Searching for Type Ia Supernovae with 2.5-m Wide Field Survey Telescope

Authors: Maokai Hu, Lei Hu, Ji-an Jiang, Lin Xiao, Lulu Fan, Junjie Wei, Xuefeng Wu

Abstract: Type Ia Supernovae (SNe Ia) are the thermonuclear explosion of a carbon-oxygen white dwarf (WD) and are well-known as a distance indicator. However, it is still unclear how WDs increase their mass near the Chandrasekhar limit and how the thermonuclear runaway happens. The observational clues associated with these open questions, such as the photometric data within hours to days since the explosion… ▽ More Type Ia Supernovae (SNe Ia) are the thermonuclear explosion of a carbon-oxygen white dwarf (WD) and are well-known as a distance indicator. However, it is still unclear how WDs increase their mass near the Chandrasekhar limit and how the thermonuclear runaway happens. The observational clues associated with these open questions, such as the photometric data within hours to days since the explosion, are scarce. Thus, an essential way is to discover SNe Ia at specific epochs with optimal surveys. The 2.5-m Wide Field Survey Telescope (WFST) is an upcoming survey facility deployed in western China. In this paper, we assess the detecability of SNe Ia with mock observations of WFST. Followed by the volumetric rate, we generate a spectral series of SNe Ia based on a data-based model and introduce the line-of-sight extinction to calculate the brightness from the observer. By comparing with the detection limit of WFST, which is affected by the observing conditions, we can count the number of SNe Ia discovered by mock WFST observations. We expect that WFST can find more than $3.0\times10^{4}$ pre-maximum SNe Ia within one-year running. In particular, WFST could discover about 45 bright SNe Ia, 99 early-phase SNe Ia, or $1.1\times10^{4}$ well-observed SNe Ia with the hypothesized Wide, Deep, or Medium mode, respectively, suggesting WFST will be an influential facility in time-domain astronomy. △ Less

Submitted 22 December, 2022; originally announced December 2022.

Comments: Accepted by Universe

On Minima of Difference of Epstein Zeta Functions and Exact Solutions to Lennard-Jones Lattice Energy

Authors: Senping Luo, Juncheng Wei

Abstract: Let $ζ(s,z)=\sum_{(m,n)\in\mathbb{Z}^2\backslash\{0\}}\frac{(\Im(z))^s}{|mz+n|^{2s}}$ be the Eisenstein series/Epstein Zeta function. Motivated by widely used Lennard-Jones potential \begin{equation}\aligned\nonumber \mathcal{V}(|\cdot|^2):=4\varepsilon\Big( (\fracσ{|\cdot|})^{12}-(\fracσ{|\cdot|})^{6} \Big), \endaligned\end{equation} in physics, in this paper, we consider the following lattic… ▽ More Let $ζ(s,z)=\sum_{(m,n)\in\mathbb{Z}^2\backslash\{0\}}\frac{(\Im(z))^s}{|mz+n|^{2s}}$ be the Eisenstein series/Epstein Zeta function. Motivated by widely used Lennard-Jones potential \begin{equation}\aligned\nonumber \mathcal{V}(|\cdot|^2):=4\varepsilon\Big( (\fracσ{|\cdot|})^{12}-(\fracσ{|\cdot|})^{6} \Big), \endaligned\end{equation} in physics, in this paper, we consider the following lattice minimization problem \begin{equation}\aligned\nonumber \min_{z\in\mathbb{H}}\Big(ζ(6,z)-bζ(3,z)\Big), \;\;b=\frac{1}{σ^6} \endaligned\end{equation} and completely classify the minimizers for all $b\in \R$. Our results resolve an open problem in Blanc-Lewin \cite{Bla2015}, and a conjecture by Bétermin \cite{Bet2018}. Furthermore, our method of proofs works for general minimization problem \begin{equation}\aligned\nonumber \min_{z\in\mathbb{H}}\Big(ζ(s_1,z)-bζ(s_2,z)\Big), \;\;s_1>s_2>1 \endaligned\end{equation} which corresponds to general Lennard-Jones potential \begin{equation}\aligned\nonumber \mathcal{V}(|\cdot|^2):=4\varepsilon\Big( (\fracσ{|\cdot|})^{2s_1}-(\fracσ{|\cdot|})^{2s_2} \Big),\;\;s_1>s_2>1. \endaligned\end{equation} △ Less

Submitted 20 December, 2022; originally announced December 2022.

Comments: 38 pages

Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding

Authors: Haoli Bai, Zhiguang Liu, Xiaojun Meng, Wentao Li, Shuang Liu, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu

Abstract: Unsupervised pre-training on millions of digital-born or scanned documents has shown promising advances in visual document understanding~(VDU). While various vision-language pre-training objectives are studied in existing solutions, the document textline, as an intrinsic granularity in VDU, has seldom been explored so far. A document textline usually contains words that are spatially and semantica… ▽ More Unsupervised pre-training on millions of digital-born or scanned documents has shown promising advances in visual document understanding~(VDU). While various vision-language pre-training objectives are studied in existing solutions, the document textline, as an intrinsic granularity in VDU, has seldom been explored so far. A document textline usually contains words that are spatially and semantically correlated, which can be easily obtained from OCR engines. In this paper, we propose Wukong-Reader, trained with new pre-training objectives to leverage the structural knowledge nested in document textlines. We introduce textline-region contrastive learning to achieve fine-grained alignment between the visual regions and texts of document textlines. Furthermore, masked region modeling and textline-grid matching are also designed to enhance the visual and layout representations of textlines. Experiments show that our Wukong-Reader has superior performance on various VDU tasks such as information extraction. The fine-grained alignment over textlines also empowers Wukong-Reader with promising localization ability. △ Less

Submitted 19 December, 2022; originally announced December 2022.

Scale invariance in X-ray flares of gamma-ray bursts

Authors: Jun-Jie Wei

Abstract: X-ray flares are generally believed to be produced by the reactivation of the central engine, and may have the same energy dissipation mechanism as the prompt emission of gamma-ray bursts (GRBs). X-ray flares can therefore provide important clues to understanding the nature of the central engines of GRBs. In this work, we study for the first time the physical connection between differential size a… ▽ More X-ray flares are generally believed to be produced by the reactivation of the central engine, and may have the same energy dissipation mechanism as the prompt emission of gamma-ray bursts (GRBs). X-ray flares can therefore provide important clues to understanding the nature of the central engines of GRBs. In this work, we study for the first time the physical connection between differential size and return distributions of X-ray flares of GRBs with known redshifts. We find that the differential distributions of duration, energy, and waiting time can be well fitted by a power-law function. In particular, the distributions for the differences of durations, energies, and waiting times at different times (i.e., the return distributions) well follow a $q$-Gaussian form. The $q$ values in the $q$-Gaussian distributions remain nearly steady for different temporal interval scales, implying a scale-invariant structure of GRB X-ray flares. Moreover, we verify that the $q$ parameters are related to the power-law indices $α$ of the differential size distributions, characterized as $q=(α+2)/α$. These statistical features can be well explained within the physical framework of a self-organizing criticality system. △ Less

Submitted 17 January, 2023; v1 submitted 17 December, 2022; originally announced December 2022.

Comments: 6 pages, 3 figures, 2 tables. Published in Phys. Rev. Research

Journal ref: Phys. Rev. Research 5, 013019 (2023)

Photometric and Spectroscopic Observations of GRB 210104A: Bright Reverse shock Emission and Dense Circumburst Environment

Authors: Lu-Lu Zhang, Li-Ping Xin, Jing Wang, Xu-Hui Han, Dong Xu, Zi-Pei Zhu, Chao Wu, Jian-Yan Wei, En-Wei Liang

Abstract: Early afterglow observations of gamma-ray bursts (GRBs) are valuable for exploring the properties of their jets and ambient medium. We report our photometric and spectroscopic observations of GRB 210104A and discuss its jet properties with multiwavelength data. Our spectroscopic observation reveals several absorption features and a tentative redshift of 0.46 is identified. A bright optical flare t… ▽ More Early afterglow observations of gamma-ray bursts (GRBs) are valuable for exploring the properties of their jets and ambient medium. We report our photometric and spectroscopic observations of GRB 210104A and discuss its jet properties with multiwavelength data. Our spectroscopic observation reveals several absorption features and a tentative redshift of 0.46 is identified. A bright optical flare that has a peak brightness of $R=13$ mag at $112\pm 7$~s was observed in the $R$ band during $67\sim 165$ seconds post the GRB trigger. The flux of the $R$-band afterglow decays with a slope of $α_{\rm O}={-0.91\pm 0.03}$ at $t>650$~s. The early X-ray afterglow lightcurve is a smooth bump, and it decays with a slope of $α_{\rm X}=-1.18\pm 0.01$ at late epoch. Our joint spectral fit to the optical-X-ray afterglows during $(1.1-1.3)\times 10^{4}$~s yields a photon index $Γ_{\rm O,X}=-1.82\pm 0.04$. The derived host galaxy extinction is $A_{R}=0.87$. Attributing the early optical flare to the reverse-shock (RS) emission and the late optical-X-ray emission to the forward shock emission; the optical and X-ray lightcurves at $t<3\times 10^4$~s can be well fit adopting an Markov Chain Monte Carlo algorithm. Comparing the properties of GRB 210104A with other GRBs that have detection of bright RS emission, we show that its jet is mildly magnetized ($R_{\rm B}=28$), with high radiation efficiency ($77\%$), is sub-energetic ($E_{\rm k, iso}=4.5\times 10^{51}$ erg), and moderately relativistic ($Γ_0\sim 35$) in a density medium ($n_{0}\sim 417\;{\rm cm}^{-3}$). It follows the tight $L_{γ,\rm iso}-E_{\rm p,z}-Γ_{0}$ relation as with typical GRBs. △ Less

Submitted 15 December, 2022; originally announced December 2022.

Comments: 17 pages, 5 figures, 2 tables; Accepted for publication in ApJ

Model selection using time-delay lenses

Authors: Fulvio Melia, Jun-Jie Wei, Xue-Feng Wu

Abstract: The sample of time-delay gravitational lenses appropriate for studying the geometry of the Universe continues to grow as dedicated campaigns, such as the Dark Energy Survey, the VST ATLAS survey, and the Large Synoptic Survey Telescope, complete their census of high-redshift sources. This catalog now includes hundreds of strong lensing systems, at least 31 of which have reasonably accurate time de… ▽ More The sample of time-delay gravitational lenses appropriate for studying the geometry of the Universe continues to grow as dedicated campaigns, such as the Dark Energy Survey, the VST ATLAS survey, and the Large Synoptic Survey Telescope, complete their census of high-redshift sources. This catalog now includes hundreds of strong lensing systems, at least 31 of which have reasonably accurate time delay measurements. In this paper, we use them to compare the predictions of two competing Friedmann-Lemaitre-Robertson-Walker models: flat LCDM, characterized by two adjustable parameters (H_0 and Omega_m), and the R_h=ct universe (with H_0 as the single free variable). Over the past decade, the latter has accounted for the data better than the standard model, most recently the emergence of well-formed galaxies discovered by JWST at cosmic dawn. Here we show that the current sample of time-delay lenses favours R_h=ct with a likelihood of ~84% versus ~16% for the standard model. This level of accuracy will greatly improve as the ongoing surveys uncover many thousands additional lens systems over the next several years. △ Less

Submitted 12 December, 2022; originally announced December 2022.

Comments: 8 pages, 1 table, 4 figures. Accepted for publication in MNRAS

Journal ref: MNRAS 519, 2528 (2023)

On Sharp Beckner's Inequality for Axially Symmetric Functions on $\mathbb{S}^4$

Authors: Tuoxin Li, Juncheng Wei, Zikai Ye

Abstract: We prove a sharp Beckner's inequality for axially symmetric functions on $S^4$. The key ingredients of our proof is some pointwise quantitative properties of Gegenbauer polynomials. We prove a sharp Beckner's inequality for axially symmetric functions on $S^4$. The key ingredients of our proof is some pointwise quantitative properties of Gegenbauer polynomials. △ Less

Submitted 8 December, 2022; originally announced December 2022.

SpaceEditing: Integrating Human Knowledge into Deep Neural Networks via Interactive Latent Space Editing

Authors: Jiafu Wei, Ding Xia, Haoran Xie, Chia-Ming Chang, Chuntao Li, Xi Yang

Abstract: We propose an interactive editing method that allows humans to help deep neural networks (DNNs) learn a latent space more consistent with human knowledge, thereby improving classification accuracy on indistinguishable ambiguous data. Firstly, we visualize high-dimensional data features through dimensionality reduction methods and design an interactive system \textit{SpaceEditing} to display the vi… ▽ More We propose an interactive editing method that allows humans to help deep neural networks (DNNs) learn a latent space more consistent with human knowledge, thereby improving classification accuracy on indistinguishable ambiguous data. Firstly, we visualize high-dimensional data features through dimensionality reduction methods and design an interactive system \textit{SpaceEditing} to display the visualized data. \textit{SpaceEditing} provides a 2D workspace based on the idea of spatial layout. In this workspace, the user can move the projection data in it according to the system guidance. Then, \textit{SpaceEditing} will find the corresponding high-dimensional features according to the projection data moved by the user, and feed the high-dimensional features back to the network for retraining, therefore achieving the purpose of interactively modifying the high-dimensional latent space for the user. Secondly, to more rationally incorporate human knowledge into the training process of neural networks, we design a new loss function that enables the network to learn user-modified information. Finally, We demonstrate how \textit{SpaceEditing} meets user needs through three case studies while evaluating our proposed new method, and the results confirm the effectiveness of our method. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Comments: 13 pages, 12 figures, Video URL: https://youtu.be/UTxji6_fs5I

Hysteretic Electronic Phase Transitions in Correlated Charge-Density-Wave State of 1T-TaS2

Authors: Geng Yanyan, Lei Le, Dong Haoyu, Guo Jianfeng, Mi Shuo, Li Yan, Huang Li, Pang Fei, Xu Rui, Zhou Weichang, Liu Zheng, Ji Wei, Cheng Zhihai

Abstract: Recently, many exotic electronic states, such as quantum spin liquid (QSL) and superconductivity (SC), have been extensively discovered and introduced in layered transition metal dichalcogenides 1T-TaS2 by controlling their complex correlated charge-density-wave (CDW) states. However, few studies have focused on its hysteretic electronic phase transitions based on the in-depth discussion of the de… ▽ More Recently, many exotic electronic states, such as quantum spin liquid (QSL) and superconductivity (SC), have been extensively discovered and introduced in layered transition metal dichalcogenides 1T-TaS2 by controlling their complex correlated charge-density-wave (CDW) states. However, few studies have focused on its hysteretic electronic phase transitions based on the in-depth discussion of the delicate interplay among temperature-dependent electronic interactions. Here, we reported a sequence of spatial electronic phase transitions in the hysteresis temperature range of 1T-TaS2 via variable-temperature scanning tunneling microscopy (VT-STM). The emergence, evolution, coexistence, and separation of diverse novel electronic states within the commensurate CDW/triclinic CDW (CCDW/TCDW) phase are investigated in detail through the warming/cooling process. These novel emergent electronic states can be attributed to the delicate temperature-dependent competition and/or cooperation of interlayer interactions, intralayer electron-electron correlation, and electron-phonon (e-ph) coupling of 1T-TaS2. Our results not only provide a novel insight to understand the hysteretic electronic phase transitions of correlated CDW state, but also pave a way to realize more exotic quantum states by accurately and effectively controlling various interactions in correlated materials. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Comments: 20 pages, 5 figures,

BoxPolyp:Boost Generalized Polyp Segmentation Using Extra Coarse Bounding Box Annotations

Authors: Jun Wei, Yiwen Hu, Guanbin Li, Shuguang Cui, S Kevin Zhou, Zhen Li

Abstract: Accurate polyp segmentation is of great importance for colorectal cancer diagnosis and treatment. However, due to the high cost of producing accurate mask annotations, existing polyp segmentation methods suffer from severe data shortage and impaired model generalization. Reversely, coarse polyp bounding box annotations are more accessible. Thus, in this paper, we propose a boosted BoxPolyp model t… ▽ More Accurate polyp segmentation is of great importance for colorectal cancer diagnosis and treatment. However, due to the high cost of producing accurate mask annotations, existing polyp segmentation methods suffer from severe data shortage and impaired model generalization. Reversely, coarse polyp bounding box annotations are more accessible. Thus, in this paper, we propose a boosted BoxPolyp model to make full use of both accurate mask and extra coarse box annotations. In practice, box annotations are applied to alleviate the over-fitting issue of previous polyp segmentation models, which generate fine-grained polyp area through the iterative boosted segmentation model. To achieve this goal, a fusion filter sampling (FFS) module is firstly proposed to generate pixel-wise pseudo labels from box annotations with less noise, leading to significant performance improvements. Besides, considering the appearance consistency of the same polyp, an image consistency (IC) loss is designed. Such IC loss explicitly narrows the distance between features extracted by two different networks, which improves the robustness of the model. Note that our BoxPolyp is a plug-and-play model, which can be merged into any appealing backbone. Quantitative and qualitative experimental results on five challenging benchmarks confirm that our proposed model outperforms previous state-of-the-art methods by a large margin. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Comments: Accepted by MICCAI2022, Codes Available

AMORETTO: A Method for Deriving IoT-enriched Event Logs

Authors: Jia Wei, Chun Ouyang, Arthur H. M. ter Hofstede, Catarina Moreira

Abstract: Process analytics aims to gain insights into the behaviour and performance of business processes through the analysis of event logs, which record the execution of processes. With the widespread use of the Internet of Things (IoT), IoT data has become readily available and can provide valuable context information about business processes. As such, process analytics can benefit from incorporating Io… ▽ More Process analytics aims to gain insights into the behaviour and performance of business processes through the analysis of event logs, which record the execution of processes. With the widespread use of the Internet of Things (IoT), IoT data has become readily available and can provide valuable context information about business processes. As such, process analytics can benefit from incorporating IoT data into event logs to support more comprehensive, context-aware analyses. However, most existing studies focus on enhancing business process models with IoT data, whereas little attention has been paid to incorporating IoT data into event logs for process analytics. Hence, this paper aims to systematically integrate IoT data into event logs to support context-aware process analytics. To this end, we propose AMORETTO - a method for deriving IoT-enriched event logs. Firstly, we provide a classification of context data, referred to as the IoT-Pro context classification, which encompasses two context dimensions: IoT context and process context. Next, we present a method for integrating IoT data with event logs, guided by IoT-Pro, to yield IoT-enriched event logs. To demonstrate the applicability of AMORETTO, we applied it to a real-life use case and examined whether the derived IoT-enriched event log sufficed to address certain specific analytical questions. △ Less

Submitted 5 December, 2022; originally announced December 2022.

Background-Mixed Augmentation for Weakly Supervised Change Detection

Authors: Rui Huang, Ruofei Wang, Qing Guo, Jieda Wei, Yuxiang Zhang, Wei Fan, Yang Liu

Abstract: Change detection (CD) is to decouple object changes (i.e., object missing or appearing) from background changes (i.e., environment variations) like light and season variations in two images captured in the same scene over a long time span, presenting critical applications in disaster management, urban development, etc. In particular, the endless patterns of background changes require detectors to… ▽ More Change detection (CD) is to decouple object changes (i.e., object missing or appearing) from background changes (i.e., environment variations) like light and season variations in two images captured in the same scene over a long time span, presenting critical applications in disaster management, urban development, etc. In particular, the endless patterns of background changes require detectors to have a high generalization against unseen environment variations, making this task significantly challenging. Recent deep learning-based methods develop novel network architectures or optimization strategies with paired-training examples, which do not handle the generalization issue explicitly and require huge manual pixel-level annotation efforts. In this work, for the first attempt in the CD community, we study the generalization issue of CD from the perspective of data augmentation and develop a novel weakly supervised training algorithm that only needs image-level labels. Different from general augmentation techniques for classification, we propose the background-mixed augmentation that is specifically designed for change detection by augmenting examples under the guidance of a set of background-changing images and letting deep CD models see diverse environment variations. Moreover, we propose the augmented & real data consistency loss that encourages the generalization increase significantly. Our method as a general framework can enhance a wide range of existing deep learning-based detectors. We conduct extensive experiments in two public datasets and enhance four state-of-the-art methods, demonstrating the advantages of our method. We release the code at https://github.com/tsingqguo/bgmix. △ Less

Submitted 19 June, 2023; v1 submitted 21 November, 2022; originally announced November 2022.

Comments: AAAI 2023 Accepted

Magnetic activities and parameters of 43 flare stars in the GWAC archive

Authors: Guang-Wei Li, Chao Wu, Gui-Ping Zhou, Chen Yang, Hua-Li Li, Jie Chen, Li-Ping Xin, Jing Wang, Hasitieer Haerken, Chao-Hong Ma, Hong-Bo Cai, Xu-Hui Han, Lei Huang, Xiao-Meng Lu, Jian-Ying Bai, Xu-Kang Zhang, Xin-Li Hao, Xiang-Yu Wang, Zi-Gao Dai, En-Wei Liang, Xiao-Feng Meng, Jian-Yan Wei

Abstract: In the archive of the Ground Wide Angle Camera (GWAC), we found 43 white light flares from 43 stars, among which, three are sympathetic or homologous flares, and one of them also has a quasi-periodic pulsation with a period of $13.0\pm1.5$ minutes. Among these 43 flare stars, there are 19 new active stars and 41 stars that have available TESS and/or K2 light curves, from which we found 931 stellar… ▽ More In the archive of the Ground Wide Angle Camera (GWAC), we found 43 white light flares from 43 stars, among which, three are sympathetic or homologous flares, and one of them also has a quasi-periodic pulsation with a period of $13.0\pm1.5$ minutes. Among these 43 flare stars, there are 19 new active stars and 41 stars that have available TESS and/or K2 light curves, from which we found 931 stellar flares. We also obtained rotational or orbital periods of 34 GWAC flare stars, of which 33 are less than 5.4 days, and ephemerides of three eclipsing binaries from these light curves. Combining with low resolution spectra from LAMOST and the Xinglong 2.16m telescope, we found that $L_{\rm Hα}/L_{\rm bol}$ are in the saturation region in the rotation-activity diagram. From the LAMOST medium-resolution spectrum, we found that Star \#3 (HAT 178-02667) has double H$α$ emissions which imply it is a binary, and two components are both active stars. Thirteen stars have flare frequency distributions (FFDs) from TESS and/or K2 light curves. These FFDs show that the flares detected by GWAC can occur at a frequency of 0.5 to 9.5 yr$^{-1}$. The impact of flares on habitable planets was also studied based on these FFDs, and flares from some GWAC flare stars may produce enough energetic flares to destroy ozone layers, but none can trigger prebiotic chemistry on their habitable planets. △ Less

Submitted 21 November, 2022; originally announced November 2022.

Comments: 20 pages, 9 figures, 3 tables

Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction

Authors: Chaoyue Song, Jiacheng Wei, Ruibo Li, Fayao Liu, Guosheng Lin

Abstract: The goal of 3D pose transfer is to transfer the pose from the source mesh to the target mesh while preserving the identity information (e.g., face, body shape) of the target mesh. Deep learning-based methods improved the efficiency and performance of 3D pose transfer. However, most of them are trained under the supervision of the ground truth, whose availability is limited in real-world scenarios.… ▽ More The goal of 3D pose transfer is to transfer the pose from the source mesh to the target mesh while preserving the identity information (e.g., face, body shape) of the target mesh. Deep learning-based methods improved the efficiency and performance of 3D pose transfer. However, most of them are trained under the supervision of the ground truth, whose availability is limited in real-world scenarios. In this work, we present X-DualNet, a simple yet effective approach that enables unsupervised 3D pose transfer. In X-DualNet, we introduce a generator $G$ which contains correspondence learning and pose transfer modules to achieve 3D pose transfer. We learn the shape correspondence by solving an optimal transport problem without any key point annotations and generate high-quality meshes with our elastic instance normalization (ElaIN) in the pose transfer module. With $G$ as the basic component, we propose a cross consistency learning scheme and a dual reconstruction objective to learn the pose transfer without supervision. Besides that, we also adopt an as-rigid-as-possible deformer in the training process to fine-tune the body shape of the generated results. Extensive experiments on human and animal data demonstrate that our framework can successfully achieve comparable performance as the state-of-the-art supervised approaches. △ Less

Submitted 16 March, 2023; v1 submitted 18 November, 2022; originally announced November 2022.

Comments: arXiv admin note: text overlap with arXiv:2109.15025

Sincere silting modules and vanishing conditions

Authors: Jifen Liu, Jiaqun Wei

Abstract: Let $R$ be a perfect ring and $T$ be an $R$-module. We study characterizations of sincere modules, sincere silting modules and tilting modules in terms of various vanishing conditions. It is proved that $T$ is sincere silting if and only if $T$ is presilting satisfing the vanishing condition $\mathrm{KerExt}^{0\le i\le 1}_R(T,-)=0$, and that $T$ is tilting if and only if… ▽ More Let $R$ be a perfect ring and $T$ be an $R$-module. We study characterizations of sincere modules, sincere silting modules and tilting modules in terms of various vanishing conditions. It is proved that $T$ is sincere silting if and only if $T$ is presilting satisfing the vanishing condition $\mathrm{KerExt}^{0\le i\le 1}_R(T,-)=0$, and that $T$ is tilting if and only if $\mathrm{Ker}\mathrm{Ext}^{0\leqslant i\leqslant 1}_{R}(T,-)=0$ and $\mathrm{Gen}T\subseteq \mathrm{Ker}\mathrm{Ext}^{1\leqslant i\leqslant 2}_{R}(T,-)$. As an application, we prove that a sincere silting $R$-module $T$ of finite projective dimension is tilting if and only if $\mathrm{Ext}^{i}_{R}(T,T^{(J)})=0$ for all sets $J$ and all integer $i\ge 1$. This not only extends a main result of Zhang [14]from finitely generated modules over Artin algebras to infinitely generated modules over more general rings, but also gives it a different proof without using the functor $τ$ and Auslander-Reiten formula. △ Less

Submitted 7 November, 2022; originally announced November 2022.

Comments: 10 pages

MSC Class: 16L30; 16D10

An 8.0\% Determination of the Baryon Fraction in the Intergalactic Medium from Localized Fast Radio Bursts

Authors: Bao Wang, Jun-Jie Wei

Abstract: The dispersion measure (DM)--redshift relation of fast radio bursts (FRBs) has been proposed as a potential new tool for probing intergalactic medium (IGM) and for studying cosmology. However, the poor knowledge of the baryon fraction in the IGM ($f_{\mathrm{IGM}}$) and its degeneracy with cosmological parameters impose restrictions on the cosmological applications of FRBs. Furthermore, DMs contri… ▽ More The dispersion measure (DM)--redshift relation of fast radio bursts (FRBs) has been proposed as a potential new tool for probing intergalactic medium (IGM) and for studying cosmology. However, the poor knowledge of the baryon fraction in the IGM ($f_{\mathrm{IGM}}$) and its degeneracy with cosmological parameters impose restrictions on the cosmological applications of FRBs. Furthermore, DMs contributed by the IGM ($\mathrm{DM_{IGM}}$) and host galaxy ($\mathrm{DM_{host}}$), important cosmological quantities, cannot be exactly extracted from observations, which would bring uncontrolled systematic uncertainties in FRB cosmology. In this work, we use seventeen localized FRBs to constrain $f_{\mathrm{IGM}}$ and its possible redshift evolution. Other cosmological probes such as type Ia supernovae, baryon acoustic oscillations, and cosmic microwave background radiation are combined to break parameter degeneracy. Taking into account the probability distributions of $\mathrm{DM_{IGM}}$ and $\mathrm{DM_{host}}$ derived from the the IllustrisTNG simulation, we obtain a robust measurement of $f_{\mathrm{IGM}}=0.927\pm0.075$, representing a precision of 8.0\%. We find that there is no strong evidence for the redshift dependence of $f_{\mathrm{IGM}}$ at the current observational data level. The rapid progress in localizing FRBs will significantly improve the constraints on $f_{\mathrm{IGM}}$. △ Less

Submitted 22 February, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: 10 pages, 4 figures, 2 tables. Updated to match the published version

Journal ref: ApJ, 944:50, 2023

Inverse scaling can become U-shaped

Authors: Jason Wei, Najoung Kim, Yi Tay, Quoc V. Le

Abstract: Scaling up language models has been empirically shown to improve performance on a wide range of downstream tasks. However, if we were to observe worse performance as a function of scale ("inverse scaling") on certain tasks, this would indicate that scaling can also encourage behaviors that are misaligned with human preferences. The Inverse Scaling Prize (McKenzie et al. 2022) identified eleven suc… ▽ More Scaling up language models has been empirically shown to improve performance on a wide range of downstream tasks. However, if we were to observe worse performance as a function of scale ("inverse scaling") on certain tasks, this would indicate that scaling can also encourage behaviors that are misaligned with human preferences. The Inverse Scaling Prize (McKenzie et al. 2022) identified eleven such inverse scaling tasks, evaluated on models of up to 280B parameters and up to 500 zettaFLOPs of training compute. This paper takes a closer look at these inverse scaling tasks. We evaluate models of up to 540B parameters, trained on five times more compute than those evaluated in the Inverse Scaling Prize. With this increased range of model sizes and training compute, only four out of the eleven tasks remain inverse scaling. Six out of the eleven tasks exhibit "U-shaped scaling", where performance decreases up to a certain size, and then increases again up to the largest model evaluated (the one remaining task displays positive scaling). In addition, we find that 1-shot examples and chain-of-thought can help mitigate undesirable scaling patterns even further. U-shaped scaling suggests that the inverse scaling trend observed in McKenzie et al. (2022) may not continue to hold for larger models, which we attribute to the presence of distractor tasks that only sufficiently large models can avoid. △ Less

Submitted 24 May, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: v5 includes a reframed discussion section and new chain-of-thought results for Round 2 tasks

Asymptotics for positive singular solutions to subcritical sixth order equations

Authors: João Henrique Andrade, Juncheng Wei

Abstract: We classify the local asymptotic behavior of positive singular solutions to a class of subcritical sixth order equations on the punctured ball. Initially, using a version of the integral moving spheres technique, we prove that solutions are asymptotically radially symmetric solutions with respect to the origin. We divide our approach into some cases concerning the growth of nonlinearity. In genera… ▽ More We classify the local asymptotic behavior of positive singular solutions to a class of subcritical sixth order equations on the punctured ball. Initially, using a version of the integral moving spheres technique, we prove that solutions are asymptotically radially symmetric solutions with respect to the origin. We divide our approach into some cases concerning the growth of nonlinearity. In general, we use an Emden--Fowler change of variables to translate our problem to a cylinder. In the lower critical regime, this is not enough, thus, we need to introduce a new notion of change of variables. The difficulty is that the cylindrical PDE in this coordinate system is nonautonomous. Nonetheless, we define an associated nonautonomous Pohozaev functional, which can be proved to be asymptotically monotone. In addition, we show a priori estimates for these two functionals, from which we extract compactness properties. With this ingredients, we can perform an asymptotic analysis technique to prove our main result. △ Less

Submitted 26 October, 2022; originally announced October 2022.

Comments: 33 pages. arXiv admin note: substantial text overlap with arXiv:2009.02402

MSC Class: 35J60; 35B09; 35J30; 35B40

Power-generation enhancements and upstream flow properties of turbines in unsteady inflow conditions

Authors: Nathaniel J. Wei, John O. Dabiri

Abstract: Energy-harvesting systems in complex flow environments, such as floating offshore wind turbines, tidal turbines, and ground-fixed turbines in axial gusts, encounter unsteady streamwise flow conditions that affect their power generation and structural loads. In some cases, enhancements in time-averaged power generation above the steady-flow operating point are observed. To characterize these dynami… ▽ More Energy-harvesting systems in complex flow environments, such as floating offshore wind turbines, tidal turbines, and ground-fixed turbines in axial gusts, encounter unsteady streamwise flow conditions that affect their power generation and structural loads. In some cases, enhancements in time-averaged power generation above the steady-flow operating point are observed. To characterize these dynamics, a nonlinear dynamical model for the rotation rate and power extraction of a periodically surging turbine is derived and connected to two potential-flow representations of the induction zone upstream of the turbine. The model predictions for the time-averaged power extraction of the turbine and the upstream flow velocity and pressure are compared against data from experiments conducted with a surging-turbine apparatus in an open-circuit wind tunnel at a diameter-based Reynolds number of $Re_D = 6.3\times10^5$ and surge-velocity amplitudes of up to 24% of the wind speed. The combined modeling approach captures trends in both the time-averaged power extraction and the fluctuations in upstream flow quantities, while relying only on data from steady-flow measurements. The sensitivity of the observed increases in time-averaged power to steady-flow turbine characteristics is established, thus clarifying the conditions under which these enhancements are possible. Finally, the influence of unsteady fluid mechanics on time-averaged power extraction is explored analytically. The theoretical framework and experimental validation provide a cohesive modeling approach that can drive the design, control, and optimization of turbines in unsteady flow conditions, as well as inform the development of novel energy-harvesting systems that can leverage unsteady flows for large increases in power-generation capacities. △ Less

Submitted 24 May, 2023; v1 submitted 26 October, 2022; originally announced October 2022.

Comments: 36 pages, 19 figures. Currently under review