Shortwave downward radiation (SWDR) plays a major role in the material and energy balance of the Earth’s climate system. However, most of the existing SWDR research and products assume that the surface is flat, ignoring the effect of topography. This approach introduces significant uncertainties in the calculated fluxes and smooths the spatial distribution of SWDR. This article proposes a uniform shortwave topographic radiation model (USWTRM) based on the principle of energy conservation. To evaluate the USWTRM, we compared it with the large-scale remote sensing data and image simulation framework (LESS). The USWTRM performed better than the traditional method in most conditions. For clear sky, when the SZA = 0°, the relative root-mean-square error (rRMSE), relative bias (rbias), and of the USWTRM at 1 km were 0.1%, 0.0%, and 1.000, respectively. At SZAs of 20°, 40°, and 60°, the USWTRM also showed better results than the traditional method. Moreover, the USWTRM performed similarly at 3 and 5 km as that of 1 km. For cloudy sky, the rRMSE and rbias of the USWTRM at fine scale were 3.5% and 0.0%, respectively. At 1 km, the rRMSE and rbias of the USWTRM were 0.9% and 0.5%, respectively. In particular, the USWTRM outperformed previous studies in accurately quantifying the SWDR over rugged areas, under both clear and cloudy skies. Overall, the analysis reveals that the USWTRM works well over mountainous regions in terms of reliable accuracy, applicability, and generalization. It provides a new perspective for accurately deriving topographic SWDR at various scales and significantly reduces radiation uncertainties over rugged terrain.