NERV: Neural-network Enhanced Reconstruction of the UniVerse with Application to Baryon Acoustic Oscillations in the BOSS DR12 Galaxy Sample
Abstract
We present the first application of neural-network-based baryon acoustic oscillation (BAO) reconstruction to real galaxy survey data, restoring the acoustic signature damped by nonlinear structure growth. NERV (Neural-network Enhanced Reconstruction of the UniVerse) augments standard reconstruction with a convolutional neural network trained on cubic -body simulations, and explicitly accounts for realistic observational effects including the curved-sky geometry, the redshift-dependent selection function, and finite survey boundaries, by tessellating the survey volume into local patches. We validate the method on the MultiDark-Patchy mock catalogs, recovering unbiased BAO dilation parameters. Applied to the BOSS DR12 galaxy sample, NERV improves the precision of the BAO distance measurements significantly. These results establish neural reconstruction as a practical component of BAO analyses for ongoing surveys such as DESI, with the potential to substantially tighten constraints on the cosmic expansion history and the nature of dark energy.
show]hmzhu@nao.cas.cn
I Introduction
The CDM model, in which dark energy is described by a cosmological constant, has been established as the standard model of cosmology through extensive tests with multiple generations of cosmological surveys [26, 3, 4, 5]. Recently, however, the combination of DESI baryon acoustic oscillation (BAO) measurements with other cosmological probes, including the cosmic microwave background (CMB) and Type Ia supernovae, has revealed a preference for dynamical dark energy over a cosmological constant, first reported at the – level with the DR1 data [2, 22] and strengthened to – with DR2 [1, 10], potentially pointing to new physics beyond the standard CDM framework.
In these measurements, the BAO feature serves as a theoretically clean and robust standard ruler for tracing the cosmic expansion history [13, 17]. The feature originates from sound waves propagating in the tightly coupled photon–baryon plasma before recombination, which imprint a characteristic sound horizon at the drag epoch, , on the late-time clustering of matter [37, 43, 16]. Because this scale is calibrated by well-understood linear physics in the early universe and lies far above the scales affected by astrophysical processes, the measured acoustic scale is shifted by nonlinear evolution and galaxy bias only at the sub-percent level [20, 34]. Nonlinear gravitational evolution, however, progressively broadens the acoustic peak. Large-scale bulk flows displace tracers from their initial positions and damp the oscillation amplitude, substantially degrading the attainable statistical precision even though the acoustic scale itself remains essentially unbiased [20, 14]. Restoring the sharpness of the BAO feature is therefore essential for extracting the full cosmological information content of modern galaxy surveys.
Conventionally, this is achieved through a technique known as standard reconstruction [19], which estimates the large-scale displacement field from the observed galaxy density field within the Zel’dovich approximation and moves the tracers backwards, thereby restoring part of the linear BAO information. Since its first application to the SDSS luminous red galaxy sample [35], standard reconstruction has become a routine component of BAO analyses in modern galaxy surveys [4, 7, 5, 2, 1]. To push beyond this linear treatment, a variety of more sophisticated techniques have been proposed, including nonlinear reconstruction [48, 42] and iterative initial-condition reconstruction [39, 23], which aim to recover the displacement or initial density field with higher fidelity. Nevertheless, the performance of these estimators remains limited by the complex nonlinear evolution of the density field and by galaxy bias [32, 33]. Moreover, while standard reconstruction has mature procedures for handling survey boundaries, selection functions, and spatially varying line of sight [9, 44], these advanced methods have so far been validated primarily in idealized simulation volumes, and their application to realistic survey data remains an open challenge.
Machine learning provides an alternative route to capturing the nonlinear information. Convolutional neural networks (CNNs) trained on simulations have been shown to recover the initial density field more accurately than standard reconstruction, learning the nonlinear mapping between the late-time and initial density fields directly from the data [31, 41, 12]. Rather than explicitly estimating and reversing a displacement field, the network exploits higher-order and small-scale information that is inaccessible to estimators built on the Zel’dovich approximation. More recently, hybrid schemes that apply a CNN correction on top of standard reconstruction have demonstrated further gains in the recovery of linear modes and BAO information [36, 6]. To date, however, all of these approaches have been developed and validated in periodic simulation boxes. Applying them to observational data remains challenging owing to the curved-sky geometry, redshift-dependent selection functions, and irregular survey boundaries that have no counterpart in the training simulations. Bridging this gap requires a reconstruction framework that retains the nonlinear information learned by the network while accommodating the geometry and selection effects of realistic galaxy surveys.
In this paper, we present such a framework: NERV (Neural-network Enhanced Reconstruction of the UniVerse), a hybrid approach that couples standard reconstruction with a CNN-based enhancement and handles the curved-sky geometry of real surveys by tessellating the survey volume into local patches. Using controlled numerical experiments, we systematically evaluate the observational effects present in realistic data including the spatially varying line of sight, the redshift-dependent number density, and survey boundaries. We also carefully quantify how mismatches between the training simulations and the target data, in redshift and in galaxy number density, propagate into the reconstructed field. We train the network on mock galaxy catalogs constructed from the AbacusSummit simulations [30] and validate the full pipeline on the MultiDark-Patchy mock catalogs [29], recovering unbiased BAO dilation parameters. Finally, we apply NERV to the BOSS DR12 galaxy sample. To our knowledge, the first application of neural-network-based BAO reconstruction to real galaxy survey data. In the lower-redshift bin, we obtain up to a improvement in the precision of the BAO distance measurements relative to standard reconstruction, while the higher-redshift bin shows no improvement. When extended to ongoing surveys such as DESI, such gains translate into a substantial increase in effective survey volume and will directly sharpen the BAO input to the dark energy constraints discussed above.
This paper is organized as follows. Section II describes the NERV framework. Section III presents controlled tests of the observational effects and training–data mismatches relevant to realistic surveys. In Section IV we present the validation on mock catalogs and the BAO measurements from the BOSS DR12 galaxy sample. Finally, Section V discusses the implications of our results for future surveys.
II Method
In this section, we describe the details of NERV framework. NERV consists of two stages: a conventional standard-reconstruction step, followed by a CNN-based enhancement that takes as input both the original galaxy overdensity field and the standard-reconstruction output, plus a sky tessellation scheme that deals with curved sky geometry. Standard reconstruction reverses the large-scale bulk flows, which are governed by well-understood quasi-linear dynamics but coherent over distances beyond the receptive field of a practical network, while the CNN supplies the spatially local corrections for the residual nonlinear evolution that the linear treatment cannot capture. Similar hybrid strategies have proven effective in periodic simulation volumes [36, 6, e.g.]. NERV extends this design to realistic survey geometry by performing the CNN stage on a tessellation of the survey volume into local patches. In the following, we first introduce the data sets used for training and inference, then describe the two reconstruction stages, and finally outline the power spectrum estimation and the BAO fitting methodology.
II.1 Data Sets
II.1.1 BOSS DR12 Galaxy Catalog
In this work, we use the BOSS Data Release 12 (DR12) galaxy catalog as our observational data set [18, 15, 38]. We additionally use the MultiDark-Patchy mock catalogs to estimate the covariance matrices. Both the BOSS data and the mock catalogs are divided into two redshift bins, , with corresponding effective redshifts and , respectively. We adopt the standard BOSS systematic weights throughout the analysis where is the redshift failure weight, is the fibre collision weight and is systematics weight. A total of mock realizations are used to estimate the covariance matrices of the power-spectrum multipoles for both the pre- and post-reconstruction measurements. Throughout the analysis, we adopt a flat CDM fiducial cosmology with and to convert observed redshifts and angles into comoving Cartesian coordinates. This fiducial model matches the base cosmology of the AbacusSummit simulations used for training, ensuring that no cosmology mismatch is introduced between the training and inference stages.
The galaxy overdensity field is calculated from the galaxy and random catalogs via
| (1) |
where and denote the weighted galaxy and random number-density fields respectively. The normalization factor is defined as
| (2) |
where and are the total weighted numbers of galaxies and random particles.
II.1.2 Training Set
We use an additional set of mock galaxy catalogs constructed from the AbacusSummit simulations [30] to train the neural network. Specifically, we employ the first 24 of 25 base-resolution simulations at . Dark-matter haloes are identified using the CompaSO halo finder [24], and galaxies are subsequently populated with AbacusHOD [47] to approximately reproduce the properties of the observed galaxy sample.
The resulting galaxy catalogs have a mean number density of . Because the two redshift bins of the BOSS DR12 sample have different characteristic number densities, we train a separate network for each bin. For the first redshift bin (), we randomly downsample the training catalogs to , approximately matching the maximum number density of this bin. For the second redshift bin (), we downsample instead to , matching the lower characteristic number density of this higher-redshift bin. Finally, the galaxy distributions are assigned to Cartesian grids using the Triangular-Shaped-Cloud (TSC) mass-assignment scheme, corresponding to a grid spacing of .
II.2 Standard Reconstruction
In the first stage, we employ the public code pyrecon11 1 https://github.com/cosmodesi/pyrecon to implement standard reconstruction, which aims to reverse the large-scale linear displacements of galaxies, , based on the Zel’dovich approximation. The displacement field is obtained by solving
| (3) |
where denotes the linear growth rate, is the unit vector along the line of sight, is the observed galaxy overdensity field, and is the galaxy bias. In simulations with a fixed line of sight, this equation can be solved straightforwardly in Fourier space. However, for realistic survey geometries in the curved sky, where the line of sight varies between the survey volumes, we adopt the IterativeFFT approach [9], which can better handle the varying lines of sight directions. We use a smoothing scale of for standard reconstruction, which is performed on a Cartesian grid with cells in a box of side length . The galaxy bias and linear growth rate entering Equation 3 are set to the values adopted in the BOSS DR12 Fourier-space BAO analysis [7]. After solving for the displacement field, we follow the RecSym convention [11, see, e.g.,] where both galaxies and randoms are shifted by the full redshift-space displacement, including the line-of-sight component, so that large-scale redshift-space distortions are retained in the reconstructed field.
II.3 CNN Enhancement
In the second stage, a convolutional neural network refines the standard-reconstruction output. The network takes as input both the observed galaxy overdensity field and the post-reconstruction field , and is trained to predict the linear density field from their combination. Because the network is trained on periodic cubic boxes drawn from the AbacusSummit simulations (Section II.1) with a fixed line of sight, it cannot be applied to a wide-field survey directly. NERV therefore tessellates the survey volume into a set of local patches, within each of which a fixed line of sight is a good approximation, and applies the same trained network independently to every patch. In the following, we describe the network architecture and training procedure, followed by the curved-sky tessellation used at inference.
II.3.1 Network Architecture and Training
We adopt the same neural network architecture used by Parker et al. [36], which is illustrated in Figure 2 . The network consists of nine consecutive convolutional blocks, each containing two convolutional layers followed by ReLU activations. The input is a cubic subgrid of size with two channels, corresponding to the galaxy overdensity field and the standard-reconstructed field . As the input propagates through the convolutional blocks, the spatial extent is progressively reduced, resulting in an output field of size .
To train the network, we adopt the weighted Fourier-space loss function introduced by Parker et al. [36]:
| (4) |
where denotes the neural network and is the target linear density field. The weighting function upweights modes in the range by a factor of 10 and is set to unity otherwise. This weighting enhances the relative contribution of the modes that carry the BAO signature and the quasi-linear information targeted by the enhancement, following Eqs. (2.8) and (2.9) of Parker et al. [36].
II.3.2 Curved-Sky Tessellation
To apply the trained CNN to curved-sky survey data, we construct a set of local Cartesian grids covering small angular regions on the sky. We first tessellate the survey footprint using the HEALPix scheme with NSIDE=422 2 We have verified that using NSIDE=3 or NSIDE=5 leads to nearly identical power-spectrum monopoles and quadrupoles, indicating that the results are insensitive to this choice., corresponding to 192 pixels with a characteristic angular scale of approximately . Each HEALPix pixel defines the center of a local patch. To reduce boundary effects in the CNN inference, we include galaxies and randoms within of the patch center, such that the actual CNN input region extends beyond the corresponding HEALPix pixel. A more detailed discussion of the boundary treatment is presented in Section III.1.3. For each local patch, the galaxy and random catalogs are mapped onto a Cartesian grid with a side length of . The box size is chosen to fully contain the objects in each local patch, while the resulting grid spacing exactly matches that of the training grids. Within each patch, the trained network is applied to overlapping subgrids tiled across the grid, and the overlapping outputs are averaged to form the reconstructed density field of the patch.
II.4 Power Spectrum Estimator
We estimate the power-spectrum multipoles using the Yamamoto estimator [46], following the FFT-based implementations of Bianchi et al. [8] and Scoccimarro [40]. This estimator accounts for the spatially varying line of sight in a wide-angle galaxy survey and is implemented using the public code pypower33 3 https://github.com/cosmodesi/pypower.
For the standard reconstruction, the power spectrum is estimated directly from the galaxy and random catalogs. The NERV, however, produces a continuous density field on a set of local Cartesian grids rather than a discrete galaxy catalog. To estimate its power spectrum, we interpret each grid cell as an effective particle whose weight is given by the reconstructed overdensity in that cell. In the overlap regions between adjacent patches, each grid cell is taken exclusively from the patch whose HEALPix pixel contains it, so the extended patch boundaries serve only as input padding for the network and no volume is double counted. The effective particles from all local patches are then combined and deposited onto a common full-survey Cartesian grid using the Nearest-Grid-Point (NGP) mass-assignment scheme, after which the power-spectrum multipoles are measured with the same Yamamoto estimator.
This procedure leaves the overall normalization of the reconstructed power spectrum arbitrary. The normalization has no impact on the BAO measurement since it is absorbed by the amplitude parameters of the template and by the broadband terms marginalized over in the fitting process, leaving the inferred acoustic scale unaffected.
Following the convention adopted in the BOSS DR12 Fourier-space BAO analysis [7], we measure the power-spectrum multipoles in linearly spaced bins of width over , yielding 29 bins per multipole. We additionally apply the FKP weight [21] to each grid cell according to the local redshift-dependent number density,
| (5) |
where .
II.5 Fitting the BAO signal
In Fourier space, the BAO signal manifests as a series of oscillations in the power spectrum with a period of in wavenumber, where denotes the sound horizon at the baryon-drag epoch. Modeling these oscillations enables measurements of the combinations in the transverse direction and along the line of sight, where is the angular diameter distance and is the Hubble parameter at redshift . In modern galaxy surveys, power spectrum multipoles are typically computed assuming a fiducial cosmology and subsequently fitted with a BAO template to extract two dilation parameters,
| (6) |
where the superscript “fid” denotes quantities evaluated in the fiducial cosmology. The uncertainties on and therefore quantify the constraining power of the BAO measurement along the line-of-sight and transverse directions, respectively.
Note that the fiducial cosmology used throughout this work, for training, inference, and the redshift-to-distance conversion, is that of the AbacusSummit simulations, whereas the MultiDark-Patchy mocks were generated with a slightly different cosmology. The expected dilation parameters for the mocks therefore deviate from unity: and at , and and at .
In this work, we follow the template by Chen and others [11], as implemented in the public desilike package44 4 https://github.com/cosmodesi/desilike. Within this model, the galaxy power spectrum is given by
| (7) |
where and denote the linear wiggle and no-wiggle power spectra in the fiducial cosmology. The second term isolates the BAO signal, while the remaining terms account for the broadband contribution. In particular, captures the smooth, non-oscillatory component of the linear power spectrum, and absorbs residual contributions arising from nonlinear evolution and higher-order effects that are not fully described by the first two terms. Specifically, we have
| (8) |
| (9) |
where is the linear Kaiser factor. The second factor in models Finger-of-God (FoG) damping along the line of sight, with treated as a free velocity-dispersion parameter. The parameters and describe the BAO damping scales parallel and perpendicular to the line of sight, respectively, and are varied in the fit. The residual term is modeled using a cubic spline basis,
| (10) |
where is the piecewise cubic spline extension of the counts-in-cell interpolation kernel [27, 28], and the coefficients are marginalized over. The node spacing sets the smoothness of the broadband component, and is the number of nodes required to span the fitted range.
Finally, we combine the BAO template with the covariance matrix estimated from the MultiDark-Patchy mock catalogs to constrain the dilation parameters and . Parameter inference is performed assuming a Gaussian likelihood, , with
| (11) |
where the indices and run over the elements of the power-spectrum data vector. The prefactor is the Hartlap correction [25], which accounts for the bias in the inverse sample covariance arising from the finite number of mock realizations. In our analysis, we use mocks and a data-vector length of .
Before evaluating the likelihood, the theoretical power-spectrum model is convolved with the survey window function to account for mode coupling induced by the survey geometry, following Wilson et al. [45] and Beutler and others [7].
III Robustness Tests
NERV is trained under idealized conditions: periodic boxes, a fixed line of sight, and a uniform galaxy sample. A real survey is different in every one of these respects. The line of sight varies across the sky, the galaxy number density changes with redshift, and the survey volume ends at boundaries. In addition, the training simulations may differ from the observed sample, for example in redshift and in number density.
Before applying NERV to the BOSS DR12 data, we test the impact of each of these differences using controlled numerical experiments, in which the effects can be switched on one at a time. Section III.1 covers the observational effects, and Section III.2 covers the training–data mismatches. In all cases we find that NERV remains robust.
III.1 Observational Effects
Each of the three observational effects changes the density field that the network receives as input, and may bias the reconstruction if left untreated. Our tests start from the fiducial simulation AbacusSummit_base_c000_ph024, which we divide into eight subboxes with a side length of each. Each test uses one or more of these subboxes, so that a single effect can be isolated and examined before the method is applied to the BOSS DR12 data.
III.1.1 Effect of the Varying Line of Sight
In cubic simulations, the line of sight is usually fixed under the plane-parallel approximation. Combined with periodic boundary conditions, this preserves translational invariance, so the same neural network can be applied to different subvolumes by sliding a subgrid window across the simulation.
In real surveys, the line of sight varies across the sky because it is defined by the position of each galaxy relative to the observer. This breaks the exact translational invariance assumed in cubic simulations. However, within sufficiently small angular patches, this variation is limited, allowing NERV to be applied locally with an approximately fixed line of sight. The relevant question is therefore how small the local patches need to be for the plane-parallel approximation to remain accurate, and whether the residual line-of-sight variation within each local patch induces a significant bias in the reconstructed density field.
Figure 3 shows the fractional differences between density fields constructed with a fixed line of sight along the -axis and with the local line of sight of each galaxy. The observer is placed at , so that the subbox covers a distance range similar to that of the first redshift bin. We compare three stages: the input density field, the field after standard reconstruction, and the field after NERV. As expected, the difference is smallest near the central line of sight and grows toward the edges, where the local direction deviates more from the -axis. Within one NSIDE=4 HEALPix pixel, the difference remains modest at all three stages. The fixed-line-of-sight approximation is therefore accurate enough for the patches used in NERV.
III.1.2 Redshift-Dependent Number Density
In a single snapshot of a cubic simulation, the galaxy number density is usually fixed, so the statistical properties of the galaxy distribution are homogeneous along the line of sight. This is not the case for realistic galaxy surveys, where the observed number density varies with redshift and may also differ across sky regions due to observation artifacts. It is therefore important to test whether NERV remains robust in the presence of such effects.
In Figure 4, we compare the impact of fixed and redshift-dependent number densities on the reconstructed power spectrum. The blue curve in the left panel shows the number-density distribution of the BOSS DR12 galaxy catalog. We use this distribution within to randomly downsample galaxies in each subbox, with the -axis as the line of sight. For comparison, we also generate a control sample with a fixed number density of (orange curve). In both cases, each galaxy is assigned a weight , following the weighting convention used in the real-data analysis.
The right panel of Figure 4 shows the power spectra after standard reconstruction and after NERV, with and without the redshift-dependent selection. Although the imposed number density varies by nearly a factor of two over the redshift range, the power spectra change only at the level. The change is similar for standard reconstruction and for NERV, so the CNN stage does not amplify the selection effect. The change is also smooth in , and a smooth change of this size is absorbed by the broadband marginalization in the BAO fit. We conclude that NERV is robust to realistic redshift-dependent number-density variations.
III.1.3 Survey Boundary Effects
Survey boundaries are the third observational effect. In previous applications to cubic simulations, the reconstruction was performed with periodic boundary conditions, so each subgrid window contains a complete density-field input. In realistic surveys, however, boundaries are unavoidable due to the finite footprint and redshift coverage. When a reconstruction window approaches these boundaries, part of the input density field may lie outside the observed region, potentially biasing the CNN output. It is therefore necessary to quantify the impact of survey boundaries on the reconstructed density field.
In Figure 5, we show the fractional reconstruction error in a local region affected by survey boundaries. The local region has a volume of and is truncated from a subbox. To mimic the unobserved region in a realistic survey, the density field outside this local region is set to zero before applying NERV. We then compare the reconstructed field obtained from this truncated region with that obtained from the full subbox.
As shown in Figure 5, the survey boundary does affect the reconstruction, but the induced error is localized near the boundary, mostly within . For a more quantitative comparison, Figure 6 shows the fractional error as a function of the distance from the boundary. With the current configuration, the boundary-induced error drops below the percent level at a distance of , and becomes consistent with numerical precision at .
To mitigate these effects, we introduce an additional masking step that discards less reliable regions near the survey boundaries. For each grid cell , we define an effective volume fraction by centering the CNN subgrid window on that cell and computing the fraction of valid grid cells within the window:
| (12) |
Here is the total number of grid cells in the subgrid window, which is in this work, and is the number of valid grid cells within the window. A cell is considered valid if it lies inside the survey volume, i.e., if it contains at least one galaxy or random particle.
We then apply a threshold to define the effective reconstruction region. Grid cells with are discarded from power spectrum estimation. Figure 5 shows the boundaries of the effective regions for thresholds (red), (blue), and (green). The choice removes the boundary-dominated grid cells while retaining more of the usable volume than the stricter thresholds. We therefore adopt throughout this work.
III.2 Effects of Model Discrepancies
Simulation-to-data discrepancies can arise in several respects: redshift, galaxy number density, cosmological parameters, galaxy bias, and the galaxy–halo connection. Some of these have already been tested elsewhere: Bayer et al. [6] found hybrid reconstruction robust to an incorrect cosmological model and AP rescaling, and Parker et al. [36] found that a model trained on halo catalogs performs worse when applied to galaxy catalogs. Here we test the two remaining sources of discrepancy that can be examined directly in our setup: redshift and galaxy number density.
III.2.1 Redshift Mismatch
Figure 7 shows the cross-correlation coefficient between the reconstructed field and the initial conditions, for networks trained at different redshifts and applied to a fixed target redshift. Models trained at different redshifts perform similarly, so the reconstruction is insensitive to the redshift of the training set. This supports our choice of training the network at a single fixed redshift and applying it to galaxy samples spanning a finite redshift range.
III.2.2 Galaxy Number-Density Mismatch
Figure 7 compares the cross-correlation coefficient of reconstructed fields from galaxy catalogs with different number densities, using networks trained on catalogs with different number densities. On the high-number-density catalog, the model trained at high number density clearly outperforms the model trained at low number density. On the low-number-density catalog, the two models perform comparably. We thus note that a model trained at high number density can therefore be applied to lower-density data, while the reverse is less effective.
A likely explanation is that training at high number density lets the network learn more of the small-scale nonlinear structure, which remains useful when applied to sparser data, while a network trained at low number density has less access to this information and struggles to recover it on a denser catalog. The degeneracy on the low-number-density catalog likely reflects a combination of effects including shot noise limits the available small-scale information, and standard reconstruction itself becomes less effective at low number density, propagating degraded input to the CNN. Because these effects are coupled, our controlled experiments cannot cleanly separate their individual contributions, and a detailed discussion is beyond the scope of this work.
IV Results
In this section, we first evaluate the performance of the NERV using mock catalogs in Section IV.1. We then present the reconstruction results for curved-sky mocks and the corresponding BAO fitting results in Section IV.2.
IV.1 Validation in the Mocks
Figure 8 shows the reconstructed power spectrum multipoles measured from the mock catalogs. The NERV preserves the overall shape of the power spectrums. The quadrupole approaches zero on small scales after NERV, as expected from the isotropic initial density field used as the training target. A small residual quadrupole remains, which may partially arise from the redshift mismatch between the training sample at and the target samples at and .
Table 1 presents the BAO fitting results obtained from the mean power spectra of 500 mock realizations. In the first redshift bin, NERV improves the precision of and by and , respectively, relative to standard reconstruction, while in the second redshift bin the two methods yield statistically indistinguishable precision. In both bins, the recovered dilation parameters remain consistent with the expected values for the MultiDark-Patchy cosmology, confirming that NERV introduces no bias in the reconstructed BAO signal. The calibration of the reported uncertainties is verified by a coverage test on the individual mock realizations in Appendix A.
| Post-StdRec | NERV | Post-StdRec | NERV | |
|---|---|---|---|---|
IV.2 BAO fitting result for BOSS DR12
| Post-StdRec | NERV | Post-StdRec | NERV | |
|---|---|---|---|---|
Figure 9 and Table 2 present a comparison of the BAO dilation-parameter constraints obtained with standard reconstruction and NERV for the BOSS DR12 galaxy sample. In the first redshift bin, standard reconstruction yields and , while NERV gives and , improving the precision of and by and , respectively. The magnitude of this improvement is generally consistent with that found in previous studies of CNN-based reconstruction [36]. These results indicate that the additional information recovered by the CNN can translate into tighter constraints on the BAO dilation parameters in observational data, though the size of this gain depends on the number density of the sample.
In the second redshift bin, standard reconstruction yields and , while NERV gives and ; here NERV yields no improvement, and its uncertainties are in fact larger than those of standard reconstruction. The absence of improvement in the second bin is also seen in the mock validation.
We attribute the lack of improvement in the second redshift bin to two related factors. First, this bin has a lower number density and thus higher shot noise, which limits the small-scale nonlinear information available to the network. Second, the network for this bin is trained on catalogs downsampled to to match the mean number density of the galaxy sample, whereas parts of the BOSS DR12 sample’s number density in this bin is higher. As shown in Section III.2.2, a network trained at low number density has limited access to small-scale information and does not fully exploit denser input, so this mismatch further limits the achievable gain. We leave improving the reconstruction performance in this redshift bin to future work.
V Discussion
The key result of this work is that the NERV improves BAO constraints in a real survey. When applied to the BOSS DR12 galaxy sample, the method improves the precision of the BAO distance measurements by up to in the lower-redshift bin, while the higher-redshift bin shows no improvement relative to standard reconstruction. This gain suggests that NERV recovers additional nonlinear information that is not fully captured by the traditional method.
Previous machine-learning-based reconstruction methods, [31, 41, 12, 36, 6], have been developed and validated exclusively in periodic simulation boxes. The results presented here show that the same method can be deployed on an irregularly shaped, curved-sky galaxy survey with a redshift-dependent selection function, provided the geometric and observational effects are handled explicitly, as demonstrated in Section III. This tessellation-and-masking approach is independent of the specific network architecture and could equally be applied to the methods above, offering a practical route for the broader machine-learning-reconstruction community to move from simulations to real survey data.
While NERV yields a clear improvement in the first redshift bin, the lack of improvement at higher redshift highlights a limitation in the current model’s ability to generalize beyond its training distribution. At the number density of the sample is nearly constant, so the data lie within the regime covered by the training set and the network performs as intended. At higher redshift, however, the reconstruction performance degrades, suggesting that the data depart from the regime on which the model was trained. Given the nonlinear nature of the network, it is difficult to isolate the dominant source of this mismatch, although the mismatch between the number-density distribution in the training set and that of the observed sample is a likely contributor. Addressing this limitation will require training samples that more closely reproduce the distribution of the observed data, together with controlled tests designed to identify which aspects of the mismatch are primarily responsible for the degradation.
We note that the best-fit values obtained after NERV are somewhat larger than those from standard reconstruction in both redshift bins, consistent with the same pattern seen in the mock validation. A possible explanation is that in the present analysis, we directly adopt the same power-spectrum template used for the standard reconstruction without re-calibration. This increase in therefore likely reflects a modest modeling mismatch rather than a degradation in the BAO information. A detailed template design based on mocks may further improve the fit and provide a more accurate description of the reconstructed power spectrum.
Finally, the number densities of DESI luminous red galaxies and emission-line galaxies are generally higher and more uniform across redshift than those of BOSS DR12, including over the redshift range corresponding to our higher-redshift bin. We therefore expect NERV-like reconstruction to provide a robust improvement in BAO precision across the DESI redshift range as reported by Bayer et al. [6]. Extending this approach to DESI and future spectroscopic surveys could further sharpen cosmological distance measurements and improve sensitivity to fundamental physics, including the nature and evolution of dark energy.
Appendix A Coverage test
Since an apparent reduction in parameter uncertainties is only meaningful if correctly calibrated, as emphasized in previous validation studies [6], we perform a coverage test using 500 MultiDark-Patchy mock realizations fitted individually. For each nominal confidence level, we compute the empirical coverage as the fraction of realizations whose credible interval contains the expected value of the corresponding dilation parameter. Figure 10 shows the result. Overall, the empirical coverage follows the nominal confidence level well for both methods. In the low-redshift bin, the constraints are well calibrated, although the NERV uncertainty is slightly conservative. Given the finite number of mock realizations, the statistical significance of these small deviations remains to be quantified.
References
- [1] (2025) DESI DR2 results. II. Measurements of baryon acoustic oscillations and cosmological constraints. Phys. Rev. D 112 (8), pp. 083515. External Links: 2503.14738, Document Cited by: §I, §I.
- [2] (2025) DESI 2024 VI: cosmological constraints from the measurements of baryon acoustic oscillations. JCAP 02, pp. 021. External Links: 2404.03002, Document Cited by: §I, §I.
- [3] (2020) Planck 2018 results. VI. Cosmological parameters. Astron. Astrophys. 641, pp. A6. Note: [Erratum: Astron.Astrophys. 652, C4 (2021)] External Links: 1807.06209, Document Cited by: §I.
- [4] (2017) The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample. Mon. Not. Roy. Astron. Soc. 470 (3), pp. 2617–2652. External Links: 1607.03155, Document Cited by: §I, §I.
- [5] (2021) Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological implications from two decades of spectroscopic surveys at the Apache Point Observatory. Phys. Rev. D 103 (8), pp. 083533. External Links: 2007.08991, Document Cited by: §I, §I.
- [6] (2026) Field-Level Inference from Galaxies: BAO Reconstruction. External Links: 2603.15732 Cited by: Appendix A, §I, §II, §III.2, §V, §V.
- [7] (2017) The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: baryon acoustic oscillations in the Fourier space. Mon. Not. Roy. Astron. Soc. 464 (3), pp. 3409–3430. External Links: 1607.03149, Document Cited by: §I, §II.2, §II.4, §II.5.
- [8] (2015) Measuring line-of-sight dependent Fourier-space clustering using FFTs. Mon. Not. Roy. Astron. Soc. 453 (1), pp. L11–L15. External Links: 1505.05341, Document Cited by: §II.4.
- [9] (2015) Reconstruction in Fourier space. Mon. Not. Roy. Astron. Soc. 453 (1), pp. 456–468. External Links: 1504.02591, Document Cited by: §I, §II.2.
- [10] (2025) Evidence for evolving dark energy from DESI DR2 BAO and Pantheon, DES-Dovekie, and Union3. External Links: 2508.10514 Cited by: §I.
- [11] (2024) Baryon acoustic oscillation theory and modelling systematics for the DESI 2024 results. Mon. Not. Roy. Astron. Soc. 534 (1), pp. 544–574. External Links: 2402.14070, Document Cited by: §II.2, §II.5.
- [12] (2023) Effective cosmic density field reconstruction with convolutional neural network. Mon. Not. Roy. Astron. Soc. 523 (4), pp. 6272–6281. External Links: 2306.10538, Document Cited by: §I, §V.
- [13] (2005) The 2dF Galaxy Redshift Survey: Power-spectrum analysis of the final dataset and cosmological implications. Mon. Not. Roy. Astron. Soc. 362, pp. 505–534. External Links: astro-ph/0501174, Document Cited by: §I.
- [14] (2008) Nonlinear Evolution of Baryon Acoustic Oscillations. Phys. Rev. D 77, pp. 023533. External Links: 0704.2783, Document Cited by: §I.
- [15] (2013) The Baryon Oscillation Spectroscopic Survey of SDSS-III. Astron. J. 145, pp. 10. External Links: 1208.0022, Document Cited by: §II.1.1.
- [16] (1998) Baryonic features in the matter transfer function. Astrophys. J. 496, pp. 605. External Links: astro-ph/9709112, Document Cited by: §I.
- [17] (2005) Detection of the Baryon Acoustic Peak in the Large-Scale Correlation Function of SDSS Luminous Red Galaxies. Astrophys. J. 633, pp. 560–574. External Links: astro-ph/0501171, Document Cited by: §I.
- [18] (2011) SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems. Astron. J. 142, pp. 72. External Links: 1101.1529, Document Cited by: §II.1.1.
- [19] (2007) Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak. Astrophys. J. 664, pp. 675–679. External Links: astro-ph/0604362, Document Cited by: §I.
- [20] (2007) On the Robustness of the Acoustic Scale in the Low-Redshift Clustering of Matter. Astrophys. J. 664, pp. 660–674. External Links: astro-ph/0604361, Document Cited by: §I.
- [21] (1994) Power spectrum analysis of three-dimensional redshift surveys. Astrophys. J. 426, pp. 23–37. External Links: astro-ph/9304022, Document Cited by: §II.4.
- [22] (2025) Dynamical dark energy beyond Planck? Constraints from multiple CMB probes, DESI BAO, and type-Ia supernovae. Phys. Rev. D 112 (2), pp. 023508. External Links: 2409.17074, Document Cited by: §I.
- [23] (2018) An iterative reconstruction of cosmological initial density fields. Mon. Not. Roy. Astron. Soc. 478 (2), pp. 1866–1874. External Links: 1804.04738, Document Cited by: §I.
- [24] (2021) compaso: A new halo finder for competitive assignment to spherical overdensities. Mon. Not. Roy. Astron. Soc. 509 (1), pp. 501–521. External Links: 2110.11408, Document Cited by: §II.1.2.
- [25] (2007) Why your model parameter confidences might be too optimistic: Unbiased estimation of the inverse covariance matrix. Astron. Astrophys. 464, pp. 399. External Links: astro-ph/0608064, Document Cited by: §II.5.
- [26] (2013) Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results. Astrophys. J. Suppl. 208, pp. 19. External Links: 1212.5226, Document Cited by: §I.
- [27] (1988) Computer simulation using particles. Cited by: §II.5.
- [28] (2010) Cosmology with high (z¿1) redshift galaxy surveys. Ph.D. Thesis, University of Texas, Austin. Cited by: §II.5.
- [29] (2016) The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release. Mon. Not. Roy. Astron. Soc. 456 (4), pp. 4156–4173. External Links: 1509.06400, Document Cited by: §I.
- [30] (2021) AbacusSummit: a massive set of high-accuracy, high-resolution N-body simulations. Mon. Not. Roy. Astron. Soc. 508 (3), pp. 4017–4037. External Links: 2110.11398, Document Cited by: §I, §II.1.2.
- [31] (2021) Baryon acoustic oscillations reconstruction using convolutional neural networks. Mon. Not. Roy. Astron. Soc. 501 (1), pp. 1499–1510. External Links: 2002.10218, Document Cited by: §I, §V.
- [32] (2021) Modeling iterative reconstruction and displacement field in the large scale structure. Phys. Rev. D 104 (12), pp. 123508. External Links: 2106.00146, Document Cited by: §I.
- [33] (2023) Lagrangian displacement field estimators in cosmology. Phys. Rev. D 107 (12), pp. 123523. External Links: 2211.07960, Document Cited by: §I.
- [34] (2009) Calibrating the Baryon Oscillation Ruler for Matter and Halos. Phys. Rev. D 80, pp. 063508. External Links: 0906.1198, Document Cited by: §I.
- [35] (2012) A 2 per cent distance to =0.35 by reconstructing baryon acoustic oscillations - I. Methods and application to the Sloan Digital Sky Survey. Mon. Not. Roy. Astron. Soc. 427 (3), pp. 2132–2145. External Links: 1202.0090, Document Cited by: §I.
- [36] (2025) Initial conditions from galaxies: machine-learning subgrid correction to standard reconstruction. J. Cosmology Astropart. Phys 2025 (9), pp. 039. External Links: Document, 2504.01092 Cited by: §I, §II.3.1, §II.3.1, §II.3.1, §II, §III.2, §IV.2, §V.
- [37] (1970) Primeval adiabatic perturbation in an expanding universe. Astrophys. J. 162, pp. 815–836. External Links: Document Cited by: §I.
- [38] (2016) SDSS-III Baryon Oscillation Spectroscopic Survey Data Release 12: galaxy target selection and large scale structure catalogues. Mon. Not. Roy. Astron. Soc. 455 (2), pp. 1553–1573. External Links: 1509.06529, Document Cited by: §II.1.1.
- [39] (2017) Iterative initial condition reconstruction. Phys. Rev. D 96 (2), pp. 023505. External Links: 1704.06634, Document Cited by: §I.
- [40] (2015) Fast Estimators for Redshift-Space Clustering. Phys. Rev. D 92 (8), pp. 083532. External Links: 1506.02729, Document Cited by: §II.4.
- [41] (2023) Reconstructing cosmological initial conditions from late-time structure with convolutional neural networks. Mon. Not. Roy. Astron. Soc. 520 (4), pp. 6256–6267. External Links: 2207.12511, Document Cited by: §I, §V.
- [42] (2018) New method for initial density reconstruction. Phys. Rev. D 97 (2), pp. 023505. External Links: 1709.06350, Document Cited by: §I.
- [43] (1970) Small-scale fluctuations of relic radiation. Astrophys. Space Sci. 7 (1), pp. 3–19. External Links: Document Cited by: §I.
- [44] (2018) The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: theoretical systematics and Baryon Acoustic Oscillations in the galaxy correlation function. Mon. Not. Roy. Astron. Soc. 477 (1), pp. 1153–1188. External Links: 1610.03506, Document Cited by: §I.
- [45] (2017) Rapid modelling of the redshift-space power spectrum multipoles for a masked density field. MNRAS 464 (3), pp. 3121–3130. External Links: Document, 1511.07799 Cited by: §II.5.
- [46] (2006) A Measurement of the quadrupole power spectrum in the clustering of the 2dF QSO Survey. Publ. Astron. Soc. Jap. 58, pp. 93–102. External Links: astro-ph/0505115, Document Cited by: §II.4.
- [47] (2022) AbacusHOD: a highly efficient extended multitracer HOD framework and its application to BOSS and eBOSS data. Mon. Not. Roy. Astron. Soc. 510 (3), pp. 3301–3320. External Links: 2110.11412, Document Cited by: §II.1.2.
- [48] (2017) Nonlinear reconstruction. Phys. Rev. D 96 (12), pp. 123502. External Links: 1611.09638, Document Cited by: §I.